2024-06-10T00:04:22.820 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-10T00:04:22.820 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} --verbose --name teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/orig.config.yaml 2024-06-10T00:04:22.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-10T00:04:22.953 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7747319' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 7b7a5d375cf4e4afab96b9d4d229b699ae8304bb owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 178 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 130/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_7b7a5d375cf4e4afab96b9d4d229b699ae8304bb/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7b7a5d375cf4e4afab96b9d4d229b699ae8304bb syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPvuCNWdoENhrqb0F6kTHABPqsn/ZIrGy7O6efjQpyC7+NPS5TwVM4H2RC1cd8P6sMBSLCBbACOluNutZDOUXws= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPicW5CkW2R6uSX8PpAMIk40RWHBvFKUTpWdI2U5u/SuzzHx+HzBkkEgnhYGUqkzJclI2p0828WGLICbsKVMlF0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-09_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-10T00:04:22.953 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7b7a5d375cf4e4afab96b9d4d229b699ae8304bb/qa; will attempt to use it 2024-06-10T00:04:22.954 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7b7a5d375cf4e4afab96b9d4d229b699ae8304bb/qa/tasks 2024-06-10T00:04:22.954 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-10T00:04:22.959 INFO:teuthology.task.internal:Checking packages... 2024-06-10T00:04:22.979 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-10T00:04:22.980 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-10T00:04:22.980 INFO:teuthology.packaging:ref: None 2024-06-10T00:04:22.980 INFO:teuthology.packaging:tag: None 2024-06-10T00:04:22.980 INFO:teuthology.packaging:branch: squid 2024-06-10T00:04:22.980 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-10T00:04:22.980 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-10T00:04:23.223 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2970.g7b7a5d37 2024-06-10T00:04:23.225 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-10T00:04:23.244 INFO:teuthology.task.internal:no buildpackages task found 2024-06-10T00:04:23.244 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-10T00:04:23.251 INFO:teuthology.task.internal:Saving configuration 2024-06-10T00:04:23.267 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-10T00:04:23.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-10T00:04:23.302 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-09 23:59:23.338955', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPvuCNWdoENhrqb0F6kTHABPqsn/ZIrGy7O6efjQpyC7+NPS5TwVM4H2RC1cd8P6sMBSLCBbACOluNutZDOUXws='} 2024-06-10T00:04:23.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-09 23:59:23.337042', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPicW5CkW2R6uSX8PpAMIk40RWHBvFKUTpWdI2U5u/SuzzHx+HzBkkEgnhYGUqkzJclI2p0828WGLICbsKVMlF0='} 2024-06-10T00:04:23.324 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-10T00:04:23.337 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-06-10T00:04:23.337 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-06-10T00:04:23.337 INFO:teuthology.run_tasks:Running task console_log... 2024-06-10T00:04:23.439 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faea2227be0>, signals=[15]) 2024-06-10T00:04:23.439 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-10T00:04:23.494 INFO:teuthology.task.internal:Opening connections... 2024-06-10T00:04:23.494 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:04:23.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:04:23.575 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:04:23.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:04:23.650 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-10T00:04:23.670 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-06-10T00:04:23.687 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-06-10T00:04:23.688 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-06-10T00:04:23.744 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-06-10T00:04:23.744 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-06-10T00:04:23.744 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-10T00:04:23.745 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-10T00:04:23.746 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-06-10T00:04:23.768 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-06-10T00:04:23.785 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-06-10T00:04:23.786 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-06-10T00:04:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-06-10T00:04:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-06-10T00:04:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-06-10T00:04:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-06-10T00:04:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-06-10T00:04:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-06-10T00:04:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-10T00:04:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-06-10T00:04:23.844 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-06-10T00:04:23.844 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-10T00:04:23.844 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-06-10T00:04:23.844 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-10T00:04:23.844 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-10T00:04:23.844 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-10T00:04:23.844 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-06-10T00:04:23.867 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-10T00:04:23.886 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-10T00:04:23.898 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-10T00:04:23.899 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-06-10T00:04:23.901 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-06-10T00:04:23.918 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-10T00:04:24.132 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-10T00:04:24.132 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-06-10T00:04:24.135 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-06-10T00:04:24.229 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-10T00:04:24.315 INFO:teuthology.run_tasks:Running task kernel... 2024-06-10T00:04:24.355 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-10T00:04:24.355 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-10T00:04:24.355 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-10T00:04:24.356 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-10T00:04:24.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:04:24.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:04:24.373 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-06-10T00:04:24.373 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-06-10T00:04:24.430 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-437.el9.x86_64 2024-06-10T00:04:24.431 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.14.0-437.el9.x86_64 2024-06-10T00:04:24.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2024-06-10T00:04:24.432 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-437.el9.x86_64 2024-06-10T00:04:24.432 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.14.0-437.el9.x86_64 2024-06-10T00:04:24.432 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-06-10T00:04:28.045 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.1 MB 00:02 2024-06-10T00:04:30.279 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-06-10T00:04:30.896 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.1 MB 00:04 2024-06-10T00:04:32.929 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-06-10T00:04:34.438 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-06-10T00:04:36.995 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 17 kB 00:01 2024-06-10T00:04:37.362 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.2 MB 00:00 2024-06-10T00:04:37.965 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 26 MB/s | 21 MB 00:00 2024-06-10T00:04:39.245 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 17 kB 00:00 2024-06-10T00:04:40.248 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-06-10T00:04:43.220 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-06-10T00:04:45.210 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-10T00:04:45.210 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-10T00:04:45.309 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-06-10T00:04:45.315 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-06-10T00:04:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:04:45.317 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 80 M 2024-06-10T00:04:45.317 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 124 M 2024-06-10T00:04:45.317 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-06-10T00:04:45.361 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-06-10T00:04:45.522 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:04:45.527 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:04:45.527 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:04:45.730 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 3.0 MB/s | 893 kB 00:00 2024-06-10T00:04:47.334 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-10T00:04:47.334 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-10T00:04:47.437 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-06-10T00:04:47.447 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-06-10T00:04:47.447 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-06-10T00:04:47.447 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-06-10T00:04:47.447 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-06-10T00:04:47.447 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-10T00:04:47.447 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-06-10T00:04:47.447 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-10T00:04:47.448 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-10T00:04:47.448 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-10T00:04:47.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:04:47.448 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-06-10T00:04:47.448 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-06-10T00:04:47.448 INFO:teuthology.orchestra.run.smithi079.stdout:Install 4 Packages 2024-06-10T00:04:47.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:04:47.449 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 80 M 2024-06-10T00:04:47.449 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 124 M 2024-06-10T00:04:47.449 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-06-10T00:04:47.566 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:04:47.566 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:04:47.570 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:04:47.804 INFO:teuthology.orchestra.run.smithi079.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 2.7 MB/s | 893 kB 00:00 2024-06-10T00:04:50.246 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-06-10T00:04:51.021 INFO:teuthology.orchestra.run.smithi079.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 4.5 MB/s | 16 MB 00:03 2024-06-10T00:04:51.596 INFO:teuthology.orchestra.run.smithi079.stdout:(3/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 8.4 MB/s | 35 MB 00:04 2024-06-10T00:04:53.154 INFO:teuthology.orchestra.run.smithi079.stdout:(4/4): kernel-modules-core-5.14.0-452.el9.x86_6 5.4 MB/s | 29 MB 00:05 2024-06-10T00:04:53.157 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-06-10T00:04:53.157 INFO:teuthology.orchestra.run.smithi079.stdout:Total 14 MB/s | 80 MB 00:05 2024-06-10T00:04:53.855 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-06-10T00:04:54.154 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 3.4 MB/s | 29 MB 00:08 2024-06-10T00:04:54.198 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-06-10T00:04:54.198 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-06-10T00:04:55.149 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-06-10T00:04:55.149 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-06-10T00:04:55.754 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 3.4 MB/s | 35 MB 00:10 2024-06-10T00:04:55.756 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-06-10T00:04:55.756 INFO:teuthology.orchestra.run.smithi117.stdout:Total 7.7 MB/s | 80 MB 00:10 2024-06-10T00:04:56.455 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-06-10T00:04:56.811 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-06-10T00:04:56.811 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-06-10T00:04:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-06-10T00:04:57.780 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-06-10T00:04:57.780 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-06-10T00:04:58.241 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-10T00:04:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-10T00:05:00.205 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-06-10T00:05:00.843 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-10T00:05:00.928 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-10T00:05:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-10T00:05:01.139 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-10T00:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-10T00:05:03.889 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-10T00:05:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-10T00:05:05.944 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:08.637 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-10T00:05:08.977 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:10.692 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:13.712 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:40.292 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:40.292 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-10T00:05:40.293 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-10T00:05:40.293 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:05:41.184 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-06-10T00:05:41.575 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-06-10T00:05:41.673 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-10T00:05:41.673 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-10T00:05:41.673 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-10T00:05:41.674 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-10T00:05:41.674 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-10T00:05:41.674 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-06-10T00:05:41.674 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-06-10T00:05:41.675 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-06-10T00:05:41.726 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-10T00:05:41.727 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-10T00:05:41.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2-tools 2024-06-10T00:05:41.766 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2-tools 2024-06-10T00:05:41.767 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2024-06-10T00:05:41.767 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.06 2024-06-10T00:05:41.767 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 68.el9 2024-06-10T00:05:41.767 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2024-06-10T00:05:41.767 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-10T00:05:41.767 INFO:teuthology.orchestra.run.smithi079.stdout:Group : Unspecified 2024-06-10T00:05:41.767 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 8264254 2024-06-10T00:05:41.768 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2024-06-10T00:05:41.768 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-10T00:05:41.768 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-10T00:05:41.768 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-10T00:05:41.768 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-10T00:05:41.768 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : builder@centos.org 2024-06-10T00:05:41.769 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : CentOS 2024-06-10T00:05:41.769 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-10T00:05:41.769 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Support tools for GRUB. 2024-06-10T00:05:41.769 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2024-06-10T00:05:41.769 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:05:41.769 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-10T00:05:41.769 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-10T00:05:41.770 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-10T00:05:41.770 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2024-06-10T00:05:41.770 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:05:41.770 INFO:teuthology.orchestra.run.smithi079.stdout:This subpackage provides tools for support of all platforms. 2024-06-10T00:05:41.771 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-10T00:05:41.771 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 5.14.0-452.el9.x86_64 2024-06-10T00:05:41.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-10T00:05:42.393 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-06-10T00:05:42.979 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:43.320 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:43.320 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-10T00:05:43.320 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-10T00:05:43.320 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-10T00:05:43.748 INFO:teuthology.orchestra.run.smithi079.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-10T00:05:43.783 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-06-10T00:05:43.785 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-06-10T00:05:43.807 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.dy3PKOK1JF 2024-06-10T00:05:43.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dy3PKOK1JF 2024-06-10T00:05:43.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.dy3PKOK1JF 2024-06-10T00:05:44.047 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.dy3PKOK1JF is 6KB 2024-06-10T00:05:44.074 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.dy3PKOK1JF 2024-06-10T00:05:44.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo /bin/ls /boot/loader/entries || true 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:05:44.117 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-06-10T00:05:44.158 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-10T00:05:44.158 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-10T00:05:44.158 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-10T00:05:44.158 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-10T00:05:44.160 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-10T00:05:44.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-06-10T00:05:44.401 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-06-10T00:05:44.450 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-06-10T00:05:44.529 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-10T00:05:44.529 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-10T00:05:44.529 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-10T00:05:44.529 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-10T00:05:44.529 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-10T00:05:44.530 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-06-10T00:05:44.530 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-06-10T00:05:44.530 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-06-10T00:05:44.583 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-10T00:05:44.583 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-10T00:05:44.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-06-10T00:05:44.618 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 68.el9 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8264254 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-10T00:05:44.619 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:05:44.620 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-06-10T00:05:44.621 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-10T00:05:44.621 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 5.14.0-452.el9.x86_64 2024-06-10T00:05:44.621 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-10T00:05:45.274 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-06-10T00:05:46.673 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-10T00:05:46.699 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-06-10T00:05:46.701 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-06-10T00:05:46.721 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.oqwUxXdvBp 2024-06-10T00:05:46.721 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oqwUxXdvBp 2024-06-10T00:05:46.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.oqwUxXdvBp 2024-06-10T00:05:46.929 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.oqwUxXdvBp is 6KB 2024-06-10T00:05:46.949 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.oqwUxXdvBp 2024-06-10T00:05:46.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-06-10T00:05:47.034 INFO:teuthology.orchestra.run.smithi117.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-10T00:05:47.034 INFO:teuthology.orchestra.run.smithi117.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-10T00:05:47.034 INFO:teuthology.orchestra.run.smithi117.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-10T00:05:47.034 INFO:teuthology.orchestra.run.smithi117.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-10T00:05:47.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-10T00:05:47.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-06-10T00:06:14.338 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-06-10T00:06:14.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-10T00:06:14.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:06:17.172 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-06-10T00:06:17.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-06-10T00:06:17.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:06:48.863 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-06-10T00:06:51.678 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-06-10T00:06:57.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-10T00:06:57.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:07:00.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-06-10T00:07:00.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:07:16.259 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-06-10T00:07:19.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-06-10T00:07:28.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-10T00:07:28.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:07:28.566 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-06-10T00:07:29.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-10T00:07:29.001 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-452.el9.x86_64"... 2024-06-10T00:07:29.002 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-06-10T00:07:29.016 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-452.el9.x86_64 2024-06-10T00:07:29.016 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-10T00:07:29.016 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-10T00:07:29.017 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-10T00:07:30.017 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-10T00:07:30.018 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-10T00:07:30.124 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-06-10T00:07:30.164 DEBUG:teuthology.parallel:result is None 2024-06-10T00:07:31.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-06-10T00:07:31.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:07:31.480 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-06-10T00:07:31.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-06-10T00:07:31.822 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-452.el9.x86_64"... 2024-06-10T00:07:31.822 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-06-10T00:07:31.876 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-452.el9.x86_64 2024-06-10T00:07:31.876 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-10T00:07:31.876 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-10T00:07:31.876 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-10T00:07:32.877 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-06-10T00:07:32.877 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-10T00:07:32.966 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-06-10T00:07:33.002 DEBUG:teuthology.parallel:result is None 2024-06-10T00:07:33.002 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-10T00:07:33.010 INFO:teuthology.task.internal:Creating test directory... 2024-06-10T00:07:33.010 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-10T00:07:33.013 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-10T00:07:33.031 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-10T00:07:33.041 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-10T00:07:33.061 INFO:teuthology.task.internal:Creating archive directory... 2024-06-10T00:07:33.061 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-10T00:07:33.072 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-10T00:07:33.126 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-10T00:07:33.132 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-10T00:07:33.132 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-10T00:07:33.148 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-10T00:07:33.182 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-10T00:07:33.188 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-10T00:07:33.192 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-10T00:07:33.198 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-10T00:07:33.200 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-10T00:07:33.214 INFO:teuthology.task.internal:Configuring sudo... 2024-06-10T00:07:33.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-10T00:07:33.216 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-10T00:07:33.256 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-10T00:07:33.264 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-10T00:07:33.265 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-10T00:07:33.279 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-10T00:07:33.308 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-10T00:07:33.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-10T00:07:33.425 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-10T00:07:33.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-10T00:07:33.544 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:07:33.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-10T00:07:33.607 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-10T00:07:33.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-10T00:07:33.695 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-10T00:07:33.773 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-10T00:07:33.810 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:07:33.810 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-10T00:07:33.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-06-10T00:07:33.874 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-06-10T00:07:33.915 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-10T00:07:33.970 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-10T00:07:34.224 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-10T00:07:34.343 INFO:teuthology.task.internal:Starting timer... 2024-06-10T00:07:34.343 INFO:teuthology.run_tasks:Running task pcp... 2024-06-10T00:07:34.378 INFO:teuthology.run_tasks:Running task selinux... 2024-06-10T00:07:34.442 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-06-10T00:07:34.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-06-10T00:07:34.509 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-06-10T00:07:34.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-06-10T00:07:34.613 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-06-10T00:07:34.618 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-10T00:07:34.618 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-06-10T00:07:34.641 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-06-10T00:07:34.641 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-06-10T00:07:34.685 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-06-10T00:07:34.685 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-06-10T00:07:34.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-10T00:07:34.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:07:34.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-10T00:07:34.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:07:34.788 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-10T00:07:34.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-06-10T00:07:34.814 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-06-10T00:07:35.033 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-10T00:07:35.047 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-10T00:07:35.051 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-10T00:07:35.161 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-10T00:07:35.172 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-10T00:07:35.172 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-10T00:11:59.895 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-06-10T00:11:59.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-10T00:11:59.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:11:59.980 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-06-10T00:12:00.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-10T00:12:00.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-06-10T00:12:00.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-10T00:12:00.096 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-06-10T00:12:00.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-06-10T00:12:00.175 INFO:teuthology.run_tasks:Running task clock... 2024-06-10T00:12:00.184 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-10T00:12:00.184 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-10T00:12:00.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-10T00:12:00.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-10T00:12:00.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-10T00:12:00.215 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-10T00:12:00.230 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-10T00:12:00.245 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-10T00:12:00.253 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-06-10T00:12:00.259 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-10T00:12:00.264 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-06-10T00:12:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-10T00:12:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-06-10T00:12:00.292 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-10T00:12:00.295 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-06-10T00:12:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-10T00:12:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-10T00:12:00.358 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-06-10T00:12:00.361 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-10T00:12:00.361 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-06-10T00:12:00.361 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:12:00.361 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:12:00.361 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:12:00.361 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:12:00.384 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-06-10T00:12:00.387 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-10T00:12:00.387 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-06-10T00:12:00.388 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:12:00.388 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:12:00.388 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:12:00.388 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:12:00.389 INFO:teuthology.run_tasks:Running task install... 2024-06-10T00:12:00.397 DEBUG:teuthology.task.install:project ceph 2024-06-10T00:12:00.397 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-10T00:12:00.397 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-10T00:12:00.397 INFO:teuthology.task.install:Using flavor: default 2024-06-10T00:12:00.403 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-10T00:12:00.403 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-10T00:12:00.403 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-10T00:12:00.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-10T00:12:00.406 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-10T00:12:00.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-10T00:12:00.554 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-10T00:12:00.554 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-10T00:12:00.561 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-10T00:12:00.561 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-10T00:12:00.670 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-10T00:12:00.670 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:12:00.670 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-10T00:12:00.695 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-10T00:12:00.696 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-10T00:12:00.733 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-10T00:12:00.734 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:12:00.734 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-10T00:12:00.760 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-10T00:12:00.760 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-10T00:12:00.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-10T00:12:00.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-10T00:12:00.836 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-10T00:12:00.901 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-06-10T00:12:00.901 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-10T00:12:00.902 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-06-10T00:12:00.966 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-06-10T00:12:00.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-06-10T00:12:01.162 INFO:teuthology.orchestra.run.smithi079.stdout:45 files removed 2024-06-10T00:12:01.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-10T00:12:01.191 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-06-10T00:12:01.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-10T00:12:01.909 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 199 kB/s | 83 kB 00:00 2024-06-10T00:12:01.954 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 170 kB/s | 83 kB 00:00 2024-06-10T00:12:02.276 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-06-10T00:12:02.347 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-06-10T00:12:02.618 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 6.3 kB/s | 1.9 kB 00:00 2024-06-10T00:12:02.706 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-06-10T00:12:04.277 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.1 MB 00:01 2024-06-10T00:12:04.670 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.1 MB 00:02 2024-06-10T00:12:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-06-10T00:12:06.637 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-06-10T00:12:10.860 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.2 MB 00:01 2024-06-10T00:12:11.737 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.2 MB 00:01 2024-06-10T00:12:12.826 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 17 kB 00:00 2024-06-10T00:12:13.462 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 17 kB 00:00 2024-06-10T00:12:14.037 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-06-10T00:12:14.340 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 29 MB/s | 21 MB 00:00 2024-06-10T00:12:19.426 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 6.8 kB/s | 1.7 kB 00:00 2024-06-10T00:12:19.504 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-06-10T00:12:21.769 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-10T00:12:21.770 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-10T00:12:21.781 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-10T00:12:21.782 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-10T00:12:21.782 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-10T00:12:21.783 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-10T00:12:21.785 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-10T00:12:21.787 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-10T00:12:21.788 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-10T00:12:21.789 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-10T00:12:21.790 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-10T00:12:21.801 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-10T00:12:21.802 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-10T00:12:21.803 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-10T00:12:21.803 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-10T00:12:21.805 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-10T00:12:21.807 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-10T00:12:21.808 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-10T00:12:21.851 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-06-10T00:12:21.868 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-06-10T00:12:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-06-10T00:12:21.868 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-06-10T00:12:21.868 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-06-10T00:12:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-10T00:12:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-10T00:12:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-10T00:12:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-10T00:12:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-10T00:12:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-06-10T00:12:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-06-10T00:12:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-10T00:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-10T00:12:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-10T00:12:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-10T00:12:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-10T00:12:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-10T00:12:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-10T00:12:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-10T00:12:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout:Install 148 Packages 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 11 Packages 2024-06-10T00:12:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:12:21.882 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-06-10T00:12:21.882 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-06-10T00:12:21.882 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-06-10T00:12:21.882 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-06-10T00:12:21.882 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-06-10T00:12:21.882 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-10T00:12:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-10T00:12:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-10T00:12:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-10T00:12:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-10T00:12:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-10T00:12:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-10T00:12:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-10T00:12:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-10T00:12:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-10T00:12:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-10T00:12:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-10T00:12:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-06-10T00:12:21.895 INFO:teuthology.orchestra.run.smithi117.stdout:Install 148 Packages 2024-06-10T00:12:21.896 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 11 Packages 2024-06-10T00:12:21.896 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:12:21.896 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 225 M 2024-06-10T00:12:21.896 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-06-10T00:12:21.896 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 225 M 2024-06-10T00:12:21.897 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-06-10T00:12:22.627 INFO:teuthology.orchestra.run.smithi079.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-06-10T00:12:22.697 INFO:teuthology.orchestra.run.smithi117.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-06-10T00:12:22.972 INFO:teuthology.orchestra.run.smithi117.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 3.2 MB/s | 890 kB 00:00 2024-06-10T00:12:23.030 INFO:teuthology.orchestra.run.smithi117.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 2.4 MB/s | 145 kB 00:00 2024-06-10T00:12:23.060 INFO:teuthology.orchestra.run.smithi079.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 2.0 MB/s | 890 kB 00:00 2024-06-10T00:12:23.144 INFO:teuthology.orchestra.run.smithi079.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 1.7 MB/s | 145 kB 00:00 2024-06-10T00:12:23.344 INFO:teuthology.orchestra.run.smithi079.stdout:(4/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 5.6 MB/s | 5.4 MB 00:00 2024-06-10T00:12:23.589 INFO:teuthology.orchestra.run.smithi117.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 4.2 MB/s | 2.4 MB 00:00 2024-06-10T00:12:23.619 INFO:teuthology.orchestra.run.smithi079.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 5.4 MB/s | 1.5 MB 00:00 2024-06-10T00:12:23.723 INFO:teuthology.orchestra.run.smithi117.stdout:(5/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 4.5 MB/s | 5.4 MB 00:01 2024-06-10T00:12:23.973 INFO:teuthology.orchestra.run.smithi117.stdout:(6/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 3.9 MB/s | 1.5 MB 00:00 2024-06-10T00:12:24.070 INFO:teuthology.orchestra.run.smithi079.stdout:(6/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 2.6 MB/s | 2.4 MB 00:00 2024-06-10T00:12:24.353 INFO:teuthology.orchestra.run.smithi079.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 6.4 MB/s | 4.7 MB 00:00 2024-06-10T00:12:24.840 INFO:teuthology.orchestra.run.smithi117.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 4.2 MB/s | 4.7 MB 00:01 2024-06-10T00:12:25.862 INFO:teuthology.orchestra.run.smithi079.stdout:(8/159): ceph-radosgw-19.0.0-2946.g3d89accf.el9 6.8 MB/s | 10 MB 00:01 2024-06-10T00:12:26.087 INFO:teuthology.orchestra.run.smithi079.stdout:(9/159): ceph-common-19.0.0-2946.g3d89accf.el9. 5.7 MB/s | 21 MB 00:03 2024-06-10T00:12:26.112 INFO:teuthology.orchestra.run.smithi079.stdout:(10/159): ceph-selinux-19.0.0-2946.g3d89accf.el 101 kB/s | 25 kB 00:00 2024-06-10T00:12:26.187 INFO:teuthology.orchestra.run.smithi079.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.9 MB/s | 221 kB 00:00 2024-06-10T00:12:26.254 INFO:teuthology.orchestra.run.smithi079.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 406 kB/s | 27 kB 00:00 2024-06-10T00:12:26.313 INFO:teuthology.orchestra.run.smithi079.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 545 kB/s | 32 kB 00:00 2024-06-10T00:12:26.415 INFO:teuthology.orchestra.run.smithi117.stdout:(8/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 6.9 MB/s | 17 MB 00:02 2024-06-10T00:12:26.430 INFO:teuthology.orchestra.run.smithi079.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 6.3 MB/s | 747 kB 00:00 2024-06-10T00:12:26.465 INFO:teuthology.orchestra.run.smithi117.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 507 kB/s | 25 kB 00:00 2024-06-10T00:12:26.497 INFO:teuthology.orchestra.run.smithi079.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.4 MB/s | 163 kB 00:00 2024-06-10T00:12:26.572 INFO:teuthology.orchestra.run.smithi079.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.7 MB/s | 127 kB 00:00 2024-06-10T00:12:26.664 INFO:teuthology.orchestra.run.smithi079.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 5.4 MB/s | 501 kB 00:00 2024-06-10T00:12:26.999 INFO:teuthology.orchestra.run.smithi117.stdout:(10/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 4.7 MB/s | 10 MB 00:02 2024-06-10T00:12:27.099 INFO:teuthology.orchestra.run.smithi117.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.2 MB/s | 221 kB 00:00 2024-06-10T00:12:27.199 INFO:teuthology.orchestra.run.smithi117.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 270 kB/s | 27 kB 00:00 2024-06-10T00:12:27.302 INFO:teuthology.orchestra.run.smithi117.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 318 kB/s | 32 kB 00:00 2024-06-10T00:12:27.390 INFO:teuthology.orchestra.run.smithi079.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 7.3 MB/s | 5.3 MB 00:00 2024-06-10T00:12:27.473 INFO:teuthology.orchestra.run.smithi079.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 543 kB/s | 45 kB 00:00 2024-06-10T00:12:27.508 INFO:teuthology.orchestra.run.smithi117.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 3.5 MB/s | 747 kB 00:00 2024-06-10T00:12:27.548 INFO:teuthology.orchestra.run.smithi079.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.8 MB/s | 135 kB 00:00 2024-06-10T00:12:27.606 INFO:teuthology.orchestra.run.smithi079.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 2.7 MB/s | 162 kB 00:00 2024-06-10T00:12:27.674 INFO:teuthology.orchestra.run.smithi079.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 4.7 MB/s | 321 kB 00:00 2024-06-10T00:12:27.708 INFO:teuthology.orchestra.run.smithi117.stdout:(15/159): ceph-common-19.0.0-2946.g3d89accf.el9 4.0 MB/s | 21 MB 00:05 2024-06-10T00:12:27.742 INFO:teuthology.orchestra.run.smithi117.stdout:(16/159): libcephsqlite-19.0.0-2946.g3d89accf.e 698 kB/s | 163 kB 00:00 2024-06-10T00:12:27.749 INFO:teuthology.orchestra.run.smithi079.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 3.9 MB/s | 300 kB 00:00 2024-06-10T00:12:27.833 INFO:teuthology.orchestra.run.smithi079.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.2 MB/s | 99 kB 00:00 2024-06-10T00:12:27.868 INFO:teuthology.orchestra.run.smithi117.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 3.9 MB/s | 501 kB 00:00 2024-06-10T00:12:27.900 INFO:teuthology.orchestra.run.smithi079.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.2 MB/s | 85 kB 00:00 2024-06-10T00:12:28.209 INFO:teuthology.orchestra.run.smithi117.stdout:(18/159): librados-devel-19.0.0-2946.g3d89accf. 253 kB/s | 127 kB 00:00 2024-06-10T00:12:28.360 INFO:teuthology.orchestra.run.smithi117.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 300 kB/s | 45 kB 00:00 2024-06-10T00:12:28.366 INFO:teuthology.orchestra.run.smithi079.stdout:(26/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 6.6 MB/s | 3.1 MB 00:00 2024-06-10T00:12:28.475 INFO:teuthology.orchestra.run.smithi079.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.5 MB/s | 171 kB 00:00 2024-06-10T00:12:28.502 INFO:teuthology.orchestra.run.smithi117.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 954 kB/s | 135 kB 00:00 2024-06-10T00:12:28.533 INFO:teuthology.orchestra.run.smithi079.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 544 kB/s | 32 kB 00:00 2024-06-10T00:12:28.626 INFO:teuthology.orchestra.run.smithi079.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.5 MB/s | 142 kB 00:00 2024-06-10T00:12:28.727 INFO:teuthology.orchestra.run.smithi117.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 719 kB/s | 162 kB 00:00 2024-06-10T00:12:29.126 INFO:teuthology.orchestra.run.smithi079.stdout:(30/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 7.0 MB/s | 3.5 MB 00:00 2024-06-10T00:12:29.285 INFO:teuthology.orchestra.run.smithi117.stdout:(22/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 3.8 MB/s | 5.3 MB 00:01 2024-06-10T00:12:29.310 INFO:teuthology.orchestra.run.smithi117.stdout:(23/159): python3-rados-19.0.0-2946.g3d89accf.e 551 kB/s | 321 kB 00:00 2024-06-10T00:12:29.436 INFO:teuthology.orchestra.run.smithi117.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 794 kB/s | 99 kB 00:00 2024-06-10T00:12:29.461 INFO:teuthology.orchestra.run.smithi117.stdout:(25/159): python3-rbd-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 300 kB 00:00 2024-06-10T00:12:29.536 INFO:teuthology.orchestra.run.smithi117.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 850 kB/s | 85 kB 00:00 2024-06-10T00:12:29.736 INFO:teuthology.orchestra.run.smithi117.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 854 kB/s | 171 kB 00:00 2024-06-10T00:12:29.845 INFO:teuthology.orchestra.run.smithi117.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 293 kB/s | 32 kB 00:00 2024-06-10T00:12:30.017 INFO:teuthology.orchestra.run.smithi079.stdout:(31/159): ceph-mgr-diskprediction-local-19.0.0- 8.3 MB/s | 7.4 MB 00:00 2024-06-10T00:12:30.046 INFO:teuthology.orchestra.run.smithi117.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 710 kB/s | 142 kB 00:00 2024-06-10T00:12:30.101 INFO:teuthology.orchestra.run.smithi079.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.9 MB/s | 249 kB 00:00 2024-06-10T00:12:30.185 INFO:teuthology.orchestra.run.smithi079.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 593 kB/s | 49 kB 00:00 2024-06-10T00:12:30.252 INFO:teuthology.orchestra.run.smithi079.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 247 kB/s | 16 kB 00:00 2024-06-10T00:12:30.262 INFO:teuthology.orchestra.run.smithi117.stdout:(30/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 3.9 MB/s | 3.1 MB 00:00 2024-06-10T00:12:30.318 INFO:teuthology.orchestra.run.smithi079.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.9 MB/s | 264 kB 00:00 2024-06-10T00:12:30.477 INFO:teuthology.orchestra.run.smithi079.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 4.7 MB/s | 763 kB 00:00 2024-06-10T00:12:30.561 INFO:teuthology.orchestra.run.smithi079.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 219 kB/s | 18 kB 00:00 2024-06-10T00:12:30.600 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:30.711 INFO:teuthology.orchestra.run.smithi079.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-06-10T00:12:30.712 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:30.820 INFO:teuthology.orchestra.run.smithi079.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-06-10T00:12:30.821 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:30.862 INFO:teuthology.orchestra.run.smithi079.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-06-10T00:12:30.903 INFO:teuthology.orchestra.run.smithi079.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-06-10T00:12:30.970 INFO:teuthology.orchestra.run.smithi079.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-06-10T00:12:31.013 INFO:teuthology.orchestra.run.smithi079.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-06-10T00:12:31.058 INFO:teuthology.orchestra.run.smithi079.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-06-10T00:12:31.097 INFO:teuthology.orchestra.run.smithi079.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-10T00:12:31.138 INFO:teuthology.orchestra.run.smithi079.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-06-10T00:12:31.139 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-10T00:12:31.405 INFO:teuthology.orchestra.run.smithi079.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-06-10T00:12:31.407 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:31.597 INFO:teuthology.orchestra.run.smithi079.stdout:(48/159): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-06-10T00:12:31.598 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:31.657 INFO:teuthology.orchestra.run.smithi079.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-06-10T00:12:31.698 INFO:teuthology.orchestra.run.smithi079.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-06-10T00:12:31.782 INFO:teuthology.orchestra.run.smithi079.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-06-10T00:12:31.824 INFO:teuthology.orchestra.run.smithi079.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 791 kB/s | 33 kB 00:00 2024-06-10T00:12:31.896 INFO:teuthology.orchestra.run.smithi117.stdout:(31/159): ceph-mgr-diskprediction-local-19.0.0- 4.5 MB/s | 7.4 MB 00:01 2024-06-10T00:12:31.988 INFO:teuthology.orchestra.run.smithi117.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.7 MB/s | 249 kB 00:00 2024-06-10T00:12:32.055 INFO:teuthology.orchestra.run.smithi117.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 739 kB/s | 49 kB 00:00 2024-06-10T00:12:32.122 INFO:teuthology.orchestra.run.smithi117.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 247 kB/s | 16 kB 00:00 2024-06-10T00:12:32.205 INFO:teuthology.orchestra.run.smithi117.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.1 MB/s | 264 kB 00:00 2024-06-10T00:12:32.255 INFO:teuthology.orchestra.run.smithi117.stdout:(36/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 1.6 MB/s | 3.5 MB 00:02 2024-06-10T00:12:32.274 INFO:teuthology.orchestra.run.smithi079.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.6 MB/s | 3.0 MB 00:00 2024-06-10T00:12:32.324 INFO:teuthology.orchestra.run.smithi079.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 367 kB/s | 18 kB 00:00 2024-06-10T00:12:32.331 INFO:teuthology.orchestra.run.smithi117.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 243 kB/s | 18 kB 00:00 2024-06-10T00:12:32.375 INFO:teuthology.orchestra.run.smithi079.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-06-10T00:12:32.398 INFO:teuthology.orchestra.run.smithi117.stdout:(38/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 3.9 MB/s | 763 kB 00:00 2024-06-10T00:12:32.429 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:32.433 INFO:teuthology.orchestra.run.smithi079.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-06-10T00:12:32.439 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:32.485 INFO:teuthology.orchestra.run.smithi079.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-06-10T00:12:32.525 INFO:teuthology.orchestra.run.smithi117.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 419 kB/s | 80 kB 00:00 2024-06-10T00:12:32.526 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:32.587 INFO:teuthology.orchestra.run.smithi117.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-06-10T00:12:32.617 INFO:teuthology.orchestra.run.smithi117.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-06-10T00:12:32.617 INFO:teuthology.orchestra.run.smithi079.stdout:(58/159): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-06-10T00:12:32.674 INFO:teuthology.orchestra.run.smithi117.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-06-10T00:12:32.716 INFO:teuthology.orchestra.run.smithi117.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-06-10T00:12:32.735 INFO:teuthology.orchestra.run.smithi079.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-06-10T00:12:32.758 INFO:teuthology.orchestra.run.smithi117.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-06-10T00:12:32.784 INFO:teuthology.orchestra.run.smithi079.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 510 kB/s | 25 kB 00:00 2024-06-10T00:12:32.800 INFO:teuthology.orchestra.run.smithi117.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-10T00:12:32.834 INFO:teuthology.orchestra.run.smithi079.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-06-10T00:12:32.859 INFO:teuthology.orchestra.run.smithi117.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-06-10T00:12:32.860 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-10T00:12:32.918 INFO:teuthology.orchestra.run.smithi079.stdout:(62/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-06-10T00:12:32.977 INFO:teuthology.orchestra.run.smithi079.stdout:(63/159): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-06-10T00:12:32.984 INFO:teuthology.orchestra.run.smithi117.stdout:(47/159): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-06-10T00:12:32.985 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:33.027 INFO:teuthology.orchestra.run.smithi079.stdout:(64/159): openblas-0.3.21-2.el9.x86_64.rpm 707 kB/s | 35 kB 00:00 2024-06-10T00:12:33.543 INFO:teuthology.orchestra.run.smithi117.stdout:(48/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 6.8 MB/s | 48 MB 00:07 2024-06-10T00:12:33.544 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:33.585 INFO:teuthology.orchestra.run.smithi117.stdout:(49/159): automake-1.16.2-8.el9.noarch.rpm 949 kB/s | 689 kB 00:00 2024-06-10T00:12:33.643 INFO:teuthology.orchestra.run.smithi117.stdout:(50/159): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-06-10T00:12:33.668 INFO:teuthology.orchestra.run.smithi117.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-06-10T00:12:33.719 INFO:teuthology.orchestra.run.smithi117.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-06-10T00:12:33.744 INFO:teuthology.orchestra.run.smithi117.stdout:(53/159): boost-program-options-1.75.0-8.el9.x8 532 kB/s | 107 kB 00:00 2024-06-10T00:12:33.769 INFO:teuthology.orchestra.run.smithi117.stdout:(54/159): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-06-10T00:12:33.794 INFO:teuthology.orchestra.run.smithi117.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-06-10T00:12:33.820 INFO:teuthology.orchestra.run.smithi117.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-06-10T00:12:33.870 INFO:teuthology.orchestra.run.smithi117.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-06-10T00:12:33.895 INFO:teuthology.orchestra.run.smithi117.stdout:(58/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-06-10T00:12:33.977 INFO:teuthology.orchestra.run.smithi079.stdout:(65/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 6.1 MB/s | 48 MB 00:07 2024-06-10T00:12:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-06-10T00:12:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:(60/159): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-06-10T00:12:34.044 INFO:teuthology.orchestra.run.smithi079.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 4.7 MB/s | 4.7 MB 00:01 2024-06-10T00:12:34.063 INFO:teuthology.orchestra.run.smithi117.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 508 kB/s | 25 kB 00:00 2024-06-10T00:12:34.088 INFO:teuthology.orchestra.run.smithi117.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-06-10T00:12:34.147 INFO:teuthology.orchestra.run.smithi117.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-06-10T00:12:34.172 INFO:teuthology.orchestra.run.smithi117.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-06-10T00:12:34.189 INFO:teuthology.orchestra.run.smithi117.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 840 kB/s | 35 kB 00:00 2024-06-10T00:12:34.336 INFO:teuthology.orchestra.run.smithi079.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-06-10T00:12:34.486 INFO:teuthology.orchestra.run.smithi079.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 5.9 MB/s | 911 kB 00:00 2024-06-10T00:12:34.538 INFO:teuthology.orchestra.run.smithi079.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 2.6 MB/s | 133 kB 00:00 2024-06-10T00:12:34.962 INFO:teuthology.orchestra.run.smithi079.stdout:(70/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-06-10T00:12:35.006 INFO:teuthology.orchestra.run.smithi117.stdout:(66/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-06-10T00:12:35.106 INFO:teuthology.orchestra.run.smithi117.stdout:(67/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-06-10T00:12:35.179 INFO:teuthology.orchestra.run.smithi079.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-06-10T00:12:35.229 INFO:teuthology.orchestra.run.smithi079.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-06-10T00:12:35.306 INFO:teuthology.orchestra.run.smithi117.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-06-10T00:12:35.365 INFO:teuthology.orchestra.run.smithi117.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 3.4 MB/s | 911 kB 00:00 2024-06-10T00:12:35.390 INFO:teuthology.orchestra.run.smithi117.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-06-10T00:12:35.537 INFO:teuthology.orchestra.run.smithi079.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 5.8 MB/s | 5.8 MB 00:01 2024-06-10T00:12:35.565 INFO:teuthology.orchestra.run.smithi117.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-06-10T00:12:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-06-10T00:12:35.658 INFO:teuthology.orchestra.run.smithi117.stdout:(72/159): openblas-openmp-0.3.21-2.el9.x86_64.r 3.2 MB/s | 4.7 MB 00:01 2024-06-10T00:12:35.679 INFO:teuthology.orchestra.run.smithi079.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-06-10T00:12:35.683 INFO:teuthology.orchestra.run.smithi117.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 746 kB/s | 87 kB 00:00 2024-06-10T00:12:35.741 INFO:teuthology.orchestra.run.smithi117.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-06-10T00:12:35.780 INFO:teuthology.orchestra.run.smithi079.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-06-10T00:12:35.830 INFO:teuthology.orchestra.run.smithi079.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-06-10T00:12:35.833 INFO:teuthology.orchestra.run.smithi117.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-06-10T00:12:35.889 INFO:teuthology.orchestra.run.smithi079.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-06-10T00:12:35.917 INFO:teuthology.orchestra.run.smithi117.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-06-10T00:12:35.969 INFO:teuthology.orchestra.run.smithi117.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-06-10T00:12:35.973 INFO:teuthology.orchestra.run.smithi079.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-06-10T00:12:36.023 INFO:teuthology.orchestra.run.smithi079.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-06-10T00:12:36.026 INFO:teuthology.orchestra.run.smithi117.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-06-10T00:12:36.076 INFO:teuthology.orchestra.run.smithi117.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-10T00:12:36.127 INFO:teuthology.orchestra.run.smithi117.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-06-10T00:12:36.223 INFO:teuthology.orchestra.run.smithi079.stdout:(81/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 1.4 MB/s | 17 MB 00:12 2024-06-10T00:12:36.357 INFO:teuthology.orchestra.run.smithi079.stdout:(82/159): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-06-10T00:12:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-06-10T00:12:36.499 INFO:teuthology.orchestra.run.smithi079.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-06-10T00:12:36.569 INFO:teuthology.orchestra.run.smithi117.stdout:(81/159): postgresql-server-13.14-1.el9.x86_64. 4.8 MB/s | 5.8 MB 00:01 2024-06-10T00:12:36.599 INFO:teuthology.orchestra.run.smithi079.stdout:(85/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 667 kB/s | 250 kB 00:00 2024-06-10T00:12:36.625 INFO:teuthology.orchestra.run.smithi079.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 337 kB/s | 42 kB 00:00 2024-06-10T00:12:36.685 INFO:teuthology.orchestra.run.smithi117.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-06-10T00:12:36.767 INFO:teuthology.orchestra.run.smithi079.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 1.6 MB/s | 269 kB 00:00 2024-06-10T00:12:36.786 INFO:teuthology.orchestra.run.smithi117.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-06-10T00:12:36.844 INFO:teuthology.orchestra.run.smithi117.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-06-10T00:12:36.895 INFO:teuthology.orchestra.run.smithi117.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-06-10T00:12:36.925 INFO:teuthology.orchestra.run.smithi079.stdout:(88/159): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-06-10T00:12:36.985 INFO:teuthology.orchestra.run.smithi079.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 877 kB/s | 51 kB 00:00 2024-06-10T00:12:36.995 INFO:teuthology.orchestra.run.smithi117.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-06-10T00:12:37.026 INFO:teuthology.orchestra.run.smithi079.stdout:(90/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 396 kB/s | 159 kB 00:00 2024-06-10T00:12:37.045 INFO:teuthology.orchestra.run.smithi117.stdout:(87/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-10T00:12:37.051 INFO:teuthology.orchestra.run.smithi079.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 801 kB/s | 54 kB 00:00 2024-06-10T00:12:37.101 INFO:teuthology.orchestra.run.smithi079.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-06-10T00:12:37.121 INFO:teuthology.orchestra.run.smithi117.stdout:(88/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.1 MB/s | 5.1 MB 00:00 2024-06-10T00:12:37.152 INFO:teuthology.orchestra.run.smithi079.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-06-10T00:12:37.171 INFO:teuthology.orchestra.run.smithi117.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-06-10T00:12:37.196 INFO:teuthology.orchestra.run.smithi117.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 680 kB/s | 51 kB 00:00 2024-06-10T00:12:37.222 INFO:teuthology.orchestra.run.smithi117.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-10T00:12:37.235 INFO:teuthology.orchestra.run.smithi079.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-06-10T00:12:37.272 INFO:teuthology.orchestra.run.smithi117.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-06-10T00:12:37.302 INFO:teuthology.orchestra.run.smithi079.stdout:(95/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-06-10T00:12:37.328 INFO:teuthology.orchestra.run.smithi079.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 394 kB/s | 36 kB 00:00 2024-06-10T00:12:37.331 INFO:teuthology.orchestra.run.smithi117.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 757 kB/s | 44 kB 00:00 2024-06-10T00:12:37.353 INFO:teuthology.orchestra.run.smithi079.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 955 kB/s | 47 kB 00:00 2024-06-10T00:12:37.397 INFO:teuthology.orchestra.run.smithi117.stdout:(94/159): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-06-10T00:12:37.403 INFO:teuthology.orchestra.run.smithi079.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-10T00:12:37.428 INFO:teuthology.orchestra.run.smithi079.stdout:(99/159): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-06-10T00:12:37.462 INFO:teuthology.orchestra.run.smithi079.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-06-10T00:12:37.471 INFO:teuthology.orchestra.run.smithi117.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-06-10T00:12:37.487 INFO:teuthology.orchestra.run.smithi079.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-06-10T00:12:37.489 INFO:teuthology.orchestra.run.smithi117.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 390 kB/s | 36 kB 00:00 2024-06-10T00:12:37.523 INFO:teuthology.orchestra.run.smithi117.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 905 kB/s | 47 kB 00:00 2024-06-10T00:12:37.538 INFO:teuthology.orchestra.run.smithi079.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-06-10T00:12:37.541 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:37.574 INFO:teuthology.orchestra.run.smithi117.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-10T00:12:37.577 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:37.599 INFO:teuthology.orchestra.run.smithi117.stdout:(99/159): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-06-10T00:12:37.621 INFO:teuthology.orchestra.run.smithi079.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-06-10T00:12:37.624 INFO:teuthology.orchestra.run.smithi117.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-10T00:12:37.650 INFO:teuthology.orchestra.run.smithi117.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-10T00:12:37.651 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:37.655 INFO:teuthology.orchestra.run.smithi079.stdout:(104/159): abseil-cpp-20211102.0-3.el9.x86_64.r 16 MB/s | 548 kB 00:00 2024-06-10T00:12:37.675 INFO:teuthology.orchestra.run.smithi117.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-06-10T00:12:37.676 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-10T00:12:37.680 INFO:teuthology.orchestra.run.smithi079.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-06-10T00:12:37.706 INFO:teuthology.orchestra.run.smithi079.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-06-10T00:12:37.810 INFO:teuthology.orchestra.run.smithi117.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 141 kB/s | 22 kB 00:00 2024-06-10T00:12:37.823 INFO:teuthology.orchestra.run.smithi079.stdout:(107/159): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-06-10T00:12:37.842 INFO:teuthology.orchestra.run.smithi117.stdout:(104/159): abseil-cpp-20211102.0-3.el9.x86_64.r 16 MB/s | 548 kB 00:00 2024-06-10T00:12:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:(108/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-06-10T00:12:37.876 INFO:teuthology.orchestra.run.smithi117.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-06-10T00:12:37.881 INFO:teuthology.orchestra.run.smithi079.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-06-10T00:12:37.893 INFO:teuthology.orchestra.run.smithi117.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-06-10T00:12:37.907 INFO:teuthology.orchestra.run.smithi079.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-06-10T00:12:37.926 INFO:teuthology.orchestra.run.smithi117.stdout:(107/159): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-06-10T00:12:37.932 INFO:teuthology.orchestra.run.smithi079.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-06-10T00:12:37.957 INFO:teuthology.orchestra.run.smithi079.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-06-10T00:12:37.985 INFO:teuthology.orchestra.run.smithi117.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 453 kB/s | 26 kB 00:00 2024-06-10T00:12:38.008 INFO:teuthology.orchestra.run.smithi079.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-06-10T00:12:38.014 INFO:teuthology.orchestra.run.smithi117.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-06-10T00:12:38.033 INFO:teuthology.orchestra.run.smithi079.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-10T00:12:38.036 INFO:teuthology.orchestra.run.smithi117.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-06-10T00:12:38.058 INFO:teuthology.orchestra.run.smithi079.stdout:(115/159): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-06-10T00:12:38.069 INFO:teuthology.orchestra.run.smithi117.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-06-10T00:12:38.083 INFO:teuthology.orchestra.run.smithi079.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-06-10T00:12:38.109 INFO:teuthology.orchestra.run.smithi079.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-06-10T00:12:38.134 INFO:teuthology.orchestra.run.smithi079.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-06-10T00:12:38.144 INFO:teuthology.orchestra.run.smithi117.stdout:(112/159): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-06-10T00:12:38.159 INFO:teuthology.orchestra.run.smithi079.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-06-10T00:12:38.186 INFO:teuthology.orchestra.run.smithi117.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-06-10T00:12:38.193 INFO:teuthology.orchestra.run.smithi079.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-06-10T00:12:38.212 INFO:teuthology.orchestra.run.smithi117.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-10T00:12:38.218 INFO:teuthology.orchestra.run.smithi079.stdout:(121/159): python3-google-auth-2.29.0-2.el9.noa 3.4 MB/s | 205 kB 00:00 2024-06-10T00:12:38.237 INFO:teuthology.orchestra.run.smithi117.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-10T00:12:38.243 INFO:teuthology.orchestra.run.smithi079.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-06-10T00:12:38.262 INFO:teuthology.orchestra.run.smithi117.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 601 kB/s | 15 kB 00:00 2024-06-10T00:12:38.269 INFO:teuthology.orchestra.run.smithi079.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-06-10T00:12:38.288 INFO:teuthology.orchestra.run.smithi117.stdout:(117/159): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-06-10T00:12:38.294 INFO:teuthology.orchestra.run.smithi079.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-06-10T00:12:38.304 INFO:teuthology.orchestra.run.smithi117.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-06-10T00:12:38.319 INFO:teuthology.orchestra.run.smithi079.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-06-10T00:12:38.338 INFO:teuthology.orchestra.run.smithi117.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-06-10T00:12:38.344 INFO:teuthology.orchestra.run.smithi079.stdout:(126/159): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-06-10T00:12:38.363 INFO:teuthology.orchestra.run.smithi117.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-06-10T00:12:38.370 INFO:teuthology.orchestra.run.smithi079.stdout:(127/159): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-06-10T00:12:38.389 INFO:teuthology.orchestra.run.smithi117.stdout:(121/159): python3-google-auth-2.29.0-2.el9.noa 4.0 MB/s | 205 kB 00:00 2024-06-10T00:12:38.422 INFO:teuthology.orchestra.run.smithi079.stdout:(128/159): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-06-10T00:12:38.423 INFO:teuthology.orchestra.run.smithi117.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-06-10T00:12:38.445 INFO:teuthology.orchestra.run.smithi079.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-10T00:12:38.447 INFO:teuthology.orchestra.run.smithi117.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-06-10T00:12:38.471 INFO:teuthology.orchestra.run.smithi079.stdout:(130/159): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-10T00:12:38.473 INFO:teuthology.orchestra.run.smithi117.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-06-10T00:12:38.496 INFO:teuthology.orchestra.run.smithi079.stdout:(131/159): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-10T00:12:38.498 INFO:teuthology.orchestra.run.smithi117.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-06-10T00:12:38.521 INFO:teuthology.orchestra.run.smithi079.stdout:(132/159): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-06-10T00:12:38.523 INFO:teuthology.orchestra.run.smithi117.stdout:(126/159): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-06-10T00:12:38.546 INFO:teuthology.orchestra.run.smithi079.stdout:(133/159): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-06-10T00:12:38.557 INFO:teuthology.orchestra.run.smithi117.stdout:(127/159): python3-jaraco-text-3.2.0-6.el9.noar 584 kB/s | 20 kB 00:00 2024-06-10T00:12:38.580 INFO:teuthology.orchestra.run.smithi079.stdout:(134/159): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-06-10T00:12:38.606 INFO:teuthology.orchestra.run.smithi079.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-06-10T00:12:38.608 INFO:teuthology.orchestra.run.smithi117.stdout:(128/159): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-06-10T00:12:38.623 INFO:teuthology.orchestra.run.smithi079.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 667 kB/s | 28 kB 00:00 2024-06-10T00:12:38.633 INFO:teuthology.orchestra.run.smithi117.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-10T00:12:38.640 INFO:teuthology.orchestra.run.smithi079.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 917 kB/s | 31 kB 00:00 2024-06-10T00:12:38.657 INFO:teuthology.orchestra.run.smithi079.stdout:(138/159): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-06-10T00:12:38.658 INFO:teuthology.orchestra.run.smithi117.stdout:(130/159): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-10T00:12:38.682 INFO:teuthology.orchestra.run.smithi079.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-06-10T00:12:38.692 INFO:teuthology.orchestra.run.smithi117.stdout:(131/159): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-06-10T00:12:38.699 INFO:teuthology.orchestra.run.smithi079.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-06-10T00:12:38.724 INFO:teuthology.orchestra.run.smithi079.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-06-10T00:12:38.734 INFO:teuthology.orchestra.run.smithi117.stdout:(132/159): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-06-10T00:12:38.750 INFO:teuthology.orchestra.run.smithi079.stdout:(142/159): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-06-10T00:12:38.759 INFO:teuthology.orchestra.run.smithi117.stdout:(133/159): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-06-10T00:12:38.775 INFO:teuthology.orchestra.run.smithi079.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-06-10T00:12:38.785 INFO:teuthology.orchestra.run.smithi117.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-06-10T00:12:38.800 INFO:teuthology.orchestra.run.smithi079.stdout:(144/159): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-06-10T00:12:38.810 INFO:teuthology.orchestra.run.smithi117.stdout:(135/159): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-06-10T00:12:38.825 INFO:teuthology.orchestra.run.smithi079.stdout:(145/159): re2-20211101-3.el9.x86_64.rpm 7.5 MB/s | 192 kB 00:00 2024-06-10T00:12:38.835 INFO:teuthology.orchestra.run.smithi117.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-10T00:12:38.851 INFO:teuthology.orchestra.run.smithi079.stdout:(146/159): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-06-10T00:12:38.861 INFO:teuthology.orchestra.run.smithi117.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-06-10T00:12:38.886 INFO:teuthology.orchestra.run.smithi117.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-06-10T00:12:38.901 INFO:teuthology.orchestra.run.smithi079.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-06-10T00:12:38.903 INFO:teuthology.orchestra.run.smithi117.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-06-10T00:12:38.928 INFO:teuthology.orchestra.run.smithi117.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-06-10T00:12:38.953 INFO:teuthology.orchestra.run.smithi117.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-10T00:12:38.978 INFO:teuthology.orchestra.run.smithi117.stdout:(142/159): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-06-10T00:12:39.004 INFO:teuthology.orchestra.run.smithi117.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-06-10T00:12:39.029 INFO:teuthology.orchestra.run.smithi117.stdout:(144/159): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-06-10T00:12:39.054 INFO:teuthology.orchestra.run.smithi117.stdout:(145/159): re2-20211101-3.el9.x86_64.rpm 7.5 MB/s | 192 kB 00:00 2024-06-10T00:12:39.080 INFO:teuthology.orchestra.run.smithi117.stdout:(146/159): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-06-10T00:12:39.130 INFO:teuthology.orchestra.run.smithi117.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-06-10T00:12:39.285 INFO:teuthology.orchestra.run.smithi079.stdout:(148/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 8.2 MB/s | 3.1 MB 00:00 2024-06-10T00:12:39.460 INFO:teuthology.orchestra.run.smithi079.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-06-10T00:12:39.527 INFO:teuthology.orchestra.run.smithi079.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-06-10T00:12:39.569 INFO:teuthology.orchestra.run.smithi079.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 994 kB/s | 41 kB 00:00 2024-06-10T00:12:39.611 INFO:teuthology.orchestra.run.smithi079.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 5.8 MB/s | 248 kB 00:00 2024-06-10T00:12:39.653 INFO:teuthology.orchestra.run.smithi079.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 886 kB/s | 37 kB 00:00 2024-06-10T00:12:39.695 INFO:teuthology.orchestra.run.smithi079.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.8 MB/s | 207 kB 00:00 2024-06-10T00:12:39.736 INFO:teuthology.orchestra.run.smithi079.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 6.1 MB/s | 260 kB 00:00 2024-06-10T00:12:39.772 INFO:teuthology.orchestra.run.smithi117.stdout:(148/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.3 MB/s | 16 MB 00:02 2024-06-10T00:12:39.795 INFO:teuthology.orchestra.run.smithi079.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-06-10T00:12:39.830 INFO:teuthology.orchestra.run.smithi117.stdout:(149/159): librados2-19.0.0-2946.g3d89accf.el9. 4.5 MB/s | 3.4 MB 00:00 2024-06-10T00:12:39.870 INFO:teuthology.orchestra.run.smithi079.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-06-10T00:12:39.906 INFO:teuthology.orchestra.run.smithi117.stdout:(150/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-06-10T00:12:39.997 INFO:teuthology.orchestra.run.smithi117.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 452 kB/s | 41 kB 00:00 2024-06-10T00:12:40.106 INFO:teuthology.orchestra.run.smithi117.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 2.2 MB/s | 248 kB 00:00 2024-06-10T00:12:40.148 INFO:teuthology.orchestra.run.smithi117.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 882 kB/s | 37 kB 00:00 2024-06-10T00:12:40.190 INFO:teuthology.orchestra.run.smithi117.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.9 MB/s | 207 kB 00:00 2024-06-10T00:12:40.232 INFO:teuthology.orchestra.run.smithi117.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 6.0 MB/s | 260 kB 00:00 2024-06-10T00:12:40.304 INFO:teuthology.orchestra.run.smithi079.stdout:(158/159): librados2-19.0.0-2946.g3d89accf.el9. 2.3 MB/s | 3.4 MB 00:01 2024-06-10T00:12:40.357 INFO:teuthology.orchestra.run.smithi117.stdout:(156/159): NetworkManager-libnm-1.47.91-1.el9.x 3.4 MB/s | 1.8 MB 00:00 2024-06-10T00:12:40.474 INFO:teuthology.orchestra.run.smithi117.stdout:(157/159): NetworkManager-1.47.91-1.el9.x86_64. 3.3 MB/s | 2.3 MB 00:00 2024-06-10T00:12:40.524 INFO:teuthology.orchestra.run.smithi117.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 4.6 MB/s | 1.3 MB 00:00 2024-06-10T00:12:40.941 INFO:teuthology.orchestra.run.smithi117.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.1 MB/s | 2.4 MB 00:00 2024-06-10T00:12:40.946 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-06-10T00:12:40.946 INFO:teuthology.orchestra.run.smithi117.stdout:Total 12 MB/s | 225 MB 00:19 2024-06-10T00:12:41.429 INFO:teuthology.orchestra.run.smithi079.stdout:(159/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-06-10T00:12:41.435 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-06-10T00:12:41.435 INFO:teuthology.orchestra.run.smithi079.stdout:Total 12 MB/s | 225 MB 00:19 2024-06-10T00:12:42.187 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-06-10T00:12:42.342 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-06-10T00:12:42.342 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-06-10T00:12:42.701 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-06-10T00:12:42.858 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-06-10T00:12:42.859 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-06-10T00:12:44.612 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-06-10T00:12:44.613 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-06-10T00:12:45.069 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-06-10T00:12:45.069 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-06-10T00:12:50.884 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-06-10T00:12:50.979 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-10T00:12:51.017 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-10T00:12:51.084 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-10T00:12:51.120 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-10T00:12:51.146 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-10T00:12:51.200 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-10T00:12:51.474 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-06-10T00:12:51.537 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-10T00:12:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-10T00:12:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-10T00:12:51.638 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-10T00:12:51.683 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-10T00:12:51.719 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-10T00:12:51.744 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-10T00:12:51.744 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-10T00:12:51.765 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-10T00:12:51.790 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-10T00:12:51.849 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-10T00:12:51.877 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-10T00:12:51.921 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-10T00:12:52.106 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-10T00:12:52.122 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-10T00:12:52.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-10T00:12:52.186 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-10T00:12:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-10T00:12:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-10T00:12:52.312 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-10T00:12:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-10T00:12:52.375 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-10T00:12:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-10T00:12:52.405 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-10T00:12:52.428 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-10T00:12:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-10T00:12:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-10T00:12:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-10T00:12:52.624 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-10T00:12:52.728 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-10T00:12:52.782 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-10T00:12:52.793 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-10T00:12:52.810 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-10T00:12:52.914 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-10T00:12:52.927 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-10T00:12:52.936 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-10T00:12:52.987 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-10T00:12:52.998 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-10T00:12:53.020 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-10T00:12:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-10T00:12:53.095 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-10T00:12:53.181 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-10T00:12:53.230 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-10T00:12:53.391 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-10T00:12:53.400 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-10T00:12:53.498 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-10T00:12:53.551 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-10T00:12:53.589 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-10T00:12:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-10T00:12:53.628 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-10T00:12:53.662 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-10T00:12:53.714 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-10T00:12:53.743 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-10T00:12:53.779 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-10T00:12:53.796 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-10T00:12:53.822 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-10T00:12:53.856 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-10T00:12:53.883 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-10T00:12:53.952 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-10T00:12:54.006 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-10T00:12:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-10T00:12:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-10T00:12:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-10T00:12:54.145 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-10T00:12:54.158 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-10T00:12:54.192 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-10T00:12:54.235 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-10T00:12:54.264 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-10T00:12:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-10T00:12:54.302 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-10T00:12:54.333 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-10T00:12:54.337 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-10T00:12:54.378 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-10T00:12:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-10T00:12:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-10T00:12:54.453 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-10T00:12:54.496 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-10T00:12:54.529 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-10T00:12:54.556 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-10T00:12:54.584 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-10T00:12:54.627 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-10T00:12:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-10T00:12:54.678 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-10T00:12:54.709 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-10T00:12:54.744 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-10T00:12:54.820 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-10T00:12:54.855 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-10T00:12:54.899 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-10T00:12:54.935 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-10T00:12:55.005 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-10T00:12:55.050 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-10T00:12:55.125 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-10T00:12:55.164 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-10T00:12:55.257 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-10T00:12:55.275 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-10T00:12:55.303 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-10T00:12:55.305 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-10T00:12:55.339 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-10T00:12:55.398 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-10T00:12:55.429 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-10T00:12:55.470 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-10T00:12:55.630 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-10T00:12:55.700 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-10T00:12:55.755 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-10T00:12:55.823 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-10T00:12:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-10T00:12:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-10T00:12:55.915 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-10T00:12:55.920 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-10T00:12:55.944 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-10T00:12:55.967 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-10T00:12:55.981 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-10T00:12:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-10T00:12:56.021 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-10T00:12:56.046 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-10T00:12:56.059 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-10T00:12:56.096 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-10T00:12:56.100 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-10T00:12:56.232 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-10T00:12:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-10T00:12:56.274 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-10T00:12:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-10T00:12:56.320 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-10T00:12:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-10T00:12:56.409 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-10T00:12:56.448 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-10T00:12:56.479 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-10T00:12:56.516 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-10T00:12:56.562 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-10T00:12:56.598 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-10T00:12:56.608 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 63/170 2024-06-10T00:12:56.641 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-10T00:12:56.652 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-10T00:12:56.681 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-10T00:12:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-10T00:12:56.706 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-10T00:12:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-10T00:12:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-10T00:12:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-10T00:12:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-10T00:12:56.931 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-10T00:12:56.971 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-10T00:12:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-10T00:12:57.007 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-10T00:12:57.036 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 63/170 2024-06-10T00:12:57.042 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-10T00:12:57.076 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-10T00:12:57.080 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-10T00:12:57.112 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-10T00:12:57.117 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-10T00:12:57.142 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-10T00:12:57.142 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-10T00:12:57.177 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-10T00:12:57.210 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-10T00:12:57.233 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-10T00:12:57.242 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-10T00:12:57.277 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-10T00:12:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-10T00:12:57.362 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-10T00:12:57.399 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-10T00:12:57.412 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-10T00:12:57.427 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-10T00:12:57.447 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-10T00:12:57.461 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-10T00:12:57.494 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-10T00:12:57.500 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-10T00:12:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-10T00:12:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-10T00:12:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-10T00:12:57.591 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-10T00:12:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-10T00:12:57.648 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-10T00:12:57.663 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-10T00:12:57.698 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-10T00:12:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-10T00:12:57.828 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-10T00:12:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-10T00:12:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-10T00:12:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-10T00:12:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-10T00:12:58.358 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-10T00:12:58.404 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-10T00:12:58.437 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-10T00:12:58.537 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-10T00:12:58.584 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-10T00:12:58.637 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-10T00:12:58.717 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-10T00:12:58.765 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-10T00:12:58.817 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-10T00:12:58.875 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-10T00:12:58.908 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-10T00:12:58.941 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-10T00:12:58.971 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-10T00:12:59.006 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-10T00:12:59.050 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-10T00:12:59.063 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-10T00:12:59.108 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-10T00:12:59.195 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-10T00:12:59.227 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-10T00:12:59.403 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-10T00:12:59.433 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-10T00:12:59.515 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-10T00:12:59.700 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-10T00:12:59.810 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-10T00:13:00.166 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-10T00:13:00.281 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-10T00:13:01.036 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-10T00:13:01.125 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-10T00:13:01.153 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-10T00:13:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-10T00:13:01.495 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-10T00:13:01.533 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-10T00:13:01.540 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-10T00:13:01.640 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-10T00:13:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-10T00:13:01.670 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-10T00:13:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-10T00:13:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-10T00:13:01.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-10T00:13:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-10T00:13:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-10T00:13:02.160 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-10T00:13:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-10T00:13:02.194 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-10T00:13:02.219 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-10T00:13:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-10T00:13:02.290 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-10T00:13:02.320 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-10T00:13:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-10T00:13:02.731 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-10T00:13:02.811 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-10T00:13:02.841 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-10T00:13:04.557 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-10T00:13:04.610 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-10T00:13:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-10T00:13:05.046 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-10T00:13:05.159 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-10T00:13:05.195 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-10T00:13:05.287 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-10T00:13:05.287 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-10T00:13:05.287 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-10T00:13:05.287 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:05.321 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-10T00:13:05.587 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-10T00:13:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-10T00:13:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-10T00:13:05.705 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-10T00:13:05.705 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-10T00:13:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:05.742 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-10T00:13:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-10T00:13:16.781 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-06-10T00:13:16.781 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-06-10T00:13:16.781 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-06-10T00:13:16.781 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-06-10T00:13:16.782 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-06-10T00:13:16.782 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-06-10T00:13:16.782 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-06-10T00:13:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:16.950 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-10T00:13:16.968 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-10T00:13:16.968 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:16.968 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-10T00:13:16.968 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:17.180 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-10T00:13:17.180 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-06-10T00:13:17.180 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-06-10T00:13:17.180 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-06-10T00:13:17.180 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-06-10T00:13:17.180 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-06-10T00:13:17.180 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-06-10T00:13:17.181 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-06-10T00:13:17.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:17.356 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-10T00:13:17.372 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-10T00:13:17.372 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:17.372 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-10T00:13:17.372 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:18.444 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-10T00:13:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-10T00:13:18.471 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:18.471 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-10T00:13:18.471 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-10T00:13:18.472 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-10T00:13:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:18.695 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-10T00:13:18.718 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-10T00:13:18.718 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:18.718 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-10T00:13:18.718 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-10T00:13:18.719 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-10T00:13:18.719 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-10T00:13:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-10T00:13:18.912 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:18.913 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-10T00:13:18.913 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-10T00:13:18.913 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-10T00:13:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-10T00:13:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-10T00:13:19.159 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:19.159 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-10T00:13:19.159 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-10T00:13:19.159 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-10T00:13:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:19.162 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-10T00:13:19.185 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-10T00:13:19.185 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:19.186 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-10T00:13:19.186 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-10T00:13:19.186 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-10T00:13:19.186 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-10T00:13:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-10T00:13:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-10T00:13:19.581 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-10T00:13:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-10T00:13:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-10T00:13:19.627 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:19.627 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-10T00:13:19.627 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-10T00:13:19.628 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-10T00:13:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:19.638 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-10T00:13:19.714 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-10T00:13:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-10T00:13:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-10T00:13:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-10T00:13:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-10T00:13:19.934 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-10T00:13:19.971 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-10T00:13:20.003 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-10T00:13:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-10T00:13:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-10T00:13:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-10T00:13:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-10T00:13:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-10T00:13:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-10T00:13:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-10T00:13:20.425 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-10T00:13:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-10T00:13:20.454 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-10T00:13:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-10T00:13:20.485 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-10T00:13:20.548 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-10T00:13:20.577 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-10T00:13:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-10T00:13:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-10T00:13:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-10T00:13:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-10T00:13:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-10T00:13:21.614 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-10T00:13:21.662 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-10T00:13:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-10T00:13:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-10T00:13:22.623 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-10T00:13:22.654 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-10T00:13:22.755 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-10T00:13:22.925 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-10T00:13:22.964 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-10T00:13:22.988 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-10T00:13:22.988 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:22.989 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-10T00:13:22.989 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-10T00:13:22.989 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-10T00:13:22.989 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:23.040 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-10T00:13:23.051 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-10T00:13:23.052 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-10T00:13:23.077 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-10T00:13:23.148 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-10T00:13:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-10T00:13:23.210 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-10T00:13:23.340 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-10T00:13:23.371 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-10T00:13:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-10T00:13:23.395 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:23.395 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-10T00:13:23.395 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-10T00:13:23.396 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-10T00:13:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-10T00:13:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-10T00:13:23.555 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-10T00:13:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-10T00:13:24.102 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-10T00:13:24.133 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-10T00:13:24.156 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-10T00:13:24.157 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:24.157 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-10T00:13:24.157 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-10T00:13:24.157 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-10T00:13:24.157 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:24.216 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-10T00:13:24.239 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-10T00:13:24.240 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:24.240 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-10T00:13:24.240 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:24.284 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-10T00:13:24.307 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-10T00:13:24.307 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:24.307 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-10T00:13:24.307 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-10T00:13:24.307 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-10T00:13:24.307 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-10T00:13:24.542 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-10T00:13:24.565 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-10T00:13:24.565 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:24.565 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-10T00:13:24.565 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-10T00:13:24.565 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-10T00:13:24.565 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:24.609 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-10T00:13:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-10T00:13:24.632 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-10T00:13:24.633 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:24.633 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-10T00:13:24.633 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-10T00:13:24.633 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-10T00:13:24.633 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-10T00:13:24.649 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:24.649 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-10T00:13:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-10T00:13:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-10T00:13:24.717 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:24.718 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-10T00:13:24.718 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-10T00:13:24.718 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-10T00:13:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:25.019 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-10T00:13:25.043 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-10T00:13:25.043 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-10T00:13:25.043 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-10T00:13:25.043 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-10T00:13:25.043 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-10T00:13:25.044 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:29.145 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-10T00:13:29.187 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-10T00:13:29.227 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-10T00:13:29.251 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-10T00:13:29.279 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-10T00:13:29.464 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-10T00:13:29.516 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-10T00:13:29.531 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-10T00:13:29.549 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-10T00:13:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-10T00:13:29.589 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-10T00:13:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-10T00:13:29.619 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-10T00:13:29.645 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-10T00:13:29.665 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-10T00:13:29.673 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-10T00:13:29.861 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-10T00:13:29.903 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-10T00:13:29.936 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-10T00:13:29.976 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-10T00:13:30.006 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-10T00:13:30.045 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-10T00:13:30.223 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-10T00:13:30.263 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-10T00:13:30.283 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-10T00:13:30.672 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-10T00:13:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-10T00:13:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-10T00:13:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-10T00:13:31.201 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-10T00:13:31.242 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-10T00:13:31.336 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-10T00:13:31.371 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-10T00:13:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-10T00:13:31.421 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-10T00:13:31.456 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-10T00:13:31.457 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-10T00:13:31.541 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-10T00:13:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-10T00:13:31.574 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-10T00:13:31.574 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-10T00:13:31.642 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-10T00:13:31.642 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-10T00:13:31.666 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-10T00:13:31.672 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-10T00:13:31.672 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-10T00:13:31.682 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-10T00:13:31.763 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-10T00:13:31.803 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-10T00:13:31.828 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-10T00:13:31.851 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-10T00:13:31.851 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-10T00:13:31.854 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-10T00:13:31.881 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-10T00:13:31.881 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-10T00:13:31.945 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-10T00:13:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-10T00:13:31.969 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-10T00:13:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-10T00:13:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-10T00:13:32.033 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-10T00:13:32.075 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-10T00:13:32.100 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-10T00:13:32.105 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-10T00:13:32.106 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-10T00:13:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-10T00:13:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-10T00:13:32.378 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-10T00:13:32.402 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-10T00:13:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-10T00:13:37.557 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-10T00:13:37.558 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-10T00:13:37.559 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-10T00:13:37.559 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-10T00:13:37.559 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-10T00:13:37.559 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-10T00:13:37.559 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-10T00:13:37.559 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-10T00:13:37.559 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-10T00:13:37.571 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-10T00:13:37.571 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-10T00:13:37.571 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-10T00:13:37.571 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-10T00:13:37.571 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-10T00:13:37.571 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-10T00:13:37.571 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-10T00:13:37.572 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-10T00:13:37.573 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-10T00:13:37.574 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-10T00:13:37.575 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-10T00:13:37.576 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-10T00:13:37.577 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-10T00:13:37.578 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-10T00:13:37.579 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-10T00:13:37.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-10T00:13:37.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-10T00:13:37.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-10T00:13:37.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-10T00:13:38.253 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-10T00:13:38.253 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-10T00:13:38.253 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-10T00:13:38.254 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-10T00:13:38.255 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-10T00:13:38.274 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-10T00:13:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-10T00:13:38.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-10T00:13:38.277 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-10T00:13:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-10T00:13:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-10T00:13:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-10T00:13:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-13.14-1.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-10T00:13:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-10T00:13:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-10T00:13:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-10T00:13:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-10T00:13:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-10T00:13:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-3.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:40.265 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-06-10T00:13:40.658 DEBUG:teuthology.parallel:result is None 2024-06-10T00:13:40.996 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-10T00:13:40.996 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:40.996 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-06-10T00:13:40.996 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-06-10T00:13:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.2-8.el9.noarch 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.7.4-5.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.4-9.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-10T00:13:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-10T00:13:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: lua-5.4.4-4.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-13.14-1.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-10T00:13:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-10T00:13:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-10T00:13:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-10T00:13:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-10T00:13:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: re2-1:20211101-3.el9.x86_64 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-10T00:13:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-10T00:13:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-10T00:13:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-10T00:13:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-10T00:13:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-10T00:13:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:41.009 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-06-10T00:13:41.410 DEBUG:teuthology.parallel:result is None 2024-06-10T00:13:41.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-10T00:13:41.550 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-10T00:13:41.571 INFO:teuthology.orchestra.run.smithi079.stdout:19.0.0-2946.g3d89accf.el9 2024-06-10T00:13:41.572 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-10T00:13:41.572 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-10T00:13:41.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-10T00:13:41.709 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-10T00:13:41.735 INFO:teuthology.orchestra.run.smithi117.stdout:19.0.0-2946.g3d89accf.el9 2024-06-10T00:13:41.735 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-10T00:13:41.735 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-10T00:13:41.737 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-10T00:13:41.738 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:41.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-10T00:13:41.765 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:13:41.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-10T00:13:41.806 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-10T00:13:41.807 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:41.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-06-10T00:13:41.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-10T00:13:41.897 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:13:41.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-06-10T00:13:41.925 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-10T00:13:41.994 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-10T00:13:41.994 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:41.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-10T00:13:42.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-10T00:13:42.082 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:13:42.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-10T00:13:42.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-10T00:13:42.174 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-10T00:13:42.175 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:42.175 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-06-10T00:13:42.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-10T00:13:42.264 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:13:42.264 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-06-10T00:13:42.289 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-10T00:13:42.355 INFO:teuthology.run_tasks:Running task ceph... 2024-06-10T00:13:42.427 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-06-10T00:13:42.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2024-06-10T00:13:42.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-06-10T00:13:42.455 INFO:tasks.ceph:Disabling ceph logrotate... 2024-06-10T00:13:42.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-10T00:13:42.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-10T00:13:42.522 INFO:tasks.ceph:Creating extra log directories... 2024-06-10T00:13:42.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-10T00:13:42.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-10T00:13:42.593 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-06-10T00:13:42.593 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-06-10T00:13:42.593 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-06-10T00:13:42.593 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:42.593 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-10T00:13:42.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-10T00:13:42.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-10T00:13:42.769 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:13:42.769 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-10T00:13:42.784 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-10T00:13:42.893 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-10T00:13:42.923 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-06-10T00:13:42.923 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-06-10T00:13:42.923 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7747319', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7b7a5d375cf4e4afab96b9d4d229b699ae8304bb'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 178, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'sleep_before_teardown': 0, 'subset': '130/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7b7a5d375cf4e4afab96b9d4d229b699ae8304bb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7b7a5d375cf4e4afab96b9d4d229b699ae8304bb', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPvuCNWdoENhrqb0F6kTHABPqsn/ZIrGy7O6efjQpyC7+NPS5TwVM4H2RC1cd8P6sMBSLCBbACOluNutZDOUXws=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPicW5CkW2R6uSX8PpAMIk40RWHBvFKUTpWdI2U5u/SuzzHx+HzBkkEgnhYGUqkzJclI2p0828WGLICbsKVMlF0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '861a8dcf7aa816a26e13f039336f7ed0a9aec0fa', 'timestamp': '2024-06-09_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-06-10T00:13:42.924 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-10T00:13:42.926 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-10T00:13:42.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-06-10T00:13:42.981 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-06-10T00:13:43.037 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:43.037 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-06-10T00:13:43.059 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-10T00:13:43.059 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-06-10T00:13:43.114 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-10T00:13:43.114 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-10T00:13:43.114 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-06-10T00:13:43.115 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-10T00:13:43.115 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-06-10T00:13:43.115 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-06-10 00:13:32.823289034 +0000 2024-06-10T00:13:43.115 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-06-10 00:11:14.289993496 +0000 2024-06-10T00:13:43.115 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-06-10 00:11:14.289993496 +0000 2024-06-10T00:13:43.118 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-06-10 00:11:14.289993496 +0000 2024-06-10T00:13:43.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-10T00:13:43.177 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-06-10T00:13:43.178 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-06-10T00:13:43.178 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000265483 s, 1.9 MB/s 2024-06-10T00:13:43.179 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-10T00:13:43.235 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-06-10 00:13:32.824289011 +0000 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-06-10 00:11:14.617985932 +0000 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-06-10 00:11:14.617985932 +0000 2024-06-10T00:13:43.291 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-06-10 00:11:14.617985932 +0000 2024-06-10T00:13:43.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-10T00:13:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-06-10T00:13:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-06-10T00:13:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000163553 s, 3.1 MB/s 2024-06-10T00:13:43.355 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-10T00:13:43.411 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-06-10T00:13:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-10T00:13:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-10T00:13:43.466 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-10T00:13:43.467 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-10T00:13:43.467 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-06-10T00:13:43.467 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-06-10 00:13:32.824289011 +0000 2024-06-10T00:13:43.467 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-06-10 00:11:14.949978275 +0000 2024-06-10T00:13:43.467 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-06-10 00:11:14.949978275 +0000 2024-06-10T00:13:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-06-10 00:11:14.949978275 +0000 2024-06-10T00:13:43.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-10T00:13:43.529 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-06-10T00:13:43.530 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-06-10T00:13:43.530 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000211606 s, 2.4 MB/s 2024-06-10T00:13:43.531 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-10T00:13:43.587 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-06-10T00:13:43.642 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-10T00:13:43.642 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-10T00:13:43.642 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-10T00:13:43.643 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-10T00:13:43.643 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-06-10T00:13:43.643 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-06-10 00:13:32.824289011 +0000 2024-06-10T00:13:43.643 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-06-10 00:11:15.287970479 +0000 2024-06-10T00:13:43.643 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-06-10 00:11:15.287970479 +0000 2024-06-10T00:13:43.643 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-06-10 00:11:15.287970479 +0000 2024-06-10T00:13:43.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-10T00:13:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-06-10T00:13:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-06-10T00:13:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000187028 s, 2.7 MB/s 2024-06-10T00:13:43.707 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-10T00:13:43.763 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-10T00:13:43.763 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:13:43.763 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-06-10T00:13:43.780 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-10T00:13:43.781 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-06-10 00:13:32.390013199 +0000 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-06-10 00:11:13.361753441 +0000 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-06-10 00:11:13.361753441 +0000 2024-06-10T00:13:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-06-10 00:11:13.361753441 +0000 2024-06-10T00:13:43.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-10T00:13:43.901 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-06-10T00:13:43.901 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-06-10T00:13:43.901 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000187154 s, 2.7 MB/s 2024-06-10T00:13:43.902 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-10T00:13:43.959 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-06-10T00:13:44.014 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-10T00:13:44.015 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-10T00:13:44.015 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-06-10T00:13:44.015 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-10T00:13:44.015 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-06-10T00:13:44.015 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-06-10 00:13:32.390013199 +0000 2024-06-10T00:13:44.015 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-06-10 00:11:13.689746999 +0000 2024-06-10T00:13:44.015 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-06-10 00:11:13.689746999 +0000 2024-06-10T00:13:44.015 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-06-10 00:11:13.689746999 +0000 2024-06-10T00:13:44.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-10T00:13:44.078 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-06-10T00:13:44.078 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-06-10T00:13:44.078 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000200209 s, 2.6 MB/s 2024-06-10T00:13:44.079 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-10T00:13:44.136 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-06-10 00:13:32.391013181 +0000 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-06-10 00:11:14.030740301 +0000 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-06-10 00:11:14.030740301 +0000 2024-06-10T00:13:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-06-10 00:11:14.030740301 +0000 2024-06-10T00:13:44.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-10T00:13:44.254 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-06-10T00:13:44.254 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-06-10T00:13:44.254 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000171546 s, 3.0 MB/s 2024-06-10T00:13:44.255 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-10T00:13:44.310 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 726 Links: 1 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-06-10 00:13:32.391013181 +0000 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-06-10 00:11:14.346734094 +0000 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-06-10 00:11:14.346734094 +0000 2024-06-10T00:13:44.366 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-06-10 00:11:14.346734094 +0000 2024-06-10T00:13:44.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-10T00:13:44.429 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-06-10T00:13:44.429 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-06-10T00:13:44.429 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000259653 s, 2.0 MB/s 2024-06-10T00:13:44.430 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-10T00:13:44.485 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-10T00:13:44.486 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-10T00:13:44.486 INFO:tasks.ceph:Generating config... 2024-06-10T00:13:44.487 INFO:tasks.ceph:[client] client mount timeout = 600 2024-06-10T00:13:44.487 INFO:tasks.ceph:[client] debug client = 20 2024-06-10T00:13:44.487 INFO:tasks.ceph:[client] debug ms = 1 2024-06-10T00:13:44.487 INFO:tasks.ceph:[client] pid file = 2024-06-10T00:13:44.487 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-06-10T00:13:44.487 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-06-10T00:13:44.487 INFO:tasks.ceph:[mds] debug mds = 20 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] debug ms = 1 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] mds debug frag = True 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mgr] debug client = 20 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mgr] debug ms = 1 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mon] debug mon = 20 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mon] debug ms = 1 2024-06-10T00:13:44.488 INFO:tasks.ceph:[mon] debug paxos = 20 2024-06-10T00:13:44.489 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-06-10T00:13:44.489 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] debug ms = 1 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] debug osd = 20 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-06-10T00:13:44.489 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-06-10T00:13:44.490 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-06-10T00:13:44.490 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-06-10T00:13:44.490 INFO:tasks.ceph:Setting up mon.a... 2024-06-10T00:13:44.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-06-10T00:13:44.554 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2024-06-10T00:13:44.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-06-10T00:13:44.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-10T00:13:44.665 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2024-06-10T00:13:44.666 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-06-10T00:13:44.667 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:44.667 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-06-10T00:13:44.721 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.79 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:13:44.807 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:13:44.807 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:13:44.807 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = quincy 2024-06-10T00:13:44.807 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2024-06-10T00:13:44.807 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:13:44.808 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2024-06-10T00:13:44.808864+0000 2024-06-10T00:13:44.808 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-06-10T00:13:44.808864+0000 2024-06-10T00:13:44.808 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 17 (quincy) 2024-06-10T00:13:44.808 INFO:teuthology.orchestra.run.smithi079.stdout:election_strategy: 1 2024-06-10T00:13:44.808 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-06-10T00:13:44.808 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-06-10T00:13:44.808 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2024-06-10T00:13:44.808 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-06-10T00:13:44.809 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-06-10T00:13:44.824 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8b20248b-d94c-44bd-ba6f-faf8829473b3... 2024-06-10T00:13:44.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:13:44.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:13:44.906 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-06-10T00:13:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-06-10T00:13:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-06-10T00:13:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-06-10T00:13:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-06-10T00:13:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2024-06-10T00:13:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:13:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:13:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-06-10T00:13:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:13:44.916 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-06-10T00:13:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2024-06-10T00:13:44.918 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:13:44.918 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:13:44.918 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:13:44.918 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-06-10T00:13:44.918 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-06-10T00:13:44.918 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:13:44.918 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-06-10T00:13:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:13:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:13:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-06-10T00:13:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-06-10T00:13:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:13:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:13:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-06-10T00:13:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-06-10T00:13:44.928 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:13:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:13:44.931 INFO:tasks.ceph:Creating admin key on mon.a... 2024-06-10T00:13:44.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-06-10T00:13:45.024 INFO:tasks.ceph:Copying monmap to all nodes... 2024-06-10T00:13:45.025 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:45.025 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-06-10T00:13:45.040 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:45.040 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-06-10T00:13:45.095 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:13:45.095 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:45.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-10T00:13:45.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-10T00:13:45.170 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:13:45.170 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:13:45.224 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:13:45.224 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:13:45.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-10T00:13:45.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-10T00:13:45.259 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:13:45.259 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:13:45.314 INFO:tasks.ceph:Setting up mon nodes... 2024-06-10T00:13:45.314 INFO:tasks.ceph:Setting up mgr nodes... 2024-06-10T00:13:45.314 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-06-10T00:13:45.365 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-06-10T00:13:45.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-06-10T00:13:45.431 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-06-10T00:13:45.433 INFO:tasks.ceph:Setting up mds nodes... 2024-06-10T00:13:45.433 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-06-10T00:13:45.484 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-06-10T00:13:45.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-06-10T00:13:45.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-06-10T00:13:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-06-10T00:13:45.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-06-10T00:13:45.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-06-10T00:13:45.678 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-06-10T00:13:45.680 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-06-10T00:13:45.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-06-10T00:13:45.794 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-06-10T00:13:45.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-06-10T00:13:45.820 INFO:tasks.ceph_client:Setting up client nodes... 2024-06-10T00:13:45.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-10T00:13:45.862 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-06-10T00:13:45.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-06-10T00:13:45.955 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-06-10T00:13:45.968 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-10T00:13:46.009 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-06-10T00:13:46.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-06-10T00:13:46.102 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-06-10T00:13:46.114 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-06-10T00:13:46.114 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-10T00:13:46.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-06-10T00:13:46.139 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-10T00:13:46.139 INFO:tasks.ceph:role: osd.0 2024-06-10T00:13:46.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:13:46.139 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-10T00:13:46.210 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-10T00:13:46.211 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-10T00:13:46.694 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-06-10T00:13:46.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-06-10T00:13:46.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-06-10T00:13:46.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-06-10T00:13:46.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-06-10T00:13:46.901 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-10T00:13:46.901 INFO:tasks.ceph:role: osd.1 2024-06-10T00:13:46.901 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:13:46.901 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-10T00:13:46.973 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-10T00:13:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-10T00:13:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-10T00:13:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-10T00:13:46.973 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-10T00:13:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-06-10T00:13:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-10T00:13:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-10T00:13:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-10T00:13:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-10T00:13:47.436 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-06-10T00:13:47.438 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-06-10T00:13:47.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-06-10T00:13:47.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-06-10T00:13:47.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-06-10T00:13:47.646 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-10T00:13:47.646 INFO:tasks.ceph:role: osd.2 2024-06-10T00:13:47.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:13:47.647 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-10T00:13:47.718 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-10T00:13:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-10T00:13:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-10T00:13:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-10T00:13:47.718 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-10T00:13:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-06-10T00:13:47.719 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-10T00:13:47.719 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-10T00:13:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-10T00:13:47.719 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-10T00:13:48.203 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-06-10T00:13:48.205 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-06-10T00:13:48.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-06-10T00:13:48.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-06-10T00:13:48.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-06-10T00:13:48.395 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-10T00:13:48.395 INFO:tasks.ceph:role: osd.3 2024-06-10T00:13:48.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:13:48.395 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-10T00:13:48.468 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-10T00:13:48.469 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-10T00:13:48.976 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-06-10T00:13:48.978 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-06-10T00:13:48.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-06-10T00:13:49.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-06-10T00:13:49.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:13:49.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:49.245+0000 7f277da19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-06-10T00:13:49.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:49.249+0000 7f277da19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-06-10T00:13:49.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:49.249+0000 7f277da19640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-10T00:13:49.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:49.250+0000 7f277da19640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-10T00:13:49.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:49.250+0000 7f277da19640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-10T00:13:49.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:49.257+0000 7f277da19640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-06-10T00:13:52.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-10T00:13:52.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:13:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:52.238+0000 7f7f9da18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-06-10T00:13:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:52.238+0000 7f7f9da18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-06-10T00:13:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:52.238+0000 7f7f9da18640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-10T00:13:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:52.238+0000 7f7f9da18640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-10T00:13:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:52.238+0000 7f7f9da18640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-10T00:13:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:52.239+0000 7f7f9da18640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-06-10T00:13:55.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-10T00:13:55.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:13:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:55.202+0000 7f8781232640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-06-10T00:13:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:55.202+0000 7f8781232640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-06-10T00:13:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:55.202+0000 7f8781232640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-10T00:13:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:55.202+0000 7f8781232640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-10T00:13:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:55.202+0000 7f8781232640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-10T00:13:55.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:55.203+0000 7f8781232640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-06-10T00:13:58.053 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-10T00:13:58.082 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:13:58.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:58.173+0000 7f4c0e61e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-06-10T00:13:58.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:58.173+0000 7f4c0e61e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-06-10T00:13:58.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:58.173+0000 7f4c0e61e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-10T00:13:58.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:58.173+0000 7f4c0e61e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-10T00:13:58.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:58.173+0000 7f4c0e61e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-10T00:13:58.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:13:58.174+0000 7f4c0e61e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-06-10T00:14:01.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-10T00:14:01.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-06-10T00:14:01.088 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-10T00:14:01.088 INFO:tasks.ceph:role: osd.4 2024-06-10T00:14:01.088 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:14:01.088 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-10T00:14:01.164 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-10T00:14:01.164 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-10T00:14:01.165 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-10T00:14:01.165 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-10T00:14:01.165 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-10T00:14:01.165 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-06-10T00:14:01.165 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-10T00:14:01.165 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-10T00:14:01.165 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-10T00:14:01.165 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-10T00:14:01.662 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-06-10T00:14:01.664 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-06-10T00:14:01.664 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-06-10T00:14:01.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-06-10T00:14:01.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-06-10T00:14:01.890 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-10T00:14:01.890 INFO:tasks.ceph:role: osd.5 2024-06-10T00:14:01.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:14:01.890 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-10T00:14:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-10T00:14:01.981 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-10T00:14:02.438 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-06-10T00:14:02.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-06-10T00:14:02.440 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-06-10T00:14:02.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-06-10T00:14:02.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-06-10T00:14:02.578 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-10T00:14:02.578 INFO:tasks.ceph:role: osd.6 2024-06-10T00:14:02.578 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:14:02.579 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-10T00:14:02.651 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-10T00:14:02.651 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-10T00:14:02.651 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-10T00:14:02.651 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-10T00:14:02.652 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-10T00:14:02.652 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-06-10T00:14:02.652 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-10T00:14:02.652 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-10T00:14:02.652 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-10T00:14:02.652 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-10T00:14:03.141 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-06-10T00:14:03.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-06-10T00:14:03.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-06-10T00:14:03.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-06-10T00:14:03.316 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-06-10T00:14:03.382 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-10T00:14:03.382 INFO:tasks.ceph:role: osd.7 2024-06-10T00:14:03.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:14:03.383 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-10T00:14:03.455 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-10T00:14:03.455 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-10T00:14:03.455 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-10T00:14:03.456 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-10T00:14:03.456 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-10T00:14:03.456 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-06-10T00:14:03.456 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-10T00:14:03.456 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-10T00:14:03.456 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-10T00:14:03.456 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-10T00:14:03.937 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-06-10T00:14:03.939 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-06-10T00:14:03.939 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-06-10T00:14:04.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-06-10T00:14:04.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:14:04.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:04.222+0000 7fbdbce86640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-06-10T00:14:04.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:04.222+0000 7fbdbce86640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-06-10T00:14:04.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:04.222+0000 7fbdbce86640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-10T00:14:04.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:04.222+0000 7fbdbce86640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-10T00:14:04.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:04.222+0000 7fbdbce86640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-10T00:14:04.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:04.223+0000 7fbdbce86640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-06-10T00:14:07.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-10T00:14:07.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:14:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:07.198+0000 7f0688a1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-06-10T00:14:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:07.199+0000 7f0688a1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-06-10T00:14:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:07.199+0000 7f0688a1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-10T00:14:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:07.199+0000 7f0688a1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-10T00:14:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:07.199+0000 7f0688a1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-10T00:14:07.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:07.199+0000 7f0688a1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-06-10T00:14:10.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-10T00:14:10.080 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:14:10.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:10.170+0000 7f084b423640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-06-10T00:14:10.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:10.170+0000 7f084b423640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-06-10T00:14:10.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:10.170+0000 7f084b423640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-10T00:14:10.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:10.170+0000 7f084b423640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-10T00:14:10.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:10.170+0000 7f084b423640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-10T00:14:10.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:10.171+0000 7f084b423640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-06-10T00:14:12.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:14:12.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:14:13.034 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-10T00:14:13.102 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:14:13.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:13.192+0000 7fa3d7157640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-06-10T00:14:13.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:13.192+0000 7fa3d7157640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-06-10T00:14:13.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:13.192+0000 7fa3d7157640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-10T00:14:13.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:13.192+0000 7fa3d7157640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-10T00:14:13.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:13.192+0000 7fa3d7157640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-10T00:14:13.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:13.193+0000 7fa3d7157640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-06-10T00:14:16.052 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-10T00:14:16.081 INFO:tasks.ceph:Reading keys from all nodes... 2024-06-10T00:14:16.081 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-06-10T00:14:16.111 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-06-10T00:14:16.179 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.179 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-06-10T00:14:16.247 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-06-10T00:14:16.314 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.314 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-06-10T00:14:16.381 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-06-10T00:14:16.447 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-06-10T00:14:16.512 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:16.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-06-10T00:14:16.543 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:16.543 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-06-10T00:14:16.611 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:16.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-06-10T00:14:16.679 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:16.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-06-10T00:14:16.746 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:16.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-06-10T00:14:16.813 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:16.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-06-10T00:14:16.878 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:16.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-06-10T00:14:16.942 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.943 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-06-10T00:14:16.959 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:16.959 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-06-10T00:14:17.015 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:17.016 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-06-10T00:14:17.031 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:17.031 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-06-10T00:14:17.086 INFO:tasks.ceph:Adding keys to all mons... 2024-06-10T00:14:17.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-10T00:14:17.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-10T00:14:17.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2024-06-10T00:14:17.129 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw== 2024-06-10T00:14:17.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-06-10T00:14:17.129 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA== 2024-06-10T00:14:17.129 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-06-10T00:14:17.129 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ== 2024-06-10T00:14:17.129 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw== 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg== 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg== 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g== 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA== 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow== 2024-06-10T00:14:17.130 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw== 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw== 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw== 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ== 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2024-06-10T00:14:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA== 2024-06-10T00:14:17.132 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-06-10T00:14:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:14:17.132 INFO:teuthology.orchestra.run.smithi079.stdout:[client.2] 2024-06-10T00:14:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A== 2024-06-10T00:14:17.132 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2024-06-10T00:14:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA== 2024-06-10T00:14:17.132 INFO:teuthology.orchestra.run.smithi079.stdout:[client.3] 2024-06-10T00:14:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw== 2024-06-10T00:14:17.148 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-06-10T00:14:17.148 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw== 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA== 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ== 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw== 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg== 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg== 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g== 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-06-10T00:14:17.149 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA== 2024-06-10T00:14:17.150 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-06-10T00:14:17.150 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow== 2024-06-10T00:14:17.150 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-06-10T00:14:17.150 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw== 2024-06-10T00:14:17.150 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-06-10T00:14:17.150 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw== 2024-06-10T00:14:17.150 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-06-10T00:14:17.150 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw== 2024-06-10T00:14:17.151 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-06-10T00:14:17.151 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ== 2024-06-10T00:14:17.151 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-06-10T00:14:17.151 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA== 2024-06-10T00:14:17.151 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-06-10T00:14:17.151 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:14:17.151 INFO:teuthology.orchestra.run.smithi117.stdout:[client.2] 2024-06-10T00:14:17.151 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A== 2024-06-10T00:14:17.152 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-06-10T00:14:17.152 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA== 2024-06-10T00:14:17.152 INFO:teuthology.orchestra.run.smithi117.stdout:[client.3] 2024-06-10T00:14:17.152 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw== 2024-06-10T00:14:17.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-10T00:14:17.176 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-10T00:14:17.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-10T00:14:17.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-10T00:14:17.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-10T00:14:17.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-10T00:14:17.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.355 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.406 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.460 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-10T00:14:17.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-10T00:14:17.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-10T00:14:17.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-10T00:14:17.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-10T00:14:17.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-10T00:14:17.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.728 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.833 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-10T00:14:17.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-10T00:14:17.937 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-10T00:14:17.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-10T00:14:17.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-10T00:14:18.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-10T00:14:18.049 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-10T00:14:18.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-10T00:14:18.104 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-10T00:14:18.157 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-06-10T00:14:18.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-06-10T00:14:18.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-10T00:14:18.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-06-10T00:14:18.303 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-06-10T00:14:18.328 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-10T00:14:18.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-06-10T00:14:18.448 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-06-10T00:14:18.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-10T00:14:18.607 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-06-10T00:14:18.631 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:14:18.634 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-10T00:14:18.687 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-06-10T00:14:18.687 INFO:tasks.ceph.mon.a:Restarting daemon 2024-06-10T00:14:18.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-06-10T00:14:18.690 INFO:tasks.ceph.mon.a:Started 2024-06-10T00:14:18.690 INFO:tasks.ceph.mon.b:Restarting daemon 2024-06-10T00:14:18.690 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-06-10T00:14:18.729 INFO:tasks.ceph.mon.b:Started 2024-06-10T00:14:18.729 INFO:tasks.ceph.mon.c:Restarting daemon 2024-06-10T00:14:18.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-06-10T00:14:18.731 INFO:tasks.ceph.mon.c:Started 2024-06-10T00:14:18.732 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-06-10T00:14:18.732 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-06-10T00:14:18.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-06-10T00:14:18.734 INFO:tasks.ceph.mgr.y:Started 2024-06-10T00:14:18.734 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-06-10T00:14:18.734 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-06-10T00:14:18.736 INFO:tasks.ceph.mgr.x:Started 2024-06-10T00:14:18.737 INFO:tasks.ceph:Setting crush tunables to default 2024-06-10T00:14:18.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2024-06-10T00:14:18.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.836+0000 7fe74d1a9640 1 Processor -- start 2024-06-10T00:14:18.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.836+0000 7fe74d1a9640 1 -- start start 2024-06-10T00:14:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe74d1a9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe74815f700 0x7fe7480cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe74d1a9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74806f3f0 con 0x7fe7480cef50 2024-06-10T00:14:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe74d1a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7480d0bc0 con 0x7fe7480d0400 2024-06-10T00:14:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe74d1a9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe74806f690 con 0x7fe74815f700 2024-06-10T00:14:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe74759e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe7480cef50 0x7fe74806fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38262/0 (socket says 172.21.15.79:38262) 2024-06-10T00:14:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe74759e640 1 -- 172.21.15.79:0/899004484 learned_addr learned my addr 172.21.15.79:0/899004484 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe746d9d640 1 --2- 172.21.15.79:0/899004484 >> v2:172.21.15.117:3300/0 conn(0x7fe74815f700 0x7fe7480cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe746d9d640 1 -- 172.21.15.79:0/899004484 >> v2:172.21.15.117:3300/0 conn(0x7fe74815f700 msgr2=0x7fe7480cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-10T00:14:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe746d9d640 1 -- 172.21.15.79:0/899004484 >> v2:172.21.15.117:3300/0 conn(0x7fe74815f700 msgr2=0x7fe7480cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-10T00:14:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe746d9d640 1 --2- 172.21.15.79:0/899004484 >> v2:172.21.15.117:3300/0 conn(0x7fe74815f700 0x7fe7480cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-10T00:14:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.837+0000 7fe746d9d640 1 --2- 172.21.15.79:0/899004484 >> v2:172.21.15.117:3300/0 conn(0x7fe74815f700 0x7fe7480cf450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-10T00:14:19.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881885796 0 0) 0x7fe7480d0bc0 con 0x7fe7480d0400 2024-06-10T00:14:19.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe734003520 con 0x7fe7480d0400 2024-06-10T00:14:19.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2406056481 0 0) 0x7fe74806f3f0 con 0x7fe7480cef50 2024-06-10T00:14:19.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7480d0bc0 con 0x7fe7480cef50 2024-06-10T00:14:19.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2898437615 0 0) 0x7fe734003520 con 0x7fe7480d0400 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 >> v2:172.21.15.117:3300/0 conn(0x7fe74815f700 msgr2=0x7fe7480cf450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 --2- 172.21.15.79:0/899004484 >> v2:172.21.15.117:3300/0 conn(0x7fe74815f700 0x7fe7480cf450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 >> v1:172.21.15.79:6789/0 conn(0x7fe7480cef50 legacy=0x7fe74806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74806f970 con 0x7fe7480d0400 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fe730001670 con 0x7fe7480d0400 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 >> v1:172.21.15.117:6789/0 conn(0x7fe7480d0400 legacy=0x7fe7480ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734003b90 0x7fe734003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe734004800 0x7fe734004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe73400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe74806f690 con 0x7fe734005330 2024-06-10T00:14:19.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe73400c280 con 0x7fe734004800 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe73400c480 con 0x7fe734003b90 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe74759e640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe73400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe746d9d640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734003b90 0x7fe734003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:18.999+0000 7fe73e59c640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe734004800 0x7fe734004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74759e640 1 -- 172.21.15.79:0/899004484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734003b90 msgr2=0x7fe734003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74759e640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734003b90 0x7fe734003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74759e640 1 -- 172.21.15.79:0/899004484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe734004800 msgr2=0x7fe734004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74759e640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe734004800 0x7fe734004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74759e640 1 -- 172.21.15.79:0/899004484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe734003520 con 0x7fe734005330 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74759e640 1 -- 172.21.15.79:0/899004484 reap_dead start 2024-06-10T00:14:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74759e640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe73400b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c2f0 tx=0x7fe734005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367aac40859b8753 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740036070 con 0x7fe734005330 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74002d070 con 0x7fe734005330 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.000+0000 7fe74659c640 1 -- 172.21.15.79:0/899004484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740002070 con 0x7fe734005330 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.001+0000 7fe74d1a9640 1 -- 172.21.15.79:0/899004484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 msgr2=0x7fe73400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.001+0000 7fe74d1a9640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe73400b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c2f0 tx=0x7fe734005830 comp rx=0 tx=0).stop 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.001+0000 7fe74d1a9640 1 -- 172.21.15.79:0/899004484 shutdown_connections 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.001+0000 7fe74d1a9640 1 --2- 172.21.15.79:0/899004484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe73400b9c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.001+0000 7fe74d1a9640 1 -- 172.21.15.79:0/899004484 >> 172.21.15.79:0/899004484 conn(0x7fe7480d1e70 msgr2=0x7fe7480d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.001+0000 7fe74d1a9640 1 -- 172.21.15.79:0/899004484 shutdown_connections 2024-06-10T00:14:19.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.001+0000 7fe74d1a9640 1 -- 172.21.15.79:0/899004484 wait complete. 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.003+0000 7fe74d1a9640 1 Processor -- start 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.003+0000 7fe74d1a9640 1 -- start start 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.003+0000 7fe74d1a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe7480ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.003+0000 7fe74d1a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7480c9fa0 0x7fe7480cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.003+0000 7fe74d1a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cb7a0 0x7fe7481fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.003+0000 7fe74d1a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7480d0850 con 0x7fe734005330 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.003+0000 7fe74d1a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe7480d0ea0 con 0x7fe7480c9fa0 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.003+0000 7fe74d1a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe7480cf450 con 0x7fe7480cb7a0 2024-06-10T00:14:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe7480ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe7480ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38322/0 (socket says 172.21.15.79:38322) 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 -- 172.21.15.79:0/3121409925 learned_addr learned my addr 172.21.15.79:0/3121409925 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe73e59c640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7480c9fa0 0x7fe7480cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe74759e640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cb7a0 0x7fe7481fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 -- 172.21.15.79:0/3121409925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cb7a0 msgr2=0x7fe7481fbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cb7a0 0x7fe7481fbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 -- 172.21.15.79:0/3121409925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7480c9fa0 msgr2=0x7fe7480cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7480c9fa0 0x7fe7480cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 -- 172.21.15.79:0/3121409925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7480c8f40 con 0x7fe734005330 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe746d9d640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe7480ca900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7380108f0 tx=0x7fe738010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe73ffff640 1 -- 172.21.15.79:0/3121409925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73801a020 con 0x7fe734005330 2024-06-10T00:14:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe73ffff640 1 -- 172.21.15.79:0/3121409925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73800e750 con 0x7fe734005330 2024-06-10T00:14:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7480cae40 con 0x7fe734005330 2024-06-10T00:14:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe73ffff640 1 -- 172.21.15.79:0/3121409925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73800eb40 con 0x7fe734005330 2024-06-10T00:14:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7480c94c0 con 0x7fe734005330 2024-06-10T00:14:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe73ffff640 1 -- 172.21.15.79:0/3121409925 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe73801d020 con 0x7fe734005330 2024-06-10T00:14:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.004+0000 7fe73ffff640 1 -- 172.21.15.79:0/3121409925 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe7380147d0 con 0x7fe734005330 2024-06-10T00:14:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.005+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7480683c0 con 0x7fe734005330 2024-06-10T00:14:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.007+0000 7fe73ffff640 1 -- 172.21.15.79:0/3121409925 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe738024020 con 0x7fe734005330 2024-06-10T00:14:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.073+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe7480cbb80 con 0x7fe734005330 2024-06-10T00:14:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.075+0000 7fe73ffff640 1 -- 172.21.15.79:0/3121409925 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe73800ece0 con 0x7fe734005330 2024-06-10T00:14:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-06-10T00:14:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 msgr2=0x7fe7480ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe7480ca900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7380108f0 tx=0x7fe738010cf0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 shutdown_connections 2024-06-10T00:14:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cb7a0 0x7fe7481fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7480c9fa0 0x7fe7480cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 --2- 172.21.15.79:0/3121409925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe734005330 0x7fe7480ca900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 >> 172.21.15.79:0/3121409925 conn(0x7fe7480d1e70 msgr2=0x7fe7480b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 shutdown_connections 2024-06-10T00:14:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:19.076+0000 7fe74d1a9640 1 -- 172.21.15.79:0/3121409925 wait complete. 2024-06-10T00:14:19.090 INFO:tasks.ceph:check_enable_crimson: False 2024-06-10T00:14:19.090 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-06-10T00:14:19.091 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:19.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-06-10T00:14:19.118 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:19.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-06-10T00:14:19.119 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:19.120+0000 7f7184821040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-10T00:14:19.128 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:19.128+0000 7fed27616040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-10T00:14:19.151 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:19.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-06-10T00:14:19.216 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:19.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-06-10T00:14:19.281 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:19.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-06-10T00:14:19.281 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:19.282+0000 7f7184821040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-10T00:14:19.282 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:19.283+0000 7fed27616040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-10T00:14:19.305 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:19.306 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-06-10T00:14:19.338 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:19.337+0000 7fed27616040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-10T00:14:19.338 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:19.338+0000 7f7184821040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-10T00:14:19.363 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:19.363 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-06-10T00:14:19.428 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:14:19.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-06-10T00:14:19.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 8fe5b02f-a366-4f2b-8196-055149f5c0b1 0 2024-06-10T00:14:19.588 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:19.589+0000 7fed27616040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-10T00:14:19.590 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:19.591+0000 7f7184821040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-10T00:14:19.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.633+0000 7f60d7990640 1 Processor -- start 2024-06-10T00:14:19.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.633+0000 7f60d7990640 1 -- start start 2024-06-10T00:14:19.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d7990640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60d0158a50 0x7f60d0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d7990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d015bf30 0x7f60d0072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d7990640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d015c3c0 con 0x7f60d00b5170 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d7990640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f60d00b4740 con 0x7f60d0158a50 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d7990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60d00b3e10 con 0x7f60d015bf30 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d4f2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d015bf30 0x7f60d0072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d4f2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d015bf30 0x7f60d0072500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54320/0 (socket says 172.21.15.117:54320) 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d4f2b640 1 -- 172.21.15.117:0/156652649 learned_addr learned my addr 172.21.15.117:0/156652649 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d572c640 1 --2- 172.21.15.117:0/156652649 >> v2:172.21.15.117:3300/0 conn(0x7f60d0158a50 0x7f60d0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d4f2b640 1 -- 172.21.15.117:0/156652649 >> v2:172.21.15.117:3300/0 conn(0x7f60d0158a50 msgr2=0x7f60d0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.634+0000 7f60d4f2b640 1 --2- 172.21.15.117:0/156652649 >> v2:172.21.15.117:3300/0 conn(0x7f60d0158a50 0x7f60d0071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.635+0000 7f60d4f2b640 1 -- 172.21.15.117:0/156652649 >> v1:172.21.15.79:6789/0 conn(0x7f60d00b5170 legacy=0x7f60d015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.635+0000 7f60d4f2b640 1 -- 172.21.15.117:0/156652649 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d00b40f0 con 0x7f60d015bf30 2024-06-10T00:14:19.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.635+0000 7f60d4f2b640 1 --2- 172.21.15.117:0/156652649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d015bf30 0x7f60d0072500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00bb40 tx=0x7f60cc02c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594043c22f417fdf server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:19.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.635+0000 7f60c7fff640 1 -- 172.21.15.117:0/156652649 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc036020 con 0x7f60d015bf30 2024-06-10T00:14:19.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.635+0000 7f60c7fff640 1 -- 172.21.15.117:0/156652649 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60cc032820 con 0x7f60d015bf30 2024-06-10T00:14:19.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.635+0000 7f60c7fff640 1 -- 172.21.15.117:0/156652649 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc032bf0 con 0x7f60d015bf30 2024-06-10T00:14:19.636 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:19.634+0000 7fed27616040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-10T00:14:19.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.636+0000 7f60d7990640 1 -- 172.21.15.117:0/156652649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d015bf30 msgr2=0x7f60d0072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.636+0000 7f60d7990640 1 --2- 172.21.15.117:0/156652649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d015bf30 0x7f60d0072500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00bb40 tx=0x7f60cc02c960 comp rx=0 tx=0).stop 2024-06-10T00:14:19.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.636+0000 7f60d7990640 1 -- 172.21.15.117:0/156652649 shutdown_connections 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.636+0000 7f60d7990640 1 --2- 172.21.15.117:0/156652649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d015bf30 0x7f60d0072500 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.636+0000 7f60d7990640 1 --2- 172.21.15.117:0/156652649 >> v2:172.21.15.117:3300/0 conn(0x7f60d0158a50 0x7f60d0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.636+0000 7f60d7990640 1 -- 172.21.15.117:0/156652649 >> 172.21.15.117:0/156652649 conn(0x7f60d006cff0 msgr2=0x7f60d00b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.636+0000 7f60d7990640 1 -- 172.21.15.117:0/156652649 shutdown_connections 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.636+0000 7f60d7990640 1 -- 172.21.15.117:0/156652649 wait complete. 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.637+0000 7f60d7990640 1 Processor -- start 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.637+0000 7f60d7990640 1 -- start start 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d7990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60d00b5170 0x7f60d0151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d7990640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d0158a50 0x7f60d00b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d7990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d0151a90 0x7f60d01efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d7990640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60d006fa60 con 0x7f60d00b5170 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d7990640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60d0158e30 con 0x7f60d0158a50 2024-06-10T00:14:19.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d7990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60d00b4bd0 con 0x7f60d0151a90 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d4f2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d0158a50 0x7f60d00b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d5f2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d0151a90 0x7f60d01efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d4f2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d0158a50 0x7f60d00b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45764/0 (socket says 172.21.15.117:45764) 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d4f2b640 1 -- 172.21.15.117:0/4265483671 learned_addr learned my addr 172.21.15.117:0/4265483671 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d572c640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60d00b5170 0x7f60d0151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d5f2d640 1 -- 172.21.15.117:0/4265483671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d0158a50 msgr2=0x7f60d00b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d5f2d640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d0158a50 0x7f60d00b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d5f2d640 1 -- 172.21.15.117:0/4265483671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60d00b5170 msgr2=0x7f60d0151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d5f2d640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60d00b5170 0x7f60d0151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d5f2d640 1 -- 172.21.15.117:0/4265483671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d01e4a40 con 0x7f60d0151a90 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.638+0000 7f60d4f2b640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d0158a50 0x7f60d00b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.639+0000 7f60d5f2d640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d0151a90 0x7f60d01efc70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f60d00cd720 tx=0x7f60c800cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:19.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.639+0000 7f60c5ffb640 1 -- 172.21.15.117:0/4265483671 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8003b70 con 0x7f60d0151a90 2024-06-10T00:14:19.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.639+0000 7f60c5ffb640 1 -- 172.21.15.117:0/4265483671 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c8003d10 con 0x7f60d0151a90 2024-06-10T00:14:19.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.639+0000 7f60c5ffb640 1 -- 172.21.15.117:0/4265483671 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8005310 con 0x7f60d0151a90 2024-06-10T00:14:19.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.639+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d01e4480 con 0x7f60d0151a90 2024-06-10T00:14:19.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.639+0000 7f60c5ffb640 1 -- 172.21.15.117:0/4265483671 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60c80054b0 con 0x7f60d0151a90 2024-06-10T00:14:19.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.639+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d00b1490 con 0x7f60d0151a90 2024-06-10T00:14:19.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.639+0000 7f60c5ffb640 1 -- 172.21.15.117:0/4265483671 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f60c800a980 con 0x7f60d0151a90 2024-06-10T00:14:19.642 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:19.640+0000 7f7184821040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-10T00:14:19.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.640+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d0068ad0 con 0x7f60d0151a90 2024-06-10T00:14:19.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.642+0000 7f60c5ffb640 1 -- 172.21.15.117:0/4265483671 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f60c800ab80 con 0x7f60d0151a90 2024-06-10T00:14:19.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.713+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8fe5b02f-a366-4f2b-8196-055149f5c0b1", "id": 0} v 0) -- 0x7f60d015aef0 con 0x7f60d0151a90 2024-06-10T00:14:19.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.719+0000 7f60c5ffb640 1 -- 172.21.15.117:0/4265483671 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fe5b02f-a366-4f2b-8196-055149f5c0b1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f60c8025430 con 0x7f60d0151a90 2024-06-10T00:14:19.718 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-06-10T00:14:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d0151a90 msgr2=0x7f60d01efc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d0151a90 0x7f60d01efc70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f60d00cd720 tx=0x7f60c800cb90 comp rx=0 tx=0).stop 2024-06-10T00:14:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 shutdown_connections 2024-06-10T00:14:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d0151a90 0x7f60d01efc70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d0158a50 0x7f60d00b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 --2- 172.21.15.117:0/4265483671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60d00b5170 0x7f60d0151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 >> 172.21.15.117:0/4265483671 conn(0x7f60d006cff0 msgr2=0x7f60d015cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 shutdown_connections 2024-06-10T00:14:19.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.720+0000 7f60d7990640 1 -- 172.21.15.117:0/4265483671 wait complete. 2024-06-10T00:14:19.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 657ccf9c-6301-4c19-b2a0-9660aa22bd2d 1 2024-06-10T00:14:19.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.829+0000 7f78ce722640 1 Processor -- start 2024-06-10T00:14:19.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.829+0000 7f78ce722640 1 -- start start 2024-06-10T00:14:19.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.829+0000 7f78ce722640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c80725a0 0x7f78c80cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.829+0000 7f78ce722640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c815b4d0 con 0x7f78c815b0f0 2024-06-10T00:14:19.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.829+0000 7f78ce722640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c80b4de0 con 0x7f78c8072140 2024-06-10T00:14:19.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.829+0000 7f78ce722640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f78c80b5e80 con 0x7f78c80725a0 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.830+0000 7f78c77fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f78c8072140 0x7f78c80cec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33980/0 (socket says 172.21.15.117:33980) 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.830+0000 7f78c77fe640 1 -- 172.21.15.117:0/1194438087 learned_addr learned my addr 172.21.15.117:0/1194438087 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.830+0000 7f78cccbf640 1 --2- 172.21.15.117:0/1194438087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c80725a0 0x7f78c80cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.830+0000 7f78c6ffd640 1 -- 172.21.15.117:0/1194438087 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690618508 0 0) 0x7f78c80b4de0 con 0x7f78c8072140 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.830+0000 7f78c6ffd640 1 -- 172.21.15.117:0/1194438087 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b0003520 con 0x7f78c8072140 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.830+0000 7f78cccbf640 1 -- 172.21.15.117:0/1194438087 >> v1:172.21.15.117:6789/0 conn(0x7f78c8072140 legacy=0x7f78c80cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.830+0000 7f78cccbf640 1 -- 172.21.15.117:0/1194438087 >> v1:172.21.15.79:6789/0 conn(0x7f78c815b0f0 legacy=0x7f78c806f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.830+0000 7f78cccbf640 1 -- 172.21.15.117:0/1194438087 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c80b50c0 con 0x7f78c80725a0 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.831+0000 7f78cccbf640 1 --2- 172.21.15.117:0/1194438087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c80725a0 0x7f78c80cf340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009dc0 tx=0x7f78c002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12eb63836bf76392 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.831+0000 7f78c6ffd640 1 -- 172.21.15.117:0/1194438087 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0007740 con 0x7f78c80725a0 2024-06-10T00:14:19.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.831+0000 7f78c6ffd640 1 -- 172.21.15.117:0/1194438087 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c00078e0 con 0x7f78c80725a0 2024-06-10T00:14:19.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.831+0000 7f78c6ffd640 1 -- 172.21.15.117:0/1194438087 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0007cb0 con 0x7f78c80725a0 2024-06-10T00:14:19.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.832+0000 7f78ce722640 1 -- 172.21.15.117:0/1194438087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c80725a0 msgr2=0x7f78c80cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.832+0000 7f78ce722640 1 --2- 172.21.15.117:0/1194438087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c80725a0 0x7f78c80cf340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009dc0 tx=0x7f78c002a6d0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.832+0000 7f78ce722640 1 -- 172.21.15.117:0/1194438087 shutdown_connections 2024-06-10T00:14:19.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.832+0000 7f78ce722640 1 --2- 172.21.15.117:0/1194438087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c80725a0 0x7f78c80cf340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.832+0000 7f78ce722640 1 -- 172.21.15.117:0/1194438087 >> 172.21.15.117:0/1194438087 conn(0x7f78c80b2ae0 msgr2=0x7f78c80b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:19.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.832+0000 7f78ce722640 1 -- 172.21.15.117:0/1194438087 shutdown_connections 2024-06-10T00:14:19.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.832+0000 7f78ce722640 1 -- 172.21.15.117:0/1194438087 wait complete. 2024-06-10T00:14:19.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.833+0000 7f78ce722640 1 Processor -- start 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.833+0000 7f78ce722640 1 -- start start 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78ce722640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c8072140 0x7f78c81525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78ce722640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c80725a0 0x7f78c809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78ce722640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c815b0f0 0x7f78c80ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78ce722640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78c80b5680 con 0x7f78c815b0f0 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78ce722640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f78c80b59f0 con 0x7f78c80725a0 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78ce722640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f78c8072a30 con 0x7f78c8072140 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c80725a0 0x7f78c809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c8072140 0x7f78c81525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c8072140 0x7f78c81525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54350/0 (socket says 172.21.15.117:54350) 2024-06-10T00:14:19.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c80725a0 0x7f78c809aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45778/0 (socket says 172.21.15.117:45778) 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 -- 172.21.15.117:0/3895640159 learned_addr learned my addr 172.21.15.117:0/3895640159 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78cccbf640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c815b0f0 0x7f78c80ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 -- 172.21.15.117:0/3895640159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c80725a0 msgr2=0x7f78c809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c80725a0 0x7f78c809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 -- 172.21.15.117:0/3895640159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c815b0f0 msgr2=0x7f78c80ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c815b0f0 0x7f78c80ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 -- 172.21.15.117:0/3895640159 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c8159a80 con 0x7f78c8072140 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c77fe640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c80725a0 0x7f78c809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.834+0000 7f78c7fff640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c8072140 0x7f78c81525d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c480 tx=0x7f78b800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.835+0000 7f78c4ff9640 1 -- 172.21.15.117:0/3895640159 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b80052d0 con 0x7f78c8072140 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.835+0000 7f78c4ff9640 1 -- 172.21.15.117:0/3895640159 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b8005470 con 0x7f78c8072140 2024-06-10T00:14:19.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.835+0000 7f78c4ff9640 1 -- 172.21.15.117:0/3895640159 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8012870 con 0x7f78c8072140 2024-06-10T00:14:19.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.835+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c809d3e0 con 0x7f78c8072140 2024-06-10T00:14:19.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.835+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c809d9a0 con 0x7f78c8072140 2024-06-10T00:14:19.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.835+0000 7f78c4ff9640 1 -- 172.21.15.117:0/3895640159 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f78b8012a10 con 0x7f78c8072140 2024-06-10T00:14:19.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.835+0000 7f78c4ff9640 1 -- 172.21.15.117:0/3895640159 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f78b801b570 con 0x7f78c8072140 2024-06-10T00:14:19.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.836+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c8068530 con 0x7f78c8072140 2024-06-10T00:14:19.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.838+0000 7f78c4ff9640 1 -- 172.21.15.117:0/3895640159 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f78c8068530 con 0x7f78c8072140 2024-06-10T00:14:19.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.908+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "657ccf9c-6301-4c19-b2a0-9660aa22bd2d", "id": 1} v 0) -- 0x7f78c80afa20 con 0x7f78c8072140 2024-06-10T00:14:19.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.916+0000 7f78c4ff9640 1 -- 172.21.15.117:0/3895640159 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "657ccf9c-6301-4c19-b2a0-9660aa22bd2d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f78b80035f0 con 0x7f78c8072140 2024-06-10T00:14:19.916 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-06-10T00:14:19.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c8072140 msgr2=0x7f78c81525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:19.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c8072140 0x7f78c81525d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c480 tx=0x7f78b800c940 comp rx=0 tx=0).stop 2024-06-10T00:14:19.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 shutdown_connections 2024-06-10T00:14:19.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c815b0f0 0x7f78c80ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c80725a0 0x7f78c809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 --2- 172.21.15.117:0/3895640159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78c8072140 0x7f78c81525d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:19.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 >> 172.21.15.117:0/3895640159 conn(0x7f78c80b2ae0 msgr2=0x7f78c80b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:19.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 shutdown_connections 2024-06-10T00:14:19.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:19.917+0000 7f78ce722640 1 -- 172.21.15.117:0/3895640159 wait complete. 2024-06-10T00:14:19.927 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78 2 2024-06-10T00:14:20.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.030+0000 7f447c79e640 1 Processor -- start 2024-06-10T00:14:20.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.030+0000 7f447c79e640 1 -- start start 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.031+0000 7f447c79e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44740cc2e0 0x7f447415f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.031+0000 7f447c79e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447415b370 con 0x7f44740cb2e0 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.031+0000 7f447c79e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44740cc8a0 con 0x7f447415af90 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.031+0000 7f447c79e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f447415ee80 con 0x7f44740cc2e0 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.031+0000 7f447a53a640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f447415af90 0x7f44740d0570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33992/0 (socket says 172.21.15.117:33992) 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.031+0000 7f447a53a640 1 -- 172.21.15.117:0/98774731 learned_addr learned my addr 172.21.15.117:0/98774731 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.031+0000 7f4479d39640 1 --2- 172.21.15.117:0/98774731 >> v2:172.21.15.79:3300/0 conn(0x7f44740cc2e0 0x7f447415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1088162917 0 0) 0x7f44740cc8a0 con 0x7f447415af90 2024-06-10T00:14:20.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4460003520 con 0x7f447415af90 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904524172 0 0) 0x7f447415b370 con 0x7f44740cb2e0 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44740cc8a0 con 0x7f44740cb2e0 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1596661971 0 0) 0x7f4460003520 con 0x7f447415af90 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 >> v2:172.21.15.79:3300/0 conn(0x7f44740cc2e0 msgr2=0x7f447415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 --2- 172.21.15.117:0/98774731 >> v2:172.21.15.79:3300/0 conn(0x7f44740cc2e0 0x7f447415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 >> v1:172.21.15.79:6789/0 conn(0x7f44740cb2e0 legacy=0x7f447406edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44740ccb80 con 0x7f447415af90 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f4464001690 con 0x7f447415af90 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479d39640 1 --2- 172.21.15.117:0/98774731 >> v2:172.21.15.79:3300/0 conn(0x7f44740cc2e0 0x7f447415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 >> v1:172.21.15.117:6789/0 conn(0x7f447415af90 legacy=0x7f44740d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4460003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4460004800 0x7f4460004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44600051c0 0x7f446000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f447415ee80 con 0x7f44600051c0 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f446000c040 con 0x7f4460004800 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f446000c240 con 0x7f4460003b40 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f447a53a640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4460003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479d39640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4460004800 0x7f4460004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f447ad3b640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44600051c0 0x7f446000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f447a53a640 1 -- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4460004800 msgr2=0x7f4460004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f447a53a640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4460004800 0x7f4460004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f447a53a640 1 -- 172.21.15.117:0/98774731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44600051c0 msgr2=0x7f446000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f447a53a640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44600051c0 0x7f446000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f447a53a640 1 -- 172.21.15.117:0/98774731 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4460003520 con 0x7f4460003b40 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f447ad3b640 1 -- 172.21.15.117:0/98774731 reap_dead start 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.032+0000 7f4479d39640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4460004800 0x7f4460004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.033+0000 7f447a53a640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4460003f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f446400c160 tx=0x7f4460005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80369c5581cb4046 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.033+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464007cc0 con 0x7f4460003b40 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.033+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4464005af0 con 0x7f4460003b40 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.033+0000 7f4479538640 1 -- 172.21.15.117:0/98774731 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464007070 con 0x7f4460003b40 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.034+0000 7f447c79e640 1 -- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 msgr2=0x7f4460003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.034+0000 7f447c79e640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4460003f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f446400c160 tx=0x7f4460005830 comp rx=0 tx=0).stop 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.034+0000 7f447c79e640 1 -- 172.21.15.117:0/98774731 shutdown_connections 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.034+0000 7f447c79e640 1 --2- 172.21.15.117:0/98774731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4460003f40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.034+0000 7f447c79e640 1 -- 172.21.15.117:0/98774731 >> 172.21.15.117:0/98774731 conn(0x7f44740d0c90 msgr2=0x7f44740d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.034+0000 7f447c79e640 1 -- 172.21.15.117:0/98774731 shutdown_connections 2024-06-10T00:14:20.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.034+0000 7f447c79e640 1 -- 172.21.15.117:0/98774731 wait complete. 2024-06-10T00:14:20.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.035+0000 7f447c79e640 1 Processor -- start 2024-06-10T00:14:20.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.035+0000 7f447c79e640 1 -- start start 2024-06-10T00:14:20.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447c79e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4474150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447c79e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44740ca890 0x7f44740c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447c79e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447415cd30 0x7f447415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447c79e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f44740cb730 con 0x7f44740ca890 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447c79e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f447415eb10 con 0x7f447415cd30 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447c79e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f44740cb8b0 con 0x7f4460003b40 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447a53a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4474150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447a53a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4474150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54366/0 (socket says 172.21.15.117:54366) 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447a53a640 1 -- 172.21.15.117:0/3573318576 learned_addr learned my addr 172.21.15.117:0/3573318576 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447ad3b640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447415cd30 0x7f447415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f4479d39640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44740ca890 0x7f44740c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447a53a640 1 -- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447415cd30 msgr2=0x7f447415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447a53a640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447415cd30 0x7f447415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447a53a640 1 -- 172.21.15.117:0/3573318576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44740ca890 msgr2=0x7f44740c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447a53a640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44740ca890 0x7f44740c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447a53a640 1 -- 172.21.15.117:0/3573318576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44741f4e20 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f447ad3b640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447415cd30 0x7f447415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.036+0000 7f4479d39640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44740ca890 0x7f44740c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.037+0000 7f447a53a640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4474150560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f446400c160 tx=0x7f44740cca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.037+0000 7f446affd640 1 -- 172.21.15.117:0/3573318576 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464037040 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.037+0000 7f446affd640 1 -- 172.21.15.117:0/3573318576 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446403f020 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.037+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44741f5100 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.037+0000 7f446affd640 1 -- 172.21.15.117:0/3573318576 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464001690 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.037+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44741f56c0 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.037+0000 7f446affd640 1 -- 172.21.15.117:0/3573318576 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4464004b70 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.037+0000 7f446affd640 1 -- 172.21.15.117:0/3573318576 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f446403ba20 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.038+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44740d1de0 con 0x7f4460003b40 2024-06-10T00:14:20.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.040+0000 7f446affd640 1 -- 172.21.15.117:0/3573318576 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f44740d1de0 con 0x7f4460003b40 2024-06-10T00:14:20.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.112+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78", "id": 2} v 0) -- 0x7f4474068ad0 con 0x7f4460003b40 2024-06-10T00:14:20.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f446affd640 1 -- 172.21.15.117:0/3573318576 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f4464049020 con 0x7f4460003b40 2024-06-10T00:14:20.117 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-06-10T00:14:20.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 msgr2=0x7f4474150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f447c79e640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4474150560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f446400c160 tx=0x7f44740cca70 comp rx=0 tx=0).stop 2024-06-10T00:14:20.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 shutdown_connections 2024-06-10T00:14:20.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f447c79e640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447415cd30 0x7f447415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f447c79e640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44740ca890 0x7f44740c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f447c79e640 1 --2- 172.21.15.117:0/3573318576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4460003b40 0x7f4474150560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 >> 172.21.15.117:0/3573318576 conn(0x7f44740d0c90 msgr2=0x7f447406ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.118+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 shutdown_connections 2024-06-10T00:14:20.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.119+0000 7f447c79e640 1 -- 172.21.15.117:0/3573318576 wait complete. 2024-06-10T00:14:20.128 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 1a300340-c4e7-4a45-af4f-6c84fa0a2934 3 2024-06-10T00:14:20.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.227+0000 7f34d09b6640 1 Processor -- start 2024-06-10T00:14:20.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.227+0000 7f34d09b6640 1 -- start start 2024-06-10T00:14:20.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34d09b6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34cc15c380 0x7f34cc0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34d09b6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc0cf6f0 con 0x7f34cc0ccaa0 2024-06-10T00:14:20.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34d09b6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc0ccf30 con 0x7f34cc1603c0 2024-06-10T00:14:20.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34d09b6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f34cc160b40 con 0x7f34cc15c380 2024-06-10T00:14:20.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34cad9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f34cc1603c0 0x7f34cc0cfa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33998/0 (socket says 172.21.15.117:33998) 2024-06-10T00:14:20.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34cad9d640 1 -- 172.21.15.117:0/2637025900 learned_addr learned my addr 172.21.15.117:0/2637025900 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-06-10T00:14:20.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34ca59c640 1 --2- 172.21.15.117:0/2637025900 >> v2:172.21.15.117:3300/0 conn(0x7f34cc15c380 0x7f34cc0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34ca59c640 1 -- 172.21.15.117:0/2637025900 >> v1:172.21.15.117:6789/0 conn(0x7f34cc1603c0 legacy=0x7f34cc0cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.228+0000 7f34ca59c640 1 -- 172.21.15.117:0/2637025900 >> v1:172.21.15.79:6789/0 conn(0x7f34cc0ccaa0 legacy=0x7f34cc15fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.229+0000 7f34ca59c640 1 -- 172.21.15.117:0/2637025900 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0cd210 con 0x7f34cc15c380 2024-06-10T00:14:20.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.229+0000 7f34ca59c640 1 --2- 172.21.15.117:0/2637025900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15c380 0x7f34cc0cf1b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34b40097a0 tx=0x7f34b402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488b2c422fe1e216 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.229+0000 7f34c959a640 1 -- 172.21.15.117:0/2637025900 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4037070 con 0x7f34cc15c380 2024-06-10T00:14:20.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.229+0000 7f34c959a640 1 -- 172.21.15.117:0/2637025900 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4032640 con 0x7f34cc15c380 2024-06-10T00:14:20.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.229+0000 7f34c959a640 1 -- 172.21.15.117:0/2637025900 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4032a10 con 0x7f34cc15c380 2024-06-10T00:14:20.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.230+0000 7f34d09b6640 1 -- 172.21.15.117:0/2637025900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15c380 msgr2=0x7f34cc0cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.230+0000 7f34d09b6640 1 --2- 172.21.15.117:0/2637025900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15c380 0x7f34cc0cf1b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34b40097a0 tx=0x7f34b402a2c0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.230+0000 7f34d09b6640 1 -- 172.21.15.117:0/2637025900 shutdown_connections 2024-06-10T00:14:20.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.230+0000 7f34d09b6640 1 --2- 172.21.15.117:0/2637025900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15c380 0x7f34cc0cf1b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.230+0000 7f34d09b6640 1 -- 172.21.15.117:0/2637025900 >> 172.21.15.117:0/2637025900 conn(0x7f34cc0b3900 msgr2=0x7f34cc0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.230+0000 7f34d09b6640 1 -- 172.21.15.117:0/2637025900 shutdown_connections 2024-06-10T00:14:20.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.230+0000 7f34d09b6640 1 -- 172.21.15.117:0/2637025900 wait complete. 2024-06-10T00:14:20.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.231+0000 7f34d09b6640 1 Processor -- start 2024-06-10T00:14:20.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.231+0000 7f34d09b6640 1 -- start start 2024-06-10T00:14:20.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34d09b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34cc15c380 0x7f34cc14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34d09b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34cc1603c0 0x7f34cc0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34d09b6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15b050 0x7f34cc0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34d09b6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0cd7d0 con 0x7f34cc1603c0 2024-06-10T00:14:20.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34d09b6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0cdb40 con 0x7f34cc15b050 2024-06-10T00:14:20.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34d09b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0d0120 con 0x7f34cc15c380 2024-06-10T00:14:20.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34ca59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34cc15c380 0x7f34cc14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34cad9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15b050 0x7f34cc0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34ca59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34cc15c380 0x7f34cc14f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54370/0 (socket says 172.21.15.117:54370) 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34ca59c640 1 -- 172.21.15.117:0/3161241191 learned_addr learned my addr 172.21.15.117:0/3161241191 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.232+0000 7f34c9d9b640 1 --2- 172.21.15.117:0/3161241191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34cc1603c0 0x7f34cc0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34ca59c640 1 -- 172.21.15.117:0/3161241191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15b050 msgr2=0x7f34cc0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34ca59c640 1 --2- 172.21.15.117:0/3161241191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15b050 0x7f34cc0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34ca59c640 1 -- 172.21.15.117:0/3161241191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34cc1603c0 msgr2=0x7f34cc0b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34ca59c640 1 --2- 172.21.15.117:0/3161241191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34cc1603c0 0x7f34cc0b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34ca59c640 1 -- 172.21.15.117:0/3161241191 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0ca490 con 0x7f34cc15c380 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34ca59c640 1 --2- 172.21.15.117:0/3161241191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34cc15c380 0x7f34cc14f220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f34b40098c0 tx=0x7f34b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34c2ffd640 1 -- 172.21.15.117:0/3161241191 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4041030 con 0x7f34cc15c380 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34c2ffd640 1 -- 172.21.15.117:0/3161241191 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4030750 con 0x7f34cc15c380 2024-06-10T00:14:20.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc0c93f0 con 0x7f34cc15c380 2024-06-10T00:14:20.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34c2ffd640 1 -- 172.21.15.117:0/3161241191 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4037040 con 0x7f34cc15c380 2024-06-10T00:14:20.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc0c99b0 con 0x7f34cc15c380 2024-06-10T00:14:20.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34c2ffd640 1 -- 172.21.15.117:0/3161241191 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34b4044070 con 0x7f34cc15c380 2024-06-10T00:14:20.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.233+0000 7f34c2ffd640 1 -- 172.21.15.117:0/3161241191 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f34b403dd40 con 0x7f34cc15c380 2024-06-10T00:14:20.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.234+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc068ad0 con 0x7f34cc15c380 2024-06-10T00:14:20.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.236+0000 7f34c2ffd640 1 -- 172.21.15.117:0/3161241191 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f34b4032500 con 0x7f34cc15c380 2024-06-10T00:14:20.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.308+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1a300340-c4e7-4a45-af4f-6c84fa0a2934", "id": 3} v 0) -- 0x7f34cc0c9130 con 0x7f34cc15c380 2024-06-10T00:14:20.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.314+0000 7f34c2ffd640 1 -- 172.21.15.117:0/3161241191 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a300340-c4e7-4a45-af4f-6c84fa0a2934", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f34b403d870 con 0x7f34cc15c380 2024-06-10T00:14:20.313 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-06-10T00:14:20.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34cc15c380 msgr2=0x7f34cc14f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 --2- 172.21.15.117:0/3161241191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34cc15c380 0x7f34cc14f220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f34b40098c0 tx=0x7f34b40046c0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 shutdown_connections 2024-06-10T00:14:20.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 --2- 172.21.15.117:0/3161241191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34cc15b050 0x7f34cc0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 --2- 172.21.15.117:0/3161241191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34cc1603c0 0x7f34cc0b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 --2- 172.21.15.117:0/3161241191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34cc15c380 0x7f34cc14f220 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 >> 172.21.15.117:0/3161241191 conn(0x7f34cc0b3900 msgr2=0x7f34cc070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 shutdown_connections 2024-06-10T00:14:20.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.315+0000 7f34d09b6640 1 -- 172.21.15.117:0/3161241191 wait complete. 2024-06-10T00:14:20.325 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new c51cdf83-096e-4b8c-8000-a81ee31a407f 4 2024-06-10T00:14:20.383 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:20.383+0000 7fed27616040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-10T00:14:20.410 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:20.411+0000 7f7184821040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-10T00:14:20.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.425+0000 7f4e33914640 1 Processor -- start 2024-06-10T00:14:20.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.425+0000 7f4e33914640 1 -- start start 2024-06-10T00:14:20.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e33914640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e2c06b630 0x7f4e2c15f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e33914640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06f9d0 0x7f4e2c0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e33914640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e2c06ba10 0x7f4e2c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e33914640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2c0b06e0 con 0x7f4e2c06ba10 2024-06-10T00:14:20.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e33914640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2c0721e0 con 0x7f4e2c06b630 2024-06-10T00:14:20.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e33914640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c0b0120 con 0x7f4e2c06f9d0 2024-06-10T00:14:20.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e30eaf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06f9d0 0x7f4e2c0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e316b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e2c06b630 0x7f4e2c15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e30eaf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06f9d0 0x7f4e2c0cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54382/0 (socket says 172.21.15.117:54382) 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e30eaf640 1 -- 172.21.15.117:0/317743464 learned_addr learned my addr 172.21.15.117:0/317743464 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e316b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e2c06b630 0x7f4e2c15f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45818/0 (socket says 172.21.15.117:45818) 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e31eb1640 1 --2- 172.21.15.117:0/317743464 >> v2:172.21.15.79:3300/0 conn(0x7f4e2c06ba10 0x7f4e2c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e316b0640 1 -- 172.21.15.117:0/317743464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06f9d0 msgr2=0x7f4e2c0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e316b0640 1 --2- 172.21.15.117:0/317743464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06f9d0 0x7f4e2c0cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e316b0640 1 -- 172.21.15.117:0/317743464 >> v2:172.21.15.79:3300/0 conn(0x7f4e2c06ba10 msgr2=0x7f4e2c1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e316b0640 1 --2- 172.21.15.117:0/317743464 >> v2:172.21.15.79:3300/0 conn(0x7f4e2c06ba10 0x7f4e2c1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e316b0640 1 -- 172.21.15.117:0/317743464 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c0b0400 con 0x7f4e2c06b630 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.426+0000 7f4e30eaf640 1 --2- 172.21.15.117:0/317743464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06f9d0 0x7f4e2c0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.427+0000 7f4e316b0640 1 --2- 172.21.15.117:0/317743464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06b630 0x7f4e2c15f450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0b3ba0 tx=0x7f4e2802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f71edd2e3b513f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.427+0000 7f4e23fff640 1 -- 172.21.15.117:0/317743464 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28037070 con 0x7f4e2c06b630 2024-06-10T00:14:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.427+0000 7f4e23fff640 1 -- 172.21.15.117:0/317743464 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2802ae50 con 0x7f4e2c06b630 2024-06-10T00:14:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.427+0000 7f4e23fff640 1 -- 172.21.15.117:0/317743464 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28032660 con 0x7f4e2c06b630 2024-06-10T00:14:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 -- 172.21.15.117:0/317743464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06b630 msgr2=0x7f4e2c15f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 --2- 172.21.15.117:0/317743464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06b630 0x7f4e2c15f450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0b3ba0 tx=0x7f4e2802a100 comp rx=0 tx=0).stop 2024-06-10T00:14:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 -- 172.21.15.117:0/317743464 shutdown_connections 2024-06-10T00:14:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 --2- 172.21.15.117:0/317743464 >> v2:172.21.15.79:3300/0 conn(0x7f4e2c06ba10 0x7f4e2c1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 --2- 172.21.15.117:0/317743464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06f9d0 0x7f4e2c0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 --2- 172.21.15.117:0/317743464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06b630 0x7f4e2c15f450 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 -- 172.21.15.117:0/317743464 >> 172.21.15.117:0/317743464 conn(0x7f4e2c0b2ae0 msgr2=0x7f4e2c0b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 -- 172.21.15.117:0/317743464 shutdown_connections 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.428+0000 7f4e33914640 1 -- 172.21.15.117:0/317743464 wait complete. 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.429+0000 7f4e33914640 1 Processor -- start 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.429+0000 7f4e33914640 1 -- start start 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e33914640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06b630 0x7f4e2c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e33914640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2c06ba10 0x7f4e2c146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e33914640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06f9d0 0x7f4e2c150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e33914640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c0cf170 con 0x7f4e2c06ba10 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e33914640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c06ff40 con 0x7f4e2c06f9d0 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e33914640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c0cf2f0 con 0x7f4e2c06b630 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06b630 0x7f4e2c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06b630 0x7f4e2c151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54386/0 (socket says 172.21.15.117:54386) 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 -- 172.21.15.117:0/2532801050 learned_addr learned my addr 172.21.15.117:0/2532801050 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e31eb1640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06f9d0 0x7f4e2c150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e30eaf640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2c06ba10 0x7f4e2c146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 -- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06f9d0 msgr2=0x7f4e2c150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06f9d0 0x7f4e2c150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 -- 172.21.15.117:0/2532801050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2c06ba10 msgr2=0x7f4e2c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2c06ba10 0x7f4e2c146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 -- 172.21.15.117:0/2532801050 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c146ba0 con 0x7f4e2c06b630 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e31eb1640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06f9d0 0x7f4e2c150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e316b0640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06b630 0x7f4e2c151de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009890 tx=0x7f4e280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e21ffb640 1 -- 172.21.15.117:0/2532801050 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28041020 con 0x7f4e2c06b630 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e21ffb640 1 -- 172.21.15.117:0/2532801050 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2803c670 con 0x7f4e2c06b630 2024-06-10T00:14:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e21ffb640 1 -- 172.21.15.117:0/2532801050 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28037040 con 0x7f4e2c06b630 2024-06-10T00:14:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.430+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c150d40 con 0x7f4e2c06b630 2024-06-10T00:14:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.431+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c151300 con 0x7f4e2c06b630 2024-06-10T00:14:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.431+0000 7f4e21ffb640 1 -- 172.21.15.117:0/2532801050 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e28044020 con 0x7f4e2c06b630 2024-06-10T00:14:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.431+0000 7f4e21ffb640 1 -- 172.21.15.117:0/2532801050 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4e28046400 con 0x7f4e2c06b630 2024-06-10T00:14:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.432+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c068ad0 con 0x7f4e2c06b630 2024-06-10T00:14:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.434+0000 7f4e21ffb640 1 -- 172.21.15.117:0/2532801050 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4e2804b030 con 0x7f4e2c06b630 2024-06-10T00:14:20.470 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:20.470+0000 7fed27616040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-10T00:14:20.502 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:20.502+0000 7f7184821040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-10T00:14:20.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.505+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c51cdf83-096e-4b8c-8000-a81ee31a407f", "id": 4} v 0) -- 0x7f4e2c073300 con 0x7f4e2c06b630 2024-06-10T00:14:20.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.511+0000 7f4e21ffb640 1 -- 172.21.15.117:0/2532801050 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c51cdf83-096e-4b8c-8000-a81ee31a407f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4e2c146ba0 con 0x7f4e2c06b630 2024-06-10T00:14:20.510 INFO:teuthology.orchestra.run.smithi117.stdout:4 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06b630 msgr2=0x7f4e2c151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06b630 0x7f4e2c151de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009890 tx=0x7f4e280046c0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 shutdown_connections 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e2c06f9d0 0x7f4e2c150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2c06ba10 0x7f4e2c146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 --2- 172.21.15.117:0/2532801050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e2c06b630 0x7f4e2c151de0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 >> 172.21.15.117:0/2532801050 conn(0x7f4e2c0b2ae0 msgr2=0x7f4e2c0ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 shutdown_connections 2024-06-10T00:14:20.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.512+0000 7f4e33914640 1 -- 172.21.15.117:0/2532801050 wait complete. 2024-06-10T00:14:20.512 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:20.513+0000 7fed27616040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-10T00:14:20.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 8bf0f524-2442-40f4-80f8-cc4cf976d8d2 5 2024-06-10T00:14:20.549 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:20.550+0000 7f7184821040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-10T00:14:20.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.623+0000 7fd73757d640 1 Processor -- start 2024-06-10T00:14:20.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.623+0000 7fd73757d640 1 -- start start 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd73757d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd73006fec0 0x7fd73015f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd73757d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd73006f450 0x7fd73015da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd73757d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd730160c80 con 0x7fd7300702a0 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd73757d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd73015f870 con 0x7fd73006fec0 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd73757d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd7300d0330 con 0x7fd73006f450 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd734b18640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd73006f450 0x7fd73015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd734b18640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd73006f450 0x7fd73015da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45826/0 (socket says 172.21.15.117:45826) 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd734b18640 1 -- 172.21.15.117:0/3584555104 learned_addr learned my addr 172.21.15.117:0/3584555104 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd735319640 1 --2- 172.21.15.117:0/3584555104 >> v2:172.21.15.79:3300/0 conn(0x7fd73006fec0 0x7fd73015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd734b18640 1 -- 172.21.15.117:0/3584555104 >> v2:172.21.15.79:3300/0 conn(0x7fd73006fec0 msgr2=0x7fd73015f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:20.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd734b18640 1 --2- 172.21.15.117:0/3584555104 >> v2:172.21.15.79:3300/0 conn(0x7fd73006fec0 0x7fd73015f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd734b18640 1 -- 172.21.15.117:0/3584555104 >> v1:172.21.15.79:6789/0 conn(0x7fd7300702a0 legacy=0x7fd73015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.624+0000 7fd734b18640 1 -- 172.21.15.117:0/3584555104 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7300d0610 con 0x7fd73006f450 2024-06-10T00:14:20.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.625+0000 7fd734b18640 1 --2- 172.21.15.117:0/3584555104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd73015da20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd730067c60 tx=0x7fd72002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c703f0048af90b6e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.625+0000 7fd727fff640 1 -- 172.21.15.117:0/3584555104 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720037070 con 0x7fd73006f450 2024-06-10T00:14:20.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.625+0000 7fd727fff640 1 -- 172.21.15.117:0/3584555104 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72002ae50 con 0x7fd73006f450 2024-06-10T00:14:20.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.625+0000 7fd727fff640 1 -- 172.21.15.117:0/3584555104 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720032860 con 0x7fd73006f450 2024-06-10T00:14:20.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.626+0000 7fd73757d640 1 -- 172.21.15.117:0/3584555104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 msgr2=0x7fd73015da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.626+0000 7fd73757d640 1 --2- 172.21.15.117:0/3584555104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd73015da20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd730067c60 tx=0x7fd72002a300 comp rx=0 tx=0).stop 2024-06-10T00:14:20.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.626+0000 7fd73757d640 1 -- 172.21.15.117:0/3584555104 shutdown_connections 2024-06-10T00:14:20.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.626+0000 7fd73757d640 1 --2- 172.21.15.117:0/3584555104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd73015da20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.626+0000 7fd73757d640 1 --2- 172.21.15.117:0/3584555104 >> v2:172.21.15.79:3300/0 conn(0x7fd73006fec0 0x7fd73015f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.626+0000 7fd73757d640 1 -- 172.21.15.117:0/3584555104 >> 172.21.15.117:0/3584555104 conn(0x7fd7300b3900 msgr2=0x7fd7300b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.626+0000 7fd73757d640 1 -- 172.21.15.117:0/3584555104 shutdown_connections 2024-06-10T00:14:20.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.626+0000 7fd73757d640 1 -- 172.21.15.117:0/3584555104 wait complete. 2024-06-10T00:14:20.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.627+0000 7fd73757d640 1 Processor -- start 2024-06-10T00:14:20.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.627+0000 7fd73757d640 1 -- start start 2024-06-10T00:14:20.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd73757d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd7301f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd73757d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd73006fec0 0x7fd7300b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd73757d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7300702a0 0x7fd7300c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd73757d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7300d0eb0 con 0x7fd73006fec0 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd73757d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd7300d0bd0 con 0x7fd73006f450 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd73757d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd7300d13d0 con 0x7fd7300702a0 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd7301f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd7301f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45840/0 (socket says 172.21.15.117:45840) 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 -- 172.21.15.117:0/2708727546 learned_addr learned my addr 172.21.15.117:0/2708727546 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735b1a640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7300702a0 0x7fd7300c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd734b18640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd73006fec0 0x7fd7300b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 -- 172.21.15.117:0/2708727546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7300702a0 msgr2=0x7fd7300c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7300702a0 0x7fd7300c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 -- 172.21.15.117:0/2708727546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd73006fec0 msgr2=0x7fd7300b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd73006fec0 0x7fd7300b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 -- 172.21.15.117:0/2708727546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7300b5dc0 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.628+0000 7fd735319640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd7301f4bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd72800d800 tx=0x7fd72800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.629+0000 7fd725ffb640 1 -- 172.21.15.117:0/2708727546 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72800b6c0 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.629+0000 7fd725ffb640 1 -- 172.21.15.117:0/2708727546 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd728019070 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.629+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7300b60a0 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.629+0000 7fd725ffb640 1 -- 172.21.15.117:0/2708727546 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72800ba80 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.629+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7301f5130 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.629+0000 7fd725ffb640 1 -- 172.21.15.117:0/2708727546 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd72800bc20 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.629+0000 7fd725ffb640 1 -- 172.21.15.117:0/2708727546 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd728014b20 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.630+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7300b67d0 con 0x7fd73006f450 2024-06-10T00:14:20.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.632+0000 7fd725ffb640 1 -- 172.21.15.117:0/2708727546 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd7300b67d0 con 0x7fd73006f450 2024-06-10T00:14:20.677 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:20.678+0000 7fed27616040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-10T00:14:20.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.703+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8bf0f524-2442-40f4-80f8-cc4cf976d8d2", "id": 5} v 0) -- 0x7fd730068ad0 con 0x7fd73006f450 2024-06-10T00:14:20.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.708+0000 7fd725ffb640 1 -- 172.21.15.117:0/2708727546 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8bf0f524-2442-40f4-80f8-cc4cf976d8d2", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd728014560 con 0x7fd73006f450 2024-06-10T00:14:20.707 INFO:teuthology.orchestra.run.smithi117.stdout:5 2024-06-10T00:14:20.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 msgr2=0x7fd7301f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd7301f4bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd72800d800 tx=0x7fd72800dcc0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 shutdown_connections 2024-06-10T00:14:20.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7300702a0 0x7fd7300c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd73006fec0 0x7fd7300b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 --2- 172.21.15.117:0/2708727546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd73006f450 0x7fd7301f4bf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 >> 172.21.15.117:0/2708727546 conn(0x7fd7300b3900 msgr2=0x7fd730161610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 shutdown_connections 2024-06-10T00:14:20.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.709+0000 7fd73757d640 1 -- 172.21.15.117:0/2708727546 wait complete. 2024-06-10T00:14:20.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new dd792ef1-cf04-4f23-9f81-803564887b61 6 2024-06-10T00:14:20.720 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:20.721+0000 7f7184821040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-10T00:14:20.729 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:20.729+0000 7fed27616040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-10T00:14:20.770 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:20.771+0000 7f7184821040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-10T00:14:20.780 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:20.781+0000 7fed27616040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-10T00:14:20.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.820+0000 7f01e53d5640 1 Processor -- start 2024-06-10T00:14:20.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.820+0000 7f01e53d5640 1 -- start start 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01e53d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01e53d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01e00af6e0 0x7f01e006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01e53d5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01e006c910 0x7f01e015e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01e53d5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f01e006df30 con 0x7f01e006c910 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01e53d5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f01e00d0230 con 0x7f01e00af6e0 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01e53d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01e006ee80 con 0x7f01e015a7b0 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01deffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01d7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01e00af6e0 0x7f01e006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01deffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e006e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54406/0 (socket says 172.21.15.117:54406) 2024-06-10T00:14:20.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01deffd640 1 -- 172.21.15.117:0/981345807 learned_addr learned my addr 172.21.15.117:0/981345807 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:20.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.821+0000 7f01df7fe640 1 --2- 172.21.15.117:0/981345807 >> v2:172.21.15.79:3300/0 conn(0x7f01e006c910 0x7f01e015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01deffd640 1 -- 172.21.15.117:0/981345807 >> v2:172.21.15.117:3300/0 conn(0x7f01e00af6e0 msgr2=0x7f01e006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:20.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01deffd640 1 --2- 172.21.15.117:0/981345807 >> v2:172.21.15.117:3300/0 conn(0x7f01e00af6e0 0x7f01e006c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01deffd640 1 -- 172.21.15.117:0/981345807 >> v2:172.21.15.79:3300/0 conn(0x7f01e006c910 msgr2=0x7f01e015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:20.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01deffd640 1 --2- 172.21.15.117:0/981345807 >> v2:172.21.15.79:3300/0 conn(0x7f01e006c910 0x7f01e015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01deffd640 1 -- 172.21.15.117:0/981345807 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e006d8e0 con 0x7f01e015a7b0 2024-06-10T00:14:20.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01d7fff640 1 --2- 172.21.15.117:0/981345807 >> v2:172.21.15.117:3300/0 conn(0x7f01e00af6e0 0x7f01e006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:20.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01deffd640 1 --2- 172.21.15.117:0/981345807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e006e730 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f01e00b3120 tx=0x7f01d002a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce6755148a6fd5b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01de7fc640 1 -- 172.21.15.117:0/981345807 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0037070 con 0x7f01e015a7b0 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01de7fc640 1 -- 172.21.15.117:0/981345807 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d0032440 con 0x7f01e015a7b0 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.822+0000 7f01de7fc640 1 -- 172.21.15.117:0/981345807 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0032810 con 0x7f01e015a7b0 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 -- 172.21.15.117:0/981345807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 msgr2=0x7f01e006e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 --2- 172.21.15.117:0/981345807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e006e730 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f01e00b3120 tx=0x7f01d002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 -- 172.21.15.117:0/981345807 shutdown_connections 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 --2- 172.21.15.117:0/981345807 >> v2:172.21.15.79:3300/0 conn(0x7f01e006c910 0x7f01e015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 --2- 172.21.15.117:0/981345807 >> v2:172.21.15.117:3300/0 conn(0x7f01e00af6e0 0x7f01e006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 --2- 172.21.15.117:0/981345807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e006e730 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 -- 172.21.15.117:0/981345807 >> 172.21.15.117:0/981345807 conn(0x7f01e0071850 msgr2=0x7f01e0071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 -- 172.21.15.117:0/981345807 shutdown_connections 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.823+0000 7f01e53d5640 1 -- 172.21.15.117:0/981345807 wait complete. 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.824+0000 7f01e53d5640 1 Processor -- start 2024-06-10T00:14:20.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.824+0000 7f01e53d5640 1 -- start start 2024-06-10T00:14:20.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01e53d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e006c910 0x7f01e0145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01e53d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00af6e0 0x7f01e00ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01e53d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e00ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01e53d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f01e006f2e0 con 0x7f01e00af6e0 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01e53d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01e006f160 con 0x7f01e006c910 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01e53d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01e006e3c0 con 0x7f01e015a7b0 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01deffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e006c910 0x7f01e0145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01deffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e006c910 0x7f01e0145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45864/0 (socket says 172.21.15.117:45864) 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01deffd640 1 -- 172.21.15.117:0/2468205957 learned_addr learned my addr 172.21.15.117:0/2468205957 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01df7fe640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e00ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01d7fff640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00af6e0 0x7f01e00ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01deffd640 1 -- 172.21.15.117:0/2468205957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 msgr2=0x7f01e00ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01deffd640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e00ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01deffd640 1 -- 172.21.15.117:0/2468205957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00af6e0 msgr2=0x7f01e00ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.825+0000 7f01deffd640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00af6e0 0x7f01e00ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01deffd640 1 -- 172.21.15.117:0/2468205957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e01496a0 con 0x7f01e006c910 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01deffd640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e006c910 0x7f01e0145a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01d002a220 tx=0x7f01d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01d77fe640 1 -- 172.21.15.117:0/2468205957 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0041070 con 0x7f01e006c910 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01d77fe640 1 -- 172.21.15.117:0/2468205957 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d003c870 con 0x7f01e006c910 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e0159440 con 0x7f01e006c910 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01d77fe640 1 -- 172.21.15.117:0/2468205957 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0037040 con 0x7f01e006c910 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e01466e0 con 0x7f01e006c910 2024-06-10T00:14:20.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01d77fe640 1 -- 172.21.15.117:0/2468205957 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f01d0044070 con 0x7f01e006c910 2024-06-10T00:14:20.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.826+0000 7f01d77fe640 1 -- 172.21.15.117:0/2468205957 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f01d003d3f0 con 0x7f01e006c910 2024-06-10T00:14:20.829 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:20.827+0000 7f7184821040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-10T00:14:20.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.827+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e0068ad0 con 0x7f01e006c910 2024-06-10T00:14:20.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.830+0000 7f01d77fe640 1 -- 172.21.15.117:0/2468205957 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f01e01496a0 con 0x7f01e006c910 2024-06-10T00:14:20.892 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:20.893+0000 7fed27616040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-10T00:14:20.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.903+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd792ef1-cf04-4f23-9f81-803564887b61", "id": 6} v 0) -- 0x7f01e00728f0 con 0x7f01e006c910 2024-06-10T00:14:20.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.908+0000 7f01d77fe640 1 -- 172.21.15.117:0/2468205957 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd792ef1-cf04-4f23-9f81-803564887b61", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f01d0046450 con 0x7f01e006c910 2024-06-10T00:14:20.908 INFO:teuthology.orchestra.run.smithi117.stdout:6 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.909+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e006c910 msgr2=0x7f01e0145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.909+0000 7f01e53d5640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e006c910 0x7f01e0145a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01d002a220 tx=0x7f01d00046c0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.909+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 shutdown_connections 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.909+0000 7f01e53d5640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e015a7b0 0x7f01e00ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.909+0000 7f01e53d5640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e00af6e0 0x7f01e00ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.909+0000 7f01e53d5640 1 --2- 172.21.15.117:0/2468205957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e006c910 0x7f01e0145a20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.909+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 >> 172.21.15.117:0/2468205957 conn(0x7f01e0071850 msgr2=0x7f01e006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.909+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 shutdown_connections 2024-06-10T00:14:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:20.910+0000 7f01e53d5640 1 -- 172.21.15.117:0/2468205957 wait complete. 2024-06-10T00:14:20.919 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 83c1913b-a6fc-4c99-b879-498b586eebd4 7 2024-06-10T00:14:20.945 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:20.946+0000 7f7184821040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-10T00:14:21.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.019+0000 7f665701b640 1 Processor -- start 2024-06-10T00:14:21.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.019+0000 7f665701b640 1 -- start start 2024-06-10T00:14:21.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.020+0000 7f665701b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f665015b0f0 0x7f665006f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.020+0000 7f665701b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66500725a0 0x7f665015f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.020+0000 7f665701b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665015b4d0 con 0x7f6650072140 2024-06-10T00:14:21.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.020+0000 7f665701b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f66500b5e80 con 0x7f665015b0f0 2024-06-10T00:14:21.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.020+0000 7f665701b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f66500b59f0 con 0x7f66500725a0 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f66555b8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66500725a0 0x7f665015f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f664ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6650072140 0x7f665015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50134/0 (socket says 172.21.15.117:50134) 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f664ffff640 1 -- 172.21.15.117:0/544358452 learned_addr learned my addr 172.21.15.117:0/544358452 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f6654db7640 1 --2- 172.21.15.117:0/544358452 >> v2:172.21.15.79:3300/0 conn(0x7f665015b0f0 0x7f665006f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f66555b8640 1 -- 172.21.15.117:0/544358452 >> v2:172.21.15.79:3300/0 conn(0x7f665015b0f0 msgr2=0x7f665006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f66555b8640 1 --2- 172.21.15.117:0/544358452 >> v2:172.21.15.79:3300/0 conn(0x7f665015b0f0 0x7f665006f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f66555b8640 1 -- 172.21.15.117:0/544358452 >> v1:172.21.15.117:6789/0 conn(0x7f6650072140 legacy=0x7f665015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f66555b8640 1 -- 172.21.15.117:0/544358452 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66500b4de0 con 0x7f66500725a0 2024-06-10T00:14:21.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.021+0000 7f664f7fe640 1 -- 172.21.15.117:0/544358452 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039606795 0 0) 0x7f665015b4d0 con 0x7f6650072140 2024-06-10T00:14:21.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.022+0000 7f66555b8640 1 --2- 172.21.15.117:0/544358452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66500725a0 0x7f665015f3a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f665015fd30 tx=0x7f664802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb482abf90c02dbe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.022+0000 7f664f7fe640 1 -- 172.21.15.117:0/544358452 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648007740 con 0x7f66500725a0 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.022+0000 7f664f7fe640 1 -- 172.21.15.117:0/544358452 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66480078e0 con 0x7f66500725a0 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.022+0000 7f664f7fe640 1 -- 172.21.15.117:0/544358452 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648007cb0 con 0x7f66500725a0 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.023+0000 7f665701b640 1 -- 172.21.15.117:0/544358452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66500725a0 msgr2=0x7f665015f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.023+0000 7f665701b640 1 --2- 172.21.15.117:0/544358452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66500725a0 0x7f665015f3a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f665015fd30 tx=0x7f664802a680 comp rx=0 tx=0).stop 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.023+0000 7f665701b640 1 -- 172.21.15.117:0/544358452 shutdown_connections 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.023+0000 7f665701b640 1 --2- 172.21.15.117:0/544358452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66500725a0 0x7f665015f3a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.023+0000 7f665701b640 1 --2- 172.21.15.117:0/544358452 >> v2:172.21.15.79:3300/0 conn(0x7f665015b0f0 0x7f665006f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.023+0000 7f665701b640 1 -- 172.21.15.117:0/544358452 >> 172.21.15.117:0/544358452 conn(0x7f66500b2ae0 msgr2=0x7f66500b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.023+0000 7f665701b640 1 -- 172.21.15.117:0/544358452 shutdown_connections 2024-06-10T00:14:21.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.023+0000 7f665701b640 1 -- 172.21.15.117:0/544358452 wait complete. 2024-06-10T00:14:21.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.024+0000 7f665701b640 1 Processor -- start 2024-06-10T00:14:21.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.025+0000 7f665701b640 1 -- start start 2024-06-10T00:14:21.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f665701b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6650072140 0x7f66501f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f665701b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66500725a0 0x7f6650155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f665701b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665015b0f0 0x7f665015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f665701b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f66500b5680 con 0x7f665015b0f0 2024-06-10T00:14:21.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f665701b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66500b53a0 con 0x7f6650072140 2024-06-10T00:14:21.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f665701b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66500729f0 con 0x7f66500725a0 2024-06-10T00:14:21.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f6654db7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6650072140 0x7f66501f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f6654db7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6650072140 0x7f66501f1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49124/0 (socket says 172.21.15.117:49124) 2024-06-10T00:14:21.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f6654db7640 1 -- 172.21.15.117:0/1578449712 learned_addr learned my addr 172.21.15.117:0/1578449712 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-06-10T00:14:21.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f664ffff640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66500725a0 0x7f6650155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f66555b8640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665015b0f0 0x7f665015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f6654db7640 1 -- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66500725a0 msgr2=0x7f6650155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f6654db7640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66500725a0 0x7f6650155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f6654db7640 1 -- 172.21.15.117:0/1578449712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665015b0f0 msgr2=0x7f665015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f6654db7640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665015b0f0 0x7f665015cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f6654db7640 1 -- 172.21.15.117:0/1578449712 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6650155c90 con 0x7f6650072140 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.026+0000 7f664ffff640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66500725a0 0x7f6650155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.027+0000 7f6654db7640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6650072140 0x7f66501f1ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f664400e9b0 tx=0x7f664400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.027+0000 7f664d7fa640 1 -- 172.21.15.117:0/1578449712 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644017070 con 0x7f6650072140 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.027+0000 7f664d7fa640 1 -- 172.21.15.117:0/1578449712 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664400c9a0 con 0x7f6650072140 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.027+0000 7f664d7fa640 1 -- 172.21.15.117:0/1578449712 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664400cd90 con 0x7f6650072140 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.027+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665009ce70 con 0x7f6650072140 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.027+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665009d430 con 0x7f6650072140 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.027+0000 7f664d7fa640 1 -- 172.21.15.117:0/1578449712 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f664401a070 con 0x7f6650072140 2024-06-10T00:14:21.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.027+0000 7f664d7fa640 1 -- 172.21.15.117:0/1578449712 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f6644013ad0 con 0x7f6650072140 2024-06-10T00:14:21.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.028+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6650068ad0 con 0x7f6650072140 2024-06-10T00:14:21.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.030+0000 7f664d7fa640 1 -- 172.21.15.117:0/1578449712 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6644013470 con 0x7f6650072140 2024-06-10T00:14:21.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.102+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "83c1913b-a6fc-4c99-b879-498b586eebd4", "id": 7} v 0) -- 0x7f66500cf670 con 0x7f6650072140 2024-06-10T00:14:21.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.108+0000 7f664d7fa640 1 -- 172.21.15.117:0/1578449712 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83c1913b-a6fc-4c99-b879-498b586eebd4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f6644013650 con 0x7f6650072140 2024-06-10T00:14:21.107 INFO:teuthology.orchestra.run.smithi117.stdout:7 2024-06-10T00:14:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6650072140 msgr2=0x7f66501f1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6650072140 0x7f66501f1ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f664400e9b0 tx=0x7f664400ee70 comp rx=0 tx=0).stop 2024-06-10T00:14:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 shutdown_connections 2024-06-10T00:14:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665015b0f0 0x7f665015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66500725a0 0x7f6650155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 --2- 172.21.15.117:0/1578449712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6650072140 0x7f66501f1ce0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 >> 172.21.15.117:0/1578449712 conn(0x7f66500b2ae0 msgr2=0x7f66500b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 shutdown_connections 2024-06-10T00:14:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:14:21.109+0000 7f665701b640 1 -- 172.21.15.117:0/1578449712 wait complete. 2024-06-10T00:14:21.118 INFO:tasks.ceph.osd.0:Restarting daemon 2024-06-10T00:14:21.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-06-10T00:14:21.120 INFO:tasks.ceph.osd.0:Started 2024-06-10T00:14:21.121 INFO:tasks.ceph.osd.1:Restarting daemon 2024-06-10T00:14:21.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-06-10T00:14:21.122 INFO:tasks.ceph.osd.1:Started 2024-06-10T00:14:21.123 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-10T00:14:21.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-10T00:14:21.125 INFO:tasks.ceph.osd.2:Started 2024-06-10T00:14:21.125 INFO:tasks.ceph.osd.3:Restarting daemon 2024-06-10T00:14:21.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-06-10T00:14:21.127 INFO:tasks.ceph.osd.3:Started 2024-06-10T00:14:21.127 INFO:tasks.ceph.osd.4:Restarting daemon 2024-06-10T00:14:21.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-06-10T00:14:21.161 INFO:tasks.ceph.osd.4:Started 2024-06-10T00:14:21.161 INFO:tasks.ceph.osd.5:Restarting daemon 2024-06-10T00:14:21.161 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-06-10T00:14:21.164 INFO:tasks.ceph.osd.5:Started 2024-06-10T00:14:21.164 INFO:tasks.ceph.osd.6:Restarting daemon 2024-06-10T00:14:21.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-06-10T00:14:21.166 INFO:tasks.ceph.osd.6:Started 2024-06-10T00:14:21.166 INFO:tasks.ceph.osd.7:Restarting daemon 2024-06-10T00:14:21.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-06-10T00:14:21.168 INFO:tasks.ceph.osd.7:Started 2024-06-10T00:14:21.169 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:21.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.286+0000 7f8b5d612640 1 Processor -- start 2024-06-10T00:14:21.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.286+0000 7f8b5d612640 1 -- start start 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b5d612640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b580d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b5d612640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b580c59a0 con 0x7f8b580d0430 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b5d612640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b580d0910 con 0x7f8b580cef50 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b5d612640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b580c5fb0 con 0x7f8b5815c1d0 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b567fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8b580d0430 0x7f8b580ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38290/0 (socket says 172.21.15.79:38290) 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b567fc640 1 -- 172.21.15.79:0/3330614448 learned_addr learned my addr 172.21.15.79:0/3330614448 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b56ffd640 1 --2- 172.21.15.79:0/3330614448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b580d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b55ffb640 1 -- 172.21.15.79:0/3330614448 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961516397 0 0) 0x7f8b580c59a0 con 0x7f8b580d0430 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b55ffb640 1 -- 172.21.15.79:0/3330614448 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b44003520 con 0x7f8b580d0430 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b55ffb640 1 -- 172.21.15.79:0/3330614448 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335512467 0 0) 0x7f8b580d0910 con 0x7f8b580cef50 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b55ffb640 1 -- 172.21.15.79:0/3330614448 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b580c59a0 con 0x7f8b580cef50 2024-06-10T00:14:21.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b56ffd640 1 -- 172.21.15.79:0/3330614448 >> v1:172.21.15.117:6789/0 conn(0x7f8b580cef50 legacy=0x7f8b580c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b56ffd640 1 -- 172.21.15.79:0/3330614448 >> v1:172.21.15.79:6789/0 conn(0x7f8b580d0430 legacy=0x7f8b580ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.287+0000 7f8b56ffd640 1 -- 172.21.15.79:0/3330614448 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b580d0bf0 con 0x7f8b5815c1d0 2024-06-10T00:14:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.288+0000 7f8b56ffd640 1 --2- 172.21.15.79:0/3330614448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b580d2970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8b400097d0 tx=0x7f8b4002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e8cbcaff93d4dec server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.288+0000 7f8b55ffb640 1 -- 172.21.15.79:0/3330614448 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40037070 con 0x7f8b5815c1d0 2024-06-10T00:14:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.288+0000 7f8b55ffb640 1 -- 172.21.15.79:0/3330614448 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b40032440 con 0x7f8b5815c1d0 2024-06-10T00:14:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.288+0000 7f8b55ffb640 1 -- 172.21.15.79:0/3330614448 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40032810 con 0x7f8b5815c1d0 2024-06-10T00:14:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.289+0000 7f8b5d612640 1 -- 172.21.15.79:0/3330614448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 msgr2=0x7f8b580d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.289+0000 7f8b5d612640 1 --2- 172.21.15.79:0/3330614448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b580d2970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8b400097d0 tx=0x7f8b4002a180 comp rx=0 tx=0).stop 2024-06-10T00:14:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.289+0000 7f8b5d612640 1 -- 172.21.15.79:0/3330614448 shutdown_connections 2024-06-10T00:14:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.289+0000 7f8b5d612640 1 --2- 172.21.15.79:0/3330614448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b580d2970 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.289+0000 7f8b5d612640 1 -- 172.21.15.79:0/3330614448 >> 172.21.15.79:0/3330614448 conn(0x7f8b580d1e50 msgr2=0x7f8b580d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.289+0000 7f8b5d612640 1 -- 172.21.15.79:0/3330614448 shutdown_connections 2024-06-10T00:14:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.289+0000 7f8b5d612640 1 -- 172.21.15.79:0/3330614448 wait complete. 2024-06-10T00:14:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.290+0000 7f8b5d612640 1 Processor -- start 2024-06-10T00:14:21.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.290+0000 7f8b5d612640 1 -- start start 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b5d612640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580cef50 0x7f8b5815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b5d612640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580d0430 0x7f8b580cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b5d612640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b581f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b5d612640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b580cf520 con 0x7f8b580cef50 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b5d612640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5815c5b0 con 0x7f8b580d0430 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b5d612640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b580cf6a0 con 0x7f8b5815c1d0 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580cef50 0x7f8b5815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580cef50 0x7f8b5815e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38358/0 (socket says 172.21.15.79:38358) 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b56ffd640 1 -- 172.21.15.79:0/2241178722 learned_addr learned my addr 172.21.15.79:0/2241178722 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b567fc640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580d0430 0x7f8b580cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b577fe640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b581f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b56ffd640 1 -- 172.21.15.79:0/2241178722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 msgr2=0x7f8b581f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b56ffd640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b581f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b56ffd640 1 -- 172.21.15.79:0/2241178722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580d0430 msgr2=0x7f8b580cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b56ffd640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580d0430 0x7f8b580cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.291+0000 7f8b56ffd640 1 -- 172.21.15.79:0/2241178722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b580c9300 con 0x7f8b580cef50 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.292+0000 7f8b56ffd640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580cef50 0x7f8b5815e3f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b400097d0 tx=0x7f8b400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.292+0000 7f8b4f7fe640 1 -- 172.21.15.79:0/2241178722 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40041020 con 0x7f8b580cef50 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.292+0000 7f8b4f7fe640 1 -- 172.21.15.79:0/2241178722 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4003d6e0 con 0x7f8b580cef50 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.292+0000 7f8b4f7fe640 1 -- 172.21.15.79:0/2241178722 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40037040 con 0x7f8b580cef50 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.292+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5815d910 con 0x7f8b580cef50 2024-06-10T00:14:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.292+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5815ded0 con 0x7f8b580cef50 2024-06-10T00:14:21.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.292+0000 7f8b4f7fe640 1 -- 172.21.15.79:0/2241178722 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8b40044020 con 0x7f8b580cef50 2024-06-10T00:14:21.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.292+0000 7f8b4f7fe640 1 -- 172.21.15.79:0/2241178722 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8b40046bd0 con 0x7f8b580cef50 2024-06-10T00:14:21.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.293+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b58068430 con 0x7f8b580cef50 2024-06-10T00:14:21.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.295+0000 7f8b4f7fe640 1 -- 172.21.15.79:0/2241178722 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8b4004b030 con 0x7f8b580cef50 2024-06-10T00:14:21.302 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:21.303+0000 7fed27616040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-10T00:14:21.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.356+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b580cdb50 con 0x7f8b580cef50 2024-06-10T00:14:21.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.356+0000 7f8b4f7fe640 1 -- 172.21.15.79:0/2241178722 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8b40046400 con 0x7f8b580cef50 2024-06-10T00:14:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:21.358 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:21.103656+0000","last_up_change":"0.000000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:21.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580cef50 msgr2=0x7f8b5815e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:21.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580cef50 0x7f8b5815e3f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b400097d0 tx=0x7f8b400046c0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 shutdown_connections 2024-06-10T00:14:21.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815c1d0 0x7f8b581f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580d0430 0x7f8b580cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 --2- 172.21.15.79:0/2241178722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b580cef50 0x7f8b5815e3f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:21.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 >> 172.21.15.79:0/2241178722 conn(0x7f8b580d1e50 msgr2=0x7f8b5815b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:21.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 shutdown_connections 2024-06-10T00:14:21.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:21.357+0000 7f8b5d612640 1 -- 172.21.15.79:0/2241178722 wait complete. 2024-06-10T00:14:21.360 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:21.361+0000 7f7184821040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-10T00:14:21.368 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-06-10T00:14:21.368 INFO:tasks.ceph:Waiting for OSDs to come up 2024-06-10T00:14:21.566 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:21.567+0000 7fed27616040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-10T00:14:21.615 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:21.616+0000 7f7184821040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-10T00:14:21.618 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:21.618+0000 7fed27616040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-10T00:14:21.666 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:21.667+0000 7f7184821040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-10T00:14:21.723 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-06-10T00:14:21.723+0000 7f09cac0f640 -1 Falling back to public interface 2024-06-10T00:14:21.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-06-10T00:14:21.733+0000 7fa36e8ad640 -1 Falling back to public interface 2024-06-10T00:14:21.733 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:21.734+0000 7fed27616040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-10T00:14:21.735 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-06-10T00:14:21.736+0000 7f2789818640 -1 Falling back to public interface 2024-06-10T00:14:21.743 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-06-10T00:14:21.743+0000 7f14a7fdc640 -1 Falling back to public interface 2024-06-10T00:14:21.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-06-10T00:14:21.759+0000 7f9579e0f640 -1 Falling back to public interface 2024-06-10T00:14:21.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-06-10T00:14:21.768+0000 7fc2cef21640 -1 Falling back to public interface 2024-06-10T00:14:21.781 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:21.782+0000 7f7184821040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-10T00:14:21.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-06-10T00:14:21.788+0000 7f2a2a1b1640 -1 Falling back to public interface 2024-06-10T00:14:21.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-06-10T00:14:21.791+0000 7f9270232640 -1 Falling back to public interface 2024-06-10T00:14:22.032 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:22.032+0000 7fed27616040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-10T00:14:22.079 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:22.079+0000 7fed27616040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-10T00:14:22.080 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:22.081+0000 7f7184821040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-10T00:14:22.126 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:22.127+0000 7f7184821040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-10T00:14:22.174 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:22.237 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:22.238+0000 7fed27616040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-10T00:14:22.266 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.267+0000 7f7d7c9e7640 1 Processor -- start 2024-06-10T00:14:22.266 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.267+0000 7f7d7c9e7640 1 -- start start 2024-06-10T00:14:22.268 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7c9e7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d7815e150 0x7f7d780d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:22.268 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7c9e7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d780d3c80 0x7f7d780d4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:22.268 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7c9e7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d780d4650 con 0x7f7d7815e530 2024-06-10T00:14:22.268 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7c9e7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7d780cf280 con 0x7f7d7815e150 2024-06-10T00:14:22.268 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7c9e7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7d780d0020 con 0x7f7d780d3c80 2024-06-10T00:14:22.268 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d7815e150 0x7f7d780d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:22.268 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d7815e150 0x7f7d780d2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38366/0 (socket says 172.21.15.79:38366) 2024-06-10T00:14:22.269 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7659c640 1 -- 172.21.15.79:0/3752330206 learned_addr learned my addr 172.21.15.79:0/3752330206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:22.269 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d76d9d640 1 --2- 172.21.15.79:0/3752330206 >> v2:172.21.15.117:3300/0 conn(0x7f7d780d3c80 0x7f7d780d4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:22.269 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7659c640 1 -- 172.21.15.79:0/3752330206 >> v2:172.21.15.117:3300/0 conn(0x7f7d780d3c80 msgr2=0x7f7d780d4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:22.269 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7659c640 1 --2- 172.21.15.79:0/3752330206 >> v2:172.21.15.117:3300/0 conn(0x7f7d780d3c80 0x7f7d780d4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.269 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7659c640 1 -- 172.21.15.79:0/3752330206 >> v1:172.21.15.117:6789/0 conn(0x7f7d7815e530 legacy=0x7f7d780ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:22.269 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d7659c640 1 -- 172.21.15.79:0/3752330206 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d780cf4a0 con 0x7f7d7815e150 2024-06-10T00:14:22.269 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.268+0000 7f7d76d9d640 1 --2- 172.21.15.79:0/3752330206 >> v2:172.21.15.117:3300/0 conn(0x7f7d780d3c80 0x7f7d780d4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:22.270 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.269+0000 7f7d7659c640 1 --2- 172.21.15.79:0/3752330206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d7815e150 0x7f7d780d2a90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7d780d39d0 tx=0x7f7d6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bbaf62ff0427c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:22.270 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.269+0000 7f7d7559a640 1 -- 172.21.15.79:0/3752330206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68037070 con 0x7f7d7815e150 2024-06-10T00:14:22.270 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.269+0000 7f7d7559a640 1 -- 172.21.15.79:0/3752330206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d68032440 con 0x7f7d7815e150 2024-06-10T00:14:22.270 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.269+0000 7f7d7559a640 1 -- 172.21.15.79:0/3752330206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68032810 con 0x7f7d7815e150 2024-06-10T00:14:22.271 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.270+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/3752330206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d7815e150 msgr2=0x7f7d780d2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:22.271 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.270+0000 7f7d7c9e7640 1 --2- 172.21.15.79:0/3752330206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d7815e150 0x7f7d780d2a90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7d780d39d0 tx=0x7f7d6802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.271 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.270+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/3752330206 shutdown_connections 2024-06-10T00:14:22.271 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.270+0000 7f7d7c9e7640 1 --2- 172.21.15.79:0/3752330206 >> v2:172.21.15.117:3300/0 conn(0x7f7d780d3c80 0x7f7d780d4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.271 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.270+0000 7f7d7c9e7640 1 --2- 172.21.15.79:0/3752330206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d7815e150 0x7f7d780d2a90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.271 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.270+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/3752330206 >> 172.21.15.79:0/3752330206 conn(0x7f7d78067c30 msgr2=0x7f7d7809d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:22.271 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.270+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/3752330206 shutdown_connections 2024-06-10T00:14:22.271 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.270+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/3752330206 wait complete. 2024-06-10T00:14:22.273 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.271+0000 7f7d7c9e7640 1 Processor -- start 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.271+0000 7f7d7c9e7640 1 -- start start 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7c9e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d780d3c80 0x7f7d7809ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7c9e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d7815e150 0x7f7d7815d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7c9e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d7815e530 0x7f7d780a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7c9e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d780cfd40 con 0x7f7d780d3c80 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7c9e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d780cfa60 con 0x7f7d7815e150 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7c9e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7d780cb410 con 0x7f7d7815e530 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d780d3c80 0x7f7d7809ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d780d3c80 0x7f7d7809ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38368/0 (socket says 172.21.15.79:38368) 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 -- 172.21.15.79:0/2715201266 learned_addr learned my addr 172.21.15.79:0/2715201266 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d75d9b640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d7815e150 0x7f7d7815d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d76d9d640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d7815e530 0x7f7d780a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:22.274 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 -- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d7815e530 msgr2=0x7f7d780a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d7815e530 0x7f7d780a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 -- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d7815e150 msgr2=0x7f7d7815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d7815e150 0x7f7d7815d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 -- 172.21.15.79:0/2715201266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d780a17b0 con 0x7f7d780d3c80 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d76d9d640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d7815e530 0x7f7d780a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.272+0000 7f7d7659c640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d780d3c80 0x7f7d7809ebd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7d6802a220 tx=0x7f7d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.273+0000 7f7d66ffd640 1 -- 172.21.15.79:0/2715201266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68041020 con 0x7f7d780d3c80 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.273+0000 7f7d66ffd640 1 -- 172.21.15.79:0/2715201266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d680306c0 con 0x7f7d780d3c80 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.273+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d780a1a90 con 0x7f7d780d3c80 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.273+0000 7f7d66ffd640 1 -- 172.21.15.79:0/2715201266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68037040 con 0x7f7d780d3c80 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.273+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d780b2df0 con 0x7f7d780d3c80 2024-06-10T00:14:22.275 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.273+0000 7f7d66ffd640 1 -- 172.21.15.79:0/2715201266 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d68044020 con 0x7f7d780d3c80 2024-06-10T00:14:22.276 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.273+0000 7f7d66ffd640 1 -- 172.21.15.79:0/2715201266 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7d6803dc90 con 0x7f7d780d3c80 2024-06-10T00:14:22.276 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.274+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d780b2930 con 0x7f7d780d3c80 2024-06-10T00:14:22.276 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.276+0000 7f7d66ffd640 1 -- 172.21.15.79:0/2715201266 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7d780b2930 con 0x7f7d780d3c80 2024-06-10T00:14:22.280 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:22.281+0000 7f7184821040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-10T00:14:22.336 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.336+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d78068cf0 con 0x7f7d780d3c80 2024-06-10T00:14:22.336 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.337+0000 7f7d66ffd640 1 -- 172.21.15.79:0/2715201266 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7d6804b030 con 0x7f7d780d3c80 2024-06-10T00:14:22.336 INFO:teuthology.misc.health.smithi079.stdout: 2024-06-10T00:14:22.337 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":10,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:21.103656+0000","last_up_change":"0.000000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:22.337 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.337+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d780d3c80 msgr2=0x7f7d7809ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:22.338 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.337+0000 7f7d7c9e7640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d780d3c80 0x7f7d7809ebd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7d6802a220 tx=0x7f7d680046c0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.338 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.338+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 shutdown_connections 2024-06-10T00:14:22.338 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.338+0000 7f7d7c9e7640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d7815e530 0x7f7d780a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.338 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.338+0000 7f7d7c9e7640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d7815e150 0x7f7d7815d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.338 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.338+0000 7f7d7c9e7640 1 --2- 172.21.15.79:0/2715201266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d780d3c80 0x7f7d7809ebd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:22.338 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.338+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 >> 172.21.15.79:0/2715201266 conn(0x7f7d78067c30 msgr2=0x7f7d780cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:22.338 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.338+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 shutdown_connections 2024-06-10T00:14:22.338 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:22.338+0000 7f7d7c9e7640 1 -- 172.21.15.79:0/2715201266 wait complete. 2024-06-10T00:14:22.346 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-10T00:14:22.380 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:22.381+0000 7fed27616040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-10T00:14:22.418 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:22.419+0000 7f7184821040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-10T00:14:22.430 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:22.430+0000 7fed27616040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-10T00:14:22.467 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:22.468+0000 7f7184821040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-10T00:14:22.499 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:22.499+0000 7fed27616040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-10T00:14:22.534 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:22.535+0000 7f7184821040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-10T00:14:22.544 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:22.545+0000 7fed27616040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-10T00:14:22.581 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:22.580+0000 7f7184821040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-10T00:14:23.018 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:23.018+0000 7fed27616040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-10T00:14:23.054 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:23.055+0000 7f7184821040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-10T00:14:23.134 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:23.135+0000 7fed27616040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-10T00:14:23.173 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-06-10T00:14:23.174+0000 7f7184821040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-10T00:14:24.150 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:24.150+0000 7fecc7d37640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-10T00:14:24.150 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-06-10T00:14:24.150+0000 7fecc7d37640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-10T00:14:25.210 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-06-10T00:14:25.210+0000 7f09cac0f640 -1 osd.3 0 log_to_monitors true 2024-06-10T00:14:25.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-06-10T00:14:25.227+0000 7f9579e0f640 -1 osd.5 0 log_to_monitors true 2024-06-10T00:14:25.257 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-06-10T00:14:25.257+0000 7f14a7fdc640 -1 osd.0 0 log_to_monitors true 2024-06-10T00:14:25.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-06-10T00:14:25.269+0000 7fc2cef21640 -1 osd.6 0 log_to_monitors true 2024-06-10T00:14:25.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-06-10T00:14:25.271+0000 7fa36e8ad640 -1 osd.1 0 log_to_monitors true 2024-06-10T00:14:25.277 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-06-10T00:14:25.278+0000 7f2789818640 -1 osd.2 0 log_to_monitors true 2024-06-10T00:14:25.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-06-10T00:14:25.293+0000 7f2a2a1b1640 -1 osd.7 0 log_to_monitors true 2024-06-10T00:14:25.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-06-10T00:14:25.328+0000 7f9270232640 -1 osd.4 0 log_to_monitors true 2024-06-10T00:14:29.153 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:29.217 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-06-10T00:14:29.217+0000 7f14a4786640 -1 osd.0 0 waiting for initial osdmap 2024-06-10T00:14:29.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-06-10T00:14:29.225+0000 7f9575724640 -1 osd.5 0 waiting for initial osdmap 2024-06-10T00:14:29.236 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-06-10T00:14:29.237+0000 7f149bd92640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-10T00:14:29.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-06-10T00:14:29.248+0000 7f956d544640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-10T00:14:29.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-06-10T00:14:29.252+0000 7fa36a843640 -1 osd.1 0 waiting for initial osdmap 2024-06-10T00:14:29.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-06-10T00:14:29.254+0000 7fc2cb6cb640 -1 osd.6 0 waiting for initial osdmap 2024-06-10T00:14:29.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-06-10T00:14:29.267+0000 7fa362663640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-10T00:14:29.270 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-06-10T00:14:29.270+0000 7f2785180640 -1 osd.2 0 waiting for initial osdmap 2024-06-10T00:14:29.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-06-10T00:14:29.270+0000 7fc2c2cd7640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-10T00:14:29.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-06-10T00:14:29.280+0000 7f2a26147640 -1 osd.7 0 waiting for initial osdmap 2024-06-10T00:14:29.287 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-06-10T00:14:29.288+0000 7f277cfa0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-10T00:14:29.293 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.293+0000 7f6f9602a640 1 Processor -- start 2024-06-10T00:14:29.293 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.293+0000 7f6f9602a640 1 -- start start 2024-06-10T00:14:29.294 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f9602a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6f9015e150 0x7f6f900d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f9602a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e530 0x7f6f900ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f9602a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f900d0020 con 0x7f6f900d3c80 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f9602a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6f900cf4a0 con 0x7f6f9015e150 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f9602a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f900cf780 con 0x7f6f9015e530 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f8f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6f9015e150 0x7f6f900d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f8effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e530 0x7f6f900ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f8effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e530 0x7f6f900ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50680/0 (socket says 172.21.15.79:50680) 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f8f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6f9015e150 0x7f6f900d2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:47352/0 (socket says 172.21.15.79:47352) 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f8effd640 1 -- 172.21.15.79:0/1106544507 learned_addr learned my addr 172.21.15.79:0/1106544507 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.294+0000 7f6f8ffff640 1 --1- 172.21.15.79:0/1106544507 >> v1:172.21.15.117:6789/0 conn(0x7f6f900d3c80 0x7f6f900d40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:43370/0 (socket says 172.21.15.79:43370) 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.295+0000 7f6f8effd640 1 -- 172.21.15.79:0/1106544507 >> v2:172.21.15.117:3300/0 conn(0x7f6f9015e150 msgr2=0x7f6f900d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:29.295 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.295+0000 7f6f8effd640 1 --2- 172.21.15.79:0/1106544507 >> v2:172.21.15.117:3300/0 conn(0x7f6f9015e150 0x7f6f900d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.296 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.295+0000 7f6f8effd640 1 -- 172.21.15.79:0/1106544507 >> v1:172.21.15.117:6789/0 conn(0x7f6f900d3c80 legacy=0x7f6f900d40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:29.296 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.295+0000 7f6f8effd640 1 -- 172.21.15.79:0/1106544507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f900cfa60 con 0x7f6f9015e530 2024-06-10T00:14:29.296 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.295+0000 7f6f8f7fe640 1 --2- 172.21.15.79:0/1106544507 >> v2:172.21.15.117:3300/0 conn(0x7f6f9015e150 0x7f6f900d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:29.296 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-06-10T00:14:29.295+0000 7f09c648c640 -1 osd.3 0 waiting for initial osdmap 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.296+0000 7f6f8effd640 1 --2- 172.21.15.79:0/1106544507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e530 0x7f6f900ceb70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009870 tx=0x7f6f8402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a3911d568ac245 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.296+0000 7f6f8e7fc640 1 -- 172.21.15.79:0/1106544507 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84037070 con 0x7f6f9015e530 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.296+0000 7f6f8e7fc640 1 -- 172.21.15.79:0/1106544507 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f84032440 con 0x7f6f9015e530 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.296+0000 7f6f8e7fc640 1 -- 172.21.15.79:0/1106544507 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84032810 con 0x7f6f9015e530 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.296+0000 7f6f9602a640 1 -- 172.21.15.79:0/1106544507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e530 msgr2=0x7f6f900ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.296+0000 7f6f9602a640 1 --2- 172.21.15.79:0/1106544507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e530 0x7f6f900ceb70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009870 tx=0x7f6f8402a1c0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.297+0000 7f6f9602a640 1 -- 172.21.15.79:0/1106544507 shutdown_connections 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.297+0000 7f6f9602a640 1 --2- 172.21.15.79:0/1106544507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e530 0x7f6f900ceb70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.297+0000 7f6f9602a640 1 --2- 172.21.15.79:0/1106544507 >> v2:172.21.15.117:3300/0 conn(0x7f6f9015e150 0x7f6f900d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.297 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.297+0000 7f6f9602a640 1 -- 172.21.15.79:0/1106544507 >> 172.21.15.79:0/1106544507 conn(0x7f6f90067c30 msgr2=0x7f6f9009d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:29.298 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.297+0000 7f6f9602a640 1 -- 172.21.15.79:0/1106544507 shutdown_connections 2024-06-10T00:14:29.298 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.297+0000 7f6f9602a640 1 -- 172.21.15.79:0/1106544507 wait complete. 2024-06-10T00:14:29.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-06-10T00:14:29.294+0000 7f2a1df67640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-10T00:14:29.300 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.298+0000 7f6f9602a640 1 Processor -- start 2024-06-10T00:14:29.300 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.298+0000 7f6f9602a640 1 -- start start 2024-06-10T00:14:29.300 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f9602a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f900d3c80 0x7f6f901f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:29.300 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f9602a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e150 0x7f6f901531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:29.300 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f9602a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9015e530 0x7f6f900b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:29.301 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f9602a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6f900cf230 con 0x7f6f900d3c80 2024-06-10T00:14:29.301 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f9602a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f900cf0b0 con 0x7f6f9015e530 2024-06-10T00:14:29.301 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f9602a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f900cb410 con 0x7f6f9015e150 2024-06-10T00:14:29.301 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f8f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f900d3c80 0x7f6f901f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f8f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f900d3c80 0x7f6f901f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43844/0 (socket says 172.21.15.79:43844) 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f8f7fe640 1 -- 172.21.15.79:0/5296291 learned_addr learned my addr 172.21.15.79:0/5296291 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f8effd640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e150 0x7f6f901531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.299+0000 7f6f8ffff640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9015e530 0x7f6f900b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f8f7fe640 1 -- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e150 msgr2=0x7f6f901531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f8f7fe640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e150 0x7f6f901531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f8f7fe640 1 -- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9015e530 msgr2=0x7f6f900b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f8f7fe640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9015e530 0x7f6f900b89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f8f7fe640 1 -- 172.21.15.79:0/5296291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f900b6370 con 0x7f6f900d3c80 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f8effd640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e150 0x7f6f901531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f8ffff640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9015e530 0x7f6f900b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:29.302 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f8f7fe640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f900d3c80 0x7f6f901f3c20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000ebe0 tx=0x7f6f8000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:29.303 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f77fff640 1 -- 172.21.15.79:0/5296291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80017070 con 0x7f6f900d3c80 2024-06-10T00:14:29.303 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f77fff640 1 -- 172.21.15.79:0/5296291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8000cc30 con 0x7f6f900d3c80 2024-06-10T00:14:29.303 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f900b6650 con 0x7f6f900d3c80 2024-06-10T00:14:29.303 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f77fff640 1 -- 172.21.15.79:0/5296291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80013470 con 0x7f6f900d3c80 2024-06-10T00:14:29.303 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.300+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f900b6c10 con 0x7f6f900d3c80 2024-06-10T00:14:29.304 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.301+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f900cee70 con 0x7f6f900d3c80 2024-06-10T00:14:29.304 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.301+0000 7f6f77fff640 1 -- 172.21.15.79:0/5296291 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f6f8001a070 con 0x7f6f900d3c80 2024-06-10T00:14:29.304 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.302+0000 7f6f77fff640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f7c06bda0 0x7f6f7c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:29.304 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.302+0000 7f6f77fff640 1 -- 172.21.15.79:0/5296291 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f6f8008a160 con 0x7f6f900d3c80 2024-06-10T00:14:29.304 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.302+0000 7f6f8effd640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f7c06bda0 0x7f6f7c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:29.304 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.302+0000 7f6f8effd640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f7c06bda0 0x7f6f7c06e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034000 tx=0x7f6f8402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:29.306 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.306+0000 7f6f77fff640 1 -- 172.21.15.79:0/5296291 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6f900cee70 con 0x7f6f900d3c80 2024-06-10T00:14:29.309 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-06-10T00:14:29.310+0000 7f09be2ac640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-10T00:14:29.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-06-10T00:14:29.322+0000 7f926c9dc640 -1 osd.4 0 waiting for initial osdmap 2024-06-10T00:14:29.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-06-10T00:14:29.334+0000 7f9263fe8640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-10T00:14:29.484 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.484+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f90068cf0 con 0x7f6f900d3c80 2024-06-10T00:14:29.484 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.485+0000 7f6f77fff640 1 -- 172.21.15.79:0/5296291 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f6f800593c0 con 0x7f6f900d3c80 2024-06-10T00:14:29.485 INFO:teuthology.misc.health.smithi079.stdout: 2024-06-10T00:14:29.485 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":12,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:27.151582+0000","last_up_change":"0.000000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:29.487 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f7c06bda0 msgr2=0x7f6f7c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:29.487 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f7c06bda0 0x7f6f7c06e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034000 tx=0x7f6f8402e000 comp rx=0 tx=0).stop 2024-06-10T00:14:29.487 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f900d3c80 msgr2=0x7f6f901f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:29.487 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f900d3c80 0x7f6f901f3c20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000ebe0 tx=0x7f6f8000c520 comp rx=0 tx=0).stop 2024-06-10T00:14:29.487 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 shutdown_connections 2024-06-10T00:14:29.487 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f7c06bda0 0x7f6f7c06e260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.487 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9015e530 0x7f6f900b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.487 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015e150 0x7f6f901531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.488 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 --2- 172.21.15.79:0/5296291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f900d3c80 0x7f6f901f3c20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:29.488 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 >> 172.21.15.79:0/5296291 conn(0x7f6f90067c30 msgr2=0x7f6f901610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:29.488 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 shutdown_connections 2024-06-10T00:14:29.488 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:29.487+0000 7f6f9602a640 1 -- 172.21.15.79:0/5296291 wait complete. 2024-06-10T00:14:29.496 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-10T00:14:36.303 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:36.404 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.403+0000 7f95b76ba640 1 Processor -- start 2024-06-10T00:14:36.404 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.404+0000 7f95b76ba640 1 -- start start 2024-06-10T00:14:36.408 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.404+0000 7f95b76ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b015e150 0x7f95b00d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.408 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.404+0000 7f95b76ba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b00d0020 con 0x7f95b015e530 2024-06-10T00:14:36.408 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.404+0000 7f95b76ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b00cf4a0 con 0x7f95b00d3c80 2024-06-10T00:14:36.408 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.404+0000 7f95b76ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95b00cf280 con 0x7f95b015e150 2024-06-10T00:14:36.408 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95b4c55640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f95b015e530 0x7f95b00ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56822/0 (socket says 172.21.15.79:56822) 2024-06-10T00:14:36.408 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95b4c55640 1 -- 172.21.15.79:0/3912052856 learned_addr learned my addr 172.21.15.79:0/3912052856 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:36.408 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95b5456640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b015e150 0x7f95b00d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.408 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957497475 0 0) 0x7f95b00d0020 con 0x7f95b015e530 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c003520 con 0x7f95b015e530 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178378727 0 0) 0x7f95b00cf4a0 con 0x7f95b00d3c80 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95b00d0020 con 0x7f95b00d3c80 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 194478612 0 0) 0x7f959c003520 con 0x7f95b015e530 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b015e150 msgr2=0x7f95b00d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b015e150 0x7f95b00d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 >> v1:172.21.15.117:6789/0 conn(0x7f95b00d3c80 legacy=0x7f95b00d40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b00cf780 con 0x7f95b015e530 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f95a0001670 con 0x7f95b015e530 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 >> v1:172.21.15.79:6789/0 conn(0x7f95b015e530 legacy=0x7f95b00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.409 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c003b70 0x7f959c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f959c004800 0x7f959c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b015e150 0x7f959c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95b00cf280 con 0x7f959c004800 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f959c00bad0 con 0x7f959c003b70 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f959c00bcd0 con 0x7f95b015e150 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95b4c55640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f959c004800 0x7f959c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95b5456640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c003b70 0x7f959c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.405+0000 7f95b5c57640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b015e150 0x7f959c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95b4c55640 1 -- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b015e150 msgr2=0x7f959c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95b4c55640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b015e150 0x7f959c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95b4c55640 1 -- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c003b70 msgr2=0x7f959c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95b4c55640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c003b70 0x7f959c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.410 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95b4c55640 1 -- 172.21.15.79:0/3912052856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c003520 con 0x7f959c004800 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95b4c55640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f959c004800 0x7f959c004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f95b00d5160 tx=0x7f959c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae7058b7ea12c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0007cc0 con 0x7f959c004800 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a0005af0 con 0x7f959c004800 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.406+0000 7f95a7fff640 1 -- 172.21.15.79:0/3912052856 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0007070 con 0x7f959c004800 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.407+0000 7f95b76ba640 1 -- 172.21.15.79:0/3912052856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f959c004800 msgr2=0x7f959c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.407+0000 7f95b76ba640 1 --2- 172.21.15.79:0/3912052856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f959c004800 0x7f959c004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f95b00d5160 tx=0x7f959c005830 comp rx=0 tx=0).stop 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.407+0000 7f95b5c57640 1 -- 172.21.15.79:0/3912052856 reap_dead start 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.407+0000 7f95b76ba640 1 -- 172.21.15.79:0/3912052856 shutdown_connections 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.407+0000 7f95b76ba640 1 -- 172.21.15.79:0/3912052856 >> 172.21.15.79:0/3912052856 conn(0x7f95b0067c30 msgr2=0x7f95b009d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.407+0000 7f95b76ba640 1 -- 172.21.15.79:0/3912052856 shutdown_connections 2024-06-10T00:14:36.411 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.407+0000 7f95b76ba640 1 -- 172.21.15.79:0/3912052856 wait complete. 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.408+0000 7f95b76ba640 1 Processor -- start 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.408+0000 7f95b76ba640 1 -- start start 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b76ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c004800 0x7f95b00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b76ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b015b570 0x7f95b00c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b76ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b00c8ac0 0x7f95b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b76ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95b00cc420 con 0x7f95b015b570 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b76ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f95b00cfd40 con 0x7f959c004800 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b76ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95b00cc5a0 con 0x7f95b00c8ac0 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b4c55640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b015b570 0x7f95b00c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b4c55640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b015b570 0x7f95b00c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43894/0 (socket says 172.21.15.79:43894) 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b4c55640 1 -- 172.21.15.79:0/3510311267 learned_addr learned my addr 172.21.15.79:0/3510311267 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:36.414 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b5c57640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b00c8ac0 0x7f95b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.409+0000 7f95b5456640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c004800 0x7f95b00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95b4c55640 1 -- 172.21.15.79:0/3510311267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b00c8ac0 msgr2=0x7f95b006d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95b4c55640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b00c8ac0 0x7f95b006d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95b4c55640 1 -- 172.21.15.79:0/3510311267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c004800 msgr2=0x7f95b00ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95b4c55640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c004800 0x7f95b00ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95b4c55640 1 -- 172.21.15.79:0/3510311267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b00c9440 con 0x7f95b015b570 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95b4c55640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b015b570 0x7f95b00c8580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95a000c190 tx=0x7f95b00cf950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95a5ffb640 1 -- 172.21.15.79:0/3510311267 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0041030 con 0x7f95b015b570 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95a5ffb640 1 -- 172.21.15.79:0/3510311267 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a0038040 con 0x7f95b015b570 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b00c9720 con 0x7f95b015b570 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95a5ffb640 1 -- 172.21.15.79:0/3510311267 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0007070 con 0x7f95b015b570 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.410+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b00c9ce0 con 0x7f95b015b570 2024-06-10T00:14:36.415 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.411+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b0068cf0 con 0x7f95b015b570 2024-06-10T00:14:36.416 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.411+0000 7f95a5ffb640 1 -- 172.21.15.79:0/3510311267 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95a0044070 con 0x7f95b015b570 2024-06-10T00:14:36.416 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.412+0000 7f95a5ffb640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f959406be60 0x7f959406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.416 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.412+0000 7f95a5ffb640 1 -- 172.21.15.79:0/3510311267 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f95a00aa3f0 con 0x7f95b015b570 2024-06-10T00:14:36.416 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.412+0000 7f95b5456640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f959406be60 0x7f959406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.416 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.412+0000 7f95b5456640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f959406be60 0x7f959406e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95ac014370 tx=0x7f95ac00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:36.417 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.417+0000 7f95a5ffb640 1 -- 172.21.15.79:0/3510311267 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f95a004b020 con 0x7f95b015b570 2024-06-10T00:14:36.591 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.590+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95b0161670 con 0x7f95b015b570 2024-06-10T00:14:36.592 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.591+0000 7f95a5ffb640 1 -- 172.21.15.79:0/3510311267 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7f95a0078aa0 con 0x7f95b015b570 2024-06-10T00:14:36.592 INFO:teuthology.misc.health.smithi079.stdout: 2024-06-10T00:14:36.592 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":16,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:33.236210+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:36.594 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f959406be60 msgr2=0x7f959406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.594 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f959406be60 0x7f959406e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95ac014370 tx=0x7f95ac00b040 comp rx=0 tx=0).stop 2024-06-10T00:14:36.594 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b015b570 msgr2=0x7f95b00c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b015b570 0x7f95b00c8580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95a000c190 tx=0x7f95b00cf950 comp rx=0 tx=0).stop 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 shutdown_connections 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f959406be60 0x7f959406e320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95b00c8ac0 0x7f95b006d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b015b570 0x7f95b00c8580 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 --2- 172.21.15.79:0/3510311267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959c004800 0x7f95b00ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 >> 172.21.15.79:0/3510311267 conn(0x7f95b0067c30 msgr2=0x7f95b0160950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 shutdown_connections 2024-06-10T00:14:36.595 INFO:teuthology.misc.health.smithi079.stderr:2024-06-10T00:14:36.593+0000 7f95b76ba640 1 -- 172.21.15.79:0/3510311267 wait complete. 2024-06-10T00:14:36.604 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-06-10T00:14:36.604 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-06-10T00:14:36.604 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-10T00:14:36.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-10T00:14:36.606 INFO:tasks.ceph.mds.a:Started 2024-06-10T00:14:36.607 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-10T00:14:36.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-10T00:14:36.608 INFO:tasks.ceph.mds.c:Started 2024-06-10T00:14:36.609 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-10T00:14:36.609 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-10T00:14:36.611 INFO:tasks.ceph.mds.b:Started 2024-06-10T00:14:36.612 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-10T00:14:36.612 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-10T00:14:36.614 INFO:tasks.ceph.mds.d:Started 2024-06-10T00:14:36.614 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-06-10T00:14:36.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:14:36.680 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:14:36.681 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:14:36.697 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:14:36.698 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:14:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.718+0000 7ff07c116640 1 Processor -- start 2024-06-10T00:14:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.718+0000 7ff07c116640 1 -- start start 2024-06-10T00:14:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07c116640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff074159d80 0x7ff0740d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07c116640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff07415cc60 0x7ff07409aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07c116640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff07415d1a0 con 0x7ff07409aa10 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07c116640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff0740b50c0 con 0x7ff07415cc60 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07c116640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff07415d480 con 0x7ff074159d80 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07a6b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff07415cc60 0x7ff07409aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff0796b1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff07409aa10 0x7ff07415c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56838/0 (socket says 172.21.15.79:56838) 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff0796b1640 1 -- 172.21.15.79:0/4222593697 learned_addr learned my addr 172.21.15.79:0/4222593697 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff078eb0640 1 -- 172.21.15.79:0/4222593697 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7461843 0 0) 0x7ff07415d1a0 con 0x7ff07409aa10 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff078eb0640 1 -- 172.21.15.79:0/4222593697 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff060003520 con 0x7ff07409aa10 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07a6b3640 1 -- 172.21.15.79:0/4222593697 >> v2:172.21.15.117:3300/0 conn(0x7ff074159d80 msgr2=0x7ff0740d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07a6b3640 1 --2- 172.21.15.79:0/4222593697 >> v2:172.21.15.117:3300/0 conn(0x7ff074159d80 0x7ff0740d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07a6b3640 1 -- 172.21.15.79:0/4222593697 >> v1:172.21.15.79:6789/0 conn(0x7ff07409aa10 legacy=0x7ff07415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.719+0000 7ff07a6b3640 1 -- 172.21.15.79:0/4222593697 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0740d1ba0 con 0x7ff07415cc60 2024-06-10T00:14:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff07a6b3640 1 --2- 172.21.15.79:0/4222593697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff07409aec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009d90 tx=0x7ff06c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4e8fdff658ab45 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff078eb0640 1 -- 172.21.15.79:0/4222593697 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c007740 con 0x7ff07415cc60 2024-06-10T00:14:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff078eb0640 1 -- 172.21.15.79:0/4222593697 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c0078e0 con 0x7ff07415cc60 2024-06-10T00:14:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff078eb0640 1 -- 172.21.15.79:0/4222593697 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c007cb0 con 0x7ff07415cc60 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff07c116640 1 -- 172.21.15.79:0/4222593697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 msgr2=0x7ff07409aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff07c116640 1 --2- 172.21.15.79:0/4222593697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff07409aec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009d90 tx=0x7ff06c02a6a0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff07c116640 1 -- 172.21.15.79:0/4222593697 shutdown_connections 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff07c116640 1 --2- 172.21.15.79:0/4222593697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff07409aec0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff07c116640 1 --2- 172.21.15.79:0/4222593697 >> v2:172.21.15.117:3300/0 conn(0x7ff074159d80 0x7ff0740d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.720+0000 7ff07c116640 1 -- 172.21.15.79:0/4222593697 >> 172.21.15.79:0/4222593697 conn(0x7ff0740b7270 msgr2=0x7ff0740b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.721+0000 7ff07c116640 1 -- 172.21.15.79:0/4222593697 shutdown_connections 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.721+0000 7ff07c116640 1 -- 172.21.15.79:0/4222593697 wait complete. 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.722+0000 7ff07c116640 1 Processor -- start 2024-06-10T00:14:36.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.722+0000 7ff07c116640 1 -- start start 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff07c116640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff07409aa10 0x7ff0741591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff07c116640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff0740b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff07c116640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0740b0e90 0x7ff074143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff07c116640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0740d2bc0 con 0x7ff07415cc60 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff07c116640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff0740d2160 con 0x7ff07409aa10 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff07c116640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0740b1d20 con 0x7ff0740b0e90 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff0740b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff0740b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43940/0 (socket says 172.21.15.79:43940) 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 -- 172.21.15.79:0/1259116220 learned_addr learned my addr 172.21.15.79:0/1259116220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff079eb2640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff07409aa10 0x7ff0741591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff07a6b3640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0740b0e90 0x7ff074143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 -- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0740b0e90 msgr2=0x7ff074143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0740b0e90 0x7ff074143c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 -- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff07409aa10 msgr2=0x7ff0741591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff07409aa10 0x7ff0741591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 -- 172.21.15.79:0/1259116220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff074144a10 con 0x7ff07415cc60 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff079eb2640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff07409aa10 0x7ff0741591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff0796b1640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff0740b0950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff06400c430 tx=0x7ff06400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff06a7fc640 1 -- 172.21.15.79:0/1259116220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064017070 con 0x7ff07415cc60 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff06a7fc640 1 -- 172.21.15.79:0/1259116220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff064005ce0 con 0x7ff07415cc60 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff074144cf0 con 0x7ff07415cc60 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.723+0000 7ff06a7fc640 1 -- 172.21.15.79:0/1259116220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0640072f0 con 0x7ff07415cc60 2024-06-10T00:14:36.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.724+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0741e49d0 con 0x7ff07415cc60 2024-06-10T00:14:36.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.725+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0740b12a0 con 0x7ff07415cc60 2024-06-10T00:14:36.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.725+0000 7ff06a7fc640 1 -- 172.21.15.79:0/1259116220 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff06401a070 con 0x7ff07415cc60 2024-06-10T00:14:36.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.725+0000 7ff06a7fc640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05806be30 0x7ff05806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:36.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.726+0000 7ff06a7fc640 1 -- 172.21.15.79:0/1259116220 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff06408a010 con 0x7ff07415cc60 2024-06-10T00:14:36.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.726+0000 7ff079eb2640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05806be30 0x7ff05806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:36.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.726+0000 7ff079eb2640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05806be30 0x7ff05806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff070006fd0 tx=0x7ff070008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:36.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.730+0000 7ff06a7fc640 1 -- 172.21.15.79:0/1259116220 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff0740b12a0 con 0x7ff07415cc60 2024-06-10T00:14:36.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.947+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0741e47c0 con 0x7ff07415cc60 2024-06-10T00:14:36.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.947+0000 7ff06a7fc640 1 -- 172.21.15.79:0/1259116220 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7ff064058d10 con 0x7ff07415cc60 2024-06-10T00:14:36.948 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:36.948 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-10T00:14:36.949 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 2 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05806be30 msgr2=0x7ff05806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05806be30 0x7ff05806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff070006fd0 tx=0x7ff070008040 comp rx=0 tx=0).stop 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 msgr2=0x7ff0740b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff0740b0950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff06400c430 tx=0x7ff06400c8f0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 shutdown_connections 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05806be30 0x7ff05806e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0740b0e90 0x7ff074143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff07415cc60 0x7ff0740b0950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 --2- 172.21.15.79:0/1259116220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff07409aa10 0x7ff0741591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 >> 172.21.15.79:0/1259116220 conn(0x7ff0740b7270 msgr2=0x7ff07406f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 shutdown_connections 2024-06-10T00:14:36.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:36.950+0000 7ff07c116640 1 -- 172.21.15.79:0/1259116220 wait complete. 2024-06-10T00:14:38.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:14:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.072+0000 7f30bfc72640 1 Processor -- start 2024-06-10T00:14:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.072+0000 7f30bfc72640 1 -- start start 2024-06-10T00:14:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.073+0000 7f30bfc72640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30b815c7f0 0x7f30b80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.073+0000 7f30bfc72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30b80b4530 0x7f30b80ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.073+0000 7f30bfc72640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b80725f0 con 0x7f30b8156830 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.073+0000 7f30bfc72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f30b80b3090 con 0x7f30b80b4530 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.073+0000 7f30bfc72640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f30b80728d0 con 0x7f30b815c7f0 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.073+0000 7f30be20f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30b80b4530 0x7f30b80ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.073+0000 7f30be20f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30b80b4530 0x7f30b80ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40376/0 (socket says 172.21.15.79:40376) 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.073+0000 7f30be20f640 1 -- 172.21.15.79:0/1770788104 learned_addr learned my addr 172.21.15.79:0/1770788104 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.074+0000 7f30bd20d640 1 --2- 172.21.15.79:0/1770788104 >> v2:172.21.15.117:3300/0 conn(0x7f30b815c7f0 0x7f30b80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.074+0000 7f30be20f640 1 -- 172.21.15.79:0/1770788104 >> v2:172.21.15.117:3300/0 conn(0x7f30b815c7f0 msgr2=0x7f30b80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.074+0000 7f30be20f640 1 --2- 172.21.15.79:0/1770788104 >> v2:172.21.15.117:3300/0 conn(0x7f30b815c7f0 0x7f30b80cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.074+0000 7f30be20f640 1 -- 172.21.15.79:0/1770788104 >> v1:172.21.15.117:6789/0 conn(0x7f30b8156830 legacy=0x7f30b8071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:39.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.074+0000 7f30be20f640 1 -- 172.21.15.79:0/1770788104 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b8072bb0 con 0x7f30b80b4530 2024-06-10T00:14:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.074+0000 7f30be20f640 1 --2- 172.21.15.79:0/1770788104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b80ccbb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30b80d0d40 tx=0x7f30b002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6581c59ebfd9bf5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bca0c640 1 -- 172.21.15.79:0/1770788104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0036070 con 0x7f30b80b4530 2024-06-10T00:14:39.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bca0c640 1 -- 172.21.15.79:0/1770788104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b0031600 con 0x7f30b80b4530 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bca0c640 1 -- 172.21.15.79:0/1770788104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b00319d0 con 0x7f30b80b4530 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bfc72640 1 -- 172.21.15.79:0/1770788104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 msgr2=0x7f30b80ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1770788104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b80ccbb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30b80d0d40 tx=0x7f30b002a6f0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bfc72640 1 -- 172.21.15.79:0/1770788104 shutdown_connections 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1770788104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b80ccbb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1770788104 >> v2:172.21.15.117:3300/0 conn(0x7f30b815c7f0 0x7f30b80cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bfc72640 1 -- 172.21.15.79:0/1770788104 >> 172.21.15.79:0/1770788104 conn(0x7f30b80b19f0 msgr2=0x7f30b80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bfc72640 1 -- 172.21.15.79:0/1770788104 shutdown_connections 2024-06-10T00:14:39.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.075+0000 7f30bfc72640 1 -- 172.21.15.79:0/1770788104 wait complete. 2024-06-10T00:14:39.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.076+0000 7f30bfc72640 1 Processor -- start 2024-06-10T00:14:39.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bfc72640 1 -- start start 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bfc72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b814b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bfc72640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b8156830 0x7f30b8154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bfc72640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b815c7f0 0x7f30b80ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bfc72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8165cc0 con 0x7f30b80b4530 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bfc72640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8072300 con 0x7f30b815c7f0 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bfc72640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30b8165e40 con 0x7f30b8156830 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bda0e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b814b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bda0e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b814b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40380/0 (socket says 172.21.15.79:40380) 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.077+0000 7f30bda0e640 1 -- 172.21.15.79:0/1230110316 learned_addr learned my addr 172.21.15.79:0/1230110316 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bd20d640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b8156830 0x7f30b8154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30be20f640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b815c7f0 0x7f30b80ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bda0e640 1 -- 172.21.15.79:0/1230110316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b8156830 msgr2=0x7f30b8154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bda0e640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b8156830 0x7f30b8154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bda0e640 1 -- 172.21.15.79:0/1230110316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b815c7f0 msgr2=0x7f30b80ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bda0e640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b815c7f0 0x7f30b80ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bda0e640 1 -- 172.21.15.79:0/1230110316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b80cdbe0 con 0x7f30b80b4530 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bda0e640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b814b8a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c440 tx=0x7f30b400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30ae7fc640 1 -- 172.21.15.79:0/1230110316 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4017070 con 0x7f30b80b4530 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30ae7fc640 1 -- 172.21.15.79:0/1230110316 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40035f0 con 0x7f30b80b4530 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30ae7fc640 1 -- 172.21.15.79:0/1230110316 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40039e0 con 0x7f30b80b4530 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b814d410 con 0x7f30b80b4530 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.078+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b814ce50 con 0x7f30b80b4530 2024-06-10T00:14:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.079+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b8068430 con 0x7f30b80b4530 2024-06-10T00:14:39.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.079+0000 7f30ae7fc640 1 -- 172.21.15.79:0/1230110316 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30b401a070 con 0x7f30b80b4530 2024-06-10T00:14:39.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.080+0000 7f30ae7fc640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f309c06be30 0x7f309c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.080+0000 7f30ae7fc640 1 -- 172.21.15.79:0/1230110316 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f30b4089ee0 con 0x7f30b80b4530 2024-06-10T00:14:39.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.080+0000 7f30bd20d640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f309c06be30 0x7f309c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.080+0000 7f30bd20d640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f309c06be30 0x7f309c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30a8006fd0 tx=0x7f30a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.084+0000 7f30ae7fc640 1 -- 172.21.15.79:0/1230110316 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f30b4058c70 con 0x7f30b80b4530 2024-06-10T00:14:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.295+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30b80cddb0 con 0x7f30b80b4530 2024-06-10T00:14:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.295+0000 7f30ae7fc640 1 -- 172.21.15.79:0/1230110316 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f30b40010c0 con 0x7f30b80b4530 2024-06-10T00:14:39.296 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:39.296 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-10T00:14:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 3 2024-06-10T00:14:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f309c06be30 msgr2=0x7f309c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f309c06be30 0x7f309c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30a8006fd0 tx=0x7f30a8008040 comp rx=0 tx=0).stop 2024-06-10T00:14:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 msgr2=0x7f30b814b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b814b8a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c440 tx=0x7f30b400c900 comp rx=0 tx=0).stop 2024-06-10T00:14:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 shutdown_connections 2024-06-10T00:14:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f309c06be30 0x7f309c06e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b815c7f0 0x7f30b80ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b8156830 0x7f30b8154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 --2- 172.21.15.79:0/1230110316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b80b4530 0x7f30b814b8a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 >> 172.21.15.79:0/1230110316 conn(0x7f30b80b19f0 msgr2=0x7f30b815f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 shutdown_connections 2024-06-10T00:14:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.297+0000 7f30bfc72640 1 -- 172.21.15.79:0/1230110316 wait complete. 2024-06-10T00:14:39.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-10T00:14:39.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.406+0000 7fce34d09640 1 Processor -- start 2024-06-10T00:14:39.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.406+0000 7fce34d09640 1 -- start start 2024-06-10T00:14:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce34d09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3006ebf0 0x7fce300cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce34d09640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce300cf190 0x7fce300acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce34d09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce300cf640 con 0x7fce300ae910 2024-06-10T00:14:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce34d09640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fce3006d130 con 0x7fce300cf190 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce34d09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce3006d410 con 0x7fce3006ebf0 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2e59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fce300ae910 0x7fce3006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34558/0 (socket says 172.21.15.79:34558) 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2e59c640 1 -- 172.21.15.79:0/3564058678 learned_addr learned my addr 172.21.15.79:0/3564058678 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2ed9d640 1 --2- 172.21.15.79:0/3564058678 >> v2:172.21.15.117:3300/0 conn(0x7fce300cf190 0x7fce300acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2dd9b640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3006ebf0 0x7fce300cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967185716 0 0) 0x7fce300cf640 con 0x7fce300ae910 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce18003520 con 0x7fce300ae910 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 681369569 0 0) 0x7fce18003520 con 0x7fce300ae910 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3006ebf0 msgr2=0x7fce300cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3006ebf0 0x7fce300cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 >> v2:172.21.15.117:3300/0 conn(0x7fce300cf190 msgr2=0x7fce300acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 --2- 172.21.15.79:0/3564058678 >> v2:172.21.15.117:3300/0 conn(0x7fce300cf190 0x7fce300acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3006d6f0 con 0x7fce300ae910 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fce20001670 con 0x7fce300ae910 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 >> v1:172.21.15.79:6789/0 conn(0x7fce300ae910 legacy=0x7fce3006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce180039b0 0x7fce18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce18004800 0x7fce18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.407+0000 7fce2d59a640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3006ebf0 0x7fce180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce3006d130 con 0x7fce180039b0 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce3006d410 con 0x7fce18004800 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce1800dc00 con 0x7fce3006ebf0 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2e59c640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce180039b0 0x7fce18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2dd9b640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce18004800 0x7fce18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2ed9d640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3006ebf0 0x7fce180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2e59c640 1 -- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3006ebf0 msgr2=0x7fce180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2e59c640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3006ebf0 0x7fce180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2e59c640 1 -- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce18004800 msgr2=0x7fce18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2e59c640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce18004800 0x7fce18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2e59c640 1 -- 172.21.15.79:0/3564058678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce18003520 con 0x7fce180039b0 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.408+0000 7fce2e59c640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce180039b0 0x7fce18003dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce2000c240 tx=0x7fce18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10483832a9a26873 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce20007d10 con 0x7fce180039b0 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce20005ad0 con 0x7fce180039b0 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce2d59a640 1 -- 172.21.15.79:0/3564058678 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce20007070 con 0x7fce180039b0 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce34d09640 1 -- 172.21.15.79:0/3564058678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce180039b0 msgr2=0x7fce18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce34d09640 1 --2- 172.21.15.79:0/3564058678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce180039b0 0x7fce18003dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce2000c240 tx=0x7fce18005830 comp rx=0 tx=0).stop 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce2ed9d640 1 -- 172.21.15.79:0/3564058678 reap_dead start 2024-06-10T00:14:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce34d09640 1 -- 172.21.15.79:0/3564058678 shutdown_connections 2024-06-10T00:14:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce34d09640 1 -- 172.21.15.79:0/3564058678 >> 172.21.15.79:0/3564058678 conn(0x7fce300b19f0 msgr2=0x7fce300b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce34d09640 1 -- 172.21.15.79:0/3564058678 shutdown_connections 2024-06-10T00:14:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.409+0000 7fce34d09640 1 -- 172.21.15.79:0/3564058678 wait complete. 2024-06-10T00:14:39.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce34d09640 1 Processor -- start 2024-06-10T00:14:39.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce34d09640 1 -- start start 2024-06-10T00:14:39.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce34d09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce180039b0 0x7fce3009b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce34d09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3014b810 0x7fce3015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce34d09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce30156f30 0x7fce3015dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce34d09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce300ad280 con 0x7fce3014b810 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce34d09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce300aecf0 con 0x7fce30156f30 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce34d09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce300ad400 con 0x7fce180039b0 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce2dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3014b810 0x7fce3015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce2dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3014b810 0x7fce3015b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40404/0 (socket says 172.21.15.79:40404) 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.411+0000 7fce2dd9b640 1 -- 172.21.15.79:0/287160817 learned_addr learned my addr 172.21.15.79:0/287160817 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2e59c640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce180039b0 0x7fce3009b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2ed9d640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce30156f30 0x7fce3015dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2dd9b640 1 -- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce180039b0 msgr2=0x7fce3009b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2dd9b640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce180039b0 0x7fce3009b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2dd9b640 1 -- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce30156f30 msgr2=0x7fce3015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2dd9b640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce30156f30 0x7fce3015dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2dd9b640 1 -- 172.21.15.79:0/287160817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3015be90 con 0x7fce3014b810 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2ed9d640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce30156f30 0x7fce3015dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce2dd9b640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3014b810 0x7fce3015b4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce24011940 tx=0x7fce24011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce1effd640 1 -- 172.21.15.79:0/287160817 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2400faf0 con 0x7fce3014b810 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce1effd640 1 -- 172.21.15.79:0/287160817 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2400fc90 con 0x7fce3014b810 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3009d790 con 0x7fce3014b810 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce1effd640 1 -- 172.21.15.79:0/287160817 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24014440 con 0x7fce3014b810 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.412+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3015c3e0 con 0x7fce3014b810 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.413+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce30068430 con 0x7fce3014b810 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.413+0000 7fce1effd640 1 -- 172.21.15.79:0/287160817 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce24012040 con 0x7fce3014b810 2024-06-10T00:14:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.414+0000 7fce1effd640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.414+0000 7fce1effd640 1 -- 172.21.15.79:0/287160817 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fce2408b1c0 con 0x7fce3014b810 2024-06-10T00:14:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.414+0000 7fce2e59c640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.414+0000 7fce2e59c640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce1006be30 0x7fce1006e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce20033000 tx=0x7fce2002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.418+0000 7fce1effd640 1 -- 172.21.15.79:0/287160817 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fce24019030 con 0x7fce3014b810 2024-06-10T00:14:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.592+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fce300ce880 con 0x7fce3014b810 2024-06-10T00:14:39.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.592+0000 7fce1effd640 1 -- 172.21.15.79:0/287160817 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fce24059ec0 con 0x7fce3014b810 2024-06-10T00:14:39.593 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:39.593 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:14:39.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:14:39.593 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-06-10T00:14:39.593 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-06-10T00:14:39.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:14:39.593 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:14:39.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce1006be30 msgr2=0x7fce1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce1006be30 0x7fce1006e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce20033000 tx=0x7fce2002e000 comp rx=0 tx=0).stop 2024-06-10T00:14:39.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3014b810 msgr2=0x7fce3015b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3014b810 0x7fce3015b4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce24011940 tx=0x7fce24011e00 comp rx=0 tx=0).stop 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 shutdown_connections 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce30156f30 0x7fce3015dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3014b810 0x7fce3015b4c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 --2- 172.21.15.79:0/287160817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce180039b0 0x7fce3009b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 >> 172.21.15.79:0/287160817 conn(0x7fce300b19f0 msgr2=0x7fce3006e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 shutdown_connections 2024-06-10T00:14:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.594+0000 7fce34d09640 1 -- 172.21.15.79:0/287160817 wait complete. 2024-06-10T00:14:39.606 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-10T00:14:39.606 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-10T00:14:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.707+0000 7f051289e640 1 Processor -- start 2024-06-10T00:14:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.707+0000 7f051289e640 1 -- start start 2024-06-10T00:14:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f051289e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f050c0ce090 0x7f050c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f051289e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050c15f0a0 con 0x7f050c1588f0 2024-06-10T00:14:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f051289e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050c15f380 con 0x7f050c0d1900 2024-06-10T00:14:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f051289e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f050c0d0f30 con 0x7f050c0ce090 2024-06-10T00:14:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f050b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f050c0ce090 0x7f050c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f050bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f050c1588f0 0x7f050c15e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34560/0 (socket says 172.21.15.79:34560) 2024-06-10T00:14:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f050bfff640 1 -- 172.21.15.79:0/3864118489 learned_addr learned my addr 172.21.15.79:0/3864118489 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f050b7fe640 1 -- 172.21.15.79:0/3864118489 >> v1:172.21.15.117:6789/0 conn(0x7f050c0d1900 legacy=0x7f050c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f050b7fe640 1 -- 172.21.15.79:0/3864118489 >> v1:172.21.15.79:6789/0 conn(0x7f050c1588f0 legacy=0x7f050c15e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f050b7fe640 1 -- 172.21.15.79:0/3864118489 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c0d0bc0 con 0x7f050c0ce090 2024-06-10T00:14:39.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.708+0000 7f050affd640 1 -- 172.21.15.79:0/3864118489 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451312994 0 0) 0x7f050c15f0a0 con 0x7f050c1588f0 2024-06-10T00:14:39.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.709+0000 7f050b7fe640 1 --2- 172.21.15.79:0/3864118489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c0ce090 0x7f050c0d13c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05000097a0 tx=0x7f050002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d29f082c445d81 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.709+0000 7f050affd640 1 -- 172.21.15.79:0/3864118489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500037070 con 0x7f050c0ce090 2024-06-10T00:14:39.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.709+0000 7f050affd640 1 -- 172.21.15.79:0/3864118489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0500032440 con 0x7f050c0ce090 2024-06-10T00:14:39.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.709+0000 7f050affd640 1 -- 172.21.15.79:0/3864118489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500032810 con 0x7f050c0ce090 2024-06-10T00:14:39.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.710+0000 7f051289e640 1 -- 172.21.15.79:0/3864118489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c0ce090 msgr2=0x7f050c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.710+0000 7f051289e640 1 --2- 172.21.15.79:0/3864118489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c0ce090 0x7f050c0d13c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05000097a0 tx=0x7f050002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.710+0000 7f051289e640 1 -- 172.21.15.79:0/3864118489 shutdown_connections 2024-06-10T00:14:39.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.710+0000 7f051289e640 1 --2- 172.21.15.79:0/3864118489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c0ce090 0x7f050c0d13c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.710+0000 7f051289e640 1 -- 172.21.15.79:0/3864118489 >> 172.21.15.79:0/3864118489 conn(0x7f050c06c6b0 msgr2=0x7f050c06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:39.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.710+0000 7f051289e640 1 -- 172.21.15.79:0/3864118489 shutdown_connections 2024-06-10T00:14:39.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.710+0000 7f051289e640 1 -- 172.21.15.79:0/3864118489 wait complete. 2024-06-10T00:14:39.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.711+0000 7f051289e640 1 Processor -- start 2024-06-10T00:14:39.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.711+0000 7f051289e640 1 -- start start 2024-06-10T00:14:39.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f051289e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050c0ce090 0x7f050c0b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f051289e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c1588f0 0x7f050c14b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f051289e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c155250 0x7f050c1f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f051289e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f050c06bc50 con 0x7f050c155250 2024-06-10T00:14:39.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f051289e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f050c06bad0 con 0x7f050c1588f0 2024-06-10T00:14:39.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f051289e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f050c072120 con 0x7f050c0ce090 2024-06-10T00:14:39.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c155250 0x7f050c1f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c155250 0x7f050c1f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40420/0 (socket says 172.21.15.79:40420) 2024-06-10T00:14:39.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 -- 172.21.15.79:0/1746690390 learned_addr learned my addr 172.21.15.79:0/1746690390 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:39.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 -- 172.21.15.79:0/1746690390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050c0ce090 msgr2=0x7f050c0b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050c0ce090 0x7f050c0b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 -- 172.21.15.79:0/1746690390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c1588f0 msgr2=0x7f050c14b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:39.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c1588f0 0x7f050c14b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:39.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 -- 172.21.15.79:0/1746690390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c0b1470 con 0x7f050c155250 2024-06-10T00:14:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0510e3b640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c155250 0x7f050c1f7680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f050400c700 tx=0x7f050400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0508ff9640 1 -- 172.21.15.79:0/1746690390 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504016020 con 0x7f050c155250 2024-06-10T00:14:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0508ff9640 1 -- 172.21.15.79:0/1746690390 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050400aa70 con 0x7f050c155250 2024-06-10T00:14:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f0508ff9640 1 -- 172.21.15.79:0/1746690390 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050400ce10 con 0x7f050c155250 2024-06-10T00:14:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.712+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c155ac0 con 0x7f050c155250 2024-06-10T00:14:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.713+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c0b1710 con 0x7f050c155250 2024-06-10T00:14:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.714+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050c06cf30 con 0x7f050c155250 2024-06-10T00:14:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.714+0000 7f0508ff9640 1 -- 172.21.15.79:0/1746690390 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0504019020 con 0x7f050c155250 2024-06-10T00:14:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.714+0000 7f0508ff9640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04f806be30 0x7f04f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.714+0000 7f050bfff640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04f806be30 0x7f04f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.714+0000 7f0508ff9640 1 -- 172.21.15.79:0/1746690390 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f050408adb0 con 0x7f050c155250 2024-06-10T00:14:39.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.715+0000 7f050bfff640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04f806be30 0x7f04f806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04fc007fd0 tx=0x7f04fc007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:39.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.719+0000 7f0508ff9640 1 -- 172.21.15.79:0/1746690390 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f050c06cf30 con 0x7f050c155250 2024-06-10T00:14:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:39.893+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f050c068540 con 0x7f050c155250 2024-06-10T00:14:40.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.838+0000 7f0508ff9640 1 -- 172.21.15.79:0/1746690390 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f0504020020 con 0x7f050c155250 2024-06-10T00:14:40.838 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-06-10T00:14:40.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04f806be30 msgr2=0x7f04f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:40.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04f806be30 0x7f04f806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04fc007fd0 tx=0x7f04fc007960 comp rx=0 tx=0).stop 2024-06-10T00:14:40.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c155250 msgr2=0x7f050c1f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:40.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c155250 0x7f050c1f7680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f050400c700 tx=0x7f050400cbc0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 shutdown_connections 2024-06-10T00:14:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04f806be30 0x7f04f806e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c155250 0x7f050c1f7680 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c1588f0 0x7f050c14b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 --2- 172.21.15.79:0/1746690390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050c0ce090 0x7f050c0b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 >> 172.21.15.79:0/1746690390 conn(0x7f050c06c6b0 msgr2=0x7f050c06f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 shutdown_connections 2024-06-10T00:14:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.842+0000 7f051289e640 1 -- 172.21.15.79:0/1746690390 wait complete. 2024-06-10T00:14:40.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-10T00:14:40.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.965+0000 7fa0c5c5d640 1 Processor -- start 2024-06-10T00:14:40.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.965+0000 7fa0c5c5d640 1 -- start start 2024-06-10T00:14:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0c5c5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00d1420 0x7fa0c006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0c5c5d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c00b49b0 con 0x7fa0c00d0f90 2024-06-10T00:14:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0c5c5d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c00d1890 con 0x7fa0c015ad10 2024-06-10T00:14:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0c5c5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c00b4c80 con 0x7fa0c00d1420 2024-06-10T00:14:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0beffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa0c00d0f90 0x7fa0c006e8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34568/0 (socket says 172.21.15.79:34568) 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0beffd640 1 -- 172.21.15.79:0/764559470 learned_addr learned my addr 172.21.15.79:0/764559470 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252873536 0 0) 0x7fa0c00b49b0 con 0x7fa0c00d0f90 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0a8003520 con 0x7fa0c00d0f90 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0bffff640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00d1420 0x7fa0c006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2290364414 0 0) 0x7fa0a8003520 con 0x7fa0c00d0f90 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00d1420 msgr2=0x7fa0c006efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00d1420 0x7fa0c006efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 >> v1:172.21.15.117:6789/0 conn(0x7fa0c015ad10 legacy=0x7fa0c00b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c00b4f60 con 0x7fa0c00d0f90 2024-06-10T00:14:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fa0b4001670 con 0x7fa0c00d0f90 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 >> v1:172.21.15.79:6789/0 conn(0x7fa0c00d0f90 legacy=0x7fa0c006e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a80039e0 0x7fa0a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0a8004800 0x7fa0a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0a80051c0 0x7fa0a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c00b4c80 con 0x7fa0a8004800 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a800c060 con 0x7fa0a80039e0 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a800c260 con 0x7fa0a80051c0 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0bffff640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00d1420 0x7fa0c006efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0beffd640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0a8004800 0x7fa0a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0bf7fe640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a80039e0 0x7fa0a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.966+0000 7fa0bffff640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0a80051c0 0x7fa0a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:40.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0beffd640 1 -- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0a80051c0 msgr2=0x7fa0a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0beffd640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0a80051c0 0x7fa0a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0beffd640 1 -- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a80039e0 msgr2=0x7fa0a8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0beffd640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a80039e0 0x7fa0a8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0beffd640 1 -- 172.21.15.79:0/764559470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a8003520 con 0x7fa0a8004800 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0beffd640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0a8004800 0x7fa0a8004c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c210 tx=0x7fa0a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722835d7932e9422 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4007d30 con 0x7fa0a8004800 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4005ad0 con 0x7fa0a8004800 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.967+0000 7fa0be7fc640 1 -- 172.21.15.79:0/764559470 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4007070 con 0x7fa0a8004800 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.968+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/764559470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0a8004800 msgr2=0x7fa0a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.968+0000 7fa0c5c5d640 1 --2- 172.21.15.79:0/764559470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0a8004800 0x7fa0a8004c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c210 tx=0x7fa0a8005830 comp rx=0 tx=0).stop 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.968+0000 7fa0bffff640 1 -- 172.21.15.79:0/764559470 reap_dead start 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.968+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/764559470 shutdown_connections 2024-06-10T00:14:40.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.968+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/764559470 >> 172.21.15.79:0/764559470 conn(0x7fa0c006c6b0 msgr2=0x7fa0c006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:40.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.968+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/764559470 shutdown_connections 2024-06-10T00:14:40.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.968+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/764559470 wait complete. 2024-06-10T00:14:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.969+0000 7fa0c5c5d640 1 Processor -- start 2024-06-10T00:14:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.969+0000 7fa0c5c5d640 1 -- start start 2024-06-10T00:14:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0c5c5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a8004800 0x7fa0c009cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0c5c5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c0144ee0 0x7fa0c013e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0c5c5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00ae5f0 0x7fa0c00aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0c5c5d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c015b0f0 con 0x7fa0c0144ee0 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0c5c5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c00b5520 con 0x7fa0a8004800 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0c5c5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c00b3dc0 con 0x7fa0c00ae5f0 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0beffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c0144ee0 0x7fa0c013e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0beffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c0144ee0 0x7fa0c013e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40438/0 (socket says 172.21.15.79:40438) 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0beffd640 1 -- 172.21.15.79:0/2481209480 learned_addr learned my addr 172.21.15.79:0/2481209480 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0bf7fe640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a8004800 0x7fa0c009cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0bffff640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00ae5f0 0x7fa0c00aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0beffd640 1 -- 172.21.15.79:0/2481209480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00ae5f0 msgr2=0x7fa0c00aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0beffd640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00ae5f0 0x7fa0c00aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0beffd640 1 -- 172.21.15.79:0/2481209480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a8004800 msgr2=0x7fa0c009cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0beffd640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a8004800 0x7fa0c009cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.970+0000 7fa0beffd640 1 -- 172.21.15.79:0/2481209480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c009d430 con 0x7fa0c0144ee0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.971+0000 7fa0beffd640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c0144ee0 0x7fa0c013e560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4034040 tx=0x7fa0b4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.971+0000 7fa0a7fff640 1 -- 172.21.15.79:0/2481209480 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4042020 con 0x7fa0c0144ee0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.971+0000 7fa0a7fff640 1 -- 172.21.15.79:0/2481209480 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4004bf0 con 0x7fa0c0144ee0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.971+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c009d710 con 0x7fa0c0144ee0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.971+0000 7fa0a7fff640 1 -- 172.21.15.79:0/2481209480 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4007d10 con 0x7fa0c0144ee0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.971+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c01e37f0 con 0x7fa0c0144ee0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.972+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c00683c0 con 0x7fa0c0144ee0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.972+0000 7fa0a7fff640 1 -- 172.21.15.79:0/2481209480 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0b4045020 con 0x7fa0c0144ee0 2024-06-10T00:14:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.973+0000 7fa0a7fff640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0ac06be30 0x7fa0ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.973+0000 7fa0a7fff640 1 -- 172.21.15.79:0/2481209480 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fa0b40aaed0 con 0x7fa0c0144ee0 2024-06-10T00:14:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.973+0000 7fa0bf7fe640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0ac06be30 0x7fa0ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.973+0000 7fa0bf7fe640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0ac06be30 0x7fa0ac06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00017e0 tx=0x7fa0b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:40.978+0000 7fa0a7fff640 1 -- 172.21.15.79:0/2481209480 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa0b404c070 con 0x7fa0c0144ee0 2024-06-10T00:14:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.151+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fa0c006de80 con 0x7fa0c0144ee0 2024-06-10T00:14:41.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.843+0000 7fa0a7fff640 1 -- 172.21.15.79:0/2481209480 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fa0b4079580 con 0x7fa0c0144ee0 2024-06-10T00:14:41.843 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0ac06be30 msgr2=0x7fa0ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0ac06be30 0x7fa0ac06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00017e0 tx=0x7fa0b0009040 comp rx=0 tx=0).stop 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c0144ee0 msgr2=0x7fa0c013e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c0144ee0 0x7fa0c013e560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4034040 tx=0x7fa0b4001a40 comp rx=0 tx=0).stop 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 shutdown_connections 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0ac06be30 0x7fa0ac06e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00ae5f0 0x7fa0c00aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c0144ee0 0x7fa0c013e560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 --2- 172.21.15.79:0/2481209480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0a8004800 0x7fa0c009cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 >> 172.21.15.79:0/2481209480 conn(0x7fa0c006c6b0 msgr2=0x7fa0c00b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 shutdown_connections 2024-06-10T00:14:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.847+0000 7fa0c5c5d640 1 -- 172.21.15.79:0/2481209480 wait complete. 2024-06-10T00:14:41.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-10T00:14:41.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.974+0000 7f3e8cfc1640 1 Processor -- start 2024-06-10T00:14:41.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.974+0000 7f3e8cfc1640 1 -- start start 2024-06-10T00:14:41.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e8cfc1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3e88072560 0x7f3e8806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e8cfc1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e88155000 con 0x7f3e880b3bf0 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e8cfc1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8806dd30 con 0x7f3e88154c20 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e8cfc1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3e8806e010 con 0x7f3e88072560 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e86d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3e88072560 0x7f3e8806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e7dd9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3e880b3bf0 0x7f3e8806cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34572/0 (socket says 172.21.15.79:34572) 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e7dd9b640 1 -- 172.21.15.79:0/717862420 learned_addr learned my addr 172.21.15.79:0/717862420 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e86d9d640 1 -- 172.21.15.79:0/717862420 >> v1:172.21.15.117:6789/0 conn(0x7f3e88154c20 legacy=0x7f3e880b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e86d9d640 1 -- 172.21.15.79:0/717862420 >> v1:172.21.15.79:6789/0 conn(0x7f3e880b3bf0 legacy=0x7f3e8806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e86d9d640 1 -- 172.21.15.79:0/717862420 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8806e2f0 con 0x7f3e88072560 2024-06-10T00:14:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.975+0000 7f3e85d9b640 1 -- 172.21.15.79:0/717862420 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494374200 0 0) 0x7f3e88155000 con 0x7f3e880b3bf0 2024-06-10T00:14:41.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e86d9d640 1 --2- 172.21.15.79:0/717862420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e8806d6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009d90 tx=0x7f3e8002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d781bde5afb3949 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e85d9b640 1 -- 172.21.15.79:0/717862420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80007740 con 0x7f3e88072560 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e85d9b640 1 -- 172.21.15.79:0/717862420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e800078e0 con 0x7f3e88072560 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e85d9b640 1 -- 172.21.15.79:0/717862420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80007cb0 con 0x7f3e88072560 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/717862420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 msgr2=0x7f3e8806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e8cfc1640 1 --2- 172.21.15.79:0/717862420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e8806d6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009d90 tx=0x7f3e8002a6a0 comp rx=0 tx=0).stop 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/717862420 shutdown_connections 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e8cfc1640 1 --2- 172.21.15.79:0/717862420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e8806d6d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/717862420 >> 172.21.15.79:0/717862420 conn(0x7f3e880b1d10 msgr2=0x7f3e880b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/717862420 shutdown_connections 2024-06-10T00:14:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.976+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/717862420 wait complete. 2024-06-10T00:14:41.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.978+0000 7f3e8cfc1640 1 Processor -- start 2024-06-10T00:14:41.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.978+0000 7f3e8cfc1640 1 -- start start 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.978+0000 7f3e8cfc1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e88168340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.978+0000 7f3e8cfc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e880b3bf0 0x7f3e881428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.978+0000 7f3e8cfc1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e88154c20 0x7f3e880b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.978+0000 7f3e8cfc1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e880d01a0 con 0x7f3e88072560 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.978+0000 7f3e8cfc1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3e880d0020 con 0x7f3e88154c20 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.978+0000 7f3e8cfc1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3e880d0320 con 0x7f3e880b3bf0 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e88168340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e88168340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40456/0 (socket says 172.21.15.79:40456) 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 -- 172.21.15.79:0/3006908638 learned_addr learned my addr 172.21.15.79:0/3006908638 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e86d9d640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e88154c20 0x7f3e880b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e7dd9b640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e880b3bf0 0x7f3e881428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 -- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e880b3bf0 msgr2=0x7f3e881428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e880b3bf0 0x7f3e881428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 -- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e88154c20 msgr2=0x7f3e880b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e88154c20 0x7f3e880b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 -- 172.21.15.79:0/3006908638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e88168880 con 0x7f3e88072560 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e86d9d640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e88154c20 0x7f3e880b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e7dd9b640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e880b3bf0 0x7f3e881428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8659c640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e88168340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800b3f0 tx=0x7f3e7800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e7f7fe640 1 -- 172.21.15.79:0/3006908638 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78015020 con 0x7f3e88072560 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e7f7fe640 1 -- 172.21.15.79:0/3006908638 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e78011830 con 0x7f3e88072560 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e7f7fe640 1 -- 172.21.15.79:0/3006908638 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78011c20 con 0x7f3e88072560 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e88143120 con 0x7f3e88072560 2024-06-10T00:14:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.979+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e88152ef0 con 0x7f3e88072560 2024-06-10T00:14:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.980+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e880683c0 con 0x7f3e88072560 2024-06-10T00:14:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.981+0000 7f3e7f7fe640 1 -- 172.21.15.79:0/3006908638 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e78018020 con 0x7f3e88072560 2024-06-10T00:14:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.981+0000 7f3e7f7fe640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3e6806be30 0x7f3e6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.981+0000 7f3e7dd9b640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3e6806be30 0x7f3e6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.981+0000 7f3e7f7fe640 1 -- 172.21.15.79:0/3006908638 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f3e7808aaa0 con 0x7f3e88072560 2024-06-10T00:14:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.982+0000 7f3e7dd9b640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3e6806be30 0x7f3e6806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e880cf0e0 tx=0x7f3e70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:41.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:41.986+0000 7f3e7f7fe640 1 -- 172.21.15.79:0/3006908638 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3e7801f030 con 0x7f3e88072560 2024-06-10T00:14:42.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.194+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3e88153210 con 0x7f3e88072560 2024-06-10T00:14:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.845+0000 7f3e7f7fe640 1 -- 172.21.15.79:0/3006908638 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f3e88153210 con 0x7f3e88072560 2024-06-10T00:14:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 2 and data pool 3 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3e6806be30 msgr2=0x7f3e6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3e6806be30 0x7f3e6806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e880cf0e0 tx=0x7f3e70009040 comp rx=0 tx=0).stop 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 msgr2=0x7f3e88168340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e88168340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800b3f0 tx=0x7f3e7800b8b0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 shutdown_connections 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3e6806be30 0x7f3e6806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e88154c20 0x7f3e880b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e880b3bf0 0x7f3e881428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 --2- 172.21.15.79:0/3006908638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e88072560 0x7f3e88168340 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 >> 172.21.15.79:0/3006908638 conn(0x7f3e880b1d10 msgr2=0x7f3e8815e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 shutdown_connections 2024-06-10T00:14:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.848+0000 7f3e8cfc1640 1 -- 172.21.15.79:0/3006908638 wait complete. 2024-06-10T00:14:42.878 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-10T00:14:42.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-10T00:14:42.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.984+0000 7f1cd049e640 1 Processor -- start 2024-06-10T00:14:42.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.985+0000 7f1cd049e640 1 -- start start 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.985+0000 7f1cd049e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1cc80d0e00 0x7f1cc80d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.985+0000 7f1cd049e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1cc80d1f30 0x7f1cc80cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.985+0000 7f1cd049e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc80d23c0 con 0x7f1cc815e670 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.985+0000 7f1cd049e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc815fa50 con 0x7f1cc80d1f30 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.985+0000 7f1cd049e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc815ea50 con 0x7f1cc80d0e00 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1ccea3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1cc80d1f30 0x7f1cc80cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1cce23a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1cc815e670 0x7f1cc80d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34580/0 (socket says 172.21.15.79:34580) 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1cce23a640 1 -- 172.21.15.79:0/3402977339 learned_addr learned my addr 172.21.15.79:0/3402977339 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1ccda39640 1 --2- 172.21.15.79:0/3402977339 >> v2:172.21.15.117:3300/0 conn(0x7f1cc80d0e00 0x7f1cc80d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1ccea3b640 1 -- 172.21.15.79:0/3402977339 >> v2:172.21.15.117:3300/0 conn(0x7f1cc80d0e00 msgr2=0x7f1cc80d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1ccea3b640 1 --2- 172.21.15.79:0/3402977339 >> v2:172.21.15.117:3300/0 conn(0x7f1cc80d0e00 0x7f1cc80d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1ccea3b640 1 -- 172.21.15.79:0/3402977339 >> v1:172.21.15.79:6789/0 conn(0x7f1cc815e670 legacy=0x7f1cc80d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:42.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1ccea3b640 1 -- 172.21.15.79:0/3402977339 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc815ec90 con 0x7f1cc80d1f30 2024-06-10T00:14:42.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1ccd238640 1 -- 172.21.15.79:0/3402977339 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490856758 0 0) 0x7f1cc80d23c0 con 0x7f1cc815e670 2024-06-10T00:14:42.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.986+0000 7f1ccda39640 1 --2- 172.21.15.79:0/3402977339 >> v2:172.21.15.117:3300/0 conn(0x7f1cc80d0e00 0x7f1cc80d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1ccea3b640 1 --2- 172.21.15.79:0/3402977339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc80d1f30 0x7f1cc80cebd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1cc808e630 tx=0x7f1cc002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73bdc5c19138fbc server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1ccd238640 1 -- 172.21.15.79:0/3402977339 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0007740 con 0x7f1cc80d1f30 2024-06-10T00:14:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1ccd238640 1 -- 172.21.15.79:0/3402977339 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc00078e0 con 0x7f1cc80d1f30 2024-06-10T00:14:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1ccd238640 1 -- 172.21.15.79:0/3402977339 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0007cb0 con 0x7f1cc80d1f30 2024-06-10T00:14:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1cd049e640 1 -- 172.21.15.79:0/3402977339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc80d1f30 msgr2=0x7f1cc80cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1cd049e640 1 --2- 172.21.15.79:0/3402977339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc80d1f30 0x7f1cc80cebd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1cc808e630 tx=0x7f1cc002a710 comp rx=0 tx=0).stop 2024-06-10T00:14:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1cd049e640 1 -- 172.21.15.79:0/3402977339 shutdown_connections 2024-06-10T00:14:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1cd049e640 1 --2- 172.21.15.79:0/3402977339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc80d1f30 0x7f1cc80cebd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1cd049e640 1 --2- 172.21.15.79:0/3402977339 >> v2:172.21.15.117:3300/0 conn(0x7f1cc80d0e00 0x7f1cc80d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1cd049e640 1 -- 172.21.15.79:0/3402977339 >> 172.21.15.79:0/3402977339 conn(0x7f1cc809d400 msgr2=0x7f1cc80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1cd049e640 1 -- 172.21.15.79:0/3402977339 shutdown_connections 2024-06-10T00:14:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.987+0000 7f1cd049e640 1 -- 172.21.15.79:0/3402977339 wait complete. 2024-06-10T00:14:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.988+0000 7f1cd049e640 1 Processor -- start 2024-06-10T00:14:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1cd049e640 1 -- start start 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1cd049e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc80d0e00 0x7f1cc815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1cd049e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc80d1f30 0x7f1cc80c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1cd049e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc815e670 0x7f1cc80cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1cd049e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc815f530 con 0x7f1cc815e670 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1cd049e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc815f250 con 0x7f1cc80d1f30 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1cd049e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc80cf110 con 0x7f1cc80d0e00 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1ccea3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc815e670 0x7f1cc80cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1ccea3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc815e670 0x7f1cc80cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40470/0 (socket says 172.21.15.79:40470) 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1ccea3b640 1 -- 172.21.15.79:0/1219355508 learned_addr learned my addr 172.21.15.79:0/1219355508 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1ccda39640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc80d1f30 0x7f1cc80c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:42.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.989+0000 7f1cce23a640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc80d0e00 0x7f1cc815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1ccea3b640 1 -- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc80d0e00 msgr2=0x7f1cc815d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1ccea3b640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc80d0e00 0x7f1cc815d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1ccea3b640 1 -- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc80d1f30 msgr2=0x7f1cc80c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1ccea3b640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc80d1f30 0x7f1cc80c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1ccea3b640 1 -- 172.21.15.79:0/1219355508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc8162640 con 0x7f1cc815e670 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1cce23a640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc80d0e00 0x7f1cc815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1ccea3b640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc815e670 0x7f1cc80cc110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009e50 tx=0x7f1cc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1cbeffd640 1 -- 172.21.15.79:0/1219355508 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0040070 con 0x7f1cc815e670 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1cbeffd640 1 -- 172.21.15.79:0/1219355508 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc0031cc0 con 0x7f1cc815e670 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1cbeffd640 1 -- 172.21.15.79:0/1219355508 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0045680 con 0x7f1cc815e670 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc815fe20 con 0x7f1cc815e670 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.990+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc81603e0 con 0x7f1cc815e670 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.991+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc8068540 con 0x7f1cc815e670 2024-06-10T00:14:42.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.991+0000 7f1cbeffd640 1 -- 172.21.15.79:0/1219355508 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cc0039040 con 0x7f1cc815e670 2024-06-10T00:14:42.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.992+0000 7f1cbeffd640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1cac06be30 0x7f1cac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:42.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.992+0000 7f1cbeffd640 1 -- 172.21.15.79:0/1219355508 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f1cc00ac810 con 0x7f1cc815e670 2024-06-10T00:14:42.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.992+0000 7f1cce23a640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1cac06be30 0x7f1cac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:42.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.992+0000 7f1cce23a640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1cac06be30 0x7f1cac06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4000f60 tx=0x7f1cc4007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:42.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:42.996+0000 7f1cbeffd640 1 -- 172.21.15.79:0/1219355508 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1cc8162640 con 0x7f1cc815e670 2024-06-10T00:14:42.999 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:14:43.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:14:43.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.183+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f1cc80c7ea0 con 0x7f1cc815e670 2024-06-10T00:14:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.862+0000 7f1cbeffd640 1 -- 172.21.15.79:0/1219355508 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f1cc007b280 con 0x7f1cc815e670 2024-06-10T00:14:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1cac06be30 msgr2=0x7f1cac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1cac06be30 0x7f1cac06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4000f60 tx=0x7f1cc4007ca0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc815e670 msgr2=0x7f1cc80cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc815e670 0x7f1cc80cc110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009e50 tx=0x7f1cc0004a40 comp rx=0 tx=0).stop 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 shutdown_connections 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1cac06be30 0x7f1cac06e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc815e670 0x7f1cc80cc110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc80d1f30 0x7f1cc80c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 --2- 172.21.15.79:0/1219355508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc80d0e00 0x7f1cc815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 >> 172.21.15.79:0/1219355508 conn(0x7f1cc809d400 msgr2=0x7f1cc806c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 shutdown_connections 2024-06-10T00:14:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.865+0000 7f1cd049e640 1 -- 172.21.15.79:0/1219355508 wait complete. 2024-06-10T00:14:43.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-10T00:14:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.989+0000 7feeb21ed640 1 Processor -- start 2024-06-10T00:14:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.989+0000 7feeb21ed640 1 -- start start 2024-06-10T00:14:43.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeb21ed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feeac15af80 0x7feeac15e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeb21ed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac0ad690 0x7feeac0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeb21ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeac15f8e0 con 0x7feeac15aba0 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeb21ed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7feeac071f30 con 0x7feeac15af80 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeb21ed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feeac15f040 con 0x7feeac0ad690 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeaaffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feeac15af80 0x7feeac15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeab7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feeac15aba0 0x7feeac0b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34588/0 (socket says 172.21.15.79:34588) 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeab7fe640 1 -- 172.21.15.79:0/1476240439 learned_addr learned my addr 172.21.15.79:0/1476240439 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeaaffd640 1 -- 172.21.15.79:0/1476240439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac0ad690 msgr2=0x7feeac0cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeaaffd640 1 --2- 172.21.15.79:0/1476240439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac0ad690 0x7feeac0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeaaffd640 1 -- 172.21.15.79:0/1476240439 >> v1:172.21.15.79:6789/0 conn(0x7feeac15aba0 legacy=0x7feeac0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeaaffd640 1 -- 172.21.15.79:0/1476240439 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac15f320 con 0x7feeac15af80 2024-06-10T00:14:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.990+0000 7feeaa7fc640 1 -- 172.21.15.79:0/1476240439 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3447296085 0 0) 0x7feeac15f8e0 con 0x7feeac15aba0 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeaaffd640 1 --2- 172.21.15.79:0/1476240439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac15af80 0x7feeac15e960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feea00097a0 tx=0x7feea002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23506c995cd256bf server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeaa7fc640 1 -- 172.21.15.79:0/1476240439 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0037070 con 0x7feeac15af80 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeaa7fc640 1 -- 172.21.15.79:0/1476240439 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea0032440 con 0x7feeac15af80 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeaa7fc640 1 -- 172.21.15.79:0/1476240439 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0032810 con 0x7feeac15af80 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeb21ed640 1 -- 172.21.15.79:0/1476240439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac15af80 msgr2=0x7feeac15e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeb21ed640 1 --2- 172.21.15.79:0/1476240439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac15af80 0x7feeac15e960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feea00097a0 tx=0x7feea002a180 comp rx=0 tx=0).stop 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeb21ed640 1 -- 172.21.15.79:0/1476240439 shutdown_connections 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeb21ed640 1 --2- 172.21.15.79:0/1476240439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac0ad690 0x7feeac0cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeb21ed640 1 --2- 172.21.15.79:0/1476240439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac15af80 0x7feeac15e960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeb21ed640 1 -- 172.21.15.79:0/1476240439 >> 172.21.15.79:0/1476240439 conn(0x7feeac06b7e0 msgr2=0x7feeac06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeb21ed640 1 -- 172.21.15.79:0/1476240439 shutdown_connections 2024-06-10T00:14:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.991+0000 7feeb21ed640 1 -- 172.21.15.79:0/1476240439 wait complete. 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.992+0000 7feeb21ed640 1 Processor -- start 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.993+0000 7feeb21ed640 1 -- start start 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.993+0000 7feeb21ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac0ad690 0x7feeac0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.993+0000 7feeb21ed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac15aba0 0x7feeac14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.993+0000 7feeb21ed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeac15af80 0x7feeac164920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.993+0000 7feeb21ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feeac0d06a0 con 0x7feeac0ad690 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.993+0000 7feeb21ed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feeac0d0520 con 0x7feeac15af80 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.993+0000 7feeb21ed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feeac0d0820 con 0x7feeac15aba0 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.993+0000 7feeab7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac0ad690 0x7feeac0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeab7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac0ad690 0x7feeac0cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40502/0 (socket says 172.21.15.79:40502) 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeab7fe640 1 -- 172.21.15.79:0/2130044092 learned_addr learned my addr 172.21.15.79:0/2130044092 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeabfff640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeac15af80 0x7feeac164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeab7fe640 1 -- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac15aba0 msgr2=0x7feeac14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeaaffd640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac15aba0 0x7feeac14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeab7fe640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac15aba0 0x7feeac14f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeab7fe640 1 -- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeac15af80 msgr2=0x7feeac164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeab7fe640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeac15af80 0x7feeac164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeab7fe640 1 -- 172.21.15.79:0/2130044092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac09c100 con 0x7feeac0ad690 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeabfff640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeac15af80 0x7feeac164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeab7fe640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac0ad690 0x7feeac0cebc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c4d0 tx=0x7fee9c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7fee93fff640 1 -- 172.21.15.79:0/2130044092 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c018070 con 0x7feeac0ad690 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7fee93fff640 1 -- 172.21.15.79:0/2130044092 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9c007500 con 0x7feeac0ad690 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac0cf2d0 con 0x7feeac0ad690 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7fee93fff640 1 -- 172.21.15.79:0/2130044092 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c004a20 con 0x7feeac0ad690 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.994+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac0cc770 con 0x7feeac0ad690 2024-06-10T00:14:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.995+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeac0683c0 con 0x7feeac0ad690 2024-06-10T00:14:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.996+0000 7fee93fff640 1 -- 172.21.15.79:0/2130044092 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee9c01b070 con 0x7feeac0ad690 2024-06-10T00:14:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.996+0000 7fee93fff640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fee9806be30 0x7fee9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.996+0000 7fee93fff640 1 -- 172.21.15.79:0/2130044092 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fee9c08a2c0 con 0x7feeac0ad690 2024-06-10T00:14:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.996+0000 7feeaaffd640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fee9806be30 0x7fee9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:43.996+0000 7feeaaffd640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fee9806be30 0x7fee9806e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feea0034000 tx=0x7feea002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:44.000+0000 7fee93fff640 1 -- 172.21.15.79:0/2130044092 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fee9c058b40 con 0x7feeac0ad690 2024-06-10T00:14:44.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:44.175+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7feeac14fa70 con 0x7feeac0ad690 2024-06-10T00:14:45.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.865+0000 7fee93fff640 1 -- 172.21.15.79:0/2130044092 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fee9c058440 con 0x7feeac0ad690 2024-06-10T00:14:45.866 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data_ec' created 2024-06-10T00:14:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fee9806be30 msgr2=0x7fee9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fee9806be30 0x7fee9806e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feea0034000 tx=0x7feea002e000 comp rx=0 tx=0).stop 2024-06-10T00:14:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac0ad690 msgr2=0x7feeac0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac0ad690 0x7feeac0cebc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c4d0 tx=0x7fee9c00c990 comp rx=0 tx=0).stop 2024-06-10T00:14:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 shutdown_connections 2024-06-10T00:14:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fee9806be30 0x7fee9806e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:45.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeac15af80 0x7feeac164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeac15aba0 0x7feeac14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 --2- 172.21.15.79:0/2130044092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feeac0ad690 0x7feeac0cebc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.869+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 >> 172.21.15.79:0/2130044092 conn(0x7feeac06b7e0 msgr2=0x7feeac15d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.870+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 shutdown_connections 2024-06-10T00:14:45.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.870+0000 7feeb21ed640 1 -- 172.21.15.79:0/2130044092 wait complete. 2024-06-10T00:14:45.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-10T00:14:45.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.998+0000 7f9e1cd1d640 1 Processor -- start 2024-06-10T00:14:45.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.998+0000 7f9e1cd1d640 1 -- start start 2024-06-10T00:14:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e1cd1d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e180b4430 0x7f9e180d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e1cd1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e1809b690 con 0x7f9e1809aa10 2024-06-10T00:14:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e1cd1d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e180d1130 con 0x7f9e1815e380 2024-06-10T00:14:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e1cd1d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9e1815e760 con 0x7f9e180b4430 2024-06-10T00:14:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e16d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9e1809aa10 0x7f9e180cc470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34592/0 (socket says 172.21.15.79:34592) 2024-06-10T00:14:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e16d9d640 1 -- 172.21.15.79:0/4169452214 learned_addr learned my addr 172.21.15.79:0/4169452214 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279617717 0 0) 0x7f9e1809b690 con 0x7f9e1809aa10 2024-06-10T00:14:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e04003520 con 0x7f9e1809aa10 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e0dd9b640 1 --2- 172.21.15.79:0/4169452214 >> v2:172.21.15.117:3300/0 conn(0x7f9e180b4430 0x7f9e180d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 183746707 0 0) 0x7f9e04003520 con 0x7f9e1809aa10 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 >> v2:172.21.15.117:3300/0 conn(0x7f9e180b4430 msgr2=0x7f9e180d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 --2- 172.21.15.79:0/4169452214 >> v2:172.21.15.117:3300/0 conn(0x7f9e180b4430 0x7f9e180d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 >> v1:172.21.15.117:6789/0 conn(0x7f9e1815e380 legacy=0x7f9e1806ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1806f4f0 con 0x7f9e1809aa10 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f9e100019f0 con 0x7f9e1809aa10 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 >> v1:172.21.15.79:6789/0 conn(0x7f9e1809aa10 legacy=0x7f9e180cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e04004800 0x7f9e04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e040051c0 0x7f9e0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1815e760 con 0x7f9e040039b0 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0400c060 con 0x7f9e04004800 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0400c260 con 0x7f9e040051c0 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e1659c640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:45.999+0000 7f9e0dd9b640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e04004800 0x7f9e04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.000+0000 7f9e16d9d640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e040051c0 0x7f9e0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.000+0000 7f9e1659c640 1 -- 172.21.15.79:0/4169452214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e040051c0 msgr2=0x7f9e0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.000+0000 7f9e1659c640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e040051c0 0x7f9e0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.000+0000 7f9e1659c640 1 -- 172.21.15.79:0/4169452214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e04004800 msgr2=0x7f9e04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.000+0000 7f9e1659c640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e04004800 0x7f9e04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.000+0000 7f9e16d9d640 1 -- 172.21.15.79:0/4169452214 reap_dead start 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.000+0000 7f9e1659c640 1 -- 172.21.15.79:0/4169452214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e04003520 con 0x7f9e040039b0 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.000+0000 7f9e1659c640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e04003dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e08001750 tx=0x7f9e04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ae34ffd37cc884 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08001370 con 0x7f9e040039b0 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e080052d0 con 0x7f9e040039b0 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e15d9b640 1 -- 172.21.15.79:0/4169452214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0802abe0 con 0x7f9e040039b0 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/4169452214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 msgr2=0x7f9e04003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e1cd1d640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e04003dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e08001750 tx=0x7f9e04005830 comp rx=0 tx=0).stop 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/4169452214 shutdown_connections 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e1cd1d640 1 --2- 172.21.15.79:0/4169452214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e04003dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/4169452214 >> 172.21.15.79:0/4169452214 conn(0x7f9e180b3910 msgr2=0x7f9e180b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/4169452214 shutdown_connections 2024-06-10T00:14:46.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.001+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/4169452214 wait complete. 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1cd1d640 1 Processor -- start 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1cd1d640 1 -- start start 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1cd1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e180c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1cd1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e180b5f80 0x7f9e180b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1cd1d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e180b7200 0x7f9e181f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1cd1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e180d0ac0 con 0x7f9e040039b0 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1cd1d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1806fb40 con 0x7f9e180b5f80 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1cd1d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e180d0c40 con 0x7f9e180b7200 2024-06-10T00:14:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e180c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e180c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40508/0 (socket says 172.21.15.79:40508) 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.003+0000 7f9e1659c640 1 -- 172.21.15.79:0/3100458817 learned_addr learned my addr 172.21.15.79:0/3100458817 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e0dd9b640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e180b5f80 0x7f9e180b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e16d9d640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e180b7200 0x7f9e181f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e1659c640 1 -- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e180b7200 msgr2=0x7f9e181f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e1659c640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e180b7200 0x7f9e181f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e1659c640 1 -- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e180b5f80 msgr2=0x7f9e180b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e1659c640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e180b5f80 0x7f9e180b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e1659c640 1 -- 172.21.15.79:0/3100458817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e181563a0 con 0x7f9e040039b0 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e16d9d640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e180b7200 0x7f9e181f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e1659c640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e180c8310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e0802a590 tx=0x7f9e08001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e0f7fe640 1 -- 172.21.15.79:0/3100458817 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08037040 con 0x7f9e040039b0 2024-06-10T00:14:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e0f7fe640 1 -- 172.21.15.79:0/3100458817 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e08040070 con 0x7f9e040039b0 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e181550e0 con 0x7f9e040039b0 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e0f7fe640 1 -- 172.21.15.79:0/3100458817 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08001370 con 0x7f9e040039b0 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.004+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e180b6a00 con 0x7f9e040039b0 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.005+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e18068540 con 0x7f9e040039b0 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.006+0000 7f9e0f7fe640 1 -- 172.21.15.79:0/3100458817 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e080052d0 con 0x7f9e040039b0 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.006+0000 7f9e0f7fe640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9df806be30 0x7f9df806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.006+0000 7f9e0dd9b640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9df806be30 0x7f9df806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.006+0000 7f9e0f7fe640 1 -- 172.21.15.79:0/3100458817 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f9e080aacb0 con 0x7f9e040039b0 2024-06-10T00:14:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.006+0000 7f9e0dd9b640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9df806be30 0x7f9df806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e181616e0 tx=0x7f9e00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:46.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.011+0000 7f9e0f7fe640 1 -- 172.21.15.79:0/3100458817 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9e080793d0 con 0x7f9e040039b0 2024-06-10T00:14:46.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.186+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f9e180b75e0 con 0x7f9e040039b0 2024-06-10T00:14:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.867+0000 7f9e0f7fe640 1 -- 172.21.15.79:0/3100458817 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f9e08078cd0 con 0x7f9e040039b0 2024-06-10T00:14:46.867 INFO:teuthology.orchestra.run.smithi079.stderr:set pool 4 allow_ec_overwrites to true 2024-06-10T00:14:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.872+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9df806be30 msgr2=0x7f9df806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.872+0000 7f9e1cd1d640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9df806be30 0x7f9df806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e181616e0 tx=0x7f9e00008040 comp rx=0 tx=0).stop 2024-06-10T00:14:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.872+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 msgr2=0x7f9e180c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:46.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.872+0000 7f9e1cd1d640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e180c8310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e0802a590 tx=0x7f9e08001120 comp rx=0 tx=0).stop 2024-06-10T00:14:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.873+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 shutdown_connections 2024-06-10T00:14:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.873+0000 7f9e1cd1d640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9df806be30 0x7f9df806e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.873+0000 7f9e1cd1d640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e180b7200 0x7f9e181f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.873+0000 7f9e1cd1d640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e180b5f80 0x7f9e180b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.873+0000 7f9e1cd1d640 1 --2- 172.21.15.79:0/3100458817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e040039b0 0x7f9e180c8310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:46.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.873+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 >> 172.21.15.79:0/3100458817 conn(0x7f9e180b3910 msgr2=0x7f9e1806fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:46.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.875+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 shutdown_connections 2024-06-10T00:14:46.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:46.877+0000 7f9e1cd1d640 1 -- 172.21.15.79:0/3100458817 wait complete. 2024-06-10T00:14:46.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-10T00:14:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.010+0000 7fdd4585d640 1 Processor -- start 2024-06-10T00:14:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.010+0000 7fdd4585d640 1 -- start start 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.010+0000 7fdd4585d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd400d0cb0 0x7fdd400cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.010+0000 7fdd4585d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd400cd0d0 0x7fdd400cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.010+0000 7fdd4585d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4015e840 con 0x7fdd4015e460 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.010+0000 7fdd4585d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdd400d1570 con 0x7fdd400d0cb0 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.010+0000 7fdd4585d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdd400d1290 con 0x7fdd400cd0d0 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd37fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd400d0cb0 0x7fdd400cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd3effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdd4015e460 0x7fdd400ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34598/0 (socket says 172.21.15.79:34598) 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd3effd640 1 -- 172.21.15.79:0/180901242 learned_addr learned my addr 172.21.15.79:0/180901242 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd37fff640 1 -- 172.21.15.79:0/180901242 >> v2:172.21.15.117:3300/0 conn(0x7fdd400cd0d0 msgr2=0x7fdd400cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd3f7fe640 1 --2- 172.21.15.79:0/180901242 >> v2:172.21.15.117:3300/0 conn(0x7fdd400cd0d0 0x7fdd400cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd37fff640 1 --2- 172.21.15.79:0/180901242 >> v2:172.21.15.117:3300/0 conn(0x7fdd400cd0d0 0x7fdd400cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd37fff640 1 -- 172.21.15.79:0/180901242 >> v1:172.21.15.79:6789/0 conn(0x7fdd4015e460 legacy=0x7fdd400ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd3e7fc640 1 -- 172.21.15.79:0/180901242 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174676679 0 0) 0x7fdd4015e840 con 0x7fdd4015e460 2024-06-10T00:14:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.011+0000 7fdd37fff640 1 -- 172.21.15.79:0/180901242 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd400cc5f0 con 0x7fdd400d0cb0 2024-06-10T00:14:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.012+0000 7fdd37fff640 1 --2- 172.21.15.79:0/180901242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd400cee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd400cc3c0 tx=0x7fdd2802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398f646103d16561 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.012+0000 7fdd3e7fc640 1 -- 172.21.15.79:0/180901242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28037070 con 0x7fdd400d0cb0 2024-06-10T00:14:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.012+0000 7fdd3e7fc640 1 -- 172.21.15.79:0/180901242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd28032440 con 0x7fdd400d0cb0 2024-06-10T00:14:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.012+0000 7fdd3e7fc640 1 -- 172.21.15.79:0/180901242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2802ae60 con 0x7fdd400d0cb0 2024-06-10T00:14:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.012+0000 7fdd4585d640 1 -- 172.21.15.79:0/180901242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 msgr2=0x7fdd400cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.012+0000 7fdd4585d640 1 --2- 172.21.15.79:0/180901242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd400cee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd400cc3c0 tx=0x7fdd2802a110 comp rx=0 tx=0).stop 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.013+0000 7fdd4585d640 1 -- 172.21.15.79:0/180901242 shutdown_connections 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.013+0000 7fdd4585d640 1 --2- 172.21.15.79:0/180901242 >> v2:172.21.15.117:3300/0 conn(0x7fdd400cd0d0 0x7fdd400cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.013+0000 7fdd4585d640 1 --2- 172.21.15.79:0/180901242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd400cee00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.013+0000 7fdd4585d640 1 -- 172.21.15.79:0/180901242 >> 172.21.15.79:0/180901242 conn(0x7fdd400d1e70 msgr2=0x7fdd400d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.013+0000 7fdd4585d640 1 -- 172.21.15.79:0/180901242 shutdown_connections 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.013+0000 7fdd4585d640 1 -- 172.21.15.79:0/180901242 wait complete. 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd4585d640 1 Processor -- start 2024-06-10T00:14:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd4585d640 1 -- start start 2024-06-10T00:14:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd4585d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd400cd0d0 0x7fdd400c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd4585d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd4014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd4585d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd4015e460 0x7fdd4014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd4585d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400706e0 con 0x7fdd400d0cb0 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd4585d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400ccbb0 con 0x7fdd4015e460 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd4585d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd400cf340 con 0x7fdd400cd0d0 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.014+0000 7fdd37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd4014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd4014e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40522/0 (socket says 172.21.15.79:40522) 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd37fff640 1 -- 172.21.15.79:0/1006880065 learned_addr learned my addr 172.21.15.79:0/1006880065 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd3f7fe640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd4015e460 0x7fdd4014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd3effd640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd400cd0d0 0x7fdd400c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd37fff640 1 -- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd400cd0d0 msgr2=0x7fdd400c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd37fff640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd400cd0d0 0x7fdd400c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd37fff640 1 -- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd4015e460 msgr2=0x7fdd4014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd37fff640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd4015e460 0x7fdd4014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd37fff640 1 -- 172.21.15.79:0/1006880065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd400c60a0 con 0x7fdd400d0cb0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd3effd640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd400cd0d0 0x7fdd400c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd37fff640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd4014e150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000c00 tx=0x7fdd280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd3cff9640 1 -- 172.21.15.79:0/1006880065 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28037050 con 0x7fdd400d0cb0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd3cff9640 1 -- 172.21.15.79:0/1006880065 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd28038040 con 0x7fdd400d0cb0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd400c6380 con 0x7fdd400d0cb0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd3cff9640 1 -- 172.21.15.79:0/1006880065 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28004450 con 0x7fdd400d0cb0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.015+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd400c6940 con 0x7fdd400d0cb0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.016+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd400683c0 con 0x7fdd400d0cb0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.017+0000 7fdd3cff9640 1 -- 172.21.15.79:0/1006880065 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd28030980 con 0x7fdd400d0cb0 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.017+0000 7fdd3cff9640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd2006be30 0x7fdd2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:47.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.017+0000 7fdd3cff9640 1 -- 172.21.15.79:0/1006880065 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fdd280abe20 con 0x7fdd400d0cb0 2024-06-10T00:14:47.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.017+0000 7fdd3effd640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd2006be30 0x7fdd2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:47.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.017+0000 7fdd3effd640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd2006be30 0x7fdd2006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd30000f60 tx=0x7fdd30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:47.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.021+0000 7fdd3cff9640 1 -- 172.21.15.79:0/1006880065 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdd2807a660 con 0x7fdd400d0cb0 2024-06-10T00:14:47.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.238+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fdd40070a90 con 0x7fdd400d0cb0 2024-06-10T00:14:47.694 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-06-10T00:14:47.694+0000 7f18a9043640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:14:47.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.899+0000 7fdd3cff9640 1 -- 172.21.15.79:0/1006880065 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fdd28079f60 con 0x7fdd400d0cb0 2024-06-10T00:14:47.899 INFO:teuthology.orchestra.run.smithi079.stderr:added data pool 4 to fsmap 2024-06-10T00:14:47.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd2006be30 msgr2=0x7fdd2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:47.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd2006be30 0x7fdd2006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd30000f60 tx=0x7fdd30009040 comp rx=0 tx=0).stop 2024-06-10T00:14:47.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 msgr2=0x7fdd4014e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:47.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd4014e150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000c00 tx=0x7fdd280046c0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 shutdown_connections 2024-06-10T00:14:47.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd2006be30 0x7fdd2006e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd4015e460 0x7fdd4014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd400d0cb0 0x7fdd4014e150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 --2- 172.21.15.79:0/1006880065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd400cd0d0 0x7fdd400c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:47.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 >> 172.21.15.79:0/1006880065 conn(0x7fdd400d1e70 msgr2=0x7fdd400d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:47.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 shutdown_connections 2024-06-10T00:14:47.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:47.901+0000 7fdd4585d640 1 -- 172.21.15.79:0/1006880065 wait complete. 2024-06-10T00:14:47.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:14:48.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.013+0000 7fd9ccfdc640 1 Processor -- start 2024-06-10T00:14:48.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.013+0000 7fd9ccfdc640 1 -- start start 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.014+0000 7fd9ccfdc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9c80d2680 0x7fd9c815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.014+0000 7fd9ccfdc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd9c80cef70 0x7fd9c80cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.014+0000 7fd9ccfdc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c80d0ad0 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.014+0000 7fd9ccfdc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c80d13e0 con 0x7fd9c80d2680 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.014+0000 7fd9ccfdc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c815f890 con 0x7fd9c80cef70 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.015+0000 7fd9c659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9c80d2680 0x7fd9c815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.015+0000 7fd9c659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9c80d2680 0x7fd9c815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60728/0 (socket says 172.21.15.79:60728) 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.015+0000 7fd9c659c640 1 -- 172.21.15.79:0/3617146216 learned_addr learned my addr 172.21.15.79:0/3617146216 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.015+0000 7fd9c6d9d640 1 --2- 172.21.15.79:0/3617146216 >> v2:172.21.15.117:3300/0 conn(0x7fd9c80cef70 0x7fd9c80cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.015+0000 7fd9c659c640 1 -- 172.21.15.79:0/3617146216 >> v2:172.21.15.117:3300/0 conn(0x7fd9c80cef70 msgr2=0x7fd9c80cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:48.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.015+0000 7fd9c659c640 1 --2- 172.21.15.79:0/3617146216 >> v2:172.21.15.117:3300/0 conn(0x7fd9c80cef70 0x7fd9c80cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.015+0000 7fd9c659c640 1 -- 172.21.15.79:0/3617146216 >> v1:172.21.15.117:6789/0 conn(0x7fd9c80d1fc0 legacy=0x7fd9c80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.015+0000 7fd9c659c640 1 -- 172.21.15.79:0/3617146216 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c80d0d90 con 0x7fd9c80d2680 2024-06-10T00:14:48.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.016+0000 7fd9c659c640 1 --2- 172.21.15.79:0/3617146216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d2680 0x7fd9c815f1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80d1560 tx=0x7fd9b802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645672f03dcfb88a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.016+0000 7fd9c559a640 1 -- 172.21.15.79:0/3617146216 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8036070 con 0x7fd9c80d2680 2024-06-10T00:14:48.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.016+0000 7fd9c559a640 1 -- 172.21.15.79:0/3617146216 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b8031600 con 0x7fd9c80d2680 2024-06-10T00:14:48.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.016+0000 7fd9c559a640 1 -- 172.21.15.79:0/3617146216 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80319d0 con 0x7fd9c80d2680 2024-06-10T00:14:48.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.017+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3617146216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d2680 msgr2=0x7fd9c815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.017+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3617146216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d2680 0x7fd9c815f1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80d1560 tx=0x7fd9b802a730 comp rx=0 tx=0).stop 2024-06-10T00:14:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.017+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3617146216 shutdown_connections 2024-06-10T00:14:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.017+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3617146216 >> v2:172.21.15.117:3300/0 conn(0x7fd9c80cef70 0x7fd9c80cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.017+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3617146216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d2680 0x7fd9c815f1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.017+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3617146216 >> 172.21.15.79:0/3617146216 conn(0x7fd9c809d3f0 msgr2=0x7fd9c80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.017+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3617146216 shutdown_connections 2024-06-10T00:14:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.017+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3617146216 wait complete. 2024-06-10T00:14:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9ccfdc640 1 Processor -- start 2024-06-10T00:14:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9ccfdc640 1 -- start start 2024-06-10T00:14:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9ccfdc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9c80cef70 0x7fd9c80cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9ccfdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d1fc0 0x7fd9c80cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9ccfdc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c80d2680 0x7fd9c80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9ccfdc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c80d4f00 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9ccfdc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c80d2400 con 0x7fd9c80d2680 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9ccfdc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c80d1870 con 0x7fd9c80cef70 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.019+0000 7fd9c5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d1fc0 0x7fd9c80cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d1fc0 0x7fd9c80cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60740/0 (socket says 172.21.15.79:60740) 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c5d9b640 1 -- 172.21.15.79:0/3555302439 learned_addr learned my addr 172.21.15.79:0/3555302439 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c6d9d640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c80d2680 0x7fd9c80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c659c640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9c80cef70 0x7fd9c80cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c5d9b640 1 -- 172.21.15.79:0/3555302439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9c80cef70 msgr2=0x7fd9c80cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c5d9b640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9c80cef70 0x7fd9c80cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c5d9b640 1 -- 172.21.15.79:0/3555302439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c80d2680 msgr2=0x7fd9c80cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c5d9b640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c80d2680 0x7fd9c80cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c5d9b640 1 -- 172.21.15.79:0/3555302439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c80cc3c0 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9c5d9b640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d1fc0 0x7fd9c80cf3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000c430 tx=0x7fd9b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9beffd640 1 -- 172.21.15.79:0/3555302439 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00052d0 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9beffd640 1 -- 172.21.15.79:0/3555302439 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b0005490 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c80cc6a0 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9beffd640 1 -- 172.21.15.79:0/3555302439 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0007260 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.020+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c81f5f60 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.021+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c8068430 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.022+0000 7fd9beffd640 1 -- 172.21.15.79:0/3555302439 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9b0007400 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.022+0000 7fd9beffd640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd9a806be60 0x7fd9a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.022+0000 7fd9c659c640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd9a806be60 0x7fd9a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.022+0000 7fd9beffd640 1 -- 172.21.15.79:0/3555302439 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd9b008a670 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.023+0000 7fd9c659c640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd9a806be60 0x7fd9a806e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8033000 tx=0x7fd9b8009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.026+0000 7fd9beffd640 1 -- 172.21.15.79:0/3555302439 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd9b00586a0 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.239+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9c80d04e0 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.239+0000 7fd9beffd640 1 -- 172.21.15.79:0/3555302439 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5177 (secure 0 0 0) 0x7fd9b005c9a0 con 0x7fd9c80d1fc0 2024-06-10T00:14:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:48.239 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:14:47.239603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:14:48.240 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-06-10T00:14:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.241+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd9a806be60 msgr2=0x7fd9a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.241+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd9a806be60 0x7fd9a806e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8033000 tx=0x7fd9b8009000 comp rx=0 tx=0).stop 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.241+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d1fc0 msgr2=0x7fd9c80cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.241+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d1fc0 0x7fd9c80cf3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000c430 tx=0x7fd9b000c8f0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.242+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 shutdown_connections 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.242+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd9a806be60 0x7fd9a806e320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.242+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c80d2680 0x7fd9c80cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.242+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9c80d1fc0 0x7fd9c80cf3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.242+0000 7fd9ccfdc640 1 --2- 172.21.15.79:0/3555302439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9c80cef70 0x7fd9c80cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.242+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 >> 172.21.15.79:0/3555302439 conn(0x7fd9c809d3f0 msgr2=0x7fd9c815fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.242+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 shutdown_connections 2024-06-10T00:14:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.242+0000 7fd9ccfdc640 1 -- 172.21.15.79:0/3555302439 wait complete. 2024-06-10T00:14:48.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:48.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.352+0000 7f63aec31640 1 Processor -- start 2024-06-10T00:14:48.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.352+0000 7f63aec31640 1 -- start start 2024-06-10T00:14:48.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.352+0000 7f63aec31640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f63a815f1a0 0x7f63a80d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.352+0000 7f63aec31640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a815f5e0 con 0x7f63a80cef70 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.352+0000 7f63aec31640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a80d0ad0 con 0x7f63a80d2680 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.352+0000 7f63aec31640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f63a80d13e0 con 0x7f63a815f1a0 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.353+0000 7f63a7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f63a815f1a0 0x7f63a80d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.353+0000 7f63ad1ce640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f63a80cef70 0x7f63a80cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56802/0 (socket says 172.21.15.79:56802) 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.353+0000 7f63ad1ce640 1 -- 172.21.15.79:0/884420026 learned_addr learned my addr 172.21.15.79:0/884420026 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.353+0000 7f63a7fff640 1 -- 172.21.15.79:0/884420026 >> v1:172.21.15.117:6789/0 conn(0x7f63a80d2680 legacy=0x7f63a80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.353+0000 7f63a7fff640 1 -- 172.21.15.79:0/884420026 >> v1:172.21.15.79:6789/0 conn(0x7f63a80cef70 legacy=0x7f63a80cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.353+0000 7f63a7fff640 1 -- 172.21.15.79:0/884420026 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a815f890 con 0x7f63a815f1a0 2024-06-10T00:14:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.353+0000 7f63a77fe640 1 -- 172.21.15.79:0/884420026 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714679586 0 0) 0x7f63a815f5e0 con 0x7f63a80cef70 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.353+0000 7f63a7fff640 1 --2- 172.21.15.79:0/884420026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a80d1fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f63940097a0 tx=0x7f639402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af3209913f8114c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63a77fe640 1 -- 172.21.15.79:0/884420026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394037070 con 0x7f63a815f1a0 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63a77fe640 1 -- 172.21.15.79:0/884420026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6394032440 con 0x7f63a815f1a0 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63a77fe640 1 -- 172.21.15.79:0/884420026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394032810 con 0x7f63a815f1a0 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63aec31640 1 -- 172.21.15.79:0/884420026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 msgr2=0x7f63a80d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63aec31640 1 --2- 172.21.15.79:0/884420026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a80d1fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f63940097a0 tx=0x7f639402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63aec31640 1 -- 172.21.15.79:0/884420026 shutdown_connections 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63aec31640 1 --2- 172.21.15.79:0/884420026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a80d1fc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63aec31640 1 -- 172.21.15.79:0/884420026 >> 172.21.15.79:0/884420026 conn(0x7f63a809d3f0 msgr2=0x7f63a80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63aec31640 1 -- 172.21.15.79:0/884420026 shutdown_connections 2024-06-10T00:14:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.354+0000 7f63aec31640 1 -- 172.21.15.79:0/884420026 wait complete. 2024-06-10T00:14:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.355+0000 7f63aec31640 1 Processor -- start 2024-06-10T00:14:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.355+0000 7f63aec31640 1 -- start start 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63aec31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a80cef70 0x7f63a815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63aec31640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a80d2680 0x7f63a80c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63aec31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a81e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63aec31640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80d4f00 con 0x7f63a815f1a0 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63aec31640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80d1070 con 0x7f63a80cef70 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63aec31640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f63a80d1870 con 0x7f63a80d2680 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63ad1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a81e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63ad1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a81e7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60754/0 (socket says 172.21.15.79:60754) 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.356+0000 7f63ad1ce640 1 -- 172.21.15.79:0/4034263803 learned_addr learned my addr 172.21.15.79:0/4034263803 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63a7fff640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a80d2680 0x7f63a80c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63ac9cd640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a80cef70 0x7f63a815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63ad1ce640 1 -- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a80d2680 msgr2=0x7f63a80c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63ad1ce640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a80d2680 0x7f63a80c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63ad1ce640 1 -- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a80cef70 msgr2=0x7f63a815b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63ad1ce640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a80cef70 0x7f63a815b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63ad1ce640 1 -- 172.21.15.79:0/4034263803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a815a820 con 0x7f63a815f1a0 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63ac9cd640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a80cef70 0x7f63a815b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63a7fff640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a80d2680 0x7f63a80c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63ad1ce640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a81e7c50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f63a000c7a0 tx=0x7f63a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63a57fa640 1 -- 172.21.15.79:0/4034263803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a0018070 con 0x7f63a815f1a0 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63a57fa640 1 -- 172.21.15.79:0/4034263803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a000a640 con 0x7f63a815f1a0 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a8146f70 con 0x7f63a815f1a0 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63a57fa640 1 -- 172.21.15.79:0/4034263803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a000aab0 con 0x7f63a815f1a0 2024-06-10T00:14:48.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.357+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a8147530 con 0x7f63a815f1a0 2024-06-10T00:14:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.358+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a8068430 con 0x7f63a815f1a0 2024-06-10T00:14:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.358+0000 7f63a57fa640 1 -- 172.21.15.79:0/4034263803 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63a001b070 con 0x7f63a815f1a0 2024-06-10T00:14:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.359+0000 7f63a57fa640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f638c06be30 0x7f638c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.359+0000 7f63a57fa640 1 -- 172.21.15.79:0/4034263803 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f63a008a760 con 0x7f63a815f1a0 2024-06-10T00:14:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.359+0000 7f63ac9cd640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f638c06be30 0x7f638c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.359+0000 7f63ac9cd640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f638c06be30 0x7f638c06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f639c003eb0 tx=0x7f639c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.363+0000 7f63a57fa640 1 -- 172.21.15.79:0/4034263803 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f63a0058e60 con 0x7f63a815f1a0 2024-06-10T00:14:48.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.537+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63a80d04e0 con 0x7f63a815f1a0 2024-06-10T00:14:48.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.538+0000 7f63a57fa640 1 -- 172.21.15.79:0/4034263803 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f63a0058760 con 0x7f63a815f1a0 2024-06-10T00:14:48.538 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:48.538 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f638c06be30 msgr2=0x7f638c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f638c06be30 0x7f638c06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f639c003eb0 tx=0x7f639c009040 comp rx=0 tx=0).stop 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 msgr2=0x7f63a81e7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a81e7c50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f63a000c7a0 tx=0x7f63a000cc60 comp rx=0 tx=0).stop 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 shutdown_connections 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f638c06be30 0x7f638c06e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a815f1a0 0x7f63a81e7c50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a80d2680 0x7f63a80c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 --2- 172.21.15.79:0/4034263803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a80cef70 0x7f63a815b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 >> 172.21.15.79:0/4034263803 conn(0x7f63a809d3f0 msgr2=0x7f63a815fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:48.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 shutdown_connections 2024-06-10T00:14:48.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.540+0000 7f63aec31640 1 -- 172.21.15.79:0/4034263803 wait complete. 2024-06-10T00:14:48.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:48.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.651+0000 7f9299a3f640 1 Processor -- start 2024-06-10T00:14:48.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.651+0000 7f9299a3f640 1 -- start start 2024-06-10T00:14:48.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.651+0000 7f9299a3f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f929415f1a0 0x7f92940d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.651+0000 7f9299a3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940cef70 0x7f92940cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.651+0000 7f9299a3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f929415f5e0 con 0x7f92940d2680 2024-06-10T00:14:48.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.651+0000 7f9299a3f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f92940d13e0 con 0x7f929415f1a0 2024-06-10T00:14:48.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.651+0000 7f9299a3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92940d0ad0 con 0x7f92940cef70 2024-06-10T00:14:48.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f92927fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f929415f1a0 0x7f92940d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f9292ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f92940d2680 0x7f92940d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56818/0 (socket says 172.21.15.79:56818) 2024-06-10T00:14:48.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f9292ffd640 1 -- 172.21.15.79:0/1703263375 learned_addr learned my addr 172.21.15.79:0/1703263375 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f92937fe640 1 --2- 172.21.15.79:0/1703263375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940cef70 0x7f92940cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f92927fc640 1 -- 172.21.15.79:0/1703263375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940cef70 msgr2=0x7f92940cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f92927fc640 1 --2- 172.21.15.79:0/1703263375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940cef70 0x7f92940cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f92927fc640 1 -- 172.21.15.79:0/1703263375 >> v1:172.21.15.79:6789/0 conn(0x7f92940d2680 legacy=0x7f92940d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f92927fc640 1 -- 172.21.15.79:0/1703263375 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929415f890 con 0x7f929415f1a0 2024-06-10T00:14:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.652+0000 7f9291ffb640 1 -- 172.21.15.79:0/1703263375 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064425236 0 0) 0x7f929415f5e0 con 0x7f92940d2680 2024-06-10T00:14:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f92927fc640 1 --2- 172.21.15.79:0/1703263375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929415f1a0 0x7f92940d1fc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92880097a0 tx=0x7f928802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcce81a5400cffcb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9291ffb640 1 -- 172.21.15.79:0/1703263375 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288037070 con 0x7f929415f1a0 2024-06-10T00:14:48.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9291ffb640 1 -- 172.21.15.79:0/1703263375 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9288032440 con 0x7f929415f1a0 2024-06-10T00:14:48.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9291ffb640 1 -- 172.21.15.79:0/1703263375 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288032810 con 0x7f929415f1a0 2024-06-10T00:14:48.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9299a3f640 1 -- 172.21.15.79:0/1703263375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929415f1a0 msgr2=0x7f92940d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9299a3f640 1 --2- 172.21.15.79:0/1703263375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929415f1a0 0x7f92940d1fc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92880097a0 tx=0x7f928802a180 comp rx=0 tx=0).stop 2024-06-10T00:14:48.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9299a3f640 1 -- 172.21.15.79:0/1703263375 shutdown_connections 2024-06-10T00:14:48.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9299a3f640 1 --2- 172.21.15.79:0/1703263375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940cef70 0x7f92940cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9299a3f640 1 --2- 172.21.15.79:0/1703263375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929415f1a0 0x7f92940d1fc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9299a3f640 1 -- 172.21.15.79:0/1703263375 >> 172.21.15.79:0/1703263375 conn(0x7f929409d3f0 msgr2=0x7f92940d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:48.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9299a3f640 1 -- 172.21.15.79:0/1703263375 shutdown_connections 2024-06-10T00:14:48.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.653+0000 7f9299a3f640 1 -- 172.21.15.79:0/1703263375 wait complete. 2024-06-10T00:14:48.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.654+0000 7f9299a3f640 1 Processor -- start 2024-06-10T00:14:48.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9299a3f640 1 -- start start 2024-06-10T00:14:48.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9299a3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92940cef70 0x7f929415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9299a3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940d2680 0x7f929415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9299a3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929415f1a0 0x7f92940b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9299a3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92940d4f00 con 0x7f92940cef70 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9299a3f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f92940d1070 con 0x7f929415f1a0 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9299a3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92940d1870 con 0x7f92940d2680 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9292ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92940cef70 0x7f929415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9292ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92940cef70 0x7f929415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60770/0 (socket says 172.21.15.79:60770) 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.655+0000 7f9292ffd640 1 -- 172.21.15.79:0/684229532 learned_addr learned my addr 172.21.15.79:0/684229532 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f9292ffd640 1 -- 172.21.15.79:0/684229532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940d2680 msgr2=0x7f929415c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f9292ffd640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940d2680 0x7f929415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f9292ffd640 1 -- 172.21.15.79:0/684229532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929415f1a0 msgr2=0x7f92940b9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f9292ffd640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929415f1a0 0x7f92940b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f9292ffd640 1 -- 172.21.15.79:0/684229532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929415c560 con 0x7f92940cef70 2024-06-10T00:14:48.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f9292ffd640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92940cef70 0x7f929415e5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f928400c4d0 tx=0x7f928400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f927bfff640 1 -- 172.21.15.79:0/684229532 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284018070 con 0x7f92940cef70 2024-06-10T00:14:48.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f927bfff640 1 -- 172.21.15.79:0/684229532 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92840074e0 con 0x7f92940cef70 2024-06-10T00:14:48.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f927bfff640 1 -- 172.21.15.79:0/684229532 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284004a20 con 0x7f92940cef70 2024-06-10T00:14:48.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929415c800 con 0x7f92940cef70 2024-06-10T00:14:48.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.656+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92940b6ef0 con 0x7f92940cef70 2024-06-10T00:14:48.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.657+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92940caec0 con 0x7f92940cef70 2024-06-10T00:14:48.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.658+0000 7f927bfff640 1 -- 172.21.15.79:0/684229532 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f928401b070 con 0x7f92940cef70 2024-06-10T00:14:48.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.658+0000 7f927bfff640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.658+0000 7f927bfff640 1 -- 172.21.15.79:0/684229532 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f928408a4c0 con 0x7f92940cef70 2024-06-10T00:14:48.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.658+0000 7f92927fc640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.658+0000 7f92927fc640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9288034000 tx=0x7f928802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.662+0000 7f927bfff640 1 -- 172.21.15.79:0/684229532 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f92940caec0 con 0x7f92940cef70 2024-06-10T00:14:48.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.839+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9294068430 con 0x7f92940cef70 2024-06-10T00:14:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.840+0000 7f927bfff640 1 -- 172.21.15.79:0/684229532 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f9284058b30 con 0x7f92940cef70 2024-06-10T00:14:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:48.840 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 msgr2=0x7f928006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9288034000 tx=0x7f928802c000 comp rx=0 tx=0).stop 2024-06-10T00:14:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92940cef70 msgr2=0x7f929415e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92940cef70 0x7f929415e5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f928400c4d0 tx=0x7f928400c990 comp rx=0 tx=0).stop 2024-06-10T00:14:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 shutdown_connections 2024-06-10T00:14:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929415f1a0 0x7f92940b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92940d2680 0x7f929415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 --2- 172.21.15.79:0/684229532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92940cef70 0x7f929415e5d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 >> 172.21.15.79:0/684229532 conn(0x7f929409d3f0 msgr2=0x7f92940d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 shutdown_connections 2024-06-10T00:14:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.842+0000 7f9299a3f640 1 -- 172.21.15.79:0/684229532 wait complete. 2024-06-10T00:14:48.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.970+0000 7fb421f42640 1 Processor -- start 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.970+0000 7fb421f42640 1 -- start start 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb421f42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb41c06ebf0 0x7fb41c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb421f42640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41c0cf600 con 0x7fb41c0ae910 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb421f42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41c06d130 con 0x7fb41c0cf190 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb421f42640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb41c06d410 con 0x7fb41c06ebf0 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb41affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb41c06ebf0 0x7fb41c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb41b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb41c0ae910 0x7fb41c06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56828/0 (socket says 172.21.15.79:56828) 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb41b7fe640 1 -- 172.21.15.79:0/2413573449 learned_addr learned my addr 172.21.15.79:0/2413573449 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb41affd640 1 -- 172.21.15.79:0/2413573449 >> v1:172.21.15.117:6789/0 conn(0x7fb41c0cf190 legacy=0x7fb41c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb41affd640 1 -- 172.21.15.79:0/2413573449 >> v1:172.21.15.79:6789/0 conn(0x7fb41c0ae910 legacy=0x7fb41c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.971+0000 7fb41affd640 1 -- 172.21.15.79:0/2413573449 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c06d6f0 con 0x7fb41c06ebf0 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.972+0000 7fb41affd640 1 --2- 172.21.15.79:0/2413573449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c06ebf0 0x7fb41c0cec50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4100097a0 tx=0x7fb41002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41995e8071ec92c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.972+0000 7fb41a7fc640 1 -- 172.21.15.79:0/2413573449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410037070 con 0x7fb41c06ebf0 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.972+0000 7fb41a7fc640 1 -- 172.21.15.79:0/2413573449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41002ae50 con 0x7fb41c06ebf0 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.972+0000 7fb41a7fc640 1 -- 172.21.15.79:0/2413573449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410032660 con 0x7fb41c06ebf0 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.973+0000 7fb421f42640 1 -- 172.21.15.79:0/2413573449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c06ebf0 msgr2=0x7fb41c0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.973+0000 7fb421f42640 1 --2- 172.21.15.79:0/2413573449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c06ebf0 0x7fb41c0cec50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4100097a0 tx=0x7fb41002a140 comp rx=0 tx=0).stop 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.973+0000 7fb421f42640 1 -- 172.21.15.79:0/2413573449 shutdown_connections 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.973+0000 7fb421f42640 1 --2- 172.21.15.79:0/2413573449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c06ebf0 0x7fb41c0cec50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.973+0000 7fb421f42640 1 -- 172.21.15.79:0/2413573449 >> 172.21.15.79:0/2413573449 conn(0x7fb41c0b19f0 msgr2=0x7fb41c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.973+0000 7fb421f42640 1 -- 172.21.15.79:0/2413573449 shutdown_connections 2024-06-10T00:14:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.973+0000 7fb421f42640 1 -- 172.21.15.79:0/2413573449 wait complete. 2024-06-10T00:14:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.974+0000 7fb421f42640 1 Processor -- start 2024-06-10T00:14:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.974+0000 7fb421f42640 1 -- start start 2024-06-10T00:14:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb421f42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb41c06ebf0 0x7fb41c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb421f42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c0ae910 0x7fb41c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb421f42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb41c0cf190 0x7fb41c09b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb421f42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c0ad450 con 0x7fb41c0ae910 2024-06-10T00:14:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb421f42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c0aecf0 con 0x7fb41c0cf190 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb421f42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb41c0ad5d0 con 0x7fb41c06ebf0 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c0ae910 0x7fb41c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c0ae910 0x7fb41c15b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60790/0 (socket says 172.21.15.79:60790) 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 -- 172.21.15.79:0/132740170 learned_addr learned my addr 172.21.15.79:0/132740170 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41bfff640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb41c0cf190 0x7fb41c09b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41b7fe640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb41c06ebf0 0x7fb41c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 -- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb41c06ebf0 msgr2=0x7fb41c148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb41c06ebf0 0x7fb41c148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 -- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb41c0cf190 msgr2=0x7fb41c09b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb41c0cf190 0x7fb41c09b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 -- 172.21.15.79:0/132740170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c148f80 con 0x7fb41c0ae910 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41bfff640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb41c0cf190 0x7fb41c09b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.975+0000 7fb41affd640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c0ae910 0x7fb41c15b730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4100098c0 tx=0x7fb4100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.976+0000 7fb403fff640 1 -- 172.21.15.79:0/132740170 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410042070 con 0x7fb41c0ae910 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.976+0000 7fb403fff640 1 -- 172.21.15.79:0/132740170 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41003e670 con 0x7fb41c0ae910 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.976+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41c15e290 con 0x7fb41c0ae910 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.976+0000 7fb403fff640 1 -- 172.21.15.79:0/132740170 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410037040 con 0x7fb41c0ae910 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.976+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41c15c520 con 0x7fb41c0ae910 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.977+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb41c0ace10 con 0x7fb41c0ae910 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.977+0000 7fb403fff640 1 -- 172.21.15.79:0/132740170 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb410045070 con 0x7fb41c0ae910 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.978+0000 7fb403fff640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb40806be30 0x7fb40806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.978+0000 7fb41b7fe640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb40806be30 0x7fb40806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.978+0000 7fb403fff640 1 -- 172.21.15.79:0/132740170 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb4100aba20 con 0x7fb41c0ae910 2024-06-10T00:14:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.978+0000 7fb41b7fe640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb40806be30 0x7fb40806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb41c14c9f0 tx=0x7fb40c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:48.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:48.982+0000 7fb403fff640 1 -- 172.21.15.79:0/132740170 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb41c0ace10 con 0x7fb41c0ae910 2024-06-10T00:14:49.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.194+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb41c068430 con 0x7fb41c0ae910 2024-06-10T00:14:49.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.194+0000 7fb403fff640 1 -- 172.21.15.79:0/132740170 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5177 (secure 0 0 0) 0x7fb41007a240 con 0x7fb41c0ae910 2024-06-10T00:14:49.194 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:14:47.239603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:14:49.194 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-06-10T00:14:49.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb40806be30 msgr2=0x7fb40806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:49.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb40806be30 0x7fb40806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb41c14c9f0 tx=0x7fb40c009040 comp rx=0 tx=0).stop 2024-06-10T00:14:49.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c0ae910 msgr2=0x7fb41c15b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:49.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c0ae910 0x7fb41c15b730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4100098c0 tx=0x7fb4100046c0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 shutdown_connections 2024-06-10T00:14:49.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb40806be30 0x7fb40806e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb41c0cf190 0x7fb41c09b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb41c0ae910 0x7fb41c15b730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 --2- 172.21.15.79:0/132740170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb41c06ebf0 0x7fb41c148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 >> 172.21.15.79:0/132740170 conn(0x7fb41c0b19f0 msgr2=0x7fb41c0cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:49.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 shutdown_connections 2024-06-10T00:14:49.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.196+0000 7fb421f42640 1 -- 172.21.15.79:0/132740170 wait complete. 2024-06-10T00:14:49.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.306+0000 7f48c14ee640 1 Processor -- start 2024-06-10T00:14:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.307+0000 7f48c14ee640 1 -- start start 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.307+0000 7f48c14ee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48bc1553c0 0x7f48bc0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.307+0000 7f48c14ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 0x7f48bc15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.307+0000 7f48c14ee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc15c3f0 con 0x7f48bc0cec50 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.307+0000 7f48c14ee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f48bc0b3170 con 0x7f48bc1553c0 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.307+0000 7f48c14ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f48bc0b3420 con 0x7f48bc0b2cf0 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.308+0000 7f48baffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48bc1553c0 0x7f48bc0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.308+0000 7f48baffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48bc1553c0 0x7f48bc0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48798/0 (socket says 172.21.15.79:48798) 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.308+0000 7f48baffd640 1 -- 172.21.15.79:0/2765236954 learned_addr learned my addr 172.21.15.79:0/2765236954 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.308+0000 7f48b27fc640 1 --2- 172.21.15.79:0/2765236954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 0x7f48bc15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.308+0000 7f48baffd640 1 -- 172.21.15.79:0/2765236954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 msgr2=0x7f48bc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.308+0000 7f48baffd640 1 --2- 172.21.15.79:0/2765236954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 0x7f48bc15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.308+0000 7f48baffd640 1 -- 172.21.15.79:0/2765236954 >> v1:172.21.15.117:6789/0 conn(0x7f48bc0cec50 legacy=0x7f48bc071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:49.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.308+0000 7f48baffd640 1 -- 172.21.15.79:0/2765236954 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc0cc750 con 0x7f48bc1553c0 2024-06-10T00:14:49.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48baffd640 1 --2- 172.21.15.79:0/2765236954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 0x7f48bc0cd230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00bb10 tx=0x7f48ac02c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a6fbc9a920c56 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:49.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48ba7fc640 1 -- 172.21.15.79:0/2765236954 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac036020 con 0x7f48bc1553c0 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48ba7fc640 1 -- 172.21.15.79:0/2765236954 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac032820 con 0x7f48bc1553c0 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48ba7fc640 1 -- 172.21.15.79:0/2765236954 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac032bf0 con 0x7f48bc1553c0 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48c14ee640 1 -- 172.21.15.79:0/2765236954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 msgr2=0x7f48bc0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2765236954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 0x7f48bc0cd230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00bb10 tx=0x7f48ac02c920 comp rx=0 tx=0).stop 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48c14ee640 1 -- 172.21.15.79:0/2765236954 shutdown_connections 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2765236954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 0x7f48bc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2765236954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 0x7f48bc0cd230 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48c14ee640 1 -- 172.21.15.79:0/2765236954 >> 172.21.15.79:0/2765236954 conn(0x7f48bc0b19f0 msgr2=0x7f48bc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48c14ee640 1 -- 172.21.15.79:0/2765236954 shutdown_connections 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.309+0000 7f48c14ee640 1 -- 172.21.15.79:0/2765236954 wait complete. 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.311+0000 7f48c14ee640 1 Processor -- start 2024-06-10T00:14:49.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.311+0000 7f48c14ee640 1 -- start start 2024-06-10T00:14:49.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.311+0000 7f48c14ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 0x7f48bc146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:49.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.311+0000 7f48c14ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0cec50 0x7f48bc09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:49.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.311+0000 7f48c14ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 0x7f48bc152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:49.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.311+0000 7f48c14ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc0b3700 con 0x7f48bc0cec50 2024-06-10T00:14:49.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.311+0000 7f48c14ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc0ccd10 con 0x7f48bc1553c0 2024-06-10T00:14:49.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.311+0000 7f48c14ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f48bc1557a0 con 0x7f48bc0b2cf0 2024-06-10T00:14:49.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0cec50 0x7f48bc09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:49.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0cec50 0x7f48bc09aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60798/0 (socket says 172.21.15.79:60798) 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 -- 172.21.15.79:0/2756391944 learned_addr learned my addr 172.21.15.79:0/2756391944 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48bb7fe640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 0x7f48bc152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48baffd640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 0x7f48bc146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 -- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 msgr2=0x7f48bc146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 0x7f48bc146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 -- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 msgr2=0x7f48bc152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 0x7f48bc152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 -- 172.21.15.79:0/2756391944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc151d40 con 0x7f48bc0cec50 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48bb7fe640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 0x7f48bc152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b27fc640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0cec50 0x7f48bc09aa10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e9b0 tx=0x7f48a400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b3fff640 1 -- 172.21.15.79:0/2756391944 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a4017070 con 0x7f48bc0cec50 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b3fff640 1 -- 172.21.15.79:0/2756391944 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a400c9a0 con 0x7f48bc0cec50 2024-06-10T00:14:49.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48bc152020 con 0x7f48bc0cec50 2024-06-10T00:14:49.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48b3fff640 1 -- 172.21.15.79:0/2756391944 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a400cd90 con 0x7f48bc0cec50 2024-06-10T00:14:49.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.312+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48bc1525e0 con 0x7f48bc0cec50 2024-06-10T00:14:49.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.313+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48bc068430 con 0x7f48bc0cec50 2024-06-10T00:14:49.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.314+0000 7f48b3fff640 1 -- 172.21.15.79:0/2756391944 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48a401a070 con 0x7f48bc0cec50 2024-06-10T00:14:49.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.314+0000 7f48b3fff640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f489c06be30 0x7f489c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:49.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.314+0000 7f48b3fff640 1 -- 172.21.15.79:0/2756391944 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f48a408b4a0 con 0x7f48bc0cec50 2024-06-10T00:14:49.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.314+0000 7f48baffd640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f489c06be30 0x7f489c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:49.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.314+0000 7f48baffd640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f489c06be30 0x7f489c06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48ac037000 tx=0x7f48ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:49.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.318+0000 7f48b3fff640 1 -- 172.21.15.79:0/2756391944 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f48a4059ba0 con 0x7f48bc0cec50 2024-06-10T00:14:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.493+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48bc15b2b0 con 0x7f48bc0cec50 2024-06-10T00:14:49.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.494+0000 7f48b3fff640 1 -- 172.21.15.79:0/2756391944 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f48a40594a0 con 0x7f48bc0cec50 2024-06-10T00:14:49.494 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:49.494 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f489c06be30 msgr2=0x7f489c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f489c06be30 0x7f489c06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48ac037000 tx=0x7f48ac008040 comp rx=0 tx=0).stop 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0cec50 msgr2=0x7f48bc09aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0cec50 0x7f48bc09aa10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e9b0 tx=0x7f48a400ee70 comp rx=0 tx=0).stop 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 shutdown_connections 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f489c06be30 0x7f489c06e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc1553c0 0x7f48bc152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0cec50 0x7f48bc09aa10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 --2- 172.21.15.79:0/2756391944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48bc0b2cf0 0x7f48bc146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 >> 172.21.15.79:0/2756391944 conn(0x7f48bc0b19f0 msgr2=0x7f48bc0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 shutdown_connections 2024-06-10T00:14:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:49.496+0000 7f48c14ee640 1 -- 172.21.15.79:0/2756391944 wait complete. 2024-06-10T00:14:49.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:14:42.196314+0000', 'modified': '2024-06-10T00:14:47.239603+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6835/4113284767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6833', 'nonce': 4113284767}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 4113284767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-06-10T00:14:49.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:14:49.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-06-10T00:14:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.012+0000 7f5972d42640 1 Processor -- start 2024-06-10T00:14:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.012+0000 7f5972d42640 1 -- start start 2024-06-10T00:14:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5972d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c072350 0x7f596c072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5972d42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f596c0730d0 0x7f596c0b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5972d42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c072c70 con 0x7f596c0b5140 2024-06-10T00:14:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5972d42640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0b5f80 con 0x7f596c0730d0 2024-06-10T00:14:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5972d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f596c0b56e0 con 0x7f596c072350 2024-06-10T00:14:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5963fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f596c0730d0 0x7f596c0b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5970ade640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c072350 0x7f596c072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5963fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f596c0730d0 0x7f596c0b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48814/0 (socket says 172.21.15.79:48814) 2024-06-10T00:14:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5963fff640 1 -- 172.21.15.79:0/3485189801 learned_addr learned my addr 172.21.15.79:0/3485189801 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.013+0000 7f5970ade640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c072350 0x7f596c072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:43238/0 (socket says 172.21.15.79:43238) 2024-06-10T00:14:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.014+0000 7f5970ade640 1 -- 172.21.15.79:0/3485189801 >> v2:172.21.15.117:3300/0 conn(0x7f596c0730d0 msgr2=0x7f596c0b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.014+0000 7f5970ade640 1 --2- 172.21.15.79:0/3485189801 >> v2:172.21.15.117:3300/0 conn(0x7f596c0730d0 0x7f596c0b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.014+0000 7f5970ade640 1 -- 172.21.15.79:0/3485189801 >> v1:172.21.15.117:6789/0 conn(0x7f596c0b5140 legacy=0x7f596c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.014+0000 7f5970ade640 1 -- 172.21.15.79:0/3485189801 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c0b59c0 con 0x7f596c072350 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.014+0000 7f5963fff640 1 --2- 172.21.15.79:0/3485189801 >> v2:172.21.15.117:3300/0 conn(0x7f596c0730d0 0x7f596c0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.014+0000 7f5970ade640 1 --2- 172.21.15.79:0/3485189801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c072350 0x7f596c072730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59680097a0 tx=0x7f596802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3df78cdd98701c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f59637fe640 1 -- 172.21.15.79:0/3485189801 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968037070 con 0x7f596c072350 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f59637fe640 1 -- 172.21.15.79:0/3485189801 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596802ae50 con 0x7f596c072350 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f59637fe640 1 -- 172.21.15.79:0/3485189801 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968032660 con 0x7f596c072350 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f5972d42640 1 -- 172.21.15.79:0/3485189801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c072350 msgr2=0x7f596c072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f5972d42640 1 --2- 172.21.15.79:0/3485189801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c072350 0x7f596c072730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59680097a0 tx=0x7f596802a100 comp rx=0 tx=0).stop 2024-06-10T00:14:50.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f5972d42640 1 -- 172.21.15.79:0/3485189801 shutdown_connections 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f5972d42640 1 --2- 172.21.15.79:0/3485189801 >> v2:172.21.15.117:3300/0 conn(0x7f596c0730d0 0x7f596c0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f5972d42640 1 --2- 172.21.15.79:0/3485189801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c072350 0x7f596c072730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f5972d42640 1 -- 172.21.15.79:0/3485189801 >> 172.21.15.79:0/3485189801 conn(0x7f596c0b2ae0 msgr2=0x7f596c0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f5972d42640 1 -- 172.21.15.79:0/3485189801 shutdown_connections 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.015+0000 7f5972d42640 1 -- 172.21.15.79:0/3485189801 wait complete. 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.016+0000 7f5972d42640 1 Processor -- start 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.016+0000 7f5972d42640 1 -- start start 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5972d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f596c072350 0x7f596c15ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5972d42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f596c0730d0 0x7f596c1476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5972d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c0b5140 0x7f596c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5972d42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f596c15c4b0 con 0x7f596c0730d0 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5972d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0cecf0 con 0x7f596c072350 2024-06-10T00:14:50.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5972d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f596c15c630 con 0x7f596c0b5140 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5963fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f596c0730d0 0x7f596c1476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5963fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f596c0730d0 0x7f596c1476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60814/0 (socket says 172.21.15.79:60814) 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5963fff640 1 -- 172.21.15.79:0/2590319441 learned_addr learned my addr 172.21.15.79:0/2590319441 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f59712df640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c0b5140 0x7f596c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.017+0000 7f5970ade640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f596c072350 0x7f596c15ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f5963fff640 1 -- 172.21.15.79:0/2590319441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c0b5140 msgr2=0x7f596c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f5963fff640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c0b5140 0x7f596c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f5963fff640 1 -- 172.21.15.79:0/2590319441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f596c072350 msgr2=0x7f596c15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f5963fff640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f596c072350 0x7f596c15ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f5963fff640 1 -- 172.21.15.79:0/2590319441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c15cf90 con 0x7f596c0730d0 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f5963fff640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f596c0730d0 0x7f596c1476a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e9d0 tx=0x7f595c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f59617fa640 1 -- 172.21.15.79:0/2590319441 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c017070 con 0x7f596c0730d0 2024-06-10T00:14:50.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f59617fa640 1 -- 172.21.15.79:0/2590319441 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c00ca60 con 0x7f596c0730d0 2024-06-10T00:14:50.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f5972d42640 1 -- 172.21.15.79:0/2590319441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c15d210 con 0x7f596c0730d0 2024-06-10T00:14:50.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f59617fa640 1 -- 172.21.15.79:0/2590319441 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c00ce10 con 0x7f596c0730d0 2024-06-10T00:14:50.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.018+0000 7f5972d42640 1 -- 172.21.15.79:0/2590319441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c15dab0 con 0x7f596c0730d0 2024-06-10T00:14:50.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.019+0000 7f59617fa640 1 -- 172.21.15.79:0/2590319441 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f595c01a070 con 0x7f596c0730d0 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.020+0000 7f59617fa640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f595806be30 0x7f595806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.020+0000 7f59617fa640 1 -- 172.21.15.79:0/2590319441 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f595c08b0b0 con 0x7f596c0730d0 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.020+0000 7f5970ade640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f595806be30 0x7f595806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.020+0000 7f5970ade640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f595806be30 0x7f595806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5968034000 tx=0x7f596802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.021+0000 7f5975a53740 1 Processor -- start 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.021+0000 7f5975a53740 1 -- start start 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.021+0000 7f5975a53740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398ddd00 0x5588398e0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.021+0000 7f5975a53740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.021+0000 7f5975a53740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398b0960 0x5588398b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.021+0000 7f5975a53740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558839819740 con 0x5588398b0960 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.021+0000 7f5975a53740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5588397b7a80 con 0x5588398de0e0 2024-06-10T00:14:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.021+0000 7f5975a53740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558839815700 con 0x5588398ddd00 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398b0960 0x5588398b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398b0960 0x5588398b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60826/0 (socket says 172.21.15.79:60826) 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 -- 172.21.15.79:0/3420467074 learned_addr learned my addr 172.21.15.79:0/3420467074 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f5970ade640 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398ddd00 0x5588398e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f5963fff640 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 -- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398ddd00 msgr2=0x5588398e0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398ddd00 0x5588398e0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 -- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 msgr2=0x5588398e0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 -- 172.21.15.79:0/3420467074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588397e2fb0 con 0x5588398b0960 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f5963fff640 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59712df640 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398b0960 0x5588398b4170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5964001e50 tx=0x7f59640015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0fc88e44324bc6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59527fc640 1 -- 172.21.15.79:0/3420467074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964002060 con 0x5588398b0960 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59527fc640 1 -- 172.21.15.79:0/3420467074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596400fdf0 con 0x5588398b0960 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.022+0000 7f59527fc640 1 -- 172.21.15.79:0/3420467074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964006b50 con 0x5588398b0960 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 -- 172.21.15.79:0/3420467074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398b0960 msgr2=0x5588398b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398b0960 0x5588398b4170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5964001e50 tx=0x7f59640015d0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 -- 172.21.15.79:0/3420467074 shutdown_connections 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398b0960 0x5588398b4170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 --2- 172.21.15.79:0/3420467074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398ddd00 0x5588398e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 -- 172.21.15.79:0/3420467074 >> 172.21.15.79:0/3420467074 conn(0x5588398b2bd0 msgr2=0x5588398fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 -- 172.21.15.79:0/3420467074 shutdown_connections 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 -- 172.21.15.79:0/3420467074 wait complete. 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 -- start start 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.023+0000 7f5975a53740 1 Processor -- start 2024-06-10T00:14:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5975a53740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398ddd00 0x55883990b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5975a53740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398de0e0 0x5588398dc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5975a53740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x5588398fc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5975a53740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5588398b5d80 con 0x5588398de0e0 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5975a53740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5588397a2c30 con 0x5588398ddd00 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5975a53740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5588398b6060 con 0x5588398dc8c0 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5975a53740 10 client.0 _ll_register_callbacks cb 0x5588397d47f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5963fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398de0e0 0x5588398dc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5963fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398de0e0 0x5588398dc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60832/0 (socket says 172.21.15.79:60832) 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5963fff640 1 -- 172.21.15.79:0/2042727975 learned_addr learned my addr 172.21.15.79:0/2042727975 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f59712df640 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x5588398fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.024+0000 7f5970ade640 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398ddd00 0x55883990b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5963fff640 1 -- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 msgr2=0x5588398fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5963fff640 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x5588398fc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5963fff640 1 -- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398ddd00 msgr2=0x55883990b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5963fff640 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398ddd00 0x55883990b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5963fff640 1 -- 172.21.15.79:0/2042727975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883952d2d0 con 0x5588398de0e0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5963fff640 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398de0e0 0x5588398dc380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f595c0616b0 tx=0x7f595c058b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bceb81c31f7d9db server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f594b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f594b7fe640 1 -- 172.21.15.79:0/2042727975 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c071030 con 0x5588398de0e0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 1 -- 172.21.15.79:0/2042727975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f596400fdf0 con 0x5588398de0e0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f594b7fe640 1 -- 172.21.15.79:0/2042727975 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f595c082de0 con 0x5588398de0e0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f594b7fe640 1 -- 172.21.15.79:0/2042727975 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f595c021040 con 0x5588398de0e0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 10 client.4410 fetch_fsmap learned FSMap version 6 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 1 -- 172.21.15.79:0/2042727975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5588395f76b0 con 0x5588398de0e0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f594b7fe640 1 -- 172.21.15.79:0/2042727975 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596400fdf0 con 0x5588398de0e0 2024-06-10T00:14:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f594b7fe640 1 -- 172.21.15.79:0/2042727975 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f595c024060 con 0x5588398de0e0 2024-06-10T00:14:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 10 client.4410 fetch_fsmap finished waiting for FSMap version 6 2024-06-10T00:14:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 10 client.4410 resolve_mds: resolved name 'd' to daemon mds.d 2024-06-10T00:14:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 20 client.4410 populate_metadata read hostname 'smithi079' 2024-06-10T00:14:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x55883990dc30 0x558839919fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 4 client.4410 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.025+0000 7f5975a53740 1 -- 172.21.15.79:0/2042727975 --> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558839826e70 con 0x55883990dc30 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.026+0000 7f5970ade640 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x55883990dc30 0x558839919fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.026+0000 7f594b7fe640 10 client.4410 ms_handle_connect on v2:172.21.15.117:6833/4113284767 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.026+0000 7f5970ade640 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x55883990dc30 0x558839919fb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5cde9da4c33e4df server_cookie=5546673bad2ee96a in_seq=0 out_seq=0 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f594b7fe640 1 -- 172.21.15.79:0/2042727975 <== mds.0 v2:172.21.15.117:6833/4113284767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558839826e70 con 0x55883990dc30 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f594b7fe640 10 client.4410 handle_command_reply: tid=0 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 client.4410 shutdown 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 -- 172.21.15.79:0/2042727975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398de0e0 msgr2=0x5588398dc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398de0e0 0x5588398dc380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f595c0616b0 tx=0x7f595c058b00 comp rx=0 tx=0).stop 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 -- 172.21.15.79:0/2042727975 shutdown_connections 2024-06-10T00:14:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x55883990dc30 0x558839919fb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x5588398fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f594b7fe640 0 client.4410 ms_handle_reset on v2:172.21.15.117:6833/4113284767 2024-06-10T00:14:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398de0e0 0x5588398dc380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 --2- 172.21.15.79:0/2042727975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398ddd00 0x55883990b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 -- 172.21.15.79:0/2042727975 >> 172.21.15.79:0/2042727975 conn(0x5588398b0960 msgr2=0x5588398dd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 -- 172.21.15.79:0/2042727975 shutdown_connections 2024-06-10T00:14:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 1 -- 172.21.15.79:0/2042727975 wait complete. 2024-06-10T00:14:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.027+0000 7f5975a53740 20 client.4410 trim_cache size 0 max 16384 2024-06-10T00:14:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.045+0000 7f5975a53740 1 Processor -- start 2024-06-10T00:14:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.045+0000 7f5975a53740 1 -- start start 2024-06-10T00:14:50.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5975a53740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x558839915010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5975a53740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x558839915550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5975a53740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5975a53740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1feb20 con 0x5588398ddd00 2024-06-10T00:14:50.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5975a53740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1fe000 con 0x5588398de0e0 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5975a53740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f596c1fe4d0 con 0x5588398dc8c0 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x558839915550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x558839915550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60848/0 (socket says 172.21.15.79:60848) 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 -- 172.21.15.79:0/4208574462 learned_addr learned my addr 172.21.15.79:0/4208574462 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5970ade640 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x558839915010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f59712df640 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 -- 172.21.15.79:0/4208574462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 msgr2=0x558839915010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x558839915010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 -- 172.21.15.79:0/4208574462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 msgr2=0x5588398e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 -- 172.21.15.79:0/4208574462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588398fc9b0 con 0x5588398ddd00 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.046+0000 7f5963fff640 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x558839915550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f595c057360 tx=0x7f595c06e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b388f563fb2be041 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5951ffb640 1 -- 172.21.15.79:0/4208574462 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c071040 con 0x5588398ddd00 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5951ffb640 1 -- 172.21.15.79:0/4208574462 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c082de0 con 0x5588398ddd00 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5951ffb640 1 -- 172.21.15.79:0/4208574462 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c058700 con 0x5588398ddd00 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 -- 172.21.15.79:0/4208574462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 msgr2=0x558839915550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x558839915550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f595c057360 tx=0x7f595c06e000 comp rx=0 tx=0).stop 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 -- 172.21.15.79:0/4208574462 shutdown_connections 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x558839915550 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 --2- 172.21.15.79:0/4208574462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x558839915010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 -- 172.21.15.79:0/4208574462 >> 172.21.15.79:0/4208574462 conn(0x5588398b0960 msgr2=0x5588398dcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 -- 172.21.15.79:0/4208574462 shutdown_connections 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.047+0000 7f5975a53740 1 -- 172.21.15.79:0/4208574462 wait complete. 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.048+0000 7f5975a53740 1 -- start start 2024-06-10T00:14:50.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.048+0000 7f5975a53740 1 Processor -- start 2024-06-10T00:14:50.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x5588399750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x5588398da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398daac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55883990c7e0 con 0x5588398ddd00 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55883990cc60 con 0x5588398de0e0 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5588398e42d0 con 0x5588398dc8c0 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 10 client.0 _ll_register_callbacks cb 0x7f595c058c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x5588398da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x5588398da580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60856/0 (socket says 172.21.15.79:60856) 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 -- 172.21.15.79:0/2211135235 learned_addr learned my addr 172.21.15.79:0/2211135235 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5970ade640 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x5588399750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f59712df640 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398daac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 -- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 msgr2=0x5588399750c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x5588399750c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 -- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 msgr2=0x5588398daac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398daac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 -- 172.21.15.79:0/2211135235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883990e0b0 con 0x5588398ddd00 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5963fff640 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x5588398da580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f595c00c520 tx=0x7f595c089150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb9dc373f6a7d0c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f594b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f594b7fe640 1 -- 172.21.15.79:0/2211135235 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c071040 con 0x5588398ddd00 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f594b7fe640 1 -- 172.21.15.79:0/2211135235 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f595c07ae30 con 0x5588398ddd00 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 1 -- 172.21.15.79:0/2211135235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595c082de0 con 0x5588398ddd00 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f594b7fe640 1 -- 172.21.15.79:0/2211135235 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f595c055010 con 0x5588398ddd00 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 10 client.4416 fetch_fsmap learned FSMap version 6 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.049+0000 7f5975a53740 1 -- 172.21.15.79:0/2211135235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5588398dbfe0 con 0x5588398ddd00 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f594b7fe640 1 -- 172.21.15.79:0/2211135235 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c082de0 con 0x5588398ddd00 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f594b7fe640 1 -- 172.21.15.79:0/2211135235 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f595c057f70 con 0x5588398ddd00 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5975a53740 10 client.4416 fetch_fsmap finished waiting for FSMap version 6 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5975a53740 10 client.4416 resolve_mds: resolved name 'd' to daemon mds.d 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5975a53740 20 client.4416 populate_metadata read hostname 'smithi079' 2024-06-10T00:14:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5975a53740 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x558839982060 0x558839982440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5975a53740 4 client.4416 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5975a53740 1 -- 172.21.15.79:0/2211135235 --> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] -- command(tid 0: {"prefix": "status"}) -- 0x5588398211c0 con 0x558839982060 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5970ade640 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x558839982060 0x558839982440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f594b7fe640 10 client.4416 ms_handle_connect on v2:172.21.15.117:6833/4113284767 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5970ade640 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x558839982060 0x558839982440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1956335e6f3513d server_cookie=7ce4810d8818fec1 in_seq=0 out_seq=0 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f594b7fe640 1 -- 172.21.15.79:0/2211135235 <== mds.0 v2:172.21.15.117:6833/4113284767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5588398211c0 con 0x558839982060 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f594b7fe640 10 client.4416 handle_command_reply: tid=0 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.050+0000 7f5975a53740 1 client.4416 shutdown 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 -- 172.21.15.79:0/2211135235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 msgr2=0x5588398da580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x5588398da580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f595c00c520 tx=0x7f595c089150 comp rx=0 tx=0).stop 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 -- 172.21.15.79:0/2211135235 shutdown_connections 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x558839982060 0x558839982440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588398de0e0 0x5588398daac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f594b7fe640 0 client.4416 ms_handle_reset on v2:172.21.15.117:6833/4113284767 2024-06-10T00:14:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588398ddd00 0x5588398da580 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 --2- 172.21.15.79:0/2211135235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588398dc8c0 0x5588399750c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 -- 172.21.15.79:0/2211135235 >> 172.21.15.79:0/2211135235 conn(0x5588398b0960 msgr2=0x5588398e3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 -- 172.21.15.79:0/2211135235 shutdown_connections 2024-06-10T00:14:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 1 -- 172.21.15.79:0/2211135235 wait complete. 2024-06-10T00:14:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5975a53740 20 client.4416 trim_cache size 0 max 16384 2024-06-10T00:14:50.057 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4287, 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 7.2044723360000003, 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 6, 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 24, 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 24, 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.350858368000001 2024-06-10T00:14:50.058 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:14:50.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 -- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f595806be30 msgr2=0x7f595806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f595806be30 0x7f595806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5968034000 tx=0x7f596802e000 comp rx=0 tx=0).stop 2024-06-10T00:14:50.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 -- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f596c0730d0 msgr2=0x7f596c1476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f596c0730d0 0x7f596c1476a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e9d0 tx=0x7f595c00ee90 comp rx=0 tx=0).stop 2024-06-10T00:14:50.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 -- 172.21.15.79:0/2590319441 shutdown_connections 2024-06-10T00:14:50.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f595806be30 0x7f595806e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f596c0b5140 0x7f596c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f596c0730d0 0x7f596c1476a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 --2- 172.21.15.79:0/2590319441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f596c072350 0x7f596c15ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 -- 172.21.15.79:0/2590319441 >> 172.21.15.79:0/2590319441 conn(0x7f596c0b2ae0 msgr2=0x7f596c15b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:50.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 -- 172.21.15.79:0/2590319441 shutdown_connections 2024-06-10T00:14:50.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.051+0000 7f5972d42640 1 -- 172.21.15.79:0/2590319441 wait complete. 2024-06-10T00:14:50.062 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-10T00:14:50.062 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-10T00:14:50.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:14:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.162+0000 7fdb8d961640 1 Processor -- start 2024-06-10T00:14:50.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.162+0000 7fdb8d961640 1 -- start start 2024-06-10T00:14:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb8d961640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb8815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb8d961640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb880d1fc0 0x7fdb880d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb8d961640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb880d2fa0 con 0x7fdb88161fa0 2024-06-10T00:14:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb8d961640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdb880cff80 con 0x7fdb880d1fc0 2024-06-10T00:14:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb8d961640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdb880d13e0 con 0x7fdb880d2680 2024-06-10T00:14:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb7ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb880d1fc0 0x7fdb880d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb86ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb8815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb877fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fdb88161fa0 0x7fdb88162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:37308/0 (socket says 172.21.15.79:37308) 2024-06-10T00:14:50.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb877fe640 1 -- 172.21.15.79:0/3905259682 learned_addr learned my addr 172.21.15.79:0/3905259682 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:50.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb7ffff640 1 -- 172.21.15.79:0/3905259682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 msgr2=0x7fdb8815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:50.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb7ffff640 1 --2- 172.21.15.79:0/3905259682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb8815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb7ffff640 1 -- 172.21.15.79:0/3905259682 >> v1:172.21.15.117:6789/0 conn(0x7fdb88161fa0 legacy=0x7fdb88162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb7ffff640 1 -- 172.21.15.79:0/3905259682 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb880d0ad0 con 0x7fdb880d1fc0 2024-06-10T00:14:50.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.163+0000 7fdb86ffd640 1 --2- 172.21.15.79:0/3905259682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb8815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:14:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.164+0000 7fdb7ffff640 1 --2- 172.21.15.79:0/3905259682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb880d1fc0 0x7fdb880d2a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097a0 tx=0x7fdb7002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d7b28b90b711204 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.164+0000 7fdb867fc640 1 -- 172.21.15.79:0/3905259682 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70037070 con 0x7fdb880d1fc0 2024-06-10T00:14:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.164+0000 7fdb867fc640 1 -- 172.21.15.79:0/3905259682 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb70032440 con 0x7fdb880d1fc0 2024-06-10T00:14:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.164+0000 7fdb867fc640 1 -- 172.21.15.79:0/3905259682 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70032810 con 0x7fdb880d1fc0 2024-06-10T00:14:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.165+0000 7fdb8d961640 1 -- 172.21.15.79:0/3905259682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb880d1fc0 msgr2=0x7fdb880d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.165+0000 7fdb8d961640 1 --2- 172.21.15.79:0/3905259682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb880d1fc0 0x7fdb880d2a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097a0 tx=0x7fdb7002a180 comp rx=0 tx=0).stop 2024-06-10T00:14:50.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.165+0000 7fdb8d961640 1 -- 172.21.15.79:0/3905259682 shutdown_connections 2024-06-10T00:14:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.165+0000 7fdb8d961640 1 --2- 172.21.15.79:0/3905259682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb880d1fc0 0x7fdb880d2a60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.165+0000 7fdb8d961640 1 --2- 172.21.15.79:0/3905259682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb8815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.165+0000 7fdb8d961640 1 -- 172.21.15.79:0/3905259682 >> 172.21.15.79:0/3905259682 conn(0x7fdb8809d3f0 msgr2=0x7fdb880d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.165+0000 7fdb8d961640 1 -- 172.21.15.79:0/3905259682 shutdown_connections 2024-06-10T00:14:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.165+0000 7fdb8d961640 1 -- 172.21.15.79:0/3905259682 wait complete. 2024-06-10T00:14:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.166+0000 7fdb8d961640 1 Processor -- start 2024-06-10T00:14:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.166+0000 7fdb8d961640 1 -- start start 2024-06-10T00:14:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb8d961640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb880d1fc0 0x7fdb880b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb8d961640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb881f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb8d961640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb88161fa0 0x7fdb8815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb8d961640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdb880d1070 con 0x7fdb880d1fc0 2024-06-10T00:14:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb8d961640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdb880d0d90 con 0x7fdb88161fa0 2024-06-10T00:14:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb8d961640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdb880d2400 con 0x7fdb880d2680 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb880d1fc0 0x7fdb880b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb880d1fc0 0x7fdb880b8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60860/0 (socket says 172.21.15.79:60860) 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 -- 172.21.15.79:0/4163548114 learned_addr learned my addr 172.21.15.79:0/4163548114 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb7ffff640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb881f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb877fe640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb88161fa0 0x7fdb8815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 -- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 msgr2=0x7fdb881f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb881f4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 -- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb88161fa0 msgr2=0x7fdb8815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb88161fa0 0x7fdb8815b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 -- 172.21.15.79:0/4163548114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb881f4b30 con 0x7fdb880d1fc0 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb7ffff640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb881f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb877fe640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb88161fa0 0x7fdb8815b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.167+0000 7fdb86ffd640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb880d1fc0 0x7fdb880b8bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800ec10 tx=0x7fdb7800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.168+0000 7fdb84ff9640 1 -- 172.21.15.79:0/4163548114 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78017070 con 0x7fdb880d1fc0 2024-06-10T00:14:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.168+0000 7fdb84ff9640 1 -- 172.21.15.79:0/4163548114 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7800cbd0 con 0x7fdb880d1fc0 2024-06-10T00:14:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.168+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb881f4e10 con 0x7fdb880d1fc0 2024-06-10T00:14:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.168+0000 7fdb84ff9640 1 -- 172.21.15.79:0/4163548114 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78013470 con 0x7fdb880d1fc0 2024-06-10T00:14:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.168+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb880b6e80 con 0x7fdb880d1fc0 2024-06-10T00:14:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.169+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb881f5330 con 0x7fdb880d1fc0 2024-06-10T00:14:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.169+0000 7fdb84ff9640 1 -- 172.21.15.79:0/4163548114 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb7801a070 con 0x7fdb880d1fc0 2024-06-10T00:14:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.169+0000 7fdb84ff9640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb6806be30 0x7fdb6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.170+0000 7fdb84ff9640 1 -- 172.21.15.79:0/4163548114 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdb7808b3c0 con 0x7fdb880d1fc0 2024-06-10T00:14:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.170+0000 7fdb7ffff640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb6806be30 0x7fdb6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.170+0000 7fdb7ffff640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb6806be30 0x7fdb6806e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb70034000 tx=0x7fdb7002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.174+0000 7fdb84ff9640 1 -- 172.21.15.79:0/4163548114 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdb78059ac0 con 0x7fdb880d1fc0 2024-06-10T00:14:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.385+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdb88068430 con 0x7fdb880d1fc0 2024-06-10T00:14:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.385+0000 7fdb84ff9640 1 -- 172.21.15.79:0/4163548114 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fdb780593c0 con 0x7fdb880d1fc0 2024-06-10T00:14:50.385 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-10T00:14:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb6806be30 msgr2=0x7fdb6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb6806be30 0x7fdb6806e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb70034000 tx=0x7fdb7002e000 comp rx=0 tx=0).stop 2024-06-10T00:14:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb880d1fc0 msgr2=0x7fdb880b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb880d1fc0 0x7fdb880b8bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800ec10 tx=0x7fdb7800c520 comp rx=0 tx=0).stop 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 shutdown_connections 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb6806be30 0x7fdb6806e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb88161fa0 0x7fdb8815b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb880d2680 0x7fdb881f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 --2- 172.21.15.79:0/4163548114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb880d1fc0 0x7fdb880b8bb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 >> 172.21.15.79:0/4163548114 conn(0x7fdb8809d3f0 msgr2=0x7fdb88161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 shutdown_connections 2024-06-10T00:14:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50.387+0000 7fdb8d961640 1 -- 172.21.15.79:0/4163548114 wait complete. 2024-06-10T00:14:50.397 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-10T00:14:50.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:14:50.398 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:14:50.398 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-10T00:14:50.398 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-10T00:14:50.398 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-10T00:14:50.398 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:14:50.398 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:14:50.398 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-10T00:14:50.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:50.398 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:14:50.414 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:14:50.414 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:14:50.415 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:14:50.415 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:14:50.415 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:14:50.415 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:14:50.415 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:14:50.416 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:14:50.416 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:14:50.416 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:14:50.416 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:14:50.416 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:14:50.416 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:14:50.417 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:14:50.417 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:14:50.417 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:14:50.417 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:14:50.417 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42754sec preferred_lft 42754sec 2024-06-10T00:14:50.417 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:14:50.417 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:14:50.418 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-10T00:14:50.418 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:14:50.418 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:14:50.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-06-10T00:14:50.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-06-10T00:14:50.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-06-10T00:14:50.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-10T00:14:50.418 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:14:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:14:50.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:14:50.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:50.611 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:14:50.635 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:14:50.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:50.637 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:14:50.698 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:14:50.698 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:14:50.698 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:14:50.698 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:14:50.698 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:14:50.699 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:14:50.699 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:14:50.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:14:50.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:14:50.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:14:50.699 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:14:50.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:14:50.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:14:50.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:50.963 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:14:50.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:50.979 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-06-10T00:14:51.035 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:14:51.035 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:14:51.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-10T00:14:51.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-10T00:14:51.035 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:14:51.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:14:51.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:14:51.155 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-10T00:14:51.156 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:14:51.156 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:14:51.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-10T00:14:51.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-10T00:14:51.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-10T00:14:51.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-10T00:14:51.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-10T00:14:51.156 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:14:51.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:14:51.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:14:51.287 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:14:51.287 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:14:51.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:14:51.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-06-10T00:14:51.288 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:14:51.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:14:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:14:51.364 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-10T00:14:51.365 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:14:51.365 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-10T00:14:51.380 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-10T00:14:51.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:14:51.380 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-10T00:14:51.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:14:51.501 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:14:51.557 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:14:51.557 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:14:51.557 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:14:51.557 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:14:51.557 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:14:51.557 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:14:51.557 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:14:51.557 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:14:51.558 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-10T00:14:51.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:51.560 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:14:51.612 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:14:51.612 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-10T00:14:51.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:14:51.679 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:14:51.735 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:14:51.735 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:14:51.735 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:14:51.735 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:14:51.735 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:14:51.736 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-10T00:14:51.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:51.738 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:14:51.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:2024-06-10T00:14:51.752+0000 7fa742d67480 -1 init, newargv = 0x558f74d24960 newargc=15 2024-06-10T00:14:51.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[44858]: starting ceph client 2024-06-10T00:14:51.758 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[44858]: starting fuse 2024-06-10T00:14:51.767 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:14:51.767 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:14:51.768 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.admin")) 2024-06-10T00:14:51.769 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:14:51.885 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.admin.44858.asok 2024-06-10T00:14:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:14:51.896 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44858.asok 2024-06-10T00:14:51.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:51.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44858.asok status 2024-06-10T00:14:52.031 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:14:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "admin", 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "44858", 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4425, 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:14:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 4425 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2095729324 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2095729324 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.4425 192.168.0.1:0/2095729324", 2024-06-10T00:14:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/2095729324", 2024-06-10T00:14:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:14:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 6, 2024-06-10T00:14:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 24, 2024-06-10T00:14:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:14:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:14:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:14:52.034 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:14:52.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:52.040 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:14:52.040 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-10T00:14:52.055 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:14:52.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-10T00:14:52.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:52.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-10T00:14:52.121 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-10T00:14:52.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-10T00:14:52.224 INFO:teuthology.orchestra.run.smithi079.stdout:# file: . 2024-06-10T00:14:52.224 INFO:teuthology.orchestra.run.smithi079.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-10T00:14:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:52.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:14:52.230 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:52.230 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:14:52.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:14:52.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.387+0000 7f8905722640 1 Processor -- start 2024-06-10T00:14:52.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.387+0000 7f8905722640 1 -- start start 2024-06-10T00:14:52.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.387+0000 7f8905722640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89000ae910 0x7f890006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.387+0000 7f8905722640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89000acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f8905722640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f890006d130 con 0x7f890006ea20 2024-06-10T00:14:52.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f8905722640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f890006ee90 con 0x7f89000ae910 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f8905722640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f890006d410 con 0x7f89000cf360 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88feffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89000ae910 0x7f890006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88fe7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f890006ea20 0x7f89000cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56836/0 (socket says 172.21.15.79:56836) 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88feffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89000ae910 0x7f890006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60868/0 (socket says 172.21.15.79:60868) 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88fe7fc640 1 -- 172.21.15.79:0/3615085410 learned_addr learned my addr 172.21.15.79:0/3615085410 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88ff7fe640 1 --2- 172.21.15.79:0/3615085410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89000acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88feffd640 1 -- 172.21.15.79:0/3615085410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 msgr2=0x7f89000acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88feffd640 1 --2- 172.21.15.79:0/3615085410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89000acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88feffd640 1 -- 172.21.15.79:0/3615085410 >> v1:172.21.15.79:6789/0 conn(0x7f890006ea20 legacy=0x7f89000cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88feffd640 1 -- 172.21.15.79:0/3615085410 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890006d6f0 con 0x7f89000ae910 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.388+0000 7f88ff7fe640 1 --2- 172.21.15.79:0/3615085410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89000acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f88feffd640 1 --2- 172.21.15.79:0/3615085410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89000ae910 0x7f890006e4e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88f000ba40 tx=0x7f88f002c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11d65471d565492 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f88fdffb640 1 -- 172.21.15.79:0/3615085410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0031710 con 0x7f89000ae910 2024-06-10T00:14:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f88fdffb640 1 -- 172.21.15.79:0/3615085410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f00318b0 con 0x7f89000ae910 2024-06-10T00:14:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f88fdffb640 1 -- 172.21.15.79:0/3615085410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0031c80 con 0x7f89000ae910 2024-06-10T00:14:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f8905722640 1 -- 172.21.15.79:0/3615085410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89000ae910 msgr2=0x7f890006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f8905722640 1 --2- 172.21.15.79:0/3615085410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89000ae910 0x7f890006e4e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88f000ba40 tx=0x7f88f002c7b0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f8905722640 1 -- 172.21.15.79:0/3615085410 shutdown_connections 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f8905722640 1 --2- 172.21.15.79:0/3615085410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89000acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f8905722640 1 --2- 172.21.15.79:0/3615085410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89000ae910 0x7f890006e4e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f8905722640 1 -- 172.21.15.79:0/3615085410 >> 172.21.15.79:0/3615085410 conn(0x7f89000b19f0 msgr2=0x7f89000b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f8905722640 1 -- 172.21.15.79:0/3615085410 shutdown_connections 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.389+0000 7f8905722640 1 -- 172.21.15.79:0/3615085410 wait complete. 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.391+0000 7f8905722640 1 Processor -- start 2024-06-10T00:14:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.391+0000 7f8905722640 1 -- start start 2024-06-10T00:14:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.391+0000 7f8905722640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890006ea20 0x7f890014be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f8905722640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89000ae910 0x7f890009b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f8905722640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89001f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f8905722640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89000ad280 con 0x7f890006ea20 2024-06-10T00:14:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f8905722640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f89000aecf0 con 0x7f89000ae910 2024-06-10T00:14:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f8905722640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f89000ad400 con 0x7f89000cf360 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890006ea20 0x7f890014be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890006ea20 0x7f890014be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60872/0 (socket says 172.21.15.79:60872) 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 -- 172.21.15.79:0/3594791533 learned_addr learned my addr 172.21.15.79:0/3594791533 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88ff7fe640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89001f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88fe7fc640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89000ae910 0x7f890009b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 -- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 msgr2=0x7f89001f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89001f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 -- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89000ae910 msgr2=0x7f890009b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89000ae910 0x7f890009b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 -- 172.21.15.79:0/3594791533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89001f3b80 con 0x7f890006ea20 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88fe7fc640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89000ae910 0x7f890009b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88ff7fe640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89001f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88feffd640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890006ea20 0x7f890014be30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88f002cda0 tx=0x7f88f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:52.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88e77fe640 1 -- 172.21.15.79:0/3594791533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0033d50 con 0x7f890006ea20 2024-06-10T00:14:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88e77fe640 1 -- 172.21.15.79:0/3594791533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f003e420 con 0x7f890006ea20 2024-06-10T00:14:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f88e77fe640 1 -- 172.21.15.79:0/3594791533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f003e810 con 0x7f890006ea20 2024-06-10T00:14:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890009d400 con 0x7f890006ea20 2024-06-10T00:14:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.392+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8900151060 con 0x7f890006ea20 2024-06-10T00:14:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.393+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8900068430 con 0x7f890006ea20 2024-06-10T00:14:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.394+0000 7f88e77fe640 1 -- 172.21.15.79:0/3594791533 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88f003b040 con 0x7f890006ea20 2024-06-10T00:14:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.394+0000 7f88e77fe640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f88ec06be30 0x7f88ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.395+0000 7f88e77fe640 1 -- 172.21.15.79:0/3594791533 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f88f00ae800 con 0x7f890006ea20 2024-06-10T00:14:52.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.395+0000 7f88fe7fc640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f88ec06be30 0x7f88ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.395+0000 7f88fe7fc640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f88ec06be30 0x7f88ec06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89000cd0e0 tx=0x7f88f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:52.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.399+0000 7f88e77fe640 1 -- 172.21.15.79:0/3594791533 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f89001f3b80 con 0x7f890006ea20 2024-06-10T00:14:52.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.586+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8900072b50 con 0x7f890006ea20 2024-06-10T00:14:52.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.586+0000 7f88e77fe640 1 -- 172.21.15.79:0/3594791533 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f88f0042030 con 0x7f890006ea20 2024-06-10T00:14:52.586 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f88ec06be30 msgr2=0x7f88ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f88ec06be30 0x7f88ec06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89000cd0e0 tx=0x7f88f4009040 comp rx=0 tx=0).stop 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890006ea20 msgr2=0x7f890014be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890006ea20 0x7f890014be30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88f002cda0 tx=0x7f88f00046c0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 shutdown_connections 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f88ec06be30 0x7f88ec06e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89000cf360 0x7f89001f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89000ae910 0x7f890009b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 --2- 172.21.15.79:0/3594791533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890006ea20 0x7f890014be30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 >> 172.21.15.79:0/3594791533 conn(0x7f89000b19f0 msgr2=0x7f89000ad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 shutdown_connections 2024-06-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.588+0000 7f8905722640 1 -- 172.21.15.79:0/3594791533 wait complete. 2024-06-10T00:14:52.598 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:14:52.598 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:14:52.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:14:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.755+0000 7fbe8c5f9640 1 Processor -- start 2024-06-10T00:14:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.755+0000 7fbe8c5f9640 1 -- start start 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.756+0000 7fbe8c5f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe840d2680 0x7fbe8415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.756+0000 7fbe8c5f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840d0ad0 con 0x7fbe840d1fc0 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.756+0000 7fbe8c5f9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8415f890 con 0x7fbe840cef70 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.756+0000 7fbe8c5f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbe840d13e0 con 0x7fbe840d2680 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89b94640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbe840d1fc0 0x7fbe840d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56840/0 (socket says 172.21.15.79:56840) 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89b94640 1 -- 172.21.15.79:0/250596535 learned_addr learned my addr 172.21.15.79:0/250596535 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668078567 0 0) 0x7fbe840d0ad0 con 0x7fbe840d1fc0 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe70003520 con 0x7fbe840d1fc0 2024-06-10T00:14:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe8a395640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe840d2680 0x7fbe8415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4206048574 0 0) 0x7fbe70003520 con 0x7fbe840d1fc0 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe840d2680 msgr2=0x7fbe8415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe840d2680 0x7fbe8415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 >> v1:172.21.15.117:6789/0 conn(0x7fbe840cef70 legacy=0x7fbe840cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe840d0d90 con 0x7fbe840d1fc0 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fbe78001670 con 0x7fbe840d1fc0 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 >> v1:172.21.15.79:6789/0 conn(0x7fbe840d1fc0 legacy=0x7fbe840d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe700039e0 0x7fbe70003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70004800 0x7fbe70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe840d2680 0x7fbe700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe840d13e0 con 0x7fbe70004800 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7000ba70 con 0x7fbe700039e0 2024-06-10T00:14:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7000bc70 con 0x7fbe840d2680 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe89b94640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70004800 0x7fbe70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe8a395640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe700039e0 0x7fbe70003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.757+0000 7fbe8ab96640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe840d2680 0x7fbe700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89b94640 1 -- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe840d2680 msgr2=0x7fbe700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89b94640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe840d2680 0x7fbe700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89b94640 1 -- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe700039e0 msgr2=0x7fbe70003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89b94640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe700039e0 0x7fbe70003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89b94640 1 -- 172.21.15.79:0/250596535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe70003520 con 0x7fbe70004800 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89b94640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70004800 0x7fbe70004c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001eb0 tx=0x7fbe70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4753c17e7a3af9d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78007d30 con 0x7fbe70004800 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe78005af0 con 0x7fbe70004800 2024-06-10T00:14:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.758+0000 7fbe89393640 1 -- 172.21.15.79:0/250596535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78007070 con 0x7fbe70004800 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.759+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/250596535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70004800 msgr2=0x7fbe70004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.759+0000 7fbe8c5f9640 1 --2- 172.21.15.79:0/250596535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70004800 0x7fbe70004c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001eb0 tx=0x7fbe70005830 comp rx=0 tx=0).stop 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.759+0000 7fbe8ab96640 1 -- 172.21.15.79:0/250596535 reap_dead start 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.759+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/250596535 shutdown_connections 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.759+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/250596535 >> 172.21.15.79:0/250596535 conn(0x7fbe8409d3f0 msgr2=0x7fbe840d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.759+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/250596535 shutdown_connections 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.759+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/250596535 wait complete. 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.760+0000 7fbe8c5f9640 1 Processor -- start 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.760+0000 7fbe8c5f9640 1 -- start start 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8c5f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe70004800 0x7fbe840a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8c5f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8409de60 0x7fbe840cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8c5f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84159210 0x7fbe84159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8c5f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe840d4f00 con 0x7fbe8409de60 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8c5f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe840d2400 con 0x7fbe84159210 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8c5f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbe840d1870 con 0x7fbe70004800 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8409de60 0x7fbe840cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8409de60 0x7fbe840cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60894/0 (socket says 172.21.15.79:60894) 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 -- 172.21.15.79:0/2128498635 learned_addr learned my addr 172.21.15.79:0/2128498635 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8ab96640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84159210 0x7fbe84159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8a395640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe70004800 0x7fbe840a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 -- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe70004800 msgr2=0x7fbe840a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe70004800 0x7fbe840a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 -- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84159210 msgr2=0x7fbe84159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84159210 0x7fbe84159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 -- 172.21.15.79:0/2128498635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe840b56f0 con 0x7fbe8409de60 2024-06-10T00:14:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe8a395640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe70004800 0x7fbe840a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.761+0000 7fbe89b94640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8409de60 0x7fbe840cd410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001970 tx=0x7fbe78001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.762+0000 7fbe76ffd640 1 -- 172.21.15.79:0/2128498635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78041030 con 0x7fbe8409de60 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.762+0000 7fbe76ffd640 1 -- 172.21.15.79:0/2128498635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe78038040 con 0x7fbe8409de60 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.762+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8409e4f0 con 0x7fbe8409de60 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.762+0000 7fbe76ffd640 1 -- 172.21.15.79:0/2128498635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78001630 con 0x7fbe8409de60 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.762+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8409eab0 con 0x7fbe8409de60 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.763+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe84068430 con 0x7fbe8409de60 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.763+0000 7fbe76ffd640 1 -- 172.21.15.79:0/2128498635 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe78044070 con 0x7fbe8409de60 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.764+0000 7fbe76ffd640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbe6806be60 0x7fbe6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.764+0000 7fbe76ffd640 1 -- 172.21.15.79:0/2128498635 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbe780aadd0 con 0x7fbe8409de60 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.764+0000 7fbe8a395640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbe6806be60 0x7fbe6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.764+0000 7fbe8a395640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbe6806be60 0x7fbe6806e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009ab0 tx=0x7fbe80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:52.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.768+0000 7fbe76ffd640 1 -- 172.21.15.79:0/2128498635 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbe7803c380 con 0x7fbe8409de60 2024-06-10T00:14:52.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.955+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbe840d04e0 con 0x7fbe8409de60 2024-06-10T00:14:52.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.956+0000 7fbe76ffd640 1 -- 172.21.15.79:0/2128498635 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fbe780ac080 con 0x7fbe8409de60 2024-06-10T00:14:52.955 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbe6806be60 msgr2=0x7fbe6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbe6806be60 0x7fbe6806e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009ab0 tx=0x7fbe80008040 comp rx=0 tx=0).stop 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8409de60 msgr2=0x7fbe840cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8409de60 0x7fbe840cd410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001970 tx=0x7fbe78001a40 comp rx=0 tx=0).stop 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 shutdown_connections 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbe6806be60 0x7fbe6806e320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84159210 0x7fbe84159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8409de60 0x7fbe840cd410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 --2- 172.21.15.79:0/2128498635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe70004800 0x7fbe840a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:52.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 >> 172.21.15.79:0/2128498635 conn(0x7fbe8409d3f0 msgr2=0x7fbe840cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:52.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 shutdown_connections 2024-06-10T00:14:52.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:52.958+0000 7fbe8c5f9640 1 -- 172.21.15.79:0/2128498635 wait complete. 2024-06-10T00:14:52.968 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:14:52.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:52.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-10T00:14:52.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[44858]: fuse finished with error 0 and tester_r 0 2024-06-10T00:14:52.993 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:14:59.094 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:14:59.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:14:59.095 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-10T00:14:59.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.279+0000 7f755255a640 1 Processor -- start 2024-06-10T00:14:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.279+0000 7f755255a640 1 -- start start 2024-06-10T00:14:59.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f755255a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c0af3b0 0x7f754c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f755255a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f754c15ac50 con 0x7f754c15a870 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f755255a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f754c06cdb0 con 0x7f754c0aef70 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f755255a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f754c06d090 con 0x7f754c0af3b0 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f754bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f754c15a870 0x7f754c06de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50562/0 (socket says 172.21.15.79:50562) 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f754bfff640 1 -- 172.21.15.79:0/1541679584 learned_addr learned my addr 172.21.15.79:0/1541679584 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f7550af7640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c0af3b0 0x7f754c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2225377783 0 0) 0x7f754c15ac50 con 0x7f754c15a870 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.280+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7534003520 con 0x7f754c15a870 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2856172097 0 0) 0x7f7534003520 con 0x7f754c15a870 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c0af3b0 msgr2=0x7f754c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c0af3b0 0x7f754c0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 >> v1:172.21.15.117:6789/0 conn(0x7f754c0aef70 legacy=0x7f754c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c06d370 con 0x7f754c15a870 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f753c001670 con 0x7f754c15a870 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 >> v1:172.21.15.79:6789/0 conn(0x7f754c15a870 legacy=0x7f754c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c0af3b0 0x7f75340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f7534004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534004d40 0x7f75340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f754c06d090 con 0x7f7534003f60 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f753400bc00 con 0x7f7534004d40 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f753400e010 con 0x7f754c0af3b0 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754b7fe640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f7534004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754bfff640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c0af3b0 0x7f75340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f7550af7640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534004d40 0x7f75340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754b7fe640 1 -- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c0af3b0 msgr2=0x7f75340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754b7fe640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c0af3b0 0x7f75340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754b7fe640 1 -- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534004d40 msgr2=0x7f75340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754b7fe640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534004d40 0x7f75340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f754b7fe640 1 -- 172.21.15.79:0/1541679584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7534003520 con 0x7f7534003f60 2024-06-10T00:14:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.281+0000 7f7550af7640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534004d40 0x7f75340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.282+0000 7f754b7fe640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f7534004800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7540001750 tx=0x7f7534005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaa978cc0debbd4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.282+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540001370 con 0x7f7534003f60 2024-06-10T00:14:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.282+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75400052d0 con 0x7f7534003f60 2024-06-10T00:14:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.282+0000 7f754affd640 1 -- 172.21.15.79:0/1541679584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754002abe0 con 0x7f7534003f60 2024-06-10T00:14:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.282+0000 7f755255a640 1 -- 172.21.15.79:0/1541679584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 msgr2=0x7f7534004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.282+0000 7f755255a640 1 --2- 172.21.15.79:0/1541679584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f7534004800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7540001750 tx=0x7f7534005830 comp rx=0 tx=0).stop 2024-06-10T00:14:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.282+0000 7f7550af7640 1 -- 172.21.15.79:0/1541679584 reap_dead start 2024-06-10T00:14:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.283+0000 7f755255a640 1 -- 172.21.15.79:0/1541679584 shutdown_connections 2024-06-10T00:14:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.283+0000 7f755255a640 1 -- 172.21.15.79:0/1541679584 >> 172.21.15.79:0/1541679584 conn(0x7f754c0b19f0 msgr2=0x7f754c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.283+0000 7f755255a640 1 -- 172.21.15.79:0/1541679584 shutdown_connections 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.283+0000 7f755255a640 1 -- 172.21.15.79:0/1541679584 wait complete. 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.284+0000 7f755255a640 1 Processor -- start 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.284+0000 7f755255a640 1 -- start start 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f755255a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f754c15d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f755255a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f754c157940 0x7f754c1f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f755255a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c14cd90 0x7f754c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f755255a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f754c0b2e40 con 0x7f7534003f60 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f755255a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f754c06d930 con 0x7f754c157940 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f755255a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f754c0b2fc0 con 0x7f754c14cd90 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f754c15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f754c15d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36416/0 (socket says 172.21.15.79:36416) 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 -- 172.21.15.79:0/453871276 learned_addr learned my addr 172.21.15.79:0/453871276 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754b7fe640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f754c157940 0x7f754c1f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f7550af7640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c14cd90 0x7f754c14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 -- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c14cd90 msgr2=0x7f754c14d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c14cd90 0x7f754c14d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 -- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f754c157940 msgr2=0x7f754c1f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f754c157940 0x7f754c1f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 -- 172.21.15.79:0/453871276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c1f4710 con 0x7f7534003f60 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f7550af7640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c14cd90 0x7f754c14d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754b7fe640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f754c157940 0x7f754c1f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f754bfff640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f754c15d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f753c007320 tx=0x7f753c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f7548ff9640 1 -- 172.21.15.79:0/453871276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c01a070 con 0x7f7534003f60 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f7548ff9640 1 -- 172.21.15.79:0/453871276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753c00f8e0 con 0x7f7534003f60 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f7548ff9640 1 -- 172.21.15.79:0/453871276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c00fcb0 con 0x7f7534003f60 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.285+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c156740 con 0x7f7534003f60 2024-06-10T00:14:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.286+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c157140 con 0x7f7534003f60 2024-06-10T00:14:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.287+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754c0b3e60 con 0x7f7534003f60 2024-06-10T00:14:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.287+0000 7f7548ff9640 1 -- 172.21.15.79:0/453871276 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f753c01d070 con 0x7f7534003f60 2024-06-10T00:14:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.287+0000 7f7548ff9640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f753806be30 0x7f753806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.288+0000 7f7548ff9640 1 -- 172.21.15.79:0/453871276 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f753c08aa10 con 0x7f7534003f60 2024-06-10T00:14:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.288+0000 7f754b7fe640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f753806be30 0x7f753806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.288+0000 7f754b7fe640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f753806be30 0x7f753806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7540032000 tx=0x7f754002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.292+0000 7f7548ff9640 1 -- 172.21.15.79:0/453871276 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f754c0b3e60 con 0x7f7534003f60 2024-06-10T00:14:59.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.465+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f754c068430 con 0x7f7534003f60 2024-06-10T00:14:59.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.466+0000 7f7548ff9640 1 -- 172.21.15.79:0/453871276 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f754c1f4710 con 0x7f7534003f60 2024-06-10T00:14:59.467 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:59.467 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:59.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.468+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f753806be30 msgr2=0x7f753806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f753806be30 0x7f753806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7540032000 tx=0x7f754002e000 comp rx=0 tx=0).stop 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 msgr2=0x7f754c15d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f754c15d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f753c007320 tx=0x7f753c0077e0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 shutdown_connections 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f753806be30 0x7f753806e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754c14cd90 0x7f754c14d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f754c157940 0x7f754c1f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 --2- 172.21.15.79:0/453871276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534003f60 0x7f754c15d350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 >> 172.21.15.79:0/453871276 conn(0x7f754c0b19f0 msgr2=0x7f754c0ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 shutdown_connections 2024-06-10T00:14:59.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.469+0000 7f755255a640 1 -- 172.21.15.79:0/453871276 wait complete. 2024-06-10T00:14:59.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:14:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.579+0000 7f4ba9d63640 1 Processor -- start 2024-06-10T00:14:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.579+0000 7f4ba9d63640 1 -- start start 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba9d63640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ba4158b50 0x7f4ba406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba9d63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba406def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba9d63640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba406e670 con 0x7f4ba4158770 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba9d63640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba406e430 con 0x7f4ba4158b50 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba9d63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba406e950 con 0x7f4ba406cae0 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba2ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ba4158b50 0x7f4ba406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba2ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ba4158b50 0x7f4ba406d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:47916/0 (socket says 172.21.15.79:47916) 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba406def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50200/0 (socket says 172.21.15.79:50200) 2024-06-10T00:14:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba2ffd640 1 -- 172.21.15.79:0/3736792889 learned_addr learned my addr 172.21.15.79:0/3736792889 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba2ffd640 1 -- 172.21.15.79:0/3736792889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 msgr2=0x7f4ba406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba2ffd640 1 --2- 172.21.15.79:0/3736792889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba406def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba2ffd640 1 -- 172.21.15.79:0/3736792889 >> v1:172.21.15.117:6789/0 conn(0x7f4ba4158770 legacy=0x7f4ba406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.580+0000 7f4ba2ffd640 1 -- 172.21.15.79:0/3736792889 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba406ec30 con 0x7f4ba4158b50 2024-06-10T00:14:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.581+0000 7f4ba2ffd640 1 --2- 172.21.15.79:0/3736792889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158b50 0x7f4ba406d9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009870 tx=0x7f4b9802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4d995121e41c5b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.581+0000 7f4ba27fc640 1 -- 172.21.15.79:0/3736792889 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98037070 con 0x7f4ba4158b50 2024-06-10T00:14:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.581+0000 7f4ba27fc640 1 -- 172.21.15.79:0/3736792889 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b98032440 con 0x7f4ba4158b50 2024-06-10T00:14:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.581+0000 7f4ba27fc640 1 -- 172.21.15.79:0/3736792889 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98032810 con 0x7f4ba4158b50 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.582+0000 7f4ba9d63640 1 -- 172.21.15.79:0/3736792889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158b50 msgr2=0x7f4ba406d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.582+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/3736792889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158b50 0x7f4ba406d9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009870 tx=0x7f4b9802a1c0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.582+0000 7f4ba9d63640 1 -- 172.21.15.79:0/3736792889 shutdown_connections 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.582+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/3736792889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.582+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/3736792889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158b50 0x7f4ba406d9b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.582+0000 7f4ba9d63640 1 -- 172.21.15.79:0/3736792889 >> 172.21.15.79:0/3736792889 conn(0x7f4ba4071950 msgr2=0x7f4ba4071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.582+0000 7f4ba9d63640 1 -- 172.21.15.79:0/3736792889 shutdown_connections 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.582+0000 7f4ba9d63640 1 -- 172.21.15.79:0/3736792889 wait complete. 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.583+0000 7f4ba9d63640 1 Processor -- start 2024-06-10T00:14:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.583+0000 7f4ba9d63640 1 -- start start 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba9d63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba4144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba9d63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158770 0x7f4ba40b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba9d63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba4158b50 0x7f4ba41531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba9d63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba40ae630 con 0x7f4ba4158b50 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba9d63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba40ae4b0 con 0x7f4ba4158770 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba9d63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba40aedb0 con 0x7f4ba406cae0 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba4158b50 0x7f4ba41531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba4158b50 0x7f4ba41531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36430/0 (socket says 172.21.15.79:36430) 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba3fff640 1 -- 172.21.15.79:0/2819433035 learned_addr learned my addr 172.21.15.79:0/2819433035 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba2ffd640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158770 0x7f4ba40b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba37fe640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba4144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba3fff640 1 -- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 msgr2=0x7f4ba4144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba3fff640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba4144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba3fff640 1 -- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158770 msgr2=0x7f4ba40b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba3fff640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158770 0x7f4ba40b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba3fff640 1 -- 172.21.15.79:0/2819433035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba4153730 con 0x7f4ba4158b50 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.584+0000 7f4ba37fe640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba4144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.585+0000 7f4ba3fff640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba4158b50 0x7f4ba41531f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009e30 tx=0x7f4b9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.585+0000 7f4b8bfff640 1 -- 172.21.15.79:0/2819433035 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c018020 con 0x7f4ba4158b50 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.585+0000 7f4b8bfff640 1 -- 172.21.15.79:0/2819433035 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9c014480 con 0x7f4ba4158b50 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.585+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba41539d0 con 0x7f4ba4158b50 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.585+0000 7f4b8bfff640 1 -- 172.21.15.79:0/2819433035 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c014870 con 0x7f4ba4158b50 2024-06-10T00:14:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.585+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba4153f90 con 0x7f4ba4158b50 2024-06-10T00:14:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.586+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba4068430 con 0x7f4ba4158b50 2024-06-10T00:14:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.586+0000 7f4b8bfff640 1 -- 172.21.15.79:0/2819433035 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b9c005d10 con 0x7f4ba4158b50 2024-06-10T00:14:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.587+0000 7f4b8bfff640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4b9006be30 0x7f4b9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.587+0000 7f4b8bfff640 1 -- 172.21.15.79:0/2819433035 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b9c08bea0 con 0x7f4ba4158b50 2024-06-10T00:14:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.587+0000 7f4ba37fe640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4b9006be30 0x7f4b9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.587+0000 7f4ba37fe640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4b9006be30 0x7f4b9006e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b94001700 tx=0x7f4b94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.591+0000 7f4b8bfff640 1 -- 172.21.15.79:0/2819433035 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4b9c022030 con 0x7f4ba4158b50 2024-06-10T00:14:59.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.766+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ba4072850 con 0x7f4ba4158b50 2024-06-10T00:14:59.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.767+0000 7f4b8bfff640 1 -- 172.21.15.79:0/2819433035 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f4b9c010040 con 0x7f4ba4158b50 2024-06-10T00:14:59.767 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:14:59.767 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:14:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4b9006be30 msgr2=0x7f4b9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4b9006be30 0x7f4b9006e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b94001700 tx=0x7f4b94009040 comp rx=0 tx=0).stop 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba4158b50 msgr2=0x7f4ba41531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba4158b50 0x7f4ba41531f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009e30 tx=0x7f4b9c00c490 comp rx=0 tx=0).stop 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 shutdown_connections 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4b9006be30 0x7f4b9006e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba4158b50 0x7f4ba41531f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4158770 0x7f4ba40b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 --2- 172.21.15.79:0/2819433035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba406cae0 0x7f4ba4144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 >> 172.21.15.79:0/2819433035 conn(0x7f4ba4071950 msgr2=0x7f4ba40b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 shutdown_connections 2024-06-10T00:14:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.769+0000 7f4ba9d63640 1 -- 172.21.15.79:0/2819433035 wait complete. 2024-06-10T00:14:59.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-10T00:14:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.882+0000 7f2bc99a9640 1 Processor -- start 2024-06-10T00:14:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.882+0000 7f2bc99a9640 1 -- start start 2024-06-10T00:14:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc99a9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2bc40d08f0 0x7f2bc40b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc99a9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bc40cf360 0x7f2bc40d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc99a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc40cf8a0 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc99a9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc40d1c80 con 0x7f2bc40d08f0 2024-06-10T00:14:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc99a9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc40cfb80 con 0x7f2bc40cf360 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2bc40d08f0 0x7f2bc40b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2bc40d08f0 0x7f2bc40b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36432/0 (socket says 172.21.15.79:36432) 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc2ffd640 1 -- 172.21.15.79:0/4229420805 learned_addr learned my addr 172.21.15.79:0/4229420805 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc37fe640 1 --2- 172.21.15.79:0/4229420805 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40cf360 0x7f2bc40d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc2ffd640 1 -- 172.21.15.79:0/4229420805 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40cf360 msgr2=0x7f2bc40d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc2ffd640 1 --2- 172.21.15.79:0/4229420805 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40cf360 0x7f2bc40d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc2ffd640 1 -- 172.21.15.79:0/4229420805 >> v1:172.21.15.117:6789/0 conn(0x7f2bc40d0cd0 legacy=0x7f2bc40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.883+0000 7f2bc2ffd640 1 -- 172.21.15.79:0/4229420805 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc40cfe60 con 0x7f2bc40d08f0 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc2ffd640 1 --2- 172.21.15.79:0/4229420805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d08f0 0x7f2bc40b3800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009870 tx=0x7f2bb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f55e4a202f703d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc27fc640 1 -- 172.21.15.79:0/4229420805 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4037070 con 0x7f2bc40d08f0 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc27fc640 1 -- 172.21.15.79:0/4229420805 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb4032440 con 0x7f2bc40d08f0 2024-06-10T00:14:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc27fc640 1 -- 172.21.15.79:0/4229420805 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4032810 con 0x7f2bc40d08f0 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc99a9640 1 -- 172.21.15.79:0/4229420805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d08f0 msgr2=0x7f2bc40b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/4229420805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d08f0 0x7f2bc40b3800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009870 tx=0x7f2bb402a270 comp rx=0 tx=0).stop 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc99a9640 1 -- 172.21.15.79:0/4229420805 shutdown_connections 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/4229420805 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40cf360 0x7f2bc40d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/4229420805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d08f0 0x7f2bc40b3800 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc99a9640 1 -- 172.21.15.79:0/4229420805 >> 172.21.15.79:0/4229420805 conn(0x7f2bc409d3c0 msgr2=0x7f2bc40d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.884+0000 7f2bc99a9640 1 -- 172.21.15.79:0/4229420805 shutdown_connections 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.885+0000 7f2bc99a9640 1 -- 172.21.15.79:0/4229420805 wait complete. 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.886+0000 7f2bc99a9640 1 Processor -- start 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.886+0000 7f2bc99a9640 1 -- start start 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.886+0000 7f2bc99a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40cf360 0x7f2bc4160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.886+0000 7f2bc99a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40d08f0 0x7f2bc414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.886+0000 7f2bc99a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d0cd0 0x7f2bc415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.886+0000 7f2bc99a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc40d1180 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.886+0000 7f2bc99a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc40b50c0 con 0x7f2bc40d08f0 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.886+0000 7f2bc99a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc40b4a60 con 0x7f2bc40cf360 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d0cd0 0x7f2bc415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d0cd0 0x7f2bc415f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36442/0 (socket says 172.21.15.79:36442) 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 -- 172.21.15.79:0/2733667770 learned_addr learned my addr 172.21.15.79:0/2733667770 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc2ffd640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40cf360 0x7f2bc4160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bba7fc640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40d08f0 0x7f2bc414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 -- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40cf360 msgr2=0x7f2bc4160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40cf360 0x7f2bc4160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 -- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40d08f0 msgr2=0x7f2bc414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40d08f0 0x7f2bc414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 -- 172.21.15.79:0/2733667770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc40b7010 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc2ffd640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40cf360 0x7f2bc4160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bba7fc640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40d08f0 0x7f2bc414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc37fe640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d0cd0 0x7f2bc415f1b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc007e40 tx=0x7f2bbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc0ff9640 1 -- 172.21.15.79:0/2733667770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc014620 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc0ff9640 1 -- 172.21.15.79:0/2733667770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc019070 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc0ff9640 1 -- 172.21.15.79:0/2733667770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc014a20 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc40b72f0 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.887+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc40b78b0 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.888+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc40683c0 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.889+0000 7f2bc0ff9640 1 -- 172.21.15.79:0/2733667770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bbc014bc0 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.889+0000 7f2bc0ff9640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba406be60 0x7f2ba406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:14:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.889+0000 7f2bc0ff9640 1 -- 172.21.15.79:0/2733667770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2bbc08ba60 con 0x7f2bc40d0cd0 2024-06-10T00:14:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.889+0000 7f2bc2ffd640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba406be60 0x7f2ba406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:14:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.890+0000 7f2bc2ffd640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba406be60 0x7f2ba406e320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4034000 tx=0x7f2bb402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:14:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:14:59.894+0000 7f2bc0ff9640 1 -- 172.21.15.79:0/2733667770 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2bbc05a0d0 con 0x7f2bc40d0cd0 2024-06-10T00:15:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.104+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2bc40d1730 con 0x7f2bc40d0cd0 2024-06-10T00:15:00.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.925+0000 7f2bc0ff9640 1 -- 172.21.15.79:0/2733667770 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f2bbc0599d0 con 0x7f2bc40d0cd0 2024-06-10T00:15:00.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba406be60 msgr2=0x7f2ba406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba406be60 0x7f2ba406e320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4034000 tx=0x7f2bb402e000 comp rx=0 tx=0).stop 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d0cd0 msgr2=0x7f2bc415f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d0cd0 0x7f2bc415f1b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc007e40 tx=0x7f2bbc00e4b0 comp rx=0 tx=0).stop 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 shutdown_connections 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba406be60 0x7f2ba406e320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bc40d0cd0 0x7f2bc415f1b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40d08f0 0x7f2bc414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 --2- 172.21.15.79:0/2733667770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40cf360 0x7f2bc4160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 >> 172.21.15.79:0/2733667770 conn(0x7f2bc409d3c0 msgr2=0x7f2bc4157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 shutdown_connections 2024-06-10T00:15:00.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:00.928+0000 7f2bc99a9640 1 -- 172.21.15.79:0/2733667770 wait complete. 2024-06-10T00:15:00.941 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-06-10T00:15:00.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-10T00:15:01.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.050+0000 7f28e22f5640 1 Processor -- start 2024-06-10T00:15:01.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.050+0000 7f28e22f5640 1 -- start start 2024-06-10T00:15:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28e22f5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28dc155320 0x7f28dc0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28e22f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28dc155700 con 0x7f28dc0d0730 2024-06-10T00:15:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28e22f5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28dc15b6b0 con 0x7f28dc0b34e0 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28e22f5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc15b990 con 0x7f28dc155320 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28e0892640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f28dc0d0730 0x7f28dc06e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50578/0 (socket says 172.21.15.79:50578) 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28e0892640 1 -- 172.21.15.79:0/3759208615 learned_addr learned my addr 172.21.15.79:0/3759208615 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28dbfff640 1 --2- 172.21.15.79:0/3759208615 >> v2:172.21.15.117:3300/0 conn(0x7f28dc155320 0x7f28dc0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444717810 0 0) 0x7f28dc155700 con 0x7f28dc0d0730 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.051+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28c4003520 con 0x7f28dc0d0730 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2619895514 0 0) 0x7f28c4003520 con 0x7f28dc0d0730 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 >> v2:172.21.15.117:3300/0 conn(0x7f28dc155320 msgr2=0x7f28dc0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 --2- 172.21.15.79:0/3759208615 >> v2:172.21.15.117:3300/0 conn(0x7f28dc155320 0x7f28dc0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 >> v1:172.21.15.117:6789/0 conn(0x7f28dc0b34e0 legacy=0x7f28dc0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc15bc70 con 0x7f28dc0d0730 2024-06-10T00:15:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28dbfff640 1 --2- 172.21.15.79:0/3759208615 >> v2:172.21.15.117:3300/0 conn(0x7f28dc155320 0x7f28dc0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f28d40019f0 con 0x7f28dc0d0730 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 >> v1:172.21.15.79:6789/0 conn(0x7f28dc0d0730 legacy=0x7f28dc06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c40039b0 0x7f28c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c4004800 0x7f28c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c40051c0 0x7f28c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc15b990 con 0x7f28c40039b0 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28c400c060 con 0x7f28c40051c0 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28c400c260 con 0x7f28c4004800 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28dbfff640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c40039b0 0x7f28c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28db7fe640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c4004800 0x7f28c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28e0892640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c40051c0 0x7f28c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28dbfff640 1 -- 172.21.15.79:0/3759208615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c4004800 msgr2=0x7f28c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28dbfff640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c4004800 0x7f28c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28dbfff640 1 -- 172.21.15.79:0/3759208615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c40051c0 msgr2=0x7f28c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28dbfff640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c40051c0 0x7f28c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28e0892640 1 -- 172.21.15.79:0/3759208615 reap_dead start 2024-06-10T00:15:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.052+0000 7f28dbfff640 1 -- 172.21.15.79:0/3759208615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c4003520 con 0x7f28c40039b0 2024-06-10T00:15:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28dbfff640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c40039b0 0x7f28c4003dd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009c90 tx=0x7f28c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a5c3e6812bf71f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc036070 con 0x7f28c40039b0 2024-06-10T00:15:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28cc031400 con 0x7f28c40039b0 2024-06-10T00:15:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28daffd640 1 -- 172.21.15.79:0/3759208615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc009860 con 0x7f28c40039b0 2024-06-10T00:15:01.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28e22f5640 1 -- 172.21.15.79:0/3759208615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c40039b0 msgr2=0x7f28c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:01.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28e22f5640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c40039b0 0x7f28c4003dd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009c90 tx=0x7f28c4005830 comp rx=0 tx=0).stop 2024-06-10T00:15:01.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28e22f5640 1 -- 172.21.15.79:0/3759208615 shutdown_connections 2024-06-10T00:15:01.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28e22f5640 1 --2- 172.21.15.79:0/3759208615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c40039b0 0x7f28c4003dd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.053+0000 7f28e22f5640 1 -- 172.21.15.79:0/3759208615 >> 172.21.15.79:0/3759208615 conn(0x7f28dc0b1d10 msgr2=0x7f28dc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:01.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.054+0000 7f28e22f5640 1 -- 172.21.15.79:0/3759208615 shutdown_connections 2024-06-10T00:15:01.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.054+0000 7f28e22f5640 1 -- 172.21.15.79:0/3759208615 wait complete. 2024-06-10T00:15:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.055+0000 7f28e22f5640 1 Processor -- start 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.055+0000 7f28e22f5640 1 -- start start 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28e22f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40039b0 0x7f28dc1f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28e22f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc0cee90 0x7f28dc09cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28e22f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1ee7a0 0x7f28dc1eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28e22f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc15b470 con 0x7f28dc0cee90 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28e22f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc15b2f0 con 0x7f28dc1ee7a0 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28e22f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc0b2fa0 con 0x7f28c40039b0 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc0cee90 0x7f28dc09cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc0cee90 0x7f28dc09cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36460/0 (socket says 172.21.15.79:36460) 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 -- 172.21.15.79:0/3678635913 learned_addr learned my addr 172.21.15.79:0/3678635913 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 -- 172.21.15.79:0/3678635913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40039b0 msgr2=0x7f28dc1f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40039b0 0x7f28dc1f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 -- 172.21.15.79:0/3678635913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1ee7a0 msgr2=0x7f28dc1eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1ee7a0 0x7f28dc1eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 -- 172.21.15.79:0/3678635913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc1f5050 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28db7fe640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc0cee90 0x7f28dc09cef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28d000e550 tx=0x7f28d000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28d8ff9640 1 -- 172.21.15.79:0/3678635913 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d00052e0 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28d8ff9640 1 -- 172.21.15.79:0/3678635913 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d0018070 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28dc1f52f0 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28d8ff9640 1 -- 172.21.15.79:0/3678635913 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0003810 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.056+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28dc1f58b0 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.057+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28dc0683c0 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.058+0000 7f28d8ff9640 1 -- 172.21.15.79:0/3678635913 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28d00039b0 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.058+0000 7f28d8ff9640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be60 0x7f28c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.058+0000 7f28dbfff640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be60 0x7f28c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.058+0000 7f28d8ff9640 1 -- 172.21.15.79:0/3678635913 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f28d008ae00 con 0x7f28dc0cee90 2024-06-10T00:15:01.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.059+0000 7f28dbfff640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be60 0x7f28c806e320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28cc033000 tx=0x7f28cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:01.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.063+0000 7f28d8ff9640 1 -- 172.21.15.79:0/3678635913 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f28d0059470 con 0x7f28dc0cee90 2024-06-10T00:15:01.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.279+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f28dc155700 con 0x7f28dc0cee90 2024-06-10T00:15:01.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.933+0000 7f28d8ff9640 1 -- 172.21.15.79:0/3678635913 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f28d0058d70 con 0x7f28dc0cee90 2024-06-10T00:15:01.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.935+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be60 msgr2=0x7f28c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:01.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.935+0000 7f28e22f5640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be60 0x7f28c806e320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28cc033000 tx=0x7f28cc02e000 comp rx=0 tx=0).stop 2024-06-10T00:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.935+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc0cee90 msgr2=0x7f28dc09cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.935+0000 7f28e22f5640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc0cee90 0x7f28dc09cef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28d000e550 tx=0x7f28d000ea10 comp rx=0 tx=0).stop 2024-06-10T00:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.936+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 shutdown_connections 2024-06-10T00:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.936+0000 7f28e22f5640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be60 0x7f28c806e320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.936+0000 7f28e22f5640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1ee7a0 0x7f28dc1eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.936+0000 7f28e22f5640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc0cee90 0x7f28dc09cef0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.936+0000 7f28e22f5640 1 --2- 172.21.15.79:0/3678635913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40039b0 0x7f28dc1f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.936+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 >> 172.21.15.79:0/3678635913 conn(0x7f28dc0b1d10 msgr2=0x7f28dc157930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.936+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 shutdown_connections 2024-06-10T00:15:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:01.936+0000 7f28e22f5640 1 -- 172.21.15.79:0/3678635913 wait complete. 2024-06-10T00:15:01.950 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-10T00:15:01.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.056+0000 7f7acd914640 1 Processor -- start 2024-06-10T00:15:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.056+0000 7f7acd914640 1 -- start start 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.056+0000 7f7acd914640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ac8161a30 0x7f7ac80d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.056+0000 7f7acd914640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ac806d050 0x7f7ac8162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.056+0000 7f7acd914640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac8162ca0 con 0x7f7ac8162190 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.056+0000 7f7acd914640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac806db10 con 0x7f7ac8161a30 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.056+0000 7f7acd914640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac80d0570 con 0x7f7ac806d050 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.056+0000 7f7abffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ac8161a30 0x7f7ac80d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.057+0000 7f7abffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ac8161a30 0x7f7ac80d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36462/0 (socket says 172.21.15.79:36462) 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.057+0000 7f7abffff640 1 -- 172.21.15.79:0/3042301586 learned_addr learned my addr 172.21.15.79:0/3042301586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.057+0000 7f7abffff640 1 -- 172.21.15.79:0/3042301586 >> v2:172.21.15.117:3300/0 conn(0x7f7ac806d050 msgr2=0x7f7ac8162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.057+0000 7f7ac77fe640 1 --2- 172.21.15.79:0/3042301586 >> v2:172.21.15.117:3300/0 conn(0x7f7ac806d050 0x7f7ac8162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.057+0000 7f7abffff640 1 --2- 172.21.15.79:0/3042301586 >> v2:172.21.15.117:3300/0 conn(0x7f7ac806d050 0x7f7ac8162570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.057+0000 7f7abffff640 1 -- 172.21.15.79:0/3042301586 >> v1:172.21.15.117:6789/0 conn(0x7f7ac8162190 legacy=0x7f7ac8161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.057+0000 7f7abffff640 1 -- 172.21.15.79:0/3042301586 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac806dd60 con 0x7f7ac8161a30 2024-06-10T00:15:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.057+0000 7f7abffff640 1 --2- 172.21.15.79:0/3042301586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac8161a30 0x7f7ac80d1c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80ce820 tx=0x7f7ab002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce25e94efd86502 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7ac67fc640 1 -- 172.21.15.79:0/3042301586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0037070 con 0x7f7ac8161a30 2024-06-10T00:15:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7ac67fc640 1 -- 172.21.15.79:0/3042301586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab0032440 con 0x7f7ac8161a30 2024-06-10T00:15:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7ac67fc640 1 -- 172.21.15.79:0/3042301586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0032810 con 0x7f7ac8161a30 2024-06-10T00:15:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7acd914640 1 -- 172.21.15.79:0/3042301586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac8161a30 msgr2=0x7f7ac80d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7acd914640 1 --2- 172.21.15.79:0/3042301586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac8161a30 0x7f7ac80d1c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80ce820 tx=0x7f7ab002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7acd914640 1 -- 172.21.15.79:0/3042301586 shutdown_connections 2024-06-10T00:15:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7acd914640 1 --2- 172.21.15.79:0/3042301586 >> v2:172.21.15.117:3300/0 conn(0x7f7ac806d050 0x7f7ac8162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7acd914640 1 --2- 172.21.15.79:0/3042301586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac8161a30 0x7f7ac80d1c80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7acd914640 1 -- 172.21.15.79:0/3042301586 >> 172.21.15.79:0/3042301586 conn(0x7f7ac809d3c0 msgr2=0x7f7ac80d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7acd914640 1 -- 172.21.15.79:0/3042301586 shutdown_connections 2024-06-10T00:15:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.058+0000 7f7acd914640 1 -- 172.21.15.79:0/3042301586 wait complete. 2024-06-10T00:15:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.059+0000 7f7acd914640 1 Processor -- start 2024-06-10T00:15:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.059+0000 7f7acd914640 1 -- start start 2024-06-10T00:15:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7acd914640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac806d050 0x7f7ac80cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7acd914640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac8161a30 0x7f7ac815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7acd914640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ac8162190 0x7f7ac80cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7acd914640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80d2d50 con 0x7f7ac806d050 2024-06-10T00:15:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7acd914640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80cf560 con 0x7f7ac8162190 2024-06-10T00:15:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7acd914640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac80ccc00 con 0x7f7ac8161a30 2024-06-10T00:15:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7ac6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac806d050 0x7f7ac80cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7ac6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac806d050 0x7f7ac80cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36466/0 (socket says 172.21.15.79:36466) 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7ac6ffd640 1 -- 172.21.15.79:0/3945302465 learned_addr learned my addr 172.21.15.79:0/3945302465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7ac77fe640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ac8162190 0x7f7ac80cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.060+0000 7f7abffff640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac8161a30 0x7f7ac815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac6ffd640 1 -- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac8161a30 msgr2=0x7f7ac815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac6ffd640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac8161a30 0x7f7ac815bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac6ffd640 1 -- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ac8162190 msgr2=0x7f7ac80cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac6ffd640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ac8162190 0x7f7ac80cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac6ffd640 1 -- 172.21.15.79:0/3945302465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac80ccee0 con 0x7f7ac806d050 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac77fe640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ac8162190 0x7f7ac80cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac6ffd640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac806d050 0x7f7ac80cdca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800b3f0 tx=0x7f7ab800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac4ff9640 1 -- 172.21.15.79:0/3945302465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8015020 con 0x7f7ac806d050 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac4ff9640 1 -- 172.21.15.79:0/3945302465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab8011830 con 0x7f7ac806d050 2024-06-10T00:15:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac80cd1c0 con 0x7f7ac806d050 2024-06-10T00:15:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7ac4ff9640 1 -- 172.21.15.79:0/3945302465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8011c20 con 0x7f7ac806d050 2024-06-10T00:15:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.061+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac80cd780 con 0x7f7ac806d050 2024-06-10T00:15:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.062+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac815c3c0 con 0x7f7ac806d050 2024-06-10T00:15:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.062+0000 7f7ac4ff9640 1 -- 172.21.15.79:0/3945302465 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ab8018020 con 0x7f7ac806d050 2024-06-10T00:15:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.063+0000 7f7ac4ff9640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7aa806be30 0x7f7aa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.063+0000 7f7abffff640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7aa806be30 0x7f7aa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.063+0000 7f7ac4ff9640 1 -- 172.21.15.79:0/3945302465 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7ab808b090 con 0x7f7ac806d050 2024-06-10T00:15:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.063+0000 7f7abffff640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7aa806be30 0x7f7aa806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0034000 tx=0x7f7ab002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.067+0000 7f7ac4ff9640 1 -- 172.21.15.79:0/3945302465 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7ab801f020 con 0x7f7ac806d050 2024-06-10T00:15:02.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.278+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ac8068ad0 con 0x7f7ac806d050 2024-06-10T00:15:02.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.279+0000 7f7ac4ff9640 1 -- 172.21.15.79:0/3945302465 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7f7ab80172c0 con 0x7f7ac806d050 2024-06-10T00:15:02.282 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:02.282 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:15:01.280562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:15:02.284 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-06-10T00:15:02.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7aa806be30 msgr2=0x7f7aa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7aa806be30 0x7f7aa806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0034000 tx=0x7f7ab002e000 comp rx=0 tx=0).stop 2024-06-10T00:15:02.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac806d050 msgr2=0x7f7ac80cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac806d050 0x7f7ac80cdca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800b3f0 tx=0x7f7ab800b8b0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 shutdown_connections 2024-06-10T00:15:02.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7aa806be30 0x7f7aa806e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ac8162190 0x7f7ac80cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac8161a30 0x7f7ac815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 --2- 172.21.15.79:0/3945302465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac806d050 0x7f7ac80cdca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 >> 172.21.15.79:0/3945302465 conn(0x7f7ac809d3c0 msgr2=0x7f7ac80d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:02.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 shutdown_connections 2024-06-10T00:15:02.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.281+0000 7f7acd914640 1 -- 172.21.15.79:0/3945302465 wait complete. 2024-06-10T00:15:02.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:02.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.392+0000 7f619386b640 1 Processor -- start 2024-06-10T00:15:02.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.392+0000 7f619386b640 1 -- start start 2024-06-10T00:15:02.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f619386b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f618c0cd230 0x7f618c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f619386b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f618c0cec50 0x7f618c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f619386b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c0b3420 con 0x7f618c1553c0 2024-06-10T00:15:02.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f619386b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f618c0cc750 con 0x7f618c0cec50 2024-06-10T00:15:02.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f619386b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f618c0cca30 con 0x7f618c0cd230 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f6191e08640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f618c0cec50 0x7f618c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f6191607640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f618c1553c0 0x7f618c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50590/0 (socket says 172.21.15.79:50590) 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f6191607640 1 -- 172.21.15.79:0/3293967698 learned_addr learned my addr 172.21.15.79:0/3293967698 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.393+0000 7f6190e06640 1 --2- 172.21.15.79:0/3293967698 >> v2:172.21.15.117:3300/0 conn(0x7f618c0cd230 0x7f618c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f6191e08640 1 -- 172.21.15.79:0/3293967698 >> v2:172.21.15.117:3300/0 conn(0x7f618c0cd230 msgr2=0x7f618c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f6191e08640 1 --2- 172.21.15.79:0/3293967698 >> v2:172.21.15.117:3300/0 conn(0x7f618c0cd230 0x7f618c0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f6191e08640 1 -- 172.21.15.79:0/3293967698 >> v1:172.21.15.79:6789/0 conn(0x7f618c1553c0 legacy=0x7f618c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f6191e08640 1 -- 172.21.15.79:0/3293967698 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0ccd10 con 0x7f618c0cec50 2024-06-10T00:15:02.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f618bfff640 1 -- 172.21.15.79:0/3293967698 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514232162 0 0) 0x7f618c0b3420 con 0x7f618c1553c0 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f6191e08640 1 --2- 172.21.15.79:0/3293967698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cec50 0x7f618c0cf0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f618c075150 tx=0x7f618402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd521ff34019a646 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f618bfff640 1 -- 172.21.15.79:0/3293967698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184037070 con 0x7f618c0cec50 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f618bfff640 1 -- 172.21.15.79:0/3293967698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6184032440 con 0x7f618c0cec50 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.394+0000 7f618bfff640 1 -- 172.21.15.79:0/3293967698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184032810 con 0x7f618c0cec50 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.395+0000 7f619386b640 1 -- 172.21.15.79:0/3293967698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cec50 msgr2=0x7f618c0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.395+0000 7f619386b640 1 --2- 172.21.15.79:0/3293967698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cec50 0x7f618c0cf0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f618c075150 tx=0x7f618402a1a0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.395+0000 7f619386b640 1 -- 172.21.15.79:0/3293967698 shutdown_connections 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.395+0000 7f619386b640 1 --2- 172.21.15.79:0/3293967698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cec50 0x7f618c0cf0e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.395+0000 7f619386b640 1 --2- 172.21.15.79:0/3293967698 >> v2:172.21.15.117:3300/0 conn(0x7f618c0cd230 0x7f618c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.395+0000 7f619386b640 1 -- 172.21.15.79:0/3293967698 >> 172.21.15.79:0/3293967698 conn(0x7f618c0b19f0 msgr2=0x7f618c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.395+0000 7f619386b640 1 -- 172.21.15.79:0/3293967698 shutdown_connections 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.395+0000 7f619386b640 1 -- 172.21.15.79:0/3293967698 wait complete. 2024-06-10T00:15:02.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.396+0000 7f619386b640 1 Processor -- start 2024-06-10T00:15:02.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.396+0000 7f619386b640 1 -- start start 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f619386b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cd230 0x7f618c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f619386b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618c0cec50 0x7f618c166380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f619386b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f618c1553c0 0x7f618c0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f619386b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f618c155920 con 0x7f618c0cd230 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f619386b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f618c1557a0 con 0x7f618c1553c0 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f619386b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f618c071030 con 0x7f618c0cec50 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cd230 0x7f618c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cd230 0x7f618c15beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36484/0 (socket says 172.21.15.79:36484) 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 -- 172.21.15.79:0/3083063604 learned_addr learned my addr 172.21.15.79:0/3083063604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 -- 172.21.15.79:0/3083063604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618c0cec50 msgr2=0x7f618c166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618c0cec50 0x7f618c166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 -- 172.21.15.79:0/3083063604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f618c1553c0 msgr2=0x7f618c0b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f618c1553c0 0x7f618c0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 -- 172.21.15.79:0/3083063604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c15f0c0 con 0x7f618c0cd230 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.397+0000 7f6191607640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cd230 0x7f618c15beb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c7f0 tx=0x7f617c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.398+0000 7f6189ffb640 1 -- 172.21.15.79:0/3083063604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c018070 con 0x7f618c0cd230 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.398+0000 7f6189ffb640 1 -- 172.21.15.79:0/3083063604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c00a640 con 0x7f618c0cd230 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.398+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c15eb00 con 0x7f618c0cd230 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.398+0000 7f6189ffb640 1 -- 172.21.15.79:0/3083063604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c00aa30 con 0x7f618c0cd230 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.398+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c09ad90 con 0x7f618c0cd230 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.399+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c068430 con 0x7f618c0cd230 2024-06-10T00:15:02.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.399+0000 7f6189ffb640 1 -- 172.21.15.79:0/3083063604 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f617c01b070 con 0x7f618c0cd230 2024-06-10T00:15:02.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.400+0000 7f6189ffb640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f617806be30 0x7f617806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.400+0000 7f6189ffb640 1 -- 172.21.15.79:0/3083063604 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f617c08a7a0 con 0x7f618c0cd230 2024-06-10T00:15:02.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.400+0000 7f6190e06640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f617806be30 0x7f617806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.400+0000 7f6190e06640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f617806be30 0x7f617806e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f618c0ae140 tx=0x7f6180008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.404+0000 7f6189ffb640 1 -- 172.21.15.79:0/3083063604 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f617c058e10 con 0x7f618c0cd230 2024-06-10T00:15:02.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.578+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f618c15c3f0 con 0x7f618c0cd230 2024-06-10T00:15:02.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.579+0000 7f6189ffb640 1 -- 172.21.15.79:0/3083063604 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f617c058710 con 0x7f618c0cd230 2024-06-10T00:15:02.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:02.580 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:02.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.581+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f617806be30 msgr2=0x7f617806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.581+0000 7f619386b640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f617806be30 0x7f617806e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f618c0ae140 tx=0x7f6180008040 comp rx=0 tx=0).stop 2024-06-10T00:15:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.581+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cd230 msgr2=0x7f618c15beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.581+0000 7f619386b640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cd230 0x7f618c15beb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c7f0 tx=0x7f617c00ccb0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.582+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 shutdown_connections 2024-06-10T00:15:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.582+0000 7f619386b640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f617806be30 0x7f617806e2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.582+0000 7f619386b640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f618c1553c0 0x7f618c0b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.582+0000 7f619386b640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618c0cec50 0x7f618c166380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.582+0000 7f619386b640 1 --2- 172.21.15.79:0/3083063604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f618c0cd230 0x7f618c15beb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.582+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 >> 172.21.15.79:0/3083063604 conn(0x7f618c0b19f0 msgr2=0x7f618c15ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.582+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 shutdown_connections 2024-06-10T00:15:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.582+0000 7f619386b640 1 -- 172.21.15.79:0/3083063604 wait complete. 2024-06-10T00:15:02.597 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:15:02.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.698+0000 7f5fd7a9e640 1 Processor -- start 2024-06-10T00:15:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.698+0000 7f5fd7a9e640 1 -- start start 2024-06-10T00:15:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd7a9e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fd00d2680 0x7f5fd015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd7a9e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5fd00d1fc0 0x7f5fd00d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd7a9e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd00d2fa0 con 0x7f5fd0161fa0 2024-06-10T00:15:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd7a9e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd00cff80 con 0x7f5fd00d1fc0 2024-06-10T00:15:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd7a9e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd00d13e0 con 0x7f5fd00d2680 2024-06-10T00:15:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd5039640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5fd00d1fc0 0x7f5fd00d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd5039640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5fd00d1fc0 0x7f5fd00d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36492/0 (socket says 172.21.15.79:36492) 2024-06-10T00:15:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd5039640 1 -- 172.21.15.79:0/2326467349 learned_addr learned my addr 172.21.15.79:0/2326467349 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd583a640 1 --2- 172.21.15.79:0/2326467349 >> v2:172.21.15.117:3300/0 conn(0x7f5fd00d2680 0x7f5fd015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd5039640 1 -- 172.21.15.79:0/2326467349 >> v2:172.21.15.117:3300/0 conn(0x7f5fd00d2680 msgr2=0x7f5fd015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd5039640 1 --2- 172.21.15.79:0/2326467349 >> v2:172.21.15.117:3300/0 conn(0x7f5fd00d2680 0x7f5fd015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd5039640 1 -- 172.21.15.79:0/2326467349 >> v1:172.21.15.117:6789/0 conn(0x7f5fd0161fa0 legacy=0x7f5fd01623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.699+0000 7f5fd5039640 1 -- 172.21.15.79:0/2326467349 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd00d0ad0 con 0x7f5fd00d1fc0 2024-06-10T00:15:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.700+0000 7f5fd5039640 1 --2- 172.21.15.79:0/2326467349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d1fc0 0x7f5fd00d2a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5fd008ca40 tx=0x7f5fc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1dd1e01f0492abf server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.700+0000 7f5fd4838640 1 -- 172.21.15.79:0/2326467349 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0037070 con 0x7f5fd00d1fc0 2024-06-10T00:15:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.700+0000 7f5fd4838640 1 -- 172.21.15.79:0/2326467349 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc0032440 con 0x7f5fd00d1fc0 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.700+0000 7f5fd4838640 1 -- 172.21.15.79:0/2326467349 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0032810 con 0x7f5fd00d1fc0 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.701+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/2326467349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d1fc0 msgr2=0x7f5fd00d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.701+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/2326467349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d1fc0 0x7f5fd00d2a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5fd008ca40 tx=0x7f5fc002a270 comp rx=0 tx=0).stop 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.701+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/2326467349 shutdown_connections 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.701+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/2326467349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d1fc0 0x7f5fd00d2a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.701+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/2326467349 >> v2:172.21.15.117:3300/0 conn(0x7f5fd00d2680 0x7f5fd015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.701+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/2326467349 >> 172.21.15.79:0/2326467349 conn(0x7f5fd009d3f0 msgr2=0x7f5fd00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.701+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/2326467349 shutdown_connections 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.701+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/2326467349 wait complete. 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.702+0000 7f5fd7a9e640 1 Processor -- start 2024-06-10T00:15:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.702+0000 7f5fd7a9e640 1 -- start start 2024-06-10T00:15:02.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd7a9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd00d1fc0 0x7f5fd00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd7a9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d2680 0x7f5fd00cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd7a9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd0161fa0 0x7f5fd00c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd7a9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd00d1070 con 0x7f5fd00d2680 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd7a9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd00d0d90 con 0x7f5fd00d1fc0 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd7a9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd00d2400 con 0x7f5fd0161fa0 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d2680 0x7f5fd00cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d2680 0x7f5fd00cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36494/0 (socket says 172.21.15.79:36494) 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 -- 172.21.15.79:0/3329789033 learned_addr learned my addr 172.21.15.79:0/3329789033 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd583a640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd00d1fc0 0x7f5fd00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd603b640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd0161fa0 0x7f5fd00c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 -- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd0161fa0 msgr2=0x7f5fd00c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd0161fa0 0x7f5fd00c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 -- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd00d1fc0 msgr2=0x7f5fd00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd00d1fc0 0x7f5fd00cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 -- 172.21.15.79:0/3329789033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd00ce020 con 0x7f5fd00d2680 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd583a640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd00d1fc0 0x7f5fd00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd5039640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d2680 0x7f5fd00cb190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5fc002a2b0 tx=0x7f5fc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fc67fc640 1 -- 172.21.15.79:0/3329789033 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0037040 con 0x7f5fd00d2680 2024-06-10T00:15:02.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fc67fc640 1 -- 172.21.15.79:0/3329789033 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc0042070 con 0x7f5fd00d2680 2024-06-10T00:15:02.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fc67fc640 1 -- 172.21.15.79:0/3329789033 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0030880 con 0x7f5fd00d2680 2024-06-10T00:15:02.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.703+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd01f5960 con 0x7f5fd00d2680 2024-06-10T00:15:02.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.704+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd00cd000 con 0x7f5fd00d2680 2024-06-10T00:15:02.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.705+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd009d7d0 con 0x7f5fd00d2680 2024-06-10T00:15:02.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.705+0000 7f5fc67fc640 1 -- 172.21.15.79:0/3329789033 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fc0030a20 con 0x7f5fd00d2680 2024-06-10T00:15:02.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.706+0000 7f5fc67fc640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fb406be30 0x7f5fb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:02.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.706+0000 7f5fd583a640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fb406be30 0x7f5fb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:02.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.706+0000 7f5fc67fc640 1 -- 172.21.15.79:0/3329789033 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5fc00aba00 con 0x7f5fd00d2680 2024-06-10T00:15:02.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.706+0000 7f5fd583a640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fb406be30 0x7f5fb406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009b90 tx=0x7f5fcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:02.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.710+0000 7f5fc67fc640 1 -- 172.21.15.79:0/3329789033 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5fd009d7d0 con 0x7f5fd00d2680 2024-06-10T00:15:02.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.880+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5fd0068430 con 0x7f5fb406be30 2024-06-10T00:15:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.889+0000 7f5fc67fc640 1 -- 172.21.15.79:0/3329789033 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f5fd0068430 con 0x7f5fb406be30 2024-06-10T00:15:02.897 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:02.900 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:02.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fb406be30 msgr2=0x7f5fb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fb406be30 0x7f5fb406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009b90 tx=0x7f5fcc008040 comp rx=0 tx=0).stop 2024-06-10T00:15:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d2680 msgr2=0x7f5fd00cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d2680 0x7f5fd00cb190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5fc002a2b0 tx=0x7f5fc00046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 shutdown_connections 2024-06-10T00:15:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fb406be30 0x7f5fb406e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd0161fa0 0x7f5fd00c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd00d2680 0x7f5fd00cb190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 --2- 172.21.15.79:0/3329789033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd00d1fc0 0x7f5fd00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 >> 172.21.15.79:0/3329789033 conn(0x7f5fd009d3f0 msgr2=0x7f5fd0160c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.893+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 shutdown_connections 2024-06-10T00:15:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:02.894+0000 7f5fd7a9e640 1 -- 172.21.15.79:0/3329789033 wait complete. 2024-06-10T00:15:02.907 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-06-10T00:15:01.150857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003191"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035823+0000","last_change":"2024-06-10T00:14:41.867016+0000","last_active":"2024-06-10T00:14:48.035823+0000","last_peered":"2024-06-10T00:14:48.035823+0000","last_clean":"2024-06-10T00:14:48.035823+0000","last_became_active":"2024-06-10T00:14:41.866719+0000","last_became_peered":"2024-06-10T00:14:41.866719+0000","last_unstale":"2024-06-10T00:14:48.035823+0000","last_undegraded":"2024-06-10T00:14:48.035823+0000","last_fullsized":"2024-06-10T00:14:48.035823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:24:00.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017302+0000","last_change":"2024-06-10T00:14:42.878734+0000","last_active":"2024-06-10T00:14:48.017302+0000","last_peered":"2024-06-10T00:14:48.017302+0000","last_clean":"2024-06-10T00:14:48.017302+0000","last_became_active":"2024-06-10T00:14:42.878470+0000","last_became_peered":"2024-06-10T00:14:42.878470+0000","last_unstale":"2024-06-10T00:14:48.017302+0000","last_undegraded":"2024-06-10T00:14:48.017302+0000","last_fullsized":"2024-06-10T00:14:48.017302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016668+0000","last_change":"2024-06-10T00:14:46.991114+0000","last_active":"2024-06-10T00:14:48.016668+0000","last_peered":"2024-06-10T00:14:48.016668+0000","last_clean":"2024-06-10T00:14:48.016668+0000","last_became_active":"2024-06-10T00:14:46.990705+0000","last_became_peered":"2024-06-10T00:14:46.990705+0000","last_unstale":"2024-06-10T00:14:48.016668+0000","last_undegraded":"2024-06-10T00:14:48.016668+0000","last_fullsized":"2024-06-10T00:14:48.016668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:53:49.602835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017392+0000","last_change":"2024-06-10T00:14:41.862823+0000","last_active":"2024-06-10T00:14:48.017392+0000","last_peered":"2024-06-10T00:14:48.017392+0000","last_clean":"2024-06-10T00:14:48.017392+0000","last_became_active":"2024-06-10T00:14:41.862550+0000","last_became_peered":"2024-06-10T00:14:41.862550+0000","last_unstale":"2024-06-10T00:14:48.017392+0000","last_undegraded":"2024-06-10T00:14:48.017392+0000","last_fullsized":"2024-06-10T00:14:48.017392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:32:16.264432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035521+0000","last_change":"2024-06-10T00:14:42.869043+0000","last_active":"2024-06-10T00:14:48.035521+0000","last_peered":"2024-06-10T00:14:48.035521+0000","last_clean":"2024-06-10T00:14:48.035521+0000","last_became_active":"2024-06-10T00:14:42.868643+0000","last_became_peered":"2024-06-10T00:14:42.868643+0000","last_unstale":"2024-06-10T00:14:48.035521+0000","last_undegraded":"2024-06-10T00:14:48.035521+0000","last_fullsized":"2024-06-10T00:14:48.035521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897961+0000","last_change":"2024-06-10T00:14:46.888840+0000","last_active":"2024-06-10T00:14:47.897961+0000","last_peered":"2024-06-10T00:14:47.897961+0000","last_clean":"2024-06-10T00:14:47.897961+0000","last_became_active":"2024-06-10T00:14:46.888089+0000","last_became_peered":"2024-06-10T00:14:46.888089+0000","last_unstale":"2024-06-10T00:14:47.897961+0000","last_undegraded":"2024-06-10T00:14:47.897961+0000","last_fullsized":"2024-06-10T00:14:47.897961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:51.568143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035749+0000","last_change":"2024-06-10T00:14:41.865458+0000","last_active":"2024-06-10T00:14:48.035749+0000","last_peered":"2024-06-10T00:14:48.035749+0000","last_clean":"2024-06-10T00:14:48.035749+0000","last_became_active":"2024-06-10T00:14:41.865040+0000","last_became_peered":"2024-06-10T00:14:41.865040+0000","last_unstale":"2024-06-10T00:14:48.035749+0000","last_undegraded":"2024-06-10T00:14:48.035749+0000","last_fullsized":"2024-06-10T00:14:48.035749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:04.344977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898593+0000","last_change":"2024-06-10T00:14:42.859102+0000","last_active":"2024-06-10T00:14:47.898593+0000","last_peered":"2024-06-10T00:14:47.898593+0000","last_clean":"2024-06-10T00:14:47.898593+0000","last_became_active":"2024-06-10T00:14:42.858811+0000","last_became_peered":"2024-06-10T00:14:42.858811+0000","last_unstale":"2024-06-10T00:14:47.898593+0000","last_undegraded":"2024-06-10T00:14:47.898593+0000","last_fullsized":"2024-06-10T00:14:47.898593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:04.905009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898969+0000","last_change":"2024-06-10T00:14:46.889397+0000","last_active":"2024-06-10T00:14:47.898969+0000","last_peered":"2024-06-10T00:14:47.898969+0000","last_clean":"2024-06-10T00:14:47.898969+0000","last_became_active":"2024-06-10T00:14:46.888054+0000","last_became_peered":"2024-06-10T00:14:46.888054+0000","last_unstale":"2024-06-10T00:14:47.898969+0000","last_undegraded":"2024-06-10T00:14:47.898969+0000","last_fullsized":"2024-06-10T00:14:47.898969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:30.058992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035367+0000","last_change":"2024-06-10T00:14:41.866377+0000","last_active":"2024-06-10T00:14:48.035367+0000","last_peered":"2024-06-10T00:14:48.035367+0000","last_clean":"2024-06-10T00:14:48.035367+0000","last_became_active":"2024-06-10T00:14:41.865036+0000","last_became_peered":"2024-06-10T00:14:41.865036+0000","last_unstale":"2024-06-10T00:14:48.035367+0000","last_undegraded":"2024-06-10T00:14:48.035367+0000","last_fullsized":"2024-06-10T00:14:48.035367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899160+0000","last_change":"2024-06-10T00:14:42.860024+0000","last_active":"2024-06-10T00:14:47.899160+0000","last_peered":"2024-06-10T00:14:47.899160+0000","last_clean":"2024-06-10T00:14:47.899160+0000","last_became_active":"2024-06-10T00:14:42.859406+0000","last_became_peered":"2024-06-10T00:14:42.859406+0000","last_unstale":"2024-06-10T00:14:47.899160+0000","last_undegraded":"2024-06-10T00:14:47.899160+0000","last_fullsized":"2024-06-10T00:14:47.899160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:11.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898485+0000","last_change":"2024-06-10T00:14:46.886019+0000","last_active":"2024-06-10T00:14:47.898485+0000","last_peered":"2024-06-10T00:14:47.898485+0000","last_clean":"2024-06-10T00:14:47.898485+0000","last_became_active":"2024-06-10T00:14:46.885548+0000","last_became_peered":"2024-06-10T00:14:46.885548+0000","last_unstale":"2024-06-10T00:14:47.898485+0000","last_undegraded":"2024-06-10T00:14:47.898485+0000","last_fullsized":"2024-06-10T00:14:47.898485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:13.328779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035910+0000","last_change":"2024-06-10T00:14:42.874737+0000","last_active":"2024-06-10T00:14:48.035910+0000","last_peered":"2024-06-10T00:14:48.035910+0000","last_clean":"2024-06-10T00:14:48.035910+0000","last_became_active":"2024-06-10T00:14:42.874456+0000","last_became_peered":"2024-06-10T00:14:42.874456+0000","last_unstale":"2024-06-10T00:14:48.035910+0000","last_undegraded":"2024-06-10T00:14:48.035910+0000","last_fullsized":"2024-06-10T00:14:48.035910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035758+0000","last_change":"2024-06-10T00:14:41.867017+0000","last_active":"2024-06-10T00:14:48.035758+0000","last_peered":"2024-06-10T00:14:48.035758+0000","last_clean":"2024-06-10T00:14:48.035758+0000","last_became_active":"2024-06-10T00:14:41.866615+0000","last_became_peered":"2024-06-10T00:14:41.866615+0000","last_unstale":"2024-06-10T00:14:48.035758+0000","last_undegraded":"2024-06-10T00:14:48.035758+0000","last_fullsized":"2024-06-10T00:14:48.035758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899866+0000","last_change":"2024-06-10T00:14:46.887357+0000","last_active":"2024-06-10T00:14:47.899866+0000","last_peered":"2024-06-10T00:14:47.899866+0000","last_clean":"2024-06-10T00:14:47.899866+0000","last_became_active":"2024-06-10T00:14:46.886828+0000","last_became_peered":"2024-06-10T00:14:46.886828+0000","last_unstale":"2024-06-10T00:14:47.899866+0000","last_undegraded":"2024-06-10T00:14:47.899866+0000","last_fullsized":"2024-06-10T00:14:47.899866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016853+0000","last_change":"2024-06-10T00:14:42.874437+0000","last_active":"2024-06-10T00:14:48.016853+0000","last_peered":"2024-06-10T00:14:48.016853+0000","last_clean":"2024-06-10T00:14:48.016853+0000","last_became_active":"2024-06-10T00:14:42.871485+0000","last_became_peered":"2024-06-10T00:14:42.871485+0000","last_unstale":"2024-06-10T00:14:48.016853+0000","last_undegraded":"2024-06-10T00:14:48.016853+0000","last_fullsized":"2024-06-10T00:14:48.016853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036080+0000","last_change":"2024-06-10T00:14:41.860772+0000","last_active":"2024-06-10T00:14:48.036080+0000","last_peered":"2024-06-10T00:14:48.036080+0000","last_clean":"2024-06-10T00:14:48.036080+0000","last_became_active":"2024-06-10T00:14:41.860372+0000","last_became_peered":"2024-06-10T00:14:41.860372+0000","last_unstale":"2024-06-10T00:14:48.036080+0000","last_undegraded":"2024-06-10T00:14:48.036080+0000","last_fullsized":"2024-06-10T00:14:48.036080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898238+0000","last_change":"2024-06-10T00:14:46.888544+0000","last_active":"2024-06-10T00:14:47.898238+0000","last_peered":"2024-06-10T00:14:47.898238+0000","last_clean":"2024-06-10T00:14:47.898238+0000","last_became_active":"2024-06-10T00:14:46.887972+0000","last_became_peered":"2024-06-10T00:14:46.887972+0000","last_unstale":"2024-06-10T00:14:47.898238+0000","last_undegraded":"2024-06-10T00:14:47.898238+0000","last_fullsized":"2024-06-10T00:14:47.898238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:46.828253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016970+0000","last_change":"2024-06-10T00:14:42.871661+0000","last_active":"2024-06-10T00:14:48.016970+0000","last_peered":"2024-06-10T00:14:48.016970+0000","last_clean":"2024-06-10T00:14:48.016970+0000","last_became_active":"2024-06-10T00:14:42.870944+0000","last_became_peered":"2024-06-10T00:14:42.870944+0000","last_unstale":"2024-06-10T00:14:48.016970+0000","last_undegraded":"2024-06-10T00:14:48.016970+0000","last_fullsized":"2024-06-10T00:14:48.016970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035625+0000","last_change":"2024-06-10T00:14:41.863225+0000","last_active":"2024-06-10T00:14:48.035625+0000","last_peered":"2024-06-10T00:14:48.035625+0000","last_clean":"2024-06-10T00:14:48.035625+0000","last_became_active":"2024-06-10T00:14:41.862940+0000","last_became_peered":"2024-06-10T00:14:41.862940+0000","last_unstale":"2024-06-10T00:14:48.035625+0000","last_undegraded":"2024-06-10T00:14:48.035625+0000","last_fullsized":"2024-06-10T00:14:48.035625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036483+0000","last_change":"2024-06-10T00:14:46.990813+0000","last_active":"2024-06-10T00:14:48.036483+0000","last_peered":"2024-06-10T00:14:48.036483+0000","last_clean":"2024-06-10T00:14:48.036483+0000","last_became_active":"2024-06-10T00:14:46.990054+0000","last_became_peered":"2024-06-10T00:14:46.990054+0000","last_unstale":"2024-06-10T00:14:48.036483+0000","last_undegraded":"2024-06-10T00:14:48.036483+0000","last_fullsized":"2024-06-10T00:14:48.036483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:27.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898430+0000","last_change":"2024-06-10T00:14:42.864896+0000","last_active":"2024-06-10T00:14:47.898430+0000","last_peered":"2024-06-10T00:14:47.898430+0000","last_clean":"2024-06-10T00:14:47.898430+0000","last_became_active":"2024-06-10T00:14:42.864638+0000","last_became_peered":"2024-06-10T00:14:42.864638+0000","last_unstale":"2024-06-10T00:14:47.898430+0000","last_undegraded":"2024-06-10T00:14:47.898430+0000","last_fullsized":"2024-06-10T00:14:47.898430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:47.083423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035079+0000","last_change":"2024-06-10T00:14:41.866168+0000","last_active":"2024-06-10T00:14:48.035079+0000","last_peered":"2024-06-10T00:14:48.035079+0000","last_clean":"2024-06-10T00:14:48.035079+0000","last_became_active":"2024-06-10T00:14:41.865791+0000","last_became_peered":"2024-06-10T00:14:41.865791+0000","last_unstale":"2024-06-10T00:14:48.035079+0000","last_undegraded":"2024-06-10T00:14:48.035079+0000","last_fullsized":"2024-06-10T00:14:48.035079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:43.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899774+0000","last_change":"2024-06-10T00:14:46.886506+0000","last_active":"2024-06-10T00:14:47.899774+0000","last_peered":"2024-06-10T00:14:47.899774+0000","last_clean":"2024-06-10T00:14:47.899774+0000","last_became_active":"2024-06-10T00:14:46.885716+0000","last_became_peered":"2024-06-10T00:14:46.885716+0000","last_unstale":"2024-06-10T00:14:47.899774+0000","last_undegraded":"2024-06-10T00:14:47.899774+0000","last_fullsized":"2024-06-10T00:14:47.899774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:05.738780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035971+0000","last_change":"2024-06-10T00:14:42.863988+0000","last_active":"2024-06-10T00:14:48.035971+0000","last_peered":"2024-06-10T00:14:48.035971+0000","last_clean":"2024-06-10T00:14:48.035971+0000","last_became_active":"2024-06-10T00:14:42.863676+0000","last_became_peered":"2024-06-10T00:14:42.863676+0000","last_unstale":"2024-06-10T00:14:48.035971+0000","last_undegraded":"2024-06-10T00:14:48.035971+0000","last_fullsized":"2024-06-10T00:14:48.035971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036781+0000","last_change":"2024-06-10T00:14:41.868147+0000","last_active":"2024-06-10T00:14:48.036781+0000","last_peered":"2024-06-10T00:14:48.036781+0000","last_clean":"2024-06-10T00:14:48.036781+0000","last_became_active":"2024-06-10T00:14:41.867865+0000","last_became_peered":"2024-06-10T00:14:41.867865+0000","last_unstale":"2024-06-10T00:14:48.036781+0000","last_undegraded":"2024-06-10T00:14:48.036781+0000","last_fullsized":"2024-06-10T00:14:48.036781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898144+0000","last_change":"2024-06-10T00:14:46.988256+0000","last_active":"2024-06-10T00:14:47.898144+0000","last_peered":"2024-06-10T00:14:47.898144+0000","last_clean":"2024-06-10T00:14:47.898144+0000","last_became_active":"2024-06-10T00:14:46.987870+0000","last_became_peered":"2024-06-10T00:14:46.987870+0000","last_unstale":"2024-06-10T00:14:47.898144+0000","last_undegraded":"2024-06-10T00:14:47.898144+0000","last_fullsized":"2024-06-10T00:14:47.898144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:15.305106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017506+0000","last_change":"2024-06-10T00:14:42.867973+0000","last_active":"2024-06-10T00:14:48.017506+0000","last_peered":"2024-06-10T00:14:48.017506+0000","last_clean":"2024-06-10T00:14:48.017506+0000","last_became_active":"2024-06-10T00:14:42.867690+0000","last_became_peered":"2024-06-10T00:14:42.867690+0000","last_unstale":"2024-06-10T00:14:48.017506+0000","last_undegraded":"2024-06-10T00:14:48.017506+0000","last_fullsized":"2024-06-10T00:14:48.017506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036284+0000","last_change":"2024-06-10T00:14:41.868966+0000","last_active":"2024-06-10T00:14:48.036284+0000","last_peered":"2024-06-10T00:14:48.036284+0000","last_clean":"2024-06-10T00:14:48.036284+0000","last_became_active":"2024-06-10T00:14:41.868645+0000","last_became_peered":"2024-06-10T00:14:41.868645+0000","last_unstale":"2024-06-10T00:14:48.036284+0000","last_undegraded":"2024-06-10T00:14:48.036284+0000","last_fullsized":"2024-06-10T00:14:48.036284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016612+0000","last_change":"2024-06-10T00:14:46.990437+0000","last_active":"2024-06-10T00:14:48.016612+0000","last_peered":"2024-06-10T00:14:48.016612+0000","last_clean":"2024-06-10T00:14:48.016612+0000","last_became_active":"2024-06-10T00:14:46.990040+0000","last_became_peered":"2024-06-10T00:14:46.990040+0000","last_unstale":"2024-06-10T00:14:48.016612+0000","last_undegraded":"2024-06-10T00:14:48.016612+0000","last_fullsized":"2024-06-10T00:14:48.016612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:56:13.445267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036047+0000","last_change":"2024-06-10T00:14:42.859747+0000","last_active":"2024-06-10T00:14:48.036047+0000","last_peered":"2024-06-10T00:14:48.036047+0000","last_clean":"2024-06-10T00:14:48.036047+0000","last_became_active":"2024-06-10T00:14:42.859406+0000","last_became_peered":"2024-06-10T00:14:42.859406+0000","last_unstale":"2024-06-10T00:14:48.036047+0000","last_undegraded":"2024-06-10T00:14:48.036047+0000","last_fullsized":"2024-06-10T00:14:48.036047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035847+0000","last_change":"2024-06-10T00:14:41.868654+0000","last_active":"2024-06-10T00:14:48.035847+0000","last_peered":"2024-06-10T00:14:48.035847+0000","last_clean":"2024-06-10T00:14:48.035847+0000","last_became_active":"2024-06-10T00:14:41.868347+0000","last_became_peered":"2024-06-10T00:14:41.868347+0000","last_unstale":"2024-06-10T00:14:48.035847+0000","last_undegraded":"2024-06-10T00:14:48.035847+0000","last_fullsized":"2024-06-10T00:14:48.035847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:35:23.234029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035282+0000","last_change":"2024-06-10T00:14:46.988194+0000","last_active":"2024-06-10T00:14:48.035282+0000","last_peered":"2024-06-10T00:14:48.035282+0000","last_clean":"2024-06-10T00:14:48.035282+0000","last_became_active":"2024-06-10T00:14:46.987822+0000","last_became_peered":"2024-06-10T00:14:46.987822+0000","last_unstale":"2024-06-10T00:14:48.035282+0000","last_undegraded":"2024-06-10T00:14:48.035282+0000","last_fullsized":"2024-06-10T00:14:48.035282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899279+0000","last_change":"2024-06-10T00:14:42.866515+0000","last_active":"2024-06-10T00:14:47.899279+0000","last_peered":"2024-06-10T00:14:47.899279+0000","last_clean":"2024-06-10T00:14:47.899279+0000","last_became_active":"2024-06-10T00:14:42.866202+0000","last_became_peered":"2024-06-10T00:14:42.866202+0000","last_unstale":"2024-06-10T00:14:47.899279+0000","last_undegraded":"2024-06-10T00:14:47.899279+0000","last_fullsized":"2024-06-10T00:14:47.899279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036142+0000","last_change":"2024-06-10T00:14:41.862650+0000","last_active":"2024-06-10T00:14:48.036142+0000","last_peered":"2024-06-10T00:14:48.036142+0000","last_clean":"2024-06-10T00:14:48.036142+0000","last_became_active":"2024-06-10T00:14:41.862386+0000","last_became_peered":"2024-06-10T00:14:41.862386+0000","last_unstale":"2024-06-10T00:14:48.036142+0000","last_undegraded":"2024-06-10T00:14:48.036142+0000","last_fullsized":"2024-06-10T00:14:48.036142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035886+0000","last_change":"2024-06-10T00:14:46.894074+0000","last_active":"2024-06-10T00:14:48.035886+0000","last_peered":"2024-06-10T00:14:48.035886+0000","last_clean":"2024-06-10T00:14:48.035886+0000","last_became_active":"2024-06-10T00:14:46.893369+0000","last_became_peered":"2024-06-10T00:14:46.893369+0000","last_unstale":"2024-06-10T00:14:48.035886+0000","last_undegraded":"2024-06-10T00:14:48.035886+0000","last_fullsized":"2024-06-10T00:14:48.035886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899512+0000","last_change":"2024-06-10T00:14:42.866544+0000","last_active":"2024-06-10T00:14:47.899512+0000","last_peered":"2024-06-10T00:14:47.899512+0000","last_clean":"2024-06-10T00:14:47.899512+0000","last_became_active":"2024-06-10T00:14:42.865366+0000","last_became_peered":"2024-06-10T00:14:42.865366+0000","last_unstale":"2024-06-10T00:14:47.899512+0000","last_undegraded":"2024-06-10T00:14:47.899512+0000","last_fullsized":"2024-06-10T00:14:47.899512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:23.595724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899407+0000","last_change":"2024-06-10T00:14:41.861648+0000","last_active":"2024-06-10T00:14:47.899407+0000","last_peered":"2024-06-10T00:14:47.899407+0000","last_clean":"2024-06-10T00:14:47.899407+0000","last_became_active":"2024-06-10T00:14:41.861363+0000","last_became_peered":"2024-06-10T00:14:41.861363+0000","last_unstale":"2024-06-10T00:14:47.899407+0000","last_undegraded":"2024-06-10T00:14:47.899407+0000","last_fullsized":"2024-06-10T00:14:47.899407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036077+0000","last_change":"2024-06-10T00:14:46.886310+0000","last_active":"2024-06-10T00:14:48.036077+0000","last_peered":"2024-06-10T00:14:48.036077+0000","last_clean":"2024-06-10T00:14:48.036077+0000","last_became_active":"2024-06-10T00:14:46.885934+0000","last_became_peered":"2024-06-10T00:14:46.885934+0000","last_unstale":"2024-06-10T00:14:48.036077+0000","last_undegraded":"2024-06-10T00:14:48.036077+0000","last_fullsized":"2024-06-10T00:14:48.036077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:08.929668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035314+0000","last_change":"2024-06-10T00:14:42.860757+0000","last_active":"2024-06-10T00:14:48.035314+0000","last_peered":"2024-06-10T00:14:48.035314+0000","last_clean":"2024-06-10T00:14:48.035314+0000","last_became_active":"2024-06-10T00:14:42.860420+0000","last_became_peered":"2024-06-10T00:14:42.860420+0000","last_unstale":"2024-06-10T00:14:48.035314+0000","last_undegraded":"2024-06-10T00:14:48.035314+0000","last_fullsized":"2024-06-10T00:14:48.035314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897376+0000","last_change":"2024-06-10T00:14:41.858056+0000","last_active":"2024-06-10T00:14:47.897376+0000","last_peered":"2024-06-10T00:14:47.897376+0000","last_clean":"2024-06-10T00:14:47.897376+0000","last_became_active":"2024-06-10T00:14:41.857761+0000","last_became_peered":"2024-06-10T00:14:41.857761+0000","last_unstale":"2024-06-10T00:14:47.897376+0000","last_undegraded":"2024-06-10T00:14:47.897376+0000","last_fullsized":"2024-06-10T00:14:47.897376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036543+0000","last_change":"2024-06-10T00:14:46.894221+0000","last_active":"2024-06-10T00:14:48.036543+0000","last_peered":"2024-06-10T00:14:48.036543+0000","last_clean":"2024-06-10T00:14:48.036543+0000","last_became_active":"2024-06-10T00:14:46.893698+0000","last_became_peered":"2024-06-10T00:14:46.893698+0000","last_unstale":"2024-06-10T00:14:48.036543+0000","last_undegraded":"2024-06-10T00:14:48.036543+0000","last_fullsized":"2024-06-10T00:14:48.036543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:36.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.034921+0000","last_change":"2024-06-10T00:14:42.873418+0000","last_active":"2024-06-10T00:14:48.034921+0000","last_peered":"2024-06-10T00:14:48.034921+0000","last_clean":"2024-06-10T00:14:48.034921+0000","last_became_active":"2024-06-10T00:14:42.872202+0000","last_became_peered":"2024-06-10T00:14:42.872202+0000","last_unstale":"2024-06-10T00:14:48.034921+0000","last_undegraded":"2024-06-10T00:14:48.034921+0000","last_fullsized":"2024-06-10T00:14:48.034921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035121+0000","last_change":"2024-06-10T00:14:41.863805+0000","last_active":"2024-06-10T00:14:48.035121+0000","last_peered":"2024-06-10T00:14:48.035121+0000","last_clean":"2024-06-10T00:14:48.035121+0000","last_became_active":"2024-06-10T00:14:41.863518+0000","last_became_peered":"2024-06-10T00:14:41.863518+0000","last_unstale":"2024-06-10T00:14:48.035121+0000","last_undegraded":"2024-06-10T00:14:48.035121+0000","last_fullsized":"2024-06-10T00:14:48.035121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:38:57.655573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035793+0000","last_change":"2024-06-10T00:14:46.988209+0000","last_active":"2024-06-10T00:14:48.035793+0000","last_peered":"2024-06-10T00:14:48.035793+0000","last_clean":"2024-06-10T00:14:48.035793+0000","last_became_active":"2024-06-10T00:14:46.987834+0000","last_became_peered":"2024-06-10T00:14:46.987834+0000","last_unstale":"2024-06-10T00:14:48.035793+0000","last_undegraded":"2024-06-10T00:14:48.035793+0000","last_fullsized":"2024-06-10T00:14:48.035793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:36.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016903+0000","last_change":"2024-06-10T00:14:42.867535+0000","last_active":"2024-06-10T00:14:48.016903+0000","last_peered":"2024-06-10T00:14:48.016903+0000","last_clean":"2024-06-10T00:14:48.016903+0000","last_became_active":"2024-06-10T00:14:42.867224+0000","last_became_peered":"2024-06-10T00:14:42.867224+0000","last_unstale":"2024-06-10T00:14:48.016903+0000","last_undegraded":"2024-06-10T00:14:48.016903+0000","last_fullsized":"2024-06-10T00:14:48.016903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899686+0000","last_change":"2024-06-10T00:14:41.858886+0000","last_active":"2024-06-10T00:14:47.899686+0000","last_peered":"2024-06-10T00:14:47.899686+0000","last_clean":"2024-06-10T00:14:47.899686+0000","last_became_active":"2024-06-10T00:14:41.858568+0000","last_became_peered":"2024-06-10T00:14:41.858568+0000","last_unstale":"2024-06-10T00:14:47.899686+0000","last_undegraded":"2024-06-10T00:14:47.899686+0000","last_fullsized":"2024-06-10T00:14:47.899686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035569+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:14:48.035569+0000","last_peered":"2024-06-10T00:14:48.035569+0000","last_clean":"2024-06-10T00:14:48.035569+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:14:48.035569+0000","last_undegraded":"2024-06-10T00:14:48.035569+0000","last_fullsized":"2024-06-10T00:14:48.035569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036528+0000","last_change":"2024-06-10T00:14:46.989884+0000","last_active":"2024-06-10T00:14:48.036528+0000","last_peered":"2024-06-10T00:14:48.036528+0000","last_clean":"2024-06-10T00:14:48.036528+0000","last_became_active":"2024-06-10T00:14:46.988326+0000","last_became_peered":"2024-06-10T00:14:46.988326+0000","last_unstale":"2024-06-10T00:14:48.036528+0000","last_undegraded":"2024-06-10T00:14:48.036528+0000","last_fullsized":"2024-06-10T00:14:48.036528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:05.738780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035660+0000","last_change":"2024-06-10T00:14:42.875447+0000","last_active":"2024-06-10T00:14:48.035660+0000","last_peered":"2024-06-10T00:14:48.035660+0000","last_clean":"2024-06-10T00:14:48.035660+0000","last_became_active":"2024-06-10T00:14:42.875163+0000","last_became_peered":"2024-06-10T00:14:42.875163+0000","last_unstale":"2024-06-10T00:14:48.035660+0000","last_undegraded":"2024-06-10T00:14:48.035660+0000","last_fullsized":"2024-06-10T00:14:48.035660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:43.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897639+0000","last_change":"2024-06-10T00:14:41.859030+0000","last_active":"2024-06-10T00:14:47.897639+0000","last_peered":"2024-06-10T00:14:47.897639+0000","last_clean":"2024-06-10T00:14:47.897639+0000","last_became_active":"2024-06-10T00:14:41.858721+0000","last_became_peered":"2024-06-10T00:14:41.858721+0000","last_unstale":"2024-06-10T00:14:47.897639+0000","last_undegraded":"2024-06-10T00:14:47.897639+0000","last_fullsized":"2024-06-10T00:14:47.897639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035781+0000","last_change":"2024-06-10T00:14:46.989519+0000","last_active":"2024-06-10T00:14:48.035781+0000","last_peered":"2024-06-10T00:14:48.035781+0000","last_clean":"2024-06-10T00:14:48.035781+0000","last_became_active":"2024-06-10T00:14:46.988160+0000","last_became_peered":"2024-06-10T00:14:46.988160+0000","last_unstale":"2024-06-10T00:14:48.035781+0000","last_undegraded":"2024-06-10T00:14:48.035781+0000","last_fullsized":"2024-06-10T00:14:48.035781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:37.577252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898697+0000","last_change":"2024-06-10T00:14:42.873285+0000","last_active":"2024-06-10T00:14:47.898697+0000","last_peered":"2024-06-10T00:14:47.898697+0000","last_clean":"2024-06-10T00:14:47.898697+0000","last_became_active":"2024-06-10T00:14:42.872722+0000","last_became_peered":"2024-06-10T00:14:42.872722+0000","last_unstale":"2024-06-10T00:14:47.898697+0000","last_undegraded":"2024-06-10T00:14:47.898697+0000","last_fullsized":"2024-06-10T00:14:47.898697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:23.901714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036246+0000","last_change":"2024-06-10T00:14:41.859803+0000","last_active":"2024-06-10T00:14:48.036246+0000","last_peered":"2024-06-10T00:14:48.036246+0000","last_clean":"2024-06-10T00:14:48.036246+0000","last_became_active":"2024-06-10T00:14:41.859233+0000","last_became_peered":"2024-06-10T00:14:41.859233+0000","last_unstale":"2024-06-10T00:14:48.036246+0000","last_undegraded":"2024-06-10T00:14:48.036246+0000","last_fullsized":"2024-06-10T00:14:48.036246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:04.344977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035388+0000","last_change":"2024-06-10T00:14:46.892114+0000","last_active":"2024-06-10T00:14:48.035388+0000","last_peered":"2024-06-10T00:14:48.035388+0000","last_clean":"2024-06-10T00:14:48.035388+0000","last_became_active":"2024-06-10T00:14:46.891627+0000","last_became_peered":"2024-06-10T00:14:46.891627+0000","last_unstale":"2024-06-10T00:14:48.035388+0000","last_undegraded":"2024-06-10T00:14:48.035388+0000","last_fullsized":"2024-06-10T00:14:48.035388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:16.762113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036057+0000","last_change":"2024-06-10T00:14:42.880436+0000","last_active":"2024-06-10T00:14:48.036057+0000","last_peered":"2024-06-10T00:14:48.036057+0000","last_clean":"2024-06-10T00:14:48.036057+0000","last_became_active":"2024-06-10T00:14:42.880194+0000","last_became_peered":"2024-06-10T00:14:42.880194+0000","last_unstale":"2024-06-10T00:14:48.036057+0000","last_undegraded":"2024-06-10T00:14:48.036057+0000","last_fullsized":"2024-06-10T00:14:48.036057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:54:40.334756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897719+0000","last_change":"2024-06-10T00:14:41.857224+0000","last_active":"2024-06-10T00:14:47.897719+0000","last_peered":"2024-06-10T00:14:47.897719+0000","last_clean":"2024-06-10T00:14:47.897719+0000","last_became_active":"2024-06-10T00:14:41.856764+0000","last_became_peered":"2024-06-10T00:14:41.856764+0000","last_unstale":"2024-06-10T00:14:47.897719+0000","last_undegraded":"2024-06-10T00:14:47.897719+0000","last_fullsized":"2024-06-10T00:14:47.897719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:32:16.264432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898625+0000","last_change":"2024-06-10T00:14:46.988209+0000","last_active":"2024-06-10T00:14:47.898625+0000","last_peered":"2024-06-10T00:14:47.898625+0000","last_clean":"2024-06-10T00:14:47.898625+0000","last_became_active":"2024-06-10T00:14:46.987828+0000","last_became_peered":"2024-06-10T00:14:46.987828+0000","last_unstale":"2024-06-10T00:14:47.898625+0000","last_undegraded":"2024-06-10T00:14:47.898625+0000","last_fullsized":"2024-06-10T00:14:47.898625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:55.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035649+0000","last_change":"2024-06-10T00:14:42.872751+0000","last_active":"2024-06-10T00:14:48.035649+0000","last_peered":"2024-06-10T00:14:48.035649+0000","last_clean":"2024-06-10T00:14:48.035649+0000","last_became_active":"2024-06-10T00:14:42.872474+0000","last_became_peered":"2024-06-10T00:14:42.872474+0000","last_unstale":"2024-06-10T00:14:48.035649+0000","last_undegraded":"2024-06-10T00:14:48.035649+0000","last_fullsized":"2024-06-10T00:14:48.035649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:23.901714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899907+0000","last_change":"2024-06-10T00:14:41.862996+0000","last_active":"2024-06-10T00:14:47.899907+0000","last_peered":"2024-06-10T00:14:47.899907+0000","last_clean":"2024-06-10T00:14:47.899907+0000","last_became_active":"2024-06-10T00:14:41.862737+0000","last_became_peered":"2024-06-10T00:14:41.862737+0000","last_unstale":"2024-06-10T00:14:47.899907+0000","last_undegraded":"2024-06-10T00:14:47.899907+0000","last_fullsized":"2024-06-10T00:14:47.899907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:33:44.025553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897822+0000","last_change":"2024-06-10T00:14:46.888769+0000","last_active":"2024-06-10T00:14:47.897822+0000","last_peered":"2024-06-10T00:14:47.897822+0000","last_clean":"2024-06-10T00:14:47.897822+0000","last_became_active":"2024-06-10T00:14:46.887888+0000","last_became_peered":"2024-06-10T00:14:46.887888+0000","last_unstale":"2024-06-10T00:14:47.897822+0000","last_undegraded":"2024-06-10T00:14:47.897822+0000","last_fullsized":"2024-06-10T00:14:47.897822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:54.764215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035898+0000","last_change":"2024-06-10T00:14:42.874352+0000","last_active":"2024-06-10T00:14:48.035898+0000","last_peered":"2024-06-10T00:14:48.035898+0000","last_clean":"2024-06-10T00:14:48.035898+0000","last_became_active":"2024-06-10T00:14:42.874088+0000","last_became_peered":"2024-06-10T00:14:42.874088+0000","last_unstale":"2024-06-10T00:14:48.035898+0000","last_undegraded":"2024-06-10T00:14:48.035898+0000","last_fullsized":"2024-06-10T00:14:48.035898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897293+0000","last_change":"2024-06-10T00:14:41.859732+0000","last_active":"2024-06-10T00:14:47.897293+0000","last_peered":"2024-06-10T00:14:47.897293+0000","last_clean":"2024-06-10T00:14:47.897293+0000","last_became_active":"2024-06-10T00:14:41.859467+0000","last_became_peered":"2024-06-10T00:14:41.859467+0000","last_unstale":"2024-06-10T00:14:47.897293+0000","last_undegraded":"2024-06-10T00:14:47.897293+0000","last_fullsized":"2024-06-10T00:14:47.897293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035648+0000","last_change":"2024-06-10T00:14:46.892523+0000","last_active":"2024-06-10T00:14:48.035648+0000","last_peered":"2024-06-10T00:14:48.035648+0000","last_clean":"2024-06-10T00:14:48.035648+0000","last_became_active":"2024-06-10T00:14:46.892158+0000","last_became_peered":"2024-06-10T00:14:46.892158+0000","last_unstale":"2024-06-10T00:14:48.035648+0000","last_undegraded":"2024-06-10T00:14:48.035648+0000","last_fullsized":"2024-06-10T00:14:48.035648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:27.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035229+0000","last_change":"2024-06-10T00:14:42.871097+0000","last_active":"2024-06-10T00:14:48.035229+0000","last_peered":"2024-06-10T00:14:48.035229+0000","last_clean":"2024-06-10T00:14:48.035229+0000","last_became_active":"2024-06-10T00:14:42.870727+0000","last_became_peered":"2024-06-10T00:14:42.870727+0000","last_unstale":"2024-06-10T00:14:48.035229+0000","last_undegraded":"2024-06-10T00:14:48.035229+0000","last_fullsized":"2024-06-10T00:14:48.035229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035767+0000","last_change":"2024-06-10T00:14:41.865937+0000","last_active":"2024-06-10T00:14:48.035767+0000","last_peered":"2024-06-10T00:14:48.035767+0000","last_clean":"2024-06-10T00:14:48.035767+0000","last_became_active":"2024-06-10T00:14:41.865669+0000","last_became_peered":"2024-06-10T00:14:41.865669+0000","last_unstale":"2024-06-10T00:14:48.035767+0000","last_undegraded":"2024-06-10T00:14:48.035767+0000","last_fullsized":"2024-06-10T00:14:48.035767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017480+0000","last_change":"2024-06-10T00:14:46.991940+0000","last_active":"2024-06-10T00:14:48.017480+0000","last_peered":"2024-06-10T00:14:48.017480+0000","last_clean":"2024-06-10T00:14:48.017480+0000","last_became_active":"2024-06-10T00:14:46.991212+0000","last_became_peered":"2024-06-10T00:14:46.991212+0000","last_unstale":"2024-06-10T00:14:48.017480+0000","last_undegraded":"2024-06-10T00:14:48.017480+0000","last_fullsized":"2024-06-10T00:14:48.017480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:46:12.021856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035567+0000","last_change":"2024-06-10T00:14:42.873727+0000","last_active":"2024-06-10T00:14:48.035567+0000","last_peered":"2024-06-10T00:14:48.035567+0000","last_clean":"2024-06-10T00:14:48.035567+0000","last_became_active":"2024-06-10T00:14:42.873459+0000","last_became_peered":"2024-06-10T00:14:42.873459+0000","last_unstale":"2024-06-10T00:14:48.035567+0000","last_undegraded":"2024-06-10T00:14:48.035567+0000","last_fullsized":"2024-06-10T00:14:48.035567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:01.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899344+0000","last_change":"2024-06-10T00:14:41.864175+0000","last_active":"2024-06-10T00:14:47.899344+0000","last_peered":"2024-06-10T00:14:47.899344+0000","last_clean":"2024-06-10T00:14:47.899344+0000","last_became_active":"2024-06-10T00:14:41.863904+0000","last_became_peered":"2024-06-10T00:14:41.863904+0000","last_unstale":"2024-06-10T00:14:47.899344+0000","last_undegraded":"2024-06-10T00:14:47.899344+0000","last_fullsized":"2024-06-10T00:14:47.899344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017189+0000","last_change":"2024-06-10T00:14:46.992939+0000","last_active":"2024-06-10T00:14:48.017189+0000","last_peered":"2024-06-10T00:14:48.017189+0000","last_clean":"2024-06-10T00:14:48.017189+0000","last_became_active":"2024-06-10T00:14:46.991804+0000","last_became_peered":"2024-06-10T00:14:46.991804+0000","last_unstale":"2024-06-10T00:14:48.017189+0000","last_undegraded":"2024-06-10T00:14:48.017189+0000","last_fullsized":"2024-06-10T00:14:48.017189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:29:27.598667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035115+0000","last_change":"2024-06-10T00:14:42.874718+0000","last_active":"2024-06-10T00:14:48.035115+0000","last_peered":"2024-06-10T00:14:48.035115+0000","last_clean":"2024-06-10T00:14:48.035115+0000","last_became_active":"2024-06-10T00:14:42.873485+0000","last_became_peered":"2024-06-10T00:14:42.873485+0000","last_unstale":"2024-06-10T00:14:48.035115+0000","last_undegraded":"2024-06-10T00:14:48.035115+0000","last_fullsized":"2024-06-10T00:14:48.035115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:38:52.325465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035564+0000","last_change":"2024-06-10T00:14:41.863792+0000","last_active":"2024-06-10T00:14:48.035564+0000","last_peered":"2024-06-10T00:14:48.035564+0000","last_clean":"2024-06-10T00:14:48.035564+0000","last_became_active":"2024-06-10T00:14:41.863525+0000","last_became_peered":"2024-06-10T00:14:41.863525+0000","last_unstale":"2024-06-10T00:14:48.035564+0000","last_undegraded":"2024-06-10T00:14:48.035564+0000","last_fullsized":"2024-06-10T00:14:48.035564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:21.351313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899455+0000","last_change":"2024-06-10T00:14:46.989177+0000","last_active":"2024-06-10T00:14:47.899455+0000","last_peered":"2024-06-10T00:14:47.899455+0000","last_clean":"2024-06-10T00:14:47.899455+0000","last_became_active":"2024-06-10T00:14:46.988818+0000","last_became_peered":"2024-06-10T00:14:46.988818+0000","last_unstale":"2024-06-10T00:14:47.899455+0000","last_undegraded":"2024-06-10T00:14:47.899455+0000","last_fullsized":"2024-06-10T00:14:47.899455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:52.363831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035517+0000","last_change":"2024-06-10T00:14:42.876047+0000","last_active":"2024-06-10T00:14:48.035517+0000","last_peered":"2024-06-10T00:14:48.035517+0000","last_clean":"2024-06-10T00:14:48.035517+0000","last_became_active":"2024-06-10T00:14:42.875789+0000","last_became_peered":"2024-06-10T00:14:42.875789+0000","last_unstale":"2024-06-10T00:14:48.035517+0000","last_undegraded":"2024-06-10T00:14:48.035517+0000","last_fullsized":"2024-06-10T00:14:48.035517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:33.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:52.223703+0000","last_change":"2024-06-10T00:14:41.866777+0000","last_active":"2024-06-10T00:14:52.223703+0000","last_peered":"2024-06-10T00:14:52.223703+0000","last_clean":"2024-06-10T00:14:52.223703+0000","last_became_active":"2024-06-10T00:14:41.866439+0000","last_became_peered":"2024-06-10T00:14:41.866439+0000","last_unstale":"2024-06-10T00:14:52.223703+0000","last_undegraded":"2024-06-10T00:14:52.223703+0000","last_fullsized":"2024-06-10T00:14:52.223703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035977+0000","last_change":"2024-06-10T00:14:46.893648+0000","last_active":"2024-06-10T00:14:48.035977+0000","last_peered":"2024-06-10T00:14:48.035977+0000","last_clean":"2024-06-10T00:14:48.035977+0000","last_became_active":"2024-06-10T00:14:46.893153+0000","last_became_peered":"2024-06-10T00:14:46.893153+0000","last_unstale":"2024-06-10T00:14:48.035977+0000","last_undegraded":"2024-06-10T00:14:48.035977+0000","last_fullsized":"2024-06-10T00:14:48.035977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:16.762113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899660+0000","last_change":"2024-06-10T00:14:42.869743+0000","last_active":"2024-06-10T00:14:47.899660+0000","last_peered":"2024-06-10T00:14:47.899660+0000","last_clean":"2024-06-10T00:14:47.899660+0000","last_became_active":"2024-06-10T00:14:42.869432+0000","last_became_peered":"2024-06-10T00:14:42.869432+0000","last_unstale":"2024-06-10T00:14:47.899660+0000","last_undegraded":"2024-06-10T00:14:47.899660+0000","last_fullsized":"2024-06-10T00:14:47.899660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:44.600998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036249+0000","last_change":"2024-06-10T00:14:41.859872+0000","last_active":"2024-06-10T00:14:48.036249+0000","last_peered":"2024-06-10T00:14:48.036249+0000","last_clean":"2024-06-10T00:14:48.036249+0000","last_became_active":"2024-06-10T00:14:41.859529+0000","last_became_peered":"2024-06-10T00:14:41.859529+0000","last_unstale":"2024-06-10T00:14:48.036249+0000","last_undegraded":"2024-06-10T00:14:48.036249+0000","last_fullsized":"2024-06-10T00:14:48.036249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:43.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899198+0000","last_change":"2024-06-10T00:14:46.887779+0000","last_active":"2024-06-10T00:14:47.899198+0000","last_peered":"2024-06-10T00:14:47.899198+0000","last_clean":"2024-06-10T00:14:47.899198+0000","last_became_active":"2024-06-10T00:14:46.887388+0000","last_became_peered":"2024-06-10T00:14:46.887388+0000","last_unstale":"2024-06-10T00:14:47.899198+0000","last_undegraded":"2024-06-10T00:14:47.899198+0000","last_fullsized":"2024-06-10T00:14:47.899198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:37.577252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035674+0000","last_change":"2024-06-10T00:14:42.868290+0000","last_active":"2024-06-10T00:14:48.035674+0000","last_peered":"2024-06-10T00:14:48.035674+0000","last_clean":"2024-06-10T00:14:48.035674+0000","last_became_active":"2024-06-10T00:14:42.868004+0000","last_became_peered":"2024-06-10T00:14:42.868004+0000","last_unstale":"2024-06-10T00:14:48.035674+0000","last_undegraded":"2024-06-10T00:14:48.035674+0000","last_fullsized":"2024-06-10T00:14:48.035674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898788+0000","last_change":"2024-06-10T00:14:41.865384+0000","last_active":"2024-06-10T00:14:47.898788+0000","last_peered":"2024-06-10T00:14:47.898788+0000","last_clean":"2024-06-10T00:14:47.898788+0000","last_became_active":"2024-06-10T00:14:41.865032+0000","last_became_peered":"2024-06-10T00:14:41.865032+0000","last_unstale":"2024-06-10T00:14:47.898788+0000","last_undegraded":"2024-06-10T00:14:47.898788+0000","last_fullsized":"2024-06-10T00:14:47.898788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016834+0000","last_change":"2024-06-10T00:14:46.886924+0000","last_active":"2024-06-10T00:14:48.016834+0000","last_peered":"2024-06-10T00:14:48.016834+0000","last_clean":"2024-06-10T00:14:48.016834+0000","last_became_active":"2024-06-10T00:14:46.886412+0000","last_became_peered":"2024-06-10T00:14:46.886412+0000","last_unstale":"2024-06-10T00:14:48.016834+0000","last_undegraded":"2024-06-10T00:14:48.016834+0000","last_fullsized":"2024-06-10T00:14:48.016834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:55.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898784+0000","last_change":"2024-06-10T00:14:42.869511+0000","last_active":"2024-06-10T00:14:47.898784+0000","last_peered":"2024-06-10T00:14:47.898784+0000","last_clean":"2024-06-10T00:14:47.898784+0000","last_became_active":"2024-06-10T00:14:42.868972+0000","last_became_peered":"2024-06-10T00:14:42.868972+0000","last_unstale":"2024-06-10T00:14:47.898784+0000","last_undegraded":"2024-06-10T00:14:47.898784+0000","last_fullsized":"2024-06-10T00:14:47.898784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:33.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036681+0000","last_change":"2024-06-10T00:14:41.866593+0000","last_active":"2024-06-10T00:14:48.036681+0000","last_peered":"2024-06-10T00:14:48.036681+0000","last_clean":"2024-06-10T00:14:48.036681+0000","last_became_active":"2024-06-10T00:14:41.866325+0000","last_became_peered":"2024-06-10T00:14:41.866325+0000","last_unstale":"2024-06-10T00:14:48.036681+0000","last_undegraded":"2024-06-10T00:14:48.036681+0000","last_fullsized":"2024-06-10T00:14:48.036681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016738+0000","last_change":"2024-06-10T00:14:46.990368+0000","last_active":"2024-06-10T00:14:48.016738+0000","last_peered":"2024-06-10T00:14:48.016738+0000","last_clean":"2024-06-10T00:14:48.016738+0000","last_became_active":"2024-06-10T00:14:46.989951+0000","last_became_peered":"2024-06-10T00:14:46.989951+0000","last_unstale":"2024-06-10T00:14:48.016738+0000","last_undegraded":"2024-06-10T00:14:48.016738+0000","last_fullsized":"2024-06-10T00:14:48.016738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:56:04.088356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035504+0000","last_change":"2024-06-10T00:14:46.990321+0000","last_active":"2024-06-10T00:14:48.035504+0000","last_peered":"2024-06-10T00:14:48.035504+0000","last_clean":"2024-06-10T00:14:48.035504+0000","last_became_active":"2024-06-10T00:14:46.989969+0000","last_became_peered":"2024-06-10T00:14:46.989969+0000","last_unstale":"2024-06-10T00:14:48.035504+0000","last_undegraded":"2024-06-10T00:14:48.035504+0000","last_fullsized":"2024-06-10T00:14:48.035504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:08.929668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035435+0000","last_change":"2024-06-10T00:14:42.876343+0000","last_active":"2024-06-10T00:14:48.035435+0000","last_peered":"2024-06-10T00:14:48.035435+0000","last_clean":"2024-06-10T00:14:48.035435+0000","last_became_active":"2024-06-10T00:14:42.876035+0000","last_became_peered":"2024-06-10T00:14:42.876035+0000","last_unstale":"2024-06-10T00:14:48.035435+0000","last_undegraded":"2024-06-10T00:14:48.035435+0000","last_fullsized":"2024-06-10T00:14:48.035435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898153+0000","last_change":"2024-06-10T00:14:41.856933+0000","last_active":"2024-06-10T00:14:47.898153+0000","last_peered":"2024-06-10T00:14:47.898153+0000","last_clean":"2024-06-10T00:14:47.898153+0000","last_became_active":"2024-06-10T00:14:41.856621+0000","last_became_peered":"2024-06-10T00:14:41.856621+0000","last_unstale":"2024-06-10T00:14:47.898153+0000","last_undegraded":"2024-06-10T00:14:47.898153+0000","last_fullsized":"2024-06-10T00:14:47.898153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036551+0000","last_change":"2024-06-10T00:14:46.889437+0000","last_active":"2024-06-10T00:14:48.036551+0000","last_peered":"2024-06-10T00:14:48.036551+0000","last_clean":"2024-06-10T00:14:48.036551+0000","last_became_active":"2024-06-10T00:14:46.888842+0000","last_became_peered":"2024-06-10T00:14:46.888842+0000","last_unstale":"2024-06-10T00:14:48.036551+0000","last_undegraded":"2024-06-10T00:14:48.036551+0000","last_fullsized":"2024-06-10T00:14:48.036551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016928+0000","last_change":"2024-06-10T00:14:42.874887+0000","last_active":"2024-06-10T00:14:48.016928+0000","last_peered":"2024-06-10T00:14:48.016928+0000","last_clean":"2024-06-10T00:14:48.016928+0000","last_became_active":"2024-06-10T00:14:42.871122+0000","last_became_peered":"2024-06-10T00:14:42.871122+0000","last_unstale":"2024-06-10T00:14:48.016928+0000","last_undegraded":"2024-06-10T00:14:48.016928+0000","last_fullsized":"2024-06-10T00:14:48.016928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016934+0000","last_change":"2024-06-10T00:14:41.869171+0000","last_active":"2024-06-10T00:14:48.016934+0000","last_peered":"2024-06-10T00:14:48.016934+0000","last_clean":"2024-06-10T00:14:48.016934+0000","last_became_active":"2024-06-10T00:14:41.868845+0000","last_became_peered":"2024-06-10T00:14:41.868845+0000","last_unstale":"2024-06-10T00:14:48.016934+0000","last_undegraded":"2024-06-10T00:14:48.016934+0000","last_fullsized":"2024-06-10T00:14:48.016934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036070+0000","last_change":"2024-06-10T00:14:41.864391+0000","last_active":"2024-06-10T00:14:48.036070+0000","last_peered":"2024-06-10T00:14:48.036070+0000","last_clean":"2024-06-10T00:14:48.036070+0000","last_became_active":"2024-06-10T00:14:41.864117+0000","last_became_peered":"2024-06-10T00:14:41.864117+0000","last_unstale":"2024-06-10T00:14:48.036070+0000","last_undegraded":"2024-06-10T00:14:48.036070+0000","last_fullsized":"2024-06-10T00:14:48.036070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035534+0000","last_change":"2024-06-10T00:14:42.869238+0000","last_active":"2024-06-10T00:14:48.035534+0000","last_peered":"2024-06-10T00:14:48.035534+0000","last_clean":"2024-06-10T00:14:48.035534+0000","last_became_active":"2024-06-10T00:14:42.868630+0000","last_became_peered":"2024-06-10T00:14:42.868630+0000","last_unstale":"2024-06-10T00:14:48.035534+0000","last_undegraded":"2024-06-10T00:14:48.035534+0000","last_fullsized":"2024-06-10T00:14:48.035534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897449+0000","last_change":"2024-06-10T00:14:46.886409+0000","last_active":"2024-06-10T00:14:47.897449+0000","last_peered":"2024-06-10T00:14:47.897449+0000","last_clean":"2024-06-10T00:14:47.897449+0000","last_became_active":"2024-06-10T00:14:46.886014+0000","last_became_peered":"2024-06-10T00:14:46.886014+0000","last_unstale":"2024-06-10T00:14:47.897449+0000","last_undegraded":"2024-06-10T00:14:47.897449+0000","last_fullsized":"2024-06-10T00:14:47.897449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:52.056077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016946+0000","last_change":"2024-06-10T00:14:41.862965+0000","last_active":"2024-06-10T00:14:48.016946+0000","last_peered":"2024-06-10T00:14:48.016946+0000","last_clean":"2024-06-10T00:14:48.016946+0000","last_became_active":"2024-06-10T00:14:41.862590+0000","last_became_peered":"2024-06-10T00:14:41.862590+0000","last_unstale":"2024-06-10T00:14:48.016946+0000","last_undegraded":"2024-06-10T00:14:48.016946+0000","last_fullsized":"2024-06-10T00:14:48.016946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:24:00.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898569+0000","last_change":"2024-06-10T00:14:42.855647+0000","last_active":"2024-06-10T00:14:47.898569+0000","last_peered":"2024-06-10T00:14:47.898569+0000","last_clean":"2024-06-10T00:14:47.898569+0000","last_became_active":"2024-06-10T00:14:42.855378+0000","last_became_peered":"2024-06-10T00:14:42.855378+0000","last_unstale":"2024-06-10T00:14:47.898569+0000","last_undegraded":"2024-06-10T00:14:47.898569+0000","last_fullsized":"2024-06-10T00:14:47.898569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:37.270508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017131+0000","last_change":"2024-06-10T00:14:46.886769+0000","last_active":"2024-06-10T00:14:48.017131+0000","last_peered":"2024-06-10T00:14:48.017131+0000","last_clean":"2024-06-10T00:14:48.017131+0000","last_became_active":"2024-06-10T00:14:46.886389+0000","last_became_peered":"2024-06-10T00:14:46.886389+0000","last_unstale":"2024-06-10T00:14:48.017131+0000","last_undegraded":"2024-06-10T00:14:48.017131+0000","last_fullsized":"2024-06-10T00:14:48.017131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:52.363831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035110+0000","last_change":"2024-06-10T00:14:42.873034+0000","last_active":"2024-06-10T00:14:48.035110+0000","last_peered":"2024-06-10T00:14:48.035110+0000","last_clean":"2024-06-10T00:14:48.035110+0000","last_became_active":"2024-06-10T00:14:42.872750+0000","last_became_peered":"2024-06-10T00:14:42.872750+0000","last_unstale":"2024-06-10T00:14:48.035110+0000","last_undegraded":"2024-06-10T00:14:48.035110+0000","last_fullsized":"2024-06-10T00:14:48.035110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897497+0000","last_change":"2024-06-10T00:14:42.859987+0000","last_active":"2024-06-10T00:14:47.897497+0000","last_peered":"2024-06-10T00:14:47.897497+0000","last_clean":"2024-06-10T00:14:47.897497+0000","last_became_active":"2024-06-10T00:14:42.859713+0000","last_became_peered":"2024-06-10T00:14:42.859713+0000","last_unstale":"2024-06-10T00:14:47.897497+0000","last_undegraded":"2024-06-10T00:14:47.897497+0000","last_fullsized":"2024-06-10T00:14:47.897497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:44.600998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899229+0000","last_change":"2024-06-10T00:14:42.873760+0000","last_active":"2024-06-10T00:14:47.899229+0000","last_peered":"2024-06-10T00:14:47.899229+0000","last_clean":"2024-06-10T00:14:47.899229+0000","last_became_active":"2024-06-10T00:14:42.872329+0000","last_became_peered":"2024-06-10T00:14:42.872329+0000","last_unstale":"2024-06-10T00:14:47.899229+0000","last_undegraded":"2024-06-10T00:14:47.899229+0000","last_fullsized":"2024-06-10T00:14:47.899229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:43.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035479+0000","last_change":"2024-06-10T00:14:42.872717+0000","last_active":"2024-06-10T00:14:48.035479+0000","last_peered":"2024-06-10T00:14:48.035479+0000","last_clean":"2024-06-10T00:14:48.035479+0000","last_became_active":"2024-06-10T00:14:42.872465+0000","last_became_peered":"2024-06-10T00:14:42.872465+0000","last_unstale":"2024-06-10T00:14:48.035479+0000","last_undegraded":"2024-06-10T00:14:48.035479+0000","last_fullsized":"2024-06-10T00:14:48.035479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017308+0000","last_change":"2024-06-10T00:14:42.871847+0000","last_active":"2024-06-10T00:14:48.017308+0000","last_peered":"2024-06-10T00:14:48.017308+0000","last_clean":"2024-06-10T00:14:48.017308+0000","last_became_active":"2024-06-10T00:14:42.871547+0000","last_became_peered":"2024-06-10T00:14:42.871547+0000","last_unstale":"2024-06-10T00:14:48.017308+0000","last_undegraded":"2024-06-10T00:14:48.017308+0000","last_fullsized":"2024-06-10T00:14:48.017308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:11.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036114+0000","last_change":"2024-06-10T00:14:42.866392+0000","last_active":"2024-06-10T00:14:48.036114+0000","last_peered":"2024-06-10T00:14:48.036114+0000","last_clean":"2024-06-10T00:14:48.036114+0000","last_became_active":"2024-06-10T00:14:42.866117+0000","last_became_peered":"2024-06-10T00:14:42.866117+0000","last_unstale":"2024-06-10T00:14:48.036114+0000","last_undegraded":"2024-06-10T00:14:48.036114+0000","last_fullsized":"2024-06-10T00:14:48.036114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036529+0000","last_change":"2024-06-10T00:14:42.876259+0000","last_active":"2024-06-10T00:14:48.036529+0000","last_peered":"2024-06-10T00:14:48.036529+0000","last_clean":"2024-06-10T00:14:48.036529+0000","last_became_active":"2024-06-10T00:14:42.875796+0000","last_became_peered":"2024-06-10T00:14:42.875796+0000","last_unstale":"2024-06-10T00:14:48.036529+0000","last_undegraded":"2024-06-10T00:14:48.036529+0000","last_fullsized":"2024-06-10T00:14:48.036529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017440+0000","last_change":"2024-06-10T00:14:42.874760+0000","last_active":"2024-06-10T00:14:48.017440+0000","last_peered":"2024-06-10T00:14:48.017440+0000","last_clean":"2024-06-10T00:14:48.017440+0000","last_became_active":"2024-06-10T00:14:42.871905+0000","last_became_peered":"2024-06-10T00:14:42.871905+0000","last_unstale":"2024-06-10T00:14:48.017440+0000","last_undegraded":"2024-06-10T00:14:48.017440+0000","last_fullsized":"2024-06-10T00:14:48.017440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898045+0000","last_change":"2024-06-10T00:14:42.873446+0000","last_active":"2024-06-10T00:14:47.898045+0000","last_peered":"2024-06-10T00:14:47.898045+0000","last_clean":"2024-06-10T00:14:47.898045+0000","last_became_active":"2024-06-10T00:14:42.872821+0000","last_became_peered":"2024-06-10T00:14:42.872821+0000","last_unstale":"2024-06-10T00:14:47.898045+0000","last_undegraded":"2024-06-10T00:14:47.898045+0000","last_fullsized":"2024-06-10T00:14:47.898045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016840+0000","last_change":"2024-06-10T00:14:42.875401+0000","last_active":"2024-06-10T00:14:48.016840+0000","last_peered":"2024-06-10T00:14:48.016840+0000","last_clean":"2024-06-10T00:14:48.016840+0000","last_became_active":"2024-06-10T00:14:42.875112+0000","last_became_peered":"2024-06-10T00:14:42.875112+0000","last_unstale":"2024-06-10T00:14:48.016840+0000","last_undegraded":"2024-06-10T00:14:48.016840+0000","last_fullsized":"2024-06-10T00:14:48.016840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899128+0000","last_change":"2024-06-10T00:14:42.870273+0000","last_active":"2024-06-10T00:14:47.899128+0000","last_peered":"2024-06-10T00:14:47.899128+0000","last_clean":"2024-06-10T00:14:47.899128+0000","last_became_active":"2024-06-10T00:14:42.869992+0000","last_became_peered":"2024-06-10T00:14:42.869992+0000","last_unstale":"2024-06-10T00:14:47.899128+0000","last_undegraded":"2024-06-10T00:14:47.899128+0000","last_fullsized":"2024-06-10T00:14:47.899128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:01.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035242+0000","last_change":"2024-06-10T00:14:42.874258+0000","last_active":"2024-06-10T00:14:48.035242+0000","last_peered":"2024-06-10T00:14:48.035242+0000","last_clean":"2024-06-10T00:14:48.035242+0000","last_became_active":"2024-06-10T00:14:42.873693+0000","last_became_peered":"2024-06-10T00:14:42.873693+0000","last_unstale":"2024-06-10T00:14:48.035242+0000","last_undegraded":"2024-06-10T00:14:48.035242+0000","last_fullsized":"2024-06-10T00:14:48.035242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036422+0000","last_change":"2024-06-10T00:14:42.874380+0000","last_active":"2024-06-10T00:14:48.036422+0000","last_peered":"2024-06-10T00:14:48.036422+0000","last_clean":"2024-06-10T00:14:48.036422+0000","last_became_active":"2024-06-10T00:14:42.873982+0000","last_became_peered":"2024-06-10T00:14:42.873982+0000","last_unstale":"2024-06-10T00:14:48.036422+0000","last_undegraded":"2024-06-10T00:14:48.036422+0000","last_fullsized":"2024-06-10T00:14:48.036422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035822+0000","last_change":"2024-06-10T00:14:42.877427+0000","last_active":"2024-06-10T00:14:48.035822+0000","last_peered":"2024-06-10T00:14:48.035822+0000","last_clean":"2024-06-10T00:14:48.035822+0000","last_became_active":"2024-06-10T00:14:42.877128+0000","last_became_peered":"2024-06-10T00:14:42.877128+0000","last_unstale":"2024-06-10T00:14:48.035822+0000","last_undegraded":"2024-06-10T00:14:48.035822+0000","last_fullsized":"2024-06-10T00:14:48.035822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:12.737454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897679+0000","last_change":"2024-06-10T00:14:42.877136+0000","last_active":"2024-06-10T00:14:47.897679+0000","last_peered":"2024-06-10T00:14:47.897679+0000","last_clean":"2024-06-10T00:14:47.897679+0000","last_became_active":"2024-06-10T00:14:42.876880+0000","last_became_peered":"2024-06-10T00:14:42.876880+0000","last_unstale":"2024-06-10T00:14:47.897679+0000","last_undegraded":"2024-06-10T00:14:47.897679+0000","last_fullsized":"2024-06-10T00:14:47.897679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:05.350314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899309+0000","last_change":"2024-06-10T00:14:42.868563+0000","last_active":"2024-06-10T00:14:47.899309+0000","last_peered":"2024-06-10T00:14:47.899309+0000","last_clean":"2024-06-10T00:14:47.899309+0000","last_became_active":"2024-06-10T00:14:42.868301+0000","last_became_peered":"2024-06-10T00:14:42.868301+0000","last_unstale":"2024-06-10T00:14:47.899309+0000","last_undegraded":"2024-06-10T00:14:47.899309+0000","last_fullsized":"2024-06-10T00:14:47.899309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:32.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897802+0000","last_change":"2024-06-10T00:14:42.861856+0000","last_active":"2024-06-10T00:14:47.897802+0000","last_peered":"2024-06-10T00:14:47.897802+0000","last_clean":"2024-06-10T00:14:47.897802+0000","last_became_active":"2024-06-10T00:14:42.861585+0000","last_became_peered":"2024-06-10T00:14:42.861585+0000","last_unstale":"2024-06-10T00:14:47.897802+0000","last_undegraded":"2024-06-10T00:14:47.897802+0000","last_fullsized":"2024-06-10T00:14:47.897802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035530+0000","last_change":"2024-06-10T00:14:42.860405+0000","last_active":"2024-06-10T00:14:48.035530+0000","last_peered":"2024-06-10T00:14:48.035530+0000","last_clean":"2024-06-10T00:14:48.035530+0000","last_became_active":"2024-06-10T00:14:42.860149+0000","last_became_peered":"2024-06-10T00:14:42.860149+0000","last_unstale":"2024-06-10T00:14:48.035530+0000","last_undegraded":"2024-06-10T00:14:48.035530+0000","last_fullsized":"2024-06-10T00:14:48.035530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035085+0000","last_change":"2024-06-10T00:14:42.865461+0000","last_active":"2024-06-10T00:14:48.035085+0000","last_peered":"2024-06-10T00:14:48.035085+0000","last_clean":"2024-06-10T00:14:48.035085+0000","last_became_active":"2024-06-10T00:14:42.864928+0000","last_became_peered":"2024-06-10T00:14:42.864928+0000","last_unstale":"2024-06-10T00:14:48.035085+0000","last_undegraded":"2024-06-10T00:14:48.035085+0000","last_fullsized":"2024-06-10T00:14:48.035085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:48.031418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016831+0000","last_change":"2024-06-10T00:14:42.874662+0000","last_active":"2024-06-10T00:14:48.016831+0000","last_peered":"2024-06-10T00:14:48.016831+0000","last_clean":"2024-06-10T00:14:48.016831+0000","last_became_active":"2024-06-10T00:14:42.871319+0000","last_became_peered":"2024-06-10T00:14:42.871319+0000","last_unstale":"2024-06-10T00:14:48.016831+0000","last_undegraded":"2024-06-10T00:14:48.016831+0000","last_fullsized":"2024-06-10T00:14:48.016831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899567+0000","last_change":"2024-06-10T00:14:42.876016+0000","last_active":"2024-06-10T00:14:47.899567+0000","last_peered":"2024-06-10T00:14:47.899567+0000","last_clean":"2024-06-10T00:14:47.899567+0000","last_became_active":"2024-06-10T00:14:42.875737+0000","last_became_peered":"2024-06-10T00:14:42.875737+0000","last_unstale":"2024-06-10T00:14:47.899567+0000","last_undegraded":"2024-06-10T00:14:47.899567+0000","last_fullsized":"2024-06-10T00:14:47.899567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:05.350314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036628+0000","last_change":"2024-06-10T00:14:42.871720+0000","last_active":"2024-06-10T00:14:48.036628+0000","last_peered":"2024-06-10T00:14:48.036628+0000","last_clean":"2024-06-10T00:14:48.036628+0000","last_became_active":"2024-06-10T00:14:42.871436+0000","last_became_peered":"2024-06-10T00:14:42.871436+0000","last_unstale":"2024-06-10T00:14:48.036628+0000","last_undegraded":"2024-06-10T00:14:48.036628+0000","last_fullsized":"2024-06-10T00:14:48.036628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036473+0000","last_change":"2024-06-10T00:14:42.876040+0000","last_active":"2024-06-10T00:14:48.036473+0000","last_peered":"2024-06-10T00:14:48.036473+0000","last_clean":"2024-06-10T00:14:48.036473+0000","last_became_active":"2024-06-10T00:14:42.875415+0000","last_became_peered":"2024-06-10T00:14:42.875415+0000","last_unstale":"2024-06-10T00:14:48.036473+0000","last_undegraded":"2024-06-10T00:14:48.036473+0000","last_fullsized":"2024-06-10T00:14:48.036473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035992+0000","last_change":"2024-06-10T00:14:42.878916+0000","last_active":"2024-06-10T00:14:48.035992+0000","last_peered":"2024-06-10T00:14:48.035992+0000","last_clean":"2024-06-10T00:14:48.035992+0000","last_became_active":"2024-06-10T00:14:42.878614+0000","last_became_peered":"2024-06-10T00:14:42.878614+0000","last_unstale":"2024-06-10T00:14:48.035992+0000","last_undegraded":"2024-06-10T00:14:48.035992+0000","last_fullsized":"2024-06-10T00:14:48.035992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:32.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016672+0000","last_change":"2024-06-10T00:14:42.871267+0000","last_active":"2024-06-10T00:14:48.016672+0000","last_peered":"2024-06-10T00:14:48.016672+0000","last_clean":"2024-06-10T00:14:48.016672+0000","last_became_active":"2024-06-10T00:14:42.870655+0000","last_became_peered":"2024-06-10T00:14:42.870655+0000","last_unstale":"2024-06-10T00:14:48.016672+0000","last_undegraded":"2024-06-10T00:14:48.016672+0000","last_fullsized":"2024-06-10T00:14:48.016672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035895+0000","last_change":"2024-06-10T00:14:42.872799+0000","last_active":"2024-06-10T00:14:48.035895+0000","last_peered":"2024-06-10T00:14:48.035895+0000","last_clean":"2024-06-10T00:14:48.035895+0000","last_became_active":"2024-06-10T00:14:42.872353+0000","last_became_peered":"2024-06-10T00:14:42.872353+0000","last_unstale":"2024-06-10T00:14:48.035895+0000","last_undegraded":"2024-06-10T00:14:48.035895+0000","last_fullsized":"2024-06-10T00:14:48.035895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899012+0000","last_change":"2024-06-10T00:14:42.861048+0000","last_active":"2024-06-10T00:14:47.899012+0000","last_peered":"2024-06-10T00:14:47.899012+0000","last_clean":"2024-06-10T00:14:47.899012+0000","last_became_active":"2024-06-10T00:14:42.860760+0000","last_became_peered":"2024-06-10T00:14:42.860760+0000","last_unstale":"2024-06-10T00:14:47.899012+0000","last_undegraded":"2024-06-10T00:14:47.899012+0000","last_fullsized":"2024-06-10T00:14:47.899012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035369+0000","last_change":"2024-06-10T00:14:42.876850+0000","last_active":"2024-06-10T00:14:48.035369+0000","last_peered":"2024-06-10T00:14:48.035369+0000","last_clean":"2024-06-10T00:14:48.035369+0000","last_became_active":"2024-06-10T00:14:42.876562+0000","last_became_peered":"2024-06-10T00:14:42.876562+0000","last_unstale":"2024-06-10T00:14:48.035369+0000","last_undegraded":"2024-06-10T00:14:48.035369+0000","last_fullsized":"2024-06-10T00:14:48.035369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898301+0000","last_change":"2024-06-10T00:14:42.872870+0000","last_active":"2024-06-10T00:14:47.898301+0000","last_peered":"2024-06-10T00:14:47.898301+0000","last_clean":"2024-06-10T00:14:47.898301+0000","last_became_active":"2024-06-10T00:14:42.872366+0000","last_became_peered":"2024-06-10T00:14:42.872366+0000","last_unstale":"2024-06-10T00:14:47.898301+0000","last_undegraded":"2024-06-10T00:14:47.898301+0000","last_fullsized":"2024-06-10T00:14:47.898301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:12.737454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035393+0000","last_change":"2024-06-10T00:14:42.870759+0000","last_active":"2024-06-10T00:14:48.035393+0000","last_peered":"2024-06-10T00:14:48.035393+0000","last_clean":"2024-06-10T00:14:48.035393+0000","last_became_active":"2024-06-10T00:14:42.869435+0000","last_became_peered":"2024-06-10T00:14:42.869435+0000","last_unstale":"2024-06-10T00:14:48.035393+0000","last_undegraded":"2024-06-10T00:14:48.035393+0000","last_fullsized":"2024-06-10T00:14:48.035393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:31:36.092116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036201+0000","last_change":"2024-06-10T00:14:42.863072+0000","last_active":"2024-06-10T00:14:48.036201+0000","last_peered":"2024-06-10T00:14:48.036201+0000","last_clean":"2024-06-10T00:14:48.036201+0000","last_became_active":"2024-06-10T00:14:42.862795+0000","last_became_peered":"2024-06-10T00:14:42.862795+0000","last_unstale":"2024-06-10T00:14:48.036201+0000","last_undegraded":"2024-06-10T00:14:48.036201+0000","last_fullsized":"2024-06-10T00:14:48.036201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035900+0000","last_change":"2024-06-10T00:14:42.880389+0000","last_active":"2024-06-10T00:14:48.035900+0000","last_peered":"2024-06-10T00:14:48.035900+0000","last_clean":"2024-06-10T00:14:48.035900+0000","last_became_active":"2024-06-10T00:14:42.880129+0000","last_became_peered":"2024-06-10T00:14:42.880129+0000","last_unstale":"2024-06-10T00:14:48.035900+0000","last_undegraded":"2024-06-10T00:14:48.035900+0000","last_fullsized":"2024-06-10T00:14:48.035900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:04.905009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:02.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:03.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.048+0000 7f37b8177640 1 Processor -- start 2024-06-10T00:15:03.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.048+0000 7f37b8177640 1 -- start start 2024-06-10T00:15:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.048+0000 7f37b8177640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37b015f1a0 0x7f37b00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b8177640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00cef70 0x7f37b00cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b8177640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b015f5e0 con 0x7f37b00d2680 2024-06-10T00:15:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b8177640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f37b00d13e0 con 0x7f37b015f1a0 2024-06-10T00:15:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b8177640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f37b00d0ad0 con 0x7f37b00cef70 2024-06-10T00:15:03.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b5712640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37b015f1a0 0x7f37b00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b5712640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37b015f1a0 0x7f37b00d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36510/0 (socket says 172.21.15.79:36510) 2024-06-10T00:15:03.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b5712640 1 -- 172.21.15.79:0/1843819137 learned_addr learned my addr 172.21.15.79:0/1843819137 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:03.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b6714640 1 --2- 172.21.15.79:0/1843819137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00cef70 0x7f37b00cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b5712640 1 -- 172.21.15.79:0/1843819137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00cef70 msgr2=0x7f37b00cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:03.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b5712640 1 --2- 172.21.15.79:0/1843819137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00cef70 0x7f37b00cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b5712640 1 -- 172.21.15.79:0/1843819137 >> v1:172.21.15.117:6789/0 conn(0x7f37b00d2680 legacy=0x7f37b00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:03.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b5712640 1 -- 172.21.15.79:0/1843819137 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b015f890 con 0x7f37b015f1a0 2024-06-10T00:15:03.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.049+0000 7f37b6714640 1 --2- 172.21.15.79:0/1843819137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00cef70 0x7f37b00cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:03.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b5712640 1 --2- 172.21.15.79:0/1843819137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b00d1fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009870 tx=0x7f37a402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5dadfc191d40af server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b4f11640 1 -- 172.21.15.79:0/1843819137 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4037070 con 0x7f37b015f1a0 2024-06-10T00:15:03.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b4f11640 1 -- 172.21.15.79:0/1843819137 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a4032440 con 0x7f37b015f1a0 2024-06-10T00:15:03.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b4f11640 1 -- 172.21.15.79:0/1843819137 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4032810 con 0x7f37b015f1a0 2024-06-10T00:15:03.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b8177640 1 -- 172.21.15.79:0/1843819137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 msgr2=0x7f37b00d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b8177640 1 --2- 172.21.15.79:0/1843819137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b00d1fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009870 tx=0x7f37a402a210 comp rx=0 tx=0).stop 2024-06-10T00:15:03.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b8177640 1 -- 172.21.15.79:0/1843819137 shutdown_connections 2024-06-10T00:15:03.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b8177640 1 --2- 172.21.15.79:0/1843819137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00cef70 0x7f37b00cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b8177640 1 --2- 172.21.15.79:0/1843819137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b00d1fc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b8177640 1 -- 172.21.15.79:0/1843819137 >> 172.21.15.79:0/1843819137 conn(0x7f37b009d3f0 msgr2=0x7f37b00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:03.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b8177640 1 -- 172.21.15.79:0/1843819137 shutdown_connections 2024-06-10T00:15:03.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.050+0000 7f37b8177640 1 -- 172.21.15.79:0/1843819137 wait complete. 2024-06-10T00:15:03.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b8177640 1 Processor -- start 2024-06-10T00:15:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b8177640 1 -- start start 2024-06-10T00:15:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b8177640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37b00cef70 0x7f37b00cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b8177640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00d2680 0x7f37b015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b8177640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b8177640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f37b00d4f00 con 0x7f37b015f1a0 2024-06-10T00:15:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b8177640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f37b00d1070 con 0x7f37b00cef70 2024-06-10T00:15:03.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b8177640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f37b00d1870 con 0x7f37b00d2680 2024-06-10T00:15:03.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b6714640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b6714640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b015b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36512/0 (socket says 172.21.15.79:36512) 2024-06-10T00:15:03.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b6714640 1 -- 172.21.15.79:0/3229339964 learned_addr learned my addr 172.21.15.79:0/3229339964 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:03.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b5f13640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37b00cef70 0x7f37b00cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.052+0000 7f37b5712640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00d2680 0x7f37b015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37b6714640 1 -- 172.21.15.79:0/3229339964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00d2680 msgr2=0x7f37b015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37b6714640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00d2680 0x7f37b015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37b6714640 1 -- 172.21.15.79:0/3229339964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37b00cef70 msgr2=0x7f37b00cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37b6714640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37b00cef70 0x7f37b00cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37b6714640 1 -- 172.21.15.79:0/3229339964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b01f4820 con 0x7f37b015f1a0 2024-06-10T00:15:03.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37b6714640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b015b800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f37a000cef0 tx=0x7f37a000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37ae7fc640 1 -- 172.21.15.79:0/3229339964 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a001a070 con 0x7f37b015f1a0 2024-06-10T00:15:03.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37ae7fc640 1 -- 172.21.15.79:0/3229339964 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a000d860 con 0x7f37b015f1a0 2024-06-10T00:15:03.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b015d020 con 0x7f37b015f1a0 2024-06-10T00:15:03.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37ae7fc640 1 -- 172.21.15.79:0/3229339964 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a000dc50 con 0x7f37b015f1a0 2024-06-10T00:15:03.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.053+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b00cb330 con 0x7f37b015f1a0 2024-06-10T00:15:03.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.054+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b0068430 con 0x7f37b015f1a0 2024-06-10T00:15:03.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.054+0000 7f37ae7fc640 1 -- 172.21.15.79:0/3229339964 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37a001d070 con 0x7f37b015f1a0 2024-06-10T00:15:03.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.055+0000 7f37ae7fc640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.055+0000 7f37ae7fc640 1 -- 172.21.15.79:0/3229339964 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f37a008b940 con 0x7f37b015f1a0 2024-06-10T00:15:03.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.055+0000 7f37b5f13640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.055+0000 7f37b5f13640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f379c06be30 0x7f379c06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37a8004f60 tx=0x7f37a8007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.059+0000 7f37ae7fc640 1 -- 172.21.15.79:0/3229339964 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f37a0059ab0 con 0x7f37b015f1a0 2024-06-10T00:15:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.231+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37b00d04e0 con 0x7f379c06be30 2024-06-10T00:15:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.238+0000 7f37ae7fc640 1 -- 172.21.15.79:0/3229339964 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f37b00d04e0 con 0x7f379c06be30 2024-06-10T00:15:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:03.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f379c06be30 msgr2=0x7f379c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f379c06be30 0x7f379c06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37a8004f60 tx=0x7f37a8007e30 comp rx=0 tx=0).stop 2024-06-10T00:15:03.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 msgr2=0x7f37b015b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b015b800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f37a000cef0 tx=0x7f37a000a710 comp rx=0 tx=0).stop 2024-06-10T00:15:03.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 shutdown_connections 2024-06-10T00:15:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37b015f1a0 0x7f37b015b800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37b00d2680 0x7f37b015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 --2- 172.21.15.79:0/3229339964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37b00cef70 0x7f37b00cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 >> 172.21.15.79:0/3229339964 conn(0x7f37b009d3f0 msgr2=0x7f37b00b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 shutdown_connections 2024-06-10T00:15:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.242+0000 7f37b8177640 1 -- 172.21.15.79:0/3229339964 wait complete. 2024-06-10T00:15:03.252 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-06-10T00:15:03.151166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003130"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035823+0000","last_change":"2024-06-10T00:14:41.867016+0000","last_active":"2024-06-10T00:14:48.035823+0000","last_peered":"2024-06-10T00:14:48.035823+0000","last_clean":"2024-06-10T00:14:48.035823+0000","last_became_active":"2024-06-10T00:14:41.866719+0000","last_became_peered":"2024-06-10T00:14:41.866719+0000","last_unstale":"2024-06-10T00:14:48.035823+0000","last_undegraded":"2024-06-10T00:14:48.035823+0000","last_fullsized":"2024-06-10T00:14:48.035823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:24:00.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017302+0000","last_change":"2024-06-10T00:14:42.878734+0000","last_active":"2024-06-10T00:14:48.017302+0000","last_peered":"2024-06-10T00:14:48.017302+0000","last_clean":"2024-06-10T00:14:48.017302+0000","last_became_active":"2024-06-10T00:14:42.878470+0000","last_became_peered":"2024-06-10T00:14:42.878470+0000","last_unstale":"2024-06-10T00:14:48.017302+0000","last_undegraded":"2024-06-10T00:14:48.017302+0000","last_fullsized":"2024-06-10T00:14:48.017302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016668+0000","last_change":"2024-06-10T00:14:46.991114+0000","last_active":"2024-06-10T00:14:48.016668+0000","last_peered":"2024-06-10T00:14:48.016668+0000","last_clean":"2024-06-10T00:14:48.016668+0000","last_became_active":"2024-06-10T00:14:46.990705+0000","last_became_peered":"2024-06-10T00:14:46.990705+0000","last_unstale":"2024-06-10T00:14:48.016668+0000","last_undegraded":"2024-06-10T00:14:48.016668+0000","last_fullsized":"2024-06-10T00:14:48.016668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:53:49.602835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017392+0000","last_change":"2024-06-10T00:14:41.862823+0000","last_active":"2024-06-10T00:14:48.017392+0000","last_peered":"2024-06-10T00:14:48.017392+0000","last_clean":"2024-06-10T00:14:48.017392+0000","last_became_active":"2024-06-10T00:14:41.862550+0000","last_became_peered":"2024-06-10T00:14:41.862550+0000","last_unstale":"2024-06-10T00:14:48.017392+0000","last_undegraded":"2024-06-10T00:14:48.017392+0000","last_fullsized":"2024-06-10T00:14:48.017392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:32:16.264432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035521+0000","last_change":"2024-06-10T00:14:42.869043+0000","last_active":"2024-06-10T00:14:48.035521+0000","last_peered":"2024-06-10T00:14:48.035521+0000","last_clean":"2024-06-10T00:14:48.035521+0000","last_became_active":"2024-06-10T00:14:42.868643+0000","last_became_peered":"2024-06-10T00:14:42.868643+0000","last_unstale":"2024-06-10T00:14:48.035521+0000","last_undegraded":"2024-06-10T00:14:48.035521+0000","last_fullsized":"2024-06-10T00:14:48.035521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897961+0000","last_change":"2024-06-10T00:14:46.888840+0000","last_active":"2024-06-10T00:14:47.897961+0000","last_peered":"2024-06-10T00:14:47.897961+0000","last_clean":"2024-06-10T00:14:47.897961+0000","last_became_active":"2024-06-10T00:14:46.888089+0000","last_became_peered":"2024-06-10T00:14:46.888089+0000","last_unstale":"2024-06-10T00:14:47.897961+0000","last_undegraded":"2024-06-10T00:14:47.897961+0000","last_fullsized":"2024-06-10T00:14:47.897961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:51.568143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035749+0000","last_change":"2024-06-10T00:14:41.865458+0000","last_active":"2024-06-10T00:14:48.035749+0000","last_peered":"2024-06-10T00:14:48.035749+0000","last_clean":"2024-06-10T00:14:48.035749+0000","last_became_active":"2024-06-10T00:14:41.865040+0000","last_became_peered":"2024-06-10T00:14:41.865040+0000","last_unstale":"2024-06-10T00:14:48.035749+0000","last_undegraded":"2024-06-10T00:14:48.035749+0000","last_fullsized":"2024-06-10T00:14:48.035749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:04.344977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898593+0000","last_change":"2024-06-10T00:14:42.859102+0000","last_active":"2024-06-10T00:14:47.898593+0000","last_peered":"2024-06-10T00:14:47.898593+0000","last_clean":"2024-06-10T00:14:47.898593+0000","last_became_active":"2024-06-10T00:14:42.858811+0000","last_became_peered":"2024-06-10T00:14:42.858811+0000","last_unstale":"2024-06-10T00:14:47.898593+0000","last_undegraded":"2024-06-10T00:14:47.898593+0000","last_fullsized":"2024-06-10T00:14:47.898593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:04.905009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898969+0000","last_change":"2024-06-10T00:14:46.889397+0000","last_active":"2024-06-10T00:14:47.898969+0000","last_peered":"2024-06-10T00:14:47.898969+0000","last_clean":"2024-06-10T00:14:47.898969+0000","last_became_active":"2024-06-10T00:14:46.888054+0000","last_became_peered":"2024-06-10T00:14:46.888054+0000","last_unstale":"2024-06-10T00:14:47.898969+0000","last_undegraded":"2024-06-10T00:14:47.898969+0000","last_fullsized":"2024-06-10T00:14:47.898969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:30.058992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035367+0000","last_change":"2024-06-10T00:14:41.866377+0000","last_active":"2024-06-10T00:14:48.035367+0000","last_peered":"2024-06-10T00:14:48.035367+0000","last_clean":"2024-06-10T00:14:48.035367+0000","last_became_active":"2024-06-10T00:14:41.865036+0000","last_became_peered":"2024-06-10T00:14:41.865036+0000","last_unstale":"2024-06-10T00:14:48.035367+0000","last_undegraded":"2024-06-10T00:14:48.035367+0000","last_fullsized":"2024-06-10T00:14:48.035367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899160+0000","last_change":"2024-06-10T00:14:42.860024+0000","last_active":"2024-06-10T00:14:47.899160+0000","last_peered":"2024-06-10T00:14:47.899160+0000","last_clean":"2024-06-10T00:14:47.899160+0000","last_became_active":"2024-06-10T00:14:42.859406+0000","last_became_peered":"2024-06-10T00:14:42.859406+0000","last_unstale":"2024-06-10T00:14:47.899160+0000","last_undegraded":"2024-06-10T00:14:47.899160+0000","last_fullsized":"2024-06-10T00:14:47.899160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:11.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898485+0000","last_change":"2024-06-10T00:14:46.886019+0000","last_active":"2024-06-10T00:14:47.898485+0000","last_peered":"2024-06-10T00:14:47.898485+0000","last_clean":"2024-06-10T00:14:47.898485+0000","last_became_active":"2024-06-10T00:14:46.885548+0000","last_became_peered":"2024-06-10T00:14:46.885548+0000","last_unstale":"2024-06-10T00:14:47.898485+0000","last_undegraded":"2024-06-10T00:14:47.898485+0000","last_fullsized":"2024-06-10T00:14:47.898485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:13.328779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035910+0000","last_change":"2024-06-10T00:14:42.874737+0000","last_active":"2024-06-10T00:14:48.035910+0000","last_peered":"2024-06-10T00:14:48.035910+0000","last_clean":"2024-06-10T00:14:48.035910+0000","last_became_active":"2024-06-10T00:14:42.874456+0000","last_became_peered":"2024-06-10T00:14:42.874456+0000","last_unstale":"2024-06-10T00:14:48.035910+0000","last_undegraded":"2024-06-10T00:14:48.035910+0000","last_fullsized":"2024-06-10T00:14:48.035910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035758+0000","last_change":"2024-06-10T00:14:41.867017+0000","last_active":"2024-06-10T00:14:48.035758+0000","last_peered":"2024-06-10T00:14:48.035758+0000","last_clean":"2024-06-10T00:14:48.035758+0000","last_became_active":"2024-06-10T00:14:41.866615+0000","last_became_peered":"2024-06-10T00:14:41.866615+0000","last_unstale":"2024-06-10T00:14:48.035758+0000","last_undegraded":"2024-06-10T00:14:48.035758+0000","last_fullsized":"2024-06-10T00:14:48.035758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899866+0000","last_change":"2024-06-10T00:14:46.887357+0000","last_active":"2024-06-10T00:14:47.899866+0000","last_peered":"2024-06-10T00:14:47.899866+0000","last_clean":"2024-06-10T00:14:47.899866+0000","last_became_active":"2024-06-10T00:14:46.886828+0000","last_became_peered":"2024-06-10T00:14:46.886828+0000","last_unstale":"2024-06-10T00:14:47.899866+0000","last_undegraded":"2024-06-10T00:14:47.899866+0000","last_fullsized":"2024-06-10T00:14:47.899866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016853+0000","last_change":"2024-06-10T00:14:42.874437+0000","last_active":"2024-06-10T00:14:48.016853+0000","last_peered":"2024-06-10T00:14:48.016853+0000","last_clean":"2024-06-10T00:14:48.016853+0000","last_became_active":"2024-06-10T00:14:42.871485+0000","last_became_peered":"2024-06-10T00:14:42.871485+0000","last_unstale":"2024-06-10T00:14:48.016853+0000","last_undegraded":"2024-06-10T00:14:48.016853+0000","last_fullsized":"2024-06-10T00:14:48.016853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036080+0000","last_change":"2024-06-10T00:14:41.860772+0000","last_active":"2024-06-10T00:14:48.036080+0000","last_peered":"2024-06-10T00:14:48.036080+0000","last_clean":"2024-06-10T00:14:48.036080+0000","last_became_active":"2024-06-10T00:14:41.860372+0000","last_became_peered":"2024-06-10T00:14:41.860372+0000","last_unstale":"2024-06-10T00:14:48.036080+0000","last_undegraded":"2024-06-10T00:14:48.036080+0000","last_fullsized":"2024-06-10T00:14:48.036080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898238+0000","last_change":"2024-06-10T00:14:46.888544+0000","last_active":"2024-06-10T00:14:47.898238+0000","last_peered":"2024-06-10T00:14:47.898238+0000","last_clean":"2024-06-10T00:14:47.898238+0000","last_became_active":"2024-06-10T00:14:46.887972+0000","last_became_peered":"2024-06-10T00:14:46.887972+0000","last_unstale":"2024-06-10T00:14:47.898238+0000","last_undegraded":"2024-06-10T00:14:47.898238+0000","last_fullsized":"2024-06-10T00:14:47.898238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:46.828253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016970+0000","last_change":"2024-06-10T00:14:42.871661+0000","last_active":"2024-06-10T00:14:48.016970+0000","last_peered":"2024-06-10T00:14:48.016970+0000","last_clean":"2024-06-10T00:14:48.016970+0000","last_became_active":"2024-06-10T00:14:42.870944+0000","last_became_peered":"2024-06-10T00:14:42.870944+0000","last_unstale":"2024-06-10T00:14:48.016970+0000","last_undegraded":"2024-06-10T00:14:48.016970+0000","last_fullsized":"2024-06-10T00:14:48.016970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035625+0000","last_change":"2024-06-10T00:14:41.863225+0000","last_active":"2024-06-10T00:14:48.035625+0000","last_peered":"2024-06-10T00:14:48.035625+0000","last_clean":"2024-06-10T00:14:48.035625+0000","last_became_active":"2024-06-10T00:14:41.862940+0000","last_became_peered":"2024-06-10T00:14:41.862940+0000","last_unstale":"2024-06-10T00:14:48.035625+0000","last_undegraded":"2024-06-10T00:14:48.035625+0000","last_fullsized":"2024-06-10T00:14:48.035625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036483+0000","last_change":"2024-06-10T00:14:46.990813+0000","last_active":"2024-06-10T00:14:48.036483+0000","last_peered":"2024-06-10T00:14:48.036483+0000","last_clean":"2024-06-10T00:14:48.036483+0000","last_became_active":"2024-06-10T00:14:46.990054+0000","last_became_peered":"2024-06-10T00:14:46.990054+0000","last_unstale":"2024-06-10T00:14:48.036483+0000","last_undegraded":"2024-06-10T00:14:48.036483+0000","last_fullsized":"2024-06-10T00:14:48.036483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:27.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898430+0000","last_change":"2024-06-10T00:14:42.864896+0000","last_active":"2024-06-10T00:14:47.898430+0000","last_peered":"2024-06-10T00:14:47.898430+0000","last_clean":"2024-06-10T00:14:47.898430+0000","last_became_active":"2024-06-10T00:14:42.864638+0000","last_became_peered":"2024-06-10T00:14:42.864638+0000","last_unstale":"2024-06-10T00:14:47.898430+0000","last_undegraded":"2024-06-10T00:14:47.898430+0000","last_fullsized":"2024-06-10T00:14:47.898430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:47.083423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035079+0000","last_change":"2024-06-10T00:14:41.866168+0000","last_active":"2024-06-10T00:14:48.035079+0000","last_peered":"2024-06-10T00:14:48.035079+0000","last_clean":"2024-06-10T00:14:48.035079+0000","last_became_active":"2024-06-10T00:14:41.865791+0000","last_became_peered":"2024-06-10T00:14:41.865791+0000","last_unstale":"2024-06-10T00:14:48.035079+0000","last_undegraded":"2024-06-10T00:14:48.035079+0000","last_fullsized":"2024-06-10T00:14:48.035079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:43.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899774+0000","last_change":"2024-06-10T00:14:46.886506+0000","last_active":"2024-06-10T00:14:47.899774+0000","last_peered":"2024-06-10T00:14:47.899774+0000","last_clean":"2024-06-10T00:14:47.899774+0000","last_became_active":"2024-06-10T00:14:46.885716+0000","last_became_peered":"2024-06-10T00:14:46.885716+0000","last_unstale":"2024-06-10T00:14:47.899774+0000","last_undegraded":"2024-06-10T00:14:47.899774+0000","last_fullsized":"2024-06-10T00:14:47.899774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:05.738780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035971+0000","last_change":"2024-06-10T00:14:42.863988+0000","last_active":"2024-06-10T00:14:48.035971+0000","last_peered":"2024-06-10T00:14:48.035971+0000","last_clean":"2024-06-10T00:14:48.035971+0000","last_became_active":"2024-06-10T00:14:42.863676+0000","last_became_peered":"2024-06-10T00:14:42.863676+0000","last_unstale":"2024-06-10T00:14:48.035971+0000","last_undegraded":"2024-06-10T00:14:48.035971+0000","last_fullsized":"2024-06-10T00:14:48.035971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036781+0000","last_change":"2024-06-10T00:14:41.868147+0000","last_active":"2024-06-10T00:14:48.036781+0000","last_peered":"2024-06-10T00:14:48.036781+0000","last_clean":"2024-06-10T00:14:48.036781+0000","last_became_active":"2024-06-10T00:14:41.867865+0000","last_became_peered":"2024-06-10T00:14:41.867865+0000","last_unstale":"2024-06-10T00:14:48.036781+0000","last_undegraded":"2024-06-10T00:14:48.036781+0000","last_fullsized":"2024-06-10T00:14:48.036781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898144+0000","last_change":"2024-06-10T00:14:46.988256+0000","last_active":"2024-06-10T00:14:47.898144+0000","last_peered":"2024-06-10T00:14:47.898144+0000","last_clean":"2024-06-10T00:14:47.898144+0000","last_became_active":"2024-06-10T00:14:46.987870+0000","last_became_peered":"2024-06-10T00:14:46.987870+0000","last_unstale":"2024-06-10T00:14:47.898144+0000","last_undegraded":"2024-06-10T00:14:47.898144+0000","last_fullsized":"2024-06-10T00:14:47.898144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:15.305106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017506+0000","last_change":"2024-06-10T00:14:42.867973+0000","last_active":"2024-06-10T00:14:48.017506+0000","last_peered":"2024-06-10T00:14:48.017506+0000","last_clean":"2024-06-10T00:14:48.017506+0000","last_became_active":"2024-06-10T00:14:42.867690+0000","last_became_peered":"2024-06-10T00:14:42.867690+0000","last_unstale":"2024-06-10T00:14:48.017506+0000","last_undegraded":"2024-06-10T00:14:48.017506+0000","last_fullsized":"2024-06-10T00:14:48.017506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036284+0000","last_change":"2024-06-10T00:14:41.868966+0000","last_active":"2024-06-10T00:14:48.036284+0000","last_peered":"2024-06-10T00:14:48.036284+0000","last_clean":"2024-06-10T00:14:48.036284+0000","last_became_active":"2024-06-10T00:14:41.868645+0000","last_became_peered":"2024-06-10T00:14:41.868645+0000","last_unstale":"2024-06-10T00:14:48.036284+0000","last_undegraded":"2024-06-10T00:14:48.036284+0000","last_fullsized":"2024-06-10T00:14:48.036284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016612+0000","last_change":"2024-06-10T00:14:46.990437+0000","last_active":"2024-06-10T00:14:48.016612+0000","last_peered":"2024-06-10T00:14:48.016612+0000","last_clean":"2024-06-10T00:14:48.016612+0000","last_became_active":"2024-06-10T00:14:46.990040+0000","last_became_peered":"2024-06-10T00:14:46.990040+0000","last_unstale":"2024-06-10T00:14:48.016612+0000","last_undegraded":"2024-06-10T00:14:48.016612+0000","last_fullsized":"2024-06-10T00:14:48.016612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:56:13.445267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036047+0000","last_change":"2024-06-10T00:14:42.859747+0000","last_active":"2024-06-10T00:14:48.036047+0000","last_peered":"2024-06-10T00:14:48.036047+0000","last_clean":"2024-06-10T00:14:48.036047+0000","last_became_active":"2024-06-10T00:14:42.859406+0000","last_became_peered":"2024-06-10T00:14:42.859406+0000","last_unstale":"2024-06-10T00:14:48.036047+0000","last_undegraded":"2024-06-10T00:14:48.036047+0000","last_fullsized":"2024-06-10T00:14:48.036047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035847+0000","last_change":"2024-06-10T00:14:41.868654+0000","last_active":"2024-06-10T00:14:48.035847+0000","last_peered":"2024-06-10T00:14:48.035847+0000","last_clean":"2024-06-10T00:14:48.035847+0000","last_became_active":"2024-06-10T00:14:41.868347+0000","last_became_peered":"2024-06-10T00:14:41.868347+0000","last_unstale":"2024-06-10T00:14:48.035847+0000","last_undegraded":"2024-06-10T00:14:48.035847+0000","last_fullsized":"2024-06-10T00:14:48.035847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:35:23.234029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035282+0000","last_change":"2024-06-10T00:14:46.988194+0000","last_active":"2024-06-10T00:14:48.035282+0000","last_peered":"2024-06-10T00:14:48.035282+0000","last_clean":"2024-06-10T00:14:48.035282+0000","last_became_active":"2024-06-10T00:14:46.987822+0000","last_became_peered":"2024-06-10T00:14:46.987822+0000","last_unstale":"2024-06-10T00:14:48.035282+0000","last_undegraded":"2024-06-10T00:14:48.035282+0000","last_fullsized":"2024-06-10T00:14:48.035282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899279+0000","last_change":"2024-06-10T00:14:42.866515+0000","last_active":"2024-06-10T00:14:47.899279+0000","last_peered":"2024-06-10T00:14:47.899279+0000","last_clean":"2024-06-10T00:14:47.899279+0000","last_became_active":"2024-06-10T00:14:42.866202+0000","last_became_peered":"2024-06-10T00:14:42.866202+0000","last_unstale":"2024-06-10T00:14:47.899279+0000","last_undegraded":"2024-06-10T00:14:47.899279+0000","last_fullsized":"2024-06-10T00:14:47.899279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036142+0000","last_change":"2024-06-10T00:14:41.862650+0000","last_active":"2024-06-10T00:14:48.036142+0000","last_peered":"2024-06-10T00:14:48.036142+0000","last_clean":"2024-06-10T00:14:48.036142+0000","last_became_active":"2024-06-10T00:14:41.862386+0000","last_became_peered":"2024-06-10T00:14:41.862386+0000","last_unstale":"2024-06-10T00:14:48.036142+0000","last_undegraded":"2024-06-10T00:14:48.036142+0000","last_fullsized":"2024-06-10T00:14:48.036142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035886+0000","last_change":"2024-06-10T00:14:46.894074+0000","last_active":"2024-06-10T00:14:48.035886+0000","last_peered":"2024-06-10T00:14:48.035886+0000","last_clean":"2024-06-10T00:14:48.035886+0000","last_became_active":"2024-06-10T00:14:46.893369+0000","last_became_peered":"2024-06-10T00:14:46.893369+0000","last_unstale":"2024-06-10T00:14:48.035886+0000","last_undegraded":"2024-06-10T00:14:48.035886+0000","last_fullsized":"2024-06-10T00:14:48.035886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899512+0000","last_change":"2024-06-10T00:14:42.866544+0000","last_active":"2024-06-10T00:14:47.899512+0000","last_peered":"2024-06-10T00:14:47.899512+0000","last_clean":"2024-06-10T00:14:47.899512+0000","last_became_active":"2024-06-10T00:14:42.865366+0000","last_became_peered":"2024-06-10T00:14:42.865366+0000","last_unstale":"2024-06-10T00:14:47.899512+0000","last_undegraded":"2024-06-10T00:14:47.899512+0000","last_fullsized":"2024-06-10T00:14:47.899512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:23.595724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899407+0000","last_change":"2024-06-10T00:14:41.861648+0000","last_active":"2024-06-10T00:14:47.899407+0000","last_peered":"2024-06-10T00:14:47.899407+0000","last_clean":"2024-06-10T00:14:47.899407+0000","last_became_active":"2024-06-10T00:14:41.861363+0000","last_became_peered":"2024-06-10T00:14:41.861363+0000","last_unstale":"2024-06-10T00:14:47.899407+0000","last_undegraded":"2024-06-10T00:14:47.899407+0000","last_fullsized":"2024-06-10T00:14:47.899407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036077+0000","last_change":"2024-06-10T00:14:46.886310+0000","last_active":"2024-06-10T00:14:48.036077+0000","last_peered":"2024-06-10T00:14:48.036077+0000","last_clean":"2024-06-10T00:14:48.036077+0000","last_became_active":"2024-06-10T00:14:46.885934+0000","last_became_peered":"2024-06-10T00:14:46.885934+0000","last_unstale":"2024-06-10T00:14:48.036077+0000","last_undegraded":"2024-06-10T00:14:48.036077+0000","last_fullsized":"2024-06-10T00:14:48.036077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:08.929668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035314+0000","last_change":"2024-06-10T00:14:42.860757+0000","last_active":"2024-06-10T00:14:48.035314+0000","last_peered":"2024-06-10T00:14:48.035314+0000","last_clean":"2024-06-10T00:14:48.035314+0000","last_became_active":"2024-06-10T00:14:42.860420+0000","last_became_peered":"2024-06-10T00:14:42.860420+0000","last_unstale":"2024-06-10T00:14:48.035314+0000","last_undegraded":"2024-06-10T00:14:48.035314+0000","last_fullsized":"2024-06-10T00:14:48.035314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897376+0000","last_change":"2024-06-10T00:14:41.858056+0000","last_active":"2024-06-10T00:14:47.897376+0000","last_peered":"2024-06-10T00:14:47.897376+0000","last_clean":"2024-06-10T00:14:47.897376+0000","last_became_active":"2024-06-10T00:14:41.857761+0000","last_became_peered":"2024-06-10T00:14:41.857761+0000","last_unstale":"2024-06-10T00:14:47.897376+0000","last_undegraded":"2024-06-10T00:14:47.897376+0000","last_fullsized":"2024-06-10T00:14:47.897376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036543+0000","last_change":"2024-06-10T00:14:46.894221+0000","last_active":"2024-06-10T00:14:48.036543+0000","last_peered":"2024-06-10T00:14:48.036543+0000","last_clean":"2024-06-10T00:14:48.036543+0000","last_became_active":"2024-06-10T00:14:46.893698+0000","last_became_peered":"2024-06-10T00:14:46.893698+0000","last_unstale":"2024-06-10T00:14:48.036543+0000","last_undegraded":"2024-06-10T00:14:48.036543+0000","last_fullsized":"2024-06-10T00:14:48.036543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:36.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.034921+0000","last_change":"2024-06-10T00:14:42.873418+0000","last_active":"2024-06-10T00:14:48.034921+0000","last_peered":"2024-06-10T00:14:48.034921+0000","last_clean":"2024-06-10T00:14:48.034921+0000","last_became_active":"2024-06-10T00:14:42.872202+0000","last_became_peered":"2024-06-10T00:14:42.872202+0000","last_unstale":"2024-06-10T00:14:48.034921+0000","last_undegraded":"2024-06-10T00:14:48.034921+0000","last_fullsized":"2024-06-10T00:14:48.034921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035121+0000","last_change":"2024-06-10T00:14:41.863805+0000","last_active":"2024-06-10T00:14:48.035121+0000","last_peered":"2024-06-10T00:14:48.035121+0000","last_clean":"2024-06-10T00:14:48.035121+0000","last_became_active":"2024-06-10T00:14:41.863518+0000","last_became_peered":"2024-06-10T00:14:41.863518+0000","last_unstale":"2024-06-10T00:14:48.035121+0000","last_undegraded":"2024-06-10T00:14:48.035121+0000","last_fullsized":"2024-06-10T00:14:48.035121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:38:57.655573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035793+0000","last_change":"2024-06-10T00:14:46.988209+0000","last_active":"2024-06-10T00:14:48.035793+0000","last_peered":"2024-06-10T00:14:48.035793+0000","last_clean":"2024-06-10T00:14:48.035793+0000","last_became_active":"2024-06-10T00:14:46.987834+0000","last_became_peered":"2024-06-10T00:14:46.987834+0000","last_unstale":"2024-06-10T00:14:48.035793+0000","last_undegraded":"2024-06-10T00:14:48.035793+0000","last_fullsized":"2024-06-10T00:14:48.035793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:36.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016903+0000","last_change":"2024-06-10T00:14:42.867535+0000","last_active":"2024-06-10T00:14:48.016903+0000","last_peered":"2024-06-10T00:14:48.016903+0000","last_clean":"2024-06-10T00:14:48.016903+0000","last_became_active":"2024-06-10T00:14:42.867224+0000","last_became_peered":"2024-06-10T00:14:42.867224+0000","last_unstale":"2024-06-10T00:14:48.016903+0000","last_undegraded":"2024-06-10T00:14:48.016903+0000","last_fullsized":"2024-06-10T00:14:48.016903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899686+0000","last_change":"2024-06-10T00:14:41.858886+0000","last_active":"2024-06-10T00:14:47.899686+0000","last_peered":"2024-06-10T00:14:47.899686+0000","last_clean":"2024-06-10T00:14:47.899686+0000","last_became_active":"2024-06-10T00:14:41.858568+0000","last_became_peered":"2024-06-10T00:14:41.858568+0000","last_unstale":"2024-06-10T00:14:47.899686+0000","last_undegraded":"2024-06-10T00:14:47.899686+0000","last_fullsized":"2024-06-10T00:14:47.899686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035569+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:14:48.035569+0000","last_peered":"2024-06-10T00:14:48.035569+0000","last_clean":"2024-06-10T00:14:48.035569+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:14:48.035569+0000","last_undegraded":"2024-06-10T00:14:48.035569+0000","last_fullsized":"2024-06-10T00:14:48.035569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036528+0000","last_change":"2024-06-10T00:14:46.989884+0000","last_active":"2024-06-10T00:14:48.036528+0000","last_peered":"2024-06-10T00:14:48.036528+0000","last_clean":"2024-06-10T00:14:48.036528+0000","last_became_active":"2024-06-10T00:14:46.988326+0000","last_became_peered":"2024-06-10T00:14:46.988326+0000","last_unstale":"2024-06-10T00:14:48.036528+0000","last_undegraded":"2024-06-10T00:14:48.036528+0000","last_fullsized":"2024-06-10T00:14:48.036528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:05.738780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035660+0000","last_change":"2024-06-10T00:14:42.875447+0000","last_active":"2024-06-10T00:14:48.035660+0000","last_peered":"2024-06-10T00:14:48.035660+0000","last_clean":"2024-06-10T00:14:48.035660+0000","last_became_active":"2024-06-10T00:14:42.875163+0000","last_became_peered":"2024-06-10T00:14:42.875163+0000","last_unstale":"2024-06-10T00:14:48.035660+0000","last_undegraded":"2024-06-10T00:14:48.035660+0000","last_fullsized":"2024-06-10T00:14:48.035660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:43.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897639+0000","last_change":"2024-06-10T00:14:41.859030+0000","last_active":"2024-06-10T00:14:47.897639+0000","last_peered":"2024-06-10T00:14:47.897639+0000","last_clean":"2024-06-10T00:14:47.897639+0000","last_became_active":"2024-06-10T00:14:41.858721+0000","last_became_peered":"2024-06-10T00:14:41.858721+0000","last_unstale":"2024-06-10T00:14:47.897639+0000","last_undegraded":"2024-06-10T00:14:47.897639+0000","last_fullsized":"2024-06-10T00:14:47.897639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035781+0000","last_change":"2024-06-10T00:14:46.989519+0000","last_active":"2024-06-10T00:14:48.035781+0000","last_peered":"2024-06-10T00:14:48.035781+0000","last_clean":"2024-06-10T00:14:48.035781+0000","last_became_active":"2024-06-10T00:14:46.988160+0000","last_became_peered":"2024-06-10T00:14:46.988160+0000","last_unstale":"2024-06-10T00:14:48.035781+0000","last_undegraded":"2024-06-10T00:14:48.035781+0000","last_fullsized":"2024-06-10T00:14:48.035781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:37.577252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898697+0000","last_change":"2024-06-10T00:14:42.873285+0000","last_active":"2024-06-10T00:14:47.898697+0000","last_peered":"2024-06-10T00:14:47.898697+0000","last_clean":"2024-06-10T00:14:47.898697+0000","last_became_active":"2024-06-10T00:14:42.872722+0000","last_became_peered":"2024-06-10T00:14:42.872722+0000","last_unstale":"2024-06-10T00:14:47.898697+0000","last_undegraded":"2024-06-10T00:14:47.898697+0000","last_fullsized":"2024-06-10T00:14:47.898697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:23.901714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036246+0000","last_change":"2024-06-10T00:14:41.859803+0000","last_active":"2024-06-10T00:14:48.036246+0000","last_peered":"2024-06-10T00:14:48.036246+0000","last_clean":"2024-06-10T00:14:48.036246+0000","last_became_active":"2024-06-10T00:14:41.859233+0000","last_became_peered":"2024-06-10T00:14:41.859233+0000","last_unstale":"2024-06-10T00:14:48.036246+0000","last_undegraded":"2024-06-10T00:14:48.036246+0000","last_fullsized":"2024-06-10T00:14:48.036246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:04.344977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035388+0000","last_change":"2024-06-10T00:14:46.892114+0000","last_active":"2024-06-10T00:14:48.035388+0000","last_peered":"2024-06-10T00:14:48.035388+0000","last_clean":"2024-06-10T00:14:48.035388+0000","last_became_active":"2024-06-10T00:14:46.891627+0000","last_became_peered":"2024-06-10T00:14:46.891627+0000","last_unstale":"2024-06-10T00:14:48.035388+0000","last_undegraded":"2024-06-10T00:14:48.035388+0000","last_fullsized":"2024-06-10T00:14:48.035388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:16.762113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036057+0000","last_change":"2024-06-10T00:14:42.880436+0000","last_active":"2024-06-10T00:14:48.036057+0000","last_peered":"2024-06-10T00:14:48.036057+0000","last_clean":"2024-06-10T00:14:48.036057+0000","last_became_active":"2024-06-10T00:14:42.880194+0000","last_became_peered":"2024-06-10T00:14:42.880194+0000","last_unstale":"2024-06-10T00:14:48.036057+0000","last_undegraded":"2024-06-10T00:14:48.036057+0000","last_fullsized":"2024-06-10T00:14:48.036057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:54:40.334756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897719+0000","last_change":"2024-06-10T00:14:41.857224+0000","last_active":"2024-06-10T00:14:47.897719+0000","last_peered":"2024-06-10T00:14:47.897719+0000","last_clean":"2024-06-10T00:14:47.897719+0000","last_became_active":"2024-06-10T00:14:41.856764+0000","last_became_peered":"2024-06-10T00:14:41.856764+0000","last_unstale":"2024-06-10T00:14:47.897719+0000","last_undegraded":"2024-06-10T00:14:47.897719+0000","last_fullsized":"2024-06-10T00:14:47.897719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:32:16.264432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898625+0000","last_change":"2024-06-10T00:14:46.988209+0000","last_active":"2024-06-10T00:14:47.898625+0000","last_peered":"2024-06-10T00:14:47.898625+0000","last_clean":"2024-06-10T00:14:47.898625+0000","last_became_active":"2024-06-10T00:14:46.987828+0000","last_became_peered":"2024-06-10T00:14:46.987828+0000","last_unstale":"2024-06-10T00:14:47.898625+0000","last_undegraded":"2024-06-10T00:14:47.898625+0000","last_fullsized":"2024-06-10T00:14:47.898625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:55.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035649+0000","last_change":"2024-06-10T00:14:42.872751+0000","last_active":"2024-06-10T00:14:48.035649+0000","last_peered":"2024-06-10T00:14:48.035649+0000","last_clean":"2024-06-10T00:14:48.035649+0000","last_became_active":"2024-06-10T00:14:42.872474+0000","last_became_peered":"2024-06-10T00:14:42.872474+0000","last_unstale":"2024-06-10T00:14:48.035649+0000","last_undegraded":"2024-06-10T00:14:48.035649+0000","last_fullsized":"2024-06-10T00:14:48.035649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:23.901714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899907+0000","last_change":"2024-06-10T00:14:41.862996+0000","last_active":"2024-06-10T00:14:47.899907+0000","last_peered":"2024-06-10T00:14:47.899907+0000","last_clean":"2024-06-10T00:14:47.899907+0000","last_became_active":"2024-06-10T00:14:41.862737+0000","last_became_peered":"2024-06-10T00:14:41.862737+0000","last_unstale":"2024-06-10T00:14:47.899907+0000","last_undegraded":"2024-06-10T00:14:47.899907+0000","last_fullsized":"2024-06-10T00:14:47.899907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:33:44.025553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897822+0000","last_change":"2024-06-10T00:14:46.888769+0000","last_active":"2024-06-10T00:14:47.897822+0000","last_peered":"2024-06-10T00:14:47.897822+0000","last_clean":"2024-06-10T00:14:47.897822+0000","last_became_active":"2024-06-10T00:14:46.887888+0000","last_became_peered":"2024-06-10T00:14:46.887888+0000","last_unstale":"2024-06-10T00:14:47.897822+0000","last_undegraded":"2024-06-10T00:14:47.897822+0000","last_fullsized":"2024-06-10T00:14:47.897822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:54.764215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035898+0000","last_change":"2024-06-10T00:14:42.874352+0000","last_active":"2024-06-10T00:14:48.035898+0000","last_peered":"2024-06-10T00:14:48.035898+0000","last_clean":"2024-06-10T00:14:48.035898+0000","last_became_active":"2024-06-10T00:14:42.874088+0000","last_became_peered":"2024-06-10T00:14:42.874088+0000","last_unstale":"2024-06-10T00:14:48.035898+0000","last_undegraded":"2024-06-10T00:14:48.035898+0000","last_fullsized":"2024-06-10T00:14:48.035898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897293+0000","last_change":"2024-06-10T00:14:41.859732+0000","last_active":"2024-06-10T00:14:47.897293+0000","last_peered":"2024-06-10T00:14:47.897293+0000","last_clean":"2024-06-10T00:14:47.897293+0000","last_became_active":"2024-06-10T00:14:41.859467+0000","last_became_peered":"2024-06-10T00:14:41.859467+0000","last_unstale":"2024-06-10T00:14:47.897293+0000","last_undegraded":"2024-06-10T00:14:47.897293+0000","last_fullsized":"2024-06-10T00:14:47.897293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035648+0000","last_change":"2024-06-10T00:14:46.892523+0000","last_active":"2024-06-10T00:14:48.035648+0000","last_peered":"2024-06-10T00:14:48.035648+0000","last_clean":"2024-06-10T00:14:48.035648+0000","last_became_active":"2024-06-10T00:14:46.892158+0000","last_became_peered":"2024-06-10T00:14:46.892158+0000","last_unstale":"2024-06-10T00:14:48.035648+0000","last_undegraded":"2024-06-10T00:14:48.035648+0000","last_fullsized":"2024-06-10T00:14:48.035648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:27.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035229+0000","last_change":"2024-06-10T00:14:42.871097+0000","last_active":"2024-06-10T00:14:48.035229+0000","last_peered":"2024-06-10T00:14:48.035229+0000","last_clean":"2024-06-10T00:14:48.035229+0000","last_became_active":"2024-06-10T00:14:42.870727+0000","last_became_peered":"2024-06-10T00:14:42.870727+0000","last_unstale":"2024-06-10T00:14:48.035229+0000","last_undegraded":"2024-06-10T00:14:48.035229+0000","last_fullsized":"2024-06-10T00:14:48.035229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035767+0000","last_change":"2024-06-10T00:14:41.865937+0000","last_active":"2024-06-10T00:14:48.035767+0000","last_peered":"2024-06-10T00:14:48.035767+0000","last_clean":"2024-06-10T00:14:48.035767+0000","last_became_active":"2024-06-10T00:14:41.865669+0000","last_became_peered":"2024-06-10T00:14:41.865669+0000","last_unstale":"2024-06-10T00:14:48.035767+0000","last_undegraded":"2024-06-10T00:14:48.035767+0000","last_fullsized":"2024-06-10T00:14:48.035767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017480+0000","last_change":"2024-06-10T00:14:46.991940+0000","last_active":"2024-06-10T00:14:48.017480+0000","last_peered":"2024-06-10T00:14:48.017480+0000","last_clean":"2024-06-10T00:14:48.017480+0000","last_became_active":"2024-06-10T00:14:46.991212+0000","last_became_peered":"2024-06-10T00:14:46.991212+0000","last_unstale":"2024-06-10T00:14:48.017480+0000","last_undegraded":"2024-06-10T00:14:48.017480+0000","last_fullsized":"2024-06-10T00:14:48.017480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:46:12.021856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035567+0000","last_change":"2024-06-10T00:14:42.873727+0000","last_active":"2024-06-10T00:14:48.035567+0000","last_peered":"2024-06-10T00:14:48.035567+0000","last_clean":"2024-06-10T00:14:48.035567+0000","last_became_active":"2024-06-10T00:14:42.873459+0000","last_became_peered":"2024-06-10T00:14:42.873459+0000","last_unstale":"2024-06-10T00:14:48.035567+0000","last_undegraded":"2024-06-10T00:14:48.035567+0000","last_fullsized":"2024-06-10T00:14:48.035567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:01.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899344+0000","last_change":"2024-06-10T00:14:41.864175+0000","last_active":"2024-06-10T00:14:47.899344+0000","last_peered":"2024-06-10T00:14:47.899344+0000","last_clean":"2024-06-10T00:14:47.899344+0000","last_became_active":"2024-06-10T00:14:41.863904+0000","last_became_peered":"2024-06-10T00:14:41.863904+0000","last_unstale":"2024-06-10T00:14:47.899344+0000","last_undegraded":"2024-06-10T00:14:47.899344+0000","last_fullsized":"2024-06-10T00:14:47.899344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017189+0000","last_change":"2024-06-10T00:14:46.992939+0000","last_active":"2024-06-10T00:14:48.017189+0000","last_peered":"2024-06-10T00:14:48.017189+0000","last_clean":"2024-06-10T00:14:48.017189+0000","last_became_active":"2024-06-10T00:14:46.991804+0000","last_became_peered":"2024-06-10T00:14:46.991804+0000","last_unstale":"2024-06-10T00:14:48.017189+0000","last_undegraded":"2024-06-10T00:14:48.017189+0000","last_fullsized":"2024-06-10T00:14:48.017189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:29:27.598667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035115+0000","last_change":"2024-06-10T00:14:42.874718+0000","last_active":"2024-06-10T00:14:48.035115+0000","last_peered":"2024-06-10T00:14:48.035115+0000","last_clean":"2024-06-10T00:14:48.035115+0000","last_became_active":"2024-06-10T00:14:42.873485+0000","last_became_peered":"2024-06-10T00:14:42.873485+0000","last_unstale":"2024-06-10T00:14:48.035115+0000","last_undegraded":"2024-06-10T00:14:48.035115+0000","last_fullsized":"2024-06-10T00:14:48.035115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:38:52.325465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035564+0000","last_change":"2024-06-10T00:14:41.863792+0000","last_active":"2024-06-10T00:14:48.035564+0000","last_peered":"2024-06-10T00:14:48.035564+0000","last_clean":"2024-06-10T00:14:48.035564+0000","last_became_active":"2024-06-10T00:14:41.863525+0000","last_became_peered":"2024-06-10T00:14:41.863525+0000","last_unstale":"2024-06-10T00:14:48.035564+0000","last_undegraded":"2024-06-10T00:14:48.035564+0000","last_fullsized":"2024-06-10T00:14:48.035564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:21.351313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899455+0000","last_change":"2024-06-10T00:14:46.989177+0000","last_active":"2024-06-10T00:14:47.899455+0000","last_peered":"2024-06-10T00:14:47.899455+0000","last_clean":"2024-06-10T00:14:47.899455+0000","last_became_active":"2024-06-10T00:14:46.988818+0000","last_became_peered":"2024-06-10T00:14:46.988818+0000","last_unstale":"2024-06-10T00:14:47.899455+0000","last_undegraded":"2024-06-10T00:14:47.899455+0000","last_fullsized":"2024-06-10T00:14:47.899455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:52.363831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035517+0000","last_change":"2024-06-10T00:14:42.876047+0000","last_active":"2024-06-10T00:14:48.035517+0000","last_peered":"2024-06-10T00:14:48.035517+0000","last_clean":"2024-06-10T00:14:48.035517+0000","last_became_active":"2024-06-10T00:14:42.875789+0000","last_became_peered":"2024-06-10T00:14:42.875789+0000","last_unstale":"2024-06-10T00:14:48.035517+0000","last_undegraded":"2024-06-10T00:14:48.035517+0000","last_fullsized":"2024-06-10T00:14:48.035517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:33.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:52.223703+0000","last_change":"2024-06-10T00:14:41.866777+0000","last_active":"2024-06-10T00:14:52.223703+0000","last_peered":"2024-06-10T00:14:52.223703+0000","last_clean":"2024-06-10T00:14:52.223703+0000","last_became_active":"2024-06-10T00:14:41.866439+0000","last_became_peered":"2024-06-10T00:14:41.866439+0000","last_unstale":"2024-06-10T00:14:52.223703+0000","last_undegraded":"2024-06-10T00:14:52.223703+0000","last_fullsized":"2024-06-10T00:14:52.223703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035977+0000","last_change":"2024-06-10T00:14:46.893648+0000","last_active":"2024-06-10T00:14:48.035977+0000","last_peered":"2024-06-10T00:14:48.035977+0000","last_clean":"2024-06-10T00:14:48.035977+0000","last_became_active":"2024-06-10T00:14:46.893153+0000","last_became_peered":"2024-06-10T00:14:46.893153+0000","last_unstale":"2024-06-10T00:14:48.035977+0000","last_undegraded":"2024-06-10T00:14:48.035977+0000","last_fullsized":"2024-06-10T00:14:48.035977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:16.762113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899660+0000","last_change":"2024-06-10T00:14:42.869743+0000","last_active":"2024-06-10T00:14:47.899660+0000","last_peered":"2024-06-10T00:14:47.899660+0000","last_clean":"2024-06-10T00:14:47.899660+0000","last_became_active":"2024-06-10T00:14:42.869432+0000","last_became_peered":"2024-06-10T00:14:42.869432+0000","last_unstale":"2024-06-10T00:14:47.899660+0000","last_undegraded":"2024-06-10T00:14:47.899660+0000","last_fullsized":"2024-06-10T00:14:47.899660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:44.600998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036249+0000","last_change":"2024-06-10T00:14:41.859872+0000","last_active":"2024-06-10T00:14:48.036249+0000","last_peered":"2024-06-10T00:14:48.036249+0000","last_clean":"2024-06-10T00:14:48.036249+0000","last_became_active":"2024-06-10T00:14:41.859529+0000","last_became_peered":"2024-06-10T00:14:41.859529+0000","last_unstale":"2024-06-10T00:14:48.036249+0000","last_undegraded":"2024-06-10T00:14:48.036249+0000","last_fullsized":"2024-06-10T00:14:48.036249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:43.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899198+0000","last_change":"2024-06-10T00:14:46.887779+0000","last_active":"2024-06-10T00:14:47.899198+0000","last_peered":"2024-06-10T00:14:47.899198+0000","last_clean":"2024-06-10T00:14:47.899198+0000","last_became_active":"2024-06-10T00:14:46.887388+0000","last_became_peered":"2024-06-10T00:14:46.887388+0000","last_unstale":"2024-06-10T00:14:47.899198+0000","last_undegraded":"2024-06-10T00:14:47.899198+0000","last_fullsized":"2024-06-10T00:14:47.899198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:37.577252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035674+0000","last_change":"2024-06-10T00:14:42.868290+0000","last_active":"2024-06-10T00:14:48.035674+0000","last_peered":"2024-06-10T00:14:48.035674+0000","last_clean":"2024-06-10T00:14:48.035674+0000","last_became_active":"2024-06-10T00:14:42.868004+0000","last_became_peered":"2024-06-10T00:14:42.868004+0000","last_unstale":"2024-06-10T00:14:48.035674+0000","last_undegraded":"2024-06-10T00:14:48.035674+0000","last_fullsized":"2024-06-10T00:14:48.035674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898788+0000","last_change":"2024-06-10T00:14:41.865384+0000","last_active":"2024-06-10T00:14:47.898788+0000","last_peered":"2024-06-10T00:14:47.898788+0000","last_clean":"2024-06-10T00:14:47.898788+0000","last_became_active":"2024-06-10T00:14:41.865032+0000","last_became_peered":"2024-06-10T00:14:41.865032+0000","last_unstale":"2024-06-10T00:14:47.898788+0000","last_undegraded":"2024-06-10T00:14:47.898788+0000","last_fullsized":"2024-06-10T00:14:47.898788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016834+0000","last_change":"2024-06-10T00:14:46.886924+0000","last_active":"2024-06-10T00:14:48.016834+0000","last_peered":"2024-06-10T00:14:48.016834+0000","last_clean":"2024-06-10T00:14:48.016834+0000","last_became_active":"2024-06-10T00:14:46.886412+0000","last_became_peered":"2024-06-10T00:14:46.886412+0000","last_unstale":"2024-06-10T00:14:48.016834+0000","last_undegraded":"2024-06-10T00:14:48.016834+0000","last_fullsized":"2024-06-10T00:14:48.016834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:55.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898784+0000","last_change":"2024-06-10T00:14:42.869511+0000","last_active":"2024-06-10T00:14:47.898784+0000","last_peered":"2024-06-10T00:14:47.898784+0000","last_clean":"2024-06-10T00:14:47.898784+0000","last_became_active":"2024-06-10T00:14:42.868972+0000","last_became_peered":"2024-06-10T00:14:42.868972+0000","last_unstale":"2024-06-10T00:14:47.898784+0000","last_undegraded":"2024-06-10T00:14:47.898784+0000","last_fullsized":"2024-06-10T00:14:47.898784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:33.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036681+0000","last_change":"2024-06-10T00:14:41.866593+0000","last_active":"2024-06-10T00:14:48.036681+0000","last_peered":"2024-06-10T00:14:48.036681+0000","last_clean":"2024-06-10T00:14:48.036681+0000","last_became_active":"2024-06-10T00:14:41.866325+0000","last_became_peered":"2024-06-10T00:14:41.866325+0000","last_unstale":"2024-06-10T00:14:48.036681+0000","last_undegraded":"2024-06-10T00:14:48.036681+0000","last_fullsized":"2024-06-10T00:14:48.036681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016738+0000","last_change":"2024-06-10T00:14:46.990368+0000","last_active":"2024-06-10T00:14:48.016738+0000","last_peered":"2024-06-10T00:14:48.016738+0000","last_clean":"2024-06-10T00:14:48.016738+0000","last_became_active":"2024-06-10T00:14:46.989951+0000","last_became_peered":"2024-06-10T00:14:46.989951+0000","last_unstale":"2024-06-10T00:14:48.016738+0000","last_undegraded":"2024-06-10T00:14:48.016738+0000","last_fullsized":"2024-06-10T00:14:48.016738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:56:04.088356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035504+0000","last_change":"2024-06-10T00:14:46.990321+0000","last_active":"2024-06-10T00:14:48.035504+0000","last_peered":"2024-06-10T00:14:48.035504+0000","last_clean":"2024-06-10T00:14:48.035504+0000","last_became_active":"2024-06-10T00:14:46.989969+0000","last_became_peered":"2024-06-10T00:14:46.989969+0000","last_unstale":"2024-06-10T00:14:48.035504+0000","last_undegraded":"2024-06-10T00:14:48.035504+0000","last_fullsized":"2024-06-10T00:14:48.035504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:08.929668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035435+0000","last_change":"2024-06-10T00:14:42.876343+0000","last_active":"2024-06-10T00:14:48.035435+0000","last_peered":"2024-06-10T00:14:48.035435+0000","last_clean":"2024-06-10T00:14:48.035435+0000","last_became_active":"2024-06-10T00:14:42.876035+0000","last_became_peered":"2024-06-10T00:14:42.876035+0000","last_unstale":"2024-06-10T00:14:48.035435+0000","last_undegraded":"2024-06-10T00:14:48.035435+0000","last_fullsized":"2024-06-10T00:14:48.035435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898153+0000","last_change":"2024-06-10T00:14:41.856933+0000","last_active":"2024-06-10T00:14:47.898153+0000","last_peered":"2024-06-10T00:14:47.898153+0000","last_clean":"2024-06-10T00:14:47.898153+0000","last_became_active":"2024-06-10T00:14:41.856621+0000","last_became_peered":"2024-06-10T00:14:41.856621+0000","last_unstale":"2024-06-10T00:14:47.898153+0000","last_undegraded":"2024-06-10T00:14:47.898153+0000","last_fullsized":"2024-06-10T00:14:47.898153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036551+0000","last_change":"2024-06-10T00:14:46.889437+0000","last_active":"2024-06-10T00:14:48.036551+0000","last_peered":"2024-06-10T00:14:48.036551+0000","last_clean":"2024-06-10T00:14:48.036551+0000","last_became_active":"2024-06-10T00:14:46.888842+0000","last_became_peered":"2024-06-10T00:14:46.888842+0000","last_unstale":"2024-06-10T00:14:48.036551+0000","last_undegraded":"2024-06-10T00:14:48.036551+0000","last_fullsized":"2024-06-10T00:14:48.036551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016928+0000","last_change":"2024-06-10T00:14:42.874887+0000","last_active":"2024-06-10T00:14:48.016928+0000","last_peered":"2024-06-10T00:14:48.016928+0000","last_clean":"2024-06-10T00:14:48.016928+0000","last_became_active":"2024-06-10T00:14:42.871122+0000","last_became_peered":"2024-06-10T00:14:42.871122+0000","last_unstale":"2024-06-10T00:14:48.016928+0000","last_undegraded":"2024-06-10T00:14:48.016928+0000","last_fullsized":"2024-06-10T00:14:48.016928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016934+0000","last_change":"2024-06-10T00:14:41.869171+0000","last_active":"2024-06-10T00:14:48.016934+0000","last_peered":"2024-06-10T00:14:48.016934+0000","last_clean":"2024-06-10T00:14:48.016934+0000","last_became_active":"2024-06-10T00:14:41.868845+0000","last_became_peered":"2024-06-10T00:14:41.868845+0000","last_unstale":"2024-06-10T00:14:48.016934+0000","last_undegraded":"2024-06-10T00:14:48.016934+0000","last_fullsized":"2024-06-10T00:14:48.016934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036070+0000","last_change":"2024-06-10T00:14:41.864391+0000","last_active":"2024-06-10T00:14:48.036070+0000","last_peered":"2024-06-10T00:14:48.036070+0000","last_clean":"2024-06-10T00:14:48.036070+0000","last_became_active":"2024-06-10T00:14:41.864117+0000","last_became_peered":"2024-06-10T00:14:41.864117+0000","last_unstale":"2024-06-10T00:14:48.036070+0000","last_undegraded":"2024-06-10T00:14:48.036070+0000","last_fullsized":"2024-06-10T00:14:48.036070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035534+0000","last_change":"2024-06-10T00:14:42.869238+0000","last_active":"2024-06-10T00:14:48.035534+0000","last_peered":"2024-06-10T00:14:48.035534+0000","last_clean":"2024-06-10T00:14:48.035534+0000","last_became_active":"2024-06-10T00:14:42.868630+0000","last_became_peered":"2024-06-10T00:14:42.868630+0000","last_unstale":"2024-06-10T00:14:48.035534+0000","last_undegraded":"2024-06-10T00:14:48.035534+0000","last_fullsized":"2024-06-10T00:14:48.035534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897449+0000","last_change":"2024-06-10T00:14:46.886409+0000","last_active":"2024-06-10T00:14:47.897449+0000","last_peered":"2024-06-10T00:14:47.897449+0000","last_clean":"2024-06-10T00:14:47.897449+0000","last_became_active":"2024-06-10T00:14:46.886014+0000","last_became_peered":"2024-06-10T00:14:46.886014+0000","last_unstale":"2024-06-10T00:14:47.897449+0000","last_undegraded":"2024-06-10T00:14:47.897449+0000","last_fullsized":"2024-06-10T00:14:47.897449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:52.056077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016946+0000","last_change":"2024-06-10T00:14:41.862965+0000","last_active":"2024-06-10T00:14:48.016946+0000","last_peered":"2024-06-10T00:14:48.016946+0000","last_clean":"2024-06-10T00:14:48.016946+0000","last_became_active":"2024-06-10T00:14:41.862590+0000","last_became_peered":"2024-06-10T00:14:41.862590+0000","last_unstale":"2024-06-10T00:14:48.016946+0000","last_undegraded":"2024-06-10T00:14:48.016946+0000","last_fullsized":"2024-06-10T00:14:48.016946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:24:00.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898569+0000","last_change":"2024-06-10T00:14:42.855647+0000","last_active":"2024-06-10T00:14:47.898569+0000","last_peered":"2024-06-10T00:14:47.898569+0000","last_clean":"2024-06-10T00:14:47.898569+0000","last_became_active":"2024-06-10T00:14:42.855378+0000","last_became_peered":"2024-06-10T00:14:42.855378+0000","last_unstale":"2024-06-10T00:14:47.898569+0000","last_undegraded":"2024-06-10T00:14:47.898569+0000","last_fullsized":"2024-06-10T00:14:47.898569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:37.270508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017131+0000","last_change":"2024-06-10T00:14:46.886769+0000","last_active":"2024-06-10T00:14:48.017131+0000","last_peered":"2024-06-10T00:14:48.017131+0000","last_clean":"2024-06-10T00:14:48.017131+0000","last_became_active":"2024-06-10T00:14:46.886389+0000","last_became_peered":"2024-06-10T00:14:46.886389+0000","last_unstale":"2024-06-10T00:14:48.017131+0000","last_undegraded":"2024-06-10T00:14:48.017131+0000","last_fullsized":"2024-06-10T00:14:48.017131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:52.363831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035110+0000","last_change":"2024-06-10T00:14:42.873034+0000","last_active":"2024-06-10T00:14:48.035110+0000","last_peered":"2024-06-10T00:14:48.035110+0000","last_clean":"2024-06-10T00:14:48.035110+0000","last_became_active":"2024-06-10T00:14:42.872750+0000","last_became_peered":"2024-06-10T00:14:42.872750+0000","last_unstale":"2024-06-10T00:14:48.035110+0000","last_undegraded":"2024-06-10T00:14:48.035110+0000","last_fullsized":"2024-06-10T00:14:48.035110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897497+0000","last_change":"2024-06-10T00:14:42.859987+0000","last_active":"2024-06-10T00:14:47.897497+0000","last_peered":"2024-06-10T00:14:47.897497+0000","last_clean":"2024-06-10T00:14:47.897497+0000","last_became_active":"2024-06-10T00:14:42.859713+0000","last_became_peered":"2024-06-10T00:14:42.859713+0000","last_unstale":"2024-06-10T00:14:47.897497+0000","last_undegraded":"2024-06-10T00:14:47.897497+0000","last_fullsized":"2024-06-10T00:14:47.897497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:44.600998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899229+0000","last_change":"2024-06-10T00:14:42.873760+0000","last_active":"2024-06-10T00:14:47.899229+0000","last_peered":"2024-06-10T00:14:47.899229+0000","last_clean":"2024-06-10T00:14:47.899229+0000","last_became_active":"2024-06-10T00:14:42.872329+0000","last_became_peered":"2024-06-10T00:14:42.872329+0000","last_unstale":"2024-06-10T00:14:47.899229+0000","last_undegraded":"2024-06-10T00:14:47.899229+0000","last_fullsized":"2024-06-10T00:14:47.899229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:43.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035479+0000","last_change":"2024-06-10T00:14:42.872717+0000","last_active":"2024-06-10T00:14:48.035479+0000","last_peered":"2024-06-10T00:14:48.035479+0000","last_clean":"2024-06-10T00:14:48.035479+0000","last_became_active":"2024-06-10T00:14:42.872465+0000","last_became_peered":"2024-06-10T00:14:42.872465+0000","last_unstale":"2024-06-10T00:14:48.035479+0000","last_undegraded":"2024-06-10T00:14:48.035479+0000","last_fullsized":"2024-06-10T00:14:48.035479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017308+0000","last_change":"2024-06-10T00:14:42.871847+0000","last_active":"2024-06-10T00:14:48.017308+0000","last_peered":"2024-06-10T00:14:48.017308+0000","last_clean":"2024-06-10T00:14:48.017308+0000","last_became_active":"2024-06-10T00:14:42.871547+0000","last_became_peered":"2024-06-10T00:14:42.871547+0000","last_unstale":"2024-06-10T00:14:48.017308+0000","last_undegraded":"2024-06-10T00:14:48.017308+0000","last_fullsized":"2024-06-10T00:14:48.017308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:11.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036114+0000","last_change":"2024-06-10T00:14:42.866392+0000","last_active":"2024-06-10T00:14:48.036114+0000","last_peered":"2024-06-10T00:14:48.036114+0000","last_clean":"2024-06-10T00:14:48.036114+0000","last_became_active":"2024-06-10T00:14:42.866117+0000","last_became_peered":"2024-06-10T00:14:42.866117+0000","last_unstale":"2024-06-10T00:14:48.036114+0000","last_undegraded":"2024-06-10T00:14:48.036114+0000","last_fullsized":"2024-06-10T00:14:48.036114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036529+0000","last_change":"2024-06-10T00:14:42.876259+0000","last_active":"2024-06-10T00:14:48.036529+0000","last_peered":"2024-06-10T00:14:48.036529+0000","last_clean":"2024-06-10T00:14:48.036529+0000","last_became_active":"2024-06-10T00:14:42.875796+0000","last_became_peered":"2024-06-10T00:14:42.875796+0000","last_unstale":"2024-06-10T00:14:48.036529+0000","last_undegraded":"2024-06-10T00:14:48.036529+0000","last_fullsized":"2024-06-10T00:14:48.036529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017440+0000","last_change":"2024-06-10T00:14:42.874760+0000","last_active":"2024-06-10T00:14:48.017440+0000","last_peered":"2024-06-10T00:14:48.017440+0000","last_clean":"2024-06-10T00:14:48.017440+0000","last_became_active":"2024-06-10T00:14:42.871905+0000","last_became_peered":"2024-06-10T00:14:42.871905+0000","last_unstale":"2024-06-10T00:14:48.017440+0000","last_undegraded":"2024-06-10T00:14:48.017440+0000","last_fullsized":"2024-06-10T00:14:48.017440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898045+0000","last_change":"2024-06-10T00:14:42.873446+0000","last_active":"2024-06-10T00:14:47.898045+0000","last_peered":"2024-06-10T00:14:47.898045+0000","last_clean":"2024-06-10T00:14:47.898045+0000","last_became_active":"2024-06-10T00:14:42.872821+0000","last_became_peered":"2024-06-10T00:14:42.872821+0000","last_unstale":"2024-06-10T00:14:47.898045+0000","last_undegraded":"2024-06-10T00:14:47.898045+0000","last_fullsized":"2024-06-10T00:14:47.898045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016840+0000","last_change":"2024-06-10T00:14:42.875401+0000","last_active":"2024-06-10T00:14:48.016840+0000","last_peered":"2024-06-10T00:14:48.016840+0000","last_clean":"2024-06-10T00:14:48.016840+0000","last_became_active":"2024-06-10T00:14:42.875112+0000","last_became_peered":"2024-06-10T00:14:42.875112+0000","last_unstale":"2024-06-10T00:14:48.016840+0000","last_undegraded":"2024-06-10T00:14:48.016840+0000","last_fullsized":"2024-06-10T00:14:48.016840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899128+0000","last_change":"2024-06-10T00:14:42.870273+0000","last_active":"2024-06-10T00:14:47.899128+0000","last_peered":"2024-06-10T00:14:47.899128+0000","last_clean":"2024-06-10T00:14:47.899128+0000","last_became_active":"2024-06-10T00:14:42.869992+0000","last_became_peered":"2024-06-10T00:14:42.869992+0000","last_unstale":"2024-06-10T00:14:47.899128+0000","last_undegraded":"2024-06-10T00:14:47.899128+0000","last_fullsized":"2024-06-10T00:14:47.899128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:01.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035242+0000","last_change":"2024-06-10T00:14:42.874258+0000","last_active":"2024-06-10T00:14:48.035242+0000","last_peered":"2024-06-10T00:14:48.035242+0000","last_clean":"2024-06-10T00:14:48.035242+0000","last_became_active":"2024-06-10T00:14:42.873693+0000","last_became_peered":"2024-06-10T00:14:42.873693+0000","last_unstale":"2024-06-10T00:14:48.035242+0000","last_undegraded":"2024-06-10T00:14:48.035242+0000","last_fullsized":"2024-06-10T00:14:48.035242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036422+0000","last_change":"2024-06-10T00:14:42.874380+0000","last_active":"2024-06-10T00:14:48.036422+0000","last_peered":"2024-06-10T00:14:48.036422+0000","last_clean":"2024-06-10T00:14:48.036422+0000","last_became_active":"2024-06-10T00:14:42.873982+0000","last_became_peered":"2024-06-10T00:14:42.873982+0000","last_unstale":"2024-06-10T00:14:48.036422+0000","last_undegraded":"2024-06-10T00:14:48.036422+0000","last_fullsized":"2024-06-10T00:14:48.036422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035822+0000","last_change":"2024-06-10T00:14:42.877427+0000","last_active":"2024-06-10T00:14:48.035822+0000","last_peered":"2024-06-10T00:14:48.035822+0000","last_clean":"2024-06-10T00:14:48.035822+0000","last_became_active":"2024-06-10T00:14:42.877128+0000","last_became_peered":"2024-06-10T00:14:42.877128+0000","last_unstale":"2024-06-10T00:14:48.035822+0000","last_undegraded":"2024-06-10T00:14:48.035822+0000","last_fullsized":"2024-06-10T00:14:48.035822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:12.737454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897679+0000","last_change":"2024-06-10T00:14:42.877136+0000","last_active":"2024-06-10T00:14:47.897679+0000","last_peered":"2024-06-10T00:14:47.897679+0000","last_clean":"2024-06-10T00:14:47.897679+0000","last_became_active":"2024-06-10T00:14:42.876880+0000","last_became_peered":"2024-06-10T00:14:42.876880+0000","last_unstale":"2024-06-10T00:14:47.897679+0000","last_undegraded":"2024-06-10T00:14:47.897679+0000","last_fullsized":"2024-06-10T00:14:47.897679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:05.350314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899309+0000","last_change":"2024-06-10T00:14:42.868563+0000","last_active":"2024-06-10T00:14:47.899309+0000","last_peered":"2024-06-10T00:14:47.899309+0000","last_clean":"2024-06-10T00:14:47.899309+0000","last_became_active":"2024-06-10T00:14:42.868301+0000","last_became_peered":"2024-06-10T00:14:42.868301+0000","last_unstale":"2024-06-10T00:14:47.899309+0000","last_undegraded":"2024-06-10T00:14:47.899309+0000","last_fullsized":"2024-06-10T00:14:47.899309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:32.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897802+0000","last_change":"2024-06-10T00:14:42.861856+0000","last_active":"2024-06-10T00:14:47.897802+0000","last_peered":"2024-06-10T00:14:47.897802+0000","last_clean":"2024-06-10T00:14:47.897802+0000","last_became_active":"2024-06-10T00:14:42.861585+0000","last_became_peered":"2024-06-10T00:14:42.861585+0000","last_unstale":"2024-06-10T00:14:47.897802+0000","last_undegraded":"2024-06-10T00:14:47.897802+0000","last_fullsized":"2024-06-10T00:14:47.897802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035530+0000","last_change":"2024-06-10T00:14:42.860405+0000","last_active":"2024-06-10T00:14:48.035530+0000","last_peered":"2024-06-10T00:14:48.035530+0000","last_clean":"2024-06-10T00:14:48.035530+0000","last_became_active":"2024-06-10T00:14:42.860149+0000","last_became_peered":"2024-06-10T00:14:42.860149+0000","last_unstale":"2024-06-10T00:14:48.035530+0000","last_undegraded":"2024-06-10T00:14:48.035530+0000","last_fullsized":"2024-06-10T00:14:48.035530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035085+0000","last_change":"2024-06-10T00:14:42.865461+0000","last_active":"2024-06-10T00:14:48.035085+0000","last_peered":"2024-06-10T00:14:48.035085+0000","last_clean":"2024-06-10T00:14:48.035085+0000","last_became_active":"2024-06-10T00:14:42.864928+0000","last_became_peered":"2024-06-10T00:14:42.864928+0000","last_unstale":"2024-06-10T00:14:48.035085+0000","last_undegraded":"2024-06-10T00:14:48.035085+0000","last_fullsized":"2024-06-10T00:14:48.035085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:48.031418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016831+0000","last_change":"2024-06-10T00:14:42.874662+0000","last_active":"2024-06-10T00:14:48.016831+0000","last_peered":"2024-06-10T00:14:48.016831+0000","last_clean":"2024-06-10T00:14:48.016831+0000","last_became_active":"2024-06-10T00:14:42.871319+0000","last_became_peered":"2024-06-10T00:14:42.871319+0000","last_unstale":"2024-06-10T00:14:48.016831+0000","last_undegraded":"2024-06-10T00:14:48.016831+0000","last_fullsized":"2024-06-10T00:14:48.016831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899567+0000","last_change":"2024-06-10T00:14:42.876016+0000","last_active":"2024-06-10T00:14:47.899567+0000","last_peered":"2024-06-10T00:14:47.899567+0000","last_clean":"2024-06-10T00:14:47.899567+0000","last_became_active":"2024-06-10T00:14:42.875737+0000","last_became_peered":"2024-06-10T00:14:42.875737+0000","last_unstale":"2024-06-10T00:14:47.899567+0000","last_undegraded":"2024-06-10T00:14:47.899567+0000","last_fullsized":"2024-06-10T00:14:47.899567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:05.350314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036628+0000","last_change":"2024-06-10T00:14:42.871720+0000","last_active":"2024-06-10T00:14:48.036628+0000","last_peered":"2024-06-10T00:14:48.036628+0000","last_clean":"2024-06-10T00:14:48.036628+0000","last_became_active":"2024-06-10T00:14:42.871436+0000","last_became_peered":"2024-06-10T00:14:42.871436+0000","last_unstale":"2024-06-10T00:14:48.036628+0000","last_undegraded":"2024-06-10T00:14:48.036628+0000","last_fullsized":"2024-06-10T00:14:48.036628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036473+0000","last_change":"2024-06-10T00:14:42.876040+0000","last_active":"2024-06-10T00:14:48.036473+0000","last_peered":"2024-06-10T00:14:48.036473+0000","last_clean":"2024-06-10T00:14:48.036473+0000","last_became_active":"2024-06-10T00:14:42.875415+0000","last_became_peered":"2024-06-10T00:14:42.875415+0000","last_unstale":"2024-06-10T00:14:48.036473+0000","last_undegraded":"2024-06-10T00:14:48.036473+0000","last_fullsized":"2024-06-10T00:14:48.036473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035992+0000","last_change":"2024-06-10T00:14:42.878916+0000","last_active":"2024-06-10T00:14:48.035992+0000","last_peered":"2024-06-10T00:14:48.035992+0000","last_clean":"2024-06-10T00:14:48.035992+0000","last_became_active":"2024-06-10T00:14:42.878614+0000","last_became_peered":"2024-06-10T00:14:42.878614+0000","last_unstale":"2024-06-10T00:14:48.035992+0000","last_undegraded":"2024-06-10T00:14:48.035992+0000","last_fullsized":"2024-06-10T00:14:48.035992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:32.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016672+0000","last_change":"2024-06-10T00:14:42.871267+0000","last_active":"2024-06-10T00:14:48.016672+0000","last_peered":"2024-06-10T00:14:48.016672+0000","last_clean":"2024-06-10T00:14:48.016672+0000","last_became_active":"2024-06-10T00:14:42.870655+0000","last_became_peered":"2024-06-10T00:14:42.870655+0000","last_unstale":"2024-06-10T00:14:48.016672+0000","last_undegraded":"2024-06-10T00:14:48.016672+0000","last_fullsized":"2024-06-10T00:14:48.016672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035895+0000","last_change":"2024-06-10T00:14:42.872799+0000","last_active":"2024-06-10T00:14:48.035895+0000","last_peered":"2024-06-10T00:14:48.035895+0000","last_clean":"2024-06-10T00:14:48.035895+0000","last_became_active":"2024-06-10T00:14:42.872353+0000","last_became_peered":"2024-06-10T00:14:42.872353+0000","last_unstale":"2024-06-10T00:14:48.035895+0000","last_undegraded":"2024-06-10T00:14:48.035895+0000","last_fullsized":"2024-06-10T00:14:48.035895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899012+0000","last_change":"2024-06-10T00:14:42.861048+0000","last_active":"2024-06-10T00:14:47.899012+0000","last_peered":"2024-06-10T00:14:47.899012+0000","last_clean":"2024-06-10T00:14:47.899012+0000","last_became_active":"2024-06-10T00:14:42.860760+0000","last_became_peered":"2024-06-10T00:14:42.860760+0000","last_unstale":"2024-06-10T00:14:47.899012+0000","last_undegraded":"2024-06-10T00:14:47.899012+0000","last_fullsized":"2024-06-10T00:14:47.899012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035369+0000","last_change":"2024-06-10T00:14:42.876850+0000","last_active":"2024-06-10T00:14:48.035369+0000","last_peered":"2024-06-10T00:14:48.035369+0000","last_clean":"2024-06-10T00:14:48.035369+0000","last_became_active":"2024-06-10T00:14:42.876562+0000","last_became_peered":"2024-06-10T00:14:42.876562+0000","last_unstale":"2024-06-10T00:14:48.035369+0000","last_undegraded":"2024-06-10T00:14:48.035369+0000","last_fullsized":"2024-06-10T00:14:48.035369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898301+0000","last_change":"2024-06-10T00:14:42.872870+0000","last_active":"2024-06-10T00:14:47.898301+0000","last_peered":"2024-06-10T00:14:47.898301+0000","last_clean":"2024-06-10T00:14:47.898301+0000","last_became_active":"2024-06-10T00:14:42.872366+0000","last_became_peered":"2024-06-10T00:14:42.872366+0000","last_unstale":"2024-06-10T00:14:47.898301+0000","last_undegraded":"2024-06-10T00:14:47.898301+0000","last_fullsized":"2024-06-10T00:14:47.898301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:12.737454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035393+0000","last_change":"2024-06-10T00:14:42.870759+0000","last_active":"2024-06-10T00:14:48.035393+0000","last_peered":"2024-06-10T00:14:48.035393+0000","last_clean":"2024-06-10T00:14:48.035393+0000","last_became_active":"2024-06-10T00:14:42.869435+0000","last_became_peered":"2024-06-10T00:14:42.869435+0000","last_unstale":"2024-06-10T00:14:48.035393+0000","last_undegraded":"2024-06-10T00:14:48.035393+0000","last_fullsized":"2024-06-10T00:14:48.035393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:31:36.092116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036201+0000","last_change":"2024-06-10T00:14:42.863072+0000","last_active":"2024-06-10T00:14:48.036201+0000","last_peered":"2024-06-10T00:14:48.036201+0000","last_clean":"2024-06-10T00:14:48.036201+0000","last_became_active":"2024-06-10T00:14:42.862795+0000","last_became_peered":"2024-06-10T00:14:42.862795+0000","last_unstale":"2024-06-10T00:14:48.036201+0000","last_undegraded":"2024-06-10T00:14:48.036201+0000","last_fullsized":"2024-06-10T00:14:48.036201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035900+0000","last_change":"2024-06-10T00:14:42.880389+0000","last_active":"2024-06-10T00:14:48.035900+0000","last_peered":"2024-06-10T00:14:48.035900+0000","last_clean":"2024-06-10T00:14:48.035900+0000","last_became_active":"2024-06-10T00:14:42.880129+0000","last_became_peered":"2024-06-10T00:14:42.880129+0000","last_unstale":"2024-06-10T00:14:48.035900+0000","last_undegraded":"2024-06-10T00:14:48.035900+0000","last_fullsized":"2024-06-10T00:14:48.035900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:04.905009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:03.257 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:15:03.257 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-10T00:15:03.257 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-06-10T00:15:03.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-06-10T00:15:03.257 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-06-10T00:15:03.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.392+0000 7fc1e8777640 1 Processor -- start 2024-06-10T00:15:03.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.392+0000 7fc1e8777640 1 -- start start 2024-06-10T00:15:03.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.393+0000 7fc1e8777640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1e006cae0 0x7fc1e0169210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.393+0000 7fc1e8777640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e006e670 con 0x7fc1e0158b50 2024-06-10T00:15:03.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.393+0000 7fc1e8777640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e006e950 con 0x7fc1e0158770 2024-06-10T00:15:03.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.393+0000 7fc1e8777640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e006ec30 con 0x7fc1e006cae0 2024-06-10T00:15:03.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.393+0000 7fc1e6d14640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1e006cae0 0x7fc1e0169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.393+0000 7fc1e6d14640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1e006cae0 0x7fc1e0169210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36520/0 (socket says 172.21.15.79:36520) 2024-06-10T00:15:03.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.393+0000 7fc1e5d12640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc1e0158b50 0x7fc1e006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50594/0 (socket says 172.21.15.79:50594) 2024-06-10T00:15:03.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.393+0000 7fc1e6d14640 1 -- 172.21.15.79:0/3968285520 learned_addr learned my addr 172.21.15.79:0/3968285520 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:03.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.394+0000 7fc1e6d14640 1 -- 172.21.15.79:0/3968285520 >> v1:172.21.15.117:6789/0 conn(0x7fc1e0158770 legacy=0x7fc1e006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.394+0000 7fc1e6d14640 1 -- 172.21.15.79:0/3968285520 >> v1:172.21.15.79:6789/0 conn(0x7fc1e0158b50 legacy=0x7fc1e006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.394+0000 7fc1e6d14640 1 -- 172.21.15.79:0/3968285520 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e00ae890 con 0x7fc1e006cae0 2024-06-10T00:15:03.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.394+0000 7fc1e6d14640 1 --2- 172.21.15.79:0/3968285520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e006cae0 0x7fc1e0169210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009e50 tx=0x7fc1d802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cc68c7b0b7080a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.394+0000 7fc1e5511640 1 -- 172.21.15.79:0/3968285520 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8036070 con 0x7fc1e006cae0 2024-06-10T00:15:03.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.394+0000 7fc1e5511640 1 -- 172.21.15.79:0/3968285520 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d8031600 con 0x7fc1e006cae0 2024-06-10T00:15:03.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.394+0000 7fc1e5511640 1 -- 172.21.15.79:0/3968285520 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80319d0 con 0x7fc1e006cae0 2024-06-10T00:15:03.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.395+0000 7fc1e8777640 1 -- 172.21.15.79:0/3968285520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e006cae0 msgr2=0x7fc1e0169210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.395+0000 7fc1e8777640 1 --2- 172.21.15.79:0/3968285520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e006cae0 0x7fc1e0169210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009e50 tx=0x7fc1d802a730 comp rx=0 tx=0).stop 2024-06-10T00:15:03.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.395+0000 7fc1e8777640 1 -- 172.21.15.79:0/3968285520 shutdown_connections 2024-06-10T00:15:03.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.395+0000 7fc1e8777640 1 --2- 172.21.15.79:0/3968285520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e006cae0 0x7fc1e0169210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.395+0000 7fc1e8777640 1 -- 172.21.15.79:0/3968285520 >> 172.21.15.79:0/3968285520 conn(0x7fc1e0071950 msgr2=0x7fc1e0071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:03.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.395+0000 7fc1e8777640 1 -- 172.21.15.79:0/3968285520 shutdown_connections 2024-06-10T00:15:03.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.395+0000 7fc1e8777640 1 -- 172.21.15.79:0/3968285520 wait complete. 2024-06-10T00:15:03.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.396+0000 7fc1e8777640 1 Processor -- start 2024-06-10T00:15:03.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.396+0000 7fc1e8777640 1 -- start start 2024-06-10T00:15:03.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e8777640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e006cae0 0x7fc1e01529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e8777640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e0158770 0x7fc1e015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e8777640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e0158b50 0x7fc1e0159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e8777640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e00aff40 con 0x7fc1e0158770 2024-06-10T00:15:03.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e8777640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e00afdc0 con 0x7fc1e0158b50 2024-06-10T00:15:03.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e8777640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e00b00c0 con 0x7fc1e006cae0 2024-06-10T00:15:03.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e5d12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e0158770 0x7fc1e015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e5d12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e0158770 0x7fc1e015b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36532/0 (socket says 172.21.15.79:36532) 2024-06-10T00:15:03.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e5d12640 1 -- 172.21.15.79:0/1266642610 learned_addr learned my addr 172.21.15.79:0/1266642610 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:03.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e6513640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e006cae0 0x7fc1e01529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e6d14640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e0158b50 0x7fc1e0159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e5d12640 1 -- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e006cae0 msgr2=0x7fc1e01529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.397+0000 7fc1e5d12640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e006cae0 0x7fc1e01529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1e5d12640 1 -- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e0158b50 msgr2=0x7fc1e0159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1e5d12640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e0158b50 0x7fc1e0159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1e5d12640 1 -- 172.21.15.79:0/1266642610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e0151660 con 0x7fc1e0158770 2024-06-10T00:15:03.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1e6d14640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e0158b50 0x7fc1e0159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:03.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1e5d12640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e0158770 0x7fc1e015b6f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c3c0 tx=0x7fc1d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1deffd640 1 -- 172.21.15.79:0/1266642610 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40074e0 con 0x7fc1e0158770 2024-06-10T00:15:03.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1deffd640 1 -- 172.21.15.79:0/1266642610 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d4007680 con 0x7fc1e0158770 2024-06-10T00:15:03.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e015bc30 con 0x7fc1e0158770 2024-06-10T00:15:03.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1deffd640 1 -- 172.21.15.79:0/1266642610 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40049e0 con 0x7fc1e0158770 2024-06-10T00:15:03.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.398+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e00b38a0 con 0x7fc1e0158770 2024-06-10T00:15:03.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.399+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e0068430 con 0x7fc1e0158770 2024-06-10T00:15:03.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.399+0000 7fc1deffd640 1 -- 172.21.15.79:0/1266642610 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1d401a020 con 0x7fc1e0158770 2024-06-10T00:15:03.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.400+0000 7fc1deffd640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.400+0000 7fc1e6513640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.400+0000 7fc1deffd640 1 -- 172.21.15.79:0/1266642610 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc1d408a7d0 con 0x7fc1e0158770 2024-06-10T00:15:03.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.400+0000 7fc1e6513640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0001760 tx=0x7fc1d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.404+0000 7fc1deffd640 1 -- 172.21.15.79:0/1266642610 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc1d40587f0 con 0x7fc1e0158770 2024-06-10T00:15:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.624+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc1e0072850 con 0x7fc1e0158770 2024-06-10T00:15:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.627+0000 7fc1deffd640 1 -- 172.21.15.79:0/1266642610 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172939 (secure 0 0 0) 0x7fc1d405caf0 con 0x7fc1e0158770 2024-06-10T00:15:03.629 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 msgr2=0x7fc1cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0001760 tx=0x7fc1d0009040 comp rx=0 tx=0).stop 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e0158770 msgr2=0x7fc1e015b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e0158770 0x7fc1e015b6f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c3c0 tx=0x7fc1d400c880 comp rx=0 tx=0).stop 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 shutdown_connections 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e0158b50 0x7fc1e0159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1e0158770 0x7fc1e015b6f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 --2- 172.21.15.79:0/1266642610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e006cae0 0x7fc1e01529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 >> 172.21.15.79:0/1266642610 conn(0x7fc1e0071950 msgr2=0x7fc1e006bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 shutdown_connections 2024-06-10T00:15:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.630+0000 7fc1e8777640 1 -- 172.21.15.79:0/1266642610 wait complete. 2024-06-10T00:15:03.640 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3912288700},{"type":"v1","addr":"172.21.15.79:6833","nonce":3912288700}]},"active_addr":"172.21.15.79:6833/3912288700","active_change":"2024-06-10T00:14:23.137311+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3603772448}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1812425635}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1022137551}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":4264683517}]}]} 2024-06-10T00:15:03.643 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-06-10T00:15:03.643 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-10T00:15:03.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:03.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.743+0000 7f5d9d4e7640 1 Processor -- start 2024-06-10T00:15:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.743+0000 7f5d9d4e7640 1 -- start start 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d9d4e7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5d980d2680 0x7f5d9815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d9d4e7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d980d0ad0 con 0x7f5d980cef70 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d9d4e7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9815f890 con 0x7f5d980d1fc0 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d9d4e7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5d980d13e0 con 0x7f5d980d2680 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d96ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5d980d2680 0x7f5d9815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d977fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5d980cef70 0x7f5d980cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50606/0 (socket says 172.21.15.79:50606) 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d977fe640 1 -- 172.21.15.79:0/350950868 learned_addr learned my addr 172.21.15.79:0/350950868 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d96ffd640 1 -- 172.21.15.79:0/350950868 >> v1:172.21.15.117:6789/0 conn(0x7f5d980d1fc0 legacy=0x7f5d980d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d96ffd640 1 -- 172.21.15.79:0/350950868 >> v1:172.21.15.79:6789/0 conn(0x7f5d980cef70 legacy=0x7f5d980cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d96ffd640 1 -- 172.21.15.79:0/350950868 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d980d0d90 con 0x7f5d980d2680 2024-06-10T00:15:03.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.744+0000 7f5d967fc640 1 -- 172.21.15.79:0/350950868 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588008155 0 0) 0x7f5d980d0ad0 con 0x7f5d980cef70 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.745+0000 7f5d96ffd640 1 --2- 172.21.15.79:0/350950868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980d2680 0x7f5d9815f1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d980d1560 tx=0x7f5d8802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d006c83b9a6fb992 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.745+0000 7f5d967fc640 1 -- 172.21.15.79:0/350950868 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88037070 con 0x7f5d980d2680 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.745+0000 7f5d967fc640 1 -- 172.21.15.79:0/350950868 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d88032440 con 0x7f5d980d2680 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.745+0000 7f5d967fc640 1 -- 172.21.15.79:0/350950868 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88032810 con 0x7f5d980d2680 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.745+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/350950868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980d2680 msgr2=0x7f5d9815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.745+0000 7f5d9d4e7640 1 --2- 172.21.15.79:0/350950868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980d2680 0x7f5d9815f1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d980d1560 tx=0x7f5d8802a210 comp rx=0 tx=0).stop 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.746+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/350950868 shutdown_connections 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.746+0000 7f5d9d4e7640 1 --2- 172.21.15.79:0/350950868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980d2680 0x7f5d9815f1a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.746+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/350950868 >> 172.21.15.79:0/350950868 conn(0x7f5d9809d3f0 msgr2=0x7f5d980d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.746+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/350950868 shutdown_connections 2024-06-10T00:15:03.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.746+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/350950868 wait complete. 2024-06-10T00:15:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.747+0000 7f5d9d4e7640 1 Processor -- start 2024-06-10T00:15:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.747+0000 7f5d9d4e7640 1 -- start start 2024-06-10T00:15:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.747+0000 7f5d9d4e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980cef70 0x7f5d980cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d9d4e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d980d1fc0 0x7f5d980b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d9d4e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d980d2680 0x7f5d981f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d9d4e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d980d4f00 con 0x7f5d980cef70 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d9d4e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5d980d2400 con 0x7f5d980d2680 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d9d4e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d980d1870 con 0x7f5d980d1fc0 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980cef70 0x7f5d980cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980cef70 0x7f5d980cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36550/0 (socket says 172.21.15.79:36550) 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 -- 172.21.15.79:0/1861647966 learned_addr learned my addr 172.21.15.79:0/1861647966 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 -- 172.21.15.79:0/1861647966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d980d1fc0 msgr2=0x7f5d980b7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d980d1fc0 0x7f5d980b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 -- 172.21.15.79:0/1861647966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d980d2680 msgr2=0x7f5d981f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d980d2680 0x7f5d981f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 -- 172.21.15.79:0/1861647966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d980b9600 con 0x7f5d980cef70 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d96ffd640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980cef70 0x7f5d980cc020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d88000c00 tx=0x7f5d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d8f7fe640 1 -- 172.21.15.79:0/1861647966 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88037040 con 0x7f5d980cef70 2024-06-10T00:15:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d8f7fe640 1 -- 172.21.15.79:0/1861647966 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d88042070 con 0x7f5d980cef70 2024-06-10T00:15:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d980b8560 con 0x7f5d980cef70 2024-06-10T00:15:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d8f7fe640 1 -- 172.21.15.79:0/1861647966 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88030bd0 con 0x7f5d980cef70 2024-06-10T00:15:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.748+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d980b8b20 con 0x7f5d980cef70 2024-06-10T00:15:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.749+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9808d7c0 con 0x7f5d980cef70 2024-06-10T00:15:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.750+0000 7f5d8f7fe640 1 -- 172.21.15.79:0/1861647966 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d88047460 con 0x7f5d980cef70 2024-06-10T00:15:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.750+0000 7f5d8f7fe640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.750+0000 7f5d8f7fe640 1 -- 172.21.15.79:0/1861647966 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5d880abdd0 con 0x7f5d980cef70 2024-06-10T00:15:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.750+0000 7f5d8ffff640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.750+0000 7f5d8ffff640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d7806be30 0x7f5d7806e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d80000f60 tx=0x7f5d800079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:03.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.754+0000 7f5d8f7fe640 1 -- 172.21.15.79:0/1861647966 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5d9808d7c0 con 0x7f5d980cef70 2024-06-10T00:15:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.931+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d98068430 con 0x7f5d980cef70 2024-06-10T00:15:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.932+0000 7f5d8f7fe640 1 -- 172.21.15.79:0/1861647966 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f5d880ad090 con 0x7f5d980cef70 2024-06-10T00:15:03.932 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:03.933 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d7806be30 msgr2=0x7f5d7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d7806be30 0x7f5d7806e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d80000f60 tx=0x7f5d800079b0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980cef70 msgr2=0x7f5d980cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980cef70 0x7f5d980cc020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d88000c00 tx=0x7f5d880046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 shutdown_connections 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d7806be30 0x7f5d7806e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d980d2680 0x7f5d981f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d980d1fc0 0x7f5d980b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 --2- 172.21.15.79:0/1861647966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d980cef70 0x7f5d980cc020 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 >> 172.21.15.79:0/1861647966 conn(0x7f5d9809d3f0 msgr2=0x7f5d981612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 shutdown_connections 2024-06-10T00:15:03.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:03.935+0000 7f5d9d4e7640 1 -- 172.21.15.79:0/1861647966 wait complete. 2024-06-10T00:15:03.947 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-10T00:15:03.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:04.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.047+0000 7fe1f14a5640 1 Processor -- start 2024-06-10T00:15:04.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.047+0000 7fe1f14a5640 1 -- start start 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1f14a5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1ec0d1fc0 0x7fe1ec0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1f14a5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ec15f5e0 con 0x7fe1ec15f1a0 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1f14a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ec0d0ad0 con 0x7fe1ec0d2680 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1f14a5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ec0d13e0 con 0x7fe1ec0d1fc0 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1ea7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe1ec15f1a0 0x7fe1ec0cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50618/0 (socket says 172.21.15.79:50618) 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1ea7fc640 1 -- 172.21.15.79:0/742855112 learned_addr learned my addr 172.21.15.79:0/742855112 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870769901 0 0) 0x7fe1ec15f5e0 con 0x7fe1ec15f1a0 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1eb7fe640 1 --2- 172.21.15.79:0/742855112 >> v2:172.21.15.117:3300/0 conn(0x7fe1ec0d1fc0 0x7fe1ec0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.048+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d4003520 con 0x7fe1ec15f1a0 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2163065156 0 0) 0x7fe1d4003520 con 0x7fe1ec15f1a0 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 >> v2:172.21.15.117:3300/0 conn(0x7fe1ec0d1fc0 msgr2=0x7fe1ec0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 --2- 172.21.15.79:0/742855112 >> v2:172.21.15.117:3300/0 conn(0x7fe1ec0d1fc0 0x7fe1ec0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 >> v1:172.21.15.117:6789/0 conn(0x7fe1ec0d2680 legacy=0x7fe1ec0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec15f890 con 0x7fe1ec15f1a0 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fe1e0001670 con 0x7fe1ec15f1a0 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 >> v1:172.21.15.79:6789/0 conn(0x7fe1ec15f1a0 legacy=0x7fe1ec0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d40039b0 0x7fe1d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4004800 0x7fe1d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d40051c0 0x7fe1d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec0d13e0 con 0x7fe1d40039b0 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d400c060 con 0x7fe1d4004800 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d400c260 con 0x7fe1d40051c0 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1eaffd640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d40039b0 0x7fe1d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1ea7fc640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4004800 0x7fe1d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1eb7fe640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d40051c0 0x7fe1d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1eaffd640 1 -- 172.21.15.79:0/742855112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d40051c0 msgr2=0x7fe1d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1eaffd640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d40051c0 0x7fe1d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1eaffd640 1 -- 172.21.15.79:0/742855112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4004800 msgr2=0x7fe1d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1eaffd640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4004800 0x7fe1d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1eaffd640 1 -- 172.21.15.79:0/742855112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d4003520 con 0x7fe1d40039b0 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.049+0000 7fe1eb7fe640 1 -- 172.21.15.79:0/742855112 reap_dead start 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1eaffd640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d40039b0 0x7fe1d4003dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc001750 tx=0x7fe1d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9db42222c5d4a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc001370 con 0x7fe1d40039b0 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc0052d0 con 0x7fe1d40039b0 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1e9ffb640 1 -- 172.21.15.79:0/742855112 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc02abc0 con 0x7fe1d40039b0 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1f14a5640 1 -- 172.21.15.79:0/742855112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d40039b0 msgr2=0x7fe1d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1f14a5640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d40039b0 0x7fe1d4003dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc001750 tx=0x7fe1d4005830 comp rx=0 tx=0).stop 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1f14a5640 1 -- 172.21.15.79:0/742855112 shutdown_connections 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1f14a5640 1 --2- 172.21.15.79:0/742855112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d40039b0 0x7fe1d4003dd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.050+0000 7fe1f14a5640 1 -- 172.21.15.79:0/742855112 >> 172.21.15.79:0/742855112 conn(0x7fe1ec09d3f0 msgr2=0x7fe1ec0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.051+0000 7fe1f14a5640 1 -- 172.21.15.79:0/742855112 shutdown_connections 2024-06-10T00:15:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.051+0000 7fe1f14a5640 1 -- 172.21.15.79:0/742855112 wait complete. 2024-06-10T00:15:04.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.052+0000 7fe1f14a5640 1 Processor -- start 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.052+0000 7fe1f14a5640 1 -- start start 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1f14a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40039b0 0x7fe1ec15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1f14a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1ec0b8a50 0x7fe1ec158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1f14a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1ec159430 0x7fe1ec161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1f14a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec0d2410 con 0x7fe1ec159430 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1f14a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec0d1070 con 0x7fe1d40039b0 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1f14a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ec0d4f00 con 0x7fe1ec0b8a50 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1ec159430 0x7fe1ec161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1ec159430 0x7fe1ec161070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36556/0 (socket says 172.21.15.79:36556) 2024-06-10T00:15:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 -- 172.21.15.79:0/1531919414 learned_addr learned my addr 172.21.15.79:0/1531919414 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1ea7fc640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1ec0b8a50 0x7fe1ec158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eaffd640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40039b0 0x7fe1ec15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 -- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1ec0b8a50 msgr2=0x7fe1ec158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1ec0b8a50 0x7fe1ec158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 -- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40039b0 msgr2=0x7fe1ec15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40039b0 0x7fe1ec15c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 -- 172.21.15.79:0/1531919414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec0b9450 con 0x7fe1ec159430 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1ea7fc640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1ec0b8a50 0x7fe1ec158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1eb7fe640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1ec159430 0x7fe1ec161070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0d3d10 tx=0x7fe1e40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1d37fe640 1 -- 172.21.15.79:0/1531919414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011e10 con 0x7fe1ec159430 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1d37fe640 1 -- 172.21.15.79:0/1531919414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e401b070 con 0x7fe1ec159430 2024-06-10T00:15:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ec0b9730 con 0x7fe1ec159430 2024-06-10T00:15:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1d37fe640 1 -- 172.21.15.79:0/1531919414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4003990 con 0x7fe1ec159430 2024-06-10T00:15:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.053+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ec0b62f0 con 0x7fe1ec159430 2024-06-10T00:15:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.054+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ec068430 con 0x7fe1ec159430 2024-06-10T00:15:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.055+0000 7fe1d37fe640 1 -- 172.21.15.79:0/1531919414 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1e4005d10 con 0x7fe1ec159430 2024-06-10T00:15:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.055+0000 7fe1d37fe640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe1d806be30 0x7fe1d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.055+0000 7fe1d37fe640 1 -- 172.21.15.79:0/1531919414 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe1e408b690 con 0x7fe1ec159430 2024-06-10T00:15:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.055+0000 7fe1eaffd640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe1d806be30 0x7fe1d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.056+0000 7fe1eaffd640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe1d806be30 0x7fe1d806e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc032000 tx=0x7fe1dc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.060+0000 7fe1d37fe640 1 -- 172.21.15.79:0/1531919414 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe1e4025020 con 0x7fe1ec159430 2024-06-10T00:15:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.232+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1ec0b64c0 con 0x7fe1ec159430 2024-06-10T00:15:04.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.234+0000 7fe1d37fe640 1 -- 172.21.15.79:0/1531919414 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fe1e4014350 con 0x7fe1ec159430 2024-06-10T00:15:04.234 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:04.234 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe1d806be30 msgr2=0x7fe1d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe1d806be30 0x7fe1d806e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc032000 tx=0x7fe1dc02e000 comp rx=0 tx=0).stop 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1ec159430 msgr2=0x7fe1ec161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1ec159430 0x7fe1ec161070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0d3d10 tx=0x7fe1e40115a0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 shutdown_connections 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe1d806be30 0x7fe1d806e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1ec159430 0x7fe1ec161070 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1ec0b8a50 0x7fe1ec158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 --2- 172.21.15.79:0/1531919414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40039b0 0x7fe1ec15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 >> 172.21.15.79:0/1531919414 conn(0x7fe1ec09d3f0 msgr2=0x7fe1ec15a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 shutdown_connections 2024-06-10T00:15:04.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.236+0000 7fe1f14a5640 1 -- 172.21.15.79:0/1531919414 wait complete. 2024-06-10T00:15:04.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-10T00:15:04.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-10T00:15:04.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-10T00:15:04.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-06-10T00:15:04.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-06-10T00:15:04.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-06-10T00:15:04.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-06-10T00:15:04.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-06-10T00:15:04.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.418+0000 7f9ae2e8c640 1 Processor -- start 2024-06-10T00:15:04.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.419+0000 7f9ae2e8c640 1 -- start start 2024-06-10T00:15:04.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.419+0000 7f589f315640 1 Processor -- start 2024-06-10T00:15:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f589f315640 1 -- start start 2024-06-10T00:15:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f4ad8858640 1 Processor -- start 2024-06-10T00:15:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f4ad8858640 1 -- start start 2024-06-10T00:15:04.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae2e8c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9adc162440 0x7f9adc0cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae2e8c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9adc0cde10 0x7f9adc162820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae2e8c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9adc165fa0 con 0x7f9adc0cccf0 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae2e8c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9adc0cf130 con 0x7f9adc0cde10 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae2e8c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9adc166240 con 0x7f9adc162440 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae1e8a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9adc162440 0x7f9adc0cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae1e8a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9adc162440 0x7f9adc0cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48070/0 (socket says 172.21.15.79:48070) 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae1e8a640 1 -- 172.21.15.79:0/2689996301 learned_addr learned my addr 172.21.15.79:0/2689996301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae1689640 1 --1- 172.21.15.79:0/2689996301 >> v1:172.21.15.117:6789/0 conn(0x7f9adc0cccf0 0x7f9adc0cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:51976/0 (socket says 172.21.15.79:51976) 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.420+0000 7f9ae268b640 1 --2- 172.21.15.79:0/2689996301 >> v2:172.21.15.79:3300/0 conn(0x7f9adc0cde10 0x7f9adc162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f9ae0e88640 1 -- 172.21.15.79:0/2689996301 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956424612 0 0) 0x7f9adc165fa0 con 0x7f9adc0cccf0 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f9ae0e88640 1 -- 172.21.15.79:0/2689996301 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ac8003520 con 0x7f9adc0cccf0 2024-06-10T00:15:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f9ae268b640 1 -- 172.21.15.79:0/2689996301 >> v2:172.21.15.117:3300/0 conn(0x7f9adc162440 msgr2=0x7f9adc0cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f589f315640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58900e11b0 0x7f5890039e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f589f315640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f5890051ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f4ad8858640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ad4166840 0x7f4ad40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f9ae268b640 1 --2- 172.21.15.79:0/2689996301 >> v2:172.21.15.117:3300/0 conn(0x7f9adc162440 0x7f9adc0cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f9ae268b640 1 -- 172.21.15.79:0/2689996301 >> v1:172.21.15.117:6789/0 conn(0x7f9adc0cccf0 legacy=0x7f9adc0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f589e313640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f58900e0dd0 0x7f58900e5510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:51986/0 (socket says 172.21.15.79:51986) 2024-06-10T00:15:04.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f9ae268b640 1 -- 172.21.15.79:0/2689996301 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9adc166520 con 0x7f9adc0cde10 2024-06-10T00:15:04.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f4ad8858640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad409bdf0 con 0x7f4ad4165a40 2024-06-10T00:15:04.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f4ad8858640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad409c0d0 con 0x7f4ad40cfe70 2024-06-10T00:15:04.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f4ad8858640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad409cce0 con 0x7f4ad4166840 2024-06-10T00:15:04.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f4ad2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ad4166840 0x7f4ad40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7fc9c0a7d640 1 Processor -- start 2024-06-10T00:15:04.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7fc9c0a7d640 1 -- start start 2024-06-10T00:15:04.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f4ad2d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ad4166840 0x7f4ad40d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36578/0 (socket says 172.21.15.79:36578) 2024-06-10T00:15:04.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.421+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/2858271038 learned_addr learned my addr 172.21.15.79:0/2858271038 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/2858271038 >> v1:172.21.15.117:6789/0 conn(0x7f4ad40cfe70 legacy=0x7f4ad4166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7ff1d6ee0640 1 Processor -- start 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/2858271038 >> v1:172.21.15.79:6789/0 conn(0x7f4ad4165a40 legacy=0x7f4ad409d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/2858271038 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad409c3b0 con 0x7f4ad4166840 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589eb14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f5890051ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589db12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58900e11b0 0x7f5890039e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589eb14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f5890051ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50314/0 (socket says 172.21.15.79:50314) 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589db12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58900e11b0 0x7f5890039e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48082/0 (socket says 172.21.15.79:48082) 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589db12640 1 -- 172.21.15.79:0/1883917521 learned_addr learned my addr 172.21.15.79:0/1883917521 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589f315640 1 -- 172.21.15.79:0/1883917521 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589003cc60 con 0x7f58900e0dd0 2024-06-10T00:15:04.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589f315640 1 -- 172.21.15.79:0/1883917521 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f58900e5c20 con 0x7f58900e11b0 2024-06-10T00:15:04.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589f315640 1 -- 172.21.15.79:0/1883917521 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5890054db0 con 0x7f589003a3c0 2024-06-10T00:15:04.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7ff1d6ee0640 1 -- start start 2024-06-10T00:15:04.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7f9ae268b640 1 --2- 172.21.15.79:0/2689996301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cde10 0x7f9adc162820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80097a0 tx=0x7f9ad802a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af56e952288728bf server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7f9ae0e88640 1 -- 172.21.15.79:0/2689996301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8037070 con 0x7f9adc0cde10 2024-06-10T00:15:04.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7f9ae0e88640 1 -- 172.21.15.79:0/2689996301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad8032440 con 0x7f9adc0cde10 2024-06-10T00:15:04.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7f9ae0e88640 1 -- 172.21.15.79:0/2689996301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8032810 con 0x7f9adc0cde10 2024-06-10T00:15:04.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9c0a7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 0x7fc9bc071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9c0a7d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9bc072130 0x7fc9bc0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9c0a7d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9bc15c7f0 0x7fc9bc0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9c0a7d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc9bc0b3090 con 0x7fc9bc15c7f0 2024-06-10T00:15:04.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9c0a7d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc9bc0725f0 con 0x7fc9bc072130 2024-06-10T00:15:04.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9c0a7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc9bc0728d0 con 0x7fc9bc156830 2024-06-10T00:15:04.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589db12640 1 -- 172.21.15.79:0/1883917521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 msgr2=0x7f5890051ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.422+0000 7f589db12640 1 --2- 172.21.15.79:0/1883917521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f5890051ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7f589db12640 1 -- 172.21.15.79:0/1883917521 >> v1:172.21.15.117:6789/0 conn(0x7f58900e0dd0 legacy=0x7f58900e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7f589db12640 1 -- 172.21.15.79:0/1883917521 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5890055090 con 0x7f58900e11b0 2024-06-10T00:15:04.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7f589e313640 1 --1- 172.21.15.79:0/1883917521 >> v1:172.21.15.117:6789/0 conn(0x7f58900e0dd0 0x7f58900e5510 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-10T00:15:04.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7f589eb14640 1 --2- 172.21.15.79:0/1883917521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f5890051ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-10T00:15:04.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7f589db12640 1 --2- 172.21.15.79:0/1883917521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 0x7f5890039e80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5894009870 tx=0x7f589402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c94a8cd155bbbf0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff1d6ee0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c804fa90 0x7ff1c804fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff1d6ee0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff1c80df420 0x7ff1c80382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff1d6ee0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c80503b0 con 0x7ff1c8038800 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff1d6ee0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c80068a0 con 0x7ff1c80df420 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff1d6ee0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c8006af0 con 0x7ff1c804fa90 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff1d66df640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff1c8038800 0x7ff1c8038c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50642/0 (socket says 172.21.15.79:50642) 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff1d66df640 1 -- 172.21.15.79:0/3759902796 learned_addr learned my addr 172.21.15.79:0/3759902796 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d56dd640 1 --2- 172.21.15.79:0/3759902796 >> v2:172.21.15.117:3300/0 conn(0x7ff1c80df420 0x7ff1c80382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231715482 0 0) 0x7ff1c80503b0 con 0x7ff1c8038800 2024-06-10T00:15:04.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1bc003520 con 0x7ff1c8038800 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d5ede640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c804fa90 0x7ff1c804fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9b9d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9bc072130 0x7fc9bc0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9b9d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9bc072130 0x7fc9bc0cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48088/0 (socket says 172.21.15.79:48088) 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9b9d9b640 1 -- 172.21.15.79:0/3117860296 learned_addr learned my addr 172.21.15.79:0/3117860296 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9b9d9b640 1 -- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 msgr2=0x7fc9bc071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9ba59c640 1 --2- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 0x7fc9bc071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9b9d9b640 1 --2- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 0x7fc9bc071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9b9d9b640 1 -- 172.21.15.79:0/3117860296 >> v2:172.21.15.79:3300/0 conn(0x7fc9bc15c7f0 msgr2=0x7fc9bc0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9b9d9b640 1 --2- 172.21.15.79:0/3117860296 >> v2:172.21.15.79:3300/0 conn(0x7fc9bc15c7f0 0x7fc9bc0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc9b9d9b640 1 -- 172.21.15.79:0/3117860296 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc072bb0 con 0x7fc9bc072130 2024-06-10T00:15:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7fc9ba59c640 1 --2- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 0x7fc9bc071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:04.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff30ce5d640 1 Processor -- start 2024-06-10T00:15:04.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7fc21bfff640 1 Processor -- start 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1145317261 0 0) 0x7ff1bc003520 con 0x7ff1c8038800 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c804fa90 msgr2=0x7ff1c804fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c804fa90 0x7ff1c804fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 >> v2:172.21.15.117:3300/0 conn(0x7ff1c80df420 msgr2=0x7ff1c80382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 --2- 172.21.15.79:0/3759902796 >> v2:172.21.15.117:3300/0 conn(0x7ff1c80df420 0x7ff1c80382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c8006dd0 con 0x7ff1c8038800 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7ff1d004ffb0 con 0x7ff1c8038800 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d56dd640 1 --2- 172.21.15.79:0/3759902796 >> v2:172.21.15.117:3300/0 conn(0x7ff1c80df420 0x7ff1c80382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 >> v1:172.21.15.79:6789/0 conn(0x7ff1c8038800 legacy=0x7ff1c8038c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7f2e21b09640 1 Processor -- start 2024-06-10T00:15:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7ff1d4edc640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c804fa90 0x7ff1bc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d4edc640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc003f30 0x7ff1bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d4edc640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc004d40 0x7ff1bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c80068a0 con 0x7ff1bc003f30 2024-06-10T00:15:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8006af0 con 0x7ff1bc004d40 2024-06-10T00:15:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff1bc00b9c0 con 0x7ff1c804fa90 2024-06-10T00:15:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7fc9b9d9b640 1 --2- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 0x7fc9bc0cc670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009e50 tx=0x7fc9b402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1928ef0ab82815a4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f589d311640 1 -- 172.21.15.79:0/1883917521 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894037070 con 0x7f58900e11b0 2024-06-10T00:15:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f589d311640 1 -- 172.21.15.79:0/1883917521 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894032440 con 0x7f58900e11b0 2024-06-10T00:15:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f589d311640 1 -- 172.21.15.79:0/1883917521 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894032810 con 0x7f58900e11b0 2024-06-10T00:15:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2689996301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cde10 msgr2=0x7f9adc162820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f9ae2e8c640 1 --2- 172.21.15.79:0/2689996301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cde10 0x7f9adc162820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80097a0 tx=0x7f9ad802a1d0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.423+0000 7ff30ce5d640 1 -- start start 2024-06-10T00:15:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff30ce5d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff300048100 0x7ff300006f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff30ce5d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff300005ec0 con 0x7ff300054560 2024-06-10T00:15:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff30ce5d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff300053280 con 0x7ff300007460 2024-06-10T00:15:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff30ce5d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff3000e7b90 con 0x7ff300048100 2024-06-10T00:15:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7f4ad2d9d640 1 --2- 172.21.15.79:0/2858271038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4166840 0x7f4ad40d0300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009e50 tx=0x7f4acc02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b5ee73a19ebbfa server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7f4ad159a640 1 -- 172.21.15.79:0/2858271038 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc036070 con 0x7f4ad4166840 2024-06-10T00:15:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7f4ad159a640 1 -- 172.21.15.79:0/2858271038 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4acc031600 con 0x7f4ad4166840 2024-06-10T00:15:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7f4ad159a640 1 -- 172.21.15.79:0/2858271038 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc031a10 con 0x7f4ad4166840 2024-06-10T00:15:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f4ad8858640 1 -- 172.21.15.79:0/2858271038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4166840 msgr2=0x7f4ad40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f4ad8858640 1 --2- 172.21.15.79:0/2858271038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4166840 0x7f4ad40d0300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009e50 tx=0x7f4acc02a780 comp rx=0 tx=0).stop 2024-06-10T00:15:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7fc9b959a640 1 -- 172.21.15.79:0/3117860296 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4036070 con 0x7fc9bc072130 2024-06-10T00:15:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7fc9b959a640 1 -- 172.21.15.79:0/3117860296 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b4031600 con 0x7fc9bc072130 2024-06-10T00:15:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7fc9b959a640 1 -- 172.21.15.79:0/3117860296 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40319d0 con 0x7fc9bc072130 2024-06-10T00:15:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.424+0000 7fc21bfff640 1 -- start start 2024-06-10T00:15:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f4ad8858640 1 -- 172.21.15.79:0/2858271038 shutdown_connections 2024-06-10T00:15:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f4ad8858640 1 --2- 172.21.15.79:0/2858271038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4166840 0x7f4ad40d0300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7fc21bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc2140df220 0x7fc21403a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f4ad8858640 1 -- 172.21.15.79:0/2858271038 >> 172.21.15.79:0/2858271038 conn(0x7f4ad40b5980 msgr2=0x7f4ad40b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff305d9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff300007460 0x7ff300053e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52012/0 (socket says 172.21.15.79:52012) 2024-06-10T00:15:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff305d9b640 1 -- 172.21.15.79:0/1622991150 learned_addr learned my addr 172.21.15.79:0/1622991150 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f4ad8858640 1 -- 172.21.15.79:0/2858271038 shutdown_connections 2024-06-10T00:15:04.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc21bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2140e31e0 0x7fc214053af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc21bfff640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc214054640 con 0x7fc2140e2d80 2024-06-10T00:15:04.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f4ad8858640 1 -- 172.21.15.79:0/2858271038 wait complete. 2024-06-10T00:15:04.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7ff30659c640 1 --2- 172.21.15.79:0/1622991150 >> v2:172.21.15.79:3300/0 conn(0x7ff300048100 0x7ff300006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc21bfff640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc214054920 con 0x7fc2140e31e0 2024-06-10T00:15:04.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc21bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc214054c00 con 0x7fc2140df220 2024-06-10T00:15:04.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7f2e21b09640 1 -- start start 2024-06-10T00:15:04.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f589f315640 1 -- 172.21.15.79:0/1883917521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 msgr2=0x7f5890039e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f589f315640 1 --2- 172.21.15.79:0/1883917521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 0x7f5890039e80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5894009870 tx=0x7f589402a210 comp rx=0 tx=0).stop 2024-06-10T00:15:04.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 msgr2=0x7fc9bc0cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 --2- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 0x7fc9bc0cc670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009e50 tx=0x7fc9b402a6f0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2689996301 shutdown_connections 2024-06-10T00:15:04.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f9ae2e8c640 1 --2- 172.21.15.79:0/2689996301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cde10 0x7f9adc162820 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f9ae2e8c640 1 --2- 172.21.15.79:0/2689996301 >> v2:172.21.15.117:3300/0 conn(0x7f9adc162440 0x7f9adc0cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2689996301 >> 172.21.15.79:0/2689996301 conn(0x7f9adc06b3c0 msgr2=0x7f9adc06b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f589f315640 1 -- 172.21.15.79:0/1883917521 shutdown_connections 2024-06-10T00:15:04.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f589f315640 1 --2- 172.21.15.79:0/1883917521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f5890051ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f589f315640 1 --2- 172.21.15.79:0/1883917521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 0x7f5890039e80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f589f315640 1 -- 172.21.15.79:0/1883917521 >> 172.21.15.79:0/1883917521 conn(0x7f5890056ce0 msgr2=0x7f58900570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc21a7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc2140e2d80 0x7fc2140533e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50658/0 (socket says 172.21.15.79:50658) 2024-06-10T00:15:04.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc21a7fc640 1 -- 172.21.15.79:0/4211448097 learned_addr learned my addr 172.21.15.79:0/4211448097 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:04.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f589f315640 1 -- 172.21.15.79:0/1883917521 shutdown_connections 2024-06-10T00:15:04.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/3117860296 shutdown_connections 2024-06-10T00:15:04.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 --2- 172.21.15.79:0/3117860296 >> v2:172.21.15.79:3300/0 conn(0x7fc9bc15c7f0 0x7fc9bc0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 --2- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 0x7fc9bc0cc670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 --2- 172.21.15.79:0/3117860296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 0x7fc9bc071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/3117860296 >> 172.21.15.79:0/3117860296 conn(0x7fc9bc0b19f0 msgr2=0x7fc9bc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f2e21b09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e1c0cd160 0x7f2e1c0d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/3117860296 shutdown_connections 2024-06-10T00:15:04.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f2e12ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2e1c0ccce0 0x7f2e1c150e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52022/0 (socket says 172.21.15.79:52022) 2024-06-10T00:15:04.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f2e12ffd640 1 -- 172.21.15.79:0/3441667754 learned_addr learned my addr 172.21.15.79:0/3441667754 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:04.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7f589f315640 1 -- 172.21.15.79:0/1883917521 wait complete. 2024-06-10T00:15:04.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d56dd640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc003f30 0x7ff1bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7f2e21b09640 1 -- 172.21.15.79:0/3441667754 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c0b43d0 con 0x7f2e1c06beb0 2024-06-10T00:15:04.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d56dd640 1 -- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c804fa90 msgr2=0x7ff1bc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7f2e21b09640 1 -- 172.21.15.79:0/3441667754 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c0b46b0 con 0x7f2e1c0ccce0 2024-06-10T00:15:04.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d56dd640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c804fa90 0x7ff1bc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d56dd640 1 -- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc004d40 msgr2=0x7ff1bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d56dd640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc004d40 0x7ff1bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.425+0000 7ff1d56dd640 1 -- 172.21.15.79:0/3759902796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc003520 con 0x7ff1bc003f30 2024-06-10T00:15:04.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7ff30559a640 1 -- 172.21.15.79:0/1622991150 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1129023611 0 0) 0x7ff300053280 con 0x7ff300007460 2024-06-10T00:15:04.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7ff30559a640 1 -- 172.21.15.79:0/1622991150 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f0003520 con 0x7ff300007460 2024-06-10T00:15:04.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7ff30559a640 1 -- 172.21.15.79:0/1622991150 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111082721 0 0) 0x7ff300005ec0 con 0x7ff300054560 2024-06-10T00:15:04.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7ff30559a640 1 -- 172.21.15.79:0/1622991150 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff300053280 con 0x7ff300054560 2024-06-10T00:15:04.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7ff30559a640 1 -- 172.21.15.79:0/1622991150 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 825318569 0 0) 0x7ff300053280 con 0x7ff300054560 2024-06-10T00:15:04.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.426+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/3117860296 wait complete. 2024-06-10T00:15:04.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7fc21b7fe640 1 --2- 172.21.15.79:0/4211448097 >> v2:172.21.15.79:3300/0 conn(0x7fc2140e31e0 0x7fc214053af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7fc219ffb640 1 -- 172.21.15.79:0/4211448097 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233542414 0 0) 0x7fc214054640 con 0x7fc2140e2d80 2024-06-10T00:15:04.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7fc219ffb640 1 -- 172.21.15.79:0/4211448097 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc200007930 con 0x7fc2140e2d80 2024-06-10T00:15:04.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7fc21affd640 1 --2- 172.21.15.79:0/4211448097 >> v2:172.21.15.117:3300/0 conn(0x7fc2140df220 0x7fc21403a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2689996301 shutdown_connections 2024-06-10T00:15:04.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7ff30659c640 1 -- 172.21.15.79:0/1622991150 >> v1:172.21.15.117:6789/0 conn(0x7ff300007460 legacy=0x7ff300053e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7ff30659c640 1 -- 172.21.15.79:0/1622991150 >> v1:172.21.15.79:6789/0 conn(0x7ff300054560 legacy=0x7ff30004f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7ff30659c640 1 -- 172.21.15.79:0/1622991150 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff300006160 con 0x7ff300048100 2024-06-10T00:15:04.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7ff1d56dd640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc003f30 0x7ff1bc004800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00098a0 tx=0x7ff1bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb462896e910c41e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7f2e1bfff640 1 --2- 172.21.15.79:0/3441667754 >> v2:172.21.15.79:3300/0 conn(0x7f2e1c0cd160 0x7f2e1c0d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2689996301 wait complete. 2024-06-10T00:15:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7f4ad8858640 1 Processor -- start 2024-06-10T00:15:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7f4ad8858640 1 -- start start 2024-06-10T00:15:04.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7f589f315640 1 Processor -- start 2024-06-10T00:15:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000f040 con 0x7ff1bc003f30 2024-06-10T00:15:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c0004230 con 0x7ff1bc003f30 2024-06-10T00:15:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7ff1d4edc640 1 -- 172.21.15.79:0/3759902796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0003610 con 0x7ff1bc003f30 2024-06-10T00:15:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7ff30659c640 1 --2- 172.21.15.79:0/1622991150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 0x7ff300006f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80097a0 tx=0x7ff2f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5553d5f010b7057f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7fc21affd640 1 -- 172.21.15.79:0/4211448097 >> v2:172.21.15.79:3300/0 conn(0x7fc2140e31e0 msgr2=0x7fc214053af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7fc21affd640 1 --2- 172.21.15.79:0/4211448097 >> v2:172.21.15.79:3300/0 conn(0x7fc2140e31e0 0x7fc214053af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7fc21affd640 1 -- 172.21.15.79:0/4211448097 >> v1:172.21.15.79:6789/0 conn(0x7fc2140e2d80 legacy=0x7fc2140533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7fc21affd640 1 -- 172.21.15.79:0/4211448097 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2140062e0 con 0x7fc2140df220 2024-06-10T00:15:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.427+0000 7f2e21b09640 1 -- 172.21.15.79:0/3441667754 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1c0cd5d0 con 0x7f2e1c0cd160 2024-06-10T00:15:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7f2e1bfff640 1 -- 172.21.15.79:0/3441667754 >> v1:172.21.15.117:6789/0 conn(0x7f2e1c0ccce0 legacy=0x7f2e1c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7f2e1affd640 1 -- 172.21.15.79:0/3441667754 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746657443 0 0) 0x7f2e1c0b46b0 con 0x7f2e1c0ccce0 2024-06-10T00:15:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7f2e1bfff640 1 -- 172.21.15.79:0/3441667754 >> v1:172.21.15.79:6789/0 conn(0x7f2e1c06beb0 legacy=0x7f2e1c15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7f589f315640 1 -- start start 2024-06-10T00:15:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.428+0000 7f2e1bfff640 1 -- 172.21.15.79:0/3441667754 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c0b4990 con 0x7f2e1c0cd160 2024-06-10T00:15:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/3759902796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc003f30 msgr2=0x7ff1bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff1d6ee0640 1 --2- 172.21.15.79:0/3759902796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc003f30 0x7ff1bc004800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00098a0 tx=0x7ff1bc005830 comp rx=0 tx=0).stop 2024-06-10T00:15:04.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7fc21affd640 1 --2- 172.21.15.79:0/4211448097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140df220 0x7fc21403a7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc21400b480 tx=0x7fc20c02a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c3cc192809fb387 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff30559a640 1 -- 172.21.15.79:0/1622991150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8037070 con 0x7ff300048100 2024-06-10T00:15:04.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff30559a640 1 -- 172.21.15.79:0/1622991150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f802ac30 con 0x7ff300048100 2024-06-10T00:15:04.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff30559a640 1 -- 172.21.15.79:0/1622991150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30804fc80 con 0x7ff300048100 2024-06-10T00:15:04.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff1d66df640 1 -- 172.21.15.79:0/3759902796 reap_dead start 2024-06-10T00:15:04.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7f9ae2e8c640 1 Processor -- start 2024-06-10T00:15:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/3759902796 shutdown_connections 2024-06-10T00:15:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/3759902796 >> 172.21.15.79:0/3759902796 conn(0x7ff1c8009fb0 msgr2=0x7ff1c800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7f4ad8858640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad40cfe70 0x7f4ad41ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad8858640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4165a40 0x7f4ad4161c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad8858640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad4166840 0x7f4ad4160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad8858640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad4165e20 con 0x7f4ad4165a40 2024-06-10T00:15:04.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad8858640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad409c970 con 0x7f4ad40cfe70 2024-06-10T00:15:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7f589f315640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f58900e1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7f589f315640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58900e0dd0 0x7f58900cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7f589f315640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 0x7f589004ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f589e313640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f58900e1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f589e313640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f58900e1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50350/0 (socket says 172.21.15.79:50350) 2024-06-10T00:15:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/3759902796 shutdown_connections 2024-06-10T00:15:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/3759902796 wait complete. 2024-06-10T00:15:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7f9ae2e8c640 1 -- start start 2024-06-10T00:15:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7fc219ffb640 1 -- 172.21.15.79:0/4211448097 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c037070 con 0x7fc2140df220 2024-06-10T00:15:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7fc219ffb640 1 -- 172.21.15.79:0/4211448097 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c032440 con 0x7fc2140df220 2024-06-10T00:15:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.429+0000 7fc219ffb640 1 -- 172.21.15.79:0/4211448097 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c02ae60 con 0x7fc2140df220 2024-06-10T00:15:04.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad8858640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad40d2a70 con 0x7f4ad4166840 2024-06-10T00:15:04.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f589e313640 1 -- 172.21.15.79:0/236209126 learned_addr learned my addr 172.21.15.79:0/236209126 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f2e1bfff640 1 --2- 172.21.15.79:0/3441667754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0cd160 0x7f2e1c0d0190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400be30 tx=0x7f2e1402ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2786a129519db49 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc9c0a7d640 1 Processor -- start 2024-06-10T00:15:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad2d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad4166840 0x7f4ad4160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad2d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad4166840 0x7f4ad4160830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50362/0 (socket says 172.21.15.79:50362) 2024-06-10T00:15:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/3363605300 learned_addr learned my addr 172.21.15.79:0/3363605300 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad1d9b640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4165a40 0x7f4ad4161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7ff30ce5d640 1 -- 172.21.15.79:0/1622991150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 msgr2=0x7ff300006f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7ff30ce5d640 1 --2- 172.21.15.79:0/1622991150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 0x7ff300006f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80097a0 tx=0x7ff2f802a1a0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7ff30ce5d640 1 -- 172.21.15.79:0/1622991150 shutdown_connections 2024-06-10T00:15:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7ff30ce5d640 1 --2- 172.21.15.79:0/1622991150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 0x7ff300006f20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7ff30ce5d640 1 -- 172.21.15.79:0/1622991150 >> 172.21.15.79:0/1622991150 conn(0x7ff300009fe0 msgr2=0x7ff30000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f2e1affd640 1 -- 172.21.15.79:0/3441667754 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14037020 con 0x7f2e1c0cd160 2024-06-10T00:15:04.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad259c640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad40cfe70 0x7f4ad41ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f2e1affd640 1 -- 172.21.15.79:0/3441667754 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e14009540 con 0x7f2e1c0cd160 2024-06-10T00:15:04.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f2e1affd640 1 -- 172.21.15.79:0/3441667754 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14009910 con 0x7f2e1c0cd160 2024-06-10T00:15:04.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc21bfff640 1 -- 172.21.15.79:0/4211448097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140df220 msgr2=0x7fc21403a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc21bfff640 1 --2- 172.21.15.79:0/4211448097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140df220 0x7fc21403a7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc21400b480 tx=0x7fc20c02a150 comp rx=0 tx=0).stop 2024-06-10T00:15:04.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc21bfff640 1 -- 172.21.15.79:0/4211448097 shutdown_connections 2024-06-10T00:15:04.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc21bfff640 1 --2- 172.21.15.79:0/4211448097 >> v2:172.21.15.79:3300/0 conn(0x7fc2140e31e0 0x7fc214053af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc21bfff640 1 --2- 172.21.15.79:0/4211448097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140df220 0x7fc21403a7f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc21bfff640 1 -- 172.21.15.79:0/4211448097 >> 172.21.15.79:0/4211448097 conn(0x7fc21400a400 msgr2=0x7fc21400a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/3363605300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad40cfe70 msgr2=0x7f4ad41ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad2d9d640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad40cfe70 0x7f4ad41ec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4165a40 msgr2=0x7f4ad4161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f589db12640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58900e0dd0 0x7f58900cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f589eb14640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 0x7f589004ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc21bfff640 1 -- 172.21.15.79:0/4211448097 shutdown_connections 2024-06-10T00:15:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc9c0a7d640 1 -- start start 2024-06-10T00:15:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5890055930 con 0x7f58900e0dd0 2024-06-10T00:15:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5890055650 con 0x7f58900e11b0 2024-06-10T00:15:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5890055c10 con 0x7f589003a3c0 2024-06-10T00:15:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7f9ae2e8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cccf0 0x7f9adc15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae2e8c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9adc0cde10 0x7f9adc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae2e8c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9adc162440 0x7f9adc071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae2e8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc06d800 con 0x7f9adc0cccf0 2024-06-10T00:15:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae2e8c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc166ae0 con 0x7f9adc162440 2024-06-10T00:15:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae2e8c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9adc06d980 con 0x7f9adc0cde10 2024-06-10T00:15:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7ff30ce5d640 1 -- 172.21.15.79:0/1622991150 shutdown_connections 2024-06-10T00:15:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f4ad2d9d640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4165a40 0x7f4ad4161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/3363605300 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad415eef0 con 0x7f4ad4166840 2024-06-10T00:15:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae1e8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cccf0 0x7f9adc15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f4ad1d9b640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad4165a40 0x7f4ad4161c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae1e8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cccf0 0x7f9adc15b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36638/0 (socket says 172.21.15.79:36638) 2024-06-10T00:15:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae1e8a640 1 -- 172.21.15.79:0/2021244804 learned_addr learned my addr 172.21.15.79:0/2021244804 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7ff30ce5d640 1 -- 172.21.15.79:0/1622991150 wait complete. 2024-06-10T00:15:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.430+0000 7fc21bfff640 1 -- 172.21.15.79:0/4211448097 wait complete. 2024-06-10T00:15:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f4ad2d9d640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad4166840 0x7f4ad4160830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009f70 tx=0x7f4acc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae1689640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9adc0cde10 0x7f9adc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f9ae268b640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9adc162440 0x7f9adc071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f2e21b09640 1 -- 172.21.15.79:0/3441667754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0cd160 msgr2=0x7f2e1c0d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7f2e21b09640 1 --2- 172.21.15.79:0/3441667754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0cd160 0x7f2e1c0d0190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400be30 tx=0x7f2e1402ea90 comp rx=0 tx=0).stop 2024-06-10T00:15:04.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9c0a7d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 0x7fc9bc09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7ff1d6ee0640 1 Processor -- start 2024-06-10T00:15:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9c0a7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 0x7fc9bc09af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9c0a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9bc15c7f0 0x7fc9bc12ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9c0a7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc0b36a0 con 0x7fc9bc15c7f0 2024-06-10T00:15:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9c0a7d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc0b3520 con 0x7fc9bc072130 2024-06-10T00:15:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9c0a7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc9bc0b3820 con 0x7fc9bc156830 2024-06-10T00:15:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9b9d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 0x7fc9bc09af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9ba59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 0x7fc9bc09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9bad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9bc15c7f0 0x7fc9bc12ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7ff1d6ee0640 1 -- start start 2024-06-10T00:15:04.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9ba59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 0x7fc9bc09aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48124/0 (socket says 172.21.15.79:48124) 2024-06-10T00:15:04.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.431+0000 7fc9ba59c640 1 -- 172.21.15.79:0/2687287381 learned_addr learned my addr 172.21.15.79:0/2687287381 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f9ae268b640 1 -- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9adc0cde10 msgr2=0x7f9adc070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f9ae268b640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9adc0cde10 0x7f9adc070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f9ae268b640 1 -- 172.21.15.79:0/2021244804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cccf0 msgr2=0x7f9adc15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f9ae268b640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9adc0cccf0 0x7f9adc15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f9ae268b640 1 -- 172.21.15.79:0/2021244804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9adc09aab0 con 0x7f9adc162440 2024-06-10T00:15:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f2e21b09640 1 -- 172.21.15.79:0/3441667754 shutdown_connections 2024-06-10T00:15:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f2e21b09640 1 --2- 172.21.15.79:0/3441667754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c0cd160 0x7f2e1c0d0190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f2e21b09640 1 -- 172.21.15.79:0/3441667754 >> 172.21.15.79:0/3441667754 conn(0x7f2e1c06b3c0 msgr2=0x7f2e1c06b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f2e21b09640 1 -- 172.21.15.79:0/3441667754 shutdown_connections 2024-06-10T00:15:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f2e21b09640 1 -- 172.21.15.79:0/3441667754 wait complete. 2024-06-10T00:15:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7fc9ba59c640 1 -- 172.21.15.79:0/2687287381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 msgr2=0x7fc9bc09af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7fc9ba59c640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9bc156830 0x7fc9bc09af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7fc9ba59c640 1 -- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9bc15c7f0 msgr2=0x7fc9bc12ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7fc9ba59c640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9bc15c7f0 0x7fc9bc12ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7fc9ba59c640 1 -- 172.21.15.79:0/2687287381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc09ce50 con 0x7fc9bc072130 2024-06-10T00:15:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc041020 con 0x7f4ad4166840 2024-06-10T00:15:04.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4acc008690 con 0x7f4ad4166840 2024-06-10T00:15:04.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc036040 con 0x7f4ad4166840 2024-06-10T00:15:04.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f9ae268b640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9adc162440 0x7f9adc071440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8031000 tx=0x7f9ad80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f589eb14640 1 -- 172.21.15.79:0/236209126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 msgr2=0x7f58900e1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f589eb14640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f58900e1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8041030 con 0x7f9adc162440 2024-06-10T00:15:04.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f589eb14640 1 -- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58900e0dd0 msgr2=0x7f58900cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7fc21bfff640 1 Processor -- start 2024-06-10T00:15:04.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad41ecf90 con 0x7f4ad4166840 2024-06-10T00:15:04.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad41ed550 con 0x7f4ad4166840 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f589eb14640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58900e0dd0 0x7f58900cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f589eb14640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589004b260 con 0x7f58900e11b0 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f589e313640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589003a3c0 0x7f58900e1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f589db12640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58900e0dd0 0x7f58900cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f589eb14640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 0x7f589004ba20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5898000b60 tx=0x7f5898074380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898073900 con 0x7f58900e11b0 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589808f030 con 0x7f58900e11b0 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589806c660 con 0x7f58900e11b0 2024-06-10T00:15:04.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589004dee0 con 0x7f58900e11b0 2024-06-10T00:15:04.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58900e1b90 con 0x7f58900e11b0 2024-06-10T00:15:04.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7ff1d6ee0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c8048b90 0x7ff1c80e1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7ff1d6ee0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c80e1fb0 0x7ff1c80c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7ff1d5ede640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c8048b90 0x7ff1c80e1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7ff1d5ede640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c8048b90 0x7ff1c80e1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48130/0 (socket says 172.21.15.79:48130) 2024-06-10T00:15:04.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7ff1d6ee0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c80d1f20 0x7ff1c80c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.432+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9adc165100 con 0x7f9adc162440 2024-06-10T00:15:04.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9adc09ad20 con 0x7f9adc162440 2024-06-10T00:15:04.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad803d4e0 con 0x7f9adc162440 2024-06-10T00:15:04.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7f2e21b09640 1 Processor -- start 2024-06-10T00:15:04.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7fc21bfff640 1 -- start start 2024-06-10T00:15:04.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2140df220 0x7fc2140d8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140e2d80 0x7fc21404e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2140df220 0x7fc2140d8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7f2e21b09640 1 -- start start 2024-06-10T00:15:04.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2140df220 0x7fc2140d8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36666/0 (socket says 172.21.15.79:36666) 2024-06-10T00:15:04.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21affd640 1 -- 172.21.15.79:0/2044634855 learned_addr learned my addr 172.21.15.79:0/2044634855 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21bfff640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2140e31e0 0x7fc2140d66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2140df600 con 0x7fc2140df220 2024-06-10T00:15:04.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc2140e3670 con 0x7fc2140e2d80 2024-06-10T00:15:04.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc2140e3a60 con 0x7fc2140e31e0 2024-06-10T00:15:04.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7ff30ce5d640 1 Processor -- start 2024-06-10T00:15:04.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7ff30ce5d640 1 -- start start 2024-06-10T00:15:04.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8037040 con 0x7f9adc162440 2024-06-10T00:15:04.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5890005390 con 0x7f58900e11b0 2024-06-10T00:15:04.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.433+0000 7fc9ba59c640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 0x7fc9bc09aa10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c7f0 tx=0x7fc9b000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0015070 con 0x7fc9bc072130 2024-06-10T00:15:04.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/2687287381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc09d130 con 0x7fc9bc072130 2024-06-10T00:15:04.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7f4ac0ff9640 1 -- 172.21.15.79:0/3363605300 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4aac001030 con 0x7f4ad4166840 2024-06-10T00:15:04.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/2687287381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc09d6f0 con 0x7fc9bc072130 2024-06-10T00:15:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff30ce5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff300007460 0x7ff3001a3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff30ce5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 0x7ff3000e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff30ce5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff300054560 0x7ff3000490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff30ce5d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff300006720 con 0x7ff300048100 2024-06-10T00:15:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff30ce5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff300006a90 con 0x7ff300007460 2024-06-10T00:15:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff30ce5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff300050040 con 0x7ff300054560 2024-06-10T00:15:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7fc21a7fc640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140e2d80 0x7fc21404e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff1d6ee0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8052b40 con 0x7ff1c80d1f20 2024-06-10T00:15:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff1d6ee0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8007390 con 0x7ff1c8048b90 2024-06-10T00:15:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff1d6ee0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c8052cc0 con 0x7ff1c80e1fb0 2024-06-10T00:15:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff1d66df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c80d1f20 0x7ff1c80c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff1d56dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c80e1fb0 0x7ff1c80c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.434+0000 7ff1d56dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c80e1fb0 0x7ff1c80c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50392/0 (socket says 172.21.15.79:50392) 2024-06-10T00:15:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7ff1d56dd640 1 -- 172.21.15.79:0/2704769527 learned_addr learned my addr 172.21.15.79:0/2704769527 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7fc21b7fe640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2140e31e0 0x7fc2140d66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b0007a30 con 0x7fc9bc072130 2024-06-10T00:15:04.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7f2e21b09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c06beb0 0x7f2e1c09c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7f2e21b09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1c0ccce0 0x7f2e1c0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7f2e21b09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1c0cd160 0x7f2e1c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7f2e21b09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c0cf300 con 0x7f2e1c06beb0 2024-06-10T00:15:04.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7f2e21b09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c0b4fe0 con 0x7f2e1c0cd160 2024-06-10T00:15:04.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7f2e21b09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1c0cf480 con 0x7f2e1c0ccce0 2024-06-10T00:15:04.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7f2e1bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1c0cd160 0x7f2e1c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7ff1d5ede640 1 -- 172.21.15.79:0/2704769527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c80e1fb0 msgr2=0x7ff1c80c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7ff1d5ede640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c80e1fb0 0x7ff1c80c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7ff1d5ede640 1 -- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c80d1f20 msgr2=0x7ff1c80c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7ff1d5ede640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c80d1f20 0x7ff1c80c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7fc21a7fc640 1 -- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2140e31e0 msgr2=0x7fc2140d66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7fc21a7fc640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2140e31e0 0x7fc2140d66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7fc21a7fc640 1 -- 172.21.15.79:0/2044634855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2140df220 msgr2=0x7fc2140d8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7fc21a7fc640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2140df220 0x7fc2140d8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7fc21a7fc640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc214034850 con 0x7fc2140e2d80 2024-06-10T00:15:04.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff1d5ede640 1 -- 172.21.15.79:0/2704769527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c8048f70 con 0x7ff1c8048b90 2024-06-10T00:15:04.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ac4001030 con 0x7f9adc162440 2024-06-10T00:15:04.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e1bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1c0cd160 0x7f2e1c0b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48150/0 (socket says 172.21.15.79:48150) 2024-06-10T00:15:04.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e1bfff640 1 -- 172.21.15.79:0/1997984203 learned_addr learned my addr 172.21.15.79:0/1997984203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7ff30659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff300007460 0x7ff3001a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7ff30659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff300007460 0x7ff3001a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48144/0 (socket says 172.21.15.79:48144) 2024-06-10T00:15:04.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.435+0000 7ff30659c640 1 -- 172.21.15.79:0/653322207 learned_addr learned my addr 172.21.15.79:0/653322207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0007e00 con 0x7fc9bc072130 2024-06-10T00:15:04.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff306d9d640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff300054560 0x7ff3000490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/2687287381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9a0001030 con 0x7fc9bc072130 2024-06-10T00:15:04.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f589806c800 con 0x7f58900e11b0 2024-06-10T00:15:04.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e12ffd640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1c0ccce0 0x7f2e1c0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff305d9b640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 0x7ff3000e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff1d5ede640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c8048b90 0x7ff1c80e1a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00e7f0 tx=0x7ff1cc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4acc044020 con 0x7f4ad4166840 2024-06-10T00:15:04.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e1b7fe640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c06beb0 0x7f2e1c09c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7fc21a7fc640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140e2d80 0x7fc21404e3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc20800c450 tx=0x7fc20800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f588effd640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f587c06beb0 0x7f587c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ad8044070 con 0x7f9adc162440 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff30659c640 1 -- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff300054560 msgr2=0x7ff3000490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff30659c640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff300054560 0x7ff3000490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff30659c640 1 -- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 msgr2=0x7ff3000e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff30659c640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 0x7ff3000e9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff30659c640 1 -- 172.21.15.79:0/653322207 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3001a3670 con 0x7ff300007460 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff306d9d640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff300054560 0x7ff3000490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff305d9b640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff300048100 0x7ff3000e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e1bfff640 1 -- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1c0ccce0 msgr2=0x7f2e1c0c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e1bfff640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1c0ccce0 0x7f2e1c0c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e1bfff640 1 -- 172.21.15.79:0/1997984203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c06beb0 msgr2=0x7f2e1c09c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e1bfff640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1c06beb0 0x7f2e1c09c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7f2e1bfff640 1 -- 172.21.15.79:0/1997984203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c09cf00 con 0x7f2e1c0cd160 2024-06-10T00:15:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc017070 con 0x7ff1c8048b90 2024-06-10T00:15:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc004020 con 0x7ff1c8048b90 2024-06-10T00:15:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0043f0 con 0x7ff1c8048b90 2024-06-10T00:15:04.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c80e09d0 con 0x7ff1c8048b90 2024-06-10T00:15:04.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.436+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c80e0f90 con 0x7ff1c8048b90 2024-06-10T00:15:04.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f4ac2ffd640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ab406bf00 0x7f4ab406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5898106220 con 0x7f58900e11b0 2024-06-10T00:15:04.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208018070 con 0x7fc2140e2d80 2024-06-10T00:15:04.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4acc0abea0 con 0x7f4ad4166840 2024-06-10T00:15:04.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f4ac2ffd640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f4ab4075600 0x7f4ab4077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4acc031600 con 0x7f4ab4075600 2024-06-10T00:15:04.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f4ad259c640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ab406bf00 0x7f4ab406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f589e313640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f587c06beb0 0x7f587c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f588effd640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7f587c075620 0x7f587c077a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2080074e0 con 0x7fc2140e2d80 2024-06-10T00:15:04.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21404e910 con 0x7fc2140e2d80 2024-06-10T00:15:04.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2140d8f80 con 0x7fc2140e2d80 2024-06-10T00:15:04.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f9ad27fc640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ac006bf00 0x7f9ac006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5898090e50 con 0x7f587c075620 2024-06-10T00:15:04.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f589810d050 con 0x7f58900e11b0 2024-06-10T00:15:04.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9ad80ab730 con 0x7f9adc162440 2024-06-10T00:15:04.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.437+0000 7f589db12640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7f587c075620 0x7f587c077a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f589e313640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f587c06beb0 0x7f587c06e370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5888007fd0 tx=0x7f5888007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4acc076090 con 0x7f4ad4166840 2024-06-10T00:15:04.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208004a00 con 0x7fc2140e2d80 2024-06-10T00:15:04.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f2e1bfff640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1c0cd160 0x7f2e1c0b1da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400be30 tx=0x7f2e14004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f589db12640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7f587c075620 0x7f587c077a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1f8001030 con 0x7fc2140e2d80 2024-06-10T00:15:04.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f9ae1e8a640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ac006bf00 0x7f9ac006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7ff30659c640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff300007460 0x7ff3001a3130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098c0 tx=0x7ff2f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8042020 con 0x7ff300007460 2024-06-10T00:15:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f803d690 con 0x7ff300007460 2024-06-10T00:15:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8037040 con 0x7ff300007460 2024-06-10T00:15:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f4ad1d9b640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f4ab4075600 0x7f4ab4077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1c8005390 con 0x7ff1c8048b90 2024-06-10T00:15:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f9ad27fc640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7f9ac0075600 0x7f9ac0077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1403c830 con 0x7f2e1c0cd160 2024-06-10T00:15:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ad800af30 con 0x7f9ac0075600 2024-06-10T00:15:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9ad80b2050 con 0x7f9adc162440 2024-06-10T00:15:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f4ad259c640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ab406bf00 0x7f4ab406e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40b4490 tx=0x7f4ac4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9b0018070 con 0x7fc9bc072130 2024-06-10T00:15:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7f9ae1689640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7f9ac0075600 0x7f9ac0077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7f4ad1d9b640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f4ab4075600 0x7f4ab4077a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.438+0000 7f2e21b09640 1 -- 172.21.15.79:0/1997984203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c09d1e0 con 0x7f2e1c0cd160 2024-06-10T00:15:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7f2e21b09640 1 -- 172.21.15.79:0/1997984203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1c09d7a0 con 0x7f2e1c0cd160 2024-06-10T00:15:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1403c9d0 con 0x7f2e1c0cd160 2024-06-10T00:15:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1403cdc0 con 0x7f2e1c0cd160 2024-06-10T00:15:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7ff30ce5d640 1 -- 172.21.15.79:0/653322207 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30004b5d0 con 0x7ff300007460 2024-06-10T00:15:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7ff30ce5d640 1 -- 172.21.15.79:0/653322207 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff300048610 con 0x7ff300007460 2024-06-10T00:15:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7fc9aaffd640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc99c06bf00 0x7fc99c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7f9ae1e8a640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ac006bf00 0x7f9ac006e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9acc006a90 tx=0x7f9acc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5898090e50 con 0x7f587c075620 2024-06-10T00:15:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.439+0000 7fc9b9d9b640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc99c06bf00 0x7fc99c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7f9ae1689640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7f9ac0075600 0x7f9ac0077a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7f2e21b09640 1 -- 172.21.15.79:0/1997984203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e1c068430 con 0x7f2e1c0cd160 2024-06-10T00:15:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc20801b070 con 0x7fc2140e2d80 2024-06-10T00:15:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7ff30ce5d640 1 -- 172.21.15.79:0/653322207 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3000053c0 con 0x7ff300007460 2024-06-10T00:15:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4acc031600 con 0x7f4ab4075600 2024-06-10T00:15:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc9b008b690 con 0x7fc9bc072130 2024-06-10T00:15:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc9aaffd640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fc99c075680 0x7fc99c077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9b001de70 con 0x7fc99c075680 2024-06-10T00:15:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc9b008ba80 con 0x7fc9bc072130 2024-06-10T00:15:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc9b9d9b640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc99c06bf00 0x7fc99c06e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4033000 tx=0x7fc9b4009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc2137fe640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc20406bf00 0x7fc20406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ad800af30 con 0x7f9ac0075600 2024-06-10T00:15:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc9bad9d640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fc99c075680 0x7fc99c077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc20808a990 con 0x7fc2140e2d80 2024-06-10T00:15:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc2137fe640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fc204075680 0x7fc204077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7fc21affd640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc20406bf00 0x7fc20406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2080074e0 con 0x7fc204075680 2024-06-10T00:15:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc20808ad80 con 0x7fc2140e2d80 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1cc005990 con 0x7ff1c8048b90 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7ff1c67fc640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1b406be80 0x7ff1b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff1cc08b3c0 con 0x7ff1c8048b90 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7ff1c67fc640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff1b4075600 0x7ff1b4077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1cc001d30 con 0x7ff1b4075600 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.440+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff1cc08b770 con 0x7ff1c8048b90 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7ff1d56dd640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1b406be80 0x7ff1b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7ff1d66df640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff1b4075600 0x7ff1b4077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7ff1d66df640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff1b4075600 0x7ff1b4077a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7ff1d56dd640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1b406be80 0x7ff1b406e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00098a0 tx=0x7ff1c0038000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.441+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e1404e060 con 0x7f2e1c0cd160 2024-06-10T00:15:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7f2e18ff9640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7fc21affd640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc20406bf00 0x7fc20406e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009560 tx=0x7fc20c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1cc001d30 con 0x7ff1b4075600 2024-06-10T00:15:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2f8045020 con 0x7ff300007460 2024-06-10T00:15:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2e140b0bf0 con 0x7f2e1c0cd160 2024-06-10T00:15:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7fc9bad9d640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fc99c075680 0x7fc99c077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7f2e18ff9640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f2e00075530 0x7f2e00077970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e14048e50 con 0x7f2e00075530 2024-06-10T00:15:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.442+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2e140b0fe0 con 0x7f2e1c0cd160 2024-06-10T00:15:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7f2e12ffd640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f2e00075530 0x7f2e00077970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7f2e1b7fe640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7ff2f6ffd640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff2e806bf00 0x7ff2e806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff2f80ab630 con 0x7ff300007460 2024-06-10T00:15:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7ff2f6ffd640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7ff2e8075670 0x7ff2e8077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2f802be50 con 0x7ff2e8075670 2024-06-10T00:15:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff2f80b2050 con 0x7ff300007460 2024-06-10T00:15:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7ff305d9b640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff2e806bf00 0x7ff2e806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.443+0000 7f2e1b7fe640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e0006be30 0x7f2e0006e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c000f60 tx=0x7f2e0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.444+0000 7ff306d9d640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7ff2e8075670 0x7ff2e8077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.444+0000 7f2e12ffd640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f2e00075530 0x7f2e00077970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.444+0000 7ff305d9b640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff2e806bf00 0x7ff2e806e3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3000e6dc0 tx=0x7ff2fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.444+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9b001de70 con 0x7fc99c075680 2024-06-10T00:15:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.444+0000 7fc21b7fe640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fc204075680 0x7fc204077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.444+0000 7ff306d9d640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7ff2e8075670 0x7ff2e8077ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.445+0000 7fc21b7fe640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fc204075680 0x7fc204077ac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.445+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e14048e50 con 0x7f2e00075530 2024-06-10T00:15:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.445+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2f802be50 con 0x7ff2e8075670 2024-06-10T00:15:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.446+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2080074e0 con 0x7fc204075680 2024-06-10T00:15:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.472+0000 7f4ac0ff9640 1 -- 172.21.15.79:0/3363605300 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4aac002dd0 con 0x7f4ab4075600 2024-06-10T00:15:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.472+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ac4002dd0 con 0x7f9ac0075600 2024-06-10T00:15:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.472+0000 7f4ac2ffd640 1 -- 172.21.15.79:0/3363605300 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4aac002dd0 con 0x7f4ab4075600 2024-06-10T00:15:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.473+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f4ab4075600 msgr2=0x7f4ab4077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.473+0000 7f4ad8858640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f4ab4075600 0x7f4ab4077a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.473+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ab406bf00 msgr2=0x7f4ab406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.473+0000 7f4ad8858640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ab406bf00 0x7f4ab406e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40b4490 tx=0x7f4ac4009040 comp rx=0 tx=0).stop 2024-06-10T00:15:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.473+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad4166840 msgr2=0x7f4ad4160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.473+0000 7f4ad8858640 1 --2- 172.21.15.79:0/3363605300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad4166840 0x7f4ad4160830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009f70 tx=0x7f4acc004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.473+0000 7f4ad2d9d640 1 -- 172.21.15.79:0/3363605300 reap_dead start 2024-06-10T00:15:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.474+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 shutdown_connections 2024-06-10T00:15:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.474+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 >> 172.21.15.79:0/3363605300 conn(0x7f4ad40b5980 msgr2=0x7f4ad40b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.474+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 shutdown_connections 2024-06-10T00:15:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.474+0000 7f9ad27fc640 1 -- 172.21.15.79:0/2021244804 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9ac4002dd0 con 0x7f9ac0075600 2024-06-10T00:15:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.474+0000 7f4ad8858640 1 -- 172.21.15.79:0/3363605300 wait complete. 2024-06-10T00:15:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7f9ac0075600 msgr2=0x7f9ac0077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7f9ac0075600 0x7f9ac0077a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1c80de170 con 0x7ff1b4075600 2024-06-10T00:15:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ac006bf00 msgr2=0x7f9ac006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ac006bf00 0x7f9ac006e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9acc006a90 tx=0x7f9acc008040 comp rx=0 tx=0).stop 2024-06-10T00:15:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9adc162440 msgr2=0x7f9adc071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 --2- 172.21.15.79:0/2021244804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9adc162440 0x7f9adc071440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8031000 tx=0x7f9ad80046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae268b640 1 -- 172.21.15.79:0/2021244804 reap_dead start 2024-06-10T00:15:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 shutdown_connections 2024-06-10T00:15:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 >> 172.21.15.79:0/2021244804 conn(0x7f9adc06b3c0 msgr2=0x7f9adc1616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 shutdown_connections 2024-06-10T00:15:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5890009c00 con 0x7f587c075620 2024-06-10T00:15:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.475+0000 7f9ae2e8c640 1 -- 172.21.15.79:0/2021244804 wait complete. 2024-06-10T00:15:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.476+0000 7ff1c67fc640 1 -- 172.21.15.79:0/2704769527 <== osd.2 v2:172.21.15.79:6816/3079975341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff1c80de170 con 0x7ff1b4075600 2024-06-10T00:15:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.476+0000 7ff30ce5d640 1 -- 172.21.15.79:0/653322207 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff300052850 con 0x7ff2e8075670 2024-06-10T00:15:04.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.476+0000 7f588effd640 1 -- 172.21.15.79:0/236209126 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5890009c00 con 0x7f587c075620 2024-06-10T00:15:04.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.476+0000 7ff2f6ffd640 1 -- 172.21.15.79:0/653322207 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff300052850 con 0x7ff2e8075670 2024-06-10T00:15:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.476+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff1b4075600 msgr2=0x7ff1b4077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.476+0000 7ff1d6ee0640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff1b4075600 0x7ff1b4077a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7f587c075620 msgr2=0x7f587c077a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7f587c075620 0x7f587c077a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1f8002dd0 con 0x7fc204075680 2024-06-10T00:15:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f587c06beb0 msgr2=0x7f587c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f587c06beb0 0x7f587c06e370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5888007fd0 tx=0x7f5888007f00 comp rx=0 tx=0).stop 2024-06-10T00:15:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 msgr2=0x7f589004ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 --2- 172.21.15.79:0/236209126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58900e11b0 0x7f589004ba20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5898000b60 tx=0x7f5898074380 comp rx=0 tx=0).stop 2024-06-10T00:15:04.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589eb14640 1 -- 172.21.15.79:0/236209126 reap_dead start 2024-06-10T00:15:04.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 shutdown_connections 2024-06-10T00:15:04.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 >> 172.21.15.79:0/236209126 conn(0x7f5890056ce0 msgr2=0x7f58900080f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 shutdown_connections 2024-06-10T00:15:04.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7f589f315640 1 -- 172.21.15.79:0/236209126 wait complete. 2024-06-10T00:15:04.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7ff2f4ff9640 1 -- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7ff2e8075670 msgr2=0x7ff2e8077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.477+0000 7ff2f4ff9640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7ff2e8075670 0x7ff2e8077ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7fc2137fe640 1 -- 172.21.15.79:0/2044634855 <== osd.7 v2:172.21.15.117:6816/2099086267 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc1f8002dd0 con 0x7fc204075680 2024-06-10T00:15:04.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1b406be80 msgr2=0x7ff1b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff1d6ee0640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1b406be80 0x7ff1b406e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00098a0 tx=0x7ff1c0038000 comp rx=0 tx=0).stop 2024-06-10T00:15:04.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff2f4ff9640 1 -- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff2e806bf00 msgr2=0x7ff2e806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff2f4ff9640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff2e806bf00 0x7ff2e806e3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3000e6dc0 tx=0x7ff2fc009040 comp rx=0 tx=0).stop 2024-06-10T00:15:04.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff2f4ff9640 1 -- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff300007460 msgr2=0x7ff3001a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff2f4ff9640 1 --2- 172.21.15.79:0/653322207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff300007460 0x7ff3001a3130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098c0 tx=0x7ff2f80046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff306d9d640 1 -- 172.21.15.79:0/653322207 reap_dead start 2024-06-10T00:15:04.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c8048b90 msgr2=0x7ff1c80e1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff1d6ee0640 1 --2- 172.21.15.79:0/2704769527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c8048b90 0x7ff1c80e1a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00e7f0 tx=0x7ff1cc00ecb0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff1d66df640 1 -- 172.21.15.79:0/2704769527 reap_dead start 2024-06-10T00:15:04.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff2f4ff9640 1 -- 172.21.15.79:0/653322207 shutdown_connections 2024-06-10T00:15:04.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff2f4ff9640 1 -- 172.21.15.79:0/653322207 >> 172.21.15.79:0/653322207 conn(0x7ff300009fe0 msgr2=0x7ff30004d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fc204075680 msgr2=0x7fc204077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7fc21bfff640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fc204075680 0x7fc204077ac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 shutdown_connections 2024-06-10T00:15:04.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 >> 172.21.15.79:0/2704769527 conn(0x7ff1c8009fb0 msgr2=0x7ff1c804c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff2f4ff9640 1 -- 172.21.15.79:0/653322207 shutdown_connections 2024-06-10T00:15:04.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7ff2f4ff9640 1 -- 172.21.15.79:0/653322207 wait complete. 2024-06-10T00:15:04.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc20406bf00 msgr2=0x7fc20406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.478+0000 7fc21bfff640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc20406bf00 0x7fc20406e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009560 tx=0x7fc20c02e000 comp rx=0 tx=0).stop 2024-06-10T00:15:04.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140e2d80 msgr2=0x7fc21404e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7fc21bfff640 1 --2- 172.21.15.79:0/2044634855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2140e2d80 0x7fc21404e3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc20800c450 tx=0x7fc20800c910 comp rx=0 tx=0).stop 2024-06-10T00:15:04.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7fc21b7fe640 1 -- 172.21.15.79:0/2044634855 reap_dead start 2024-06-10T00:15:04.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 shutdown_connections 2024-06-10T00:15:04.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 shutdown_connections 2024-06-10T00:15:04.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 >> 172.21.15.79:0/2044634855 conn(0x7fc21400a400 msgr2=0x7fc2140de060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7ff1d6ee0640 1 -- 172.21.15.79:0/2704769527 wait complete. 2024-06-10T00:15:04.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7fc9c0a7d640 1 -- 172.21.15.79:0/2687287381 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9a0002d50 con 0x7fc99c075680 2024-06-10T00:15:04.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7f2e21b09640 1 -- 172.21.15.79:0/1997984203 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2e1c0cf930 con 0x7f2e00075530 2024-06-10T00:15:04.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 shutdown_connections 2024-06-10T00:15:04.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.479+0000 7fc21bfff640 1 -- 172.21.15.79:0/2044634855 wait complete. 2024-06-10T00:15:04.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.480+0000 7fc9aaffd640 1 -- 172.21.15.79:0/2687287381 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc9a0002d50 con 0x7fc99c075680 2024-06-10T00:15:04.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.480+0000 7f2e18ff9640 1 -- 172.21.15.79:0/1997984203 <== osd.5 v2:172.21.15.117:6800/419453692 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2e1c0cf930 con 0x7f2e00075530 2024-06-10T00:15:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.480+0000 7f2e11ffb640 1 -- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f2e00075530 msgr2=0x7f2e00077970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.480+0000 7f2e11ffb640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f2e00075530 0x7f2e00077970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7f2e11ffb640 1 -- 172.21.15.79:0/1997984203 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e0006be30 msgr2=0x7f2e0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7f2e11ffb640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e0006be30 0x7f2e0006e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c000f60 tx=0x7f2e0c009040 comp rx=0 tx=0).stop 2024-06-10T00:15:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7f2e11ffb640 1 -- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1c0cd160 msgr2=0x7f2e1c0b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7f2e11ffb640 1 --2- 172.21.15.79:0/1997984203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1c0cd160 0x7f2e1c0b1da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400be30 tx=0x7f2e14004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7f2e1bfff640 1 -- 172.21.15.79:0/1997984203 reap_dead start 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7fc9a8ff9640 1 -- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fc99c075680 msgr2=0x7fc99c077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7fc9a8ff9640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fc99c075680 0x7fc99c077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7fc9a8ff9640 1 -- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc99c06bf00 msgr2=0x7fc99c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7fc9a8ff9640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc99c06bf00 0x7fc99c06e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4033000 tx=0x7fc9b4009000 comp rx=0 tx=0).stop 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7fc9a8ff9640 1 -- 172.21.15.79:0/2687287381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 msgr2=0x7fc9bc09aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.481+0000 7fc9a8ff9640 1 --2- 172.21.15.79:0/2687287381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9bc072130 0x7fc9bc09aa10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c7f0 tx=0x7fc9b000cbf0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.482+0000 7fc9bad9d640 1 -- 172.21.15.79:0/2687287381 reap_dead start 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.482+0000 7fc9a8ff9640 1 -- 172.21.15.79:0/2687287381 shutdown_connections 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.482+0000 7fc9a8ff9640 1 -- 172.21.15.79:0/2687287381 >> 172.21.15.79:0/2687287381 conn(0x7fc9bc0b19f0 msgr2=0x7fc9bc0aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.482+0000 7fc9a8ff9640 1 -- 172.21.15.79:0/2687287381 shutdown_connections 2024-06-10T00:15:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.482+0000 7fc9a8ff9640 1 -- 172.21.15.79:0/2687287381 wait complete. 2024-06-10T00:15:04.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.483+0000 7f2e11ffb640 1 -- 172.21.15.79:0/1997984203 shutdown_connections 2024-06-10T00:15:04.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.483+0000 7f2e11ffb640 1 -- 172.21.15.79:0/1997984203 >> 172.21.15.79:0/1997984203 conn(0x7f2e1c06b3c0 msgr2=0x7f2e1c15c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.483+0000 7f2e11ffb640 1 -- 172.21.15.79:0/1997984203 shutdown_connections 2024-06-10T00:15:04.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.483+0000 7f2e11ffb640 1 -- 172.21.15.79:0/1997984203 wait complete. 2024-06-10T00:15:04.542 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:04.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-10T00:15:04.543 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:04.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-10T00:15:04.544 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:04.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-10T00:15:04.545 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:04.545 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-10T00:15:04.546 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:04.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-10T00:15:04.547 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:04.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-10T00:15:04.548 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:04.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-10T00:15:04.549 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:04.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-10T00:15:04.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.753+0000 7feda759e640 1 Processor -- start 2024-06-10T00:15:04.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.753+0000 7feda759e640 1 -- start start 2024-06-10T00:15:04.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.754+0000 7fd44a49e640 1 Processor -- start 2024-06-10T00:15:04.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.754+0000 7fd44a49e640 1 -- start start 2024-06-10T00:15:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.754+0000 7feda759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8162a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.754+0000 7feda759e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feda80b3800 0x7feda815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.754+0000 7feda759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda80cfa20 con 0x7feda80cca80 2024-06-10T00:15:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.754+0000 7feda759e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7feda8163090 con 0x7feda80b3800 2024-06-10T00:15:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.754+0000 7feda759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feda8163370 con 0x7feda80cce60 2024-06-10T00:15:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7feda6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feda80b3800 0x7feda815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7feda6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feda80b3800 0x7feda815c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36696/0 (socket says 172.21.15.79:36696) 2024-06-10T00:15:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7feda6d9d640 1 -- 172.21.15.79:0/2853970106 learned_addr learned my addr 172.21.15.79:0/2853970106 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7feda5d9b640 1 --2- 172.21.15.79:0/2853970106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7feda6d9d640 1 -- 172.21.15.79:0/2853970106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 msgr2=0x7feda8162a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7feda6d9d640 1 --2- 172.21.15.79:0/2853970106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8162a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7feda6d9d640 1 -- 172.21.15.79:0/2853970106 >> v1:172.21.15.117:6789/0 conn(0x7feda80cca80 legacy=0x7feda80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7feda6d9d640 1 -- 172.21.15.79:0/2853970106 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda8163650 con 0x7feda80b3800 2024-06-10T00:15:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fae7c184640 1 Processor -- start 2024-06-10T00:15:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7f80aac95640 1 Processor -- start 2024-06-10T00:15:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7fd44a49e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd444165bc0 0x7fd44406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7fd44a49e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4440b4e30 0x7fd44406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7fd44a49e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd444165fa0 con 0x7fd444072820 2024-06-10T00:15:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7fd44a49e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440af990 con 0x7fd4440b4e30 2024-06-10T00:15:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.755+0000 7fd44a49e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440afc70 con 0x7fd444165bc0 2024-06-10T00:15:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd443fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd444165bc0 0x7fd44406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd443fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd444165bc0 0x7fd44406c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48164/0 (socket says 172.21.15.79:48164) 2024-06-10T00:15:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7f80aac95640 1 -- start start 2024-06-10T00:15:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd443fff640 1 -- 172.21.15.79:0/65661829 learned_addr learned my addr 172.21.15.79:0/65661829 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd448a3b640 1 --2- 172.21.15.79:0/65661829 >> v2:172.21.15.79:3300/0 conn(0x7fd4440b4e30 0x7fd44406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7f5f4bfff640 1 Processor -- start 2024-06-10T00:15:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7f5f4bfff640 1 -- start start 2024-06-10T00:15:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd443fff640 1 -- 172.21.15.79:0/65661829 >> v2:172.21.15.79:3300/0 conn(0x7fd4440b4e30 msgr2=0x7fd44406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd443fff640 1 --2- 172.21.15.79:0/65661829 >> v2:172.21.15.79:3300/0 conn(0x7fd4440b4e30 0x7fd44406c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd443fff640 1 -- 172.21.15.79:0/65661829 >> v1:172.21.15.79:6789/0 conn(0x7fd444072820 legacy=0x7fd444166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd443fff640 1 -- 172.21.15.79:0/65661829 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4440aff50 con 0x7fd444165bc0 2024-06-10T00:15:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fb027342640 1 Processor -- start 2024-06-10T00:15:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fd448a3b640 1 --2- 172.21.15.79:0/65661829 >> v2:172.21.15.79:3300/0 conn(0x7fd4440b4e30 0x7fd44406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7feda6d9d640 1 --2- 172.21.15.79:0/2853970106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80b3800 0x7feda815c5b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feda0009e50 tx=0x7feda002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a05718d6eaee9ce server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7feda559a640 1 -- 172.21.15.79:0/2853970106 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0036070 con 0x7feda80b3800 2024-06-10T00:15:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fba8aa93640 1 Processor -- start 2024-06-10T00:15:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7fba8aa93640 1 -- start start 2024-06-10T00:15:04.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7feda559a640 1 -- 172.21.15.79:0/2853970106 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda0031600 con 0x7feda80b3800 2024-06-10T00:15:04.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7feda559a640 1 -- 172.21.15.79:0/2853970106 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00319d0 con 0x7feda80b3800 2024-06-10T00:15:04.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.756+0000 7fae7c184640 1 -- start start 2024-06-10T00:15:04.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80aac95640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f809c050dd0 0x7f809c038630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80aac95640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f809c03a5d0 0x7f809c005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f3120d3c640 1 Processor -- start 2024-06-10T00:15:04.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80aac95640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f809c04f540 con 0x7f809c0e1090 2024-06-10T00:15:04.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80aac95640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f809c04f820 con 0x7f809c03a5d0 2024-06-10T00:15:04.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80aac95640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f809c04fb00 con 0x7f809c050dd0 2024-06-10T00:15:04.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80a9232640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f809c03a5d0 0x7f809c005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7fae7c184640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae7406b3c0 0x7fae74072650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7fae7c184640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae7406b7a0 0x7fae740cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7fae7c184640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae74072ca0 con 0x7fae74162a90 2024-06-10T00:15:04.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7fae7c184640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fae74072f80 con 0x7fae7406b3c0 2024-06-10T00:15:04.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7fae7c184640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fae740cedd0 con 0x7fae7406b7a0 2024-06-10T00:15:04.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80a9232640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f809c03a5d0 0x7f809c005f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36722/0 (socket says 172.21.15.79:36722) 2024-06-10T00:15:04.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80a9232640 1 -- 172.21.15.79:0/3585322591 learned_addr learned my addr 172.21.15.79:0/3585322591 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f80a3fff640 1 --2- 172.21.15.79:0/3585322591 >> v2:172.21.15.117:3300/0 conn(0x7f809c050dd0 0x7f809c038630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f5f4bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f4c071fa0 0x7f5f4c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f4c06fea0 0x7f5f4c070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4bfff640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5f4c072710 con 0x7f5f4c071fa0 2024-06-10T00:15:04.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5f4c0729f0 con 0x7f5f4c06fea0 2024-06-10T00:15:04.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4c072cd0 con 0x7f5f4c145610 2024-06-10T00:15:04.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7feda759e640 1 -- 172.21.15.79:0/2853970106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80b3800 msgr2=0x7feda815c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fb027342640 1 -- start start 2024-06-10T00:15:04.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4a7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f4c071fa0 0x7f5f4c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4a7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f4c071fa0 0x7f5f4c0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36728/0 (socket says 172.21.15.79:36728) 2024-06-10T00:15:04.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4a7fc640 1 -- 172.21.15.79:0/2610139829 learned_addr learned my addr 172.21.15.79:0/2610139829 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50414/0 (socket says 172.21.15.79:50414) 2024-06-10T00:15:04.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f4c06fea0 0x7f5f4c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fd443fff640 1 --2- 172.21.15.79:0/65661829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd44406c3d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd444073360 tx=0x7fd43802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d4d9a30ee92277 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f80a3fff640 1 -- 172.21.15.79:0/3585322591 >> v2:172.21.15.79:3300/0 conn(0x7f809c03a5d0 msgr2=0x7f809c005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f80a3fff640 1 --2- 172.21.15.79:0/3585322591 >> v2:172.21.15.79:3300/0 conn(0x7f809c03a5d0 0x7f809c005f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f80a3fff640 1 -- 172.21.15.79:0/3585322591 >> v1:172.21.15.79:6789/0 conn(0x7f809c0e1090 legacy=0x7f809c039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f80a3fff640 1 -- 172.21.15.79:0/3585322591 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c04fde0 con 0x7f809c050dd0 2024-06-10T00:15:04.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7feda759e640 1 --2- 172.21.15.79:0/2853970106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80b3800 0x7feda815c5b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feda0009e50 tx=0x7feda002a730 comp rx=0 tx=0).stop 2024-06-10T00:15:04.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4affd640 1 -- 172.21.15.79:0/2610139829 >> v2:172.21.15.117:3300/0 conn(0x7f5f4c06fea0 msgr2=0x7f5f4c070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4affd640 1 --2- 172.21.15.79:0/2610139829 >> v2:172.21.15.117:3300/0 conn(0x7f5f4c06fea0 0x7f5f4c070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4affd640 1 -- 172.21.15.79:0/2610139829 >> v2:172.21.15.79:3300/0 conn(0x7f5f4c071fa0 msgr2=0x7f5f4c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4affd640 1 --2- 172.21.15.79:0/2610139829 >> v2:172.21.15.79:3300/0 conn(0x7f5f4c071fa0 0x7f5f4c0b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fd442ffd640 1 -- 172.21.15.79:0/65661829 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438037070 con 0x7fd444165bc0 2024-06-10T00:15:04.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fd442ffd640 1 -- 172.21.15.79:0/65661829 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43802ae20 con 0x7fd444165bc0 2024-06-10T00:15:04.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fd442ffd640 1 -- 172.21.15.79:0/65661829 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438032660 con 0x7fd444165bc0 2024-06-10T00:15:04.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.757+0000 7f3120d3c640 1 -- start start 2024-06-10T00:15:04.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f3120d3c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f311c15e2d0 0x7f311c0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f3120d3c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f311c15e6b0 0x7f311c0d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fba8aa93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840d1280 0x7fba840b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fba8aa93640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba840b2e00 con 0x7fba840c9000 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fba8aa93640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8406c5e0 con 0x7fba840c4c60 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fba8aa93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba840b3620 con 0x7fba840d1280 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fba89030640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fba840c9000 0x7fba840c9490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50694/0 (socket says 172.21.15.79:50694) 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fba89030640 1 -- 172.21.15.79:0/4290871532 learned_addr learned my addr 172.21.15.79:0/4290871532 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fba83fff640 1 --2- 172.21.15.79:0/4290871532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840d1280 0x7fba840b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fba837fe640 1 -- 172.21.15.79:0/4290871532 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708089390 0 0) 0x7fba840b2e00 con 0x7fba840c9000 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fba837fe640 1 -- 172.21.15.79:0/4290871532 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba6c003520 con 0x7fba840c9000 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fba837fe640 1 -- 172.21.15.79:0/4290871532 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646538015 0 0) 0x7fba8406c5e0 con 0x7fba840c4c60 2024-06-10T00:15:04.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fba837fe640 1 -- 172.21.15.79:0/4290871532 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba840b2e00 con 0x7fba840c4c60 2024-06-10T00:15:04.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fae79f20640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae7406b3c0 0x7fae74072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fae79f20640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae7406b3c0 0x7fae74072650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36726/0 (socket says 172.21.15.79:36726) 2024-06-10T00:15:04.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f311b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f311c15e2d0 0x7f311c0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f311b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f311c15e2d0 0x7f311c0d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36738/0 (socket says 172.21.15.79:36738) 2024-06-10T00:15:04.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f311affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f311c15e6b0 0x7f311c0d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f311affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f311c15e6b0 0x7f311c0d2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48202/0 (socket says 172.21.15.79:48202) 2024-06-10T00:15:04.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f311bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f311c0d4a50 0x7f311c161e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50700/0 (socket says 172.21.15.79:50700) 2024-06-10T00:15:04.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fae79f20640 1 -- 172.21.15.79:0/2132113551 learned_addr learned my addr 172.21.15.79:0/2132113551 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f3120d3c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f311c15ebd0 con 0x7f311c0d4a50 2024-06-10T00:15:04.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f3120d3c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f311c15eeb0 con 0x7f311c15e2d0 2024-06-10T00:15:04.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f3120d3c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f311c15f190 con 0x7f311c15e6b0 2024-06-10T00:15:04.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7fae7a721640 1 --2- 172.21.15.79:0/2132113551 >> v2:172.21.15.117:3300/0 conn(0x7fae7406b7a0 0x7fae740cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fae79f20640 1 -- 172.21.15.79:0/2132113551 >> v2:172.21.15.117:3300/0 conn(0x7fae7406b7a0 msgr2=0x7fae740cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fae79f20640 1 --2- 172.21.15.79:0/2132113551 >> v2:172.21.15.117:3300/0 conn(0x7fae7406b7a0 0x7fae740cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fae79f20640 1 -- 172.21.15.79:0/2132113551 >> v1:172.21.15.117:6789/0 conn(0x7fae74162a90 legacy=0x7fae7406fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-10T00:15:04.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f311b7fe640 1 -- 172.21.15.79:0/354554993 learned_addr learned my addr 172.21.15.79:0/354554993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fae79f20640 1 -- 172.21.15.79:0/2132113551 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7406bc30 con 0x7fae7406b3c0 2024-06-10T00:15:04.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fb027342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.758+0000 7f5f4affd640 1 -- 172.21.15.79:0/2610139829 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c06e650 con 0x7f5f4c145610 2024-06-10T00:15:04.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fb027342640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0200b4cb0 0x7fb020165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fba83fff640 1 -- 172.21.15.79:0/4290871532 >> v1:172.21.15.117:6789/0 conn(0x7fba840c4c60 legacy=0x7fba840c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fba83fff640 1 -- 172.21.15.79:0/4290871532 >> v1:172.21.15.79:6789/0 conn(0x7fba840c9000 legacy=0x7fba840c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fba83fff640 1 -- 172.21.15.79:0/4290871532 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8406c8c0 con 0x7fba840d1280 2024-06-10T00:15:04.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fb027342640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb020166e50 con 0x7fb0200cfee0 2024-06-10T00:15:04.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fb027342640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb020071630 con 0x7fb0200b4cb0 2024-06-10T00:15:04.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fb027342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb02014c210 con 0x7fb02014be30 2024-06-10T00:15:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7fb0250de640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f5f4affd640 1 --2- 172.21.15.79:0/2610139829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0d1650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c06e430 tx=0x7f5f4402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=291fd216abb4eb7c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.759+0000 7f80a3fff640 1 --2- 172.21.15.79:0/3585322591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f809c050dd0 0x7f809c038630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f809c052570 tx=0x7f809002a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950b47eedb147c83 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f80a37fe640 1 -- 172.21.15.79:0/3585322591 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090037070 con 0x7f809c050dd0 2024-06-10T00:15:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f80a37fe640 1 -- 172.21.15.79:0/3585322591 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8090032440 con 0x7f809c050dd0 2024-06-10T00:15:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f80a37fe640 1 -- 172.21.15.79:0/3585322591 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090032810 con 0x7f809c050dd0 2024-06-10T00:15:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7feda759e640 1 -- 172.21.15.79:0/2853970106 shutdown_connections 2024-06-10T00:15:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7feda759e640 1 --2- 172.21.15.79:0/2853970106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80b3800 0x7feda815c5b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7feda759e640 1 --2- 172.21.15.79:0/2853970106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7feda759e640 1 -- 172.21.15.79:0/2853970106 >> 172.21.15.79:0/2853970106 conn(0x7feda806b5a0 msgr2=0x7feda806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fae79f20640 1 --2- 172.21.15.79:0/2132113551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae7406b3c0 0x7fae74072650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fae74074230 tx=0x7fae6802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c054065c9a06a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fb0250de640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50424/0 (socket says 172.21.15.79:50424) 2024-06-10T00:15:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fb0250de640 1 -- 172.21.15.79:0/1803800432 learned_addr learned my addr 172.21.15.79:0/1803800432 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f5f49ffb640 1 -- 172.21.15.79:0/2610139829 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44031600 con 0x7f5f4c145610 2024-06-10T00:15:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f5f49ffb640 1 -- 172.21.15.79:0/2610139829 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f440317a0 con 0x7f5f4c145610 2024-06-10T00:15:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f5f49ffb640 1 -- 172.21.15.79:0/2610139829 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44031b70 con 0x7f5f4c145610 2024-06-10T00:15:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fb017fff640 1 -- 172.21.15.79:0/1803800432 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 653584577 0 0) 0x7fb020166e50 con 0x7fb0200cfee0 2024-06-10T00:15:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fb017fff640 1 -- 172.21.15.79:0/1803800432 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb00c003520 con 0x7fb0200cfee0 2024-06-10T00:15:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fb0250de640 1 -- 172.21.15.79:0/1803800432 >> v2:172.21.15.79:3300/0 conn(0x7fb0200b4cb0 msgr2=0x7fb020165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fb0250de640 1 --2- 172.21.15.79:0/1803800432 >> v2:172.21.15.79:3300/0 conn(0x7fb0200b4cb0 0x7fb020165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fb0250de640 1 -- 172.21.15.79:0/1803800432 >> v1:172.21.15.117:6789/0 conn(0x7fb0200cfee0 legacy=0x7fb020071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fb0250de640 1 -- 172.21.15.79:0/1803800432 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb020166890 con 0x7fb02014be30 2024-06-10T00:15:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7feda759e640 1 -- 172.21.15.79:0/2853970106 shutdown_connections 2024-06-10T00:15:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fd44a49e640 1 -- 172.21.15.79:0/65661829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 msgr2=0x7fd44406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fd44a49e640 1 --2- 172.21.15.79:0/65661829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd44406c3d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd444073360 tx=0x7fd43802a110 comp rx=0 tx=0).stop 2024-06-10T00:15:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fd44a49e640 1 -- 172.21.15.79:0/65661829 shutdown_connections 2024-06-10T00:15:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fd44a49e640 1 --2- 172.21.15.79:0/65661829 >> v2:172.21.15.79:3300/0 conn(0x7fd4440b4e30 0x7fd44406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fd44a49e640 1 --2- 172.21.15.79:0/65661829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd44406c3d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fd44a49e640 1 -- 172.21.15.79:0/65661829 >> 172.21.15.79:0/65661829 conn(0x7fd444071850 msgr2=0x7fd444071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fd44a49e640 1 -- 172.21.15.79:0/65661829 shutdown_connections 2024-06-10T00:15:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7fd44a49e640 1 -- 172.21.15.79:0/65661829 wait complete. 2024-06-10T00:15:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f311affd640 1 -- 172.21.15.79:0/354554993 >> v2:172.21.15.79:3300/0 conn(0x7f311c15e2d0 msgr2=0x7f311c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f311affd640 1 --2- 172.21.15.79:0/354554993 >> v2:172.21.15.79:3300/0 conn(0x7f311c15e2d0 0x7f311c0d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f311affd640 1 -- 172.21.15.79:0/354554993 >> v1:172.21.15.79:6789/0 conn(0x7f311c0d4a50 legacy=0x7f311c161e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7f311affd640 1 -- 172.21.15.79:0/354554993 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c15f470 con 0x7f311c15e6b0 2024-06-10T00:15:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7fae78f1e640 1 -- 172.21.15.79:0/2132113551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68037070 con 0x7fae7406b3c0 2024-06-10T00:15:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7fae78f1e640 1 -- 172.21.15.79:0/2132113551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae68032440 con 0x7fae7406b3c0 2024-06-10T00:15:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f80aac95640 1 -- 172.21.15.79:0/3585322591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f809c050dd0 msgr2=0x7f809c038630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f80aac95640 1 --2- 172.21.15.79:0/3585322591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f809c050dd0 0x7f809c038630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f809c052570 tx=0x7f809002a160 comp rx=0 tx=0).stop 2024-06-10T00:15:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.760+0000 7feda759e640 1 -- 172.21.15.79:0/2853970106 wait complete. 2024-06-10T00:15:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7fae78f1e640 1 -- 172.21.15.79:0/2132113551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68032810 con 0x7fae7406b3c0 2024-06-10T00:15:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f80aac95640 1 -- 172.21.15.79:0/3585322591 shutdown_connections 2024-06-10T00:15:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f80aac95640 1 --2- 172.21.15.79:0/3585322591 >> v2:172.21.15.79:3300/0 conn(0x7f809c03a5d0 0x7f809c005f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f80aac95640 1 --2- 172.21.15.79:0/3585322591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f809c050dd0 0x7f809c038630 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f80aac95640 1 -- 172.21.15.79:0/3585322591 >> 172.21.15.79:0/3585322591 conn(0x7f809c009fb0 msgr2=0x7f809c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7fba83fff640 1 --2- 172.21.15.79:0/4290871532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840d1280 0x7fba840b30e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba780097d0 tx=0x7fba7802a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f9f9d6d91eab2d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f80aac95640 1 -- 172.21.15.79:0/3585322591 shutdown_connections 2024-06-10T00:15:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 -- 172.21.15.79:0/2610139829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 msgr2=0x7f5f4c0d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f80aac95640 1 -- 172.21.15.79:0/3585322591 wait complete. 2024-06-10T00:15:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/2610139829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0d1650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c06e430 tx=0x7f5f4402a5d0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7fb0250de640 1 --2- 172.21.15.79:0/1803800432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cc4d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb018009e50 tx=0x7fb01802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c9fa53577b28e2a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f311affd640 1 --2- 172.21.15.79:0/354554993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e6b0 0x7f311c0d2260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f311c08c560 tx=0x7f310402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9701cf1793bc44e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f311a7fc640 1 -- 172.21.15.79:0/354554993 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104037070 con 0x7f311c15e6b0 2024-06-10T00:15:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f311a7fc640 1 -- 172.21.15.79:0/354554993 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3104032440 con 0x7f311c15e6b0 2024-06-10T00:15:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7fba837fe640 1 -- 172.21.15.79:0/4290871532 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78037070 con 0x7fba840d1280 2024-06-10T00:15:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f311a7fc640 1 -- 172.21.15.79:0/354554993 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310402ae60 con 0x7f311c15e6b0 2024-06-10T00:15:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7fba837fe640 1 -- 172.21.15.79:0/4290871532 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7802ab70 con 0x7fba840d1280 2024-06-10T00:15:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7fba837fe640 1 -- 172.21.15.79:0/4290871532 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0019f0 con 0x7fba840d1280 2024-06-10T00:15:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fb017fff640 1 -- 172.21.15.79:0/1803800432 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018036070 con 0x7fb02014be30 2024-06-10T00:15:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fb017fff640 1 -- 172.21.15.79:0/1803800432 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb018031600 con 0x7fb02014be30 2024-06-10T00:15:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fb017fff640 1 -- 172.21.15.79:0/1803800432 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0180319d0 con 0x7fb02014be30 2024-06-10T00:15:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fae7c184640 1 -- 172.21.15.79:0/2132113551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae7406b3c0 msgr2=0x7fae74072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fae7c184640 1 --2- 172.21.15.79:0/2132113551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae7406b3c0 0x7fae74072650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fae74074230 tx=0x7fae6802a1a0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 -- 172.21.15.79:0/2610139829 shutdown_connections 2024-06-10T00:15:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/2610139829 >> v2:172.21.15.117:3300/0 conn(0x7f5f4c06fea0 0x7f5f4c070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/2610139829 >> v2:172.21.15.79:3300/0 conn(0x7f5f4c071fa0 0x7f5f4c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/2610139829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0d1650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 -- 172.21.15.79:0/2610139829 >> 172.21.15.79:0/2610139829 conn(0x7f5f4c0d0b30 msgr2=0x7f5f4c0d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 -- 172.21.15.79:0/2610139829 shutdown_connections 2024-06-10T00:15:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.761+0000 7f5f4bfff640 1 -- 172.21.15.79:0/2610139829 wait complete. 2024-06-10T00:15:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fae7c184640 1 -- 172.21.15.79:0/2132113551 shutdown_connections 2024-06-10T00:15:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fae7c184640 1 --2- 172.21.15.79:0/2132113551 >> v2:172.21.15.117:3300/0 conn(0x7fae7406b7a0 0x7fae740cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fae7c184640 1 --2- 172.21.15.79:0/2132113551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae7406b3c0 0x7fae74072650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fd44a49e640 1 Processor -- start 2024-06-10T00:15:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fae7c184640 1 -- 172.21.15.79:0/2132113551 >> 172.21.15.79:0/2132113551 conn(0x7fae740b2ae0 msgr2=0x7fae740b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7feda759e640 1 Processor -- start 2024-06-10T00:15:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fd44a49e640 1 -- start start 2024-06-10T00:15:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7feda759e640 1 -- start start 2024-06-10T00:15:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fba8aa93640 1 -- 172.21.15.79:0/4290871532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840d1280 msgr2=0x7fba840b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.762+0000 7fba8aa93640 1 --2- 172.21.15.79:0/4290871532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840d1280 0x7fba840b30e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba780097d0 tx=0x7fba7802a0e0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fb027342640 1 -- 172.21.15.79:0/1803800432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 msgr2=0x7fb0200cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fb027342640 1 --2- 172.21.15.79:0/1803800432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cc4d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb018009e50 tx=0x7fb01802a6d0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fba8aa93640 1 -- 172.21.15.79:0/4290871532 shutdown_connections 2024-06-10T00:15:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fba8aa93640 1 --2- 172.21.15.79:0/4290871532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840d1280 0x7fba840b30e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fba8aa93640 1 -- 172.21.15.79:0/4290871532 >> 172.21.15.79:0/4290871532 conn(0x7fba840b3820 msgr2=0x7fba840b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fae7c184640 1 -- 172.21.15.79:0/2132113551 shutdown_connections 2024-06-10T00:15:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fb027342640 1 -- 172.21.15.79:0/1803800432 shutdown_connections 2024-06-10T00:15:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fb027342640 1 --2- 172.21.15.79:0/1803800432 >> v2:172.21.15.79:3300/0 conn(0x7fb0200b4cb0 0x7fb020165fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fb027342640 1 --2- 172.21.15.79:0/1803800432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cc4d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fb027342640 1 -- 172.21.15.79:0/1803800432 >> 172.21.15.79:0/1803800432 conn(0x7fb02006b7e0 msgr2=0x7fb02006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f80aac95640 1 Processor -- start 2024-06-10T00:15:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f3120d3c640 1 -- 172.21.15.79:0/354554993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e6b0 msgr2=0x7f311c0d2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f3120d3c640 1 --2- 172.21.15.79:0/354554993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e6b0 0x7f311c0d2260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f311c08c560 tx=0x7f310402a110 comp rx=0 tx=0).stop 2024-06-10T00:15:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fb027342640 1 -- 172.21.15.79:0/1803800432 shutdown_connections 2024-06-10T00:15:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f3120d3c640 1 -- 172.21.15.79:0/354554993 shutdown_connections 2024-06-10T00:15:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f3120d3c640 1 --2- 172.21.15.79:0/354554993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e6b0 0x7f311c0d2260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f3120d3c640 1 --2- 172.21.15.79:0/354554993 >> v2:172.21.15.79:3300/0 conn(0x7f311c15e2d0 0x7f311c0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f3120d3c640 1 -- 172.21.15.79:0/354554993 >> 172.21.15.79:0/354554993 conn(0x7f311c0d3f30 msgr2=0x7f311c0d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f80aac95640 1 -- start start 2024-06-10T00:15:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f3120d3c640 1 -- 172.21.15.79:0/354554993 shutdown_connections 2024-06-10T00:15:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7feda759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda80b3800 0x7feda8071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f5f4bfff640 1 Processor -- start 2024-06-10T00:15:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fb027342640 1 -- 172.21.15.79:0/1803800432 wait complete. 2024-06-10T00:15:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80cca80 0x7feda8156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7fae7c184640 1 -- 172.21.15.79:0/2132113551 wait complete. 2024-06-10T00:15:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda759e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feda80b3df0 con 0x7feda80cca80 2024-06-10T00:15:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feda80b3c70 con 0x7feda80b3800 2024-06-10T00:15:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feda80b3f70 con 0x7feda80cce60 2024-06-10T00:15:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7f5f4bfff640 1 -- start start 2024-06-10T00:15:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80cca80 0x7feda8156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8164eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50430/0 (socket says 172.21.15.79:50430) 2024-06-10T00:15:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80cca80 0x7feda8156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36754/0 (socket says 172.21.15.79:36754) 2024-06-10T00:15:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda6d9d640 1 -- 172.21.15.79:0/2072324485 learned_addr learned my addr 172.21.15.79:0/2072324485 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda659c640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda80b3800 0x7feda8071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7fd44a49e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd444072820 0x7fd4441543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7fd44a49e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4440b4e30 0x7fd444159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7fd44a49e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd444159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda6d9d640 1 -- 172.21.15.79:0/2072324485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda80b3800 msgr2=0x7feda8071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda6d9d640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda80b3800 0x7feda8071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda6d9d640 1 -- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80cca80 msgr2=0x7feda8156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda6d9d640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80cca80 0x7feda8156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.764+0000 7feda6d9d640 1 -- 172.21.15.79:0/2072324485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda8072e90 con 0x7feda80cce60 2024-06-10T00:15:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fae7c184640 1 Processor -- start 2024-06-10T00:15:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd44a49e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440b5790 con 0x7fd444072820 2024-06-10T00:15:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fae7c184640 1 -- start start 2024-06-10T00:15:04.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd44a49e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440b3900 con 0x7fd444165bc0 2024-06-10T00:15:04.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd44a49e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4440b5910 con 0x7fd4440b4e30 2024-06-10T00:15:04.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fb027342640 1 Processor -- start 2024-06-10T00:15:04.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7feda6d9d640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8164eb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feda0009f70 tx=0x7feda0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd448a3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd444159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd448a3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd444159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48228/0 (socket says 172.21.15.79:48228) 2024-06-10T00:15:04.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd448a3b640 1 -- 172.21.15.79:0/3558406778 learned_addr learned my addr 172.21.15.79:0/3558406778 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.763+0000 7f3120d3c640 1 -- 172.21.15.79:0/354554993 wait complete. 2024-06-10T00:15:04.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fed96ffd640 1 -- 172.21.15.79:0/2072324485 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda003f020 con 0x7feda80cce60 2024-06-10T00:15:04.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4c06fea0 0x7f5f4c1374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd448a3b640 1 -- 172.21.15.79:0/3558406778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4440b4e30 msgr2=0x7fd444159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd448a3b640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4440b4e30 0x7fd444159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd448a3b640 1 -- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd444072820 msgr2=0x7fd4441543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f80aac95640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f809c03a5d0 0x7f809c0e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f80aac95640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f809c050dd0 0x7f809c0df060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f80aac95640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809c0e1090 0x7f809c0dac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f80aac95640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f809c0064d0 con 0x7f809c03a5d0 2024-06-10T00:15:04.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f80aac95640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f809c0503a0 con 0x7f809c050dd0 2024-06-10T00:15:04.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f80aac95640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f809c006650 con 0x7f809c0e1090 2024-06-10T00:15:04.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fba8aa93640 1 -- 172.21.15.79:0/4290871532 shutdown_connections 2024-06-10T00:15:04.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fba8aa93640 1 -- 172.21.15.79:0/4290871532 wait complete. 2024-06-10T00:15:04.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fed96ffd640 1 -- 172.21.15.79:0/2072324485 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda0037040 con 0x7feda80cce60 2024-06-10T00:15:04.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fed96ffd640 1 -- 172.21.15.79:0/2072324485 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0036070 con 0x7feda80cce60 2024-06-10T00:15:04.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda8072310 con 0x7feda80cce60 2024-06-10T00:15:04.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feda80728d0 con 0x7feda80cce60 2024-06-10T00:15:04.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c071fa0 0x7f5f4c0a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4c06fea0 0x7f5f4c1374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4c06fea0 0x7f5f4c1374e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48244/0 (socket says 172.21.15.79:48244) 2024-06-10T00:15:04.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4affd640 1 -- 172.21.15.79:0/282510287 learned_addr learned my addr 172.21.15.79:0/282510287 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c0b5a90 con 0x7f5f4c071fa0 2024-06-10T00:15:04.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fb027342640 1 -- start start 2024-06-10T00:15:04.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fb027342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0200b4cb0 0x7fb020161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fae7c184640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7406b7a0 0x7fae7414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fae7c184640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae74162a90 0x7fae7415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fae7c184640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae74165550 0x7fae74160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fb027342640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0200cfee0 0x7fb0201ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4b7fe640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fae7c184640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fae740cfb10 con 0x7fae74165550 2024-06-10T00:15:04.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fb0250de640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0200b4cb0 0x7fb020161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fb0250de640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0200b4cb0 0x7fb020161ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48248/0 (socket says 172.21.15.79:48248) 2024-06-10T00:15:04.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fb0250de640 1 -- 172.21.15.79:0/708850342 learned_addr learned my addr 172.21.15.79:0/708850342 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fae7c184640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fae740cfc90 con 0x7fae7406b7a0 2024-06-10T00:15:04.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fae7c184640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae740cfe10 con 0x7fae74162a90 2024-06-10T00:15:04.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fb027342640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4a7fc640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c071fa0 0x7f5f4c0a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c0b5910 con 0x7f5f4c06fea0 2024-06-10T00:15:04.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4c06eb70 con 0x7f5f4c145610 2024-06-10T00:15:04.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f3120d3c640 1 Processor -- start 2024-06-10T00:15:04.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7f3120d3c640 1 -- start start 2024-06-10T00:15:04.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.766+0000 7fae79f20640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7406b7a0 0x7fae7414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae79f20640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7406b7a0 0x7fae7414e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48250/0 (socket says 172.21.15.79:48250) 2024-06-10T00:15:04.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae79f20640 1 -- 172.21.15.79:0/3902017427 learned_addr learned my addr 172.21.15.79:0/3902017427 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae7a721640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae74165550 0x7fae74160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a8a31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f809c03a5d0 0x7f809c0e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda80683c0 con 0x7feda80cce60 2024-06-10T00:15:04.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.765+0000 7fd448a3b640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd444072820 0x7fd4441543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fd448a3b640 1 -- 172.21.15.79:0/3558406778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4441f8990 con 0x7fd444165bc0 2024-06-10T00:15:04.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a8a31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f809c03a5d0 0x7f809c0e3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36792/0 (socket says 172.21.15.79:36792) 2024-06-10T00:15:04.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a8a31640 1 -- 172.21.15.79:0/1027404434 learned_addr learned my addr 172.21.15.79:0/1027404434 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb0248dd640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0200cfee0 0x7fb0201ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a9232640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809c0e1090 0x7f809c0dac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f5f4affd640 1 -- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 msgr2=0x7f5f4c0a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f3120d3c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0d4a50 0x7f311c0b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fd448a3b640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd444159fd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00efc0 tx=0x7fd43c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f5f4affd640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f5f4affd640 1 -- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c071fa0 msgr2=0x7f5f4c0a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f5f4affd640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c071fa0 0x7f5f4c0a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f5f4affd640 1 -- 172.21.15.79:0/282510287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c137a20 con 0x7f5f4c06fea0 2024-06-10T00:15:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a8a31640 1 -- 172.21.15.79:0/1027404434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809c0e1090 msgr2=0x7f809c0dac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f3120d3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e2d0 0x7f311c0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fba8aa93640 1 Processor -- start 2024-06-10T00:15:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0201664f0 con 0x7fb0200cfee0 2024-06-10T00:15:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb0200712c0 con 0x7fb0200b4cb0 2024-06-10T00:15:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb020166670 con 0x7fb02014be30 2024-06-10T00:15:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb0258df640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a8a31640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809c0e1090 0x7f809c0dac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f3120d3c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c15e6b0 0x7f311c15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fd440ff9640 1 -- 172.21.15.79:0/3558406778 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c018030 con 0x7fd444165bc0 2024-06-10T00:15:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f3120d3c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f311c0cfcd0 con 0x7f311c15e6b0 2024-06-10T00:15:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f3120d3c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f311c0cfb50 con 0x7f311c15e2d0 2024-06-10T00:15:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f5f4affd640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4c06fea0 0x7f5f4c1374e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e80 tx=0x7f5f44004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f3120d3c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f311c0cfe50 con 0x7f311c0d4a50 2024-06-10T00:15:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fba8aa93640 1 -- start start 2024-06-10T00:15:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb0248dd640 1 -- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 msgr2=0x7fb0200cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb0248dd640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fd44a49e640 1 -- 172.21.15.79:0/3558406778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd444156c80 con 0x7fd444165bc0 2024-06-10T00:15:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fd440ff9640 1 -- 172.21.15.79:0/3558406778 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c00cde0 con 0x7fd444165bc0 2024-06-10T00:15:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb0248dd640 1 -- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0200b4cb0 msgr2=0x7fb020161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb0248dd640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0200b4cb0 0x7fb020161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae79f20640 1 -- 172.21.15.79:0/3902017427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae74162a90 msgr2=0x7fae7415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae79f20640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae74162a90 0x7fae7415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae79f20640 1 -- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae74165550 msgr2=0x7fae74160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fb0248dd640 1 -- 172.21.15.79:0/708850342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0201ed820 con 0x7fb0200cfee0 2024-06-10T00:15:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fb0250de640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0200b4cb0 0x7fb020161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae79f20640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae74165550 0x7fae74160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae79f20640 1 -- 172.21.15.79:0/3902017427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae741641d0 con 0x7fae7406b7a0 2024-06-10T00:15:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae7a721640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae74165550 0x7fae74160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7fae79f20640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7406b7a0 0x7fae7414e0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae68000c00 tx=0x7fae680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fd440ff9640 1 -- 172.21.15.79:0/3558406778 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c003bb0 con 0x7fd444165bc0 2024-06-10T00:15:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fd44a49e640 1 -- 172.21.15.79:0/3558406778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4441f8c30 con 0x7fd444165bc0 2024-06-10T00:15:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e2d0 0x7f311c0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e2d0 0x7f311c0720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48268/0 (socket says 172.21.15.79:48268) 2024-06-10T00:15:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 -- 172.21.15.79:0/2454892162 learned_addr learned my addr 172.21.15.79:0/2454892162 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a8a31640 1 -- 172.21.15.79:0/1027404434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f809c050dd0 msgr2=0x7f809c0df060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-10T00:15:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a8a31640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f809c050dd0 0x7f809c0df060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fb0248dd640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0200cfee0 0x7fb0201ed2e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00b3c0 tx=0x7fb01c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.767+0000 7f80a8a31640 1 -- 172.21.15.79:0/1027404434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c180940 con 0x7f809c03a5d0 2024-06-10T00:15:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f5f33fff640 1 -- 172.21.15.79:0/282510287 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44040070 con 0x7f5f4c06fea0 2024-06-10T00:15:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f5f33fff640 1 -- 172.21.15.79:0/282510287 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4403c8f0 con 0x7f5f4c06fea0 2024-06-10T00:15:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f5f33fff640 1 -- 172.21.15.79:0/282510287 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4403ccc0 con 0x7f5f4c06fea0 2024-06-10T00:15:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fae727fc640 1 -- 172.21.15.79:0/3902017427 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68037040 con 0x7fae7406b7a0 2024-06-10T00:15:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 -- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0d4a50 msgr2=0x7f311c0b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311b7fe640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0d4a50 0x7f311c0b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0d4a50 0x7f311c0b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 -- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c15e6b0 msgr2=0x7f311c15d2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-10T00:15:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c15e6b0 0x7f311c15d2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 -- 172.21.15.79:0/2454892162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c0b32f0 con 0x7f311c15e2d0 2024-06-10T00:15:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311b7fe640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0d4a50 0x7f311c0b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f311affd640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e2d0 0x7f311c0720a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3104000c00 tx=0x7f31040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4c0afbc0 con 0x7f5f4c06fea0 2024-06-10T00:15:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4c0afea0 con 0x7f5f4c06fea0 2024-06-10T00:15:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7f80a8a31640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f809c03a5d0 0x7f809c0e3f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f809800b3f0 tx=0x7f809800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f3113fff640 1 -- 172.21.15.79:0/2454892162 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104037040 con 0x7f311c15e2d0 2024-06-10T00:15:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f3113fff640 1 -- 172.21.15.79:0/2454892162 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3104042070 con 0x7f311c15e2d0 2024-06-10T00:15:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f3120d3c640 1 -- 172.21.15.79:0/2454892162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c0b35d0 con 0x7f311c15e2d0 2024-06-10T00:15:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba8aa93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840c4c60 0x7fba841f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba8aa93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba840c9000 0x7fba841f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fb015ffb640 1 -- 172.21.15.79:0/708850342 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c011830 con 0x7fb0200cfee0 2024-06-10T00:15:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f3120d3c640 1 -- 172.21.15.79:0/2454892162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c0b3b90 con 0x7f311c15e2d0 2024-06-10T00:15:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fb015ffb640 1 -- 172.21.15.79:0/708850342 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01c016070 con 0x7fb0200cfee0 2024-06-10T00:15:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fb015ffb640 1 -- 172.21.15.79:0/708850342 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c011c10 con 0x7fb0200cfee0 2024-06-10T00:15:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0201ec240 con 0x7fb0200cfee0 2024-06-10T00:15:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0201ec800 con 0x7fb0200cfee0 2024-06-10T00:15:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f3113fff640 1 -- 172.21.15.79:0/2454892162 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104030940 con 0x7f311c15e2d0 2024-06-10T00:15:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba83fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba840c9000 0x7fba841f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba83fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba840c9000 0x7fba841f8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36806/0 (socket says 172.21.15.79:36806) 2024-06-10T00:15:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba8882f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840c4c60 0x7fba841f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba83fff640 1 -- 172.21.15.79:0/311639760 learned_addr learned my addr 172.21.15.79:0/311639760 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba8aa93640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba840d1280 0x7fba840b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba840d1700 con 0x7fba840c9000 2024-06-10T00:15:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba840b45e0 con 0x7fba840d1280 2024-06-10T00:15:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba840b2420 con 0x7fba840c4c60 2024-06-10T00:15:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fba89030640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba840d1280 0x7fba840b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f80a17fa640 1 -- 172.21.15.79:0/1027404434 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098015020 con 0x7f809c03a5d0 2024-06-10T00:15:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f80a17fa640 1 -- 172.21.15.79:0/1027404434 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8098011830 con 0x7f809c03a5d0 2024-06-10T00:15:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f80a17fa640 1 -- 172.21.15.79:0/1027404434 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098011c20 con 0x7f809c03a5d0 2024-06-10T00:15:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7f80a9232640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809c0e1090 0x7f809c0dac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c180c20 con 0x7f809c03a5d0 2024-06-10T00:15:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7fba8882f640 1 -- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba840d1280 msgr2=0x7fba840b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7fba8882f640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba840d1280 0x7fba840b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7fba8882f640 1 -- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba840c9000 msgr2=0x7fba841f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7fba8882f640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba840c9000 0x7fba841f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7fba8882f640 1 -- 172.21.15.79:0/311639760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba841fb160 con 0x7fba840c4c60 2024-06-10T00:15:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7fba89030640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba840d1280 0x7fba840b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.770+0000 7fba8882f640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840c4c60 0x7fba841f7660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c390 tx=0x7fba74001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7f5f31ffb640 1 -- 172.21.15.79:0/282510287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4c0b1ce0 con 0x7f5f4c06fea0 2024-06-10T00:15:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae741644b0 con 0x7fae7406b7a0 2024-06-10T00:15:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.768+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae74164a70 con 0x7fae7406b7a0 2024-06-10T00:15:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fae727fc640 1 -- 172.21.15.79:0/3902017427 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae68042070 con 0x7fae7406b7a0 2024-06-10T00:15:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.769+0000 7fae727fc640 1 -- 172.21.15.79:0/3902017427 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68032810 con 0x7fae7406b7a0 2024-06-10T00:15:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.771+0000 7fd440ff9640 1 -- 172.21.15.79:0/3558406778 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd43c01b070 con 0x7fd444165bc0 2024-06-10T00:15:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.771+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0200683c0 con 0x7fb0200cfee0 2024-06-10T00:15:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.771+0000 7f3111ffb640 1 -- 172.21.15.79:0/2454892162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311c0683c0 con 0x7f311c15e2d0 2024-06-10T00:15:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.771+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c1811e0 con 0x7f809c03a5d0 2024-06-10T00:15:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.771+0000 7fd42a7fc640 1 -- 172.21.15.79:0/3558406778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c005290 con 0x7fd444165bc0 2024-06-10T00:15:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae54005290 con 0x7fae7406b7a0 2024-06-10T00:15:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7fb015ffb640 1 -- 172.21.15.79:0/708850342 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb01c01b460 con 0x7fb0200cfee0 2024-06-10T00:15:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7f5f33fff640 1 -- 172.21.15.79:0/282510287 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f44039040 con 0x7f5f4c06fea0 2024-06-10T00:15:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7fd440ff9640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd43006be30 0x7fd43006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7fd443fff640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd43006be30 0x7fd43006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7fd440ff9640 1 -- 172.21.15.79:0/3558406778 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd43c08bce0 con 0x7fd444165bc0 2024-06-10T00:15:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7fb015ffb640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb00406bf30 0x7fb00406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7fb015ffb640 1 -- 172.21.15.79:0/708850342 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb01c08ac20 con 0x7fb0200cfee0 2024-06-10T00:15:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7f5f33fff640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5f3806bf00 0x7f5f3806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.772+0000 7f5f33fff640 1 -- 172.21.15.79:0/282510287 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5f440acef0 con 0x7f5f4c06fea0 2024-06-10T00:15:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c005390 con 0x7f809c03a5d0 2024-06-10T00:15:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7f3113fff640 1 -- 172.21.15.79:0/2454892162 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3104030ae0 con 0x7f311c15e2d0 2024-06-10T00:15:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7fd443fff640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd43006be30 0x7fd43006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd438034000 tx=0x7fd43802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7f5f4a7fc640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5f3806bf00 0x7f5f3806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7fb0250de640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb00406bf30 0x7fb00406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7fed96ffd640 1 -- 172.21.15.79:0/2072324485 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feda0042020 con 0x7feda80cce60 2024-06-10T00:15:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7f3113fff640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30fc06bf00 0x7f30fc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7fba817fa640 1 -- 172.21.15.79:0/311639760 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba74017070 con 0x7fba840c4c60 2024-06-10T00:15:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7fba817fa640 1 -- 172.21.15.79:0/311639760 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba740052d0 con 0x7fba840c4c60 2024-06-10T00:15:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7f3113fff640 1 -- 172.21.15.79:0/2454892162 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f31040abc70 con 0x7f311c15e2d0 2024-06-10T00:15:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7f5f4a7fc640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5f3806bf00 0x7f5f3806e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0af9d0 tx=0x7f5f3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7f311b7fe640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30fc06bf00 0x7f30fc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.773+0000 7f80a17fa640 1 -- 172.21.15.79:0/1027404434 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8098018020 con 0x7f809c03a5d0 2024-06-10T00:15:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.774+0000 7fb0250de640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb00406bf30 0x7fb00406e3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb01802a710 tx=0x7fb018009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.774+0000 7fba817fa640 1 -- 172.21.15.79:0/311639760 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba74003830 con 0x7fba840c4c60 2024-06-10T00:15:04.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.774+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba841fb440 con 0x7fba840c4c60 2024-06-10T00:15:04.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.774+0000 7f80a17fa640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f808806be80 0x7f808806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.774+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba841fba00 con 0x7fba840c4c60 2024-06-10T00:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.774+0000 7f311b7fe640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30fc06bf00 0x7f30fc06e3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f310c009d70 tx=0x7f310c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.774+0000 7f80a3fff640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f808806be80 0x7f808806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.775+0000 7fed96ffd640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fed8806be30 0x7fed8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.775+0000 7f80a3fff640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f808806be80 0x7f808806e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8090034000 tx=0x7f809002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.775+0000 7fed96ffd640 1 -- 172.21.15.79:0/2072324485 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feda00abc10 con 0x7feda80cce60 2024-06-10T00:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.775+0000 7feda659c640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fed8806be30 0x7fed8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.775+0000 7fed96ffd640 1 -- 172.21.15.79:0/2072324485 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7feda0049030 con 0x7feda80cce60 2024-06-10T00:15:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.775+0000 7feda659c640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fed8806be30 0x7fed8806e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed98000f60 tx=0x7fed98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.775+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba84068ad0 con 0x7fba840c4c60 2024-06-10T00:15:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.776+0000 7fba817fa640 1 -- 172.21.15.79:0/311639760 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba7401a070 con 0x7fba840c4c60 2024-06-10T00:15:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.776+0000 7fba817fa640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba7006be80 0x7fba7006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.776+0000 7fba83fff640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba7006be80 0x7fba7006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.776+0000 7fba817fa640 1 -- 172.21.15.79:0/311639760 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fba7408a340 con 0x7fba840c4c60 2024-06-10T00:15:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.776+0000 7f5f33fff640 1 -- 172.21.15.79:0/282510287 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5f4407b540 con 0x7f5f4c06fea0 2024-06-10T00:15:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.776+0000 7fba83fff640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba7006be80 0x7fba7006e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba78009720 tx=0x7fba7802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.777+0000 7fae727fc640 1 -- 172.21.15.79:0/3902017427 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae68003830 con 0x7fae7406b7a0 2024-06-10T00:15:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.778+0000 7fae727fc640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fae6006be80 0x7fae6006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.778+0000 7fae7971f640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fae6006be80 0x7fae6006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.778+0000 7f80a17fa640 1 -- 172.21.15.79:0/1027404434 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f80980570f0 con 0x7f809c03a5d0 2024-06-10T00:15:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.778+0000 7fae7971f640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fae6006be80 0x7fae6006e340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae74162730 tx=0x7fae64009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.779+0000 7fb015ffb640 1 -- 172.21.15.79:0/708850342 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb01c058cb0 con 0x7fb0200cfee0 2024-06-10T00:15:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.781+0000 7fba817fa640 1 -- 172.21.15.79:0/311639760 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fba740584d0 con 0x7fba840c4c60 2024-06-10T00:15:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.781+0000 7f3113fff640 1 -- 172.21.15.79:0/2454892162 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f310407a350 con 0x7f311c15e2d0 2024-06-10T00:15:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.783+0000 7f80a17fa640 1 -- 172.21.15.79:0/1027404434 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f809801f020 con 0x7f809c03a5d0 2024-06-10T00:15:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.785+0000 7fae727fc640 1 -- 172.21.15.79:0/3902017427 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fae68078400 con 0x7fae7406b7a0 2024-06-10T00:15:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.786+0000 7fd440ff9640 1 -- 172.21.15.79:0/3558406778 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd43c010040 con 0x7fd444165bc0 2024-06-10T00:15:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:04.790+0000 7fae727fc640 1 -- 172.21.15.79:0/3902017427 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fae6807aa60 con 0x7fae7406b7a0 2024-06-10T00:15:05.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.188+0000 7f5f31ffb640 1 -- 172.21.15.79:0/282510287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5f4c068ad0 con 0x7f5f4c06fea0 2024-06-10T00:15:05.190 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2024-06-10T00:15:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.188+0000 7f5f33fff640 1 -- 172.21.15.79:0/282510287 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f4407ae40 con 0x7f5f4c06fea0 2024-06-10T00:15:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.191+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7feda80af6f0 con 0x7feda80cce60 2024-06-10T00:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5f3806bf00 msgr2=0x7f5f3806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5f3806bf00 0x7f5f3806e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0af9d0 tx=0x7f5f3c008040 comp rx=0 tx=0).stop 2024-06-10T00:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4c06fea0 msgr2=0x7f5f4c1374e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4c06fea0 0x7f5f4c1374e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e80 tx=0x7f5f44004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7fed96ffd640 1 -- 172.21.15.79:0/2072324485 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feda0079d30 con 0x7feda80cce60 2024-06-10T00:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 shutdown_connections 2024-06-10T00:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5f3806bf00 0x7f5f3806e3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4c145610 0x7f5f4c0a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.193 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2024-06-10T00:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c071fa0 0x7f5f4c0a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 --2- 172.21.15.79:0/282510287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4c06fea0 0x7f5f4c1374e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 >> 172.21.15.79:0/282510287 conn(0x7f5f4c0d0b30 msgr2=0x7f5f4c06ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.192+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fba84075180 con 0x7fba840c4c60 2024-06-10T00:15:05.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.193+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 shutdown_connections 2024-06-10T00:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.193+0000 7f5f4bfff640 1 -- 172.21.15.79:0/282510287 wait complete. 2024-06-10T00:15:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.193+0000 7fba817fa640 1 -- 172.21.15.79:0/311639760 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba7405c7d0 con 0x7fba840c4c60 2024-06-10T00:15:05.195 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2024-06-10T00:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.195+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fed8806be30 msgr2=0x7fed8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.195+0000 7feda759e640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fed8806be30 0x7fed8806e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed98000f60 tx=0x7fed98009040 comp rx=0 tx=0).stop 2024-06-10T00:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 msgr2=0x7feda8164eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8164eb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feda0009f70 tx=0x7feda0004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 shutdown_connections 2024-06-10T00:15:05.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fed8806be30 0x7fed8806e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda80cce60 0x7feda8164eb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda80cca80 0x7feda8156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 --2- 172.21.15.79:0/2072324485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda80b3800 0x7feda8071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 >> 172.21.15.79:0/2072324485 conn(0x7feda806b5a0 msgr2=0x7feda806b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:05.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 shutdown_connections 2024-06-10T00:15:05.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.196+0000 7feda759e640 1 -- 172.21.15.79:0/2072324485 wait complete. 2024-06-10T00:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.197+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba7006be80 msgr2=0x7fba7006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.197+0000 7fba8aa93640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba7006be80 0x7fba7006e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba78009720 tx=0x7fba7802e000 comp rx=0 tx=0).stop 2024-06-10T00:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.197+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840c4c60 msgr2=0x7fba841f7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.197+0000 7fba8aa93640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840c4c60 0x7fba841f7660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c390 tx=0x7fba74001e70 comp rx=0 tx=0).stop 2024-06-10T00:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.198+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 shutdown_connections 2024-06-10T00:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.198+0000 7fba8aa93640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba7006be80 0x7fba7006e340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.198+0000 7fba8aa93640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba840d1280 0x7fba840b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.198+0000 7fba8aa93640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba840c9000 0x7fba841f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.198+0000 7fba8aa93640 1 --2- 172.21.15.79:0/311639760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba840c4c60 0x7fba841f7660 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.198+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 >> 172.21.15.79:0/311639760 conn(0x7fba840b3820 msgr2=0x7fba8406f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.198+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 shutdown_connections 2024-06-10T00:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.198+0000 7fba8aa93640 1 -- 172.21.15.79:0/311639760 wait complete. 2024-06-10T00:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.199+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f809c054270 con 0x7f809c03a5d0 2024-06-10T00:15:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.199+0000 7f80a17fa640 1 -- 172.21.15.79:0/1027404434 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f80980172c0 con 0x7f809c03a5d0 2024-06-10T00:15:05.206 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2024-06-10T00:15:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.203+0000 7fd42a7fc640 1 -- 172.21.15.79:0/3558406778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd41c005580 con 0x7fd444165bc0 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.203+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f808806be80 msgr2=0x7f808806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.203+0000 7f80aac95640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f808806be80 0x7f808806e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8090034000 tx=0x7f809002e000 comp rx=0 tx=0).stop 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.203+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f809c03a5d0 msgr2=0x7f809c0e3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.203+0000 7f80aac95640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f809c03a5d0 0x7f809c0e3f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f809800b3f0 tx=0x7f809800b8b0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 shutdown_connections 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7f80aac95640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f808806be80 0x7f808806e340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7f80aac95640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809c0e1090 0x7f809c0dac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7f80aac95640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f809c050dd0 0x7f809c0df060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7f80aac95640 1 --2- 172.21.15.79:0/1027404434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f809c03a5d0 0x7f809c0e3f50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7fd440ff9640 1 -- 172.21.15.79:0/3558406778 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd43c05a230 con 0x7fd444165bc0 2024-06-10T00:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb02006bdc0 con 0x7fb0200cfee0 2024-06-10T00:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 >> 172.21.15.79:0/1027404434 conn(0x7f809c009fb0 msgr2=0x7f809c035730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 shutdown_connections 2024-06-10T00:15:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7f80aac95640 1 -- 172.21.15.79:0/1027404434 wait complete. 2024-06-10T00:15:05.209 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2024-06-10T00:15:05.209 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2024-06-10T00:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.204+0000 7fb015ffb640 1 -- 172.21.15.79:0/708850342 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb01c05cfb0 con 0x7fb0200cfee0 2024-06-10T00:15:05.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.207+0000 7f3111ffb640 1 -- 172.21.15.79:0/2454892162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f311c0b9da0 con 0x7f311c15e2d0 2024-06-10T00:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb00406bf30 msgr2=0x7fb00406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb00406bf30 0x7fb00406e3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb01802a710 tx=0x7fb018009000 comp rx=0 tx=0).stop 2024-06-10T00:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0200cfee0 msgr2=0x7fb0201ed2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0200cfee0 0x7fb0201ed2e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00b3c0 tx=0x7fb01c00b880 comp rx=0 tx=0).stop 2024-06-10T00:15:05.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7f3113fff640 1 -- 172.21.15.79:0/2454892162 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3104079c50 con 0x7f311c15e2d0 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 shutdown_connections 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb00406bf30 0x7fb00406e3f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02014be30 0x7fb0200cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0200cfee0 0x7fb0201ed2e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 --2- 172.21.15.79:0/708850342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0200b4cb0 0x7fb020161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 >> 172.21.15.79:0/708850342 conn(0x7fb02006b7e0 msgr2=0x7fb020071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 shutdown_connections 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.208+0000 7fb027342640 1 -- 172.21.15.79:0/708850342 wait complete. 2024-06-10T00:15:05.211 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2024-06-10T00:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 -- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd43006be30 msgr2=0x7fd43006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd43006be30 0x7fd43006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd438034000 tx=0x7fd43802c000 comp rx=0 tx=0).stop 2024-06-10T00:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 -- 172.21.15.79:0/3558406778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 msgr2=0x7fd444159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd444159fd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00efc0 tx=0x7fd43c009f90 comp rx=0 tx=0).stop 2024-06-10T00:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 -- 172.21.15.79:0/3558406778 shutdown_connections 2024-06-10T00:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd43006be30 0x7fd43006e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd444165bc0 0x7fd444159fd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4440b4e30 0x7fd444159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 --2- 172.21.15.79:0/3558406778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd444072820 0x7fd4441543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 -- 172.21.15.79:0/3558406778 >> 172.21.15.79:0/3558406778 conn(0x7fd444071850 msgr2=0x7fd4440b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:05.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 -- 172.21.15.79:0/3558406778 shutdown_connections 2024-06-10T00:15:05.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.209+0000 7fd42a7fc640 1 -- 172.21.15.79:0/3558406778 wait complete. 2024-06-10T00:15:05.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.211+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fae54005850 con 0x7fae7406b7a0 2024-06-10T00:15:05.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 -- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30fc06bf00 msgr2=0x7f30fc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30fc06bf00 0x7f30fc06e3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f310c009d70 tx=0x7f310c00b040 comp rx=0 tx=0).stop 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 -- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e2d0 msgr2=0x7f311c0720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e2d0 0x7f311c0720a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3104000c00 tx=0x7f31040046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 -- 172.21.15.79:0/2454892162 shutdown_connections 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30fc06bf00 0x7f30fc06e3c0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f310c009d70 tx=0x7f310c00b040 comp rx=0 tx=0).stop 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c15e6b0 0x7f311c15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c15e2d0 0x7f311c0720a0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3104000c00 tx=0x7f31040046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 --2- 172.21.15.79:0/2454892162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0d4a50 0x7f311c0b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.212+0000 7f3111ffb640 1 -- 172.21.15.79:0/2454892162 >> 172.21.15.79:0/2454892162 conn(0x7f311c0d3f30 msgr2=0x7f311c0d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.213+0000 7f3111ffb640 1 -- 172.21.15.79:0/2454892162 shutdown_connections 2024-06-10T00:15:05.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.213+0000 7fae727fc640 1 -- 172.21.15.79:0/3902017427 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fae6807a360 con 0x7fae7406b7a0 2024-06-10T00:15:05.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.213+0000 7f3111ffb640 1 -- 172.21.15.79:0/2454892162 wait complete. 2024-06-10T00:15:05.215 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2024-06-10T00:15:05.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-06-10T00:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fae6006be80 msgr2=0x7fae6006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fae6006be80 0x7fae6006e340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae74162730 tx=0x7fae64009250 comp rx=0 tx=0).stop 2024-06-10T00:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7406b7a0 msgr2=0x7fae7414e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7406b7a0 0x7fae7414e0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae68000c00 tx=0x7fae680046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 shutdown_connections 2024-06-10T00:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fae6006be80 0x7fae6006e340 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae74165550 0x7fae74160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-06-10T00:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae74162a90 0x7fae7415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 --2- 172.21.15.79:0/3902017427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7406b7a0 0x7fae7414e0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 >> 172.21.15.79:0/3902017427 conn(0x7fae740b2ae0 msgr2=0x7fae7406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 shutdown_connections 2024-06-10T00:15:05.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:05.217+0000 7fae7c184640 1 -- 172.21.15.79:0/3902017427 wait complete. 2024-06-10T00:15:05.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-06-10T00:15:05.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-06-10T00:15:05.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-06-10T00:15:05.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-06-10T00:15:05.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-06-10T00:15:05.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-06-10T00:15:06.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-10T00:15:06.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-10T00:15:06.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-10T00:15:06.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-10T00:15:06.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-10T00:15:06.229 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-10T00:15:06.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-10T00:15:06.234 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-10T00:15:06.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.378+0000 7f0545ba2640 1 Processor -- start 2024-06-10T00:15:06.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.378+0000 7f0545ba2640 1 -- start start 2024-06-10T00:15:06.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.379+0000 7f857fbd5640 1 Processor -- start 2024-06-10T00:15:06.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f0545ba2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f054006d8f0 0x7f0540072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f0545ba2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f054015ace0 0x7f054015b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f0545ba2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0540140a10 con 0x7f05400d05d0 2024-06-10T00:15:06.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f0545ba2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f05400731c0 con 0x7f054006d8f0 2024-06-10T00:15:06.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f0545ba2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0540072920 con 0x7f054015ace0 2024-06-10T00:15:06.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f053f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f05400d05d0 0x7f054015a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50704/0 (socket says 172.21.15.79:50704) 2024-06-10T00:15:06.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f053f7fe640 1 -- 172.21.15.79:0/3853250030 learned_addr learned my addr 172.21.15.79:0/3853250030 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:06.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f053effd640 1 --2- 172.21.15.79:0/3853250030 >> v2:172.21.15.117:3300/0 conn(0x7f054006d8f0 0x7f0540072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865253839 0 0) 0x7f0540140a10 con 0x7f05400d05d0 2024-06-10T00:15:06.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.380+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0528003520 con 0x7f05400d05d0 2024-06-10T00:15:06.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3146887997 0 0) 0x7f0528003520 con 0x7f05400d05d0 2024-06-10T00:15:06.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053ffff640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f054015ace0 0x7f054015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f054015ace0 msgr2=0x7f054015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:06.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f054015ace0 0x7f054015b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 >> v2:172.21.15.117:3300/0 conn(0x7f054006d8f0 msgr2=0x7f0540072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 --2- 172.21.15.79:0/3853250030 >> v2:172.21.15.117:3300/0 conn(0x7f054006d8f0 0x7f0540072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0540072c00 con 0x7f05400d05d0 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f0534001670 con 0x7f05400d05d0 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 >> v1:172.21.15.79:6789/0 conn(0x7f05400d05d0 legacy=0x7f054015a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05280039b0 0x7f0528003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05280043a0 0x7f0528004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0528005080 0x7f052800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05400731c0 con 0x7f0528005080 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0540072920 con 0x7f05280043a0 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f052800c030 con 0x7f05280039b0 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.381+0000 7f053effd640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05280043a0 0x7f0528004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.382+0000 7f053ffff640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0528005080 0x7f052800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.382+0000 7f053effd640 1 -- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05280039b0 msgr2=0x7f0528003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-10T00:15:06.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.382+0000 7f053effd640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05280039b0 0x7f0528003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.382+0000 7f053effd640 1 -- 172.21.15.79:0/3853250030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0528005080 msgr2=0x7f052800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:06.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.382+0000 7f053effd640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0528005080 0x7f052800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.382+0000 7f053effd640 1 -- 172.21.15.79:0/3853250030 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0528003520 con 0x7f05280043a0 2024-06-10T00:15:06.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.383+0000 7f053ffff640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0528005080 0x7f052800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:06.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.382+0000 7f857fbd5640 1 -- start start 2024-06-10T00:15:06.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.383+0000 7f857fbd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 0x7f85780d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.383+0000 7f857fbd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85780cf920 0x7f85780cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.383+0000 7f857fbd5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85780b2120 con 0x7f85781625c0 2024-06-10T00:15:06.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.383+0000 7f857fbd5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f857809c6e0 con 0x7f85780cf920 2024-06-10T00:15:06.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.383+0000 7f857fbd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f85781629a0 con 0x7f8578166b70 2024-06-10T00:15:06.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f857e172640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85780cf920 0x7f85780cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f857e172640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85780cf920 0x7f85780cfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36830/0 (socket says 172.21.15.79:36830) 2024-06-10T00:15:06.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f857e172640 1 -- 172.21.15.79:0/1308668220 learned_addr learned my addr 172.21.15.79:0/1308668220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f857e172640 1 -- 172.21.15.79:0/1308668220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 msgr2=0x7f85780d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:06.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f857d170640 1 --2- 172.21.15.79:0/1308668220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 0x7f85780d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f857e172640 1 --2- 172.21.15.79:0/1308668220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 0x7f85780d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f857e172640 1 -- 172.21.15.79:0/1308668220 >> v1:172.21.15.79:6789/0 conn(0x7f85781625c0 legacy=0x7f857809bfd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-10T00:15:06.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f857e172640 1 -- 172.21.15.79:0/1308668220 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85780b23c0 con 0x7f85780cf920 2024-06-10T00:15:06.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.384+0000 7f053effd640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05280043a0 0x7f0528004880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0530009ac0 tx=0x7f0528005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e05bf0596694bcff server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.385+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530036070 con 0x7f05280043a0 2024-06-10T00:15:06.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.385+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0530031400 con 0x7f05280043a0 2024-06-10T00:15:06.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.385+0000 7f053e7fc640 1 -- 172.21.15.79:0/3853250030 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530009690 con 0x7f05280043a0 2024-06-10T00:15:06.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.385+0000 7f857e172640 1 --2- 172.21.15.79:0/1308668220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780cfdd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8570009e50 tx=0x7f857002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95e86bd7449bd34 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f857c96f640 1 -- 172.21.15.79:0/1308668220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570036070 con 0x7f85780cf920 2024-06-10T00:15:06.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f857c96f640 1 -- 172.21.15.79:0/1308668220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8570031600 con 0x7f85780cf920 2024-06-10T00:15:06.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f857c96f640 1 -- 172.21.15.79:0/1308668220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85700319d0 con 0x7f85780cf920 2024-06-10T00:15:06.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f0545ba2640 1 -- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05280043a0 msgr2=0x7f0528004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f0545ba2640 1 --2- 172.21.15.79:0/3853250030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05280043a0 0x7f0528004880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0530009ac0 tx=0x7f0528005830 comp rx=0 tx=0).stop 2024-06-10T00:15:06.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f053ffff640 1 -- 172.21.15.79:0/3853250030 reap_dead start 2024-06-10T00:15:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f0545ba2640 1 -- 172.21.15.79:0/3853250030 shutdown_connections 2024-06-10T00:15:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f0545ba2640 1 -- 172.21.15.79:0/3853250030 >> 172.21.15.79:0/3853250030 conn(0x7f05400cfab0 msgr2=0x7f05400cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.387+0000 7f857fbd5640 1 -- 172.21.15.79:0/1308668220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 msgr2=0x7f85780cfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.387+0000 7f857fbd5640 1 --2- 172.21.15.79:0/1308668220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780cfdd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8570009e50 tx=0x7f857002a640 comp rx=0 tx=0).stop 2024-06-10T00:15:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.387+0000 7f857fbd5640 1 -- 172.21.15.79:0/1308668220 shutdown_connections 2024-06-10T00:15:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.387+0000 7f857fbd5640 1 --2- 172.21.15.79:0/1308668220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780cfdd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.387+0000 7f857fbd5640 1 --2- 172.21.15.79:0/1308668220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 0x7f85780d2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.387+0000 7f857fbd5640 1 -- 172.21.15.79:0/1308668220 >> 172.21.15.79:0/1308668220 conn(0x7f85780d4290 msgr2=0x7f85780d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f0545ba2640 1 -- 172.21.15.79:0/3853250030 shutdown_connections 2024-06-10T00:15:06.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.386+0000 7f0545ba2640 1 -- 172.21.15.79:0/3853250030 wait complete. 2024-06-10T00:15:06.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.388+0000 7f857fbd5640 1 -- 172.21.15.79:0/1308668220 shutdown_connections 2024-06-10T00:15:06.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.388+0000 7f0545ba2640 1 Processor -- start 2024-06-10T00:15:06.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.389+0000 7f0545ba2640 1 -- start start 2024-06-10T00:15:06.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.388+0000 7f857fbd5640 1 -- 172.21.15.79:0/1308668220 wait complete. 2024-06-10T00:15:06.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.390+0000 7f857fbd5640 1 Processor -- start 2024-06-10T00:15:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.390+0000 7f857fbd5640 1 -- start start 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.390+0000 7f0545ba2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054013fd20 0x7f0540153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.390+0000 7f0545ba2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05401542d0 0x7f05401f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.390+0000 7f0545ba2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05401f35f0 0x7f05401efa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.390+0000 7f0545ba2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f054006d200 con 0x7f05401542d0 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.390+0000 7f0545ba2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f05400cd7b0 con 0x7f054013fd20 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.390+0000 7f0545ba2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f054015b110 con 0x7f05401f35f0 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05401542d0 0x7f05401f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05401542d0 0x7f05401f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36842/0 (socket says 172.21.15.79:36842) 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053effd640 1 -- 172.21.15.79:0/2468222116 learned_addr learned my addr 172.21.15.79:0/2468222116 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053ffff640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05401f35f0 0x7f05401efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f857fbd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f857fbd5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781625c0 0x7f8578161450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f857fbd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 0x7f8578161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053effd640 1 -- 172.21.15.79:0/2468222116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05401f35f0 msgr2=0x7f05401efa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053effd640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05401f35f0 0x7f05401efa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053effd640 1 -- 172.21.15.79:0/2468222116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054013fd20 msgr2=0x7f0540153d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-10T00:15:06.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053effd640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054013fd20 0x7f0540153d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.391+0000 7f053effd640 1 -- 172.21.15.79:0/2468222116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0540154dd0 con 0x7f05401542d0 2024-06-10T00:15:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.392+0000 7f857fbd5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8578167050 con 0x7f85780cf920 2024-06-10T00:15:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.392+0000 7f857fbd5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f85780b2980 con 0x7f85781625c0 2024-06-10T00:15:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.392+0000 7f857fbd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f85780d3950 con 0x7f8578166b70 2024-06-10T00:15:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.392+0000 7f857d971640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.392+0000 7f857d971640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36846/0 (socket says 172.21.15.79:36846) 2024-06-10T00:15:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.392+0000 7f857d971640 1 -- 172.21.15.79:0/1043395075 learned_addr learned my addr 172.21.15.79:0/1043395075 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.392+0000 7f053effd640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05401542d0 0x7f05401f30b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0530009be0 tx=0x7f0530004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.393+0000 7f857d971640 1 -- 172.21.15.79:0/1043395075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 msgr2=0x7f8578161990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-10T00:15:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.393+0000 7f857d971640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 0x7f8578161990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.393+0000 7f857d971640 1 -- 172.21.15.79:0/1043395075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781625c0 msgr2=0x7f8578161450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-10T00:15:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.393+0000 7f857d971640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781625c0 0x7f8578161450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.393+0000 7f857d971640 1 -- 172.21.15.79:0/1043395075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8578162c60 con 0x7f85780cf920 2024-06-10T00:15:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.393+0000 7f0527fff640 1 -- 172.21.15.79:0/2468222116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053003f020 con 0x7f05401542d0 2024-06-10T00:15:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.393+0000 7f0545ba2640 1 -- 172.21.15.79:0/2468222116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0540154810 con 0x7f05401542d0 2024-06-10T00:15:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.393+0000 7f0545ba2640 1 -- 172.21.15.79:0/2468222116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05400b3a30 con 0x7f05401542d0 2024-06-10T00:15:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.394+0000 7f0527fff640 1 -- 172.21.15.79:0/2468222116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0530003830 con 0x7f05401542d0 2024-06-10T00:15:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.395+0000 7f0527fff640 1 -- 172.21.15.79:0/2468222116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530036040 con 0x7f05401542d0 2024-06-10T00:15:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.395+0000 7f857d971640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780c6720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f857400b480 tx=0x7f857400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.396+0000 7f0527fff640 1 -- 172.21.15.79:0/2468222116 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0530042020 con 0x7f05401542d0 2024-06-10T00:15:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.397+0000 7f0527fff640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f052c06bf30 0x7f052c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.397+0000 7f0527fff640 1 -- 172.21.15.79:0/2468222116 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f05300aaff0 con 0x7f05401542d0 2024-06-10T00:15:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.397+0000 7f053f7fe640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f052c06bf30 0x7f052c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.399+0000 7f856e7fc640 1 -- 172.21.15.79:0/1043395075 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574014070 con 0x7f85780cf920 2024-06-10T00:15:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.399+0000 7f857fbd5640 1 -- 172.21.15.79:0/1043395075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8578162f00 con 0x7f85780cf920 2024-06-10T00:15:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.399+0000 7f857fbd5640 1 -- 172.21.15.79:0/1043395075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85781634c0 con 0x7f85780cf920 2024-06-10T00:15:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.400+0000 7f856e7fc640 1 -- 172.21.15.79:0/1043395075 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8574010870 con 0x7f85780cf920 2024-06-10T00:15:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.401+0000 7f856e7fc640 1 -- 172.21.15.79:0/1043395075 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574010c60 con 0x7f85780cf920 2024-06-10T00:15:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.396+0000 7f0525ffb640 1 -- 172.21.15.79:0/2468222116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05401f3a00 con 0x7f05401542d0 2024-06-10T00:15:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.399+0000 7f053f7fe640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f052c06bf30 0x7f052c06e3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0534000f60 tx=0x7f0534000ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.402+0000 7f857fbd5640 1 -- 172.21.15.79:0/1043395075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8560005290 con 0x7f85780cf920 2024-06-10T00:15:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.408+0000 7f856e7fc640 1 -- 172.21.15.79:0/1043395075 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8574017070 con 0x7f85780cf920 2024-06-10T00:15:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.409+0000 7f856e7fc640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f855c06bf00 0x7f855c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.409+0000 7f856e7fc640 1 -- 172.21.15.79:0/1043395075 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f857408b410 con 0x7f85780cf920 2024-06-10T00:15:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.410+0000 7f857d170640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f855c06bf00 0x7f855c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.411+0000 7f857d170640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f855c06bf00 0x7f855c06e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85780cb010 tx=0x7f8568008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.411+0000 7f0527fff640 1 -- 172.21.15.79:0/2468222116 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f05401f3a00 con 0x7f05401542d0 2024-06-10T00:15:06.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.415+0000 7f856e7fc640 1 -- 172.21.15.79:0/1043395075 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8574059af0 con 0x7f85780cf920 2024-06-10T00:15:06.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.436+0000 7fac56fd6640 1 Processor -- start 2024-06-10T00:15:06.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.436+0000 7fac56fd6640 1 -- start start 2024-06-10T00:15:06.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.437+0000 7fac56fd6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fac5006e880 0x7fac500d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.437+0000 7fac56fd6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac5006da50 0x7fac5015ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.437+0000 7fac56fd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500cc810 0x7fac500b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.437+0000 7fac56fd6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fac500d0ae0 con 0x7fac5006da50 2024-06-10T00:15:06.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.437+0000 7fac56fd6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fac5006d5c0 con 0x7fac5006e880 2024-06-10T00:15:06.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.437+0000 7fac56fd6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fac5006cd20 con 0x7fac500cc810 2024-06-10T00:15:06.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.438+0000 7f01ea4ca640 1 Processor -- start 2024-06-10T00:15:06.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.438+0000 7f01ea4ca640 1 -- start start 2024-06-10T00:15:06.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.438+0000 7fac557d3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac5006da50 0x7fac5015ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.438+0000 7fac557d3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac5006da50 0x7fac5015ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36852/0 (socket says 172.21.15.79:36852) 2024-06-10T00:15:06.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.438+0000 7fac557d3640 1 -- 172.21.15.79:0/2680128556 learned_addr learned my addr 172.21.15.79:0/2680128556 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.438+0000 7f96d98df640 1 Processor -- start 2024-06-10T00:15:06.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.438+0000 7fac55fd4640 1 --2- 172.21.15.79:0/2680128556 >> v2:172.21.15.117:3300/0 conn(0x7fac5006e880 0x7fac500d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7fac55fd4640 1 -- 172.21.15.79:0/2680128556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500cc810 msgr2=0x7fac500b3f60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-10T00:15:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7fac55fd4640 1 --2- 172.21.15.79:0/2680128556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500cc810 0x7fac500b3f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7fac55fd4640 1 -- 172.21.15.79:0/2680128556 >> v2:172.21.15.79:3300/0 conn(0x7fac5006da50 msgr2=0x7fac5015ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7fac55fd4640 1 --2- 172.21.15.79:0/2680128556 >> v2:172.21.15.79:3300/0 conn(0x7fac5006da50 0x7fac5015ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7fac55fd4640 1 -- 172.21.15.79:0/2680128556 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5015efa0 con 0x7fac5006e880 2024-06-10T00:15:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7fac557d3640 1 --2- 172.21.15.79:0/2680128556 >> v2:172.21.15.79:3300/0 conn(0x7fac5006da50 0x7fac5015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7f846d701640 1 Processor -- start 2024-06-10T00:15:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7f01ea4ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e4155400 0x7f01e415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7f01ea4ca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01e40d1270 0x7f01e406e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7f01ea4ca640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e41557e0 con 0x7f01e415c100 2024-06-10T00:15:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7f01ea4ca640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f01e40ae7b0 con 0x7f01e40d1270 2024-06-10T00:15:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7f01ea4ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01e40aea90 con 0x7f01e4155400 2024-06-10T00:15:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.439+0000 7f846d701640 1 -- start start 2024-06-10T00:15:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f4eb4f63640 1 Processor -- start 2024-06-10T00:15:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f01e8a67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01e40d1270 0x7f01e406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f4eb4f63640 1 -- start start 2024-06-10T00:15:06.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f01e8a67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01e40d1270 0x7f01e406e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48322/0 (socket says 172.21.15.79:48322) 2024-06-10T00:15:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f01e8a67640 1 -- 172.21.15.79:0/3277857445 learned_addr learned my addr 172.21.15.79:0/3277857445 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f01e3fff640 1 --2- 172.21.15.79:0/3277857445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e4155400 0x7f01e415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.438+0000 7f96d98df640 1 -- start start 2024-06-10T00:15:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7fac55fd4640 1 --2- 172.21.15.79:0/2680128556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac5006e880 0x7fac500d05a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac500709b0 tx=0x7fac4002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=922241b4c588fec3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f01e8a67640 1 -- 172.21.15.79:0/3277857445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e4155400 msgr2=0x7f01e415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f01e8a67640 1 --2- 172.21.15.79:0/3277857445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e4155400 0x7f01e415bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f01e8a67640 1 -- 172.21.15.79:0/3277857445 >> v1:172.21.15.117:6789/0 conn(0x7f01e415c100 legacy=0x7f01e40d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7f01e8a67640 1 -- 172.21.15.79:0/3277857445 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e40aed70 con 0x7f01e40d1270 2024-06-10T00:15:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7ff779f5f640 1 Processor -- start 2024-06-10T00:15:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7ff779f5f640 1 -- start start 2024-06-10T00:15:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7fac54fd2640 1 -- 172.21.15.79:0/2680128556 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40037070 con 0x7fac5006e880 2024-06-10T00:15:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.440+0000 7fac54fd2640 1 -- 172.21.15.79:0/2680128556 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac40032440 con 0x7fac5006e880 2024-06-10T00:15:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7f846d701640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680b42d0 0x7f84680cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7f846d701640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84680cdb50 con 0x7f846815f460 2024-06-10T00:15:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7f846d701640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846815f840 con 0x7f84680cd6e0 2024-06-10T00:15:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7f8467fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f846815f460 0x7f846806f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50710/0 (socket says 172.21.15.79:50710) 2024-06-10T00:15:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7f8467fff640 1 -- 172.21.15.79:0/1497859160 learned_addr learned my addr 172.21.15.79:0/1497859160 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7f846d701640 1 -- 172.21.15.79:0/1497859160 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f84680cee20 con 0x7f84680b42d0 2024-06-10T00:15:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7f84677fe640 1 --2- 172.21.15.79:0/1497859160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680b42d0 0x7f84680cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7fac54fd2640 1 -- 172.21.15.79:0/2680128556 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40037070 con 0x7fac5006e880 2024-06-10T00:15:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.441+0000 7f01e8a67640 1 --2- 172.21.15.79:0/3277857445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 0x7f01e406e580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009e50 tx=0x7f01dc02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23419555c06092ad server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f8466ffd640 1 -- 172.21.15.79:0/1497859160 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007489479 0 0) 0x7f84680cdb50 con 0x7f846815f460 2024-06-10T00:15:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f8466ffd640 1 -- 172.21.15.79:0/1497859160 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8450003520 con 0x7f846815f460 2024-06-10T00:15:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 -- 172.21.15.79:0/2680128556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac5006e880 msgr2=0x7fac500d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 --2- 172.21.15.79:0/2680128556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac5006e880 0x7fac500d05a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac500709b0 tx=0x7fac4002a1c0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f4eb4f63640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4eb0166b70 0x7f4eb00d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f4eae59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4eb01625c0 0x7f4eb009bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52088/0 (socket says 172.21.15.79:52088) 2024-06-10T00:15:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 -- 172.21.15.79:0/2680128556 shutdown_connections 2024-06-10T00:15:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 --2- 172.21.15.79:0/2680128556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500cc810 0x7fac500b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 --2- 172.21.15.79:0/2680128556 >> v2:172.21.15.79:3300/0 conn(0x7fac5006da50 0x7fac5015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 --2- 172.21.15.79:0/2680128556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac5006e880 0x7fac500d05a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 -- 172.21.15.79:0/2680128556 >> 172.21.15.79:0/2680128556 conn(0x7fac5006b5a0 msgr2=0x7fac5006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff779f5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c0e1310 0x7ff76c03a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff779f5f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff76c00ab40 0x7ff76c009d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff779f5f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff76c0516e0 0x7ff76c00a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff779f5f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff76c055920 con 0x7ff76c0516e0 2024-06-10T00:15:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff779f5f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff76c03a6b0 con 0x7ff76c00ab40 2024-06-10T00:15:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff779f5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c054d10 con 0x7ff76c0e1310 2024-06-10T00:15:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 -- 172.21.15.79:0/2680128556 shutdown_connections 2024-06-10T00:15:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7fac56fd6640 1 -- 172.21.15.79:0/2680128556 wait complete. 2024-06-10T00:15:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff773fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff76c00ab40 0x7ff76c009d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff773fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff76c00ab40 0x7ff76c009d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48332/0 (socket says 172.21.15.79:48332) 2024-06-10T00:15:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff773fff640 1 -- 172.21.15.79:0/2109873993 learned_addr learned my addr 172.21.15.79:0/2109873993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff77975e640 1 --2- 172.21.15.79:0/2109873993 >> v2:172.21.15.79:3300/0 conn(0x7ff76c0516e0 0x7ff76c00a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f4eadd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4eb0166b70 0x7f4eb00d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f96d98df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d40b3b50 0x7f96d40b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f96d98df640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d406d160 con 0x7f96d40cc680 2024-06-10T00:15:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f96d98df640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d406d440 con 0x7f96d4165bf0 2024-06-10T00:15:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f96d98df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96d406dd70 con 0x7f96d40b3b50 2024-06-10T00:15:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f01e2ffd640 1 -- 172.21.15.79:0/3277857445 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc036070 con 0x7f01e40d1270 2024-06-10T00:15:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f4eadd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4eb0166b70 0x7f4eb00d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36862/0 (socket says 172.21.15.79:36862) 2024-06-10T00:15:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f4eae59c640 1 -- 172.21.15.79:0/1437143171 learned_addr learned my addr 172.21.15.79:0/1437143171 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f96d2ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f96d4165bf0 0x7f96d406e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52100/0 (socket says 172.21.15.79:52100) 2024-06-10T00:15:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f96d2ffd640 1 -- 172.21.15.79:0/2392868599 learned_addr learned my addr 172.21.15.79:0/2392868599 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f96d27fc640 1 --2- 172.21.15.79:0/2392868599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d40b3b50 0x7f96d40b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff773fff640 1 -- 172.21.15.79:0/2109873993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c0e1310 msgr2=0x7ff76c03a170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-10T00:15:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff773fff640 1 --2- 172.21.15.79:0/2109873993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c0e1310 0x7ff76c03a170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7ff773fff640 1 -- 172.21.15.79:0/2109873993 >> v2:172.21.15.79:3300/0 conn(0x7ff76c0516e0 msgr2=0x7ff76c00a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7ff773fff640 1 --2- 172.21.15.79:0/2109873993 >> v2:172.21.15.79:3300/0 conn(0x7ff76c0516e0 0x7ff76c00a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/1437143171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb00cf920 0x7f4eb00cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f01e2ffd640 1 -- 172.21.15.79:0/3277857445 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01dc031600 con 0x7f01e40d1270 2024-06-10T00:15:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f01e2ffd640 1 -- 172.21.15.79:0/3277857445 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0319b0 con 0x7f01e40d1270 2024-06-10T00:15:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f84677fe640 1 -- 172.21.15.79:0/1497859160 >> v1:172.21.15.117:6789/0 conn(0x7f84680cd6e0 legacy=0x7f84680cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f84677fe640 1 -- 172.21.15.79:0/1497859160 >> v1:172.21.15.79:6789/0 conn(0x7f846815f460 legacy=0x7f846806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.442+0000 7f84677fe640 1 -- 172.21.15.79:0/1497859160 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846806f7e0 con 0x7f84680b42d0 2024-06-10T00:15:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7ff773fff640 1 -- 172.21.15.79:0/2109873993 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c054ff0 con 0x7ff76c00ab40 2024-06-10T00:15:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f4eb4f63640 1 -- 172.21.15.79:0/1437143171 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb00b2120 con 0x7f4eb01625c0 2024-06-10T00:15:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f4eb4f63640 1 -- 172.21.15.79:0/1437143171 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb009c6e0 con 0x7f4eb0166b70 2024-06-10T00:15:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f4eb4f63640 1 -- 172.21.15.79:0/1437143171 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb01629a0 con 0x7f4eb00cf920 2024-06-10T00:15:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7ff77975e640 1 --2- 172.21.15.79:0/2109873993 >> v2:172.21.15.79:3300/0 conn(0x7ff76c0516e0 0x7ff76c00a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f4eaed9d640 1 --2- 172.21.15.79:0/1437143171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb00cf920 0x7f4eb00cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f96d27fc640 1 -- 172.21.15.79:0/2392868599 >> v1:172.21.15.117:6789/0 conn(0x7f96d4165bf0 legacy=0x7f96d406e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f4eaed9d640 1 -- 172.21.15.79:0/1437143171 >> v2:172.21.15.79:3300/0 conn(0x7f4eb0166b70 msgr2=0x7f4eb00d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f4eaed9d640 1 --2- 172.21.15.79:0/1437143171 >> v2:172.21.15.79:3300/0 conn(0x7f4eb0166b70 0x7f4eb00d2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f01ea4ca640 1 -- 172.21.15.79:0/3277857445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 msgr2=0x7f01e406e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/3277857445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 0x7f01e406e580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009e50 tx=0x7f01dc02a730 comp rx=0 tx=0).stop 2024-06-10T00:15:06.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f4eaed9d640 1 -- 172.21.15.79:0/1437143171 >> v1:172.21.15.117:6789/0 conn(0x7f4eb01625c0 legacy=0x7f4eb009bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f4eaed9d640 1 -- 172.21.15.79:0/1437143171 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb00b23c0 con 0x7f4eb00cf920 2024-06-10T00:15:06.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.443+0000 7f96d1ffb640 1 -- 172.21.15.79:0/2392868599 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797580403 0 0) 0x7f96d406d440 con 0x7f96d4165bf0 2024-06-10T00:15:06.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f96d27fc640 1 -- 172.21.15.79:0/2392868599 >> v1:172.21.15.79:6789/0 conn(0x7f96d40cc680 legacy=0x7f96d40ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f96d27fc640 1 -- 172.21.15.79:0/2392868599 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d406d720 con 0x7f96d40b3b50 2024-06-10T00:15:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f84677fe640 1 --2- 172.21.15.79:0/1497859160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680b42d0 0x7f84680cd1a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097d0 tx=0x7f845c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b15bb5c6b289e1fe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f01ea4ca640 1 -- 172.21.15.79:0/3277857445 shutdown_connections 2024-06-10T00:15:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/3277857445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 0x7f01e406e580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/3277857445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e4155400 0x7f01e415bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f01ea4ca640 1 -- 172.21.15.79:0/3277857445 >> 172.21.15.79:0/3277857445 conn(0x7f01e406c4d0 msgr2=0x7f01e406c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f01ea4ca640 1 -- 172.21.15.79:0/3277857445 shutdown_connections 2024-06-10T00:15:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7ff773fff640 1 --2- 172.21.15.79:0/2109873993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c00ab40 0x7ff76c009d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00bad0 tx=0x7ff76802a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d6397d4357c6332 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7ff7737fe640 1 -- 172.21.15.79:0/2109873993 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768037070 con 0x7ff76c00ab40 2024-06-10T00:15:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7ff7737fe640 1 -- 172.21.15.79:0/2109873993 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff768032440 con 0x7ff76c00ab40 2024-06-10T00:15:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7ff7737fe640 1 -- 172.21.15.79:0/2109873993 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768032810 con 0x7ff76c00ab40 2024-06-10T00:15:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f8466ffd640 1 -- 172.21.15.79:0/1497859160 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c037070 con 0x7f84680b42d0 2024-06-10T00:15:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f8466ffd640 1 -- 172.21.15.79:0/1497859160 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845c032440 con 0x7f84680b42d0 2024-06-10T00:15:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f8466ffd640 1 -- 172.21.15.79:0/1497859160 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c032810 con 0x7f84680b42d0 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7fac56fd6640 1 Processor -- start 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7fac56fd6640 1 -- start start 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac56fd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac5006da50 0x7fac5014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac56fd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac500cc810 0x7fac500cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac56fd6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac50151410 0x7fac5014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac557d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac500cc810 0x7fac500cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac557d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac500cc810 0x7fac500cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36884/0 (socket says 172.21.15.79:36884) 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac557d3640 1 -- 172.21.15.79:0/3472128119 learned_addr learned my addr 172.21.15.79:0/3472128119 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fac5006d250 con 0x7fac500cc810 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fac5006cf70 con 0x7fac50151410 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fac500730e0 con 0x7fac5006da50 2024-06-10T00:15:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac55fd4640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac5006da50 0x7fac5014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac567d5640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac50151410 0x7fac5014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f96d27fc640 1 --2- 172.21.15.79:0/2392868599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d40b3b50 0x7f96d40b4b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097d0 tx=0x7f96c402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dda328308eca742 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f96d1ffb640 1 -- 172.21.15.79:0/2392868599 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4037070 con 0x7f96d40b3b50 2024-06-10T00:15:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f96d1ffb640 1 -- 172.21.15.79:0/2392868599 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c402ada0 con 0x7f96d40b3b50 2024-06-10T00:15:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f96d1ffb640 1 -- 172.21.15.79:0/2392868599 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4032660 con 0x7f96d40b3b50 2024-06-10T00:15:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f96d98df640 1 -- 172.21.15.79:0/2392868599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d40b3b50 msgr2=0x7f96d40b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f96d98df640 1 --2- 172.21.15.79:0/2392868599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d40b3b50 0x7f96d40b4b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097d0 tx=0x7f96c402a110 comp rx=0 tx=0).stop 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f846d701640 1 -- 172.21.15.79:0/1497859160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680b42d0 msgr2=0x7f84680cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f846d701640 1 --2- 172.21.15.79:0/1497859160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680b42d0 0x7f84680cd1a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097d0 tx=0x7f845c02a1c0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7ff779f5f640 1 -- 172.21.15.79:0/2109873993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c00ab40 msgr2=0x7ff76c009d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7ff779f5f640 1 --2- 172.21.15.79:0/2109873993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c00ab40 0x7ff76c009d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00bad0 tx=0x7ff76802a1d0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7ff779f5f640 1 -- 172.21.15.79:0/2109873993 shutdown_connections 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7ff779f5f640 1 --2- 172.21.15.79:0/2109873993 >> v2:172.21.15.79:3300/0 conn(0x7ff76c0516e0 0x7ff76c00a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7ff779f5f640 1 --2- 172.21.15.79:0/2109873993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c00ab40 0x7ff76c009d50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7ff779f5f640 1 --2- 172.21.15.79:0/2109873993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c0e1310 0x7ff76c03a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7ff779f5f640 1 -- 172.21.15.79:0/2109873993 >> 172.21.15.79:0/2109873993 conn(0x7ff76c056cd0 msgr2=0x7ff76c0570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f96d98df640 1 -- 172.21.15.79:0/2392868599 shutdown_connections 2024-06-10T00:15:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f96d98df640 1 --2- 172.21.15.79:0/2392868599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d40b3b50 0x7f96d40b4b20 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097d0 tx=0x7f96c402a110 comp rx=0 tx=0).stop 2024-06-10T00:15:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f96d98df640 1 -- 172.21.15.79:0/2392868599 >> 172.21.15.79:0/2392868599 conn(0x7f96d40b19f0 msgr2=0x7f96d40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac557d3640 1 -- 172.21.15.79:0/3472128119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac5006da50 msgr2=0x7fac5014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f846d701640 1 -- 172.21.15.79:0/1497859160 shutdown_connections 2024-06-10T00:15:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f846d701640 1 --2- 172.21.15.79:0/1497859160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680b42d0 0x7f84680cd1a0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097d0 tx=0x7f845c02a1c0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f846d701640 1 -- 172.21.15.79:0/1497859160 >> 172.21.15.79:0/1497859160 conn(0x7f84680b37b0 msgr2=0x7f84680b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f96d98df640 1 -- 172.21.15.79:0/2392868599 shutdown_connections 2024-06-10T00:15:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f96d98df640 1 -- 172.21.15.79:0/2392868599 wait complete. 2024-06-10T00:15:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac557d3640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac5006da50 0x7fac5014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac557d3640 1 -- 172.21.15.79:0/3472128119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac50151410 msgr2=0x7fac5014fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac557d3640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac50151410 0x7fac5014fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac557d3640 1 -- 172.21.15.79:0/3472128119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5014b1b0 con 0x7fac500cc810 2024-06-10T00:15:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac557d3640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac500cc810 0x7fac500cf740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00e9d0 tx=0x7fac4c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7fac467fc640 1 -- 172.21.15.79:0/3472128119 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c017070 con 0x7fac500cc810 2024-06-10T00:15:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f4eaed9d640 1 --2- 172.21.15.79:0/1437143171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb00cf920 0x7f4eb00cfdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009d90 tx=0x7f4ea802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1831c0907420c96 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f4ead59a640 1 -- 172.21.15.79:0/1437143171 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8031600 con 0x7f4eb00cf920 2024-06-10T00:15:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f4ead59a640 1 -- 172.21.15.79:0/1437143171 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea80317a0 con 0x7f4eb00cf920 2024-06-10T00:15:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.445+0000 7f4ead59a640 1 -- 172.21.15.79:0/1437143171 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8031b70 con 0x7f4eb00cf920 2024-06-10T00:15:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.447+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5014cba0 con 0x7fac500cc810 2024-06-10T00:15:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.447+0000 7fac467fc640 1 -- 172.21.15.79:0/3472128119 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c00ca60 con 0x7fac500cc810 2024-06-10T00:15:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.447+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5014d160 con 0x7fac500cc810 2024-06-10T00:15:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.447+0000 7f96d98df640 1 Processor -- start 2024-06-10T00:15:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.447+0000 7fac467fc640 1 -- 172.21.15.79:0/3472128119 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00ce10 con 0x7fac500cc810 2024-06-10T00:15:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.444+0000 7f01ea4ca640 1 -- 172.21.15.79:0/3277857445 wait complete. 2024-06-10T00:15:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f96d98df640 1 -- start start 2024-06-10T00:15:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f01ea4ca640 1 Processor -- start 2024-06-10T00:15:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.446+0000 7f01ea4ca640 1 -- start start 2024-06-10T00:15:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.447+0000 7f01ea4ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 0x7f01e4146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.447+0000 7f01ea4ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e4155400 0x7f01e40b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.447+0000 7f01ea4ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e415c100 0x7f01e41436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01ea4ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f01e415b590 con 0x7f01e4155400 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01ea4ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01e40af330 con 0x7f01e40d1270 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01ea4ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01e415b710 con 0x7f01e415c100 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 0x7f01e4146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 0x7f01e4146160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48350/0 (socket says 172.21.15.79:48350) 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01e3fff640 1 -- 172.21.15.79:0/1608311178 learned_addr learned my addr 172.21.15.79:0/1608311178 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01e8a67640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e415c100 0x7f01e41436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01e37fe640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e4155400 0x7f01e40b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7ff779f5f640 1 -- 172.21.15.79:0/2109873993 shutdown_connections 2024-06-10T00:15:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7ff779f5f640 1 -- 172.21.15.79:0/2109873993 wait complete. 2024-06-10T00:15:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f846d701640 1 -- 172.21.15.79:0/1497859160 shutdown_connections 2024-06-10T00:15:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01e8a67640 1 -- 172.21.15.79:0/1608311178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 msgr2=0x7f01e4146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01e8a67640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 0x7f01e4146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f01e8a67640 1 -- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e4155400 msgr2=0x7f01e40b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.448+0000 7f846d701640 1 -- 172.21.15.79:0/1497859160 wait complete. 2024-06-10T00:15:06.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f96d98df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96d40cc680 0x7f96d40ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f4eb4f63640 1 -- 172.21.15.79:0/1437143171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb00cf920 msgr2=0x7f4eb00cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/1437143171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb00cf920 0x7f4eb00cfdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009d90 tx=0x7f4ea802a5d0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7fac467fc640 1 -- 172.21.15.79:0/3472128119 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac4c01a070 con 0x7fac500cc810 2024-06-10T00:15:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac500683c0 con 0x7fac500cc810 2024-06-10T00:15:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f96d98df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d4165bf0 0x7f96d4071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f96d2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96d40cc680 0x7f96d40ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f4eb4f63640 1 -- 172.21.15.79:0/1437143171 shutdown_connections 2024-06-10T00:15:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/1437143171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb00cf920 0x7f4eb00cfdb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/1437143171 >> v2:172.21.15.79:3300/0 conn(0x7f4eb0166b70 0x7f4eb00d2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f4eb4f63640 1 -- 172.21.15.79:0/1437143171 >> 172.21.15.79:0/1437143171 conn(0x7f4eb00d4290 msgr2=0x7f4eb00d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f96d2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96d40cc680 0x7f96d40ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48360/0 (socket says 172.21.15.79:48360) 2024-06-10T00:15:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f96d27fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d4165bf0 0x7f96d4071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f4eb4f63640 1 -- 172.21.15.79:0/1437143171 shutdown_connections 2024-06-10T00:15:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f4eb4f63640 1 -- 172.21.15.79:0/1437143171 wait complete. 2024-06-10T00:15:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.449+0000 7f96d27fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d4165bf0 0x7f96d4071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50638/0 (socket says 172.21.15.79:50638) 2024-06-10T00:15:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7f96d98df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d4156b00 0x7f96d4071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7ff779f5f640 1 Processor -- start 2024-06-10T00:15:06.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7f96d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d4156b00 0x7f96d4071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7f96d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d4156b00 0x7f96d4071b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36902/0 (socket says 172.21.15.79:36902) 2024-06-10T00:15:06.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7f96d2ffd640 1 -- 172.21.15.79:0/904528582 learned_addr learned my addr 172.21.15.79:0/904528582 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7f846d701640 1 Processor -- start 2024-06-10T00:15:06.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7fac467fc640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fac3406be30 0x7fac3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4071030 con 0x7f96d4156b00 2024-06-10T00:15:06.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96d406e910 con 0x7f96d40cc680 2024-06-10T00:15:06.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96d40711b0 con 0x7f96d4165bf0 2024-06-10T00:15:06.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f846d701640 1 -- start start 2024-06-10T00:15:06.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7fac467fc640 1 -- 172.21.15.79:0/3472128119 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fac4c08b450 con 0x7fac500cc810 2024-06-10T00:15:06.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f4eb4f63640 1 Processor -- start 2024-06-10T00:15:06.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f96d37fe640 1 -- 172.21.15.79:0/904528582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d4165bf0 msgr2=0x7f96d4071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f4eb4f63640 1 -- start start 2024-06-10T00:15:06.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7fac55fd4640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fac3406be30 0x7fac3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f96d37fe640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d4165bf0 0x7f96d4071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f96d37fe640 1 -- 172.21.15.79:0/904528582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96d40cc680 msgr2=0x7f96d40ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f96d37fe640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96d40cc680 0x7f96d40ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f96d37fe640 1 -- 172.21.15.79:0/904528582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d40cea90 con 0x7f96d4156b00 2024-06-10T00:15:06.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.451+0000 7f96d27fc640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d4165bf0 0x7f96d4071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-10T00:15:06.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f01e8a67640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e4155400 0x7f01e40b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f01e8a67640 1 -- 172.21.15.79:0/1608311178 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e4146a30 con 0x7f01e415c100 2024-06-10T00:15:06.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f01e37fe640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e4155400 0x7f01e40b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:06.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f846d701640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680cd6e0 0x7f84680b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7fac55fd4640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fac3406be30 0x7fac3406e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fac40034000 tx=0x7fac4002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f846d701640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846815f460 0x7f84680b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f846d701640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84680b6ee0 0x7f84680b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f01e8a67640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e415c100 0x7f01e41436b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f01dc030000 tx=0x7f01dc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f84677fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846815f460 0x7f84680b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f84677fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846815f460 0x7f84680b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48364/0 (socket says 172.21.15.79:48364) 2024-06-10T00:15:06.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f96d37fe640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d4156b00 0x7f96d4071b80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00cac0 tx=0x7f96cc00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f8467fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680cd6e0 0x7f84680b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84680cf350 con 0x7f84680b6ee0 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f84677fe640 1 -- 172.21.15.79:0/1896063324 learned_addr learned my addr 172.21.15.79:0/1896063324 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f846cf00640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84680b6ee0 0x7f84680b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84680cf630 con 0x7f846815f460 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f84680cc9a0 con 0x7f84680cd6e0 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f01e0ff9640 1 -- 172.21.15.79:0/1608311178 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc03f020 con 0x7f01e415c100 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f01e0ff9640 1 -- 172.21.15.79:0/1608311178 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01dc003e10 con 0x7f01e415c100 2024-06-10T00:15:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7f01e0ff9640 1 -- 172.21.15.79:0/1608311178 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc036040 con 0x7f01e415c100 2024-06-10T00:15:06.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.450+0000 7ff779f5f640 1 -- start start 2024-06-10T00:15:06.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7ff779f5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c00ab40 0x7ff76c0e4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.452+0000 7ff779f5f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0516e0 0x7ff76c0e16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff778f5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c00ab40 0x7ff76c0e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff778f5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c00ab40 0x7ff76c0e4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50658/0 (socket says 172.21.15.79:50658) 2024-06-10T00:15:06.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eb4f63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00cf920 0x7f4eb0153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eb4f63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb01625c0 0x7f4eb00c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eae59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00cf920 0x7f4eb0153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f84677fe640 1 -- 172.21.15.79:0/1896063324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680cd6e0 msgr2=0x7f84680b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f84677fe640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680cd6e0 0x7f84680b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f84677fe640 1 -- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84680b6ee0 msgr2=0x7f84680b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f84677fe640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84680b6ee0 0x7f84680b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eae59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00cf920 0x7f4eb0153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48378/0 (socket says 172.21.15.79:48378) 2024-06-10T00:15:06.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f84677fe640 1 -- 172.21.15.79:0/1896063324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84680b7390 con 0x7f846815f460 2024-06-10T00:15:06.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eb4f63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb0166b70 0x7f4eb00c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eadd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb01625c0 0x7f4eb00c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eae59c640 1 -- 172.21.15.79:0/446233179 learned_addr learned my addr 172.21.15.79:0/446233179 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff779f5f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0e1310 0x7ff76c0e1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff773fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0516e0 0x7ff76c0e16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff773fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0516e0 0x7ff76c0e16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36918/0 (socket says 172.21.15.79:36918) 2024-06-10T00:15:06.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eaed9d640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb0166b70 0x7f4eb00c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0167050 con 0x7f4eb01625c0 2024-06-10T00:15:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00b2980 con 0x7f4eb00cf920 2024-06-10T00:15:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb00d3950 con 0x7f4eb0166b70 2024-06-10T00:15:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e414b9e0 con 0x7f01e415c100 2024-06-10T00:15:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e413f830 con 0x7f01e415c100 2024-06-10T00:15:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff779f5f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c0548a0 con 0x7ff76c0516e0 2024-06-10T00:15:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff779f5f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c0555b0 con 0x7ff76c0e1310 2024-06-10T00:15:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff779f5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c054a20 con 0x7ff76c00ab40 2024-06-10T00:15:06.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.453+0000 7ff778f5d640 1 -- 172.21.15.79:0/4209127517 learned_addr learned my addr 172.21.15.79:0/4209127517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:06.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7ff77975e640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0e1310 0x7ff76c0e1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f84677fe640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846815f460 0x7f84680b48a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f845c009720 tx=0x7f845c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f4eae59c640 1 -- 172.21.15.79:0/446233179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb0166b70 msgr2=0x7f4eb00c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f4eae59c640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb0166b70 0x7f4eb00c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f4eae59c640 1 -- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb01625c0 msgr2=0x7f4eb00c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7ff778f5d640 1 -- 172.21.15.79:0/4209127517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0e1310 msgr2=0x7ff76c0e1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7ff778f5d640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0e1310 0x7ff76c0e1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7ff778f5d640 1 -- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0516e0 msgr2=0x7ff76c0e16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7ff778f5d640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0516e0 0x7ff76c0e16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f4eae59c640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb01625c0 0x7f4eb00c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f4eae59c640 1 -- 172.21.15.79:0/446233179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb0154010 con 0x7f4eb00cf920 2024-06-10T00:15:06.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7ff778f5d640 1 -- 172.21.15.79:0/4209127517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c1870a0 con 0x7ff76c00ab40 2024-06-10T00:15:06.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f4eadd9b640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb01625c0 0x7f4eb00c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:06.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f8464ff9640 1 -- 172.21.15.79:0/1896063324 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c042020 con 0x7f846815f460 2024-06-10T00:15:06.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f8464ff9640 1 -- 172.21.15.79:0/1896063324 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845c038040 con 0x7f846815f460 2024-06-10T00:15:06.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f8464ff9640 1 -- 172.21.15.79:0/1896063324 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c037050 con 0x7f846815f460 2024-06-10T00:15:06.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.454+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84680b7650 con 0x7f846815f460 2024-06-10T00:15:06.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846815cdd0 con 0x7f846815f460 2024-06-10T00:15:06.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7f4eae59c640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00cf920 0x7f4eb0153ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c4a0 tx=0x7f4ea000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e40d1060 con 0x7f01e415c100 2024-06-10T00:15:06.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7f4e9effd640 1 -- 172.21.15.79:0/446233179 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0017070 con 0x7f4eb00cf920 2024-06-10T00:15:06.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7f4e9effd640 1 -- 172.21.15.79:0/446233179 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea0005ce0 con 0x7f4eb00cf920 2024-06-10T00:15:06.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb00c7cc0 con 0x7f4eb00cf920 2024-06-10T00:15:06.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb00c8280 con 0x7f4eb00cf920 2024-06-10T00:15:06.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7ff778f5d640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c00ab40 0x7ff76c0e4330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff774064ec0 tx=0x7ff774074380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7ff7717fa640 1 -- 172.21.15.79:0/4209127517 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77406fa10 con 0x7ff76c00ab40 2024-06-10T00:15:06.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.455+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c187380 con 0x7ff76c00ab40 2024-06-10T00:15:06.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.456+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c0e3e10 con 0x7ff76c00ab40 2024-06-10T00:15:06.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.456+0000 7ff7717fa640 1 -- 172.21.15.79:0/4209127517 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77406fbf0 con 0x7ff76c00ab40 2024-06-10T00:15:06.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.456+0000 7f01e0ff9640 1 -- 172.21.15.79:0/1608311178 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01dc042020 con 0x7f01e415c100 2024-06-10T00:15:06.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.456+0000 7f01e0ff9640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01d006bf00 0x7f01d006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.457+0000 7f01e3fff640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01d006bf00 0x7f01d006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.457+0000 7ff7717fa640 1 -- 172.21.15.79:0/4209127517 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77406fe60 con 0x7ff76c00ab40 2024-06-10T00:15:06.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.456+0000 7f4e9effd640 1 -- 172.21.15.79:0/446233179 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0007270 con 0x7f4eb00cf920 2024-06-10T00:15:06.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.457+0000 7f01e0ff9640 1 -- 172.21.15.79:0/1608311178 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f01dc0ab3f0 con 0x7f01e415c100 2024-06-10T00:15:06.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.456+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8468068ad0 con 0x7f846815f460 2024-06-10T00:15:06.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.457+0000 7f01e3fff640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01d006bf00 0x7f01d006e3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009c50 tx=0x7f01d4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.458+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb0068ad0 con 0x7f4eb00cf920 2024-06-10T00:15:06.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.457+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff754005290 con 0x7ff76c00ab40 2024-06-10T00:15:06.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.458+0000 7f4e9effd640 1 -- 172.21.15.79:0/446233179 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ea001a070 con 0x7f4eb00cf920 2024-06-10T00:15:06.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.458+0000 7f8464ff9640 1 -- 172.21.15.79:0/1896063324 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f845c003610 con 0x7f846815f460 2024-06-10T00:15:06.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.458+0000 7f4e9effd640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e9006be30 0x7f4e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f4e9effd640 1 -- 172.21.15.79:0/446233179 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4ea008a3e0 con 0x7f4eb00cf920 2024-06-10T00:15:06.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f4eadd9b640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e9006be30 0x7f4e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7ff7717fa640 1 -- 172.21.15.79:0/4209127517 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff774073370 con 0x7ff76c00ab40 2024-06-10T00:15:06.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f96bbfff640 1 -- 172.21.15.79:0/904528582 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc017070 con 0x7f96d4156b00 2024-06-10T00:15:06.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f96bbfff640 1 -- 172.21.15.79:0/904528582 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96cc003b70 con 0x7f96d4156b00 2024-06-10T00:15:06.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d409c0a0 con 0x7f96d4156b00 2024-06-10T00:15:06.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7fac467fc640 1 -- 172.21.15.79:0/3472128119 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fac4c059460 con 0x7fac500cc810 2024-06-10T00:15:06.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f96bbfff640 1 -- 172.21.15.79:0/904528582 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc00a820 con 0x7f96d4156b00 2024-06-10T00:15:06.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f8464ff9640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f845406bf30 0x7f845406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d409c660 con 0x7f96d4156b00 2024-06-10T00:15:06.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f8464ff9640 1 -- 172.21.15.79:0/1896063324 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f845c0ab9b0 con 0x7f846815f460 2024-06-10T00:15:06.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f8467fff640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f845406bf30 0x7f845406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.459+0000 7f4eadd9b640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e9006be30 0x7f4e9006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006fd0 tx=0x7f4ea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.460+0000 7f8467fff640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f845406bf30 0x7f845406e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8458007fd0 tx=0x7f8458007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.460+0000 7ff7717fa640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff75806bf00 0x7ff75806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.460+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d4068430 con 0x7f96d4156b00 2024-06-10T00:15:06.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.461+0000 7ff7717fa640 1 -- 172.21.15.79:0/4209127517 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff774105da0 con 0x7ff76c00ab40 2024-06-10T00:15:06.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.461+0000 7ff773fff640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff75806bf00 0x7ff75806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.461+0000 7ff773fff640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff75806bf00 0x7ff75806e3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff768034000 tx=0x7ff76802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.461+0000 7f01e0ff9640 1 -- 172.21.15.79:0/1608311178 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f01e40d1060 con 0x7f01e415c100 2024-06-10T00:15:06.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.462+0000 7f8464ff9640 1 -- 172.21.15.79:0/1896063324 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f845c04c020 con 0x7f846815f460 2024-06-10T00:15:06.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.462+0000 7f96bbfff640 1 -- 172.21.15.79:0/904528582 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96cc01a070 con 0x7f96d4156b00 2024-06-10T00:15:06.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.462+0000 7f96bbfff640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f96c006be60 0x7f96c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:06.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.462+0000 7f96d2ffd640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f96c006be60 0x7f96c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:06.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.462+0000 7f96bbfff640 1 -- 172.21.15.79:0/904528582 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f96cc08a9d0 con 0x7f96d4156b00 2024-06-10T00:15:06.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.463+0000 7f96d2ffd640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f96c006be60 0x7f96c006e320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f96c8000f60 tx=0x7f96c8007d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:06.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.466+0000 7ff7717fa640 1 -- 172.21.15.79:0/4209127517 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff774098030 con 0x7ff76c00ab40 2024-06-10T00:15:06.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.466+0000 7f4e9effd640 1 -- 172.21.15.79:0/446233179 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4eb0154010 con 0x7f4eb00cf920 2024-06-10T00:15:06.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.471+0000 7f96bbfff640 1 -- 172.21.15.79:0/904528582 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f96cc021080 con 0x7f96d4156b00 2024-06-10T00:15:06.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.816+0000 7f0525ffb640 1 -- 172.21.15.79:0/2468222116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f05400683c0 con 0x7f05401542d0 2024-06-10T00:15:06.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.817+0000 7f0527fff640 1 -- 172.21.15.79:0/2468222116 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0530049030 con 0x7f05401542d0 2024-06-10T00:15:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:06.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.820+0000 7f0545ba2640 1 -- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f052c06bf30 msgr2=0x7f052c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.820+0000 7f0545ba2640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f052c06bf30 0x7f052c06e3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0534000f60 tx=0x7f0534000ef0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.821+0000 7f0545ba2640 1 -- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05401542d0 msgr2=0x7f05401f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.821+0000 7f0545ba2640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05401542d0 0x7f05401f30b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0530009be0 tx=0x7f0530004730 comp rx=0 tx=0).stop 2024-06-10T00:15:06.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.821+0000 7f0545ba2640 1 -- 172.21.15.79:0/2468222116 shutdown_connections 2024-06-10T00:15:06.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.821+0000 7f0545ba2640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f052c06bf30 0x7f052c06e3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.821+0000 7f0545ba2640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05401f35f0 0x7f05401efa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.821+0000 7f0545ba2640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05401542d0 0x7f05401f30b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.821+0000 7f0545ba2640 1 --2- 172.21.15.79:0/2468222116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054013fd20 0x7f0540153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.822+0000 7f0545ba2640 1 -- 172.21.15.79:0/2468222116 >> 172.21.15.79:0/2468222116 conn(0x7f05400cfab0 msgr2=0x7f05401599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.822+0000 7f0545ba2640 1 -- 172.21.15.79:0/2468222116 shutdown_connections 2024-06-10T00:15:06.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.822+0000 7f0545ba2640 1 -- 172.21.15.79:0/2468222116 wait complete. 2024-06-10T00:15:06.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.826+0000 7f857fbd5640 1 -- 172.21.15.79:0/1043395075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8560005850 con 0x7f85780cf920 2024-06-10T00:15:06.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.827+0000 7f856e7fc640 1 -- 172.21.15.79:0/1043395075 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85740593f0 con 0x7f85780cf920 2024-06-10T00:15:06.826 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:06.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.831+0000 7f855bfff640 1 -- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f855c06bf00 msgr2=0x7f855c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.831+0000 7f855bfff640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f855c06bf00 0x7f855c06e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85780cb010 tx=0x7f8568008040 comp rx=0 tx=0).stop 2024-06-10T00:15:06.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.831+0000 7f855bfff640 1 -- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 msgr2=0x7f85780c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.831+0000 7f855bfff640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780c6720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f857400b480 tx=0x7f857400b940 comp rx=0 tx=0).stop 2024-06-10T00:15:06.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.831+0000 7f855bfff640 1 -- 172.21.15.79:0/1043395075 shutdown_connections 2024-06-10T00:15:06.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.831+0000 7f855bfff640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f855c06bf00 0x7f855c06e3c0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85780cb010 tx=0x7f8568008040 comp rx=0 tx=0).stop 2024-06-10T00:15:06.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.831+0000 7f855bfff640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8578166b70 0x7f8578161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.832+0000 7f855bfff640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781625c0 0x7f8578161450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.832+0000 7f855bfff640 1 --2- 172.21.15.79:0/1043395075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85780cf920 0x7f85780c6720 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.832+0000 7f855bfff640 1 -- 172.21.15.79:0/1043395075 >> 172.21.15.79:0/1043395075 conn(0x7f85780d4290 msgr2=0x7f85781600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.832+0000 7f855bfff640 1 -- 172.21.15.79:0/1043395075 shutdown_connections 2024-06-10T00:15:06.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.832+0000 7f855bfff640 1 -- 172.21.15.79:0/1043395075 wait complete. 2024-06-10T00:15:06.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-06-10T00:15:06.839 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:06.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-06-10T00:15:06.848 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.855+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f01e4068ad0 con 0x7f01e415c100 2024-06-10T00:15:06.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.855+0000 7f01e0ff9640 1 -- 172.21.15.79:0/1608311178 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01dc049030 con 0x7f01e415c100 2024-06-10T00:15:06.855 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:06.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01d006bf00 msgr2=0x7f01d006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01d006bf00 0x7f01d006e3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009c50 tx=0x7f01d4009190 comp rx=0 tx=0).stop 2024-06-10T00:15:06.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e415c100 msgr2=0x7f01e41436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e415c100 0x7f01e41436b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f01dc030000 tx=0x7f01dc004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:06.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 shutdown_connections 2024-06-10T00:15:06.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01d006bf00 0x7f01d006e3c0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009c50 tx=0x7f01d4009190 comp rx=0 tx=0).stop 2024-06-10T00:15:06.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01e415c100 0x7f01e41436b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01e4155400 0x7f01e40b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 --2- 172.21.15.79:0/1608311178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e40d1270 0x7f01e4146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.857+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 >> 172.21.15.79:0/1608311178 conn(0x7f01e406c4d0 msgr2=0x7f01e415eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.858+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 shutdown_connections 2024-06-10T00:15:06.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.859+0000 7f01ea4ca640 1 -- 172.21.15.79:0/1608311178 wait complete. 2024-06-10T00:15:06.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.862+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff754005580 con 0x7ff76c00ab40 2024-06-10T00:15:06.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.862+0000 7ff7717fa640 1 -- 172.21.15.79:0/4209127517 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff77408f030 con 0x7ff76c00ab40 2024-06-10T00:15:06.862 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff75806bf00 msgr2=0x7ff75806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff75806bf00 0x7ff75806e3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff768034000 tx=0x7ff76802e000 comp rx=0 tx=0).stop 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c00ab40 msgr2=0x7ff76c0e4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c00ab40 0x7ff76c0e4330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff774064ec0 tx=0x7ff774074380 comp rx=0 tx=0).stop 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 shutdown_connections 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff75806bf00 0x7ff75806e3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0e1310 0x7ff76c0e1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0516e0 0x7ff76c0e16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 --2- 172.21.15.79:0/4209127517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c00ab40 0x7ff76c0e4330 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.865+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 >> 172.21.15.79:0/4209127517 conn(0x7ff76c056cd0 msgr2=0x7ff76c055db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.866+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 shutdown_connections 2024-06-10T00:15:06.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.866+0000 7ff779f5f640 1 -- 172.21.15.79:0/4209127517 wait complete. 2024-06-10T00:15:06.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-06-10T00:15:06.874 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:06.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-06-10T00:15:06.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.880+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fac5006de70 con 0x7fac500cc810 2024-06-10T00:15:06.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.880+0000 7fac467fc640 1 -- 172.21.15.79:0/3472128119 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac4c05d760 con 0x7fac500cc810 2024-06-10T00:15:06.880 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:06.880 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fac3406be30 msgr2=0x7fac3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fac3406be30 0x7fac3406e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fac40034000 tx=0x7fac4002e000 comp rx=0 tx=0).stop 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac500cc810 msgr2=0x7fac500cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac500cc810 0x7fac500cf740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00e9d0 tx=0x7fac4c00ee90 comp rx=0 tx=0).stop 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 shutdown_connections 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fac3406be30 0x7fac3406e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac50151410 0x7fac5014fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac500cc810 0x7fac500cf740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 --2- 172.21.15.79:0/3472128119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac5006da50 0x7fac5014a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 >> 172.21.15.79:0/3472128119 conn(0x7fac5006b5a0 msgr2=0x7fac50071680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 shutdown_connections 2024-06-10T00:15:06.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.882+0000 7fac56fd6640 1 -- 172.21.15.79:0/3472128119 wait complete. 2024-06-10T00:15:06.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.885+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f84680b1060 con 0x7f846815f460 2024-06-10T00:15:06.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.885+0000 7f8464ff9640 1 -- 172.21.15.79:0/1896063324 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f845c07a1b0 con 0x7f846815f460 2024-06-10T00:15:06.885 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:06.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.887+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f96d40cfd80 con 0x7f96d4156b00 2024-06-10T00:15:06.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.887+0000 7f96bbfff640 1 -- 172.21.15.79:0/904528582 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96cc0591b0 con 0x7f96d4156b00 2024-06-10T00:15:06.887 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:06.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f845406bf30 msgr2=0x7f845406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f845406bf30 0x7f845406e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8458007fd0 tx=0x7f8458007240 comp rx=0 tx=0).stop 2024-06-10T00:15:06.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846815f460 msgr2=0x7f84680b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846815f460 0x7f84680b48a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f845c009720 tx=0x7f845c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 shutdown_connections 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f845406bf30 0x7f845406e3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84680b6ee0 0x7f84680b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846815f460 0x7f84680b48a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 --2- 172.21.15.79:0/1896063324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84680cd6e0 0x7f84680b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.888+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 >> 172.21.15.79:0/1896063324 conn(0x7f84680b37b0 msgr2=0x7f846806fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.889+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 shutdown_connections 2024-06-10T00:15:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.889+0000 7f846d701640 1 -- 172.21.15.79:0/1896063324 wait complete. 2024-06-10T00:15:06.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f96c006be60 msgr2=0x7f96c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f96c006be60 0x7f96c006e320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f96c8000f60 tx=0x7f96c8007d90 comp rx=0 tx=0).stop 2024-06-10T00:15:06.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d4156b00 msgr2=0x7f96d4071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d4156b00 0x7f96d4071b80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00cac0 tx=0x7f96cc00cf80 comp rx=0 tx=0).stop 2024-06-10T00:15:06.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 shutdown_connections 2024-06-10T00:15:06.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f96c006be60 0x7f96c006e320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4eb00d2cf0 con 0x7f4eb00cf920 2024-06-10T00:15:06.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96d4156b00 0x7f96d4071b80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96d4165bf0 0x7f96d4071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 --2- 172.21.15.79:0/904528582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96d40cc680 0x7f96d40ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 >> 172.21.15.79:0/904528582 conn(0x7f96d40b19f0 msgr2=0x7f96d406ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 shutdown_connections 2024-06-10T00:15:06.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.890+0000 7f96d98df640 1 -- 172.21.15.79:0/904528582 wait complete. 2024-06-10T00:15:06.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.891+0000 7f4e9effd640 1 -- 172.21.15.79:0/446233179 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ea00583f0 con 0x7f4eb00cf920 2024-06-10T00:15:06.892 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2024-06-10T00:15:06.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-06-10T00:15:06.895 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:06.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e9006be30 msgr2=0x7f4e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e9006be30 0x7f4e9006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006fd0 tx=0x7f4ea4008040 comp rx=0 tx=0).stop 2024-06-10T00:15:06.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00cf920 msgr2=0x7f4eb0153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00cf920 0x7f4eb0153ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c4a0 tx=0x7f4ea000c960 comp rx=0 tx=0).stop 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 shutdown_connections 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e9006be30 0x7f4e9006e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eb0166b70 0x7f4eb00c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb01625c0 0x7f4eb00c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 --2- 172.21.15.79:0/446233179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00cf920 0x7f4eb0153ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 >> 172.21.15.79:0/446233179 conn(0x7f4eb00d4290 msgr2=0x7f4eb01618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 shutdown_connections 2024-06-10T00:15:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:06.894+0000 7f4eb4f63640 1 -- 172.21.15.79:0/446233179 wait complete. 2024-06-10T00:15:06.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-06-10T00:15:06.903 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:06.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-06-10T00:15:06.906 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:06.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-06-10T00:15:06.908 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:06.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:15:06.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:07.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.048+0000 7fc02508c640 1 Processor -- start 2024-06-10T00:15:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.048+0000 7fc02508c640 1 -- start start 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.048+0000 7fc02508c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0200ae910 0x7fc02006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.048+0000 7fc02508c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200cf360 0x7fc0200acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc02508c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02006d130 con 0x7fc02006ea20 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc02508c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc02006ee90 con 0x7fc0200ae910 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc02508c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc02006d410 con 0x7fc0200cf360 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01e59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc02006ea20 0x7fc0200cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50726/0 (socket says 172.21.15.79:50726) 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01e59c640 1 -- 172.21.15.79:0/390408612 learned_addr learned my addr 172.21.15.79:0/390408612 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01ed9d640 1 --2- 172.21.15.79:0/390408612 >> v2:172.21.15.117:3300/0 conn(0x7fc0200ae910 0x7fc02006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01f59e640 1 --2- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200cf360 0x7fc0200acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01dd9b640 1 -- 172.21.15.79:0/390408612 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2546381422 0 0) 0x7fc02006d130 con 0x7fc02006ea20 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01dd9b640 1 -- 172.21.15.79:0/390408612 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc008003520 con 0x7fc02006ea20 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01ed9d640 1 -- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200cf360 msgr2=0x7fc0200acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01ed9d640 1 --2- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200cf360 0x7fc0200acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01ed9d640 1 -- 172.21.15.79:0/390408612 >> v1:172.21.15.79:6789/0 conn(0x7fc02006ea20 legacy=0x7fc0200cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01dd9b640 1 -- 172.21.15.79:0/390408612 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4231562702 0 0) 0x7fc008003520 con 0x7fc02006ea20 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01ed9d640 1 -- 172.21.15.79:0/390408612 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02006d6f0 con 0x7fc0200ae910 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.049+0000 7fc01f59e640 1 --2- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200cf360 0x7fc0200acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.050+0000 7fc01ed9d640 1 --2- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 0x7fc02006e4e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc0100097a0 tx=0x7fc01002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f11e89b85351024c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.050+0000 7fc01dd9b640 1 -- 172.21.15.79:0/390408612 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc010037070 con 0x7fc0200ae910 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.050+0000 7fc01dd9b640 1 -- 172.21.15.79:0/390408612 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01002ab10 con 0x7fc0200ae910 2024-06-10T00:15:07.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.050+0000 7fc01dd9b640 1 -- 172.21.15.79:0/390408612 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014001670 con 0x7fc0200ae910 2024-06-10T00:15:07.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.051+0000 7fc02508c640 1 -- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 msgr2=0x7fc02006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.051+0000 7fc02508c640 1 --2- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 0x7fc02006e4e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc0100097a0 tx=0x7fc01002a080 comp rx=0 tx=0).stop 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.051+0000 7fc02508c640 1 -- 172.21.15.79:0/390408612 shutdown_connections 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.051+0000 7fc02508c640 1 --2- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200cf360 0x7fc0200acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.051+0000 7fc02508c640 1 --2- 172.21.15.79:0/390408612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 0x7fc02006e4e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.051+0000 7fc02508c640 1 -- 172.21.15.79:0/390408612 >> 172.21.15.79:0/390408612 conn(0x7fc0200b19f0 msgr2=0x7fc0200b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.051+0000 7fc02508c640 1 -- 172.21.15.79:0/390408612 shutdown_connections 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.051+0000 7fc02508c640 1 -- 172.21.15.79:0/390408612 wait complete. 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.052+0000 7fc02508c640 1 Processor -- start 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.052+0000 7fc02508c640 1 -- start start 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc02508c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc02006ea20 0x7fc020159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc02508c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 0x7fc0201f1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc02508c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200cf360 0x7fc0200c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc02508c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200ad280 con 0x7fc0200cf360 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc02508c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200aecf0 con 0x7fc0200ae910 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc02508c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0200ad400 con 0x7fc02006ea20 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200cf360 0x7fc0200c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200cf360 0x7fc0200c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36926/0 (socket says 172.21.15.79:36926) 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01f59e640 1 -- 172.21.15.79:0/1126019700 learned_addr learned my addr 172.21.15.79:0/1126019700 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01ed9d640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc02006ea20 0x7fc020159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01e59c640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 0x7fc0201f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01f59e640 1 -- 172.21.15.79:0/1126019700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc02006ea20 msgr2=0x7fc020159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01f59e640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc02006ea20 0x7fc020159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01f59e640 1 -- 172.21.15.79:0/1126019700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 msgr2=0x7fc0201f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01f59e640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 0x7fc0201f1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.053+0000 7fc01f59e640 1 -- 172.21.15.79:0/1126019700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0200c5920 con 0x7fc0200cf360 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.054+0000 7fc01f59e640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200cf360 0x7fc0200c75b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc01800efc0 tx=0x7fc018009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.054+0000 7fc0077fe640 1 -- 172.21.15.79:0/1126019700 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018018030 con 0x7fc0200cf360 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.054+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0200c5c00 con 0x7fc0200cf360 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.054+0000 7fc0077fe640 1 -- 172.21.15.79:0/1126019700 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01800cde0 con 0x7fc0200cf360 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.054+0000 7fc0077fe640 1 -- 172.21.15.79:0/1126019700 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018003bb0 con 0x7fc0200cf360 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.054+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0200c61c0 con 0x7fc0200cf360 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.055+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc020068430 con 0x7fc0200cf360 2024-06-10T00:15:07.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.055+0000 7fc0077fe640 1 -- 172.21.15.79:0/1126019700 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc01801b070 con 0x7fc0200cf360 2024-06-10T00:15:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.055+0000 7fc0077fe640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc00c06be30 0x7fc00c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.056+0000 7fc0077fe640 1 -- 172.21.15.79:0/1126019700 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc01808bc50 con 0x7fc0200cf360 2024-06-10T00:15:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.056+0000 7fc01ed9d640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc00c06be30 0x7fc00c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.056+0000 7fc01ed9d640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc00c06be30 0x7fc00c06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc010034000 tx=0x7fc01002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.060+0000 7fc0077fe640 1 -- 172.21.15.79:0/1126019700 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc018091020 con 0x7fc0200cf360 2024-06-10T00:15:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.235+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0201f17d0 con 0x7fc00c06be30 2024-06-10T00:15:07.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.242+0000 7fc0077fe640 1 -- 172.21.15.79:0/1126019700 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fc010032440 con 0x7fc00c06be30 2024-06-10T00:15:07.246 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc00c06be30 msgr2=0x7fc00c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc00c06be30 0x7fc00c06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc010034000 tx=0x7fc01002e000 comp rx=0 tx=0).stop 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200cf360 msgr2=0x7fc0200c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200cf360 0x7fc0200c75b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc01800efc0 tx=0x7fc018009f90 comp rx=0 tx=0).stop 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 shutdown_connections 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc00c06be30 0x7fc00c06e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200cf360 0x7fc0200c75b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200ae910 0x7fc0201f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 --2- 172.21.15.79:0/1126019700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc02006ea20 0x7fc020159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 >> 172.21.15.79:0/1126019700 conn(0x7fc0200b19f0 msgr2=0x7fc02015a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 shutdown_connections 2024-06-10T00:15:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.246+0000 7fc02508c640 1 -- 172.21.15.79:0/1126019700 wait complete. 2024-06-10T00:15:07.257 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-06-10T00:15:07.152364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003182"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035823+0000","last_change":"2024-06-10T00:14:41.867016+0000","last_active":"2024-06-10T00:14:48.035823+0000","last_peered":"2024-06-10T00:14:48.035823+0000","last_clean":"2024-06-10T00:14:48.035823+0000","last_became_active":"2024-06-10T00:14:41.866719+0000","last_became_peered":"2024-06-10T00:14:41.866719+0000","last_unstale":"2024-06-10T00:14:48.035823+0000","last_undegraded":"2024-06-10T00:14:48.035823+0000","last_fullsized":"2024-06-10T00:14:48.035823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:24:00.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017302+0000","last_change":"2024-06-10T00:14:42.878734+0000","last_active":"2024-06-10T00:14:48.017302+0000","last_peered":"2024-06-10T00:14:48.017302+0000","last_clean":"2024-06-10T00:14:48.017302+0000","last_became_active":"2024-06-10T00:14:42.878470+0000","last_became_peered":"2024-06-10T00:14:42.878470+0000","last_unstale":"2024-06-10T00:14:48.017302+0000","last_undegraded":"2024-06-10T00:14:48.017302+0000","last_fullsized":"2024-06-10T00:14:48.017302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016668+0000","last_change":"2024-06-10T00:14:46.991114+0000","last_active":"2024-06-10T00:14:48.016668+0000","last_peered":"2024-06-10T00:14:48.016668+0000","last_clean":"2024-06-10T00:14:48.016668+0000","last_became_active":"2024-06-10T00:14:46.990705+0000","last_became_peered":"2024-06-10T00:14:46.990705+0000","last_unstale":"2024-06-10T00:14:48.016668+0000","last_undegraded":"2024-06-10T00:14:48.016668+0000","last_fullsized":"2024-06-10T00:14:48.016668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:53:49.602835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017392+0000","last_change":"2024-06-10T00:14:41.862823+0000","last_active":"2024-06-10T00:14:48.017392+0000","last_peered":"2024-06-10T00:14:48.017392+0000","last_clean":"2024-06-10T00:14:48.017392+0000","last_became_active":"2024-06-10T00:14:41.862550+0000","last_became_peered":"2024-06-10T00:14:41.862550+0000","last_unstale":"2024-06-10T00:14:48.017392+0000","last_undegraded":"2024-06-10T00:14:48.017392+0000","last_fullsized":"2024-06-10T00:14:48.017392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:32:16.264432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035521+0000","last_change":"2024-06-10T00:14:42.869043+0000","last_active":"2024-06-10T00:14:48.035521+0000","last_peered":"2024-06-10T00:14:48.035521+0000","last_clean":"2024-06-10T00:14:48.035521+0000","last_became_active":"2024-06-10T00:14:42.868643+0000","last_became_peered":"2024-06-10T00:14:42.868643+0000","last_unstale":"2024-06-10T00:14:48.035521+0000","last_undegraded":"2024-06-10T00:14:48.035521+0000","last_fullsized":"2024-06-10T00:14:48.035521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897961+0000","last_change":"2024-06-10T00:14:46.888840+0000","last_active":"2024-06-10T00:14:47.897961+0000","last_peered":"2024-06-10T00:14:47.897961+0000","last_clean":"2024-06-10T00:14:47.897961+0000","last_became_active":"2024-06-10T00:14:46.888089+0000","last_became_peered":"2024-06-10T00:14:46.888089+0000","last_unstale":"2024-06-10T00:14:47.897961+0000","last_undegraded":"2024-06-10T00:14:47.897961+0000","last_fullsized":"2024-06-10T00:14:47.897961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:51.568143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035749+0000","last_change":"2024-06-10T00:14:41.865458+0000","last_active":"2024-06-10T00:14:48.035749+0000","last_peered":"2024-06-10T00:14:48.035749+0000","last_clean":"2024-06-10T00:14:48.035749+0000","last_became_active":"2024-06-10T00:14:41.865040+0000","last_became_peered":"2024-06-10T00:14:41.865040+0000","last_unstale":"2024-06-10T00:14:48.035749+0000","last_undegraded":"2024-06-10T00:14:48.035749+0000","last_fullsized":"2024-06-10T00:14:48.035749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:04.344977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898593+0000","last_change":"2024-06-10T00:14:42.859102+0000","last_active":"2024-06-10T00:14:47.898593+0000","last_peered":"2024-06-10T00:14:47.898593+0000","last_clean":"2024-06-10T00:14:47.898593+0000","last_became_active":"2024-06-10T00:14:42.858811+0000","last_became_peered":"2024-06-10T00:14:42.858811+0000","last_unstale":"2024-06-10T00:14:47.898593+0000","last_undegraded":"2024-06-10T00:14:47.898593+0000","last_fullsized":"2024-06-10T00:14:47.898593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:04.905009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898969+0000","last_change":"2024-06-10T00:14:46.889397+0000","last_active":"2024-06-10T00:14:47.898969+0000","last_peered":"2024-06-10T00:14:47.898969+0000","last_clean":"2024-06-10T00:14:47.898969+0000","last_became_active":"2024-06-10T00:14:46.888054+0000","last_became_peered":"2024-06-10T00:14:46.888054+0000","last_unstale":"2024-06-10T00:14:47.898969+0000","last_undegraded":"2024-06-10T00:14:47.898969+0000","last_fullsized":"2024-06-10T00:14:47.898969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:30.058992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035367+0000","last_change":"2024-06-10T00:14:41.866377+0000","last_active":"2024-06-10T00:14:48.035367+0000","last_peered":"2024-06-10T00:14:48.035367+0000","last_clean":"2024-06-10T00:14:48.035367+0000","last_became_active":"2024-06-10T00:14:41.865036+0000","last_became_peered":"2024-06-10T00:14:41.865036+0000","last_unstale":"2024-06-10T00:14:48.035367+0000","last_undegraded":"2024-06-10T00:14:48.035367+0000","last_fullsized":"2024-06-10T00:14:48.035367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899160+0000","last_change":"2024-06-10T00:14:42.860024+0000","last_active":"2024-06-10T00:14:47.899160+0000","last_peered":"2024-06-10T00:14:47.899160+0000","last_clean":"2024-06-10T00:14:47.899160+0000","last_became_active":"2024-06-10T00:14:42.859406+0000","last_became_peered":"2024-06-10T00:14:42.859406+0000","last_unstale":"2024-06-10T00:14:47.899160+0000","last_undegraded":"2024-06-10T00:14:47.899160+0000","last_fullsized":"2024-06-10T00:14:47.899160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:11.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898485+0000","last_change":"2024-06-10T00:14:46.886019+0000","last_active":"2024-06-10T00:14:47.898485+0000","last_peered":"2024-06-10T00:14:47.898485+0000","last_clean":"2024-06-10T00:14:47.898485+0000","last_became_active":"2024-06-10T00:14:46.885548+0000","last_became_peered":"2024-06-10T00:14:46.885548+0000","last_unstale":"2024-06-10T00:14:47.898485+0000","last_undegraded":"2024-06-10T00:14:47.898485+0000","last_fullsized":"2024-06-10T00:14:47.898485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:13.328779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035910+0000","last_change":"2024-06-10T00:14:42.874737+0000","last_active":"2024-06-10T00:14:48.035910+0000","last_peered":"2024-06-10T00:14:48.035910+0000","last_clean":"2024-06-10T00:14:48.035910+0000","last_became_active":"2024-06-10T00:14:42.874456+0000","last_became_peered":"2024-06-10T00:14:42.874456+0000","last_unstale":"2024-06-10T00:14:48.035910+0000","last_undegraded":"2024-06-10T00:14:48.035910+0000","last_fullsized":"2024-06-10T00:14:48.035910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035758+0000","last_change":"2024-06-10T00:14:41.867017+0000","last_active":"2024-06-10T00:14:48.035758+0000","last_peered":"2024-06-10T00:14:48.035758+0000","last_clean":"2024-06-10T00:14:48.035758+0000","last_became_active":"2024-06-10T00:14:41.866615+0000","last_became_peered":"2024-06-10T00:14:41.866615+0000","last_unstale":"2024-06-10T00:14:48.035758+0000","last_undegraded":"2024-06-10T00:14:48.035758+0000","last_fullsized":"2024-06-10T00:14:48.035758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899866+0000","last_change":"2024-06-10T00:14:46.887357+0000","last_active":"2024-06-10T00:14:47.899866+0000","last_peered":"2024-06-10T00:14:47.899866+0000","last_clean":"2024-06-10T00:14:47.899866+0000","last_became_active":"2024-06-10T00:14:46.886828+0000","last_became_peered":"2024-06-10T00:14:46.886828+0000","last_unstale":"2024-06-10T00:14:47.899866+0000","last_undegraded":"2024-06-10T00:14:47.899866+0000","last_fullsized":"2024-06-10T00:14:47.899866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016853+0000","last_change":"2024-06-10T00:14:42.874437+0000","last_active":"2024-06-10T00:14:48.016853+0000","last_peered":"2024-06-10T00:14:48.016853+0000","last_clean":"2024-06-10T00:14:48.016853+0000","last_became_active":"2024-06-10T00:14:42.871485+0000","last_became_peered":"2024-06-10T00:14:42.871485+0000","last_unstale":"2024-06-10T00:14:48.016853+0000","last_undegraded":"2024-06-10T00:14:48.016853+0000","last_fullsized":"2024-06-10T00:14:48.016853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036080+0000","last_change":"2024-06-10T00:14:41.860772+0000","last_active":"2024-06-10T00:14:48.036080+0000","last_peered":"2024-06-10T00:14:48.036080+0000","last_clean":"2024-06-10T00:14:48.036080+0000","last_became_active":"2024-06-10T00:14:41.860372+0000","last_became_peered":"2024-06-10T00:14:41.860372+0000","last_unstale":"2024-06-10T00:14:48.036080+0000","last_undegraded":"2024-06-10T00:14:48.036080+0000","last_fullsized":"2024-06-10T00:14:48.036080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898238+0000","last_change":"2024-06-10T00:14:46.888544+0000","last_active":"2024-06-10T00:14:47.898238+0000","last_peered":"2024-06-10T00:14:47.898238+0000","last_clean":"2024-06-10T00:14:47.898238+0000","last_became_active":"2024-06-10T00:14:46.887972+0000","last_became_peered":"2024-06-10T00:14:46.887972+0000","last_unstale":"2024-06-10T00:14:47.898238+0000","last_undegraded":"2024-06-10T00:14:47.898238+0000","last_fullsized":"2024-06-10T00:14:47.898238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:46.828253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016970+0000","last_change":"2024-06-10T00:14:42.871661+0000","last_active":"2024-06-10T00:14:48.016970+0000","last_peered":"2024-06-10T00:14:48.016970+0000","last_clean":"2024-06-10T00:14:48.016970+0000","last_became_active":"2024-06-10T00:14:42.870944+0000","last_became_peered":"2024-06-10T00:14:42.870944+0000","last_unstale":"2024-06-10T00:14:48.016970+0000","last_undegraded":"2024-06-10T00:14:48.016970+0000","last_fullsized":"2024-06-10T00:14:48.016970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035625+0000","last_change":"2024-06-10T00:14:41.863225+0000","last_active":"2024-06-10T00:14:48.035625+0000","last_peered":"2024-06-10T00:14:48.035625+0000","last_clean":"2024-06-10T00:14:48.035625+0000","last_became_active":"2024-06-10T00:14:41.862940+0000","last_became_peered":"2024-06-10T00:14:41.862940+0000","last_unstale":"2024-06-10T00:14:48.035625+0000","last_undegraded":"2024-06-10T00:14:48.035625+0000","last_fullsized":"2024-06-10T00:14:48.035625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036483+0000","last_change":"2024-06-10T00:14:46.990813+0000","last_active":"2024-06-10T00:14:48.036483+0000","last_peered":"2024-06-10T00:14:48.036483+0000","last_clean":"2024-06-10T00:14:48.036483+0000","last_became_active":"2024-06-10T00:14:46.990054+0000","last_became_peered":"2024-06-10T00:14:46.990054+0000","last_unstale":"2024-06-10T00:14:48.036483+0000","last_undegraded":"2024-06-10T00:14:48.036483+0000","last_fullsized":"2024-06-10T00:14:48.036483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:27.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898430+0000","last_change":"2024-06-10T00:14:42.864896+0000","last_active":"2024-06-10T00:14:47.898430+0000","last_peered":"2024-06-10T00:14:47.898430+0000","last_clean":"2024-06-10T00:14:47.898430+0000","last_became_active":"2024-06-10T00:14:42.864638+0000","last_became_peered":"2024-06-10T00:14:42.864638+0000","last_unstale":"2024-06-10T00:14:47.898430+0000","last_undegraded":"2024-06-10T00:14:47.898430+0000","last_fullsized":"2024-06-10T00:14:47.898430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:47.083423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035079+0000","last_change":"2024-06-10T00:14:41.866168+0000","last_active":"2024-06-10T00:14:48.035079+0000","last_peered":"2024-06-10T00:14:48.035079+0000","last_clean":"2024-06-10T00:14:48.035079+0000","last_became_active":"2024-06-10T00:14:41.865791+0000","last_became_peered":"2024-06-10T00:14:41.865791+0000","last_unstale":"2024-06-10T00:14:48.035079+0000","last_undegraded":"2024-06-10T00:14:48.035079+0000","last_fullsized":"2024-06-10T00:14:48.035079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:43.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899774+0000","last_change":"2024-06-10T00:14:46.886506+0000","last_active":"2024-06-10T00:14:47.899774+0000","last_peered":"2024-06-10T00:14:47.899774+0000","last_clean":"2024-06-10T00:14:47.899774+0000","last_became_active":"2024-06-10T00:14:46.885716+0000","last_became_peered":"2024-06-10T00:14:46.885716+0000","last_unstale":"2024-06-10T00:14:47.899774+0000","last_undegraded":"2024-06-10T00:14:47.899774+0000","last_fullsized":"2024-06-10T00:14:47.899774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:05.738780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035971+0000","last_change":"2024-06-10T00:14:42.863988+0000","last_active":"2024-06-10T00:14:48.035971+0000","last_peered":"2024-06-10T00:14:48.035971+0000","last_clean":"2024-06-10T00:14:48.035971+0000","last_became_active":"2024-06-10T00:14:42.863676+0000","last_became_peered":"2024-06-10T00:14:42.863676+0000","last_unstale":"2024-06-10T00:14:48.035971+0000","last_undegraded":"2024-06-10T00:14:48.035971+0000","last_fullsized":"2024-06-10T00:14:48.035971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036781+0000","last_change":"2024-06-10T00:14:41.868147+0000","last_active":"2024-06-10T00:14:48.036781+0000","last_peered":"2024-06-10T00:14:48.036781+0000","last_clean":"2024-06-10T00:14:48.036781+0000","last_became_active":"2024-06-10T00:14:41.867865+0000","last_became_peered":"2024-06-10T00:14:41.867865+0000","last_unstale":"2024-06-10T00:14:48.036781+0000","last_undegraded":"2024-06-10T00:14:48.036781+0000","last_fullsized":"2024-06-10T00:14:48.036781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898144+0000","last_change":"2024-06-10T00:14:46.988256+0000","last_active":"2024-06-10T00:14:47.898144+0000","last_peered":"2024-06-10T00:14:47.898144+0000","last_clean":"2024-06-10T00:14:47.898144+0000","last_became_active":"2024-06-10T00:14:46.987870+0000","last_became_peered":"2024-06-10T00:14:46.987870+0000","last_unstale":"2024-06-10T00:14:47.898144+0000","last_undegraded":"2024-06-10T00:14:47.898144+0000","last_fullsized":"2024-06-10T00:14:47.898144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:15.305106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017506+0000","last_change":"2024-06-10T00:14:42.867973+0000","last_active":"2024-06-10T00:14:48.017506+0000","last_peered":"2024-06-10T00:14:48.017506+0000","last_clean":"2024-06-10T00:14:48.017506+0000","last_became_active":"2024-06-10T00:14:42.867690+0000","last_became_peered":"2024-06-10T00:14:42.867690+0000","last_unstale":"2024-06-10T00:14:48.017506+0000","last_undegraded":"2024-06-10T00:14:48.017506+0000","last_fullsized":"2024-06-10T00:14:48.017506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036284+0000","last_change":"2024-06-10T00:14:41.868966+0000","last_active":"2024-06-10T00:14:48.036284+0000","last_peered":"2024-06-10T00:14:48.036284+0000","last_clean":"2024-06-10T00:14:48.036284+0000","last_became_active":"2024-06-10T00:14:41.868645+0000","last_became_peered":"2024-06-10T00:14:41.868645+0000","last_unstale":"2024-06-10T00:14:48.036284+0000","last_undegraded":"2024-06-10T00:14:48.036284+0000","last_fullsized":"2024-06-10T00:14:48.036284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016612+0000","last_change":"2024-06-10T00:14:46.990437+0000","last_active":"2024-06-10T00:14:48.016612+0000","last_peered":"2024-06-10T00:14:48.016612+0000","last_clean":"2024-06-10T00:14:48.016612+0000","last_became_active":"2024-06-10T00:14:46.990040+0000","last_became_peered":"2024-06-10T00:14:46.990040+0000","last_unstale":"2024-06-10T00:14:48.016612+0000","last_undegraded":"2024-06-10T00:14:48.016612+0000","last_fullsized":"2024-06-10T00:14:48.016612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:56:13.445267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036047+0000","last_change":"2024-06-10T00:14:42.859747+0000","last_active":"2024-06-10T00:14:48.036047+0000","last_peered":"2024-06-10T00:14:48.036047+0000","last_clean":"2024-06-10T00:14:48.036047+0000","last_became_active":"2024-06-10T00:14:42.859406+0000","last_became_peered":"2024-06-10T00:14:42.859406+0000","last_unstale":"2024-06-10T00:14:48.036047+0000","last_undegraded":"2024-06-10T00:14:48.036047+0000","last_fullsized":"2024-06-10T00:14:48.036047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035847+0000","last_change":"2024-06-10T00:14:41.868654+0000","last_active":"2024-06-10T00:14:48.035847+0000","last_peered":"2024-06-10T00:14:48.035847+0000","last_clean":"2024-06-10T00:14:48.035847+0000","last_became_active":"2024-06-10T00:14:41.868347+0000","last_became_peered":"2024-06-10T00:14:41.868347+0000","last_unstale":"2024-06-10T00:14:48.035847+0000","last_undegraded":"2024-06-10T00:14:48.035847+0000","last_fullsized":"2024-06-10T00:14:48.035847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:35:23.234029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035282+0000","last_change":"2024-06-10T00:14:46.988194+0000","last_active":"2024-06-10T00:14:48.035282+0000","last_peered":"2024-06-10T00:14:48.035282+0000","last_clean":"2024-06-10T00:14:48.035282+0000","last_became_active":"2024-06-10T00:14:46.987822+0000","last_became_peered":"2024-06-10T00:14:46.987822+0000","last_unstale":"2024-06-10T00:14:48.035282+0000","last_undegraded":"2024-06-10T00:14:48.035282+0000","last_fullsized":"2024-06-10T00:14:48.035282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899279+0000","last_change":"2024-06-10T00:14:42.866515+0000","last_active":"2024-06-10T00:14:47.899279+0000","last_peered":"2024-06-10T00:14:47.899279+0000","last_clean":"2024-06-10T00:14:47.899279+0000","last_became_active":"2024-06-10T00:14:42.866202+0000","last_became_peered":"2024-06-10T00:14:42.866202+0000","last_unstale":"2024-06-10T00:14:47.899279+0000","last_undegraded":"2024-06-10T00:14:47.899279+0000","last_fullsized":"2024-06-10T00:14:47.899279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036142+0000","last_change":"2024-06-10T00:14:41.862650+0000","last_active":"2024-06-10T00:14:48.036142+0000","last_peered":"2024-06-10T00:14:48.036142+0000","last_clean":"2024-06-10T00:14:48.036142+0000","last_became_active":"2024-06-10T00:14:41.862386+0000","last_became_peered":"2024-06-10T00:14:41.862386+0000","last_unstale":"2024-06-10T00:14:48.036142+0000","last_undegraded":"2024-06-10T00:14:48.036142+0000","last_fullsized":"2024-06-10T00:14:48.036142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035886+0000","last_change":"2024-06-10T00:14:46.894074+0000","last_active":"2024-06-10T00:14:48.035886+0000","last_peered":"2024-06-10T00:14:48.035886+0000","last_clean":"2024-06-10T00:14:48.035886+0000","last_became_active":"2024-06-10T00:14:46.893369+0000","last_became_peered":"2024-06-10T00:14:46.893369+0000","last_unstale":"2024-06-10T00:14:48.035886+0000","last_undegraded":"2024-06-10T00:14:48.035886+0000","last_fullsized":"2024-06-10T00:14:48.035886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899512+0000","last_change":"2024-06-10T00:14:42.866544+0000","last_active":"2024-06-10T00:14:47.899512+0000","last_peered":"2024-06-10T00:14:47.899512+0000","last_clean":"2024-06-10T00:14:47.899512+0000","last_became_active":"2024-06-10T00:14:42.865366+0000","last_became_peered":"2024-06-10T00:14:42.865366+0000","last_unstale":"2024-06-10T00:14:47.899512+0000","last_undegraded":"2024-06-10T00:14:47.899512+0000","last_fullsized":"2024-06-10T00:14:47.899512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:23.595724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899407+0000","last_change":"2024-06-10T00:14:41.861648+0000","last_active":"2024-06-10T00:14:47.899407+0000","last_peered":"2024-06-10T00:14:47.899407+0000","last_clean":"2024-06-10T00:14:47.899407+0000","last_became_active":"2024-06-10T00:14:41.861363+0000","last_became_peered":"2024-06-10T00:14:41.861363+0000","last_unstale":"2024-06-10T00:14:47.899407+0000","last_undegraded":"2024-06-10T00:14:47.899407+0000","last_fullsized":"2024-06-10T00:14:47.899407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036077+0000","last_change":"2024-06-10T00:14:46.886310+0000","last_active":"2024-06-10T00:14:48.036077+0000","last_peered":"2024-06-10T00:14:48.036077+0000","last_clean":"2024-06-10T00:14:48.036077+0000","last_became_active":"2024-06-10T00:14:46.885934+0000","last_became_peered":"2024-06-10T00:14:46.885934+0000","last_unstale":"2024-06-10T00:14:48.036077+0000","last_undegraded":"2024-06-10T00:14:48.036077+0000","last_fullsized":"2024-06-10T00:14:48.036077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:08.929668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035314+0000","last_change":"2024-06-10T00:14:42.860757+0000","last_active":"2024-06-10T00:14:48.035314+0000","last_peered":"2024-06-10T00:14:48.035314+0000","last_clean":"2024-06-10T00:14:48.035314+0000","last_became_active":"2024-06-10T00:14:42.860420+0000","last_became_peered":"2024-06-10T00:14:42.860420+0000","last_unstale":"2024-06-10T00:14:48.035314+0000","last_undegraded":"2024-06-10T00:14:48.035314+0000","last_fullsized":"2024-06-10T00:14:48.035314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897376+0000","last_change":"2024-06-10T00:14:41.858056+0000","last_active":"2024-06-10T00:14:47.897376+0000","last_peered":"2024-06-10T00:14:47.897376+0000","last_clean":"2024-06-10T00:14:47.897376+0000","last_became_active":"2024-06-10T00:14:41.857761+0000","last_became_peered":"2024-06-10T00:14:41.857761+0000","last_unstale":"2024-06-10T00:14:47.897376+0000","last_undegraded":"2024-06-10T00:14:47.897376+0000","last_fullsized":"2024-06-10T00:14:47.897376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036543+0000","last_change":"2024-06-10T00:14:46.894221+0000","last_active":"2024-06-10T00:14:48.036543+0000","last_peered":"2024-06-10T00:14:48.036543+0000","last_clean":"2024-06-10T00:14:48.036543+0000","last_became_active":"2024-06-10T00:14:46.893698+0000","last_became_peered":"2024-06-10T00:14:46.893698+0000","last_unstale":"2024-06-10T00:14:48.036543+0000","last_undegraded":"2024-06-10T00:14:48.036543+0000","last_fullsized":"2024-06-10T00:14:48.036543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:36.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.034921+0000","last_change":"2024-06-10T00:14:42.873418+0000","last_active":"2024-06-10T00:14:48.034921+0000","last_peered":"2024-06-10T00:14:48.034921+0000","last_clean":"2024-06-10T00:14:48.034921+0000","last_became_active":"2024-06-10T00:14:42.872202+0000","last_became_peered":"2024-06-10T00:14:42.872202+0000","last_unstale":"2024-06-10T00:14:48.034921+0000","last_undegraded":"2024-06-10T00:14:48.034921+0000","last_fullsized":"2024-06-10T00:14:48.034921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035121+0000","last_change":"2024-06-10T00:14:41.863805+0000","last_active":"2024-06-10T00:14:48.035121+0000","last_peered":"2024-06-10T00:14:48.035121+0000","last_clean":"2024-06-10T00:14:48.035121+0000","last_became_active":"2024-06-10T00:14:41.863518+0000","last_became_peered":"2024-06-10T00:14:41.863518+0000","last_unstale":"2024-06-10T00:14:48.035121+0000","last_undegraded":"2024-06-10T00:14:48.035121+0000","last_fullsized":"2024-06-10T00:14:48.035121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:38:57.655573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035793+0000","last_change":"2024-06-10T00:14:46.988209+0000","last_active":"2024-06-10T00:14:48.035793+0000","last_peered":"2024-06-10T00:14:48.035793+0000","last_clean":"2024-06-10T00:14:48.035793+0000","last_became_active":"2024-06-10T00:14:46.987834+0000","last_became_peered":"2024-06-10T00:14:46.987834+0000","last_unstale":"2024-06-10T00:14:48.035793+0000","last_undegraded":"2024-06-10T00:14:48.035793+0000","last_fullsized":"2024-06-10T00:14:48.035793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:36.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016903+0000","last_change":"2024-06-10T00:14:42.867535+0000","last_active":"2024-06-10T00:14:48.016903+0000","last_peered":"2024-06-10T00:14:48.016903+0000","last_clean":"2024-06-10T00:14:48.016903+0000","last_became_active":"2024-06-10T00:14:42.867224+0000","last_became_peered":"2024-06-10T00:14:42.867224+0000","last_unstale":"2024-06-10T00:14:48.016903+0000","last_undegraded":"2024-06-10T00:14:48.016903+0000","last_fullsized":"2024-06-10T00:14:48.016903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899686+0000","last_change":"2024-06-10T00:14:41.858886+0000","last_active":"2024-06-10T00:14:47.899686+0000","last_peered":"2024-06-10T00:14:47.899686+0000","last_clean":"2024-06-10T00:14:47.899686+0000","last_became_active":"2024-06-10T00:14:41.858568+0000","last_became_peered":"2024-06-10T00:14:41.858568+0000","last_unstale":"2024-06-10T00:14:47.899686+0000","last_undegraded":"2024-06-10T00:14:47.899686+0000","last_fullsized":"2024-06-10T00:14:47.899686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035569+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:14:48.035569+0000","last_peered":"2024-06-10T00:14:48.035569+0000","last_clean":"2024-06-10T00:14:48.035569+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:14:48.035569+0000","last_undegraded":"2024-06-10T00:14:48.035569+0000","last_fullsized":"2024-06-10T00:14:48.035569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036528+0000","last_change":"2024-06-10T00:14:46.989884+0000","last_active":"2024-06-10T00:14:48.036528+0000","last_peered":"2024-06-10T00:14:48.036528+0000","last_clean":"2024-06-10T00:14:48.036528+0000","last_became_active":"2024-06-10T00:14:46.988326+0000","last_became_peered":"2024-06-10T00:14:46.988326+0000","last_unstale":"2024-06-10T00:14:48.036528+0000","last_undegraded":"2024-06-10T00:14:48.036528+0000","last_fullsized":"2024-06-10T00:14:48.036528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:05.738780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035660+0000","last_change":"2024-06-10T00:14:42.875447+0000","last_active":"2024-06-10T00:14:48.035660+0000","last_peered":"2024-06-10T00:14:48.035660+0000","last_clean":"2024-06-10T00:14:48.035660+0000","last_became_active":"2024-06-10T00:14:42.875163+0000","last_became_peered":"2024-06-10T00:14:42.875163+0000","last_unstale":"2024-06-10T00:14:48.035660+0000","last_undegraded":"2024-06-10T00:14:48.035660+0000","last_fullsized":"2024-06-10T00:14:48.035660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:43.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897639+0000","last_change":"2024-06-10T00:14:41.859030+0000","last_active":"2024-06-10T00:14:47.897639+0000","last_peered":"2024-06-10T00:14:47.897639+0000","last_clean":"2024-06-10T00:14:47.897639+0000","last_became_active":"2024-06-10T00:14:41.858721+0000","last_became_peered":"2024-06-10T00:14:41.858721+0000","last_unstale":"2024-06-10T00:14:47.897639+0000","last_undegraded":"2024-06-10T00:14:47.897639+0000","last_fullsized":"2024-06-10T00:14:47.897639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035781+0000","last_change":"2024-06-10T00:14:46.989519+0000","last_active":"2024-06-10T00:14:48.035781+0000","last_peered":"2024-06-10T00:14:48.035781+0000","last_clean":"2024-06-10T00:14:48.035781+0000","last_became_active":"2024-06-10T00:14:46.988160+0000","last_became_peered":"2024-06-10T00:14:46.988160+0000","last_unstale":"2024-06-10T00:14:48.035781+0000","last_undegraded":"2024-06-10T00:14:48.035781+0000","last_fullsized":"2024-06-10T00:14:48.035781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:37.577252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898697+0000","last_change":"2024-06-10T00:14:42.873285+0000","last_active":"2024-06-10T00:14:47.898697+0000","last_peered":"2024-06-10T00:14:47.898697+0000","last_clean":"2024-06-10T00:14:47.898697+0000","last_became_active":"2024-06-10T00:14:42.872722+0000","last_became_peered":"2024-06-10T00:14:42.872722+0000","last_unstale":"2024-06-10T00:14:47.898697+0000","last_undegraded":"2024-06-10T00:14:47.898697+0000","last_fullsized":"2024-06-10T00:14:47.898697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:23.901714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036246+0000","last_change":"2024-06-10T00:14:41.859803+0000","last_active":"2024-06-10T00:14:48.036246+0000","last_peered":"2024-06-10T00:14:48.036246+0000","last_clean":"2024-06-10T00:14:48.036246+0000","last_became_active":"2024-06-10T00:14:41.859233+0000","last_became_peered":"2024-06-10T00:14:41.859233+0000","last_unstale":"2024-06-10T00:14:48.036246+0000","last_undegraded":"2024-06-10T00:14:48.036246+0000","last_fullsized":"2024-06-10T00:14:48.036246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:04.344977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035388+0000","last_change":"2024-06-10T00:14:46.892114+0000","last_active":"2024-06-10T00:14:48.035388+0000","last_peered":"2024-06-10T00:14:48.035388+0000","last_clean":"2024-06-10T00:14:48.035388+0000","last_became_active":"2024-06-10T00:14:46.891627+0000","last_became_peered":"2024-06-10T00:14:46.891627+0000","last_unstale":"2024-06-10T00:14:48.035388+0000","last_undegraded":"2024-06-10T00:14:48.035388+0000","last_fullsized":"2024-06-10T00:14:48.035388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:16.762113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036057+0000","last_change":"2024-06-10T00:14:42.880436+0000","last_active":"2024-06-10T00:14:48.036057+0000","last_peered":"2024-06-10T00:14:48.036057+0000","last_clean":"2024-06-10T00:14:48.036057+0000","last_became_active":"2024-06-10T00:14:42.880194+0000","last_became_peered":"2024-06-10T00:14:42.880194+0000","last_unstale":"2024-06-10T00:14:48.036057+0000","last_undegraded":"2024-06-10T00:14:48.036057+0000","last_fullsized":"2024-06-10T00:14:48.036057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:54:40.334756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897719+0000","last_change":"2024-06-10T00:14:41.857224+0000","last_active":"2024-06-10T00:14:47.897719+0000","last_peered":"2024-06-10T00:14:47.897719+0000","last_clean":"2024-06-10T00:14:47.897719+0000","last_became_active":"2024-06-10T00:14:41.856764+0000","last_became_peered":"2024-06-10T00:14:41.856764+0000","last_unstale":"2024-06-10T00:14:47.897719+0000","last_undegraded":"2024-06-10T00:14:47.897719+0000","last_fullsized":"2024-06-10T00:14:47.897719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:32:16.264432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898625+0000","last_change":"2024-06-10T00:14:46.988209+0000","last_active":"2024-06-10T00:14:47.898625+0000","last_peered":"2024-06-10T00:14:47.898625+0000","last_clean":"2024-06-10T00:14:47.898625+0000","last_became_active":"2024-06-10T00:14:46.987828+0000","last_became_peered":"2024-06-10T00:14:46.987828+0000","last_unstale":"2024-06-10T00:14:47.898625+0000","last_undegraded":"2024-06-10T00:14:47.898625+0000","last_fullsized":"2024-06-10T00:14:47.898625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:55.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035649+0000","last_change":"2024-06-10T00:14:42.872751+0000","last_active":"2024-06-10T00:14:48.035649+0000","last_peered":"2024-06-10T00:14:48.035649+0000","last_clean":"2024-06-10T00:14:48.035649+0000","last_became_active":"2024-06-10T00:14:42.872474+0000","last_became_peered":"2024-06-10T00:14:42.872474+0000","last_unstale":"2024-06-10T00:14:48.035649+0000","last_undegraded":"2024-06-10T00:14:48.035649+0000","last_fullsized":"2024-06-10T00:14:48.035649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:23.901714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899907+0000","last_change":"2024-06-10T00:14:41.862996+0000","last_active":"2024-06-10T00:14:47.899907+0000","last_peered":"2024-06-10T00:14:47.899907+0000","last_clean":"2024-06-10T00:14:47.899907+0000","last_became_active":"2024-06-10T00:14:41.862737+0000","last_became_peered":"2024-06-10T00:14:41.862737+0000","last_unstale":"2024-06-10T00:14:47.899907+0000","last_undegraded":"2024-06-10T00:14:47.899907+0000","last_fullsized":"2024-06-10T00:14:47.899907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:33:44.025553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897822+0000","last_change":"2024-06-10T00:14:46.888769+0000","last_active":"2024-06-10T00:14:47.897822+0000","last_peered":"2024-06-10T00:14:47.897822+0000","last_clean":"2024-06-10T00:14:47.897822+0000","last_became_active":"2024-06-10T00:14:46.887888+0000","last_became_peered":"2024-06-10T00:14:46.887888+0000","last_unstale":"2024-06-10T00:14:47.897822+0000","last_undegraded":"2024-06-10T00:14:47.897822+0000","last_fullsized":"2024-06-10T00:14:47.897822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:54.764215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035898+0000","last_change":"2024-06-10T00:14:42.874352+0000","last_active":"2024-06-10T00:14:48.035898+0000","last_peered":"2024-06-10T00:14:48.035898+0000","last_clean":"2024-06-10T00:14:48.035898+0000","last_became_active":"2024-06-10T00:14:42.874088+0000","last_became_peered":"2024-06-10T00:14:42.874088+0000","last_unstale":"2024-06-10T00:14:48.035898+0000","last_undegraded":"2024-06-10T00:14:48.035898+0000","last_fullsized":"2024-06-10T00:14:48.035898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897293+0000","last_change":"2024-06-10T00:14:41.859732+0000","last_active":"2024-06-10T00:14:47.897293+0000","last_peered":"2024-06-10T00:14:47.897293+0000","last_clean":"2024-06-10T00:14:47.897293+0000","last_became_active":"2024-06-10T00:14:41.859467+0000","last_became_peered":"2024-06-10T00:14:41.859467+0000","last_unstale":"2024-06-10T00:14:47.897293+0000","last_undegraded":"2024-06-10T00:14:47.897293+0000","last_fullsized":"2024-06-10T00:14:47.897293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035648+0000","last_change":"2024-06-10T00:14:46.892523+0000","last_active":"2024-06-10T00:14:48.035648+0000","last_peered":"2024-06-10T00:14:48.035648+0000","last_clean":"2024-06-10T00:14:48.035648+0000","last_became_active":"2024-06-10T00:14:46.892158+0000","last_became_peered":"2024-06-10T00:14:46.892158+0000","last_unstale":"2024-06-10T00:14:48.035648+0000","last_undegraded":"2024-06-10T00:14:48.035648+0000","last_fullsized":"2024-06-10T00:14:48.035648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:27.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035229+0000","last_change":"2024-06-10T00:14:42.871097+0000","last_active":"2024-06-10T00:14:48.035229+0000","last_peered":"2024-06-10T00:14:48.035229+0000","last_clean":"2024-06-10T00:14:48.035229+0000","last_became_active":"2024-06-10T00:14:42.870727+0000","last_became_peered":"2024-06-10T00:14:42.870727+0000","last_unstale":"2024-06-10T00:14:48.035229+0000","last_undegraded":"2024-06-10T00:14:48.035229+0000","last_fullsized":"2024-06-10T00:14:48.035229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035767+0000","last_change":"2024-06-10T00:14:41.865937+0000","last_active":"2024-06-10T00:14:48.035767+0000","last_peered":"2024-06-10T00:14:48.035767+0000","last_clean":"2024-06-10T00:14:48.035767+0000","last_became_active":"2024-06-10T00:14:41.865669+0000","last_became_peered":"2024-06-10T00:14:41.865669+0000","last_unstale":"2024-06-10T00:14:48.035767+0000","last_undegraded":"2024-06-10T00:14:48.035767+0000","last_fullsized":"2024-06-10T00:14:48.035767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017480+0000","last_change":"2024-06-10T00:14:46.991940+0000","last_active":"2024-06-10T00:14:48.017480+0000","last_peered":"2024-06-10T00:14:48.017480+0000","last_clean":"2024-06-10T00:14:48.017480+0000","last_became_active":"2024-06-10T00:14:46.991212+0000","last_became_peered":"2024-06-10T00:14:46.991212+0000","last_unstale":"2024-06-10T00:14:48.017480+0000","last_undegraded":"2024-06-10T00:14:48.017480+0000","last_fullsized":"2024-06-10T00:14:48.017480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:46:12.021856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035567+0000","last_change":"2024-06-10T00:14:42.873727+0000","last_active":"2024-06-10T00:14:48.035567+0000","last_peered":"2024-06-10T00:14:48.035567+0000","last_clean":"2024-06-10T00:14:48.035567+0000","last_became_active":"2024-06-10T00:14:42.873459+0000","last_became_peered":"2024-06-10T00:14:42.873459+0000","last_unstale":"2024-06-10T00:14:48.035567+0000","last_undegraded":"2024-06-10T00:14:48.035567+0000","last_fullsized":"2024-06-10T00:14:48.035567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:01.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899344+0000","last_change":"2024-06-10T00:14:41.864175+0000","last_active":"2024-06-10T00:14:47.899344+0000","last_peered":"2024-06-10T00:14:47.899344+0000","last_clean":"2024-06-10T00:14:47.899344+0000","last_became_active":"2024-06-10T00:14:41.863904+0000","last_became_peered":"2024-06-10T00:14:41.863904+0000","last_unstale":"2024-06-10T00:14:47.899344+0000","last_undegraded":"2024-06-10T00:14:47.899344+0000","last_fullsized":"2024-06-10T00:14:47.899344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017189+0000","last_change":"2024-06-10T00:14:46.992939+0000","last_active":"2024-06-10T00:14:48.017189+0000","last_peered":"2024-06-10T00:14:48.017189+0000","last_clean":"2024-06-10T00:14:48.017189+0000","last_became_active":"2024-06-10T00:14:46.991804+0000","last_became_peered":"2024-06-10T00:14:46.991804+0000","last_unstale":"2024-06-10T00:14:48.017189+0000","last_undegraded":"2024-06-10T00:14:48.017189+0000","last_fullsized":"2024-06-10T00:14:48.017189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:29:27.598667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035115+0000","last_change":"2024-06-10T00:14:42.874718+0000","last_active":"2024-06-10T00:14:48.035115+0000","last_peered":"2024-06-10T00:14:48.035115+0000","last_clean":"2024-06-10T00:14:48.035115+0000","last_became_active":"2024-06-10T00:14:42.873485+0000","last_became_peered":"2024-06-10T00:14:42.873485+0000","last_unstale":"2024-06-10T00:14:48.035115+0000","last_undegraded":"2024-06-10T00:14:48.035115+0000","last_fullsized":"2024-06-10T00:14:48.035115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:38:52.325465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035564+0000","last_change":"2024-06-10T00:14:41.863792+0000","last_active":"2024-06-10T00:14:48.035564+0000","last_peered":"2024-06-10T00:14:48.035564+0000","last_clean":"2024-06-10T00:14:48.035564+0000","last_became_active":"2024-06-10T00:14:41.863525+0000","last_became_peered":"2024-06-10T00:14:41.863525+0000","last_unstale":"2024-06-10T00:14:48.035564+0000","last_undegraded":"2024-06-10T00:14:48.035564+0000","last_fullsized":"2024-06-10T00:14:48.035564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:21.351313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899455+0000","last_change":"2024-06-10T00:14:46.989177+0000","last_active":"2024-06-10T00:14:47.899455+0000","last_peered":"2024-06-10T00:14:47.899455+0000","last_clean":"2024-06-10T00:14:47.899455+0000","last_became_active":"2024-06-10T00:14:46.988818+0000","last_became_peered":"2024-06-10T00:14:46.988818+0000","last_unstale":"2024-06-10T00:14:47.899455+0000","last_undegraded":"2024-06-10T00:14:47.899455+0000","last_fullsized":"2024-06-10T00:14:47.899455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:52.363831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035517+0000","last_change":"2024-06-10T00:14:42.876047+0000","last_active":"2024-06-10T00:14:48.035517+0000","last_peered":"2024-06-10T00:14:48.035517+0000","last_clean":"2024-06-10T00:14:48.035517+0000","last_became_active":"2024-06-10T00:14:42.875789+0000","last_became_peered":"2024-06-10T00:14:42.875789+0000","last_unstale":"2024-06-10T00:14:48.035517+0000","last_undegraded":"2024-06-10T00:14:48.035517+0000","last_fullsized":"2024-06-10T00:14:48.035517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:33.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:52.223703+0000","last_change":"2024-06-10T00:14:41.866777+0000","last_active":"2024-06-10T00:14:52.223703+0000","last_peered":"2024-06-10T00:14:52.223703+0000","last_clean":"2024-06-10T00:14:52.223703+0000","last_became_active":"2024-06-10T00:14:41.866439+0000","last_became_peered":"2024-06-10T00:14:41.866439+0000","last_unstale":"2024-06-10T00:14:52.223703+0000","last_undegraded":"2024-06-10T00:14:52.223703+0000","last_fullsized":"2024-06-10T00:14:52.223703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035977+0000","last_change":"2024-06-10T00:14:46.893648+0000","last_active":"2024-06-10T00:14:48.035977+0000","last_peered":"2024-06-10T00:14:48.035977+0000","last_clean":"2024-06-10T00:14:48.035977+0000","last_became_active":"2024-06-10T00:14:46.893153+0000","last_became_peered":"2024-06-10T00:14:46.893153+0000","last_unstale":"2024-06-10T00:14:48.035977+0000","last_undegraded":"2024-06-10T00:14:48.035977+0000","last_fullsized":"2024-06-10T00:14:48.035977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:16.762113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899660+0000","last_change":"2024-06-10T00:14:42.869743+0000","last_active":"2024-06-10T00:14:47.899660+0000","last_peered":"2024-06-10T00:14:47.899660+0000","last_clean":"2024-06-10T00:14:47.899660+0000","last_became_active":"2024-06-10T00:14:42.869432+0000","last_became_peered":"2024-06-10T00:14:42.869432+0000","last_unstale":"2024-06-10T00:14:47.899660+0000","last_undegraded":"2024-06-10T00:14:47.899660+0000","last_fullsized":"2024-06-10T00:14:47.899660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:44.600998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036249+0000","last_change":"2024-06-10T00:14:41.859872+0000","last_active":"2024-06-10T00:14:48.036249+0000","last_peered":"2024-06-10T00:14:48.036249+0000","last_clean":"2024-06-10T00:14:48.036249+0000","last_became_active":"2024-06-10T00:14:41.859529+0000","last_became_peered":"2024-06-10T00:14:41.859529+0000","last_unstale":"2024-06-10T00:14:48.036249+0000","last_undegraded":"2024-06-10T00:14:48.036249+0000","last_fullsized":"2024-06-10T00:14:48.036249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:43.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899198+0000","last_change":"2024-06-10T00:14:46.887779+0000","last_active":"2024-06-10T00:14:47.899198+0000","last_peered":"2024-06-10T00:14:47.899198+0000","last_clean":"2024-06-10T00:14:47.899198+0000","last_became_active":"2024-06-10T00:14:46.887388+0000","last_became_peered":"2024-06-10T00:14:46.887388+0000","last_unstale":"2024-06-10T00:14:47.899198+0000","last_undegraded":"2024-06-10T00:14:47.899198+0000","last_fullsized":"2024-06-10T00:14:47.899198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:37.577252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035674+0000","last_change":"2024-06-10T00:14:42.868290+0000","last_active":"2024-06-10T00:14:48.035674+0000","last_peered":"2024-06-10T00:14:48.035674+0000","last_clean":"2024-06-10T00:14:48.035674+0000","last_became_active":"2024-06-10T00:14:42.868004+0000","last_became_peered":"2024-06-10T00:14:42.868004+0000","last_unstale":"2024-06-10T00:14:48.035674+0000","last_undegraded":"2024-06-10T00:14:48.035674+0000","last_fullsized":"2024-06-10T00:14:48.035674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898788+0000","last_change":"2024-06-10T00:14:41.865384+0000","last_active":"2024-06-10T00:14:47.898788+0000","last_peered":"2024-06-10T00:14:47.898788+0000","last_clean":"2024-06-10T00:14:47.898788+0000","last_became_active":"2024-06-10T00:14:41.865032+0000","last_became_peered":"2024-06-10T00:14:41.865032+0000","last_unstale":"2024-06-10T00:14:47.898788+0000","last_undegraded":"2024-06-10T00:14:47.898788+0000","last_fullsized":"2024-06-10T00:14:47.898788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016834+0000","last_change":"2024-06-10T00:14:46.886924+0000","last_active":"2024-06-10T00:14:48.016834+0000","last_peered":"2024-06-10T00:14:48.016834+0000","last_clean":"2024-06-10T00:14:48.016834+0000","last_became_active":"2024-06-10T00:14:46.886412+0000","last_became_peered":"2024-06-10T00:14:46.886412+0000","last_unstale":"2024-06-10T00:14:48.016834+0000","last_undegraded":"2024-06-10T00:14:48.016834+0000","last_fullsized":"2024-06-10T00:14:48.016834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:55.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898784+0000","last_change":"2024-06-10T00:14:42.869511+0000","last_active":"2024-06-10T00:14:47.898784+0000","last_peered":"2024-06-10T00:14:47.898784+0000","last_clean":"2024-06-10T00:14:47.898784+0000","last_became_active":"2024-06-10T00:14:42.868972+0000","last_became_peered":"2024-06-10T00:14:42.868972+0000","last_unstale":"2024-06-10T00:14:47.898784+0000","last_undegraded":"2024-06-10T00:14:47.898784+0000","last_fullsized":"2024-06-10T00:14:47.898784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:33.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036681+0000","last_change":"2024-06-10T00:14:41.866593+0000","last_active":"2024-06-10T00:14:48.036681+0000","last_peered":"2024-06-10T00:14:48.036681+0000","last_clean":"2024-06-10T00:14:48.036681+0000","last_became_active":"2024-06-10T00:14:41.866325+0000","last_became_peered":"2024-06-10T00:14:41.866325+0000","last_unstale":"2024-06-10T00:14:48.036681+0000","last_undegraded":"2024-06-10T00:14:48.036681+0000","last_fullsized":"2024-06-10T00:14:48.036681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016738+0000","last_change":"2024-06-10T00:14:46.990368+0000","last_active":"2024-06-10T00:14:48.016738+0000","last_peered":"2024-06-10T00:14:48.016738+0000","last_clean":"2024-06-10T00:14:48.016738+0000","last_became_active":"2024-06-10T00:14:46.989951+0000","last_became_peered":"2024-06-10T00:14:46.989951+0000","last_unstale":"2024-06-10T00:14:48.016738+0000","last_undegraded":"2024-06-10T00:14:48.016738+0000","last_fullsized":"2024-06-10T00:14:48.016738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:56:04.088356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035504+0000","last_change":"2024-06-10T00:14:46.990321+0000","last_active":"2024-06-10T00:14:48.035504+0000","last_peered":"2024-06-10T00:14:48.035504+0000","last_clean":"2024-06-10T00:14:48.035504+0000","last_became_active":"2024-06-10T00:14:46.989969+0000","last_became_peered":"2024-06-10T00:14:46.989969+0000","last_unstale":"2024-06-10T00:14:48.035504+0000","last_undegraded":"2024-06-10T00:14:48.035504+0000","last_fullsized":"2024-06-10T00:14:48.035504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:08.929668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035435+0000","last_change":"2024-06-10T00:14:42.876343+0000","last_active":"2024-06-10T00:14:48.035435+0000","last_peered":"2024-06-10T00:14:48.035435+0000","last_clean":"2024-06-10T00:14:48.035435+0000","last_became_active":"2024-06-10T00:14:42.876035+0000","last_became_peered":"2024-06-10T00:14:42.876035+0000","last_unstale":"2024-06-10T00:14:48.035435+0000","last_undegraded":"2024-06-10T00:14:48.035435+0000","last_fullsized":"2024-06-10T00:14:48.035435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898153+0000","last_change":"2024-06-10T00:14:41.856933+0000","last_active":"2024-06-10T00:14:47.898153+0000","last_peered":"2024-06-10T00:14:47.898153+0000","last_clean":"2024-06-10T00:14:47.898153+0000","last_became_active":"2024-06-10T00:14:41.856621+0000","last_became_peered":"2024-06-10T00:14:41.856621+0000","last_unstale":"2024-06-10T00:14:47.898153+0000","last_undegraded":"2024-06-10T00:14:47.898153+0000","last_fullsized":"2024-06-10T00:14:47.898153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036551+0000","last_change":"2024-06-10T00:14:46.889437+0000","last_active":"2024-06-10T00:14:48.036551+0000","last_peered":"2024-06-10T00:14:48.036551+0000","last_clean":"2024-06-10T00:14:48.036551+0000","last_became_active":"2024-06-10T00:14:46.888842+0000","last_became_peered":"2024-06-10T00:14:46.888842+0000","last_unstale":"2024-06-10T00:14:48.036551+0000","last_undegraded":"2024-06-10T00:14:48.036551+0000","last_fullsized":"2024-06-10T00:14:48.036551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016928+0000","last_change":"2024-06-10T00:14:42.874887+0000","last_active":"2024-06-10T00:14:48.016928+0000","last_peered":"2024-06-10T00:14:48.016928+0000","last_clean":"2024-06-10T00:14:48.016928+0000","last_became_active":"2024-06-10T00:14:42.871122+0000","last_became_peered":"2024-06-10T00:14:42.871122+0000","last_unstale":"2024-06-10T00:14:48.016928+0000","last_undegraded":"2024-06-10T00:14:48.016928+0000","last_fullsized":"2024-06-10T00:14:48.016928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016934+0000","last_change":"2024-06-10T00:14:41.869171+0000","last_active":"2024-06-10T00:14:48.016934+0000","last_peered":"2024-06-10T00:14:48.016934+0000","last_clean":"2024-06-10T00:14:48.016934+0000","last_became_active":"2024-06-10T00:14:41.868845+0000","last_became_peered":"2024-06-10T00:14:41.868845+0000","last_unstale":"2024-06-10T00:14:48.016934+0000","last_undegraded":"2024-06-10T00:14:48.016934+0000","last_fullsized":"2024-06-10T00:14:48.016934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036070+0000","last_change":"2024-06-10T00:14:41.864391+0000","last_active":"2024-06-10T00:14:48.036070+0000","last_peered":"2024-06-10T00:14:48.036070+0000","last_clean":"2024-06-10T00:14:48.036070+0000","last_became_active":"2024-06-10T00:14:41.864117+0000","last_became_peered":"2024-06-10T00:14:41.864117+0000","last_unstale":"2024-06-10T00:14:48.036070+0000","last_undegraded":"2024-06-10T00:14:48.036070+0000","last_fullsized":"2024-06-10T00:14:48.036070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035534+0000","last_change":"2024-06-10T00:14:42.869238+0000","last_active":"2024-06-10T00:14:48.035534+0000","last_peered":"2024-06-10T00:14:48.035534+0000","last_clean":"2024-06-10T00:14:48.035534+0000","last_became_active":"2024-06-10T00:14:42.868630+0000","last_became_peered":"2024-06-10T00:14:42.868630+0000","last_unstale":"2024-06-10T00:14:48.035534+0000","last_undegraded":"2024-06-10T00:14:48.035534+0000","last_fullsized":"2024-06-10T00:14:48.035534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897449+0000","last_change":"2024-06-10T00:14:46.886409+0000","last_active":"2024-06-10T00:14:47.897449+0000","last_peered":"2024-06-10T00:14:47.897449+0000","last_clean":"2024-06-10T00:14:47.897449+0000","last_became_active":"2024-06-10T00:14:46.886014+0000","last_became_peered":"2024-06-10T00:14:46.886014+0000","last_unstale":"2024-06-10T00:14:47.897449+0000","last_undegraded":"2024-06-10T00:14:47.897449+0000","last_fullsized":"2024-06-10T00:14:47.897449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:52.056077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016946+0000","last_change":"2024-06-10T00:14:41.862965+0000","last_active":"2024-06-10T00:14:48.016946+0000","last_peered":"2024-06-10T00:14:48.016946+0000","last_clean":"2024-06-10T00:14:48.016946+0000","last_became_active":"2024-06-10T00:14:41.862590+0000","last_became_peered":"2024-06-10T00:14:41.862590+0000","last_unstale":"2024-06-10T00:14:48.016946+0000","last_undegraded":"2024-06-10T00:14:48.016946+0000","last_fullsized":"2024-06-10T00:14:48.016946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:24:00.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898569+0000","last_change":"2024-06-10T00:14:42.855647+0000","last_active":"2024-06-10T00:14:47.898569+0000","last_peered":"2024-06-10T00:14:47.898569+0000","last_clean":"2024-06-10T00:14:47.898569+0000","last_became_active":"2024-06-10T00:14:42.855378+0000","last_became_peered":"2024-06-10T00:14:42.855378+0000","last_unstale":"2024-06-10T00:14:47.898569+0000","last_undegraded":"2024-06-10T00:14:47.898569+0000","last_fullsized":"2024-06-10T00:14:47.898569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:37.270508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017131+0000","last_change":"2024-06-10T00:14:46.886769+0000","last_active":"2024-06-10T00:14:48.017131+0000","last_peered":"2024-06-10T00:14:48.017131+0000","last_clean":"2024-06-10T00:14:48.017131+0000","last_became_active":"2024-06-10T00:14:46.886389+0000","last_became_peered":"2024-06-10T00:14:46.886389+0000","last_unstale":"2024-06-10T00:14:48.017131+0000","last_undegraded":"2024-06-10T00:14:48.017131+0000","last_fullsized":"2024-06-10T00:14:48.017131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:52.363831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035110+0000","last_change":"2024-06-10T00:14:42.873034+0000","last_active":"2024-06-10T00:14:48.035110+0000","last_peered":"2024-06-10T00:14:48.035110+0000","last_clean":"2024-06-10T00:14:48.035110+0000","last_became_active":"2024-06-10T00:14:42.872750+0000","last_became_peered":"2024-06-10T00:14:42.872750+0000","last_unstale":"2024-06-10T00:14:48.035110+0000","last_undegraded":"2024-06-10T00:14:48.035110+0000","last_fullsized":"2024-06-10T00:14:48.035110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897497+0000","last_change":"2024-06-10T00:14:42.859987+0000","last_active":"2024-06-10T00:14:47.897497+0000","last_peered":"2024-06-10T00:14:47.897497+0000","last_clean":"2024-06-10T00:14:47.897497+0000","last_became_active":"2024-06-10T00:14:42.859713+0000","last_became_peered":"2024-06-10T00:14:42.859713+0000","last_unstale":"2024-06-10T00:14:47.897497+0000","last_undegraded":"2024-06-10T00:14:47.897497+0000","last_fullsized":"2024-06-10T00:14:47.897497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:44.600998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899229+0000","last_change":"2024-06-10T00:14:42.873760+0000","last_active":"2024-06-10T00:14:47.899229+0000","last_peered":"2024-06-10T00:14:47.899229+0000","last_clean":"2024-06-10T00:14:47.899229+0000","last_became_active":"2024-06-10T00:14:42.872329+0000","last_became_peered":"2024-06-10T00:14:42.872329+0000","last_unstale":"2024-06-10T00:14:47.899229+0000","last_undegraded":"2024-06-10T00:14:47.899229+0000","last_fullsized":"2024-06-10T00:14:47.899229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:43.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035479+0000","last_change":"2024-06-10T00:14:42.872717+0000","last_active":"2024-06-10T00:14:48.035479+0000","last_peered":"2024-06-10T00:14:48.035479+0000","last_clean":"2024-06-10T00:14:48.035479+0000","last_became_active":"2024-06-10T00:14:42.872465+0000","last_became_peered":"2024-06-10T00:14:42.872465+0000","last_unstale":"2024-06-10T00:14:48.035479+0000","last_undegraded":"2024-06-10T00:14:48.035479+0000","last_fullsized":"2024-06-10T00:14:48.035479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017308+0000","last_change":"2024-06-10T00:14:42.871847+0000","last_active":"2024-06-10T00:14:48.017308+0000","last_peered":"2024-06-10T00:14:48.017308+0000","last_clean":"2024-06-10T00:14:48.017308+0000","last_became_active":"2024-06-10T00:14:42.871547+0000","last_became_peered":"2024-06-10T00:14:42.871547+0000","last_unstale":"2024-06-10T00:14:48.017308+0000","last_undegraded":"2024-06-10T00:14:48.017308+0000","last_fullsized":"2024-06-10T00:14:48.017308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:11.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036114+0000","last_change":"2024-06-10T00:14:42.866392+0000","last_active":"2024-06-10T00:14:48.036114+0000","last_peered":"2024-06-10T00:14:48.036114+0000","last_clean":"2024-06-10T00:14:48.036114+0000","last_became_active":"2024-06-10T00:14:42.866117+0000","last_became_peered":"2024-06-10T00:14:42.866117+0000","last_unstale":"2024-06-10T00:14:48.036114+0000","last_undegraded":"2024-06-10T00:14:48.036114+0000","last_fullsized":"2024-06-10T00:14:48.036114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036529+0000","last_change":"2024-06-10T00:14:42.876259+0000","last_active":"2024-06-10T00:14:48.036529+0000","last_peered":"2024-06-10T00:14:48.036529+0000","last_clean":"2024-06-10T00:14:48.036529+0000","last_became_active":"2024-06-10T00:14:42.875796+0000","last_became_peered":"2024-06-10T00:14:42.875796+0000","last_unstale":"2024-06-10T00:14:48.036529+0000","last_undegraded":"2024-06-10T00:14:48.036529+0000","last_fullsized":"2024-06-10T00:14:48.036529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017440+0000","last_change":"2024-06-10T00:14:42.874760+0000","last_active":"2024-06-10T00:14:48.017440+0000","last_peered":"2024-06-10T00:14:48.017440+0000","last_clean":"2024-06-10T00:14:48.017440+0000","last_became_active":"2024-06-10T00:14:42.871905+0000","last_became_peered":"2024-06-10T00:14:42.871905+0000","last_unstale":"2024-06-10T00:14:48.017440+0000","last_undegraded":"2024-06-10T00:14:48.017440+0000","last_fullsized":"2024-06-10T00:14:48.017440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898045+0000","last_change":"2024-06-10T00:14:42.873446+0000","last_active":"2024-06-10T00:14:47.898045+0000","last_peered":"2024-06-10T00:14:47.898045+0000","last_clean":"2024-06-10T00:14:47.898045+0000","last_became_active":"2024-06-10T00:14:42.872821+0000","last_became_peered":"2024-06-10T00:14:42.872821+0000","last_unstale":"2024-06-10T00:14:47.898045+0000","last_undegraded":"2024-06-10T00:14:47.898045+0000","last_fullsized":"2024-06-10T00:14:47.898045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016840+0000","last_change":"2024-06-10T00:14:42.875401+0000","last_active":"2024-06-10T00:14:48.016840+0000","last_peered":"2024-06-10T00:14:48.016840+0000","last_clean":"2024-06-10T00:14:48.016840+0000","last_became_active":"2024-06-10T00:14:42.875112+0000","last_became_peered":"2024-06-10T00:14:42.875112+0000","last_unstale":"2024-06-10T00:14:48.016840+0000","last_undegraded":"2024-06-10T00:14:48.016840+0000","last_fullsized":"2024-06-10T00:14:48.016840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899128+0000","last_change":"2024-06-10T00:14:42.870273+0000","last_active":"2024-06-10T00:14:47.899128+0000","last_peered":"2024-06-10T00:14:47.899128+0000","last_clean":"2024-06-10T00:14:47.899128+0000","last_became_active":"2024-06-10T00:14:42.869992+0000","last_became_peered":"2024-06-10T00:14:42.869992+0000","last_unstale":"2024-06-10T00:14:47.899128+0000","last_undegraded":"2024-06-10T00:14:47.899128+0000","last_fullsized":"2024-06-10T00:14:47.899128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:01.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035242+0000","last_change":"2024-06-10T00:14:42.874258+0000","last_active":"2024-06-10T00:14:48.035242+0000","last_peered":"2024-06-10T00:14:48.035242+0000","last_clean":"2024-06-10T00:14:48.035242+0000","last_became_active":"2024-06-10T00:14:42.873693+0000","last_became_peered":"2024-06-10T00:14:42.873693+0000","last_unstale":"2024-06-10T00:14:48.035242+0000","last_undegraded":"2024-06-10T00:14:48.035242+0000","last_fullsized":"2024-06-10T00:14:48.035242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036422+0000","last_change":"2024-06-10T00:14:42.874380+0000","last_active":"2024-06-10T00:14:48.036422+0000","last_peered":"2024-06-10T00:14:48.036422+0000","last_clean":"2024-06-10T00:14:48.036422+0000","last_became_active":"2024-06-10T00:14:42.873982+0000","last_became_peered":"2024-06-10T00:14:42.873982+0000","last_unstale":"2024-06-10T00:14:48.036422+0000","last_undegraded":"2024-06-10T00:14:48.036422+0000","last_fullsized":"2024-06-10T00:14:48.036422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035822+0000","last_change":"2024-06-10T00:14:42.877427+0000","last_active":"2024-06-10T00:14:48.035822+0000","last_peered":"2024-06-10T00:14:48.035822+0000","last_clean":"2024-06-10T00:14:48.035822+0000","last_became_active":"2024-06-10T00:14:42.877128+0000","last_became_peered":"2024-06-10T00:14:42.877128+0000","last_unstale":"2024-06-10T00:14:48.035822+0000","last_undegraded":"2024-06-10T00:14:48.035822+0000","last_fullsized":"2024-06-10T00:14:48.035822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:12.737454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897679+0000","last_change":"2024-06-10T00:14:42.877136+0000","last_active":"2024-06-10T00:14:47.897679+0000","last_peered":"2024-06-10T00:14:47.897679+0000","last_clean":"2024-06-10T00:14:47.897679+0000","last_became_active":"2024-06-10T00:14:42.876880+0000","last_became_peered":"2024-06-10T00:14:42.876880+0000","last_unstale":"2024-06-10T00:14:47.897679+0000","last_undegraded":"2024-06-10T00:14:47.897679+0000","last_fullsized":"2024-06-10T00:14:47.897679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:05.350314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899309+0000","last_change":"2024-06-10T00:14:42.868563+0000","last_active":"2024-06-10T00:14:47.899309+0000","last_peered":"2024-06-10T00:14:47.899309+0000","last_clean":"2024-06-10T00:14:47.899309+0000","last_became_active":"2024-06-10T00:14:42.868301+0000","last_became_peered":"2024-06-10T00:14:42.868301+0000","last_unstale":"2024-06-10T00:14:47.899309+0000","last_undegraded":"2024-06-10T00:14:47.899309+0000","last_fullsized":"2024-06-10T00:14:47.899309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:32.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897802+0000","last_change":"2024-06-10T00:14:42.861856+0000","last_active":"2024-06-10T00:14:47.897802+0000","last_peered":"2024-06-10T00:14:47.897802+0000","last_clean":"2024-06-10T00:14:47.897802+0000","last_became_active":"2024-06-10T00:14:42.861585+0000","last_became_peered":"2024-06-10T00:14:42.861585+0000","last_unstale":"2024-06-10T00:14:47.897802+0000","last_undegraded":"2024-06-10T00:14:47.897802+0000","last_fullsized":"2024-06-10T00:14:47.897802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035530+0000","last_change":"2024-06-10T00:14:42.860405+0000","last_active":"2024-06-10T00:14:48.035530+0000","last_peered":"2024-06-10T00:14:48.035530+0000","last_clean":"2024-06-10T00:14:48.035530+0000","last_became_active":"2024-06-10T00:14:42.860149+0000","last_became_peered":"2024-06-10T00:14:42.860149+0000","last_unstale":"2024-06-10T00:14:48.035530+0000","last_undegraded":"2024-06-10T00:14:48.035530+0000","last_fullsized":"2024-06-10T00:14:48.035530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035085+0000","last_change":"2024-06-10T00:14:42.865461+0000","last_active":"2024-06-10T00:14:48.035085+0000","last_peered":"2024-06-10T00:14:48.035085+0000","last_clean":"2024-06-10T00:14:48.035085+0000","last_became_active":"2024-06-10T00:14:42.864928+0000","last_became_peered":"2024-06-10T00:14:42.864928+0000","last_unstale":"2024-06-10T00:14:48.035085+0000","last_undegraded":"2024-06-10T00:14:48.035085+0000","last_fullsized":"2024-06-10T00:14:48.035085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:48.031418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016831+0000","last_change":"2024-06-10T00:14:42.874662+0000","last_active":"2024-06-10T00:14:48.016831+0000","last_peered":"2024-06-10T00:14:48.016831+0000","last_clean":"2024-06-10T00:14:48.016831+0000","last_became_active":"2024-06-10T00:14:42.871319+0000","last_became_peered":"2024-06-10T00:14:42.871319+0000","last_unstale":"2024-06-10T00:14:48.016831+0000","last_undegraded":"2024-06-10T00:14:48.016831+0000","last_fullsized":"2024-06-10T00:14:48.016831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899567+0000","last_change":"2024-06-10T00:14:42.876016+0000","last_active":"2024-06-10T00:14:47.899567+0000","last_peered":"2024-06-10T00:14:47.899567+0000","last_clean":"2024-06-10T00:14:47.899567+0000","last_became_active":"2024-06-10T00:14:42.875737+0000","last_became_peered":"2024-06-10T00:14:42.875737+0000","last_unstale":"2024-06-10T00:14:47.899567+0000","last_undegraded":"2024-06-10T00:14:47.899567+0000","last_fullsized":"2024-06-10T00:14:47.899567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:05.350314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036628+0000","last_change":"2024-06-10T00:14:42.871720+0000","last_active":"2024-06-10T00:14:48.036628+0000","last_peered":"2024-06-10T00:14:48.036628+0000","last_clean":"2024-06-10T00:14:48.036628+0000","last_became_active":"2024-06-10T00:14:42.871436+0000","last_became_peered":"2024-06-10T00:14:42.871436+0000","last_unstale":"2024-06-10T00:14:48.036628+0000","last_undegraded":"2024-06-10T00:14:48.036628+0000","last_fullsized":"2024-06-10T00:14:48.036628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036473+0000","last_change":"2024-06-10T00:14:42.876040+0000","last_active":"2024-06-10T00:14:48.036473+0000","last_peered":"2024-06-10T00:14:48.036473+0000","last_clean":"2024-06-10T00:14:48.036473+0000","last_became_active":"2024-06-10T00:14:42.875415+0000","last_became_peered":"2024-06-10T00:14:42.875415+0000","last_unstale":"2024-06-10T00:14:48.036473+0000","last_undegraded":"2024-06-10T00:14:48.036473+0000","last_fullsized":"2024-06-10T00:14:48.036473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035992+0000","last_change":"2024-06-10T00:14:42.878916+0000","last_active":"2024-06-10T00:14:48.035992+0000","last_peered":"2024-06-10T00:14:48.035992+0000","last_clean":"2024-06-10T00:14:48.035992+0000","last_became_active":"2024-06-10T00:14:42.878614+0000","last_became_peered":"2024-06-10T00:14:42.878614+0000","last_unstale":"2024-06-10T00:14:48.035992+0000","last_undegraded":"2024-06-10T00:14:48.035992+0000","last_fullsized":"2024-06-10T00:14:48.035992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:32.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016672+0000","last_change":"2024-06-10T00:14:42.871267+0000","last_active":"2024-06-10T00:14:48.016672+0000","last_peered":"2024-06-10T00:14:48.016672+0000","last_clean":"2024-06-10T00:14:48.016672+0000","last_became_active":"2024-06-10T00:14:42.870655+0000","last_became_peered":"2024-06-10T00:14:42.870655+0000","last_unstale":"2024-06-10T00:14:48.016672+0000","last_undegraded":"2024-06-10T00:14:48.016672+0000","last_fullsized":"2024-06-10T00:14:48.016672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035895+0000","last_change":"2024-06-10T00:14:42.872799+0000","last_active":"2024-06-10T00:14:48.035895+0000","last_peered":"2024-06-10T00:14:48.035895+0000","last_clean":"2024-06-10T00:14:48.035895+0000","last_became_active":"2024-06-10T00:14:42.872353+0000","last_became_peered":"2024-06-10T00:14:42.872353+0000","last_unstale":"2024-06-10T00:14:48.035895+0000","last_undegraded":"2024-06-10T00:14:48.035895+0000","last_fullsized":"2024-06-10T00:14:48.035895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899012+0000","last_change":"2024-06-10T00:14:42.861048+0000","last_active":"2024-06-10T00:14:47.899012+0000","last_peered":"2024-06-10T00:14:47.899012+0000","last_clean":"2024-06-10T00:14:47.899012+0000","last_became_active":"2024-06-10T00:14:42.860760+0000","last_became_peered":"2024-06-10T00:14:42.860760+0000","last_unstale":"2024-06-10T00:14:47.899012+0000","last_undegraded":"2024-06-10T00:14:47.899012+0000","last_fullsized":"2024-06-10T00:14:47.899012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035369+0000","last_change":"2024-06-10T00:14:42.876850+0000","last_active":"2024-06-10T00:14:48.035369+0000","last_peered":"2024-06-10T00:14:48.035369+0000","last_clean":"2024-06-10T00:14:48.035369+0000","last_became_active":"2024-06-10T00:14:42.876562+0000","last_became_peered":"2024-06-10T00:14:42.876562+0000","last_unstale":"2024-06-10T00:14:48.035369+0000","last_undegraded":"2024-06-10T00:14:48.035369+0000","last_fullsized":"2024-06-10T00:14:48.035369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898301+0000","last_change":"2024-06-10T00:14:42.872870+0000","last_active":"2024-06-10T00:14:47.898301+0000","last_peered":"2024-06-10T00:14:47.898301+0000","last_clean":"2024-06-10T00:14:47.898301+0000","last_became_active":"2024-06-10T00:14:42.872366+0000","last_became_peered":"2024-06-10T00:14:42.872366+0000","last_unstale":"2024-06-10T00:14:47.898301+0000","last_undegraded":"2024-06-10T00:14:47.898301+0000","last_fullsized":"2024-06-10T00:14:47.898301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:12.737454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035393+0000","last_change":"2024-06-10T00:14:42.870759+0000","last_active":"2024-06-10T00:14:48.035393+0000","last_peered":"2024-06-10T00:14:48.035393+0000","last_clean":"2024-06-10T00:14:48.035393+0000","last_became_active":"2024-06-10T00:14:42.869435+0000","last_became_peered":"2024-06-10T00:14:42.869435+0000","last_unstale":"2024-06-10T00:14:48.035393+0000","last_undegraded":"2024-06-10T00:14:48.035393+0000","last_fullsized":"2024-06-10T00:14:48.035393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:31:36.092116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036201+0000","last_change":"2024-06-10T00:14:42.863072+0000","last_active":"2024-06-10T00:14:48.036201+0000","last_peered":"2024-06-10T00:14:48.036201+0000","last_clean":"2024-06-10T00:14:48.036201+0000","last_became_active":"2024-06-10T00:14:42.862795+0000","last_became_peered":"2024-06-10T00:14:42.862795+0000","last_unstale":"2024-06-10T00:14:48.036201+0000","last_undegraded":"2024-06-10T00:14:48.036201+0000","last_fullsized":"2024-06-10T00:14:48.036201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035900+0000","last_change":"2024-06-10T00:14:42.880389+0000","last_active":"2024-06-10T00:14:48.035900+0000","last_peered":"2024-06-10T00:14:48.035900+0000","last_clean":"2024-06-10T00:14:48.035900+0000","last_became_active":"2024-06-10T00:14:42.880129+0000","last_became_peered":"2024-06-10T00:14:42.880129+0000","last_unstale":"2024-06-10T00:14:48.035900+0000","last_undegraded":"2024-06-10T00:14:48.035900+0000","last_fullsized":"2024-06-10T00:14:48.035900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:04.905009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:07.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:07.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.397+0000 7ff022031640 1 Processor -- start 2024-06-10T00:15:07.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.397+0000 7ff022031640 1 -- start start 2024-06-10T00:15:07.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff022031640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c1617f0 0x7ff01c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff022031640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff01c06ece0 0x7ff01c161d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff022031640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01c0714a0 con 0x7ff01c162270 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff022031640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff01c0ccba0 con 0x7ff01c06ece0 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff022031640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff01c0cce80 con 0x7ff01c1617f0 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff01c162270 0x7ff01c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50738/0 (socket says 172.21.15.79:50738) 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01bfff640 1 -- 172.21.15.79:0/4195389315 learned_addr learned my addr 172.21.15.79:0/4195389315 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01b7fe640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c1617f0 0x7ff01c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01affd640 1 --2- 172.21.15.79:0/4195389315 >> v2:172.21.15.117:3300/0 conn(0x7ff01c06ece0 0x7ff01c161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541098278 0 0) 0x7ff01c0714a0 con 0x7ff01c162270 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff004003520 con 0x7ff01c162270 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1286003908 0 0) 0x7ff004003520 con 0x7ff01c162270 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c1617f0 msgr2=0x7ff01c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:07.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c1617f0 0x7ff01c0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 >> v2:172.21.15.117:3300/0 conn(0x7ff01c06ece0 msgr2=0x7ff01c161d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 --2- 172.21.15.79:0/4195389315 >> v2:172.21.15.117:3300/0 conn(0x7ff01c06ece0 0x7ff01c161d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c0cd160 con 0x7ff01c162270 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7ff0140019f0 con 0x7ff01c162270 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 >> v1:172.21.15.79:6789/0 conn(0x7ff01c162270 legacy=0x7ff01c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c1617f0 0x7ff0040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff004003f30 0x7ff004004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004004d40 0x7ff0040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c0ccba0 con 0x7ff004003f30 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c0cce80 con 0x7ff004004d40 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.398+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff00400ba10 con 0x7ff01c1617f0 2024-06-10T00:15:07.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.399+0000 7ff01affd640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff004003f30 0x7ff004004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.399+0000 7ff01b7fe640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c1617f0 0x7ff0040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.399+0000 7ff01bfff640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004004d40 0x7ff0040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.399+0000 7ff01affd640 1 -- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c1617f0 msgr2=0x7ff0040039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.399+0000 7ff01affd640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c1617f0 0x7ff0040039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.399+0000 7ff01affd640 1 -- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004004d40 msgr2=0x7ff0040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.399+0000 7ff01affd640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004004d40 0x7ff0040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.399+0000 7ff01affd640 1 -- 172.21.15.79:0/4195389315 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff004003520 con 0x7ff004003f30 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff01affd640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff004003f30 0x7ff004004800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff010009af0 tx=0x7ff004005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9360d1852566fd1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff010036070 con 0x7ff004003f30 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff010031400 con 0x7ff004003f30 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff01a7fc640 1 -- 172.21.15.79:0/4195389315 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff010009690 con 0x7ff004003f30 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff022031640 1 -- 172.21.15.79:0/4195389315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff004003f30 msgr2=0x7ff004004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff022031640 1 --2- 172.21.15.79:0/4195389315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff004003f30 0x7ff004004800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff010009af0 tx=0x7ff004005830 comp rx=0 tx=0).stop 2024-06-10T00:15:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff01bfff640 1 -- 172.21.15.79:0/4195389315 reap_dead start 2024-06-10T00:15:07.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff022031640 1 -- 172.21.15.79:0/4195389315 shutdown_connections 2024-06-10T00:15:07.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff022031640 1 -- 172.21.15.79:0/4195389315 >> 172.21.15.79:0/4195389315 conn(0x7ff01c0b1bb0 msgr2=0x7ff01c0b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:07.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff022031640 1 -- 172.21.15.79:0/4195389315 shutdown_connections 2024-06-10T00:15:07.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.400+0000 7ff022031640 1 -- 172.21.15.79:0/4195389315 wait complete. 2024-06-10T00:15:07.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.401+0000 7ff022031640 1 Processor -- start 2024-06-10T00:15:07.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff022031640 1 -- start start 2024-06-10T00:15:07.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff022031640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004003f30 0x7ff01c0c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff022031640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c1f74b0 0x7ff01c1f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff022031640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c15ddd0 0x7ff01c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff022031640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c06f2a0 con 0x7ff01c1f74b0 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff022031640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c06f120 con 0x7ff004003f30 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff022031640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff01c0729b0 con 0x7ff01c15ddd0 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff01affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c1f74b0 0x7ff01c1f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff01affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c1f74b0 0x7ff01c1f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36942/0 (socket says 172.21.15.79:36942) 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.402+0000 7ff01affd640 1 -- 172.21.15.79:0/1776739467 learned_addr learned my addr 172.21.15.79:0/1776739467 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01b7fe640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004003f30 0x7ff01c0c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01bfff640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c15ddd0 0x7ff01c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01affd640 1 -- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c15ddd0 msgr2=0x7ff01c158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01affd640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c15ddd0 0x7ff01c158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01affd640 1 -- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004003f30 msgr2=0x7ff01c0c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01affd640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004003f30 0x7ff01c0c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01affd640 1 -- 172.21.15.79:0/1776739467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c1f7a00 con 0x7ff01c1f74b0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01bfff640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c15ddd0 0x7ff01c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01b7fe640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004003f30 0x7ff01c0c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff01affd640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c1f74b0 0x7ff01c1f4940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff010009c10 tx=0x7ff010004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff003fff640 1 -- 172.21.15.79:0/1776739467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff010040020 con 0x7ff01c1f74b0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff003fff640 1 -- 172.21.15.79:0/1776739467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff010003830 con 0x7ff01c1f74b0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01c1f7ce0 con 0x7ff01c1f74b0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff003fff640 1 -- 172.21.15.79:0/1776739467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff010036040 con 0x7ff01c1f74b0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.403+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff01c15a500 con 0x7ff01c1f74b0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.404+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c068430 con 0x7ff01c1f74b0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.405+0000 7ff003fff640 1 -- 172.21.15.79:0/1776739467 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff010043020 con 0x7ff01c1f74b0 2024-06-10T00:15:07.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.405+0000 7ff003fff640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff00806be30 0x7ff00806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.405+0000 7ff003fff640 1 -- 172.21.15.79:0/1776739467 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff0100ab1c0 con 0x7ff01c1f74b0 2024-06-10T00:15:07.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.405+0000 7ff01b7fe640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff00806be30 0x7ff00806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.406+0000 7ff01b7fe640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff00806be30 0x7ff00806e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009ae0 tx=0x7ff00c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.409+0000 7ff003fff640 1 -- 172.21.15.79:0/1776739467 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff01004a070 con 0x7ff01c1f74b0 2024-06-10T00:15:07.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.579+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff01c0cbb30 con 0x7ff00806be30 2024-06-10T00:15:07.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.587+0000 7ff003fff640 1 -- 172.21.15.79:0/1776739467 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7ff01c0cbb30 con 0x7ff00806be30 2024-06-10T00:15:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff00806be30 msgr2=0x7ff00806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff00806be30 0x7ff00806e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009ae0 tx=0x7ff00c008040 comp rx=0 tx=0).stop 2024-06-10T00:15:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c1f74b0 msgr2=0x7ff01c1f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c1f74b0 0x7ff01c1f4940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff010009c10 tx=0x7ff010004730 comp rx=0 tx=0).stop 2024-06-10T00:15:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 shutdown_connections 2024-06-10T00:15:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff00806be30 0x7ff00806e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff01c15ddd0 0x7ff01c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c1f74b0 0x7ff01c1f4940 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 --2- 172.21.15.79:0/1776739467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff004003f30 0x7ff01c0c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.590+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 >> 172.21.15.79:0/1776739467 conn(0x7ff01c0b1bb0 msgr2=0x7ff01c160430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.591+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 shutdown_connections 2024-06-10T00:15:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.591+0000 7ff022031640 1 -- 172.21.15.79:0/1776739467 wait complete. 2024-06-10T00:15:07.601 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-06-10T00:15:07.152364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003182"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035823+0000","last_change":"2024-06-10T00:14:41.867016+0000","last_active":"2024-06-10T00:14:48.035823+0000","last_peered":"2024-06-10T00:14:48.035823+0000","last_clean":"2024-06-10T00:14:48.035823+0000","last_became_active":"2024-06-10T00:14:41.866719+0000","last_became_peered":"2024-06-10T00:14:41.866719+0000","last_unstale":"2024-06-10T00:14:48.035823+0000","last_undegraded":"2024-06-10T00:14:48.035823+0000","last_fullsized":"2024-06-10T00:14:48.035823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:24:00.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017302+0000","last_change":"2024-06-10T00:14:42.878734+0000","last_active":"2024-06-10T00:14:48.017302+0000","last_peered":"2024-06-10T00:14:48.017302+0000","last_clean":"2024-06-10T00:14:48.017302+0000","last_became_active":"2024-06-10T00:14:42.878470+0000","last_became_peered":"2024-06-10T00:14:42.878470+0000","last_unstale":"2024-06-10T00:14:48.017302+0000","last_undegraded":"2024-06-10T00:14:48.017302+0000","last_fullsized":"2024-06-10T00:14:48.017302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016668+0000","last_change":"2024-06-10T00:14:46.991114+0000","last_active":"2024-06-10T00:14:48.016668+0000","last_peered":"2024-06-10T00:14:48.016668+0000","last_clean":"2024-06-10T00:14:48.016668+0000","last_became_active":"2024-06-10T00:14:46.990705+0000","last_became_peered":"2024-06-10T00:14:46.990705+0000","last_unstale":"2024-06-10T00:14:48.016668+0000","last_undegraded":"2024-06-10T00:14:48.016668+0000","last_fullsized":"2024-06-10T00:14:48.016668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:53:49.602835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017392+0000","last_change":"2024-06-10T00:14:41.862823+0000","last_active":"2024-06-10T00:14:48.017392+0000","last_peered":"2024-06-10T00:14:48.017392+0000","last_clean":"2024-06-10T00:14:48.017392+0000","last_became_active":"2024-06-10T00:14:41.862550+0000","last_became_peered":"2024-06-10T00:14:41.862550+0000","last_unstale":"2024-06-10T00:14:48.017392+0000","last_undegraded":"2024-06-10T00:14:48.017392+0000","last_fullsized":"2024-06-10T00:14:48.017392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:32:16.264432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035521+0000","last_change":"2024-06-10T00:14:42.869043+0000","last_active":"2024-06-10T00:14:48.035521+0000","last_peered":"2024-06-10T00:14:48.035521+0000","last_clean":"2024-06-10T00:14:48.035521+0000","last_became_active":"2024-06-10T00:14:42.868643+0000","last_became_peered":"2024-06-10T00:14:42.868643+0000","last_unstale":"2024-06-10T00:14:48.035521+0000","last_undegraded":"2024-06-10T00:14:48.035521+0000","last_fullsized":"2024-06-10T00:14:48.035521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897961+0000","last_change":"2024-06-10T00:14:46.888840+0000","last_active":"2024-06-10T00:14:47.897961+0000","last_peered":"2024-06-10T00:14:47.897961+0000","last_clean":"2024-06-10T00:14:47.897961+0000","last_became_active":"2024-06-10T00:14:46.888089+0000","last_became_peered":"2024-06-10T00:14:46.888089+0000","last_unstale":"2024-06-10T00:14:47.897961+0000","last_undegraded":"2024-06-10T00:14:47.897961+0000","last_fullsized":"2024-06-10T00:14:47.897961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:51.568143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035749+0000","last_change":"2024-06-10T00:14:41.865458+0000","last_active":"2024-06-10T00:14:48.035749+0000","last_peered":"2024-06-10T00:14:48.035749+0000","last_clean":"2024-06-10T00:14:48.035749+0000","last_became_active":"2024-06-10T00:14:41.865040+0000","last_became_peered":"2024-06-10T00:14:41.865040+0000","last_unstale":"2024-06-10T00:14:48.035749+0000","last_undegraded":"2024-06-10T00:14:48.035749+0000","last_fullsized":"2024-06-10T00:14:48.035749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:04.344977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898593+0000","last_change":"2024-06-10T00:14:42.859102+0000","last_active":"2024-06-10T00:14:47.898593+0000","last_peered":"2024-06-10T00:14:47.898593+0000","last_clean":"2024-06-10T00:14:47.898593+0000","last_became_active":"2024-06-10T00:14:42.858811+0000","last_became_peered":"2024-06-10T00:14:42.858811+0000","last_unstale":"2024-06-10T00:14:47.898593+0000","last_undegraded":"2024-06-10T00:14:47.898593+0000","last_fullsized":"2024-06-10T00:14:47.898593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:04.905009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898969+0000","last_change":"2024-06-10T00:14:46.889397+0000","last_active":"2024-06-10T00:14:47.898969+0000","last_peered":"2024-06-10T00:14:47.898969+0000","last_clean":"2024-06-10T00:14:47.898969+0000","last_became_active":"2024-06-10T00:14:46.888054+0000","last_became_peered":"2024-06-10T00:14:46.888054+0000","last_unstale":"2024-06-10T00:14:47.898969+0000","last_undegraded":"2024-06-10T00:14:47.898969+0000","last_fullsized":"2024-06-10T00:14:47.898969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:30.058992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035367+0000","last_change":"2024-06-10T00:14:41.866377+0000","last_active":"2024-06-10T00:14:48.035367+0000","last_peered":"2024-06-10T00:14:48.035367+0000","last_clean":"2024-06-10T00:14:48.035367+0000","last_became_active":"2024-06-10T00:14:41.865036+0000","last_became_peered":"2024-06-10T00:14:41.865036+0000","last_unstale":"2024-06-10T00:14:48.035367+0000","last_undegraded":"2024-06-10T00:14:48.035367+0000","last_fullsized":"2024-06-10T00:14:48.035367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899160+0000","last_change":"2024-06-10T00:14:42.860024+0000","last_active":"2024-06-10T00:14:47.899160+0000","last_peered":"2024-06-10T00:14:47.899160+0000","last_clean":"2024-06-10T00:14:47.899160+0000","last_became_active":"2024-06-10T00:14:42.859406+0000","last_became_peered":"2024-06-10T00:14:42.859406+0000","last_unstale":"2024-06-10T00:14:47.899160+0000","last_undegraded":"2024-06-10T00:14:47.899160+0000","last_fullsized":"2024-06-10T00:14:47.899160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:11.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898485+0000","last_change":"2024-06-10T00:14:46.886019+0000","last_active":"2024-06-10T00:14:47.898485+0000","last_peered":"2024-06-10T00:14:47.898485+0000","last_clean":"2024-06-10T00:14:47.898485+0000","last_became_active":"2024-06-10T00:14:46.885548+0000","last_became_peered":"2024-06-10T00:14:46.885548+0000","last_unstale":"2024-06-10T00:14:47.898485+0000","last_undegraded":"2024-06-10T00:14:47.898485+0000","last_fullsized":"2024-06-10T00:14:47.898485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:13.328779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035910+0000","last_change":"2024-06-10T00:14:42.874737+0000","last_active":"2024-06-10T00:14:48.035910+0000","last_peered":"2024-06-10T00:14:48.035910+0000","last_clean":"2024-06-10T00:14:48.035910+0000","last_became_active":"2024-06-10T00:14:42.874456+0000","last_became_peered":"2024-06-10T00:14:42.874456+0000","last_unstale":"2024-06-10T00:14:48.035910+0000","last_undegraded":"2024-06-10T00:14:48.035910+0000","last_fullsized":"2024-06-10T00:14:48.035910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035758+0000","last_change":"2024-06-10T00:14:41.867017+0000","last_active":"2024-06-10T00:14:48.035758+0000","last_peered":"2024-06-10T00:14:48.035758+0000","last_clean":"2024-06-10T00:14:48.035758+0000","last_became_active":"2024-06-10T00:14:41.866615+0000","last_became_peered":"2024-06-10T00:14:41.866615+0000","last_unstale":"2024-06-10T00:14:48.035758+0000","last_undegraded":"2024-06-10T00:14:48.035758+0000","last_fullsized":"2024-06-10T00:14:48.035758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899866+0000","last_change":"2024-06-10T00:14:46.887357+0000","last_active":"2024-06-10T00:14:47.899866+0000","last_peered":"2024-06-10T00:14:47.899866+0000","last_clean":"2024-06-10T00:14:47.899866+0000","last_became_active":"2024-06-10T00:14:46.886828+0000","last_became_peered":"2024-06-10T00:14:46.886828+0000","last_unstale":"2024-06-10T00:14:47.899866+0000","last_undegraded":"2024-06-10T00:14:47.899866+0000","last_fullsized":"2024-06-10T00:14:47.899866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016853+0000","last_change":"2024-06-10T00:14:42.874437+0000","last_active":"2024-06-10T00:14:48.016853+0000","last_peered":"2024-06-10T00:14:48.016853+0000","last_clean":"2024-06-10T00:14:48.016853+0000","last_became_active":"2024-06-10T00:14:42.871485+0000","last_became_peered":"2024-06-10T00:14:42.871485+0000","last_unstale":"2024-06-10T00:14:48.016853+0000","last_undegraded":"2024-06-10T00:14:48.016853+0000","last_fullsized":"2024-06-10T00:14:48.016853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036080+0000","last_change":"2024-06-10T00:14:41.860772+0000","last_active":"2024-06-10T00:14:48.036080+0000","last_peered":"2024-06-10T00:14:48.036080+0000","last_clean":"2024-06-10T00:14:48.036080+0000","last_became_active":"2024-06-10T00:14:41.860372+0000","last_became_peered":"2024-06-10T00:14:41.860372+0000","last_unstale":"2024-06-10T00:14:48.036080+0000","last_undegraded":"2024-06-10T00:14:48.036080+0000","last_fullsized":"2024-06-10T00:14:48.036080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898238+0000","last_change":"2024-06-10T00:14:46.888544+0000","last_active":"2024-06-10T00:14:47.898238+0000","last_peered":"2024-06-10T00:14:47.898238+0000","last_clean":"2024-06-10T00:14:47.898238+0000","last_became_active":"2024-06-10T00:14:46.887972+0000","last_became_peered":"2024-06-10T00:14:46.887972+0000","last_unstale":"2024-06-10T00:14:47.898238+0000","last_undegraded":"2024-06-10T00:14:47.898238+0000","last_fullsized":"2024-06-10T00:14:47.898238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:46.828253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016970+0000","last_change":"2024-06-10T00:14:42.871661+0000","last_active":"2024-06-10T00:14:48.016970+0000","last_peered":"2024-06-10T00:14:48.016970+0000","last_clean":"2024-06-10T00:14:48.016970+0000","last_became_active":"2024-06-10T00:14:42.870944+0000","last_became_peered":"2024-06-10T00:14:42.870944+0000","last_unstale":"2024-06-10T00:14:48.016970+0000","last_undegraded":"2024-06-10T00:14:48.016970+0000","last_fullsized":"2024-06-10T00:14:48.016970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035625+0000","last_change":"2024-06-10T00:14:41.863225+0000","last_active":"2024-06-10T00:14:48.035625+0000","last_peered":"2024-06-10T00:14:48.035625+0000","last_clean":"2024-06-10T00:14:48.035625+0000","last_became_active":"2024-06-10T00:14:41.862940+0000","last_became_peered":"2024-06-10T00:14:41.862940+0000","last_unstale":"2024-06-10T00:14:48.035625+0000","last_undegraded":"2024-06-10T00:14:48.035625+0000","last_fullsized":"2024-06-10T00:14:48.035625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036483+0000","last_change":"2024-06-10T00:14:46.990813+0000","last_active":"2024-06-10T00:14:48.036483+0000","last_peered":"2024-06-10T00:14:48.036483+0000","last_clean":"2024-06-10T00:14:48.036483+0000","last_became_active":"2024-06-10T00:14:46.990054+0000","last_became_peered":"2024-06-10T00:14:46.990054+0000","last_unstale":"2024-06-10T00:14:48.036483+0000","last_undegraded":"2024-06-10T00:14:48.036483+0000","last_fullsized":"2024-06-10T00:14:48.036483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:27.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898430+0000","last_change":"2024-06-10T00:14:42.864896+0000","last_active":"2024-06-10T00:14:47.898430+0000","last_peered":"2024-06-10T00:14:47.898430+0000","last_clean":"2024-06-10T00:14:47.898430+0000","last_became_active":"2024-06-10T00:14:42.864638+0000","last_became_peered":"2024-06-10T00:14:42.864638+0000","last_unstale":"2024-06-10T00:14:47.898430+0000","last_undegraded":"2024-06-10T00:14:47.898430+0000","last_fullsized":"2024-06-10T00:14:47.898430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:47.083423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035079+0000","last_change":"2024-06-10T00:14:41.866168+0000","last_active":"2024-06-10T00:14:48.035079+0000","last_peered":"2024-06-10T00:14:48.035079+0000","last_clean":"2024-06-10T00:14:48.035079+0000","last_became_active":"2024-06-10T00:14:41.865791+0000","last_became_peered":"2024-06-10T00:14:41.865791+0000","last_unstale":"2024-06-10T00:14:48.035079+0000","last_undegraded":"2024-06-10T00:14:48.035079+0000","last_fullsized":"2024-06-10T00:14:48.035079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:43.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899774+0000","last_change":"2024-06-10T00:14:46.886506+0000","last_active":"2024-06-10T00:14:47.899774+0000","last_peered":"2024-06-10T00:14:47.899774+0000","last_clean":"2024-06-10T00:14:47.899774+0000","last_became_active":"2024-06-10T00:14:46.885716+0000","last_became_peered":"2024-06-10T00:14:46.885716+0000","last_unstale":"2024-06-10T00:14:47.899774+0000","last_undegraded":"2024-06-10T00:14:47.899774+0000","last_fullsized":"2024-06-10T00:14:47.899774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:05.738780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035971+0000","last_change":"2024-06-10T00:14:42.863988+0000","last_active":"2024-06-10T00:14:48.035971+0000","last_peered":"2024-06-10T00:14:48.035971+0000","last_clean":"2024-06-10T00:14:48.035971+0000","last_became_active":"2024-06-10T00:14:42.863676+0000","last_became_peered":"2024-06-10T00:14:42.863676+0000","last_unstale":"2024-06-10T00:14:48.035971+0000","last_undegraded":"2024-06-10T00:14:48.035971+0000","last_fullsized":"2024-06-10T00:14:48.035971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036781+0000","last_change":"2024-06-10T00:14:41.868147+0000","last_active":"2024-06-10T00:14:48.036781+0000","last_peered":"2024-06-10T00:14:48.036781+0000","last_clean":"2024-06-10T00:14:48.036781+0000","last_became_active":"2024-06-10T00:14:41.867865+0000","last_became_peered":"2024-06-10T00:14:41.867865+0000","last_unstale":"2024-06-10T00:14:48.036781+0000","last_undegraded":"2024-06-10T00:14:48.036781+0000","last_fullsized":"2024-06-10T00:14:48.036781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898144+0000","last_change":"2024-06-10T00:14:46.988256+0000","last_active":"2024-06-10T00:14:47.898144+0000","last_peered":"2024-06-10T00:14:47.898144+0000","last_clean":"2024-06-10T00:14:47.898144+0000","last_became_active":"2024-06-10T00:14:46.987870+0000","last_became_peered":"2024-06-10T00:14:46.987870+0000","last_unstale":"2024-06-10T00:14:47.898144+0000","last_undegraded":"2024-06-10T00:14:47.898144+0000","last_fullsized":"2024-06-10T00:14:47.898144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:15.305106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017506+0000","last_change":"2024-06-10T00:14:42.867973+0000","last_active":"2024-06-10T00:14:48.017506+0000","last_peered":"2024-06-10T00:14:48.017506+0000","last_clean":"2024-06-10T00:14:48.017506+0000","last_became_active":"2024-06-10T00:14:42.867690+0000","last_became_peered":"2024-06-10T00:14:42.867690+0000","last_unstale":"2024-06-10T00:14:48.017506+0000","last_undegraded":"2024-06-10T00:14:48.017506+0000","last_fullsized":"2024-06-10T00:14:48.017506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036284+0000","last_change":"2024-06-10T00:14:41.868966+0000","last_active":"2024-06-10T00:14:48.036284+0000","last_peered":"2024-06-10T00:14:48.036284+0000","last_clean":"2024-06-10T00:14:48.036284+0000","last_became_active":"2024-06-10T00:14:41.868645+0000","last_became_peered":"2024-06-10T00:14:41.868645+0000","last_unstale":"2024-06-10T00:14:48.036284+0000","last_undegraded":"2024-06-10T00:14:48.036284+0000","last_fullsized":"2024-06-10T00:14:48.036284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016612+0000","last_change":"2024-06-10T00:14:46.990437+0000","last_active":"2024-06-10T00:14:48.016612+0000","last_peered":"2024-06-10T00:14:48.016612+0000","last_clean":"2024-06-10T00:14:48.016612+0000","last_became_active":"2024-06-10T00:14:46.990040+0000","last_became_peered":"2024-06-10T00:14:46.990040+0000","last_unstale":"2024-06-10T00:14:48.016612+0000","last_undegraded":"2024-06-10T00:14:48.016612+0000","last_fullsized":"2024-06-10T00:14:48.016612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:56:13.445267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036047+0000","last_change":"2024-06-10T00:14:42.859747+0000","last_active":"2024-06-10T00:14:48.036047+0000","last_peered":"2024-06-10T00:14:48.036047+0000","last_clean":"2024-06-10T00:14:48.036047+0000","last_became_active":"2024-06-10T00:14:42.859406+0000","last_became_peered":"2024-06-10T00:14:42.859406+0000","last_unstale":"2024-06-10T00:14:48.036047+0000","last_undegraded":"2024-06-10T00:14:48.036047+0000","last_fullsized":"2024-06-10T00:14:48.036047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035847+0000","last_change":"2024-06-10T00:14:41.868654+0000","last_active":"2024-06-10T00:14:48.035847+0000","last_peered":"2024-06-10T00:14:48.035847+0000","last_clean":"2024-06-10T00:14:48.035847+0000","last_became_active":"2024-06-10T00:14:41.868347+0000","last_became_peered":"2024-06-10T00:14:41.868347+0000","last_unstale":"2024-06-10T00:14:48.035847+0000","last_undegraded":"2024-06-10T00:14:48.035847+0000","last_fullsized":"2024-06-10T00:14:48.035847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:35:23.234029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035282+0000","last_change":"2024-06-10T00:14:46.988194+0000","last_active":"2024-06-10T00:14:48.035282+0000","last_peered":"2024-06-10T00:14:48.035282+0000","last_clean":"2024-06-10T00:14:48.035282+0000","last_became_active":"2024-06-10T00:14:46.987822+0000","last_became_peered":"2024-06-10T00:14:46.987822+0000","last_unstale":"2024-06-10T00:14:48.035282+0000","last_undegraded":"2024-06-10T00:14:48.035282+0000","last_fullsized":"2024-06-10T00:14:48.035282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899279+0000","last_change":"2024-06-10T00:14:42.866515+0000","last_active":"2024-06-10T00:14:47.899279+0000","last_peered":"2024-06-10T00:14:47.899279+0000","last_clean":"2024-06-10T00:14:47.899279+0000","last_became_active":"2024-06-10T00:14:42.866202+0000","last_became_peered":"2024-06-10T00:14:42.866202+0000","last_unstale":"2024-06-10T00:14:47.899279+0000","last_undegraded":"2024-06-10T00:14:47.899279+0000","last_fullsized":"2024-06-10T00:14:47.899279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036142+0000","last_change":"2024-06-10T00:14:41.862650+0000","last_active":"2024-06-10T00:14:48.036142+0000","last_peered":"2024-06-10T00:14:48.036142+0000","last_clean":"2024-06-10T00:14:48.036142+0000","last_became_active":"2024-06-10T00:14:41.862386+0000","last_became_peered":"2024-06-10T00:14:41.862386+0000","last_unstale":"2024-06-10T00:14:48.036142+0000","last_undegraded":"2024-06-10T00:14:48.036142+0000","last_fullsized":"2024-06-10T00:14:48.036142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035886+0000","last_change":"2024-06-10T00:14:46.894074+0000","last_active":"2024-06-10T00:14:48.035886+0000","last_peered":"2024-06-10T00:14:48.035886+0000","last_clean":"2024-06-10T00:14:48.035886+0000","last_became_active":"2024-06-10T00:14:46.893369+0000","last_became_peered":"2024-06-10T00:14:46.893369+0000","last_unstale":"2024-06-10T00:14:48.035886+0000","last_undegraded":"2024-06-10T00:14:48.035886+0000","last_fullsized":"2024-06-10T00:14:48.035886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899512+0000","last_change":"2024-06-10T00:14:42.866544+0000","last_active":"2024-06-10T00:14:47.899512+0000","last_peered":"2024-06-10T00:14:47.899512+0000","last_clean":"2024-06-10T00:14:47.899512+0000","last_became_active":"2024-06-10T00:14:42.865366+0000","last_became_peered":"2024-06-10T00:14:42.865366+0000","last_unstale":"2024-06-10T00:14:47.899512+0000","last_undegraded":"2024-06-10T00:14:47.899512+0000","last_fullsized":"2024-06-10T00:14:47.899512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:23.595724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899407+0000","last_change":"2024-06-10T00:14:41.861648+0000","last_active":"2024-06-10T00:14:47.899407+0000","last_peered":"2024-06-10T00:14:47.899407+0000","last_clean":"2024-06-10T00:14:47.899407+0000","last_became_active":"2024-06-10T00:14:41.861363+0000","last_became_peered":"2024-06-10T00:14:41.861363+0000","last_unstale":"2024-06-10T00:14:47.899407+0000","last_undegraded":"2024-06-10T00:14:47.899407+0000","last_fullsized":"2024-06-10T00:14:47.899407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:40:22.590387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036077+0000","last_change":"2024-06-10T00:14:46.886310+0000","last_active":"2024-06-10T00:14:48.036077+0000","last_peered":"2024-06-10T00:14:48.036077+0000","last_clean":"2024-06-10T00:14:48.036077+0000","last_became_active":"2024-06-10T00:14:46.885934+0000","last_became_peered":"2024-06-10T00:14:46.885934+0000","last_unstale":"2024-06-10T00:14:48.036077+0000","last_undegraded":"2024-06-10T00:14:48.036077+0000","last_fullsized":"2024-06-10T00:14:48.036077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:08.929668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035314+0000","last_change":"2024-06-10T00:14:42.860757+0000","last_active":"2024-06-10T00:14:48.035314+0000","last_peered":"2024-06-10T00:14:48.035314+0000","last_clean":"2024-06-10T00:14:48.035314+0000","last_became_active":"2024-06-10T00:14:42.860420+0000","last_became_peered":"2024-06-10T00:14:42.860420+0000","last_unstale":"2024-06-10T00:14:48.035314+0000","last_undegraded":"2024-06-10T00:14:48.035314+0000","last_fullsized":"2024-06-10T00:14:48.035314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897376+0000","last_change":"2024-06-10T00:14:41.858056+0000","last_active":"2024-06-10T00:14:47.897376+0000","last_peered":"2024-06-10T00:14:47.897376+0000","last_clean":"2024-06-10T00:14:47.897376+0000","last_became_active":"2024-06-10T00:14:41.857761+0000","last_became_peered":"2024-06-10T00:14:41.857761+0000","last_unstale":"2024-06-10T00:14:47.897376+0000","last_undegraded":"2024-06-10T00:14:47.897376+0000","last_fullsized":"2024-06-10T00:14:47.897376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036543+0000","last_change":"2024-06-10T00:14:46.894221+0000","last_active":"2024-06-10T00:14:48.036543+0000","last_peered":"2024-06-10T00:14:48.036543+0000","last_clean":"2024-06-10T00:14:48.036543+0000","last_became_active":"2024-06-10T00:14:46.893698+0000","last_became_peered":"2024-06-10T00:14:46.893698+0000","last_unstale":"2024-06-10T00:14:48.036543+0000","last_undegraded":"2024-06-10T00:14:48.036543+0000","last_fullsized":"2024-06-10T00:14:48.036543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:36.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.034921+0000","last_change":"2024-06-10T00:14:42.873418+0000","last_active":"2024-06-10T00:14:48.034921+0000","last_peered":"2024-06-10T00:14:48.034921+0000","last_clean":"2024-06-10T00:14:48.034921+0000","last_became_active":"2024-06-10T00:14:42.872202+0000","last_became_peered":"2024-06-10T00:14:42.872202+0000","last_unstale":"2024-06-10T00:14:48.034921+0000","last_undegraded":"2024-06-10T00:14:48.034921+0000","last_fullsized":"2024-06-10T00:14:48.034921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035121+0000","last_change":"2024-06-10T00:14:41.863805+0000","last_active":"2024-06-10T00:14:48.035121+0000","last_peered":"2024-06-10T00:14:48.035121+0000","last_clean":"2024-06-10T00:14:48.035121+0000","last_became_active":"2024-06-10T00:14:41.863518+0000","last_became_peered":"2024-06-10T00:14:41.863518+0000","last_unstale":"2024-06-10T00:14:48.035121+0000","last_undegraded":"2024-06-10T00:14:48.035121+0000","last_fullsized":"2024-06-10T00:14:48.035121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:38:57.655573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035793+0000","last_change":"2024-06-10T00:14:46.988209+0000","last_active":"2024-06-10T00:14:48.035793+0000","last_peered":"2024-06-10T00:14:48.035793+0000","last_clean":"2024-06-10T00:14:48.035793+0000","last_became_active":"2024-06-10T00:14:46.987834+0000","last_became_peered":"2024-06-10T00:14:46.987834+0000","last_unstale":"2024-06-10T00:14:48.035793+0000","last_undegraded":"2024-06-10T00:14:48.035793+0000","last_fullsized":"2024-06-10T00:14:48.035793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:36.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016903+0000","last_change":"2024-06-10T00:14:42.867535+0000","last_active":"2024-06-10T00:14:48.016903+0000","last_peered":"2024-06-10T00:14:48.016903+0000","last_clean":"2024-06-10T00:14:48.016903+0000","last_became_active":"2024-06-10T00:14:42.867224+0000","last_became_peered":"2024-06-10T00:14:42.867224+0000","last_unstale":"2024-06-10T00:14:48.016903+0000","last_undegraded":"2024-06-10T00:14:48.016903+0000","last_fullsized":"2024-06-10T00:14:48.016903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899686+0000","last_change":"2024-06-10T00:14:41.858886+0000","last_active":"2024-06-10T00:14:47.899686+0000","last_peered":"2024-06-10T00:14:47.899686+0000","last_clean":"2024-06-10T00:14:47.899686+0000","last_became_active":"2024-06-10T00:14:41.858568+0000","last_became_peered":"2024-06-10T00:14:41.858568+0000","last_unstale":"2024-06-10T00:14:47.899686+0000","last_undegraded":"2024-06-10T00:14:47.899686+0000","last_fullsized":"2024-06-10T00:14:47.899686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035569+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:14:48.035569+0000","last_peered":"2024-06-10T00:14:48.035569+0000","last_clean":"2024-06-10T00:14:48.035569+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:14:48.035569+0000","last_undegraded":"2024-06-10T00:14:48.035569+0000","last_fullsized":"2024-06-10T00:14:48.035569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036528+0000","last_change":"2024-06-10T00:14:46.989884+0000","last_active":"2024-06-10T00:14:48.036528+0000","last_peered":"2024-06-10T00:14:48.036528+0000","last_clean":"2024-06-10T00:14:48.036528+0000","last_became_active":"2024-06-10T00:14:46.988326+0000","last_became_peered":"2024-06-10T00:14:46.988326+0000","last_unstale":"2024-06-10T00:14:48.036528+0000","last_undegraded":"2024-06-10T00:14:48.036528+0000","last_fullsized":"2024-06-10T00:14:48.036528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:05.738780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035660+0000","last_change":"2024-06-10T00:14:42.875447+0000","last_active":"2024-06-10T00:14:48.035660+0000","last_peered":"2024-06-10T00:14:48.035660+0000","last_clean":"2024-06-10T00:14:48.035660+0000","last_became_active":"2024-06-10T00:14:42.875163+0000","last_became_peered":"2024-06-10T00:14:42.875163+0000","last_unstale":"2024-06-10T00:14:48.035660+0000","last_undegraded":"2024-06-10T00:14:48.035660+0000","last_fullsized":"2024-06-10T00:14:48.035660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:43.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897639+0000","last_change":"2024-06-10T00:14:41.859030+0000","last_active":"2024-06-10T00:14:47.897639+0000","last_peered":"2024-06-10T00:14:47.897639+0000","last_clean":"2024-06-10T00:14:47.897639+0000","last_became_active":"2024-06-10T00:14:41.858721+0000","last_became_peered":"2024-06-10T00:14:41.858721+0000","last_unstale":"2024-06-10T00:14:47.897639+0000","last_undegraded":"2024-06-10T00:14:47.897639+0000","last_fullsized":"2024-06-10T00:14:47.897639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035781+0000","last_change":"2024-06-10T00:14:46.989519+0000","last_active":"2024-06-10T00:14:48.035781+0000","last_peered":"2024-06-10T00:14:48.035781+0000","last_clean":"2024-06-10T00:14:48.035781+0000","last_became_active":"2024-06-10T00:14:46.988160+0000","last_became_peered":"2024-06-10T00:14:46.988160+0000","last_unstale":"2024-06-10T00:14:48.035781+0000","last_undegraded":"2024-06-10T00:14:48.035781+0000","last_fullsized":"2024-06-10T00:14:48.035781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:37.577252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898697+0000","last_change":"2024-06-10T00:14:42.873285+0000","last_active":"2024-06-10T00:14:47.898697+0000","last_peered":"2024-06-10T00:14:47.898697+0000","last_clean":"2024-06-10T00:14:47.898697+0000","last_became_active":"2024-06-10T00:14:42.872722+0000","last_became_peered":"2024-06-10T00:14:42.872722+0000","last_unstale":"2024-06-10T00:14:47.898697+0000","last_undegraded":"2024-06-10T00:14:47.898697+0000","last_fullsized":"2024-06-10T00:14:47.898697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:23.901714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036246+0000","last_change":"2024-06-10T00:14:41.859803+0000","last_active":"2024-06-10T00:14:48.036246+0000","last_peered":"2024-06-10T00:14:48.036246+0000","last_clean":"2024-06-10T00:14:48.036246+0000","last_became_active":"2024-06-10T00:14:41.859233+0000","last_became_peered":"2024-06-10T00:14:41.859233+0000","last_unstale":"2024-06-10T00:14:48.036246+0000","last_undegraded":"2024-06-10T00:14:48.036246+0000","last_fullsized":"2024-06-10T00:14:48.036246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:04.344977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035388+0000","last_change":"2024-06-10T00:14:46.892114+0000","last_active":"2024-06-10T00:14:48.035388+0000","last_peered":"2024-06-10T00:14:48.035388+0000","last_clean":"2024-06-10T00:14:48.035388+0000","last_became_active":"2024-06-10T00:14:46.891627+0000","last_became_peered":"2024-06-10T00:14:46.891627+0000","last_unstale":"2024-06-10T00:14:48.035388+0000","last_undegraded":"2024-06-10T00:14:48.035388+0000","last_fullsized":"2024-06-10T00:14:48.035388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:16.762113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036057+0000","last_change":"2024-06-10T00:14:42.880436+0000","last_active":"2024-06-10T00:14:48.036057+0000","last_peered":"2024-06-10T00:14:48.036057+0000","last_clean":"2024-06-10T00:14:48.036057+0000","last_became_active":"2024-06-10T00:14:42.880194+0000","last_became_peered":"2024-06-10T00:14:42.880194+0000","last_unstale":"2024-06-10T00:14:48.036057+0000","last_undegraded":"2024-06-10T00:14:48.036057+0000","last_fullsized":"2024-06-10T00:14:48.036057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:54:40.334756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897719+0000","last_change":"2024-06-10T00:14:41.857224+0000","last_active":"2024-06-10T00:14:47.897719+0000","last_peered":"2024-06-10T00:14:47.897719+0000","last_clean":"2024-06-10T00:14:47.897719+0000","last_became_active":"2024-06-10T00:14:41.856764+0000","last_became_peered":"2024-06-10T00:14:41.856764+0000","last_unstale":"2024-06-10T00:14:47.897719+0000","last_undegraded":"2024-06-10T00:14:47.897719+0000","last_fullsized":"2024-06-10T00:14:47.897719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:32:16.264432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898625+0000","last_change":"2024-06-10T00:14:46.988209+0000","last_active":"2024-06-10T00:14:47.898625+0000","last_peered":"2024-06-10T00:14:47.898625+0000","last_clean":"2024-06-10T00:14:47.898625+0000","last_became_active":"2024-06-10T00:14:46.987828+0000","last_became_peered":"2024-06-10T00:14:46.987828+0000","last_unstale":"2024-06-10T00:14:47.898625+0000","last_undegraded":"2024-06-10T00:14:47.898625+0000","last_fullsized":"2024-06-10T00:14:47.898625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:55.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035649+0000","last_change":"2024-06-10T00:14:42.872751+0000","last_active":"2024-06-10T00:14:48.035649+0000","last_peered":"2024-06-10T00:14:48.035649+0000","last_clean":"2024-06-10T00:14:48.035649+0000","last_became_active":"2024-06-10T00:14:42.872474+0000","last_became_peered":"2024-06-10T00:14:42.872474+0000","last_unstale":"2024-06-10T00:14:48.035649+0000","last_undegraded":"2024-06-10T00:14:48.035649+0000","last_fullsized":"2024-06-10T00:14:48.035649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:23.901714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899907+0000","last_change":"2024-06-10T00:14:41.862996+0000","last_active":"2024-06-10T00:14:47.899907+0000","last_peered":"2024-06-10T00:14:47.899907+0000","last_clean":"2024-06-10T00:14:47.899907+0000","last_became_active":"2024-06-10T00:14:41.862737+0000","last_became_peered":"2024-06-10T00:14:41.862737+0000","last_unstale":"2024-06-10T00:14:47.899907+0000","last_undegraded":"2024-06-10T00:14:47.899907+0000","last_fullsized":"2024-06-10T00:14:47.899907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:33:44.025553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897822+0000","last_change":"2024-06-10T00:14:46.888769+0000","last_active":"2024-06-10T00:14:47.897822+0000","last_peered":"2024-06-10T00:14:47.897822+0000","last_clean":"2024-06-10T00:14:47.897822+0000","last_became_active":"2024-06-10T00:14:46.887888+0000","last_became_peered":"2024-06-10T00:14:46.887888+0000","last_unstale":"2024-06-10T00:14:47.897822+0000","last_undegraded":"2024-06-10T00:14:47.897822+0000","last_fullsized":"2024-06-10T00:14:47.897822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:54.764215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035898+0000","last_change":"2024-06-10T00:14:42.874352+0000","last_active":"2024-06-10T00:14:48.035898+0000","last_peered":"2024-06-10T00:14:48.035898+0000","last_clean":"2024-06-10T00:14:48.035898+0000","last_became_active":"2024-06-10T00:14:42.874088+0000","last_became_peered":"2024-06-10T00:14:42.874088+0000","last_unstale":"2024-06-10T00:14:48.035898+0000","last_undegraded":"2024-06-10T00:14:48.035898+0000","last_fullsized":"2024-06-10T00:14:48.035898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897293+0000","last_change":"2024-06-10T00:14:41.859732+0000","last_active":"2024-06-10T00:14:47.897293+0000","last_peered":"2024-06-10T00:14:47.897293+0000","last_clean":"2024-06-10T00:14:47.897293+0000","last_became_active":"2024-06-10T00:14:41.859467+0000","last_became_peered":"2024-06-10T00:14:41.859467+0000","last_unstale":"2024-06-10T00:14:47.897293+0000","last_undegraded":"2024-06-10T00:14:47.897293+0000","last_fullsized":"2024-06-10T00:14:47.897293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035648+0000","last_change":"2024-06-10T00:14:46.892523+0000","last_active":"2024-06-10T00:14:48.035648+0000","last_peered":"2024-06-10T00:14:48.035648+0000","last_clean":"2024-06-10T00:14:48.035648+0000","last_became_active":"2024-06-10T00:14:46.892158+0000","last_became_peered":"2024-06-10T00:14:46.892158+0000","last_unstale":"2024-06-10T00:14:48.035648+0000","last_undegraded":"2024-06-10T00:14:48.035648+0000","last_fullsized":"2024-06-10T00:14:48.035648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:27.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035229+0000","last_change":"2024-06-10T00:14:42.871097+0000","last_active":"2024-06-10T00:14:48.035229+0000","last_peered":"2024-06-10T00:14:48.035229+0000","last_clean":"2024-06-10T00:14:48.035229+0000","last_became_active":"2024-06-10T00:14:42.870727+0000","last_became_peered":"2024-06-10T00:14:42.870727+0000","last_unstale":"2024-06-10T00:14:48.035229+0000","last_undegraded":"2024-06-10T00:14:48.035229+0000","last_fullsized":"2024-06-10T00:14:48.035229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035767+0000","last_change":"2024-06-10T00:14:41.865937+0000","last_active":"2024-06-10T00:14:48.035767+0000","last_peered":"2024-06-10T00:14:48.035767+0000","last_clean":"2024-06-10T00:14:48.035767+0000","last_became_active":"2024-06-10T00:14:41.865669+0000","last_became_peered":"2024-06-10T00:14:41.865669+0000","last_unstale":"2024-06-10T00:14:48.035767+0000","last_undegraded":"2024-06-10T00:14:48.035767+0000","last_fullsized":"2024-06-10T00:14:48.035767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017480+0000","last_change":"2024-06-10T00:14:46.991940+0000","last_active":"2024-06-10T00:14:48.017480+0000","last_peered":"2024-06-10T00:14:48.017480+0000","last_clean":"2024-06-10T00:14:48.017480+0000","last_became_active":"2024-06-10T00:14:46.991212+0000","last_became_peered":"2024-06-10T00:14:46.991212+0000","last_unstale":"2024-06-10T00:14:48.017480+0000","last_undegraded":"2024-06-10T00:14:48.017480+0000","last_fullsized":"2024-06-10T00:14:48.017480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:46:12.021856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035567+0000","last_change":"2024-06-10T00:14:42.873727+0000","last_active":"2024-06-10T00:14:48.035567+0000","last_peered":"2024-06-10T00:14:48.035567+0000","last_clean":"2024-06-10T00:14:48.035567+0000","last_became_active":"2024-06-10T00:14:42.873459+0000","last_became_peered":"2024-06-10T00:14:42.873459+0000","last_unstale":"2024-06-10T00:14:48.035567+0000","last_undegraded":"2024-06-10T00:14:48.035567+0000","last_fullsized":"2024-06-10T00:14:48.035567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:01.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899344+0000","last_change":"2024-06-10T00:14:41.864175+0000","last_active":"2024-06-10T00:14:47.899344+0000","last_peered":"2024-06-10T00:14:47.899344+0000","last_clean":"2024-06-10T00:14:47.899344+0000","last_became_active":"2024-06-10T00:14:41.863904+0000","last_became_peered":"2024-06-10T00:14:41.863904+0000","last_unstale":"2024-06-10T00:14:47.899344+0000","last_undegraded":"2024-06-10T00:14:47.899344+0000","last_fullsized":"2024-06-10T00:14:47.899344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017189+0000","last_change":"2024-06-10T00:14:46.992939+0000","last_active":"2024-06-10T00:14:48.017189+0000","last_peered":"2024-06-10T00:14:48.017189+0000","last_clean":"2024-06-10T00:14:48.017189+0000","last_became_active":"2024-06-10T00:14:46.991804+0000","last_became_peered":"2024-06-10T00:14:46.991804+0000","last_unstale":"2024-06-10T00:14:48.017189+0000","last_undegraded":"2024-06-10T00:14:48.017189+0000","last_fullsized":"2024-06-10T00:14:48.017189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:29:27.598667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035115+0000","last_change":"2024-06-10T00:14:42.874718+0000","last_active":"2024-06-10T00:14:48.035115+0000","last_peered":"2024-06-10T00:14:48.035115+0000","last_clean":"2024-06-10T00:14:48.035115+0000","last_became_active":"2024-06-10T00:14:42.873485+0000","last_became_peered":"2024-06-10T00:14:42.873485+0000","last_unstale":"2024-06-10T00:14:48.035115+0000","last_undegraded":"2024-06-10T00:14:48.035115+0000","last_fullsized":"2024-06-10T00:14:48.035115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:38:52.325465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035564+0000","last_change":"2024-06-10T00:14:41.863792+0000","last_active":"2024-06-10T00:14:48.035564+0000","last_peered":"2024-06-10T00:14:48.035564+0000","last_clean":"2024-06-10T00:14:48.035564+0000","last_became_active":"2024-06-10T00:14:41.863525+0000","last_became_peered":"2024-06-10T00:14:41.863525+0000","last_unstale":"2024-06-10T00:14:48.035564+0000","last_undegraded":"2024-06-10T00:14:48.035564+0000","last_fullsized":"2024-06-10T00:14:48.035564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:21.351313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899455+0000","last_change":"2024-06-10T00:14:46.989177+0000","last_active":"2024-06-10T00:14:47.899455+0000","last_peered":"2024-06-10T00:14:47.899455+0000","last_clean":"2024-06-10T00:14:47.899455+0000","last_became_active":"2024-06-10T00:14:46.988818+0000","last_became_peered":"2024-06-10T00:14:46.988818+0000","last_unstale":"2024-06-10T00:14:47.899455+0000","last_undegraded":"2024-06-10T00:14:47.899455+0000","last_fullsized":"2024-06-10T00:14:47.899455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:52.363831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035517+0000","last_change":"2024-06-10T00:14:42.876047+0000","last_active":"2024-06-10T00:14:48.035517+0000","last_peered":"2024-06-10T00:14:48.035517+0000","last_clean":"2024-06-10T00:14:48.035517+0000","last_became_active":"2024-06-10T00:14:42.875789+0000","last_became_peered":"2024-06-10T00:14:42.875789+0000","last_unstale":"2024-06-10T00:14:48.035517+0000","last_undegraded":"2024-06-10T00:14:48.035517+0000","last_fullsized":"2024-06-10T00:14:48.035517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:33.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:52.223703+0000","last_change":"2024-06-10T00:14:41.866777+0000","last_active":"2024-06-10T00:14:52.223703+0000","last_peered":"2024-06-10T00:14:52.223703+0000","last_clean":"2024-06-10T00:14:52.223703+0000","last_became_active":"2024-06-10T00:14:41.866439+0000","last_became_peered":"2024-06-10T00:14:41.866439+0000","last_unstale":"2024-06-10T00:14:52.223703+0000","last_undegraded":"2024-06-10T00:14:52.223703+0000","last_fullsized":"2024-06-10T00:14:52.223703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035977+0000","last_change":"2024-06-10T00:14:46.893648+0000","last_active":"2024-06-10T00:14:48.035977+0000","last_peered":"2024-06-10T00:14:48.035977+0000","last_clean":"2024-06-10T00:14:48.035977+0000","last_became_active":"2024-06-10T00:14:46.893153+0000","last_became_peered":"2024-06-10T00:14:46.893153+0000","last_unstale":"2024-06-10T00:14:48.035977+0000","last_undegraded":"2024-06-10T00:14:48.035977+0000","last_fullsized":"2024-06-10T00:14:48.035977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:16.762113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899660+0000","last_change":"2024-06-10T00:14:42.869743+0000","last_active":"2024-06-10T00:14:47.899660+0000","last_peered":"2024-06-10T00:14:47.899660+0000","last_clean":"2024-06-10T00:14:47.899660+0000","last_became_active":"2024-06-10T00:14:42.869432+0000","last_became_peered":"2024-06-10T00:14:42.869432+0000","last_unstale":"2024-06-10T00:14:47.899660+0000","last_undegraded":"2024-06-10T00:14:47.899660+0000","last_fullsized":"2024-06-10T00:14:47.899660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:44.600998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036249+0000","last_change":"2024-06-10T00:14:41.859872+0000","last_active":"2024-06-10T00:14:48.036249+0000","last_peered":"2024-06-10T00:14:48.036249+0000","last_clean":"2024-06-10T00:14:48.036249+0000","last_became_active":"2024-06-10T00:14:41.859529+0000","last_became_peered":"2024-06-10T00:14:41.859529+0000","last_unstale":"2024-06-10T00:14:48.036249+0000","last_undegraded":"2024-06-10T00:14:48.036249+0000","last_fullsized":"2024-06-10T00:14:48.036249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:43.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899198+0000","last_change":"2024-06-10T00:14:46.887779+0000","last_active":"2024-06-10T00:14:47.899198+0000","last_peered":"2024-06-10T00:14:47.899198+0000","last_clean":"2024-06-10T00:14:47.899198+0000","last_became_active":"2024-06-10T00:14:46.887388+0000","last_became_peered":"2024-06-10T00:14:46.887388+0000","last_unstale":"2024-06-10T00:14:47.899198+0000","last_undegraded":"2024-06-10T00:14:47.899198+0000","last_fullsized":"2024-06-10T00:14:47.899198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:37.577252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035674+0000","last_change":"2024-06-10T00:14:42.868290+0000","last_active":"2024-06-10T00:14:48.035674+0000","last_peered":"2024-06-10T00:14:48.035674+0000","last_clean":"2024-06-10T00:14:48.035674+0000","last_became_active":"2024-06-10T00:14:42.868004+0000","last_became_peered":"2024-06-10T00:14:42.868004+0000","last_unstale":"2024-06-10T00:14:48.035674+0000","last_undegraded":"2024-06-10T00:14:48.035674+0000","last_fullsized":"2024-06-10T00:14:48.035674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898788+0000","last_change":"2024-06-10T00:14:41.865384+0000","last_active":"2024-06-10T00:14:47.898788+0000","last_peered":"2024-06-10T00:14:47.898788+0000","last_clean":"2024-06-10T00:14:47.898788+0000","last_became_active":"2024-06-10T00:14:41.865032+0000","last_became_peered":"2024-06-10T00:14:41.865032+0000","last_unstale":"2024-06-10T00:14:47.898788+0000","last_undegraded":"2024-06-10T00:14:47.898788+0000","last_fullsized":"2024-06-10T00:14:47.898788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:46.078086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016834+0000","last_change":"2024-06-10T00:14:46.886924+0000","last_active":"2024-06-10T00:14:48.016834+0000","last_peered":"2024-06-10T00:14:48.016834+0000","last_clean":"2024-06-10T00:14:48.016834+0000","last_became_active":"2024-06-10T00:14:46.886412+0000","last_became_peered":"2024-06-10T00:14:46.886412+0000","last_unstale":"2024-06-10T00:14:48.016834+0000","last_undegraded":"2024-06-10T00:14:48.016834+0000","last_fullsized":"2024-06-10T00:14:48.016834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:55.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898784+0000","last_change":"2024-06-10T00:14:42.869511+0000","last_active":"2024-06-10T00:14:47.898784+0000","last_peered":"2024-06-10T00:14:47.898784+0000","last_clean":"2024-06-10T00:14:47.898784+0000","last_became_active":"2024-06-10T00:14:42.868972+0000","last_became_peered":"2024-06-10T00:14:42.868972+0000","last_unstale":"2024-06-10T00:14:47.898784+0000","last_undegraded":"2024-06-10T00:14:47.898784+0000","last_fullsized":"2024-06-10T00:14:47.898784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:33.552593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036681+0000","last_change":"2024-06-10T00:14:41.866593+0000","last_active":"2024-06-10T00:14:48.036681+0000","last_peered":"2024-06-10T00:14:48.036681+0000","last_clean":"2024-06-10T00:14:48.036681+0000","last_became_active":"2024-06-10T00:14:41.866325+0000","last_became_peered":"2024-06-10T00:14:41.866325+0000","last_unstale":"2024-06-10T00:14:48.036681+0000","last_undegraded":"2024-06-10T00:14:48.036681+0000","last_fullsized":"2024-06-10T00:14:48.036681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:36.265171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016738+0000","last_change":"2024-06-10T00:14:46.990368+0000","last_active":"2024-06-10T00:14:48.016738+0000","last_peered":"2024-06-10T00:14:48.016738+0000","last_clean":"2024-06-10T00:14:48.016738+0000","last_became_active":"2024-06-10T00:14:46.989951+0000","last_became_peered":"2024-06-10T00:14:46.989951+0000","last_unstale":"2024-06-10T00:14:48.016738+0000","last_undegraded":"2024-06-10T00:14:48.016738+0000","last_fullsized":"2024-06-10T00:14:48.016738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:56:04.088356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035504+0000","last_change":"2024-06-10T00:14:46.990321+0000","last_active":"2024-06-10T00:14:48.035504+0000","last_peered":"2024-06-10T00:14:48.035504+0000","last_clean":"2024-06-10T00:14:48.035504+0000","last_became_active":"2024-06-10T00:14:46.989969+0000","last_became_peered":"2024-06-10T00:14:46.989969+0000","last_unstale":"2024-06-10T00:14:48.035504+0000","last_undegraded":"2024-06-10T00:14:48.035504+0000","last_fullsized":"2024-06-10T00:14:48.035504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:08.929668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035435+0000","last_change":"2024-06-10T00:14:42.876343+0000","last_active":"2024-06-10T00:14:48.035435+0000","last_peered":"2024-06-10T00:14:48.035435+0000","last_clean":"2024-06-10T00:14:48.035435+0000","last_became_active":"2024-06-10T00:14:42.876035+0000","last_became_peered":"2024-06-10T00:14:42.876035+0000","last_unstale":"2024-06-10T00:14:48.035435+0000","last_undegraded":"2024-06-10T00:14:48.035435+0000","last_fullsized":"2024-06-10T00:14:48.035435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898153+0000","last_change":"2024-06-10T00:14:41.856933+0000","last_active":"2024-06-10T00:14:47.898153+0000","last_peered":"2024-06-10T00:14:47.898153+0000","last_clean":"2024-06-10T00:14:47.898153+0000","last_became_active":"2024-06-10T00:14:41.856621+0000","last_became_peered":"2024-06-10T00:14:41.856621+0000","last_unstale":"2024-06-10T00:14:47.898153+0000","last_undegraded":"2024-06-10T00:14:47.898153+0000","last_fullsized":"2024-06-10T00:14:47.898153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036551+0000","last_change":"2024-06-10T00:14:46.889437+0000","last_active":"2024-06-10T00:14:48.036551+0000","last_peered":"2024-06-10T00:14:48.036551+0000","last_clean":"2024-06-10T00:14:48.036551+0000","last_became_active":"2024-06-10T00:14:46.888842+0000","last_became_peered":"2024-06-10T00:14:46.888842+0000","last_unstale":"2024-06-10T00:14:48.036551+0000","last_undegraded":"2024-06-10T00:14:48.036551+0000","last_fullsized":"2024-06-10T00:14:48.036551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:47.409705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016928+0000","last_change":"2024-06-10T00:14:42.874887+0000","last_active":"2024-06-10T00:14:48.016928+0000","last_peered":"2024-06-10T00:14:48.016928+0000","last_clean":"2024-06-10T00:14:48.016928+0000","last_became_active":"2024-06-10T00:14:42.871122+0000","last_became_peered":"2024-06-10T00:14:42.871122+0000","last_unstale":"2024-06-10T00:14:48.016928+0000","last_undegraded":"2024-06-10T00:14:48.016928+0000","last_fullsized":"2024-06-10T00:14:48.016928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016934+0000","last_change":"2024-06-10T00:14:41.869171+0000","last_active":"2024-06-10T00:14:48.016934+0000","last_peered":"2024-06-10T00:14:48.016934+0000","last_clean":"2024-06-10T00:14:48.016934+0000","last_became_active":"2024-06-10T00:14:41.868845+0000","last_became_peered":"2024-06-10T00:14:41.868845+0000","last_unstale":"2024-06-10T00:14:48.016934+0000","last_undegraded":"2024-06-10T00:14:48.016934+0000","last_fullsized":"2024-06-10T00:14:48.016934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:09:21.566143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036070+0000","last_change":"2024-06-10T00:14:41.864391+0000","last_active":"2024-06-10T00:14:48.036070+0000","last_peered":"2024-06-10T00:14:48.036070+0000","last_clean":"2024-06-10T00:14:48.036070+0000","last_became_active":"2024-06-10T00:14:41.864117+0000","last_became_peered":"2024-06-10T00:14:41.864117+0000","last_unstale":"2024-06-10T00:14:48.036070+0000","last_undegraded":"2024-06-10T00:14:48.036070+0000","last_fullsized":"2024-06-10T00:14:48.036070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:17.703626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035534+0000","last_change":"2024-06-10T00:14:42.869238+0000","last_active":"2024-06-10T00:14:48.035534+0000","last_peered":"2024-06-10T00:14:48.035534+0000","last_clean":"2024-06-10T00:14:48.035534+0000","last_became_active":"2024-06-10T00:14:42.868630+0000","last_became_peered":"2024-06-10T00:14:42.868630+0000","last_unstale":"2024-06-10T00:14:48.035534+0000","last_undegraded":"2024-06-10T00:14:48.035534+0000","last_fullsized":"2024-06-10T00:14:48.035534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897449+0000","last_change":"2024-06-10T00:14:46.886409+0000","last_active":"2024-06-10T00:14:47.897449+0000","last_peered":"2024-06-10T00:14:47.897449+0000","last_clean":"2024-06-10T00:14:47.897449+0000","last_became_active":"2024-06-10T00:14:46.886014+0000","last_became_peered":"2024-06-10T00:14:46.886014+0000","last_unstale":"2024-06-10T00:14:47.897449+0000","last_undegraded":"2024-06-10T00:14:47.897449+0000","last_fullsized":"2024-06-10T00:14:47.897449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:52.056077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016946+0000","last_change":"2024-06-10T00:14:41.862965+0000","last_active":"2024-06-10T00:14:48.016946+0000","last_peered":"2024-06-10T00:14:48.016946+0000","last_clean":"2024-06-10T00:14:48.016946+0000","last_became_active":"2024-06-10T00:14:41.862590+0000","last_became_peered":"2024-06-10T00:14:41.862590+0000","last_unstale":"2024-06-10T00:14:48.016946+0000","last_undegraded":"2024-06-10T00:14:48.016946+0000","last_fullsized":"2024-06-10T00:14:48.016946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:40.834665+0000","last_clean_scrub_stamp":"2024-06-10T00:14:40.834665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:24:00.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898569+0000","last_change":"2024-06-10T00:14:42.855647+0000","last_active":"2024-06-10T00:14:47.898569+0000","last_peered":"2024-06-10T00:14:47.898569+0000","last_clean":"2024-06-10T00:14:47.898569+0000","last_became_active":"2024-06-10T00:14:42.855378+0000","last_became_peered":"2024-06-10T00:14:42.855378+0000","last_unstale":"2024-06-10T00:14:47.898569+0000","last_undegraded":"2024-06-10T00:14:47.898569+0000","last_fullsized":"2024-06-10T00:14:47.898569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:20:37.270508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017131+0000","last_change":"2024-06-10T00:14:46.886769+0000","last_active":"2024-06-10T00:14:48.017131+0000","last_peered":"2024-06-10T00:14:48.017131+0000","last_clean":"2024-06-10T00:14:48.017131+0000","last_became_active":"2024-06-10T00:14:46.886389+0000","last_became_peered":"2024-06-10T00:14:46.886389+0000","last_unstale":"2024-06-10T00:14:48.017131+0000","last_undegraded":"2024-06-10T00:14:48.017131+0000","last_fullsized":"2024-06-10T00:14:48.017131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:45.864661+0000","last_clean_scrub_stamp":"2024-06-10T00:14:45.864661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:52.363831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035110+0000","last_change":"2024-06-10T00:14:42.873034+0000","last_active":"2024-06-10T00:14:48.035110+0000","last_peered":"2024-06-10T00:14:48.035110+0000","last_clean":"2024-06-10T00:14:48.035110+0000","last_became_active":"2024-06-10T00:14:42.872750+0000","last_became_peered":"2024-06-10T00:14:42.872750+0000","last_unstale":"2024-06-10T00:14:48.035110+0000","last_undegraded":"2024-06-10T00:14:48.035110+0000","last_fullsized":"2024-06-10T00:14:48.035110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:57.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897497+0000","last_change":"2024-06-10T00:14:42.859987+0000","last_active":"2024-06-10T00:14:47.897497+0000","last_peered":"2024-06-10T00:14:47.897497+0000","last_clean":"2024-06-10T00:14:47.897497+0000","last_became_active":"2024-06-10T00:14:42.859713+0000","last_became_peered":"2024-06-10T00:14:42.859713+0000","last_unstale":"2024-06-10T00:14:47.897497+0000","last_undegraded":"2024-06-10T00:14:47.897497+0000","last_fullsized":"2024-06-10T00:14:47.897497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:13:44.600998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899229+0000","last_change":"2024-06-10T00:14:42.873760+0000","last_active":"2024-06-10T00:14:47.899229+0000","last_peered":"2024-06-10T00:14:47.899229+0000","last_clean":"2024-06-10T00:14:47.899229+0000","last_became_active":"2024-06-10T00:14:42.872329+0000","last_became_peered":"2024-06-10T00:14:42.872329+0000","last_unstale":"2024-06-10T00:14:47.899229+0000","last_undegraded":"2024-06-10T00:14:47.899229+0000","last_fullsized":"2024-06-10T00:14:47.899229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:43.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035479+0000","last_change":"2024-06-10T00:14:42.872717+0000","last_active":"2024-06-10T00:14:48.035479+0000","last_peered":"2024-06-10T00:14:48.035479+0000","last_clean":"2024-06-10T00:14:48.035479+0000","last_became_active":"2024-06-10T00:14:42.872465+0000","last_became_peered":"2024-06-10T00:14:42.872465+0000","last_unstale":"2024-06-10T00:14:48.035479+0000","last_undegraded":"2024-06-10T00:14:48.035479+0000","last_fullsized":"2024-06-10T00:14:48.035479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017308+0000","last_change":"2024-06-10T00:14:42.871847+0000","last_active":"2024-06-10T00:14:48.017308+0000","last_peered":"2024-06-10T00:14:48.017308+0000","last_clean":"2024-06-10T00:14:48.017308+0000","last_became_active":"2024-06-10T00:14:42.871547+0000","last_became_peered":"2024-06-10T00:14:42.871547+0000","last_unstale":"2024-06-10T00:14:48.017308+0000","last_undegraded":"2024-06-10T00:14:48.017308+0000","last_fullsized":"2024-06-10T00:14:48.017308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:11.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036114+0000","last_change":"2024-06-10T00:14:42.866392+0000","last_active":"2024-06-10T00:14:48.036114+0000","last_peered":"2024-06-10T00:14:48.036114+0000","last_clean":"2024-06-10T00:14:48.036114+0000","last_became_active":"2024-06-10T00:14:42.866117+0000","last_became_peered":"2024-06-10T00:14:42.866117+0000","last_unstale":"2024-06-10T00:14:48.036114+0000","last_undegraded":"2024-06-10T00:14:48.036114+0000","last_fullsized":"2024-06-10T00:14:48.036114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036529+0000","last_change":"2024-06-10T00:14:42.876259+0000","last_active":"2024-06-10T00:14:48.036529+0000","last_peered":"2024-06-10T00:14:48.036529+0000","last_clean":"2024-06-10T00:14:48.036529+0000","last_became_active":"2024-06-10T00:14:42.875796+0000","last_became_peered":"2024-06-10T00:14:42.875796+0000","last_unstale":"2024-06-10T00:14:48.036529+0000","last_undegraded":"2024-06-10T00:14:48.036529+0000","last_fullsized":"2024-06-10T00:14:48.036529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.017440+0000","last_change":"2024-06-10T00:14:42.874760+0000","last_active":"2024-06-10T00:14:48.017440+0000","last_peered":"2024-06-10T00:14:48.017440+0000","last_clean":"2024-06-10T00:14:48.017440+0000","last_became_active":"2024-06-10T00:14:42.871905+0000","last_became_peered":"2024-06-10T00:14:42.871905+0000","last_unstale":"2024-06-10T00:14:48.017440+0000","last_undegraded":"2024-06-10T00:14:48.017440+0000","last_fullsized":"2024-06-10T00:14:48.017440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898045+0000","last_change":"2024-06-10T00:14:42.873446+0000","last_active":"2024-06-10T00:14:47.898045+0000","last_peered":"2024-06-10T00:14:47.898045+0000","last_clean":"2024-06-10T00:14:47.898045+0000","last_became_active":"2024-06-10T00:14:42.872821+0000","last_became_peered":"2024-06-10T00:14:42.872821+0000","last_unstale":"2024-06-10T00:14:47.898045+0000","last_undegraded":"2024-06-10T00:14:47.898045+0000","last_fullsized":"2024-06-10T00:14:47.898045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:01:09.304121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016840+0000","last_change":"2024-06-10T00:14:42.875401+0000","last_active":"2024-06-10T00:14:48.016840+0000","last_peered":"2024-06-10T00:14:48.016840+0000","last_clean":"2024-06-10T00:14:48.016840+0000","last_became_active":"2024-06-10T00:14:42.875112+0000","last_became_peered":"2024-06-10T00:14:42.875112+0000","last_unstale":"2024-06-10T00:14:48.016840+0000","last_undegraded":"2024-06-10T00:14:48.016840+0000","last_fullsized":"2024-06-10T00:14:48.016840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899128+0000","last_change":"2024-06-10T00:14:42.870273+0000","last_active":"2024-06-10T00:14:47.899128+0000","last_peered":"2024-06-10T00:14:47.899128+0000","last_clean":"2024-06-10T00:14:47.899128+0000","last_became_active":"2024-06-10T00:14:42.869992+0000","last_became_peered":"2024-06-10T00:14:42.869992+0000","last_unstale":"2024-06-10T00:14:47.899128+0000","last_undegraded":"2024-06-10T00:14:47.899128+0000","last_fullsized":"2024-06-10T00:14:47.899128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:18:01.714121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035242+0000","last_change":"2024-06-10T00:14:42.874258+0000","last_active":"2024-06-10T00:14:48.035242+0000","last_peered":"2024-06-10T00:14:48.035242+0000","last_clean":"2024-06-10T00:14:48.035242+0000","last_became_active":"2024-06-10T00:14:42.873693+0000","last_became_peered":"2024-06-10T00:14:42.873693+0000","last_unstale":"2024-06-10T00:14:48.035242+0000","last_undegraded":"2024-06-10T00:14:48.035242+0000","last_fullsized":"2024-06-10T00:14:48.035242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036422+0000","last_change":"2024-06-10T00:14:42.874380+0000","last_active":"2024-06-10T00:14:48.036422+0000","last_peered":"2024-06-10T00:14:48.036422+0000","last_clean":"2024-06-10T00:14:48.036422+0000","last_became_active":"2024-06-10T00:14:42.873982+0000","last_became_peered":"2024-06-10T00:14:42.873982+0000","last_unstale":"2024-06-10T00:14:48.036422+0000","last_undegraded":"2024-06-10T00:14:48.036422+0000","last_fullsized":"2024-06-10T00:14:48.036422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:14:22.882957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035822+0000","last_change":"2024-06-10T00:14:42.877427+0000","last_active":"2024-06-10T00:14:48.035822+0000","last_peered":"2024-06-10T00:14:48.035822+0000","last_clean":"2024-06-10T00:14:48.035822+0000","last_became_active":"2024-06-10T00:14:42.877128+0000","last_became_peered":"2024-06-10T00:14:42.877128+0000","last_unstale":"2024-06-10T00:14:48.035822+0000","last_undegraded":"2024-06-10T00:14:48.035822+0000","last_fullsized":"2024-06-10T00:14:48.035822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:12.737454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897679+0000","last_change":"2024-06-10T00:14:42.877136+0000","last_active":"2024-06-10T00:14:47.897679+0000","last_peered":"2024-06-10T00:14:47.897679+0000","last_clean":"2024-06-10T00:14:47.897679+0000","last_became_active":"2024-06-10T00:14:42.876880+0000","last_became_peered":"2024-06-10T00:14:42.876880+0000","last_unstale":"2024-06-10T00:14:47.897679+0000","last_undegraded":"2024-06-10T00:14:47.897679+0000","last_fullsized":"2024-06-10T00:14:47.897679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:05.350314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899309+0000","last_change":"2024-06-10T00:14:42.868563+0000","last_active":"2024-06-10T00:14:47.899309+0000","last_peered":"2024-06-10T00:14:47.899309+0000","last_clean":"2024-06-10T00:14:47.899309+0000","last_became_active":"2024-06-10T00:14:42.868301+0000","last_became_peered":"2024-06-10T00:14:42.868301+0000","last_unstale":"2024-06-10T00:14:47.899309+0000","last_undegraded":"2024-06-10T00:14:47.899309+0000","last_fullsized":"2024-06-10T00:14:47.899309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:32.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.897802+0000","last_change":"2024-06-10T00:14:42.861856+0000","last_active":"2024-06-10T00:14:47.897802+0000","last_peered":"2024-06-10T00:14:47.897802+0000","last_clean":"2024-06-10T00:14:47.897802+0000","last_became_active":"2024-06-10T00:14:42.861585+0000","last_became_peered":"2024-06-10T00:14:42.861585+0000","last_unstale":"2024-06-10T00:14:47.897802+0000","last_undegraded":"2024-06-10T00:14:47.897802+0000","last_fullsized":"2024-06-10T00:14:47.897802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:47.543484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035530+0000","last_change":"2024-06-10T00:14:42.860405+0000","last_active":"2024-06-10T00:14:48.035530+0000","last_peered":"2024-06-10T00:14:48.035530+0000","last_clean":"2024-06-10T00:14:48.035530+0000","last_became_active":"2024-06-10T00:14:42.860149+0000","last_became_peered":"2024-06-10T00:14:42.860149+0000","last_unstale":"2024-06-10T00:14:48.035530+0000","last_undegraded":"2024-06-10T00:14:48.035530+0000","last_fullsized":"2024-06-10T00:14:48.035530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035085+0000","last_change":"2024-06-10T00:14:42.865461+0000","last_active":"2024-06-10T00:14:48.035085+0000","last_peered":"2024-06-10T00:14:48.035085+0000","last_clean":"2024-06-10T00:14:48.035085+0000","last_became_active":"2024-06-10T00:14:42.864928+0000","last_became_peered":"2024-06-10T00:14:42.864928+0000","last_unstale":"2024-06-10T00:14:48.035085+0000","last_undegraded":"2024-06-10T00:14:48.035085+0000","last_fullsized":"2024-06-10T00:14:48.035085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:48.031418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016831+0000","last_change":"2024-06-10T00:14:42.874662+0000","last_active":"2024-06-10T00:14:48.016831+0000","last_peered":"2024-06-10T00:14:48.016831+0000","last_clean":"2024-06-10T00:14:48.016831+0000","last_became_active":"2024-06-10T00:14:42.871319+0000","last_became_peered":"2024-06-10T00:14:42.871319+0000","last_unstale":"2024-06-10T00:14:48.016831+0000","last_undegraded":"2024-06-10T00:14:48.016831+0000","last_fullsized":"2024-06-10T00:14:48.016831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899567+0000","last_change":"2024-06-10T00:14:42.876016+0000","last_active":"2024-06-10T00:14:47.899567+0000","last_peered":"2024-06-10T00:14:47.899567+0000","last_clean":"2024-06-10T00:14:47.899567+0000","last_became_active":"2024-06-10T00:14:42.875737+0000","last_became_peered":"2024-06-10T00:14:42.875737+0000","last_unstale":"2024-06-10T00:14:47.899567+0000","last_undegraded":"2024-06-10T00:14:47.899567+0000","last_fullsized":"2024-06-10T00:14:47.899567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:48:05.350314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036628+0000","last_change":"2024-06-10T00:14:42.871720+0000","last_active":"2024-06-10T00:14:48.036628+0000","last_peered":"2024-06-10T00:14:48.036628+0000","last_clean":"2024-06-10T00:14:48.036628+0000","last_became_active":"2024-06-10T00:14:42.871436+0000","last_became_peered":"2024-06-10T00:14:42.871436+0000","last_unstale":"2024-06-10T00:14:48.036628+0000","last_undegraded":"2024-06-10T00:14:48.036628+0000","last_fullsized":"2024-06-10T00:14:48.036628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:41:46.483603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036473+0000","last_change":"2024-06-10T00:14:42.876040+0000","last_active":"2024-06-10T00:14:48.036473+0000","last_peered":"2024-06-10T00:14:48.036473+0000","last_clean":"2024-06-10T00:14:48.036473+0000","last_became_active":"2024-06-10T00:14:42.875415+0000","last_became_peered":"2024-06-10T00:14:42.875415+0000","last_unstale":"2024-06-10T00:14:48.036473+0000","last_undegraded":"2024-06-10T00:14:48.036473+0000","last_fullsized":"2024-06-10T00:14:48.036473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:09:50.739556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035992+0000","last_change":"2024-06-10T00:14:42.878916+0000","last_active":"2024-06-10T00:14:48.035992+0000","last_peered":"2024-06-10T00:14:48.035992+0000","last_clean":"2024-06-10T00:14:48.035992+0000","last_became_active":"2024-06-10T00:14:42.878614+0000","last_became_peered":"2024-06-10T00:14:42.878614+0000","last_unstale":"2024-06-10T00:14:48.035992+0000","last_undegraded":"2024-06-10T00:14:48.035992+0000","last_fullsized":"2024-06-10T00:14:48.035992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:26:32.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.016672+0000","last_change":"2024-06-10T00:14:42.871267+0000","last_active":"2024-06-10T00:14:48.016672+0000","last_peered":"2024-06-10T00:14:48.016672+0000","last_clean":"2024-06-10T00:14:48.016672+0000","last_became_active":"2024-06-10T00:14:42.870655+0000","last_became_peered":"2024-06-10T00:14:42.870655+0000","last_unstale":"2024-06-10T00:14:48.016672+0000","last_undegraded":"2024-06-10T00:14:48.016672+0000","last_fullsized":"2024-06-10T00:14:48.016672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:41:26.989308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035895+0000","last_change":"2024-06-10T00:14:42.872799+0000","last_active":"2024-06-10T00:14:48.035895+0000","last_peered":"2024-06-10T00:14:48.035895+0000","last_clean":"2024-06-10T00:14:48.035895+0000","last_became_active":"2024-06-10T00:14:42.872353+0000","last_became_peered":"2024-06-10T00:14:42.872353+0000","last_unstale":"2024-06-10T00:14:48.035895+0000","last_undegraded":"2024-06-10T00:14:48.035895+0000","last_fullsized":"2024-06-10T00:14:48.035895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:42.803595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.899012+0000","last_change":"2024-06-10T00:14:42.861048+0000","last_active":"2024-06-10T00:14:47.899012+0000","last_peered":"2024-06-10T00:14:47.899012+0000","last_clean":"2024-06-10T00:14:47.899012+0000","last_became_active":"2024-06-10T00:14:42.860760+0000","last_became_peered":"2024-06-10T00:14:42.860760+0000","last_unstale":"2024-06-10T00:14:47.899012+0000","last_undegraded":"2024-06-10T00:14:47.899012+0000","last_fullsized":"2024-06-10T00:14:47.899012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035369+0000","last_change":"2024-06-10T00:14:42.876850+0000","last_active":"2024-06-10T00:14:48.035369+0000","last_peered":"2024-06-10T00:14:48.035369+0000","last_clean":"2024-06-10T00:14:48.035369+0000","last_became_active":"2024-06-10T00:14:42.876562+0000","last_became_peered":"2024-06-10T00:14:42.876562+0000","last_unstale":"2024-06-10T00:14:48.035369+0000","last_undegraded":"2024-06-10T00:14:48.035369+0000","last_fullsized":"2024-06-10T00:14:48.035369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:04:26.034333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:47.898301+0000","last_change":"2024-06-10T00:14:42.872870+0000","last_active":"2024-06-10T00:14:47.898301+0000","last_peered":"2024-06-10T00:14:47.898301+0000","last_clean":"2024-06-10T00:14:47.898301+0000","last_became_active":"2024-06-10T00:14:42.872366+0000","last_became_peered":"2024-06-10T00:14:42.872366+0000","last_unstale":"2024-06-10T00:14:47.898301+0000","last_undegraded":"2024-06-10T00:14:47.898301+0000","last_fullsized":"2024-06-10T00:14:47.898301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:17:12.737454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035393+0000","last_change":"2024-06-10T00:14:42.870759+0000","last_active":"2024-06-10T00:14:48.035393+0000","last_peered":"2024-06-10T00:14:48.035393+0000","last_clean":"2024-06-10T00:14:48.035393+0000","last_became_active":"2024-06-10T00:14:42.869435+0000","last_became_peered":"2024-06-10T00:14:42.869435+0000","last_unstale":"2024-06-10T00:14:48.035393+0000","last_undegraded":"2024-06-10T00:14:48.035393+0000","last_fullsized":"2024-06-10T00:14:48.035393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:31:36.092116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.036201+0000","last_change":"2024-06-10T00:14:42.863072+0000","last_active":"2024-06-10T00:14:48.036201+0000","last_peered":"2024-06-10T00:14:48.036201+0000","last_clean":"2024-06-10T00:14:48.036201+0000","last_became_active":"2024-06-10T00:14:42.862795+0000","last_became_peered":"2024-06-10T00:14:42.862795+0000","last_unstale":"2024-06-10T00:14:48.036201+0000","last_undegraded":"2024-06-10T00:14:48.036201+0000","last_fullsized":"2024-06-10T00:14:48.036201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:17.283744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-10T00:14:48.035900+0000","last_change":"2024-06-10T00:14:42.880389+0000","last_active":"2024-06-10T00:14:48.035900+0000","last_peered":"2024-06-10T00:14:48.035900+0000","last_clean":"2024-06-10T00:14:48.035900+0000","last_became_active":"2024-06-10T00:14:42.880129+0000","last_became_peered":"2024-06-10T00:14:42.880129+0000","last_unstale":"2024-06-10T00:14:48.035900+0000","last_undegraded":"2024-06-10T00:14:48.035900+0000","last_fullsized":"2024-06-10T00:14:48.035900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:41.840002+0000","last_clean_scrub_stamp":"2024-06-10T00:14:41.840002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:04.905009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:07.606 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:15:07.606 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-10T00:15:07.607 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-06-10T00:15:07.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-10T00:15:07.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.740+0000 7fccaa990640 1 Processor -- start 2024-06-10T00:15:07.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.740+0000 7fccaa990640 1 -- start start 2024-06-10T00:15:07.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fccaa990640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcca40b7940 0x7fcca40d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fccaa990640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca40b7d20 con 0x7fcca40b4c80 2024-06-10T00:15:07.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fccaa990640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca40cc620 con 0x7fcca40cede0 2024-06-10T00:15:07.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fccaa990640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcca40cc900 con 0x7fcca40b7940 2024-06-10T00:15:07.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fcca37fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcca40b4c80 0x7fcca40ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50752/0 (socket says 172.21.15.79:50752) 2024-06-10T00:15:07.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fcca37fe640 1 -- 172.21.15.79:0/3979409035 learned_addr learned my addr 172.21.15.79:0/3979409035 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:07.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fcca3fff640 1 --2- 172.21.15.79:0/3979409035 >> v2:172.21.15.117:3300/0 conn(0x7fcca40b7940 0x7fcca40d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fcca2ffd640 1 -- 172.21.15.79:0/3979409035 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891996274 0 0) 0x7fcca40b7d20 con 0x7fcca40b4c80 2024-06-10T00:15:07.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fcca2ffd640 1 -- 172.21.15.79:0/3979409035 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc8c003520 con 0x7fcca40b4c80 2024-06-10T00:15:07.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fcca3fff640 1 -- 172.21.15.79:0/3979409035 >> v1:172.21.15.117:6789/0 conn(0x7fcca40cede0 legacy=0x7fcca40cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fcca3fff640 1 -- 172.21.15.79:0/3979409035 >> v1:172.21.15.79:6789/0 conn(0x7fcca40b4c80 legacy=0x7fcca40ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.741+0000 7fcca3fff640 1 -- 172.21.15.79:0/3979409035 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca40ccbe0 con 0x7fcca40b7940 2024-06-10T00:15:07.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.742+0000 7fcca3fff640 1 --2- 172.21.15.79:0/3979409035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b7940 0x7fcca40d0af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097a0 tx=0x7fcc9402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36690d0cfc0c27de server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.742+0000 7fcca2ffd640 1 -- 172.21.15.79:0/3979409035 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94037070 con 0x7fcca40b7940 2024-06-10T00:15:07.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.742+0000 7fcca2ffd640 1 -- 172.21.15.79:0/3979409035 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc94032440 con 0x7fcca40b7940 2024-06-10T00:15:07.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.742+0000 7fcca2ffd640 1 -- 172.21.15.79:0/3979409035 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc940327f0 con 0x7fcca40b7940 2024-06-10T00:15:07.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.743+0000 7fccaa990640 1 -- 172.21.15.79:0/3979409035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b7940 msgr2=0x7fcca40d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.743+0000 7fccaa990640 1 --2- 172.21.15.79:0/3979409035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b7940 0x7fcca40d0af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097a0 tx=0x7fcc9402a230 comp rx=0 tx=0).stop 2024-06-10T00:15:07.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.743+0000 7fccaa990640 1 -- 172.21.15.79:0/3979409035 shutdown_connections 2024-06-10T00:15:07.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.743+0000 7fccaa990640 1 --2- 172.21.15.79:0/3979409035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b7940 0x7fcca40d0af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.743+0000 7fccaa990640 1 -- 172.21.15.79:0/3979409035 >> 172.21.15.79:0/3979409035 conn(0x7fcca40d1e50 msgr2=0x7fcca40d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:07.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.743+0000 7fccaa990640 1 -- 172.21.15.79:0/3979409035 shutdown_connections 2024-06-10T00:15:07.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.743+0000 7fccaa990640 1 -- 172.21.15.79:0/3979409035 wait complete. 2024-06-10T00:15:07.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.744+0000 7fccaa990640 1 Processor -- start 2024-06-10T00:15:07.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.744+0000 7fccaa990640 1 -- start start 2024-06-10T00:15:07.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fccaa990640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b4c80 0x7fcca415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fccaa990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca40b7940 0x7fcca41f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fccaa990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40cede0 0x7fcca414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fccaa990640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcca40d2c10 con 0x7fcca40b7940 2024-06-10T00:15:07.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fccaa990640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcca40d2a90 con 0x7fcca40b4c80 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fccaa990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcca40d1030 con 0x7fcca40cede0 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca40b7940 0x7fcca41f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca40b7940 0x7fcca41f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36950/0 (socket says 172.21.15.79:36950) 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca37fe640 1 -- 172.21.15.79:0/31310256 learned_addr learned my addr 172.21.15.79:0/31310256 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca3fff640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b4c80 0x7fcca415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca8f2d640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40cede0 0x7fcca414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca37fe640 1 -- 172.21.15.79:0/31310256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40cede0 msgr2=0x7fcca414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca37fe640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40cede0 0x7fcca414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca37fe640 1 -- 172.21.15.79:0/31310256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b4c80 msgr2=0x7fcca415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca37fe640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b4c80 0x7fcca415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.745+0000 7fcca37fe640 1 -- 172.21.15.79:0/31310256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca40cab20 con 0x7fcca40b7940 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.746+0000 7fcca37fe640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca40b7940 0x7fcca41f3ff0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c500 tx=0x7fcc9800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.746+0000 7fcca0ff9640 1 -- 172.21.15.79:0/31310256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98017070 con 0x7fcca40b7940 2024-06-10T00:15:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.746+0000 7fcca0ff9640 1 -- 172.21.15.79:0/31310256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc98005ce0 con 0x7fcca40b7940 2024-06-10T00:15:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.746+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca40cb8a0 con 0x7fcca40b7940 2024-06-10T00:15:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.746+0000 7fcca0ff9640 1 -- 172.21.15.79:0/31310256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98007330 con 0x7fcca40b7940 2024-06-10T00:15:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.746+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca40cb0a0 con 0x7fcca40b7940 2024-06-10T00:15:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.747+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca4068430 con 0x7fcca40b7940 2024-06-10T00:15:07.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.747+0000 7fcca0ff9640 1 -- 172.21.15.79:0/31310256 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc9801a070 con 0x7fcca40b7940 2024-06-10T00:15:07.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.748+0000 7fcca0ff9640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc9006be60 0x7fcc9006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:07.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.748+0000 7fcca0ff9640 1 -- 172.21.15.79:0/31310256 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcc9808a590 con 0x7fcca40b7940 2024-06-10T00:15:07.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.748+0000 7fcca3fff640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc9006be60 0x7fcc9006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:07.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.748+0000 7fcca3fff640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc9006be60 0x7fcc9006e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc94034000 tx=0x7fcc9402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:07.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.752+0000 7fcca0ff9640 1 -- 172.21.15.79:0/31310256 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcc98058d50 con 0x7fcca40b7940 2024-06-10T00:15:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.962+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcca406ff30 con 0x7fcca40b7940 2024-06-10T00:15:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.962+0000 7fcca0ff9640 1 -- 172.21.15.79:0/31310256 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcc98058650 con 0x7fcca40b7940 2024-06-10T00:15:07.962 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:07.962 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-10T00:15:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc9006be60 msgr2=0x7fcc9006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc9006be60 0x7fcc9006e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc94034000 tx=0x7fcc9402e000 comp rx=0 tx=0).stop 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca40b7940 msgr2=0x7fcca41f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca40b7940 0x7fcca41f3ff0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c500 tx=0x7fcc9800c9c0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 shutdown_connections 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc9006be60 0x7fcc9006e320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40cede0 0x7fcca414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcca40b7940 0x7fcca41f3ff0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 --2- 172.21.15.79:0/31310256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40b4c80 0x7fcca415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.964+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 >> 172.21.15.79:0/31310256 conn(0x7fcca40d1e50 msgr2=0x7fcca406d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.965+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 shutdown_connections 2024-06-10T00:15:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:07.965+0000 7fccaa990640 1 -- 172.21.15.79:0/31310256 wait complete. 2024-06-10T00:15:07.975 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-06-10T00:15:07.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:08.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.075+0000 7fbf2f129640 1 Processor -- start 2024-06-10T00:15:08.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.075+0000 7fbf2f129640 1 -- start start 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2f129640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf2815a5d0 0x7fbf28072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2f129640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf280cd4a0 0x7fbf280b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2f129640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf280ce5f0 con 0x7fbf280b4960 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2f129640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbf280cf690 con 0x7fbf2815a5d0 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2f129640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbf280ce8d0 con 0x7fbf280cd4a0 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2cec5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf2815a5d0 0x7fbf28072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2d6c6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbf280b4960 0x7fbf2815e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56200/0 (socket says 172.21.15.79:56200) 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2d6c6640 1 -- 172.21.15.79:0/4013098578 learned_addr learned my addr 172.21.15.79:0/4013098578 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:08.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf27fff640 1 --2- 172.21.15.79:0/4013098578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf280cd4a0 0x7fbf280b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2cec5640 1 -- 172.21.15.79:0/4013098578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf280cd4a0 msgr2=0x7fbf280b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2cec5640 1 --2- 172.21.15.79:0/4013098578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf280cd4a0 0x7fbf280b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2cec5640 1 -- 172.21.15.79:0/4013098578 >> v1:172.21.15.79:6789/0 conn(0x7fbf280b4960 legacy=0x7fbf2815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf2cec5640 1 -- 172.21.15.79:0/4013098578 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf280cebb0 con 0x7fbf2815a5d0 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.076+0000 7fbf277fe640 1 -- 172.21.15.79:0/4013098578 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746447981 0 0) 0x7fbf280ce5f0 con 0x7fbf280b4960 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.077+0000 7fbf2cec5640 1 --2- 172.21.15.79:0/4013098578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2815a5d0 0x7fbf28072fb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbf180097a0 tx=0x7fbf1802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7f7575cbf3c461 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.077+0000 7fbf277fe640 1 -- 172.21.15.79:0/4013098578 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18037070 con 0x7fbf2815a5d0 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.077+0000 7fbf277fe640 1 -- 172.21.15.79:0/4013098578 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf18032440 con 0x7fbf2815a5d0 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.077+0000 7fbf277fe640 1 -- 172.21.15.79:0/4013098578 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18032810 con 0x7fbf2815a5d0 2024-06-10T00:15:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.078+0000 7fbf2f129640 1 -- 172.21.15.79:0/4013098578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2815a5d0 msgr2=0x7fbf28072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.078+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4013098578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2815a5d0 0x7fbf28072fb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbf180097a0 tx=0x7fbf1802a180 comp rx=0 tx=0).stop 2024-06-10T00:15:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.078+0000 7fbf2f129640 1 -- 172.21.15.79:0/4013098578 shutdown_connections 2024-06-10T00:15:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.078+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4013098578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf280cd4a0 0x7fbf280b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.078+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4013098578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2815a5d0 0x7fbf28072fb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.078+0000 7fbf2f129640 1 -- 172.21.15.79:0/4013098578 >> 172.21.15.79:0/4013098578 conn(0x7fbf280b19f0 msgr2=0x7fbf280b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.078+0000 7fbf2f129640 1 -- 172.21.15.79:0/4013098578 shutdown_connections 2024-06-10T00:15:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.078+0000 7fbf2f129640 1 -- 172.21.15.79:0/4013098578 wait complete. 2024-06-10T00:15:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.079+0000 7fbf2f129640 1 Processor -- start 2024-06-10T00:15:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.079+0000 7fbf2f129640 1 -- start start 2024-06-10T00:15:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2f129640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf280b4960 0x7fbf2814d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2f129640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf280cd4a0 0x7fbf28145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2f129640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2815a5d0 0x7fbf2814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2f129640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf280b4df0 con 0x7fbf280b4960 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2f129640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbf280cf170 con 0x7fbf280cd4a0 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2f129640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbf28072040 con 0x7fbf2815a5d0 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf280b4960 0x7fbf2814d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf280b4960 0x7fbf2814d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36808/0 (socket says 172.21.15.79:36808) 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 -- 172.21.15.79:0/4020639442 learned_addr learned my addr 172.21.15.79:0/4020639442 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf27fff640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf280cd4a0 0x7fbf28145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2d6c6640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2815a5d0 0x7fbf2814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 -- 172.21.15.79:0/4020639442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2815a5d0 msgr2=0x7fbf2814b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2815a5d0 0x7fbf2814b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 -- 172.21.15.79:0/4020639442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf280cd4a0 msgr2=0x7fbf28145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf280cd4a0 0x7fbf28145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 -- 172.21.15.79:0/4020639442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2814cc70 con 0x7fbf280b4960 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.080+0000 7fbf2cec5640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf280b4960 0x7fbf2814d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf180098c0 tx=0x7fbf180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.081+0000 7fbf257fa640 1 -- 172.21.15.79:0/4020639442 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18037040 con 0x7fbf280b4960 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.081+0000 7fbf257fa640 1 -- 172.21.15.79:0/4020639442 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf18030500 con 0x7fbf280b4960 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.081+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2814cef0 con 0x7fbf280b4960 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.081+0000 7fbf257fa640 1 -- 172.21.15.79:0/4020639442 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf180308d0 con 0x7fbf280b4960 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.081+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf28146ef0 con 0x7fbf280b4960 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.082+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf28068430 con 0x7fbf280b4960 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.082+0000 7fbf257fa640 1 -- 172.21.15.79:0/4020639442 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf18044020 con 0x7fbf280b4960 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.082+0000 7fbf257fa640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbf1406be30 0x7fbf1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.083+0000 7fbf257fa640 1 -- 172.21.15.79:0/4020639442 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbf180ab3d0 con 0x7fbf280b4960 2024-06-10T00:15:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.083+0000 7fbf27fff640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbf1406be30 0x7fbf1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.083+0000 7fbf27fff640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbf1406be30 0x7fbf1406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbf280cbef0 tx=0x7fbf1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.087+0000 7fbf257fa640 1 -- 172.21.15.79:0/4020639442 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbf2814cc70 con 0x7fbf280b4960 2024-06-10T00:15:08.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.297+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf2806f350 con 0x7fbf280b4960 2024-06-10T00:15:08.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.298+0000 7fbf257fa640 1 -- 172.21.15.79:0/4020639442 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7fbf18079ad0 con 0x7fbf280b4960 2024-06-10T00:15:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:08.298 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:15:01.280562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:15:08.298 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-06-10T00:15:08.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbf1406be30 msgr2=0x7fbf1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbf1406be30 0x7fbf1406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbf280cbef0 tx=0x7fbf1c008040 comp rx=0 tx=0).stop 2024-06-10T00:15:08.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf280b4960 msgr2=0x7fbf2814d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf280b4960 0x7fbf2814d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf180098c0 tx=0x7fbf180046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 shutdown_connections 2024-06-10T00:15:08.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbf1406be30 0x7fbf1406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2815a5d0 0x7fbf2814b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf280cd4a0 0x7fbf28145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 --2- 172.21.15.79:0/4020639442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf280b4960 0x7fbf2814d3f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 >> 172.21.15.79:0/4020639442 conn(0x7fbf280b19f0 msgr2=0x7fbf280cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:08.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 shutdown_connections 2024-06-10T00:15:08.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.300+0000 7fbf2f129640 1 -- 172.21.15.79:0/4020639442 wait complete. 2024-06-10T00:15:08.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:08.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.411+0000 7f4faf8f5640 1 Processor -- start 2024-06-10T00:15:08.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.411+0000 7f4faf8f5640 1 -- start start 2024-06-10T00:15:08.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4faf8f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fa80ae910 0x7f4fa806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4faf8f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa806ea20 0x7f4fa80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4faf8f5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa80cf620 con 0x7f4fa80cf190 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4faf8f5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4fa806ee60 con 0x7f4fa80ae910 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4faf8f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa806d130 con 0x7f4fa806ea20 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4fad691640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fa80ae910 0x7f4fa806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4fad691640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fa80ae910 0x7f4fa806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36810/0 (socket says 172.21.15.79:36810) 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4fad691640 1 -- 172.21.15.79:0/1729604663 learned_addr learned my addr 172.21.15.79:0/1729604663 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4face90640 1 --2- 172.21.15.79:0/1729604663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa806ea20 0x7f4fa80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4fad691640 1 -- 172.21.15.79:0/1729604663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa806ea20 msgr2=0x7f4fa80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:08.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4fad691640 1 --2- 172.21.15.79:0/1729604663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa806ea20 0x7f4fa80cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4fad691640 1 -- 172.21.15.79:0/1729604663 >> v1:172.21.15.117:6789/0 conn(0x7f4fa80cf190 legacy=0x7f4fa815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:08.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.412+0000 7f4fad691640 1 -- 172.21.15.79:0/1729604663 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa806d410 con 0x7f4fa80ae910 2024-06-10T00:15:08.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4fad691640 1 --2- 172.21.15.79:0/1729604663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa806e4e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400bb40 tx=0x7f4fa402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25540e68cdd69d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4f9ffff640 1 -- 172.21.15.79:0/1729604663 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4034620 con 0x7f4fa80ae910 2024-06-10T00:15:08.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4f9ffff640 1 -- 172.21.15.79:0/1729604663 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa40347c0 con 0x7f4fa80ae910 2024-06-10T00:15:08.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4f9ffff640 1 -- 172.21.15.79:0/1729604663 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4034b90 con 0x7f4fa80ae910 2024-06-10T00:15:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4faf8f5640 1 -- 172.21.15.79:0/1729604663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 msgr2=0x7f4fa806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/1729604663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa806e4e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400bb40 tx=0x7f4fa402c870 comp rx=0 tx=0).stop 2024-06-10T00:15:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4faf8f5640 1 -- 172.21.15.79:0/1729604663 shutdown_connections 2024-06-10T00:15:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/1729604663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa806ea20 0x7f4fa80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/1729604663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa806e4e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.413+0000 7f4faf8f5640 1 -- 172.21.15.79:0/1729604663 >> 172.21.15.79:0/1729604663 conn(0x7f4fa80b19f0 msgr2=0x7f4fa80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.414+0000 7f4faf8f5640 1 -- 172.21.15.79:0/1729604663 shutdown_connections 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.414+0000 7f4faf8f5640 1 -- 172.21.15.79:0/1729604663 wait complete. 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4faf8f5640 1 Processor -- start 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4faf8f5640 1 -- start start 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4faf8f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa806ea20 0x7f4fa815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4faf8f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa81e4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4faf8f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa80cf190 0x7f4fa81593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4faf8f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa80aecf0 con 0x7f4fa80ae910 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4faf8f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa806d9d0 con 0x7f4fa806ea20 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4faf8f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa80add50 con 0x7f4fa80cf190 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4face90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa81e4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4face90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa81e4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36814/0 (socket says 172.21.15.79:36814) 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.415+0000 7f4face90640 1 -- 172.21.15.79:0/166800112 learned_addr learned my addr 172.21.15.79:0/166800112 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4face90640 1 -- 172.21.15.79:0/166800112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa80cf190 msgr2=0x7f4fa81593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4face90640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa80cf190 0x7f4fa81593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4face90640 1 -- 172.21.15.79:0/166800112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa806ea20 msgr2=0x7f4fa815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4fad691640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa806ea20 0x7f4fa815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4face90640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa806ea20 0x7f4fa815da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4face90640 1 -- 172.21.15.79:0/166800112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa81e58b0 con 0x7f4fa80ae910 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4face90640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa81e4e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800c7f0 tx=0x7f4f9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4f9dffb640 1 -- 172.21.15.79:0/166800112 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98015070 con 0x7f4fa80ae910 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4f9dffb640 1 -- 172.21.15.79:0/166800112 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f98004220 con 0x7f4fa80ae910 2024-06-10T00:15:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4f9dffb640 1 -- 172.21.15.79:0/166800112 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98007620 con 0x7f4fa80ae910 2024-06-10T00:15:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa81f3090 con 0x7f4fa80ae910 2024-06-10T00:15:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.416+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa809d720 con 0x7f4fa80ae910 2024-06-10T00:15:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.417+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa81f2eb0 con 0x7f4fa80ae910 2024-06-10T00:15:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.418+0000 7f4f9dffb640 1 -- 172.21.15.79:0/166800112 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f980079d0 con 0x7f4fa80ae910 2024-06-10T00:15:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.418+0000 7f4f9dffb640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4f8c06be60 0x7f4f8c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.418+0000 7f4f9dffb640 1 -- 172.21.15.79:0/166800112 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4f9808b1d0 con 0x7f4fa80ae910 2024-06-10T00:15:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.418+0000 7f4fad691640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4f8c06be60 0x7f4f8c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.419+0000 7f4fad691640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4f8c06be60 0x7f4f8c06e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4037000 tx=0x7f4fa4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.422+0000 7f4f9dffb640 1 -- 172.21.15.79:0/166800112 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4fa81f2eb0 con 0x7f4fa80ae910 2024-06-10T00:15:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.629+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fa8068430 con 0x7f4fa80ae910 2024-06-10T00:15:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.630+0000 7f4f9dffb640 1 -- 172.21.15.79:0/166800112 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7f4f98059840 con 0x7f4fa80ae910 2024-06-10T00:15:08.630 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:08.630 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:15:01.280562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:15:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-06-10T00:15:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4f8c06be60 msgr2=0x7f4f8c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4f8c06be60 0x7f4f8c06e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4037000 tx=0x7f4fa4032000 comp rx=0 tx=0).stop 2024-06-10T00:15:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 msgr2=0x7f4fa81e4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa81e4e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800c7f0 tx=0x7f4f9800ccb0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 shutdown_connections 2024-06-10T00:15:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4f8c06be60 0x7f4f8c06e320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa80cf190 0x7f4fa81593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fa80ae910 0x7f4fa81e4e10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 --2- 172.21.15.79:0/166800112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa806ea20 0x7f4fa815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 >> 172.21.15.79:0/166800112 conn(0x7f4fa80b19f0 msgr2=0x7f4fa80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:08.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 shutdown_connections 2024-06-10T00:15:08.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.632+0000 7f4faf8f5640 1 -- 172.21.15.79:0/166800112 wait complete. 2024-06-10T00:15:08.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:08.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.742+0000 7f6603948640 1 Processor -- start 2024-06-10T00:15:08.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.742+0000 7f6603948640 1 -- start start 2024-06-10T00:15:08.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f6603948640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f6603948640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65fc0cec50 0x7f65fc0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f6603948640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc0b3170 con 0x7f65fc0b2cf0 2024-06-10T00:15:08.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f6603948640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f65fc0b3420 con 0x7f65fc0cec50 2024-06-10T00:15:08.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f6603948640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc0cc750 con 0x7f65fc1553c0 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f6600ee3640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65fc0b2cf0 0x7f65fc15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56212/0 (socket says 172.21.15.79:56212) 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f6600ee3640 1 -- 172.21.15.79:0/3702636119 learned_addr learned my addr 172.21.15.79:0/3702636119 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f66016e4640 1 --2- 172.21.15.79:0/3702636119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f6601ee5640 1 --2- 172.21.15.79:0/3702636119 >> v2:172.21.15.117:3300/0 conn(0x7f65fc0cec50 0x7f65fc0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f65f3fff640 1 -- 172.21.15.79:0/3702636119 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942800393 0 0) 0x7f65fc0b3170 con 0x7f65fc0b2cf0 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.743+0000 7f65f3fff640 1 -- 172.21.15.79:0/3702636119 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e8003520 con 0x7f65fc0b2cf0 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.744+0000 7f66016e4640 1 -- 172.21.15.79:0/3702636119 >> v2:172.21.15.117:3300/0 conn(0x7f65fc0cec50 msgr2=0x7f65fc0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.744+0000 7f66016e4640 1 --2- 172.21.15.79:0/3702636119 >> v2:172.21.15.117:3300/0 conn(0x7f65fc0cec50 0x7f65fc0cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.744+0000 7f66016e4640 1 -- 172.21.15.79:0/3702636119 >> v1:172.21.15.79:6789/0 conn(0x7f65fc0b2cf0 legacy=0x7f65fc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.744+0000 7f65f3fff640 1 -- 172.21.15.79:0/3702636119 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1209072836 0 0) 0x7f65e8003520 con 0x7f65fc0b2cf0 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.744+0000 7f66016e4640 1 -- 172.21.15.79:0/3702636119 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc0cca30 con 0x7f65fc1553c0 2024-06-10T00:15:08.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.744+0000 7f66016e4640 1 --2- 172.21.15.79:0/3702636119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc0cd230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65f80097a0 tx=0x7f65f802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=472185b9b71fe3ae server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f65f3fff640 1 -- 172.21.15.79:0/3702636119 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8037070 con 0x7f65fc1553c0 2024-06-10T00:15:08.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f65f3fff640 1 -- 172.21.15.79:0/3702636119 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f802aba0 con 0x7f65fc1553c0 2024-06-10T00:15:08.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f65f3fff640 1 -- 172.21.15.79:0/3702636119 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec001670 con 0x7f65fc1553c0 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f6603948640 1 -- 172.21.15.79:0/3702636119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 msgr2=0x7f65fc0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f6603948640 1 --2- 172.21.15.79:0/3702636119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc0cd230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65f80097a0 tx=0x7f65f802a110 comp rx=0 tx=0).stop 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f6603948640 1 -- 172.21.15.79:0/3702636119 shutdown_connections 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f6603948640 1 --2- 172.21.15.79:0/3702636119 >> v2:172.21.15.117:3300/0 conn(0x7f65fc0cec50 0x7f65fc0cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f6603948640 1 --2- 172.21.15.79:0/3702636119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc0cd230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f6603948640 1 -- 172.21.15.79:0/3702636119 >> 172.21.15.79:0/3702636119 conn(0x7f65fc0b19f0 msgr2=0x7f65fc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f6603948640 1 -- 172.21.15.79:0/3702636119 shutdown_connections 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.745+0000 7f6603948640 1 -- 172.21.15.79:0/3702636119 wait complete. 2024-06-10T00:15:08.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.746+0000 7f6603948640 1 Processor -- start 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.746+0000 7f6603948640 1 -- start start 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6603948640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65fc0b2cf0 0x7f65fc1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6603948640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65fc0cec50 0x7f65fc154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6603948640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc09c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6603948640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1557a0 con 0x7f65fc0cec50 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6603948640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc0b3700 con 0x7f65fc0b2cf0 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6603948640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc155920 con 0x7f65fc1553c0 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6600ee3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65fc0cec50 0x7f65fc154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6600ee3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65fc0cec50 0x7f65fc154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36832/0 (socket says 172.21.15.79:36832) 2024-06-10T00:15:08.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6600ee3640 1 -- 172.21.15.79:0/1338139616 learned_addr learned my addr 172.21.15.79:0/1338139616 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6601ee5640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc09c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f66016e4640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65fc0b2cf0 0x7f65fc1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6600ee3640 1 -- 172.21.15.79:0/1338139616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 msgr2=0x7f65fc09c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6600ee3640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc09c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6600ee3640 1 -- 172.21.15.79:0/1338139616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65fc0b2cf0 msgr2=0x7f65fc1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6600ee3640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65fc0b2cf0 0x7f65fc1530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.747+0000 7f6600ee3640 1 -- 172.21.15.79:0/1338139616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc09ad60 con 0x7f65fc0cec50 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.748+0000 7f6600ee3640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65fc0cec50 0x7f65fc154570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c780 tx=0x7f65ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.748+0000 7f65f1ffb640 1 -- 172.21.15.79:0/1338139616 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec017070 con 0x7f65fc0cec50 2024-06-10T00:15:08.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.748+0000 7f65f1ffb640 1 -- 172.21.15.79:0/1338139616 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec005ad0 con 0x7f65fc0cec50 2024-06-10T00:15:08.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.748+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc09b040 con 0x7f65fc0cec50 2024-06-10T00:15:08.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.748+0000 7f65f1ffb640 1 -- 172.21.15.79:0/1338139616 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec007070 con 0x7f65fc0cec50 2024-06-10T00:15:08.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.748+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc09b600 con 0x7f65fc0cec50 2024-06-10T00:15:08.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.749+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc068430 con 0x7f65fc0cec50 2024-06-10T00:15:08.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.749+0000 7f65f1ffb640 1 -- 172.21.15.79:0/1338139616 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65ec01a070 con 0x7f65fc0cec50 2024-06-10T00:15:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.750+0000 7f65f1ffb640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65e006be30 0x7f65e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.750+0000 7f66016e4640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65e006be30 0x7f65e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.750+0000 7f65f1ffb640 1 -- 172.21.15.79:0/1338139616 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f65ec08a640 con 0x7f65fc0cec50 2024-06-10T00:15:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.750+0000 7f66016e4640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65e006be30 0x7f65e006e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f65f8034000 tx=0x7f65f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.754+0000 7f65f1ffb640 1 -- 172.21.15.79:0/1338139616 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f65ec058660 con 0x7f65fc0cec50 2024-06-10T00:15:08.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.926+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65fc075430 con 0x7f65fc0cec50 2024-06-10T00:15:08.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.927+0000 7f65f1ffb640 1 -- 172.21.15.79:0/1338139616 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f65ec05c960 con 0x7f65fc0cec50 2024-06-10T00:15:08.928 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:08.928 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:08.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.929+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65e006be30 msgr2=0x7f65e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.929+0000 7f6603948640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65e006be30 0x7f65e006e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f65f8034000 tx=0x7f65f802e000 comp rx=0 tx=0).stop 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65fc0cec50 msgr2=0x7f65fc154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65fc0cec50 0x7f65fc154570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c780 tx=0x7f65ec00cc40 comp rx=0 tx=0).stop 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 shutdown_connections 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65e006be30 0x7f65e006e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65fc1553c0 0x7f65fc09c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65fc0cec50 0x7f65fc154570 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 --2- 172.21.15.79:0/1338139616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65fc0b2cf0 0x7f65fc1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 >> 172.21.15.79:0/1338139616 conn(0x7f65fc0b19f0 msgr2=0x7f65fc0cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 shutdown_connections 2024-06-10T00:15:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:08.930+0000 7f6603948640 1 -- 172.21.15.79:0/1338139616 wait complete. 2024-06-10T00:15:08.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:09.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.039+0000 7ff8fcbd5640 1 Processor -- start 2024-06-10T00:15:09.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.039+0000 7ff8fcbd5640 1 -- start start 2024-06-10T00:15:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.040+0000 7ff8fcbd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8f806ebf0 0x7ff8f80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.040+0000 7ff8fcbd5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8f80cf190 0x7ff8f80acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.040+0000 7ff8fcbd5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f80cf600 con 0x7ff8f80ae910 2024-06-10T00:15:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.040+0000 7ff8fcbd5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff8f806d130 con 0x7ff8f806ebf0 2024-06-10T00:15:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.040+0000 7ff8fcbd5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff8f806d410 con 0x7ff8f80cf190 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.041+0000 7ff8f5d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8f806ebf0 0x7ff8f80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.041+0000 7ff8f5d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8f806ebf0 0x7ff8f80cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36836/0 (socket says 172.21.15.79:36836) 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.041+0000 7ff8f5d9b640 1 -- 172.21.15.79:0/384558903 learned_addr learned my addr 172.21.15.79:0/384558903 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.041+0000 7ff8f6d9d640 1 --2- 172.21.15.79:0/384558903 >> v2:172.21.15.117:3300/0 conn(0x7ff8f80cf190 0x7ff8f80acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.041+0000 7ff8f5d9b640 1 -- 172.21.15.79:0/384558903 >> v2:172.21.15.117:3300/0 conn(0x7ff8f80cf190 msgr2=0x7ff8f80acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.041+0000 7ff8f5d9b640 1 --2- 172.21.15.79:0/384558903 >> v2:172.21.15.117:3300/0 conn(0x7ff8f80cf190 0x7ff8f80acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.041+0000 7ff8f5d9b640 1 -- 172.21.15.79:0/384558903 >> v1:172.21.15.117:6789/0 conn(0x7ff8f80ae910 legacy=0x7ff8f806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.041+0000 7ff8f5d9b640 1 -- 172.21.15.79:0/384558903 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f806d6f0 con 0x7ff8f806ebf0 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8f5d9b640 1 --2- 172.21.15.79:0/384558903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f806ebf0 0x7ff8f80cec50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8f806dcb0 tx=0x7ff8ec02c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40eb287199ad0e7f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8f559a640 1 -- 172.21.15.79:0/384558903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec032710 con 0x7ff8f806ebf0 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8f559a640 1 -- 172.21.15.79:0/384558903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0328b0 con 0x7ff8f806ebf0 2024-06-10T00:15:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8f559a640 1 -- 172.21.15.79:0/384558903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec032ca0 con 0x7ff8f806ebf0 2024-06-10T00:15:09.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/384558903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f806ebf0 msgr2=0x7ff8f80cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/384558903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f806ebf0 0x7ff8f80cec50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8f806dcb0 tx=0x7ff8ec02c850 comp rx=0 tx=0).stop 2024-06-10T00:15:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/384558903 shutdown_connections 2024-06-10T00:15:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/384558903 >> v2:172.21.15.117:3300/0 conn(0x7ff8f80cf190 0x7ff8f80acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/384558903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f806ebf0 0x7ff8f80cec50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/384558903 >> 172.21.15.79:0/384558903 conn(0x7ff8f80b19f0 msgr2=0x7ff8f80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/384558903 shutdown_connections 2024-06-10T00:15:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.042+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/384558903 wait complete. 2024-06-10T00:15:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.044+0000 7ff8fcbd5640 1 Processor -- start 2024-06-10T00:15:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.044+0000 7ff8fcbd5640 1 -- start start 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.044+0000 7ff8fcbd5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f806ebf0 0x7ff8f80c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.044+0000 7ff8fcbd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f80ae910 0x7ff8f81594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.044+0000 7ff8fcbd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f80cf190 0x7ff8f815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.044+0000 7ff8fcbd5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f80ad280 con 0x7ff8f80ae910 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8fcbd5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f80aecf0 con 0x7ff8f806ebf0 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8fcbd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f80ad400 con 0x7ff8f80cf190 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f80ae910 0x7ff8f81594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f80ae910 0x7ff8f81594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36852/0 (socket says 172.21.15.79:36852) 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 -- 172.21.15.79:0/2776852887 learned_addr learned my addr 172.21.15.79:0/2776852887 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f659c640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f806ebf0 0x7ff8f80c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f6d9d640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f80cf190 0x7ff8f815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 -- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f80cf190 msgr2=0x7ff8f815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f80cf190 0x7ff8f815dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 -- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f806ebf0 msgr2=0x7ff8f80c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f806ebf0 0x7ff8f80c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 -- 172.21.15.79:0/2776852887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f815cc20 con 0x7ff8f80ae910 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f659c640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f806ebf0 0x7ff8f80c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8f5d9b640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f80ae910 0x7ff8f81594a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00b2c0 tx=0x7ff8ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8e6ffd640 1 -- 172.21.15.79:0/2776852887 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec043070 con 0x7ff8f80ae910 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8e6ffd640 1 -- 172.21.15.79:0/2776852887 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec003830 con 0x7ff8f80ae910 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f815cf00 con 0x7ff8f80ae910 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8e6ffd640 1 -- 172.21.15.79:0/2776852887 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec003c20 con 0x7ff8f80ae910 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.045+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f815d7a0 con 0x7ff8f80ae910 2024-06-10T00:15:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.046+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f815d0d0 con 0x7ff8f80ae910 2024-06-10T00:15:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.047+0000 7ff8e6ffd640 1 -- 172.21.15.79:0/2776852887 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8ec046070 con 0x7ff8f80ae910 2024-06-10T00:15:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.047+0000 7ff8e6ffd640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8d806be30 0x7ff8d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.047+0000 7ff8e6ffd640 1 -- 172.21.15.79:0/2776852887 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff8ec0ae010 con 0x7ff8f80ae910 2024-06-10T00:15:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.047+0000 7ff8f659c640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8d806be30 0x7ff8d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.048+0000 7ff8f659c640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8d806be30 0x7ff8d806e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8003eb0 tx=0x7ff8e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.052+0000 7ff8e6ffd640 1 -- 172.21.15.79:0/2776852887 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff8ec07c830 con 0x7ff8f80ae910 2024-06-10T00:15:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.262+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8f8068430 con 0x7ff8f80ae910 2024-06-10T00:15:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.263+0000 7ff8e6ffd640 1 -- 172.21.15.79:0/2776852887 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7ff8ec07c130 con 0x7ff8f80ae910 2024-06-10T00:15:09.263 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:09.263 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:15:01.280562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:15:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8d806be30 msgr2=0x7ff8d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8d806be30 0x7ff8d806e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8003eb0 tx=0x7ff8e8009040 comp rx=0 tx=0).stop 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f80ae910 msgr2=0x7ff8f81594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f80ae910 0x7ff8f81594a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00b2c0 tx=0x7ff8ec0046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 shutdown_connections 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8d806be30 0x7ff8d806e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f80cf190 0x7ff8f815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f80ae910 0x7ff8f81594a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 --2- 172.21.15.79:0/2776852887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f806ebf0 0x7ff8f80c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 >> 172.21.15.79:0/2776852887 conn(0x7ff8f80b19f0 msgr2=0x7ff8f80728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 shutdown_connections 2024-06-10T00:15:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.265+0000 7ff8fcbd5640 1 -- 172.21.15.79:0/2776852887 wait complete. 2024-06-10T00:15:09.678 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:14:42.196314+0000', 'modified': '2024-06-10T00:15:01.280562+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6835/4113284767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6833', 'nonce': 4113284767}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 4113284767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-06-10T00:15:09.678 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:15:09.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-06-10T00:15:09.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.786+0000 7f1889c3f640 1 Processor -- start 2024-06-10T00:15:09.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.786+0000 7f1889c3f640 1 -- start start 2024-06-10T00:15:09.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f1889c3f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f18840cf360 0x7f18840b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f1889c3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18840b3420 con 0x7f18840cd230 2024-06-10T00:15:09.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f1889c3f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18840cc750 con 0x7f18841553c0 2024-06-10T00:15:09.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f1889c3f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f18840cca30 con 0x7f18840cf360 2024-06-10T00:15:09.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f1882ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f18840cd230 0x7f18840cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56218/0 (socket says 172.21.15.79:56218) 2024-06-10T00:15:09.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f1882ffd640 1 -- 172.21.15.79:0/2520044582 learned_addr learned my addr 172.21.15.79:0/2520044582 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:09.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f1883fff640 1 --2- 172.21.15.79:0/2520044582 >> v2:172.21.15.117:3300/0 conn(0x7f18840cf360 0x7f18840b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f18827fc640 1 -- 172.21.15.79:0/2520044582 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4263238045 0 0) 0x7f18840b3420 con 0x7f18840cd230 2024-06-10T00:15:09.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f18827fc640 1 -- 172.21.15.79:0/2520044582 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f186c003520 con 0x7f18840cd230 2024-06-10T00:15:09.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.787+0000 7f1883fff640 1 -- 172.21.15.79:0/2520044582 >> v1:172.21.15.117:6789/0 conn(0x7f18841553c0 legacy=0x7f188415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.788+0000 7f1883fff640 1 -- 172.21.15.79:0/2520044582 >> v1:172.21.15.79:6789/0 conn(0x7f18840cd230 legacy=0x7f18840cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.788+0000 7f18827fc640 1 -- 172.21.15.79:0/2520044582 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3017417087 0 0) 0x7f186c003520 con 0x7f18840cd230 2024-06-10T00:15:09.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.788+0000 7f1883fff640 1 -- 172.21.15.79:0/2520044582 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18840ccd10 con 0x7f18840cf360 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.788+0000 7f1883fff640 1 --2- 172.21.15.79:0/2520044582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 0x7f18840b2cf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f187c009d90 tx=0x7f187c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a683d6ee191aa2ca server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.788+0000 7f18827fc640 1 -- 172.21.15.79:0/2520044582 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878001670 con 0x7f18840cf360 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.788+0000 7f18827fc640 1 -- 172.21.15.79:0/2520044582 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c007540 con 0x7f18840cf360 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.788+0000 7f18827fc640 1 -- 172.21.15.79:0/2520044582 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0078f0 con 0x7f18840cf360 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.789+0000 7f1889c3f640 1 -- 172.21.15.79:0/2520044582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 msgr2=0x7f18840b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.789+0000 7f1889c3f640 1 --2- 172.21.15.79:0/2520044582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 0x7f18840b2cf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f187c009d90 tx=0x7f187c02a680 comp rx=0 tx=0).stop 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.789+0000 7f1889c3f640 1 -- 172.21.15.79:0/2520044582 shutdown_connections 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.789+0000 7f1889c3f640 1 --2- 172.21.15.79:0/2520044582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 0x7f18840b2cf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.789+0000 7f1889c3f640 1 -- 172.21.15.79:0/2520044582 >> 172.21.15.79:0/2520044582 conn(0x7f18840b19f0 msgr2=0x7f18840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:09.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.789+0000 7f1889c3f640 1 -- 172.21.15.79:0/2520044582 shutdown_connections 2024-06-10T00:15:09.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.789+0000 7f1889c3f640 1 -- 172.21.15.79:0/2520044582 wait complete. 2024-06-10T00:15:09.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.790+0000 7f1889c3f640 1 Processor -- start 2024-06-10T00:15:09.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.790+0000 7f1889c3f640 1 -- start start 2024-06-10T00:15:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f1889c3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18840cd230 0x7f188415de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f1889c3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 0x7f1884145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f1889c3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18841553c0 0x7f188409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f1889c3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1884155920 con 0x7f18840cd230 2024-06-10T00:15:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f1889c3f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18841557a0 con 0x7f18840cf360 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f1889c3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1884071030 con 0x7f18841553c0 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f18837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18840cd230 0x7f188415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f18837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18840cd230 0x7f188415de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36862/0 (socket says 172.21.15.79:36862) 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f18837fe640 1 -- 172.21.15.79:0/2134336752 learned_addr learned my addr 172.21.15.79:0/2134336752 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f1882ffd640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 0x7f1884145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.791+0000 7f1883fff640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18841553c0 0x7f188409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f18837fe640 1 -- 172.21.15.79:0/2134336752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18841553c0 msgr2=0x7f188409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f18837fe640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18841553c0 0x7f188409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f18837fe640 1 -- 172.21.15.79:0/2134336752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 msgr2=0x7f1884145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f18837fe640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 0x7f1884145840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f18837fe640 1 -- 172.21.15.79:0/2134336752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188415cda0 con 0x7f18840cd230 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f18837fe640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18840cd230 0x7f188415de40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f187400c3f0 tx=0x7f187400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f186bfff640 1 -- 172.21.15.79:0/2134336752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18740052d0 con 0x7f18840cd230 2024-06-10T00:15:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f186bfff640 1 -- 172.21.15.79:0/2134336752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1874005490 con 0x7f18840cd230 2024-06-10T00:15:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f1889c3f640 1 -- 172.21.15.79:0/2134336752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188415d080 con 0x7f18840cd230 2024-06-10T00:15:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f186bfff640 1 -- 172.21.15.79:0/2134336752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874007260 con 0x7f18840cd230 2024-06-10T00:15:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.792+0000 7f1889c3f640 1 -- 172.21.15.79:0/2134336752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188415d640 con 0x7f18840cd230 2024-06-10T00:15:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.794+0000 7f186bfff640 1 -- 172.21.15.79:0/2134336752 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1874007400 con 0x7f18840cd230 2024-06-10T00:15:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.794+0000 7f186bfff640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f187006be30 0x7f187006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.794+0000 7f186bfff640 1 -- 172.21.15.79:0/2134336752 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f187408a550 con 0x7f18840cd230 2024-06-10T00:15:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.794+0000 7f1882ffd640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f187006be30 0x7f187006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.795+0000 7f1882ffd640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f187006be30 0x7f187006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1884151da0 tx=0x7f18780016d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.795+0000 7f188ca2b740 1 Processor -- start 2024-06-10T00:15:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.795+0000 7f188ca2b740 1 -- start start 2024-06-10T00:15:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 0x5594bc6d8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc6d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6a8960 0x5594bc6ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f188ca2b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5594bc611740 con 0x5594bc6d60e0 2024-06-10T00:15:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f188ca2b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5594bc5afa80 con 0x5594bc6a8960 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f188ca2b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5594bc60d700 con 0x5594bc6d5d00 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc6d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc6d8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36870/0 (socket says 172.21.15.79:36870) 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 -- 172.21.15.79:0/405740968 learned_addr learned my addr 172.21.15.79:0/405740968 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 -- 172.21.15.79:0/405740968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 msgr2=0x5594bc6d8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 --2- 172.21.15.79:0/405740968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 0x5594bc6d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 -- 172.21.15.79:0/405740968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6a8960 msgr2=0x5594bc6ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 --2- 172.21.15.79:0/405740968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6a8960 0x5594bc6ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 -- 172.21.15.79:0/405740968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594bc5dafb0 con 0x5594bc6d60e0 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.796+0000 7f1882ffd640 1 --2- 172.21.15.79:0/405740968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc6d8a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1878005880 tx=0x7f1878012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5933d2b34e06d0d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f18697fa640 1 -- 172.21.15.79:0/405740968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878026070 con 0x5594bc6d60e0 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f18697fa640 1 -- 172.21.15.79:0/405740968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18780065d0 con 0x5594bc6d60e0 2024-06-10T00:15:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f18697fa640 1 -- 172.21.15.79:0/405740968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780133f0 con 0x5594bc6d60e0 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 -- 172.21.15.79:0/405740968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 msgr2=0x5594bc6d8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 --2- 172.21.15.79:0/405740968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc6d8a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1878005880 tx=0x7f1878012000 comp rx=0 tx=0).stop 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 -- 172.21.15.79:0/405740968 shutdown_connections 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 --2- 172.21.15.79:0/405740968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6a8960 0x5594bc6ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 --2- 172.21.15.79:0/405740968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc6d8a50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 --2- 172.21.15.79:0/405740968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 0x5594bc6d8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 -- 172.21.15.79:0/405740968 >> 172.21.15.79:0/405740968 conn(0x5594bc6aabd0 msgr2=0x5594bc6f3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 -- 172.21.15.79:0/405740968 shutdown_connections 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.797+0000 7f188ca2b740 1 -- 172.21.15.79:0/405740968 wait complete. 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.798+0000 7f188ca2b740 1 -- start start 2024-06-10T00:15:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.798+0000 7f188ca2b740 1 Processor -- start 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d5d00 0x5594bc6d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d60e0 0x5594bc6cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6ccaf0 0x5594bc6f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f188ca2b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5594bc6add80 con 0x5594bc6d5d00 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f188ca2b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5594bc59ac30 con 0x5594bc6ccaf0 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f188ca2b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5594bc6ae060 con 0x5594bc6d60e0 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f188ca2b740 10 client.0 _ll_register_callbacks cb 0x5594bc5cc7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d5d00 0x5594bc6d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d5d00 0x5594bc6d3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36876/0 (socket says 172.21.15.79:36876) 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 -- 172.21.15.79:0/3358938053 learned_addr learned my addr 172.21.15.79:0/3358938053 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f1882ffd640 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d60e0 0x5594bc6cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f1883fff640 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6ccaf0 0x5594bc6f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 -- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d60e0 msgr2=0x5594bc6cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d60e0 0x5594bc6cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 -- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6ccaf0 msgr2=0x5594bc6f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6ccaf0 0x5594bc6f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 -- 172.21.15.79:0/3358938053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594bc3252d0 con 0x5594bc6d5d00 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f1883fff640 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6ccaf0 0x5594bc6f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18837fe640 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d5d00 0x5594bc6d3cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1874054a60 tx=0x7f1874058050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c39c436b81b3b81 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18627fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18627fc640 1 -- 172.21.15.79:0/3358938053 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187408a0c0 con 0x5594bc6d5d00 2024-06-10T00:15:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18627fc640 1 -- 172.21.15.79:0/3358938053 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f187408a260 con 0x5594bc6d5d00 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f188ca2b740 1 -- 172.21.15.79:0/3358938053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18780065d0 con 0x5594bc6d5d00 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.799+0000 7f18627fc640 1 -- 172.21.15.79:0/3358938053 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f1874088b60 con 0x5594bc6d5d00 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f188ca2b740 10 client.4704 fetch_fsmap learned FSMap version 8 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f188ca2b740 1 -- 172.21.15.79:0/3358938053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5594bc3ef6b0 con 0x5594bc6d5d00 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f18627fc640 1 -- 172.21.15.79:0/3358938053 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18780065d0 con 0x5594bc6d5d00 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f18627fc640 1 -- 172.21.15.79:0/3358938053 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f1874057a50 con 0x5594bc6d5d00 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f188ca2b740 10 client.4704 fetch_fsmap finished waiting for FSMap version 8 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f188ca2b740 10 client.4704 resolve_mds: resolved name 'd' to daemon mds.d 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f188ca2b740 20 client.4704 populate_metadata read hostname 'smithi079' 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x5594bc6f5ce0 0x5594bc6da000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f188ca2b740 4 client.4704 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f188ca2b740 1 -- 172.21.15.79:0/3358938053 --> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594bc61ee70 con 0x5594bc6f5ce0 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f1882ffd640 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x5594bc6f5ce0 0x5594bc6da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f1882ffd640 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x5594bc6f5ce0 0x5594bc6da000 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=220ed085ecfd3d52 server_cookie=1b5a9f2547a28f0d in_seq=0 out_seq=0 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.800+0000 7f18627fc640 10 client.4704 ms_handle_connect on v2:172.21.15.117:6833/4113284767 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f18627fc640 1 -- 172.21.15.79:0/3358938053 <== mds.0 v2:172.21.15.117:6833/4113284767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5594bc61ee70 con 0x5594bc6f5ce0 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f18627fc640 10 client.4704 handle_command_reply: tid=0 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 client.4704 shutdown 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 -- 172.21.15.79:0/3358938053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d5d00 msgr2=0x5594bc6d3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d5d00 0x5594bc6d3cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1874054a60 tx=0x7f1874058050 comp rx=0 tx=0).stop 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 -- 172.21.15.79:0/3358938053 shutdown_connections 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x5594bc6f5ce0 0x5594bc6da000 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6ccaf0 0x5594bc6f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d60e0 0x5594bc6cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f18627fc640 0 client.4704 ms_handle_reset on v2:172.21.15.117:6833/4113284767 2024-06-10T00:15:09.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3358938053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d5d00 0x5594bc6d3cd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 -- 172.21.15.79:0/3358938053 >> 172.21.15.79:0/3358938053 conn(0x5594bc6a8960 msgr2=0x5594bc6d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:09.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 -- 172.21.15.79:0/3358938053 shutdown_connections 2024-06-10T00:15:09.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.801+0000 7f188ca2b740 1 -- 172.21.15.79:0/3358938053 wait complete. 2024-06-10T00:15:09.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.802+0000 7f188ca2b740 20 client.4704 trim_cache size 0 max 16384 2024-06-10T00:15:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.820+0000 7f188ca2b740 1 Processor -- start 2024-06-10T00:15:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.820+0000 7f188ca2b740 1 -- start start 2024-06-10T00:15:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6ccaf0 0x5594bc6cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 0x5594bc6a7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d60e0 0x5594bc6a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f188ca2b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18841fe920 con 0x5594bc6ccaf0 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f188ca2b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18840ce4a0 con 0x5594bc6d60e0 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f188ca2b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18841fe3a0 con 0x5594bc6d5d00 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6ccaf0 0x5594bc6cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6ccaf0 0x5594bc6cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36890/0 (socket says 172.21.15.79:36890) 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 -- 172.21.15.79:0/3608926676 learned_addr learned my addr 172.21.15.79:0/3608926676 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 -- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 msgr2=0x5594bc6a7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f1882ffd640 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 0x5594bc6a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 0x5594bc6a7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 -- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d60e0 msgr2=0x5594bc6a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f1883fff640 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d60e0 0x5594bc6a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d60e0 0x5594bc6a7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 -- 172.21.15.79:0/3608926676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594bc6aa470 con 0x5594bc6ccaf0 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f1882ffd640 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 0x5594bc6a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f1883fff640 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d60e0 0x5594bc6a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.821+0000 7f18837fe640 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6ccaf0 0x5594bc6cb7e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f18740568b0 tx=0x7f187408a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b656db6d28c85d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f1868ff9640 1 -- 172.21.15.79:0/3608926676 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874054c70 con 0x5594bc6ccaf0 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f1868ff9640 1 -- 172.21.15.79:0/3608926676 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1874074020 con 0x5594bc6ccaf0 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f1868ff9640 1 -- 172.21.15.79:0/3608926676 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874054e10 con 0x5594bc6ccaf0 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 -- 172.21.15.79:0/3608926676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6ccaf0 msgr2=0x5594bc6cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6ccaf0 0x5594bc6cb7e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f18740568b0 tx=0x7f187408a050 comp rx=0 tx=0).stop 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 -- 172.21.15.79:0/3608926676 shutdown_connections 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d60e0 0x5594bc6a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6d5d00 0x5594bc6a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3608926676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6ccaf0 0x5594bc6cb7e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 -- 172.21.15.79:0/3608926676 >> 172.21.15.79:0/3608926676 conn(0x5594bc6a8960 msgr2=0x5594bc6a4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 -- 172.21.15.79:0/3608926676 shutdown_connections 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.822+0000 7f188ca2b740 1 -- 172.21.15.79:0/3608926676 wait complete. 2024-06-10T00:15:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.823+0000 7f188ca2b740 1 -- start start 2024-06-10T00:15:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.823+0000 7f188ca2b740 1 Processor -- start 2024-06-10T00:15:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6ccaf0 0x5594bc6d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d5d00 0x5594bc6d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc716e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5594bc6f5b60 con 0x5594bc6d60e0 2024-06-10T00:15:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5594bc6d93c0 con 0x5594bc6d5d00 2024-06-10T00:15:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5594bc6f6180 con 0x5594bc6ccaf0 2024-06-10T00:15:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 10 client.0 _ll_register_callbacks cb 0x7f18740581d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc716e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc716e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36900/0 (socket says 172.21.15.79:36900) 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 -- 172.21.15.79:0/3238390392 learned_addr learned my addr 172.21.15.79:0/3238390392 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f18837fe640 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6ccaf0 0x5594bc6d43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1882ffd640 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d5d00 0x5594bc6d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 -- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6ccaf0 msgr2=0x5594bc6d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6ccaf0 0x5594bc6d43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 -- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d5d00 msgr2=0x5594bc6d48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d5d00 0x5594bc6d48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 -- 172.21.15.79:0/3238390392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594bc6ac6b0 con 0x5594bc6d60e0 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f1883fff640 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc716e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f187c009eb0 tx=0x7f187c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dca9f82ac344035 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f18627fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f18627fc640 1 -- 172.21.15.79:0/3238390392 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c009450 con 0x5594bc6d60e0 2024-06-10T00:15:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f18627fc640 1 -- 172.21.15.79:0/3238390392 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f187c004500 con 0x5594bc6d60e0 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 1 -- 172.21.15.79:0/3238390392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1874074020 con 0x5594bc6d60e0 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f18627fc640 1 -- 172.21.15.79:0/3238390392 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f187c009a30 con 0x5594bc6d60e0 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.824+0000 7f188ca2b740 10 client.4710 fetch_fsmap learned FSMap version 8 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f188ca2b740 1 -- 172.21.15.79:0/3238390392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5594bc6cfc30 con 0x5594bc6d60e0 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f18627fc640 1 -- 172.21.15.79:0/3238390392 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1874074020 con 0x5594bc6d60e0 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f18627fc640 1 -- 172.21.15.79:0/3238390392 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f187c004700 con 0x5594bc6d60e0 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f188ca2b740 10 client.4710 fetch_fsmap finished waiting for FSMap version 8 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f188ca2b740 10 client.4710 resolve_mds: resolved name 'd' to daemon mds.d 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f188ca2b740 20 client.4710 populate_metadata read hostname 'smithi079' 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x5594bc6f0fd0 0x5594bc6f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f188ca2b740 4 client.4710 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:15:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f188ca2b740 1 -- 172.21.15.79:0/3238390392 --> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] -- command(tid 0: {"prefix": "status"}) -- 0x5594bc6191c0 con 0x5594bc6f0fd0 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f18837fe640 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x5594bc6f0fd0 0x5594bc6f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f18837fe640 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x5594bc6f0fd0 0x5594bc6f13b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5f9cfb92f856419 server_cookie=c8a1bfba43e0f80d in_seq=0 out_seq=0 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.825+0000 7f18627fc640 10 client.4710 ms_handle_connect on v2:172.21.15.117:6833/4113284767 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f18627fc640 1 -- 172.21.15.79:0/3238390392 <== mds.0 v2:172.21.15.117:6833/4113284767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5594bc6191c0 con 0x5594bc6f0fd0 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f18627fc640 10 client.4710 handle_command_reply: tid=0 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 client.4710 shutdown 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 -- 172.21.15.79:0/3238390392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 msgr2=0x5594bc716e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc716e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f187c009eb0 tx=0x7f187c004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 -- 172.21.15.79:0/3238390392 shutdown_connections 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:6833/4113284767,v1:172.21.15.117:6835/4113284767] conn(0x5594bc6f0fd0 0x5594bc6f13b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5594bc6d60e0 0x5594bc716e90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594bc6d5d00 0x5594bc6d48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f18627fc640 0 client.4710 ms_handle_reset on v2:172.21.15.117:6833/4113284767 2024-06-10T00:15:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 --2- 172.21.15.79:0/3238390392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5594bc6ccaf0 0x5594bc6d43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 -- 172.21.15.79:0/3238390392 >> 172.21.15.79:0/3238390392 conn(0x5594bc6a8960 msgr2=0x5594bc6a8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 -- 172.21.15.79:0/3238390392 shutdown_connections 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 1 -- 172.21.15.79:0/3238390392 wait complete. 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f188ca2b740 20 client.4710 trim_cache size 0 max 16384 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4287, 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:15:09.832 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:15:09.833 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:15:09.833 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 26.979496296000001, 2024-06-10T00:15:09.833 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 8, 2024-06-10T00:15:09.833 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 24, 2024-06-10T00:15:09.833 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 24, 2024-06-10T00:15:09.833 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 33.125880316999996 2024-06-10T00:15:09.833 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:15:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 -- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f187006be30 msgr2=0x7f187006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f187006be30 0x7f187006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1884151da0 tx=0x7f18780016d0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 -- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18840cd230 msgr2=0x7f188415de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18840cd230 0x7f188415de40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f187400c3f0 tx=0x7f187400c8b0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 -- 172.21.15.79:0/2134336752 shutdown_connections 2024-06-10T00:15:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f187006be30 0x7f187006e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18841553c0 0x7f188409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18840cf360 0x7f1884145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 --2- 172.21.15.79:0/2134336752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18840cd230 0x7f188415de40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:09.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 -- 172.21.15.79:0/2134336752 >> 172.21.15.79:0/2134336752 conn(0x7f18840b19f0 msgr2=0x7f18840ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:09.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.826+0000 7f1889c3f640 1 -- 172.21.15.79:0/2134336752 shutdown_connections 2024-06-10T00:15:09.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:09.827+0000 7f1889c3f640 1 -- 172.21.15.79:0/2134336752 wait complete. 2024-06-10T00:15:09.837 INFO:teuthology.run_tasks:Running task sequential... 2024-06-10T00:15:09.858 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-10T00:15:09.858 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-10T00:15:09.859 INFO:teuthology.task.print:Enabling mgr modules 2024-06-10T00:15:09.859 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-06-10T00:15:09.916 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-06-10T00:15:09.917 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-06-10T00:15:09.917 INFO:tasks.ceph_fuse:client.0 config is {} 2024-06-10T00:15:09.917 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-10T00:15:09.917 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:09.917 INFO:tasks.ceph_fuse:client.2 config is {} 2024-06-10T00:15:09.917 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-10T00:15:09.917 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-10T00:15:09.917 INFO:tasks.ceph_fuse:client.1 config is {} 2024-06-10T00:15:09.917 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-10T00:15:09.917 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:09.918 INFO:tasks.ceph_fuse:client.3 config is {} 2024-06-10T00:15:09.918 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-10T00:15:09.918 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-10T00:15:09.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:09.918 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:15:09.934 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-10T00:15:09.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:09.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-10T00:15:09.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:10.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-06-10T00:15:10.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:10.098 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-06-10T00:15:10.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:10.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-06-10T00:15:10.190 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-06-10T00:15:10.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:15:10.191 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-06-10T00:15:10.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:15:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.292+0000 7f6964cee640 1 Processor -- start 2024-06-10T00:15:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.292+0000 7f6964cee640 1 -- start start 2024-06-10T00:15:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.293+0000 7f6964cee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960156830 0x7f6960071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.293+0000 7f6964cee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6960072130 0x7f69600cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.293+0000 7f6964cee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69600725f0 con 0x7f696015c7f0 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.293+0000 7f6964cee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f69600b3090 con 0x7f6960072130 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.293+0000 7f6964cee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f69600728d0 con 0x7f6960156830 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.294+0000 7f695dd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6960072130 0x7f69600cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.294+0000 7f695dd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6960072130 0x7f69600cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36904/0 (socket says 172.21.15.79:36904) 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.294+0000 7f695dd9b640 1 -- 172.21.15.79:0/1342811581 learned_addr learned my addr 172.21.15.79:0/1342811581 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.294+0000 7f695e59c640 1 --2- 172.21.15.79:0/1342811581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960156830 0x7f6960071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.294+0000 7f695dd9b640 1 -- 172.21.15.79:0/1342811581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960156830 msgr2=0x7f6960071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.294+0000 7f695dd9b640 1 --2- 172.21.15.79:0/1342811581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960156830 0x7f6960071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.294+0000 7f695dd9b640 1 -- 172.21.15.79:0/1342811581 >> v1:172.21.15.117:6789/0 conn(0x7f696015c7f0 legacy=0x7f69600b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.294+0000 7f695dd9b640 1 -- 172.21.15.79:0/1342811581 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6960072bb0 con 0x7f6960072130 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f695dd9b640 1 --2- 172.21.15.79:0/1342811581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960072130 0x7f69600cc670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f69480098a0 tx=0x7f694802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a0159d3357ef18 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f695d59a640 1 -- 172.21.15.79:0/1342811581 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948037070 con 0x7f6960072130 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f695d59a640 1 -- 172.21.15.79:0/1342811581 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6948032440 con 0x7f6960072130 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f695d59a640 1 -- 172.21.15.79:0/1342811581 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948032810 con 0x7f6960072130 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f6964cee640 1 -- 172.21.15.79:0/1342811581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960072130 msgr2=0x7f69600cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f6964cee640 1 --2- 172.21.15.79:0/1342811581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960072130 0x7f69600cc670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f69480098a0 tx=0x7f694802a250 comp rx=0 tx=0).stop 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f6964cee640 1 -- 172.21.15.79:0/1342811581 shutdown_connections 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f6964cee640 1 --2- 172.21.15.79:0/1342811581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960072130 0x7f69600cc670 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f6964cee640 1 --2- 172.21.15.79:0/1342811581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960156830 0x7f6960071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f6964cee640 1 -- 172.21.15.79:0/1342811581 >> 172.21.15.79:0/1342811581 conn(0x7f69600b19f0 msgr2=0x7f69600b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f6964cee640 1 -- 172.21.15.79:0/1342811581 shutdown_connections 2024-06-10T00:15:10.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.295+0000 7f6964cee640 1 -- 172.21.15.79:0/1342811581 wait complete. 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.297+0000 7f6964cee640 1 Processor -- start 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.297+0000 7f6964cee640 1 -- start start 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.297+0000 7f6964cee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960072130 0x7f696014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.297+0000 7f6964cee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960156830 0x7f69600cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.297+0000 7f6964cee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f696015c7f0 0x7f696009ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.297+0000 7f6964cee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69600ccd30 con 0x7f6960156830 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f6964cee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69600ccbb0 con 0x7f696015c7f0 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f6964cee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f69600cceb0 con 0x7f6960072130 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960156830 0x7f69600cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960156830 0x7f69600cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36908/0 (socket says 172.21.15.79:36908) 2024-06-10T00:15:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 -- 172.21.15.79:0/1568205204 learned_addr learned my addr 172.21.15.79:0/1568205204 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695e59c640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960072130 0x7f696014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 -- 172.21.15.79:0/1568205204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960072130 msgr2=0x7f696014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695ed9d640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f696015c7f0 0x7f696009ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960072130 0x7f696014fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 -- 172.21.15.79:0/1568205204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f696015c7f0 msgr2=0x7f696009ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f696015c7f0 0x7f696009ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 -- 172.21.15.79:0/1568205204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6960150370 con 0x7f6960156830 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f695dd9b640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960156830 0x7f69600cf710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f69480098a0 tx=0x7f69480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f6956ffd640 1 -- 172.21.15.79:0/1568205204 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948037040 con 0x7f6960156830 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f6956ffd640 1 -- 172.21.15.79:0/1568205204 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6948004230 con 0x7f6960156830 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69600d0210 con 0x7f6960156830 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f6956ffd640 1 -- 172.21.15.79:0/1568205204 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948030620 con 0x7f6960156830 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.298+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6960151320 con 0x7f6960156830 2024-06-10T00:15:10.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.299+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696015f770 con 0x7f6960156830 2024-06-10T00:15:10.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.300+0000 7f6956ffd640 1 -- 172.21.15.79:0/1568205204 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69480307c0 con 0x7f6960156830 2024-06-10T00:15:10.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.300+0000 7f6956ffd640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:10.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.300+0000 7f6956ffd640 1 -- 172.21.15.79:0/1568205204 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f69480ac0f0 con 0x7f6960156830 2024-06-10T00:15:10.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.300+0000 7f695e59c640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:10.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.300+0000 7f695e59c640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f694006be30 0x7f694006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6958008ef0 tx=0x7f6958008440 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:10.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.304+0000 7f6956ffd640 1 -- 172.21.15.79:0/1568205204 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f696015f770 con 0x7f6960156830 2024-06-10T00:15:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.515+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6960068430 con 0x7f6960156830 2024-06-10T00:15:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.515+0000 7f6956ffd640 1 -- 172.21.15.79:0/1568205204 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f6960150370 con 0x7f6960156830 2024-06-10T00:15:10.515 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-10T00:15:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f694006be30 msgr2=0x7f694006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f694006be30 0x7f694006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6958008ef0 tx=0x7f6958008440 comp rx=0 tx=0).stop 2024-06-10T00:15:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960156830 msgr2=0x7f69600cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960156830 0x7f69600cf710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f69480098a0 tx=0x7f69480046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 shutdown_connections 2024-06-10T00:15:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f696015c7f0 0x7f696009ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6960156830 0x7f69600cf710 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 --2- 172.21.15.79:0/1568205204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6960072130 0x7f696014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 >> 172.21.15.79:0/1568205204 conn(0x7f69600b19f0 msgr2=0x7f69600b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 shutdown_connections 2024-06-10T00:15:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10.517+0000 7f6964cee640 1 -- 172.21.15.79:0/1568205204 wait complete. 2024-06-10T00:15:10.527 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:15:10.528 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:15:10.528 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:15:10.528 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:15:10.528 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:10.528 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:15:10.528 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:15:10.528 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:15:10.528 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:15:10.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:10.528 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42734sec preferred_lft 42734sec 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:15:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:10.546 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-10T00:15:10.546 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:10.546 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:10.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-06-10T00:15:10.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-06-10T00:15:10.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-06-10T00:15:10.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-10T00:15:10.546 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:10.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:10.682 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:15:10.705 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:15:10.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:10.707 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:15:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:15:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:15:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:15:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:15:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:15:10.763 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:10.764 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:10.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:15:10.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:15:10.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:15:10.764 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:10.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:10.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:10.890 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:15:10.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:10.905 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-06-10T00:15:10.961 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:10.961 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:10.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:10.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-10T00:15:10.961 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:11.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:11.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:11.078 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-10T00:15:11.078 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:11.079 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:11.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-10T00:15:11.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-10T00:15:11.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-10T00:15:11.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-10T00:15:11.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-10T00:15:11.079 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:11.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:11.193 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:11.193 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:11.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:15:11.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-06-10T00:15:11.194 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:11.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:11.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:11.270 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:15:11.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:11.270 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:15:11.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:11.285 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:11.340 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:15:11.406 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:11.462 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:15:11.462 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:15:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:15:11.464 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:15:11.465 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:15:11.465 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:15:11.465 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:15:11.465 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:11.465 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:11.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:11.465 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:15:11.517 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:15:11.517 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:15:11.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:15:11.583 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:11.639 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:15:11.639 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:15:11.639 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:15:11.639 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:15:11.639 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:15:11.639 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:15:11.639 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:15:11.639 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:11.640 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:11.641 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:11.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:11.642 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:15:11.643 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:15:11.642+0000 7f15c2d41480 -1 init, newargv = 0x55f0f28ae030 newargc=15 2024-06-10T00:15:11.643 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[47461]: starting ceph client 2024-06-10T00:15:11.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[47461]: starting fuse 2024-06-10T00:15:11.660 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:15:11.660 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:15:11.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:15:11.660 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:15:11.660 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:15:11.660 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:11.660 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:15:11.660 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:15:11.661 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:15:11.662 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:15:11.662 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:15:11.662 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:15:11.662 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:11.662 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:15:11.662 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.47461.asok 2024-06-10T00:15:11.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:11.789 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47461.asok 2024-06-10T00:15:11.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:11.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47461.asok status 2024-06-10T00:15:11.923 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:15:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:15:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:15:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:15:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:15:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:15:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "47461", 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4722, 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 4722 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:15:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3491706109 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3491706109 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.4722 192.168.0.1:0/3491706109", 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/3491706109", 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 8, 2024-06-10T00:15:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 24, 2024-06-10T00:15:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:15:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:15:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:15:11.926 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:15:11.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:15:12.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.030+0000 7f06f44a5640 1 Processor -- start 2024-06-10T00:15:12.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.030+0000 7f06f44a5640 1 -- start start 2024-06-10T00:15:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.031+0000 7f06f44a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.031+0000 7f06f44a5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06ec0cef70 0x7f06ec0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.031+0000 7f06f44a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec15f5e0 con 0x7f06ec0d2680 2024-06-10T00:15:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.031+0000 7f06f44a5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f06ec0d13e0 con 0x7f06ec0cef70 2024-06-10T00:15:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.031+0000 7f06f44a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06ec0d0ad0 con 0x7f06ec15f1a0 2024-06-10T00:15:12.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f1a40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:12.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f2a42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06ec0cef70 0x7f06ec0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:12.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f2a42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06ec0cef70 0x7f06ec0cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:32902/0 (socket says 172.21.15.79:32902) 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f1a40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:45318/0 (socket says 172.21.15.79:45318) 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f2241640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f06ec0d2680 0x7f06ec0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:44932/0 (socket says 172.21.15.79:44932) 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f2a42640 1 -- 172.21.15.79:0/348437834 learned_addr learned my addr 172.21.15.79:0/348437834 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f2a42640 1 -- 172.21.15.79:0/348437834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 msgr2=0x7f06ec0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f2a42640 1 --2- 172.21.15.79:0/348437834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f2a42640 1 -- 172.21.15.79:0/348437834 >> v1:172.21.15.117:6789/0 conn(0x7f06ec0d2680 legacy=0x7f06ec0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f2a42640 1 -- 172.21.15.79:0/348437834 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec15f890 con 0x7f06ec0cef70 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.032+0000 7f06f1a40640 1 --2- 172.21.15.79:0/348437834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.033+0000 7f06f2a42640 1 --2- 172.21.15.79:0/348437834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0cef70 0x7f06ec0cf400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009e50 tx=0x7f06e402a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebaf2abf4385dc19 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.033+0000 7f06f123f640 1 -- 172.21.15.79:0/348437834 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4036070 con 0x7f06ec0cef70 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.033+0000 7f06f123f640 1 -- 172.21.15.79:0/348437834 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e4031600 con 0x7f06ec0cef70 2024-06-10T00:15:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.033+0000 7f06f123f640 1 -- 172.21.15.79:0/348437834 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40319d0 con 0x7f06ec0cef70 2024-06-10T00:15:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.033+0000 7f06f44a5640 1 -- 172.21.15.79:0/348437834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0cef70 msgr2=0x7f06ec0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.033+0000 7f06f44a5640 1 --2- 172.21.15.79:0/348437834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0cef70 0x7f06ec0cf400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009e50 tx=0x7f06e402a630 comp rx=0 tx=0).stop 2024-06-10T00:15:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.034+0000 7f06f44a5640 1 -- 172.21.15.79:0/348437834 shutdown_connections 2024-06-10T00:15:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.034+0000 7f06f44a5640 1 --2- 172.21.15.79:0/348437834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0cef70 0x7f06ec0cf400 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.034+0000 7f06f44a5640 1 --2- 172.21.15.79:0/348437834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.034+0000 7f06f44a5640 1 -- 172.21.15.79:0/348437834 >> 172.21.15.79:0/348437834 conn(0x7f06ec09d3f0 msgr2=0x7f06ec0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.034+0000 7f06f44a5640 1 -- 172.21.15.79:0/348437834 shutdown_connections 2024-06-10T00:15:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.034+0000 7f06f44a5640 1 -- 172.21.15.79:0/348437834 wait complete. 2024-06-10T00:15:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.035+0000 7f06f44a5640 1 Processor -- start 2024-06-10T00:15:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.035+0000 7f06f44a5640 1 -- start start 2024-06-10T00:15:12.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.035+0000 7f06f44a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06ec0cef70 0x7f06ec1f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.035+0000 7f06f44a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0d2680 0x7f06ec143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.035+0000 7f06f44a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.035+0000 7f06f44a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec0d4f00 con 0x7f06ec0cef70 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.035+0000 7f06f44a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec0d1070 con 0x7f06ec0d2680 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.035+0000 7f06f44a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06ec0d1870 con 0x7f06ec15f1a0 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06ec0cef70 0x7f06ec1f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06ec0cef70 0x7f06ec1f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36912/0 (socket says 172.21.15.79:36912) 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 -- 172.21.15.79:0/653019550 learned_addr learned my addr 172.21.15.79:0/653019550 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f1a40640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0d2680 0x7f06ec143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2a42640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 -- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 msgr2=0x7f06ec0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 -- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0d2680 msgr2=0x7f06ec143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0d2680 0x7f06ec143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 -- 172.21.15.79:0/653019550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec0cdb80 con 0x7f06ec0cef70 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f1a40640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0d2680 0x7f06ec143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2a42640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f2241640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06ec0cef70 0x7f06ec1f41b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06e800c780 tx=0x7f06e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06e2ffd640 1 -- 172.21.15.79:0/653019550 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8018070 con 0x7f06ec0cef70 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06e2ffd640 1 -- 172.21.15.79:0/653019550 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e80072f0 con 0x7f06ec0cef70 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec143e90 con 0x7f06ec0cef70 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06e2ffd640 1 -- 172.21.15.79:0/653019550 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80047e0 con 0x7f06ec0cef70 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.036+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec0c9f00 con 0x7f06ec0cef70 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.037+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec068430 con 0x7f06ec0cef70 2024-06-10T00:15:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.038+0000 7f06e2ffd640 1 -- 172.21.15.79:0/653019550 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06e801b070 con 0x7f06ec0cef70 2024-06-10T00:15:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.038+0000 7f06e2ffd640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06d006be30 0x7f06d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.038+0000 7f06e2ffd640 1 -- 172.21.15.79:0/653019550 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f06e808a640 con 0x7f06ec0cef70 2024-06-10T00:15:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.038+0000 7f06f1a40640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06d006be30 0x7f06d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.039+0000 7f06f1a40640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06d006be30 0x7f06d006e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0d4510 tx=0x7f06dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.042+0000 7f06e2ffd640 1 -- 172.21.15.79:0/653019550 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f06e8058d40 con 0x7f06ec0cef70 2024-06-10T00:15:12.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.253+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06ec0d04e0 con 0x7f06ec0cef70 2024-06-10T00:15:12.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.254+0000 7f06e2ffd640 1 -- 172.21.15.79:0/653019550 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f06e8058640 con 0x7f06ec0cef70 2024-06-10T00:15:12.253 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-10T00:15:12.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06d006be30 msgr2=0x7f06d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:12.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06d006be30 0x7f06d006e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0d4510 tx=0x7f06dc008040 comp rx=0 tx=0).stop 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06ec0cef70 msgr2=0x7f06ec1f41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06ec0cef70 0x7f06ec1f41b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06e800c780 tx=0x7f06e800cc40 comp rx=0 tx=0).stop 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 shutdown_connections 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06d006be30 0x7f06d006e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06ec15f1a0 0x7f06ec0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06ec0d2680 0x7f06ec143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.255+0000 7f06f44a5640 1 --2- 172.21.15.79:0/653019550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06ec0cef70 0x7f06ec1f41b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.256+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 >> 172.21.15.79:0/653019550 conn(0x7f06ec09d3f0 msgr2=0x7f06ec15a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.256+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 shutdown_connections 2024-06-10T00:15:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12.256+0000 7f06f44a5640 1 -- 172.21.15.79:0/653019550 wait complete. 2024-06-10T00:15:12.266 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:15:12.266 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:15:12.266 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:15:12.267 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-06-10T00:15:12.267 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-10T00:15:12.267 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:15:12.267 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:15:12.267 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:15:12.267 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-06-10T00:15:12.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:12.267 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:15:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link tentative 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link tentative 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:12.285 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:15:12.346 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:15:12.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:12.349 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:15:12.404 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:15:12.404 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:15:12.404 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:15:12.404 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:15:12.405 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:15:12.405 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:12.405 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:12.405 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:15:12.405 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:15:12.405 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:15:12.405 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:12.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:12.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:12.531 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:15:12.546 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:15:12.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:12.547 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-06-10T00:15:12.601 INFO:teuthology.orchestra.run.smithi079.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-06-10T00:15:12.602 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:12.602 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:12.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:12.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-06-10T00:15:12.602 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:12.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:12.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:12.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-10T00:15:12.741 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:12.741 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:12.741 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:12.741 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.741 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:12.741 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.742 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:15:12.742 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:b4:a7:07:46:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-10T00:15:12.742 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-10T00:15:12.742 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.742 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a8b4:a7ff:fe07:46af/64 scope link tentative 2024-06-10T00:15:12.742 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:12.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-10T00:15:12.808 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:12.808 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:12.808 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:12.808 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.809 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:12.809 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.809 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:15:12.809 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:b4:a7:07:46:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-10T00:15:12.809 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-10T00:15:12.809 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.809 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a8b4:a7ff:fe07:46af/64 scope link 2024-06-10T00:15:12.809 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:12.810 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-06-10T00:15:12.811 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:12.811 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:12.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-06-10T00:15:12.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-10T00:15:12.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-06-10T00:15:12.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-06-10T00:15:12.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-06-10T00:15:12.811 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:12.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:12.962 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:12.962 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:12.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.1 up 2024-06-10T00:15:12.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.1 master ceph-brx 2024-06-10T00:15:12.963 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:13.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:13.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:13.039 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-06-10T00:15:13.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:13.039 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-06-10T00:15:13.054 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-06-10T00:15:13.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:13.054 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-06-10T00:15:13.063 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:15:13.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:15:13.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:15:13.210 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:13.266 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:15:13.267 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:15:13.268 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:13.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:13.269 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:15:13.321 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:15:13.322 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-06-10T00:15:13.322 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-06-10T00:15:13.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:15:13.387 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:13.443 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:15:13.444 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:15:13.445 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:15:13.446 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:15:13.446 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:15:13.446 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:13.446 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:13.446 INFO:teuthology.orchestra.run.smithi079.stdout:/home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:13.446 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:13.446 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:13.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:13.447 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:15:13.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi079.stderr:2024-06-10T00:15:13.445+0000 7f2bdf198480 -1 init, newargv = 0x556df4c34750 newargc=15 2024-06-10T00:15:13.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi079.stderr:ceph-fuse[47977]: starting ceph client 2024-06-10T00:15:13.449 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi079.stderr:ceph-fuse[47977]: starting fuse 2024-06-10T00:15:13.463 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:15:13.463 INFO:teuthology.orchestra.run.smithi079.stdout:43 2024-06-10T00:15:13.463 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-06-10T00:15:13.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:15:13.463 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:15:13.463 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:15:13.464 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.2")) 2024-06-10T00:15:13.465 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:13.581 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.2.47977.asok 2024-06-10T00:15:13.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:13.591 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.47977.asok 2024-06-10T00:15:13.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:13.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.47977.asok status 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "2", 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "47977", 2024-06-10T00:15:13.726 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4731, 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 4731 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.2:0", 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1640686906 2024-06-10T00:15:13.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.2:0", 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1640686906 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.4731 192.168.0.2:0/1640686906", 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.2:0/1640686906", 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 8, 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 24, 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:15:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:15:13.729 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:15:13.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:15:13.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.833+0000 7fd072888640 1 Processor -- start 2024-06-10T00:15:13.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.833+0000 7fd072888640 1 -- start start 2024-06-10T00:15:13.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd072888640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd06c15a870 0x7fd06c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:13.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd072888640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0aef70 0x7fd06c0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:13.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd072888640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd06c0af3d0 0x7fd06c0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:13.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd072888640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd06c0b4fe0 con 0x7fd06c15a870 2024-06-10T00:15:13.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd072888640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd06c06e390 con 0x7fd06c0af3d0 2024-06-10T00:15:13.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd072888640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c15ac50 con 0x7fd06c0aef70 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd06bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd06c15a870 0x7fd06c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd06bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd06c15a870 0x7fd06c06de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36924/0 (socket says 172.21.15.79:36924) 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.834+0000 7fd06bfff640 1 -- 172.21.15.79:0/3682285034 learned_addr learned my addr 172.21.15.79:0/3682285034 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd06bfff640 1 -- 172.21.15.79:0/3682285034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0aef70 msgr2=0x7fd06c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd06bfff640 1 --2- 172.21.15.79:0/3682285034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0aef70 0x7fd06c0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd06bfff640 1 -- 172.21.15.79:0/3682285034 >> v2:172.21.15.117:3300/0 conn(0x7fd06c0af3d0 msgr2=0x7fd06c0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd070e25640 1 --2- 172.21.15.79:0/3682285034 >> v2:172.21.15.117:3300/0 conn(0x7fd06c0af3d0 0x7fd06c0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd06bfff640 1 --2- 172.21.15.79:0/3682285034 >> v2:172.21.15.117:3300/0 conn(0x7fd06c0af3d0 0x7fd06c0b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd06bfff640 1 -- 172.21.15.79:0/3682285034 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c06cdb0 con 0x7fd06c15a870 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd06bfff640 1 --2- 172.21.15.79:0/3682285034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c06de50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0cd970 tx=0x7fd05c02c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e526f39f2c03c1d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd06b7fe640 1 -- 172.21.15.79:0/3682285034 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c032700 con 0x7fd06c15a870 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.835+0000 7fd06b7fe640 1 -- 172.21.15.79:0/3682285034 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05c0328a0 con 0x7fd06c15a870 2024-06-10T00:15:13.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd06b7fe640 1 -- 172.21.15.79:0/3682285034 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c032c70 con 0x7fd06c15a870 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 -- 172.21.15.79:0/3682285034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 msgr2=0x7fd06c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 --2- 172.21.15.79:0/3682285034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c06de50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0cd970 tx=0x7fd05c02c800 comp rx=0 tx=0).stop 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 -- 172.21.15.79:0/3682285034 shutdown_connections 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 --2- 172.21.15.79:0/3682285034 >> v2:172.21.15.117:3300/0 conn(0x7fd06c0af3d0 0x7fd06c0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 --2- 172.21.15.79:0/3682285034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0aef70 0x7fd06c0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 --2- 172.21.15.79:0/3682285034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c06de50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 -- 172.21.15.79:0/3682285034 >> 172.21.15.79:0/3682285034 conn(0x7fd06c0b19f0 msgr2=0x7fd06c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 -- 172.21.15.79:0/3682285034 shutdown_connections 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.836+0000 7fd072888640 1 -- 172.21.15.79:0/3682285034 wait complete. 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.837+0000 7fd072888640 1 Processor -- start 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.837+0000 7fd072888640 1 -- start start 2024-06-10T00:15:13.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd072888640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0aef70 0x7fd06c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd072888640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0af3d0 0x7fd06c1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd072888640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c1f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd072888640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c06d650 con 0x7fd06c15a870 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd072888640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c06d370 con 0x7fd06c0aef70 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd072888640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c06d930 con 0x7fd06c0af3d0 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd070e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c1f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd070e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c1f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36932/0 (socket says 172.21.15.79:36932) 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd070e25640 1 -- 172.21.15.79:0/2663484517 learned_addr learned my addr 172.21.15.79:0/2663484517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd06bfff640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0aef70 0x7fd06c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd063fff640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0af3d0 0x7fd06c1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd070e25640 1 -- 172.21.15.79:0/2663484517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0af3d0 msgr2=0x7fd06c1f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd070e25640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0af3d0 0x7fd06c1f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:13.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd070e25640 1 -- 172.21.15.79:0/2663484517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0aef70 msgr2=0x7fd06c14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd070e25640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0aef70 0x7fd06c14c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.838+0000 7fd070e25640 1 -- 172.21.15.79:0/2663484517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c14c940 con 0x7fd06c15a870 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.839+0000 7fd070e25640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c1f8050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd06400cda0 tx=0x7fd06400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.839+0000 7fd0697fa640 1 -- 172.21.15.79:0/2663484517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064003b90 con 0x7fd06c15a870 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.839+0000 7fd0697fa640 1 -- 172.21.15.79:0/2663484517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd064003d30 con 0x7fd06c15a870 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.839+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06c14cc20 con 0x7fd06c15a870 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.839+0000 7fd0697fa640 1 -- 172.21.15.79:0/2663484517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064004240 con 0x7fd06c15a870 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.839+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06c14d1e0 con 0x7fd06c15a870 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.840+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06c068430 con 0x7fd06c15a870 2024-06-10T00:15:13.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.840+0000 7fd0697fa640 1 -- 172.21.15.79:0/2663484517 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0640043e0 con 0x7fd06c15a870 2024-06-10T00:15:13.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.841+0000 7fd0697fa640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:13.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.841+0000 7fd0697fa640 1 -- 172.21.15.79:0/2663484517 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd06408bba0 con 0x7fd06c15a870 2024-06-10T00:15:13.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.841+0000 7fd06bfff640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:13.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.841+0000 7fd06bfff640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd04c06be30 0x7fd04c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd05c037000 tx=0x7fd05c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:13.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:13.845+0000 7fd0697fa640 1 -- 172.21.15.79:0/2663484517 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd064059bc0 con 0x7fd06c15a870 2024-06-10T00:15:14.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.058+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd06c1589a0 con 0x7fd06c15a870 2024-06-10T00:15:14.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.059+0000 7fd0697fa640 1 -- 172.21.15.79:0/2663484517 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fd06408b030 con 0x7fd06c15a870 2024-06-10T00:15:14.059 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-10T00:15:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd04c06be30 msgr2=0x7fd04c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd04c06be30 0x7fd04c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd05c037000 tx=0x7fd05c008040 comp rx=0 tx=0).stop 2024-06-10T00:15:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 msgr2=0x7fd06c1f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c1f8050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd06400cda0 tx=0x7fd06400a660 comp rx=0 tx=0).stop 2024-06-10T00:15:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 shutdown_connections 2024-06-10T00:15:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd06c15a870 0x7fd06c1f8050 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0af3d0 0x7fd06c1f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 --2- 172.21.15.79:0/2663484517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0aef70 0x7fd06c14c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 >> 172.21.15.79:0/2663484517 conn(0x7fd06c0b19f0 msgr2=0x7fd06c0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 shutdown_connections 2024-06-10T00:15:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:14.061+0000 7fd072888640 1 -- 172.21.15.79:0/2663484517 wait complete. 2024-06-10T00:15:14.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:15:14.071 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:15:14.072 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-06-10T00:15:14.072 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-06-10T00:15:14.072 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:14.072 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:15:14.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:15:14.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:15:14.072 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-06-10T00:15:14.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:14.072 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:14.092 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-06-10T00:15:14.093 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:14.093 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:14.093 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:15:14.093 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:14.093 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:15:14.093 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42733sec preferred_lft 42733sec 2024-06-10T00:15:14.093 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-06-10T00:15:14.093 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:14.093 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-10T00:15:14.093 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:14.094 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:14.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-06-10T00:15:14.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-06-10T00:15:14.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-06-10T00:15:14.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-10T00:15:14.094 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:14.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:14.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:14.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:14.386 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:15:14.410 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-06-10T00:15:14.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:14.412 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-06-10T00:15:14.499 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-06-10T00:15:14.499 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:15:14.500 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:15:14.500 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:15:14.500 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:15:14.500 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:14.500 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:14.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:15:14.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:15:14.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:15:14.500 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:14.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:14.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:14.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:14.802 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-06-10T00:15:14.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:14.817 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-06-10T00:15:14.873 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:14.873 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:14.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:14.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-06-10T00:15:14.873 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:14.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:14.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:14.992 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-06-10T00:15:14.992 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:14.992 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:14.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-06-10T00:15:14.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-10T00:15:14.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-06-10T00:15:14.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-06-10T00:15:14.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-06-10T00:15:14.992 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:15.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:15.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:15.117 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:15.117 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:15.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-06-10T00:15:15.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-06-10T00:15:15.118 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:15.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:15.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:15.195 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-06-10T00:15:15.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:15.195 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:15.210 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-06-10T00:15:15.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:15.211 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:15.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-06-10T00:15:15.331 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:15.386 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-06-10T00:15:15.387 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-06-10T00:15:15.388 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-4 2024-06-10T00:15:15.389 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-5 2024-06-10T00:15:15.389 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-6 2024-06-10T00:15:15.389 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-7 2024-06-10T00:15:15.389 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-06-10T00:15:15.389 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:15.389 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:15.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:15.389 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-06-10T00:15:15.441 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:15:15.442 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-06-10T00:15:15.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-06-10T00:15:15.509 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:15.564 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-06-10T00:15:15.565 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-06-10T00:15:15.567 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-06-10T00:15:15.567 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-4 2024-06-10T00:15:15.567 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-5 2024-06-10T00:15:15.567 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-6 2024-06-10T00:15:15.567 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-7 2024-06-10T00:15:15.567 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-06-10T00:15:15.567 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:15.567 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:15.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:15.570 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-06-10T00:15:15.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2024-06-10T00:15:15.610+0000 7f5ae2c23480 -1 init, newargv = 0x559805249790 newargc=15 2024-06-10T00:15:15.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44067]: starting ceph client 2024-06-10T00:15:15.614 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44067]: starting fuse 2024-06-10T00:15:15.625 INFO:teuthology.orchestra.run.smithi117.stdout:40 2024-06-10T00:15:15.625 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:15:15.625 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:15:15.625 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-06-10T00:15:15.625 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-06-10T00:15:15.625 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-06-10T00:15:15.625 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-06-10T00:15:15.625 DEBUG:teuthology.orchestra.run.smithi117:> 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:15:15.626 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-06-10T00:15:15.627 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-06-10T00:15:15.627 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-06-10T00:15:15.627 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:15:15.627 DEBUG:teuthology.orchestra.run.smithi117:> 2024-06-10T00:15:15.627 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2024-06-10T00:15:15.627 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-06-10T00:15:15.742 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44067.asok 2024-06-10T00:15:15.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:15.753 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44067.asok 2024-06-10T00:15:15.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:15.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44067.asok status 2024-06-10T00:15:15.887 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-06-10T00:15:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-06-10T00:15:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:15:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:15:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44067", 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4463, 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4463 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-06-10T00:15:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2154117687 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2154117687 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4463 192.168.0.1:0/2154117687", 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2154117687", 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 8, 2024-06-10T00:15:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 24, 2024-06-10T00:15:15.890 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:15:15.890 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-06-10T00:15:15.890 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-06-10T00:15:15.890 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-06-10T00:15:15.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:15:16.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.006+0000 7f711185d640 1 Processor -- start 2024-06-10T00:15:16.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.006+0000 7f711185d640 1 -- start start 2024-06-10T00:15:16.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f711185d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f710c162190 0x7f710c0d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:16.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f711185d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f710c06d050 0x7f710c162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f711185d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c161320 0x7f710c1617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f711185d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f710c161d10 con 0x7f710c162190 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f711185d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f710c06db10 con 0x7f710c06d050 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f711185d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f710c162ca0 con 0x7f710c161320 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f710affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f710c162190 0x7f710c0d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f710affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f710c162190 0x7f710c0d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36936/0 (socket says 172.21.15.79:36936) 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.007+0000 7f710affd640 1 -- 172.21.15.79:0/1261743623 learned_addr learned my addr 172.21.15.79:0/1261743623 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.008+0000 7f710b7fe640 1 --2- 172.21.15.79:0/1261743623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c161320 0x7f710c1617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.008+0000 7f71027fc640 1 --2- 172.21.15.79:0/1261743623 >> v2:172.21.15.117:3300/0 conn(0x7f710c06d050 0x7f710c162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.008+0000 7f710affd640 1 -- 172.21.15.79:0/1261743623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c161320 msgr2=0x7f710c1617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.008+0000 7f710affd640 1 --2- 172.21.15.79:0/1261743623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c161320 0x7f710c1617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.008+0000 7f710affd640 1 -- 172.21.15.79:0/1261743623 >> v2:172.21.15.117:3300/0 conn(0x7f710c06d050 msgr2=0x7f710c162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:16.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.008+0000 7f710affd640 1 --2- 172.21.15.79:0/1261743623 >> v2:172.21.15.117:3300/0 conn(0x7f710c06d050 0x7f710c162570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.008+0000 7f710affd640 1 -- 172.21.15.79:0/1261743623 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c06dd60 con 0x7f710c162190 2024-06-10T00:15:16.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.008+0000 7f710affd640 1 --2- 172.21.15.79:0/1261743623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c162190 0x7f710c0d1c80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f710c08c2b0 tx=0x7f70fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9f09bd11f64052 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:16.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f710a7fc640 1 -- 172.21.15.79:0/1261743623 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc037070 con 0x7f710c162190 2024-06-10T00:15:16.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f710a7fc640 1 -- 172.21.15.79:0/1261743623 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc032440 con 0x7f710c162190 2024-06-10T00:15:16.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f710a7fc640 1 -- 172.21.15.79:0/1261743623 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc032810 con 0x7f710c162190 2024-06-10T00:15:16.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 -- 172.21.15.79:0/1261743623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c162190 msgr2=0x7f710c0d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:16.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 --2- 172.21.15.79:0/1261743623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c162190 0x7f710c0d1c80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f710c08c2b0 tx=0x7f70fc02a140 comp rx=0 tx=0).stop 2024-06-10T00:15:16.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 -- 172.21.15.79:0/1261743623 shutdown_connections 2024-06-10T00:15:16.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 --2- 172.21.15.79:0/1261743623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c161320 0x7f710c1617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 --2- 172.21.15.79:0/1261743623 >> v2:172.21.15.117:3300/0 conn(0x7f710c06d050 0x7f710c162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 --2- 172.21.15.79:0/1261743623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c162190 0x7f710c0d1c80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 -- 172.21.15.79:0/1261743623 >> 172.21.15.79:0/1261743623 conn(0x7f710c09d3c0 msgr2=0x7f710c0d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:16.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 -- 172.21.15.79:0/1261743623 shutdown_connections 2024-06-10T00:15:16.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.009+0000 7f711185d640 1 -- 172.21.15.79:0/1261743623 wait complete. 2024-06-10T00:15:16.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.010+0000 7f711185d640 1 Processor -- start 2024-06-10T00:15:16.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.011+0000 7f711185d640 1 -- start start 2024-06-10T00:15:16.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.011+0000 7f711185d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c06d050 0x7f710c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:16.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.011+0000 7f711185d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c161320 0x7f710c0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:16.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.011+0000 7f711185d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c162190 0x7f710c0b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.011+0000 7f711185d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0d2d50 con 0x7f710c06d050 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.011+0000 7f711185d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f710c06bf40 con 0x7f710c161320 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.011+0000 7f711185d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0b8b00 con 0x7f710c162190 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c06d050 0x7f710c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c06d050 0x7f710c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36940/0 (socket says 172.21.15.79:36940) 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 -- 172.21.15.79:0/3114632342 learned_addr learned my addr 172.21.15.79:0/3114632342 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 -- 172.21.15.79:0/3114632342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c162190 msgr2=0x7f710c0b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c162190 0x7f710c0b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 -- 172.21.15.79:0/3114632342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c161320 msgr2=0x7f710c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c161320 0x7f710c0ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 -- 172.21.15.79:0/3114632342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0cad70 con 0x7f710c06d050 2024-06-10T00:15:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f710affd640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c06d050 0x7f710c154440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f70fc02a180 tx=0x7f70fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f7108ff9640 1 -- 172.21.15.79:0/3114632342 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc037040 con 0x7f710c06d050 2024-06-10T00:15:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f7108ff9640 1 -- 172.21.15.79:0/3114632342 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc042070 con 0x7f710c06d050 2024-06-10T00:15:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c0b87d0 con 0x7f710c06d050 2024-06-10T00:15:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f7108ff9640 1 -- 172.21.15.79:0/3114632342 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc03d880 con 0x7f710c06d050 2024-06-10T00:15:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.012+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c09e320 con 0x7f710c06d050 2024-06-10T00:15:16.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.013+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c0ce670 con 0x7f710c06d050 2024-06-10T00:15:16.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.014+0000 7f7108ff9640 1 -- 172.21.15.79:0/3114632342 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70fc03da20 con 0x7f710c06d050 2024-06-10T00:15:16.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.014+0000 7f7108ff9640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70ec06be30 0x7f70ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:16.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.014+0000 7f7108ff9640 1 -- 172.21.15.79:0/3114632342 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f70fc0ab8f0 con 0x7f710c06d050 2024-06-10T00:15:16.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.014+0000 7f71027fc640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70ec06be30 0x7f70ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:16.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.015+0000 7f71027fc640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70ec06be30 0x7f70ec06e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70f4006a90 tx=0x7f70f4006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:16.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.018+0000 7f7108ff9640 1 -- 172.21.15.79:0/3114632342 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f710c0ce670 con 0x7f710c06d050 2024-06-10T00:15:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.228+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f710c068ad0 con 0x7f710c06d050 2024-06-10T00:15:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.229+0000 7f7108ff9640 1 -- 172.21.15.79:0/3114632342 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f70fc079ff0 con 0x7f710c06d050 2024-06-10T00:15:16.229 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-10T00:15:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70ec06be30 msgr2=0x7f70ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70ec06be30 0x7f70ec06e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70f4006a90 tx=0x7f70f4006a20 comp rx=0 tx=0).stop 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c06d050 msgr2=0x7f710c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c06d050 0x7f710c154440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f70fc02a180 tx=0x7f70fc0046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 shutdown_connections 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70ec06be30 0x7f70ec06e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c162190 0x7f710c0b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c161320 0x7f710c0ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 --2- 172.21.15.79:0/3114632342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f710c06d050 0x7f710c154440 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 >> 172.21.15.79:0/3114632342 conn(0x7f710c09d3c0 msgr2=0x7f710c0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 shutdown_connections 2024-06-10T00:15:16.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:16.231+0000 7f711185d640 1 -- 172.21.15.79:0/3114632342 wait complete. 2024-06-10T00:15:16.242 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:15:16.242 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:15:16.242 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-06-10T00:15:16.242 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-06-10T00:15:16.242 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-10T00:15:16.243 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:15:16.243 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:15:16.243 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:15:16.243 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-06-10T00:15:16.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:16.243 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-06-10T00:15:16.259 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:16.259 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:16.259 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:16.260 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42731sec preferred_lft 42731sec 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether d2:e9:9b:da:d1:f0 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::dc03:7fff:fe18:f447/64 scope link 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether d2:e9:9b:da:d1:f0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:16.261 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::d0e9:9bff:feda:d1f0/64 scope link tentative 2024-06-10T00:15:16.262 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:16.262 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:15:16.323 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-06-10T00:15:16.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:16.325 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-06-10T00:15:16.381 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-06-10T00:15:16.381 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:15:16.381 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:15:16.381 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:15:16.381 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:15:16.381 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:16.381 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:16.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:15:16.382 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:15:16.382 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:15:16.382 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:16.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:16.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:16.507 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-06-10T00:15:16.522 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-10T00:15:16.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:16.522 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-06-10T00:15:16.577 INFO:teuthology.orchestra.run.smithi117.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-06-10T00:15:16.577 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:16.577 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:16.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-10T00:15:16.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-06-10T00:15:16.577 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:16.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:16.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:16.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:16.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-10T00:15:16.717 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:16.717 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:16.717 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether e6:b3:84:0f:06:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::e4b3:84ff:fe0f:682/64 scope link 2024-06-10T00:15:16.718 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:16.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-10T00:15:16.784 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:15:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether e6:b3:84:0f:06:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-10T00:15:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-10T00:15:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::e4b3:84ff:fe0f:682/64 scope link 2024-06-10T00:15:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:16.786 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-06-10T00:15:16.786 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:16.786 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:16.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-06-10T00:15:16.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-10T00:15:16.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-06-10T00:15:16.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-06-10T00:15:16.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-06-10T00:15:16.787 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:16.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:16.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:16.937 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:16.937 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-06-10T00:15:16.937 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.1 up 2024-06-10T00:15:16.937 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.1 master ceph-brx 2024-06-10T00:15:16.937 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-06-10T00:15:16.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:17.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:17.016 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-06-10T00:15:17.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:17.016 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-06-10T00:15:17.031 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-06-10T00:15:17.031 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:17.031 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-06-10T00:15:17.086 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-06-10T00:15:17.151 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-06-10T00:15:17.207 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:17.208 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-4 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-5 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-6 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-7 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-10T00:15:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-10T00:15:17.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.210 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-06-10T00:15:17.262 INFO:teuthology.orchestra.run.smithi117.stdout:40 2024-06-10T00:15:17.262 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-06-10T00:15:17.262 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-06-10T00:15:17.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-06-10T00:15:17.328 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-06-10T00:15:17.385 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:17.386 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-4 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-5 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-6 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-7 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-10T00:15:17.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.388 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-06-10T00:15:17.388 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:2024-06-10T00:15:17.387+0000 7fc507ce5480 -1 init, newargv = 0x563c09f04680 newargc=15 2024-06-10T00:15:17.388 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:ceph-fuse[44506]: starting ceph client 2024-06-10T00:15:17.390 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:ceph-fuse[44506]: starting fuse 2024-06-10T00:15:17.403 INFO:teuthology.orchestra.run.smithi117.stdout:40 2024-06-10T00:15:17.403 INFO:teuthology.orchestra.run.smithi117.stdout:43 2024-06-10T00:15:17.403 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-06-10T00:15:17.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:15:17.403 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-06-10T00:15:17.403 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-06-10T00:15:17.404 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.3")) 2024-06-10T00:15:17.405 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-06-10T00:15:17.521 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.3.44506.asok 2024-06-10T00:15:17.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-06-10T00:15:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:17.532 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44506.asok 2024-06-10T00:15:17.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.532 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44506.asok status 2024-06-10T00:15:17.665 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "3", 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44506", 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-06-10T00:15:17.666 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4472, 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4472 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2364274618 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-06-10T00:15:17.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2364274618 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4472 192.168.0.2:0/2364274618", 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.2:0/2364274618", 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 8, 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 24, 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-06-10T00:15:17.668 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-06-10T00:15:17.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.674 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:15:17.674 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:17.694 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:15:17.694 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:17.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:17.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.766 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:15:17.766 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.2 2024-06-10T00:15:17.824 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:15:17.825 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-06-10T00:15:17.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-06-10T00:15:17.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.893 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-06-10T00:15:17.893 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:17.909 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-06-10T00:15:17.909 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:17.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.910 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:17.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:17.977 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-06-10T00:15:17.977 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.3 2024-06-10T00:15:18.033 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-06-10T00:15:18.033 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-06-10T00:15:18.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:18.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-06-10T00:15:18.098 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-06-10T00:15:18.145 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-06-10T00:15:18.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:18.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.255+0000 7f1de2aa5640 1 Processor -- start 2024-06-10T00:15:18.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.255+0000 7f1de2aa5640 1 -- start start 2024-06-10T00:15:18.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1de2aa5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ddc0b4c80 0x7f1ddc0ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1de2aa5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ddc0cec10 0x7f1ddc0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1de2aa5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ddc0b7d20 con 0x7f1ddc0b7940 2024-06-10T00:15:18.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1de2aa5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1ddc0d1200 con 0x7f1ddc0b4c80 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1de2aa5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1ddc0cc620 con 0x7f1ddc0cec10 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1ddbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ddc0b4c80 0x7f1ddc0ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1ddbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ddc0b4c80 0x7f1ddc0ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45788/0 (socket says 172.21.15.79:45788) 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1ddbfff640 1 -- 172.21.15.79:0/2008794016 learned_addr learned my addr 172.21.15.79:0/2008794016 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1de1042640 1 --2- 172.21.15.79:0/2008794016 >> v2:172.21.15.117:3300/0 conn(0x7f1ddc0cec10 0x7f1ddc0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1ddbfff640 1 -- 172.21.15.79:0/2008794016 >> v2:172.21.15.117:3300/0 conn(0x7f1ddc0cec10 msgr2=0x7f1ddc0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1ddbfff640 1 --2- 172.21.15.79:0/2008794016 >> v2:172.21.15.117:3300/0 conn(0x7f1ddc0cec10 0x7f1ddc0cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1ddbfff640 1 -- 172.21.15.79:0/2008794016 >> v1:172.21.15.117:6789/0 conn(0x7f1ddc0b7940 legacy=0x7f1ddc0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.256+0000 7f1ddbfff640 1 -- 172.21.15.79:0/2008794016 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc0cc900 con 0x7f1ddc0b4c80 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.257+0000 7f1ddbfff640 1 --2- 172.21.15.79:0/2008794016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b4c80 0x7f1ddc0ce6d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc072f40 tx=0x7f1dd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb743ab929c0ce9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.257+0000 7f1ddb7fe640 1 -- 172.21.15.79:0/2008794016 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0037070 con 0x7f1ddc0b4c80 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.257+0000 7f1ddb7fe640 1 -- 172.21.15.79:0/2008794016 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd0032440 con 0x7f1ddc0b4c80 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.257+0000 7f1ddb7fe640 1 -- 172.21.15.79:0/2008794016 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0032810 con 0x7f1ddc0b4c80 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.258+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2008794016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b4c80 msgr2=0x7f1ddc0ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.258+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2008794016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b4c80 0x7f1ddc0ce6d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc072f40 tx=0x7f1dd002a270 comp rx=0 tx=0).stop 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.258+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2008794016 shutdown_connections 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.258+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2008794016 >> v2:172.21.15.117:3300/0 conn(0x7f1ddc0cec10 0x7f1ddc0cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.258+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2008794016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b4c80 0x7f1ddc0ce6d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.258+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2008794016 >> 172.21.15.79:0/2008794016 conn(0x7f1ddc0d1e50 msgr2=0x7f1ddc0d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:18.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.258+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2008794016 shutdown_connections 2024-06-10T00:15:18.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.258+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2008794016 wait complete. 2024-06-10T00:15:18.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.259+0000 7f1de2aa5640 1 Processor -- start 2024-06-10T00:15:18.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.259+0000 7f1de2aa5640 1 -- start start 2024-06-10T00:15:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1de2aa5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ddc0b4c80 0x7f1ddc0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1de2aa5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b7940 0x7f1ddc0c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1de2aa5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ddc0cec10 0x7f1ddc1f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1de2aa5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc0d2a90 con 0x7f1ddc0b7940 2024-06-10T00:15:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1de2aa5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc0ccec0 con 0x7f1ddc0cec10 2024-06-10T00:15:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1de2aa5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ddc0d2c10 con 0x7f1ddc0b4c80 2024-06-10T00:15:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1ddbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b7940 0x7f1ddc0c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1ddbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b7940 0x7f1ddc0c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45802/0 (socket says 172.21.15.79:45802) 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1ddbfff640 1 -- 172.21.15.79:0/2897073348 learned_addr learned my addr 172.21.15.79:0/2897073348 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1de0841640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ddc0b4c80 0x7f1ddc0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.260+0000 7f1de1042640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ddc0cec10 0x7f1ddc1f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1ddbfff640 1 -- 172.21.15.79:0/2897073348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ddc0b4c80 msgr2=0x7f1ddc0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1ddbfff640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ddc0b4c80 0x7f1ddc0c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1ddbfff640 1 -- 172.21.15.79:0/2897073348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ddc0cec10 msgr2=0x7f1ddc1f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1ddbfff640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ddc0cec10 0x7f1ddc1f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1ddbfff640 1 -- 172.21.15.79:0/2897073348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc0c7450 con 0x7f1ddc0b7940 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1ddbfff640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b7940 0x7f1ddc0c6f10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1dd002a2b0 tx=0x7f1dd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1dd97fa640 1 -- 172.21.15.79:0/2897073348 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0041020 con 0x7f1ddc0b7940 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1dd97fa640 1 -- 172.21.15.79:0/2897073348 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd00306c0 con 0x7f1ddc0b7940 2024-06-10T00:15:18.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc0c7700 con 0x7f1ddc0b7940 2024-06-10T00:15:18.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1dd97fa640 1 -- 172.21.15.79:0/2897073348 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0037040 con 0x7f1ddc0b7940 2024-06-10T00:15:18.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.261+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc0c7cc0 con 0x7f1ddc0b7940 2024-06-10T00:15:18.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.262+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc14bb10 con 0x7f1ddc0b7940 2024-06-10T00:15:18.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.262+0000 7f1dd97fa640 1 -- 172.21.15.79:0/2897073348 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1dd0044020 con 0x7f1ddc0b7940 2024-06-10T00:15:18.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.263+0000 7f1dd97fa640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1dc806be60 0x7f1dc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.263+0000 7f1dd97fa640 1 -- 172.21.15.79:0/2897073348 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1dd00ab890 con 0x7f1ddc0b7940 2024-06-10T00:15:18.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.263+0000 7f1de0841640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1dc806be60 0x7f1dc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.263+0000 7f1de0841640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1dc806be60 0x7f1dc806e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc001780 tx=0x7f1dcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.267+0000 7f1dd97fa640 1 -- 172.21.15.79:0/2897073348 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1ddc14bb10 con 0x7f1ddc0b7940 2024-06-10T00:15:18.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.445+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ddc068430 con 0x7f1ddc0b7940 2024-06-10T00:15:18.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.446+0000 7f1dd97fa640 1 -- 172.21.15.79:0/2897073348 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f1dd004b030 con 0x7f1ddc0b7940 2024-06-10T00:15:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:18.447 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:14:47.239411+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1dc806be60 msgr2=0x7f1dc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1dc806be60 0x7f1dc806e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc001780 tx=0x7f1dcc009040 comp rx=0 tx=0).stop 2024-06-10T00:15:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b7940 msgr2=0x7f1ddc0c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b7940 0x7f1ddc0c6f10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1dd002a2b0 tx=0x7f1dd00046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 shutdown_connections 2024-06-10T00:15:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1dc806be60 0x7f1dc806e320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ddc0cec10 0x7f1ddc1f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ddc0b7940 0x7f1ddc0c6f10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 --2- 172.21.15.79:0/2897073348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ddc0b4c80 0x7f1ddc0c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 >> 172.21.15.79:0/2897073348 conn(0x7f1ddc0d1e50 msgr2=0x7f1ddc0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 shutdown_connections 2024-06-10T00:15:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.448+0000 7f1de2aa5640 1 -- 172.21.15.79:0/2897073348 wait complete. 2024-06-10T00:15:18.460 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-10T00:14:31.177808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-10T00:14:39.913263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-10T00:14:41.170269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-10T00:14:44.884399+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-10T00:15:18.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-10T00:15:18.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.562+0000 7fc61931b640 1 Processor -- start 2024-06-10T00:15:18.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.563+0000 7fc61931b640 1 -- start start 2024-06-10T00:15:18.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.563+0000 7fc61931b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6140718e0 0x7fc61415e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.563+0000 7fc61931b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc614071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.563+0000 7fc61931b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc614072690 con 0x7fc614072200 2024-06-10T00:15:18.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.563+0000 7fc61931b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc61406e4e0 con 0x7fc6140718e0 2024-06-10T00:15:18.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.563+0000 7fc61931b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc6141622a0 con 0x7fc6140ce400 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc612ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6140718e0 0x7fc61415e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc6137fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc614072200 0x7fc61406e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58810/0 (socket says 172.21.15.79:58810) 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc6137fe640 1 -- 172.21.15.79:0/3661025752 learned_addr learned my addr 172.21.15.79:0/3661025752 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc6127fc640 1 --2- 172.21.15.79:0/3661025752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc614071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc612ffd640 1 -- 172.21.15.79:0/3661025752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 msgr2=0x7fc614071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc612ffd640 1 --2- 172.21.15.79:0/3661025752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc614071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc612ffd640 1 -- 172.21.15.79:0/3661025752 >> v1:172.21.15.79:6789/0 conn(0x7fc614072200 legacy=0x7fc61406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc612ffd640 1 -- 172.21.15.79:0/3661025752 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc614162580 con 0x7fc6140718e0 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.564+0000 7fc611ffb640 1 -- 172.21.15.79:0/3661025752 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400529317 0 0) 0x7fc614072690 con 0x7fc614072200 2024-06-10T00:15:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc612ffd640 1 --2- 172.21.15.79:0/3661025752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6140718e0 0x7fc61415e910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc604009d90 tx=0x7fc60402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c608d6edc59d9e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc611ffb640 1 -- 172.21.15.79:0/3661025752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604007740 con 0x7fc6140718e0 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc611ffb640 1 -- 172.21.15.79:0/3661025752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6040078e0 con 0x7fc6140718e0 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc611ffb640 1 -- 172.21.15.79:0/3661025752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604007cb0 con 0x7fc6140718e0 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc61931b640 1 -- 172.21.15.79:0/3661025752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6140718e0 msgr2=0x7fc61415e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc61931b640 1 --2- 172.21.15.79:0/3661025752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6140718e0 0x7fc61415e910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc604009d90 tx=0x7fc60402a530 comp rx=0 tx=0).stop 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc61931b640 1 -- 172.21.15.79:0/3661025752 shutdown_connections 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc61931b640 1 --2- 172.21.15.79:0/3661025752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc614071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc61931b640 1 --2- 172.21.15.79:0/3661025752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6140718e0 0x7fc61415e910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc61931b640 1 -- 172.21.15.79:0/3661025752 >> 172.21.15.79:0/3661025752 conn(0x7fc6140b22b0 msgr2=0x7fc6140b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc61931b640 1 -- 172.21.15.79:0/3661025752 shutdown_connections 2024-06-10T00:15:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.565+0000 7fc61931b640 1 -- 172.21.15.79:0/3661025752 wait complete. 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc61931b640 1 Processor -- start 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc61931b640 1 -- start start 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc61931b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6140718e0 0x7fc61414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc61931b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc614072200 0x7fc6140b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc61931b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc6140b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc61931b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc61415c1a0 con 0x7fc614072200 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc61931b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc614162b40 con 0x7fc6140718e0 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc61931b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc61415c320 con 0x7fc6140ce400 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc6127fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc614072200 0x7fc6140b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc6127fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc614072200 0x7fc6140b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45822/0 (socket says 172.21.15.79:45822) 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.567+0000 7fc6127fc640 1 -- 172.21.15.79:0/3371965905 learned_addr learned my addr 172.21.15.79:0/3371965905 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc612ffd640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6140718e0 0x7fc61414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc6137fe640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc6140b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc6127fc640 1 -- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 msgr2=0x7fc6140b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc6127fc640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc6140b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc6127fc640 1 -- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6140718e0 msgr2=0x7fc61414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc6127fc640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6140718e0 0x7fc61414b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc6127fc640 1 -- 172.21.15.79:0/3371965905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6140aeb40 con 0x7fc614072200 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc6137fe640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc6140b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc6127fc640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc614072200 0x7fc6140b0460 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00e8a0 tx=0x7fc5fc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc60b7fe640 1 -- 172.21.15.79:0/3371965905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc017070 con 0x7fc614072200 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc60b7fe640 1 -- 172.21.15.79:0/3371965905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00c940 con 0x7fc614072200 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6140aee20 con 0x7fc614072200 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc60b7fe640 1 -- 172.21.15.79:0/3371965905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00cd30 con 0x7fc614072200 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.568+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6140af3e0 con 0x7fc614072200 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.569+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6140683c0 con 0x7fc614072200 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.569+0000 7fc60b7fe640 1 -- 172.21.15.79:0/3371965905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5fc01a070 con 0x7fc614072200 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.570+0000 7fc60b7fe640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc5f406be30 0x7fc5f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.570+0000 7fc60b7fe640 1 -- 172.21.15.79:0/3371965905 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc5fc08b3d0 con 0x7fc614072200 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.570+0000 7fc612ffd640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc5f406be30 0x7fc5f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.570+0000 7fc612ffd640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc5f406be30 0x7fc5f406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc604034000 tx=0x7fc60402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.574+0000 7fc60b7fe640 1 -- 172.21.15.79:0/3371965905 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc5fc059360 con 0x7fc614072200 2024-06-10T00:15:18.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.750+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc6140675e0 con 0x7fc614072200 2024-06-10T00:15:18.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.751+0000 7fc60b7fe640 1 -- 172.21.15.79:0/3371965905 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fc5fc05d660 con 0x7fc614072200 2024-06-10T00:15:18.752 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-06-10T00:15:18.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc5f406be30 msgr2=0x7fc5f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc5f406be30 0x7fc5f406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc604034000 tx=0x7fc60402f000 comp rx=0 tx=0).stop 2024-06-10T00:15:18.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc614072200 msgr2=0x7fc6140b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc614072200 0x7fc6140b0460 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00e8a0 tx=0x7fc5fc00ed60 comp rx=0 tx=0).stop 2024-06-10T00:15:18.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 shutdown_connections 2024-06-10T00:15:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc5f406be30 0x7fc5f406e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6140ce400 0x7fc6140b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc614072200 0x7fc6140b0460 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 --2- 172.21.15.79:0/3371965905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6140718e0 0x7fc61414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 >> 172.21.15.79:0/3371965905 conn(0x7fc6140b22b0 msgr2=0x7fc61406f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 shutdown_connections 2024-06-10T00:15:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.753+0000 7fc61931b640 1 -- 172.21.15.79:0/3371965905 wait complete. 2024-06-10T00:15:18.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-10T00:15:18.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.866+0000 7f221fc93640 1 Processor -- start 2024-06-10T00:15:18.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.867+0000 7f221fc93640 1 -- start start 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.867+0000 7f221fc93640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22180b3b40 0x7f22180b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.867+0000 7f221fc93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180d0730 0x7f22180b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221fc93640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221815c870 con 0x7f22180b48e0 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221fc93640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f221815cb50 con 0x7f22180b3b40 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221fc93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f221815ce30 con 0x7f22180d0730 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221da2f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22180b3b40 0x7f22180b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221d22e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f22180b48e0 0x7f22180d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58812/0 (socket says 172.21.15.79:58812) 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221d22e640 1 -- 172.21.15.79:0/3657323086 learned_addr learned my addr 172.21.15.79:0/3657323086 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:18.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221e230640 1 --2- 172.21.15.79:0/3657323086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180d0730 0x7f22180b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221da2f640 1 -- 172.21.15.79:0/3657323086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180d0730 msgr2=0x7f22180b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:18.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221da2f640 1 --2- 172.21.15.79:0/3657323086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180d0730 0x7f22180b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221da2f640 1 -- 172.21.15.79:0/3657323086 >> v1:172.21.15.79:6789/0 conn(0x7f22180b48e0 legacy=0x7f22180d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221ca2d640 1 -- 172.21.15.79:0/3657323086 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4060352133 0 0) 0x7f221815c870 con 0x7f22180b48e0 2024-06-10T00:15:18.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.868+0000 7f221da2f640 1 -- 172.21.15.79:0/3657323086 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221815d110 con 0x7f22180b3b40 2024-06-10T00:15:18.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221da2f640 1 --2- 172.21.15.79:0/3657323086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b3b40 0x7f22180b2bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f22140097a0 tx=0x7f221402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a38e4e091952f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221ca2d640 1 -- 172.21.15.79:0/3657323086 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214037070 con 0x7f22180b3b40 2024-06-10T00:15:18.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221ca2d640 1 -- 172.21.15.79:0/3657323086 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2214032440 con 0x7f22180b3b40 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221ca2d640 1 -- 172.21.15.79:0/3657323086 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214032810 con 0x7f22180b3b40 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221fc93640 1 -- 172.21.15.79:0/3657323086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b3b40 msgr2=0x7f22180b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221fc93640 1 --2- 172.21.15.79:0/3657323086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b3b40 0x7f22180b2bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f22140097a0 tx=0x7f221402a180 comp rx=0 tx=0).stop 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221fc93640 1 -- 172.21.15.79:0/3657323086 shutdown_connections 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221fc93640 1 --2- 172.21.15.79:0/3657323086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180d0730 0x7f22180b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221fc93640 1 --2- 172.21.15.79:0/3657323086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b3b40 0x7f22180b2bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.869+0000 7f221fc93640 1 -- 172.21.15.79:0/3657323086 >> 172.21.15.79:0/3657323086 conn(0x7f22180b1d10 msgr2=0x7f22180b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.870+0000 7f221fc93640 1 -- 172.21.15.79:0/3657323086 shutdown_connections 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.870+0000 7f221fc93640 1 -- 172.21.15.79:0/3657323086 wait complete. 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221fc93640 1 Processor -- start 2024-06-10T00:15:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221fc93640 1 -- start start 2024-06-10T00:15:18.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221fc93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180b3b40 0x7f2218153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221fc93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b48e0 0x7f22181579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221fc93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22180d0730 0x7f2218148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221fc93640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f221815c490 con 0x7f22180b48e0 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221fc93640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22180b3f20 con 0x7f22180d0730 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221fc93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f221815c610 con 0x7f22180b3b40 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221d22e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b48e0 0x7f22181579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221d22e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b48e0 0x7f22181579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45846/0 (socket says 172.21.15.79:45846) 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.871+0000 7f221d22e640 1 -- 172.21.15.79:0/1028915173 learned_addr learned my addr 172.21.15.79:0/1028915173 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221da2f640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180b3b40 0x7f2218153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221e230640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22180d0730 0x7f2218148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221d22e640 1 -- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180b3b40 msgr2=0x7f2218153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221d22e640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180b3b40 0x7f2218153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221d22e640 1 -- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22180d0730 msgr2=0x7f2218148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221d22e640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22180d0730 0x7f2218148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221d22e640 1 -- 172.21.15.79:0/1028915173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22181536c0 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221da2f640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180b3b40 0x7f2218153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221d22e640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b48e0 0x7f22181579c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f220800c4a0 tx=0x7f220800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f220e7fc640 1 -- 172.21.15.79:0/1028915173 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208017070 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f220e7fc640 1 -- 172.21.15.79:0/1028915173 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2208005ce0 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2218156300 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f220e7fc640 1 -- 172.21.15.79:0/1028915173 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22080072b0 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.872+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f221809aed0 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.873+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221809aa10 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.874+0000 7f220e7fc640 1 -- 172.21.15.79:0/1028915173 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f220801a070 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.874+0000 7f220e7fc640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f21fc06be30 0x7f21fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.874+0000 7f221da2f640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f21fc06be30 0x7f21fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.874+0000 7f220e7fc640 1 -- 172.21.15.79:0/1028915173 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f220808a560 con 0x7f22180b48e0 2024-06-10T00:15:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.875+0000 7f221da2f640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f21fc06be30 0x7f21fc06e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2214034000 tx=0x7f221402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:18.879+0000 7f220e7fc640 1 -- 172.21.15.79:0/1028915173 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f221809aa10 con 0x7f22180b48e0 2024-06-10T00:15:19.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.056+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2218159d40 con 0x7f22180b48e0 2024-06-10T00:15:19.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.057+0000 7f220e7fc640 1 -- 172.21.15.79:0/1028915173 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f2208058bd0 con 0x7f22180b48e0 2024-06-10T00:15:19.058 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-06-10T00:15:19.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f21fc06be30 msgr2=0x7f21fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f21fc06be30 0x7f21fc06e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2214034000 tx=0x7f221402e000 comp rx=0 tx=0).stop 2024-06-10T00:15:19.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b48e0 msgr2=0x7f22181579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b48e0 0x7f22181579c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f220800c4a0 tx=0x7f220800c960 comp rx=0 tx=0).stop 2024-06-10T00:15:19.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 shutdown_connections 2024-06-10T00:15:19.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f21fc06be30 0x7f21fc06e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22180d0730 0x7f2218148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22180b48e0 0x7f22181579c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 --2- 172.21.15.79:0/1028915173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22180b3b40 0x7f2218153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 >> 172.21.15.79:0/1028915173 conn(0x7f22180b1d10 msgr2=0x7f22180cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:19.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 shutdown_connections 2024-06-10T00:15:19.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.059+0000 7f221fc93640 1 -- 172.21.15.79:0/1028915173 wait complete. 2024-06-10T00:15:19.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-10T00:15:19.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.173+0000 7fd7e65b0640 1 Processor -- start 2024-06-10T00:15:19.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.173+0000 7fd7e65b0640 1 -- start start 2024-06-10T00:15:19.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e65b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e00b3bf0 0x7fd7e006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e65b0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd7e006d500 0x7fd7e0071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e65b0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e0155000 con 0x7fd7e0154c20 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e65b0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e006dd30 con 0x7fd7e006d500 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e65b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e006e010 con 0x7fd7e00b3bf0 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7dffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd7e0154c20 0x7fd7e00b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58828/0 (socket says 172.21.15.79:58828) 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7dffff640 1 -- 172.21.15.79:0/3125342089 learned_addr learned my addr 172.21.15.79:0/3125342089 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e4b4d640 1 --2- 172.21.15.79:0/3125342089 >> v2:172.21.15.79:3300/0 conn(0x7fd7e006d500 0x7fd7e0071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7deffd640 1 -- 172.21.15.79:0/3125342089 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050999902 0 0) 0x7fd7e0155000 con 0x7fd7e0154c20 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7deffd640 1 -- 172.21.15.79:0/3125342089 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7c8003520 con 0x7fd7e0154c20 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7df7fe640 1 --2- 172.21.15.79:0/3125342089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e00b3bf0 0x7fd7e006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e4b4d640 1 -- 172.21.15.79:0/3125342089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e00b3bf0 msgr2=0x7fd7e006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e4b4d640 1 --2- 172.21.15.79:0/3125342089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e00b3bf0 0x7fd7e006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e4b4d640 1 -- 172.21.15.79:0/3125342089 >> v1:172.21.15.79:6789/0 conn(0x7fd7e0154c20 legacy=0x7fd7e00b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.174+0000 7fd7e4b4d640 1 -- 172.21.15.79:0/3125342089 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e006e2f0 con 0x7fd7e006d500 2024-06-10T00:15:19.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.175+0000 7fd7e4b4d640 1 --2- 172.21.15.79:0/3125342089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0071550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009d90 tx=0x7fd7d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d362c1dea3c44f22 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.175+0000 7fd7deffd640 1 -- 172.21.15.79:0/3125342089 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8007740 con 0x7fd7e006d500 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.175+0000 7fd7deffd640 1 -- 172.21.15.79:0/3125342089 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d80078e0 con 0x7fd7e006d500 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.175+0000 7fd7deffd640 1 -- 172.21.15.79:0/3125342089 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8007cb0 con 0x7fd7e006d500 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.176+0000 7fd7e65b0640 1 -- 172.21.15.79:0/3125342089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 msgr2=0x7fd7e0071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.176+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/3125342089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0071550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009d90 tx=0x7fd7d802a660 comp rx=0 tx=0).stop 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.176+0000 7fd7e65b0640 1 -- 172.21.15.79:0/3125342089 shutdown_connections 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.176+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/3125342089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0071550 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.176+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/3125342089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e00b3bf0 0x7fd7e006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.176+0000 7fd7e65b0640 1 -- 172.21.15.79:0/3125342089 >> 172.21.15.79:0/3125342089 conn(0x7fd7e00b1d10 msgr2=0x7fd7e00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.176+0000 7fd7e65b0640 1 -- 172.21.15.79:0/3125342089 shutdown_connections 2024-06-10T00:15:19.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.176+0000 7fd7e65b0640 1 -- 172.21.15.79:0/3125342089 wait complete. 2024-06-10T00:15:19.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.177+0000 7fd7e65b0640 1 Processor -- start 2024-06-10T00:15:19.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.177+0000 7fd7e65b0640 1 -- start start 2024-06-10T00:15:19.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7e65b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7e65b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e00b3bf0 0x7fd7e0137460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7e65b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e0154c20 0x7fd7e009cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7e65b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e00d0020 con 0x7fd7e006d500 2024-06-10T00:15:19.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7e65b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e006d9b0 con 0x7fd7e00b3bf0 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7e65b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e00d01a0 con 0x7fd7e0154c20 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0148b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45874/0 (socket says 172.21.15.79:45874) 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 -- 172.21.15.79:0/1574104121 learned_addr learned my addr 172.21.15.79:0/1574104121 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7e4b4d640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e0154c20 0x7fd7e009cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7df7fe640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e00b3bf0 0x7fd7e0137460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 -- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e0154c20 msgr2=0x7fd7e009cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e0154c20 0x7fd7e009cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 -- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e00b3bf0 msgr2=0x7fd7e0137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e00b3bf0 0x7fd7e0137460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 -- 172.21.15.79:0/1574104121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e0150760 con 0x7fd7e006d500 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7e4b4d640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e0154c20 0x7fd7e009cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:19.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.178+0000 7fd7dffff640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0148b70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c3c0 tx=0x7fd7d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.179+0000 7fd7dcff9640 1 -- 172.21.15.79:0/1574104121 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0017070 con 0x7fd7e006d500 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.179+0000 7fd7dcff9640 1 -- 172.21.15.79:0/1574104121 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d0005ce0 con 0x7fd7e006d500 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.179+0000 7fd7dcff9640 1 -- 172.21.15.79:0/1574104121 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00072f0 con 0x7fd7e006d500 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.179+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e0150a00 con 0x7fd7e006d500 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.179+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e0150fc0 con 0x7fd7e006d500 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.180+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e00683c0 con 0x7fd7e006d500 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.180+0000 7fd7dcff9640 1 -- 172.21.15.79:0/1574104121 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7d001a070 con 0x7fd7e006d500 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.180+0000 7fd7dcff9640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be30 0x7fd7cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.181+0000 7fd7dcff9640 1 -- 172.21.15.79:0/1574104121 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd7d008a510 con 0x7fd7e006d500 2024-06-10T00:15:19.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.181+0000 7fd7df7fe640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be30 0x7fd7cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.181+0000 7fd7df7fe640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be30 0x7fd7cc06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7e01505e0 tx=0x7fd7d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.185+0000 7fd7dcff9640 1 -- 172.21.15.79:0/1574104121 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd7d0058c10 con 0x7fd7e006d500 2024-06-10T00:15:19.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.360+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd7e015da80 con 0x7fd7e006d500 2024-06-10T00:15:19.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.360+0000 7fd7dcff9640 1 -- 172.21.15.79:0/1574104121 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fd7d0058510 con 0x7fd7e006d500 2024-06-10T00:15:19.361 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-06-10T00:15:19.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be30 msgr2=0x7fd7cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be30 0x7fd7cc06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7e01505e0 tx=0x7fd7d4008040 comp rx=0 tx=0).stop 2024-06-10T00:15:19.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 msgr2=0x7fd7e0148b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0148b70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c3c0 tx=0x7fd7d000c880 comp rx=0 tx=0).stop 2024-06-10T00:15:19.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 shutdown_connections 2024-06-10T00:15:19.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be30 0x7fd7cc06e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e0154c20 0x7fd7e009cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e00b3bf0 0x7fd7e0137460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 --2- 172.21.15.79:0/1574104121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e006d500 0x7fd7e0148b70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 >> 172.21.15.79:0/1574104121 conn(0x7fd7e00b1d10 msgr2=0x7fd7e0072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:19.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 shutdown_connections 2024-06-10T00:15:19.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.362+0000 7fd7e65b0640 1 -- 172.21.15.79:0/1574104121 wait complete. 2024-06-10T00:15:19.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-10T00:15:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.475+0000 7f7783e4d640 1 Processor -- start 2024-06-10T00:15:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.475+0000 7f7783e4d640 1 -- start start 2024-06-10T00:15:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7783e4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f777c0b2bf0 0x7f777c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7783e4d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c0b3080 con 0x7f777c0b3b40 2024-06-10T00:15:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7783e4d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c15c870 con 0x7f777c0d0560 2024-06-10T00:15:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7783e4d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f777c0d09b0 con 0x7f777c0b2bf0 2024-06-10T00:15:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7781be9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f777c0b3b40 0x7f777c0b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58838/0 (socket says 172.21.15.79:58838) 2024-06-10T00:15:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7781be9640 1 -- 172.21.15.79:0/1458908542 learned_addr learned my addr 172.21.15.79:0/1458908542 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f77813e8640 1 --2- 172.21.15.79:0/1458908542 >> v2:172.21.15.79:3300/0 conn(0x7f777c0b2bf0 0x7f777c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7780be7640 1 -- 172.21.15.79:0/1458908542 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626420482 0 0) 0x7f777c0b3080 con 0x7f777c0b3b40 2024-06-10T00:15:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7780be7640 1 -- 172.21.15.79:0/1458908542 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7768003520 con 0x7f777c0b3b40 2024-06-10T00:15:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f7780be7640 1 -- 172.21.15.79:0/1458908542 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3573964823 0 0) 0x7f7768003520 con 0x7f777c0b3b40 2024-06-10T00:15:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f77813e8640 1 -- 172.21.15.79:0/1458908542 >> v1:172.21.15.117:6789/0 conn(0x7f777c0d0560 legacy=0x7f777c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.476+0000 7f77813e8640 1 -- 172.21.15.79:0/1458908542 >> v1:172.21.15.79:6789/0 conn(0x7f777c0b3b40 legacy=0x7f777c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.477+0000 7f77813e8640 1 -- 172.21.15.79:0/1458908542 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c15cb50 con 0x7f777c0b2bf0 2024-06-10T00:15:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.477+0000 7f77813e8640 1 --2- 172.21.15.79:0/1458908542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c0d0020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f776c0097a0 tx=0x7f776c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d7a170a7f19413 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.477+0000 7f7780be7640 1 -- 172.21.15.79:0/1458908542 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c037070 con 0x7f777c0b2bf0 2024-06-10T00:15:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.477+0000 7f7780be7640 1 -- 172.21.15.79:0/1458908542 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c02ac50 con 0x7f777c0b2bf0 2024-06-10T00:15:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.477+0000 7f7780be7640 1 -- 172.21.15.79:0/1458908542 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778001670 con 0x7f777c0b2bf0 2024-06-10T00:15:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.478+0000 7f7783e4d640 1 -- 172.21.15.79:0/1458908542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 msgr2=0x7f777c0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.478+0000 7f7783e4d640 1 --2- 172.21.15.79:0/1458908542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c0d0020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f776c0097a0 tx=0x7f776c02a1c0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.478+0000 7f7783e4d640 1 -- 172.21.15.79:0/1458908542 shutdown_connections 2024-06-10T00:15:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.478+0000 7f7783e4d640 1 --2- 172.21.15.79:0/1458908542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c0d0020 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.478+0000 7f7783e4d640 1 -- 172.21.15.79:0/1458908542 >> 172.21.15.79:0/1458908542 conn(0x7f777c0b1d10 msgr2=0x7f777c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.478+0000 7f7783e4d640 1 -- 172.21.15.79:0/1458908542 shutdown_connections 2024-06-10T00:15:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.478+0000 7f7783e4d640 1 -- 172.21.15.79:0/1458908542 wait complete. 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.479+0000 7f7783e4d640 1 Processor -- start 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7783e4d640 1 -- start start 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7783e4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7783e4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777c0b3b40 0x7f777c144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7783e4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f777c0d0560 0x7f777c0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7783e4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f777c15d3f0 con 0x7f777c0b2bf0 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7783e4d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f777c15d110 con 0x7f777c0d0560 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7783e4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f777c0b3f20 con 0x7f777c0b3b40 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7781be9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7781be9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45898/0 (socket says 172.21.15.79:45898) 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f7781be9640 1 -- 172.21.15.79:0/3573799765 learned_addr learned my addr 172.21.15.79:0/3573799765 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f77813e8640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777c0b3b40 0x7f777c144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.480+0000 7f77823ea640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f777c0d0560 0x7f777c0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f7781be9640 1 -- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777c0b3b40 msgr2=0x7f777c144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f7781be9640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777c0b3b40 0x7f777c144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f7781be9640 1 -- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f777c0d0560 msgr2=0x7f777c0b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f7781be9640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f777c0d0560 0x7f777c0b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f7781be9640 1 -- 172.21.15.79:0/3573799765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c155410 con 0x7f777c0b2bf0 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f77813e8640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777c0b3b40 0x7f777c144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f77823ea640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f777c0d0560 0x7f777c0b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f7781be9640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c156190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f777800c750 tx=0x7f777800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f77727fc640 1 -- 172.21.15.79:0/3573799765 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778017070 con 0x7f777c0b2bf0 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f77727fc640 1 -- 172.21.15.79:0/3573799765 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7778005ad0 con 0x7f777c0b2bf0 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777c1486a0 con 0x7f777c0b2bf0 2024-06-10T00:15:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f77727fc640 1 -- 172.21.15.79:0/3573799765 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778007070 con 0x7f777c0b2bf0 2024-06-10T00:15:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.481+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777c155990 con 0x7f777c0b2bf0 2024-06-10T00:15:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.482+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777c0683c0 con 0x7f777c0b2bf0 2024-06-10T00:15:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.482+0000 7f77727fc640 1 -- 172.21.15.79:0/3573799765 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f777801a070 con 0x7f777c0b2bf0 2024-06-10T00:15:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.483+0000 7f77727fc640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f776006be30 0x7f776006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.483+0000 7f77727fc640 1 -- 172.21.15.79:0/3573799765 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f777808a690 con 0x7f777c0b2bf0 2024-06-10T00:15:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.483+0000 7f77813e8640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f776006be30 0x7f776006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.483+0000 7f77813e8640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f776006be30 0x7f776006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f776c034000 tx=0x7f776c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.487+0000 7f77727fc640 1 -- 172.21.15.79:0/3573799765 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7778058d90 con 0x7f777c0b2bf0 2024-06-10T00:15:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.661+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f777c159d40 con 0x7f777c0b2bf0 2024-06-10T00:15:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.661+0000 7f77727fc640 1 -- 172.21.15.79:0/3573799765 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f7778058690 con 0x7f777c0b2bf0 2024-06-10T00:15:19.662 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f776006be30 msgr2=0x7f776006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f776006be30 0x7f776006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f776c034000 tx=0x7f776c02e000 comp rx=0 tx=0).stop 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 msgr2=0x7f777c156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c156190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f777800c750 tx=0x7f777800cc10 comp rx=0 tx=0).stop 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 shutdown_connections 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f776006be30 0x7f776006e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f777c0d0560 0x7f777c0b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777c0b3b40 0x7f777c144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 --2- 172.21.15.79:0/3573799765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f777c0b2bf0 0x7f777c156190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 >> 172.21.15.79:0/3573799765 conn(0x7f777c0b1d10 msgr2=0x7f777c0cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 shutdown_connections 2024-06-10T00:15:19.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.663+0000 7f7783e4d640 1 -- 172.21.15.79:0/3573799765 wait complete. 2024-06-10T00:15:19.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-06-10T00:15:19.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.773+0000 7f1a1f163640 1 Processor -- start 2024-06-10T00:15:19.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.773+0000 7f1a1f163640 1 -- start start 2024-06-10T00:15:19.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.773+0000 7f1a1f163640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a180d2680 0x7f1a1815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.773+0000 7f1a1f163640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a180d1fc0 0x7f1a180d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.773+0000 7f1a1f163640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a18161fa0 0x7f1a18162430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.773+0000 7f1a1f163640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1a180d13e0 con 0x7f1a18161fa0 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.773+0000 7f1a1f163640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1a180d2fa0 con 0x7f1a180d1fc0 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.773+0000 7f1a1f163640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1a180d0ad0 con 0x7f1a180d2680 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1d700640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a18161fa0 0x7f1a18162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1d700640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a18161fa0 0x7f1a18162430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45906/0 (socket says 172.21.15.79:45906) 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1d700640 1 -- 172.21.15.79:0/756841938 learned_addr learned my addr 172.21.15.79:0/756841938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1ceff640 1 --2- 172.21.15.79:0/756841938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a180d2680 0x7f1a1815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a17fff640 1 --2- 172.21.15.79:0/756841938 >> v2:172.21.15.117:3300/0 conn(0x7f1a180d1fc0 0x7f1a180d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1d700640 1 -- 172.21.15.79:0/756841938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a180d2680 msgr2=0x7f1a1815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1d700640 1 --2- 172.21.15.79:0/756841938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a180d2680 0x7f1a1815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1d700640 1 -- 172.21.15.79:0/756841938 >> v2:172.21.15.117:3300/0 conn(0x7f1a180d1fc0 msgr2=0x7f1a180d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1d700640 1 --2- 172.21.15.79:0/756841938 >> v2:172.21.15.117:3300/0 conn(0x7f1a180d1fc0 0x7f1a180d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.774+0000 7f1a1d700640 1 -- 172.21.15.79:0/756841938 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1815f890 con 0x7f1a18161fa0 2024-06-10T00:15:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1d700640 1 --2- 172.21.15.79:0/756841938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a18161fa0 0x7f1a18162430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a1808cb20 tx=0x7f1a1002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92ce87f81f98d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a177fe640 1 -- 172.21.15.79:0/756841938 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10036070 con 0x7f1a18161fa0 2024-06-10T00:15:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a177fe640 1 -- 172.21.15.79:0/756841938 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a10031600 con 0x7f1a18161fa0 2024-06-10T00:15:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a177fe640 1 -- 172.21.15.79:0/756841938 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a100319d0 con 0x7f1a18161fa0 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 -- 172.21.15.79:0/756841938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a18161fa0 msgr2=0x7f1a18162430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 --2- 172.21.15.79:0/756841938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a18161fa0 0x7f1a18162430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a1808cb20 tx=0x7f1a1002a6a0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 -- 172.21.15.79:0/756841938 shutdown_connections 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 --2- 172.21.15.79:0/756841938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a18161fa0 0x7f1a18162430 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 --2- 172.21.15.79:0/756841938 >> v2:172.21.15.117:3300/0 conn(0x7f1a180d1fc0 0x7f1a180d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 --2- 172.21.15.79:0/756841938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a180d2680 0x7f1a1815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 -- 172.21.15.79:0/756841938 >> 172.21.15.79:0/756841938 conn(0x7f1a1809d3f0 msgr2=0x7f1a180d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 -- 172.21.15.79:0/756841938 shutdown_connections 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.775+0000 7f1a1f163640 1 -- 172.21.15.79:0/756841938 wait complete. 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.777+0000 7f1a1f163640 1 Processor -- start 2024-06-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.777+0000 7f1a1f163640 1 -- start start 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.777+0000 7f1a1f163640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a180d1fc0 0x7f1a180b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.777+0000 7f1a1f163640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a180d2680 0x7f1a181f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.777+0000 7f1a1f163640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a18161fa0 0x7f1a180cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a1f163640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a180d2400 con 0x7f1a180d2680 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a1f163640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a180d1070 con 0x7f1a180d1fc0 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a1f163640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1a180d4f00 con 0x7f1a18161fa0 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a180d2680 0x7f1a181f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a180d2680 0x7f1a181f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45912/0 (socket says 172.21.15.79:45912) 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 -- 172.21.15.79:0/218065841 learned_addr learned my addr 172.21.15.79:0/218065841 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a1ceff640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a180d1fc0 0x7f1a180b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a1d700640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a18161fa0 0x7f1a180cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 -- 172.21.15.79:0/218065841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a18161fa0 msgr2=0x7f1a180cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a18161fa0 0x7f1a180cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 -- 172.21.15.79:0/218065841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a180d1fc0 msgr2=0x7f1a180b8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a180d1fc0 0x7f1a180b8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 -- 172.21.15.79:0/218065841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1815c2c0 con 0x7f1a180d2680 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a17fff640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a180d2680 0x7f1a181f46d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400d800 tx=0x7f1a0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a157fa640 1 -- 172.21.15.79:0/218065841 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04018020 con 0x7f1a180d2680 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a157fa640 1 -- 172.21.15.79:0/218065841 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a040096a0 con 0x7f1a180d2680 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1815c5a0 con 0x7f1a180d2680 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a157fa640 1 -- 172.21.15.79:0/218065841 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04009a70 con 0x7f1a180d2680 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.778+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1815cb60 con 0x7f1a180d2680 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.779+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a18068430 con 0x7f1a180d2680 2024-06-10T00:15:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.780+0000 7f1a157fa640 1 -- 172.21.15.79:0/218065841 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a0401b020 con 0x7f1a180d2680 2024-06-10T00:15:19.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.780+0000 7f1a157fa640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19fc06be30 0x7f19fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:19.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.780+0000 7f1a1ceff640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19fc06be30 0x7f19fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:19.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.780+0000 7f1a157fa640 1 -- 172.21.15.79:0/218065841 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1a0408b420 con 0x7f1a180d2680 2024-06-10T00:15:19.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.781+0000 7f1a1ceff640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19fc06be30 0x7f19fc06e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c006fd0 tx=0x7f1a0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:19.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:19.785+0000 7f1a157fa640 1 -- 172.21.15.79:0/218065841 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1a04022030 con 0x7f1a180d2680 2024-06-10T00:15:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.028+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f1a180ce3f0 con 0x7f1a180d2680 2024-06-10T00:15:20.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.971+0000 7f1a157fa640 1 -- 172.21.15.79:0/218065841 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v54) ==== 145+0+0 (secure 0 0 0) 0x7f1a04059a90 con 0x7f1a180d2680 2024-06-10T00:15:20.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.973+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19fc06be30 msgr2=0x7f19fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:20.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.973+0000 7f1a1f163640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19fc06be30 0x7f19fc06e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c006fd0 tx=0x7f1a0c008040 comp rx=0 tx=0).stop 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.973+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a180d2680 msgr2=0x7f1a181f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.973+0000 7f1a1f163640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a180d2680 0x7f1a181f46d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400d800 tx=0x7f1a0400dcc0 comp rx=0 tx=0).stop 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.974+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 shutdown_connections 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.974+0000 7f1a1f163640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19fc06be30 0x7f19fc06e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.974+0000 7f1a1f163640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a18161fa0 0x7f1a180cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.974+0000 7f1a1f163640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a180d2680 0x7f1a181f46d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.974+0000 7f1a1f163640 1 --2- 172.21.15.79:0/218065841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a180d1fc0 0x7f1a180b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.974+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 >> 172.21.15.79:0/218065841 conn(0x7f1a1809d3f0 msgr2=0x7f1a1806c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.974+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 shutdown_connections 2024-06-10T00:15:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:20.974+0000 7f1a1f163640 1 -- 172.21.15.79:0/218065841 wait complete. 2024-06-10T00:15:20.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-10T00:15:21.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.089+0000 7f0be1e93640 1 Processor -- start 2024-06-10T00:15:21.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.089+0000 7f0be1e93640 1 -- start start 2024-06-10T00:15:21.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0be1e93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 0x7f0bdc0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0be1e93640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0bdc0b34e0 0x7f0bdc0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0be1e93640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bdc0d0560 0x7f0bdc06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0be1e93640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0bdc155700 con 0x7f0bdc0d0560 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0be1e93640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0bdc15b6b0 con 0x7f0bdc0b34e0 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0be1e93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc15b990 con 0x7f0bdc155320 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bdc0d0560 0x7f0bdc06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bdc0d0560 0x7f0bdc06e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45914/0 (socket says 172.21.15.79:45914) 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdbfff640 1 -- 172.21.15.79:0/2599638360 learned_addr learned my addr 172.21.15.79:0/2599638360 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdaffd640 1 --2- 172.21.15.79:0/2599638360 >> v2:172.21.15.117:3300/0 conn(0x7f0bdc0b34e0 0x7f0bdc0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdb7fe640 1 --2- 172.21.15.79:0/2599638360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 0x7f0bdc0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdbfff640 1 -- 172.21.15.79:0/2599638360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 msgr2=0x7f0bdc0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdbfff640 1 --2- 172.21.15.79:0/2599638360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 0x7f0bdc0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdbfff640 1 -- 172.21.15.79:0/2599638360 >> v2:172.21.15.117:3300/0 conn(0x7f0bdc0b34e0 msgr2=0x7f0bdc0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdbfff640 1 --2- 172.21.15.79:0/2599638360 >> v2:172.21.15.117:3300/0 conn(0x7f0bdc0b34e0 0x7f0bdc0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdbfff640 1 -- 172.21.15.79:0/2599638360 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc15bc70 con 0x7f0bdc0d0560 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.090+0000 7f0bdb7fe640 1 --2- 172.21.15.79:0/2599638360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 0x7f0bdc0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0bdbfff640 1 --2- 172.21.15.79:0/2599638360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc06e1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0d0c90 tx=0x7f0bd402c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf0a6e0c2f82f09 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0bda7fc640 1 -- 172.21.15.79:0/2599638360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400b2e0 con 0x7f0bdc0d0560 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0bda7fc640 1 -- 172.21.15.79:0/2599638360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd4009600 con 0x7f0bdc0d0560 2024-06-10T00:15:21.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0bda7fc640 1 -- 172.21.15.79:0/2599638360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400b480 con 0x7f0bdc0d0560 2024-06-10T00:15:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 -- 172.21.15.79:0/2599638360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 msgr2=0x7f0bdc06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2599638360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc06e1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0d0c90 tx=0x7f0bd402c8a0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 -- 172.21.15.79:0/2599638360 shutdown_connections 2024-06-10T00:15:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2599638360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc06e1f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2599638360 >> v2:172.21.15.117:3300/0 conn(0x7f0bdc0b34e0 0x7f0bdc0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2599638360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 0x7f0bdc0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 -- 172.21.15.79:0/2599638360 >> 172.21.15.79:0/2599638360 conn(0x7f0bdc0b1d10 msgr2=0x7f0bdc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 -- 172.21.15.79:0/2599638360 shutdown_connections 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.091+0000 7f0be1e93640 1 -- 172.21.15.79:0/2599638360 wait complete. 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.093+0000 7f0be1e93640 1 Processor -- start 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.093+0000 7f0be1e93640 1 -- start start 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.093+0000 7f0be1e93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bdc0b34e0 0x7f0bdc1eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.093+0000 7f0be1e93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc14d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.093+0000 7f0be1e93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 0x7f0bdc152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.093+0000 7f0be1e93640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc15b470 con 0x7f0bdc0d0560 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.093+0000 7f0be1e93640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc15b2f0 con 0x7f0bdc0b34e0 2024-06-10T00:15:21.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.093+0000 7f0be1e93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc06e730 con 0x7f0bdc155320 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc14d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc14d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45928/0 (socket says 172.21.15.79:45928) 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 -- 172.21.15.79:0/2763187043 learned_addr learned my addr 172.21.15.79:0/2763187043 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdb7fe640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bdc0b34e0 0x7f0bdc1eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 -- 172.21.15.79:0/2763187043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 msgr2=0x7f0bdc152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 0x7f0bdc152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 -- 172.21.15.79:0/2763187043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bdc0b34e0 msgr2=0x7f0bdc1eeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bdc0b34e0 0x7f0bdc1eeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 -- 172.21.15.79:0/2763187043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc1ef530 con 0x7f0bdc0d0560 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bdaffd640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc14d580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000d800 tx=0x7f0bd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bc3fff640 1 -- 172.21.15.79:0/2763187043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0018020 con 0x7f0bdc0d0560 2024-06-10T00:15:21.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bc3fff640 1 -- 172.21.15.79:0/2763187043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd00096a0 con 0x7f0bdc0d0560 2024-06-10T00:15:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0bc3fff640 1 -- 172.21.15.79:0/2763187043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0009a70 con 0x7f0bdc0d0560 2024-06-10T00:15:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bdc14ded0 con 0x7f0bdc0d0560 2024-06-10T00:15:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.094+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bdc0af8f0 con 0x7f0bdc0d0560 2024-06-10T00:15:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.095+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bdc0af6e0 con 0x7f0bdc0d0560 2024-06-10T00:15:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.096+0000 7f0bc3fff640 1 -- 172.21.15.79:0/2763187043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bd001b020 con 0x7f0bdc0d0560 2024-06-10T00:15:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.096+0000 7f0bc3fff640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0bc806be60 0x7f0bc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.096+0000 7f0bc3fff640 1 -- 172.21.15.79:0/2763187043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0bd008b6e0 con 0x7f0bdc0d0560 2024-06-10T00:15:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.096+0000 7f0bdb7fe640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0bc806be60 0x7f0bc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.097+0000 7f0bdb7fe640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0bc806be60 0x7f0bc806e320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00b840 tx=0x7f0bcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.100+0000 7f0bc3fff640 1 -- 172.21.15.79:0/2763187043 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0bd0022020 con 0x7f0bdc0d0560 2024-06-10T00:15:21.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.279+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0bdc15c230 con 0x7f0bdc0d0560 2024-06-10T00:15:21.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.282+0000 7f0bc3fff640 1 -- 172.21.15.79:0/2763187043 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f0bd0059700 con 0x7f0bdc0d0560 2024-06-10T00:15:21.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0bc806be60 msgr2=0x7f0bc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0bc806be60 0x7f0bc806e320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00b840 tx=0x7f0bcc008040 comp rx=0 tx=0).stop 2024-06-10T00:15:21.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 msgr2=0x7f0bdc14d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc14d580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000d800 tx=0x7f0bd000dcc0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 shutdown_connections 2024-06-10T00:15:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0bc806be60 0x7f0bc806e320 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bdc155320 0x7f0bdc152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bdc0d0560 0x7f0bdc14d580 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 --2- 172.21.15.79:0/2763187043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bdc0b34e0 0x7f0bdc1eeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 >> 172.21.15.79:0/2763187043 conn(0x7f0bdc0b1d10 msgr2=0x7f0bdc071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 shutdown_connections 2024-06-10T00:15:21.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.285+0000 7f0be1e93640 1 -- 172.21.15.79:0/2763187043 wait complete. 2024-06-10T00:15:21.296 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:15:21.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:15:21.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:15:21.383 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:15:21.384 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:15:21.384 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:21.400 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:15:21.400 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:21.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:21.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.596+0000 7fb2d614c640 1 Processor -- start 2024-06-10T00:15:21.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.596+0000 7fb2d614c640 1 -- start start 2024-06-10T00:15:21.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.596+0000 7fb2d614c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb2d00d2680 0x7fb2d015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.596+0000 7fb2d614c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb2d00cef70 0x7fb2d00cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.596+0000 7fb2d614c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d00d0ad0 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.596+0000 7fb2d614c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d00d13e0 con 0x7fb2d00d2680 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.596+0000 7fb2d614c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d015f890 con 0x7fb2d00cef70 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cf7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb2d00d2680 0x7fb2d015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cf7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb2d00d2680 0x7fb2d015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45942/0 (socket says 172.21.15.79:45942) 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cf7fe640 1 -- 172.21.15.79:0/4063354772 learned_addr learned my addr 172.21.15.79:0/4063354772 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cffff640 1 --2- 172.21.15.79:0/4063354772 >> v2:172.21.15.117:3300/0 conn(0x7fb2d00cef70 0x7fb2d00cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cf7fe640 1 -- 172.21.15.79:0/4063354772 >> v2:172.21.15.117:3300/0 conn(0x7fb2d00cef70 msgr2=0x7fb2d00cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cf7fe640 1 --2- 172.21.15.79:0/4063354772 >> v2:172.21.15.117:3300/0 conn(0x7fb2d00cef70 0x7fb2d00cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cf7fe640 1 -- 172.21.15.79:0/4063354772 >> v1:172.21.15.117:6789/0 conn(0x7fb2d00d1fc0 legacy=0x7fb2d00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:21.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cf7fe640 1 -- 172.21.15.79:0/4063354772 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d00d0d90 con 0x7fb2d00d2680 2024-06-10T00:15:21.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.597+0000 7fb2cffff640 1 --2- 172.21.15.79:0/4063354772 >> v2:172.21.15.117:3300/0 conn(0x7fb2d00cef70 0x7fb2d00cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2cf7fe640 1 --2- 172.21.15.79:0/4063354772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d2680 0x7fb2d015f1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00d1560 tx=0x7fb2c002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978d6df8ae2a9bfa server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2ce7fc640 1 -- 172.21.15.79:0/4063354772 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0036070 con 0x7fb2d00d2680 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2ce7fc640 1 -- 172.21.15.79:0/4063354772 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c0031600 con 0x7fb2d00d2680 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2ce7fc640 1 -- 172.21.15.79:0/4063354772 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00319d0 con 0x7fb2d00d2680 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2d614c640 1 -- 172.21.15.79:0/4063354772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d2680 msgr2=0x7fb2d015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2d614c640 1 --2- 172.21.15.79:0/4063354772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d2680 0x7fb2d015f1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00d1560 tx=0x7fb2c002a6d0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2d614c640 1 -- 172.21.15.79:0/4063354772 shutdown_connections 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2d614c640 1 --2- 172.21.15.79:0/4063354772 >> v2:172.21.15.117:3300/0 conn(0x7fb2d00cef70 0x7fb2d00cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2d614c640 1 --2- 172.21.15.79:0/4063354772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d2680 0x7fb2d015f1a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2d614c640 1 -- 172.21.15.79:0/4063354772 >> 172.21.15.79:0/4063354772 conn(0x7fb2d009d3f0 msgr2=0x7fb2d00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2d614c640 1 -- 172.21.15.79:0/4063354772 shutdown_connections 2024-06-10T00:15:21.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.598+0000 7fb2d614c640 1 -- 172.21.15.79:0/4063354772 wait complete. 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.599+0000 7fb2d614c640 1 Processor -- start 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.600+0000 7fb2d614c640 1 -- start start 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.600+0000 7fb2d614c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2d00cef70 0x7fb2d01f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.600+0000 7fb2d614c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d1fc0 0x7fb2d015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.600+0000 7fb2d614c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2d00d2680 0x7fb2d015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.600+0000 7fb2d614c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d00d4f00 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.600+0000 7fb2d614c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d00d2400 con 0x7fb2d00cef70 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.600+0000 7fb2d614c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d00d1870 con 0x7fb2d00d2680 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.600+0000 7fb2ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d1fc0 0x7fb2d015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d1fc0 0x7fb2d015c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45954/0 (socket says 172.21.15.79:45954) 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2ceffd640 1 -- 172.21.15.79:0/2911356356 learned_addr learned my addr 172.21.15.79:0/2911356356 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2cf7fe640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2d00cef70 0x7fb2d01f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2cffff640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2d00d2680 0x7fb2d015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2ceffd640 1 -- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2d00d2680 msgr2=0x7fb2d015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2ceffd640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2d00d2680 0x7fb2d015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2ceffd640 1 -- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2d00cef70 msgr2=0x7fb2d01f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2ceffd640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2d00cef70 0x7fb2d01f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2ceffd640 1 -- 172.21.15.79:0/2911356356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d00b8a40 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2cf7fe640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2d00cef70 0x7fb2d01f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2ceffd640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d1fc0 0x7fb2d015c150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c430 tx=0x7fb2c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2b7fff640 1 -- 172.21.15.79:0/2911356356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4011790 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2b7fff640 1 -- 172.21.15.79:0/2911356356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c4017070 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2b7fff640 1 -- 172.21.15.79:0/2911356356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4011bb0 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d00b8d20 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.601+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d015b950 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.602+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d01f5610 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.603+0000 7fb2b7fff640 1 -- 172.21.15.79:0/2911356356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2c401c460 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.603+0000 7fb2b7fff640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb2bc06be30 0x7fb2bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.603+0000 7fb2b7fff640 1 -- 172.21.15.79:0/2911356356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb2c408b060 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.603+0000 7fb2cf7fe640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb2bc06be30 0x7fb2bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.604+0000 7fb2cf7fe640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb2bc06be30 0x7fb2bc06e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0033000 tx=0x7fb2c0009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.608+0000 7fb2b7fff640 1 -- 172.21.15.79:0/2911356356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb2c40596d0 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.798+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2d0068430 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.798+0000 7fb2b7fff640 1 -- 172.21.15.79:0/2911356356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fb2c4058fd0 con 0x7fb2d00d1fc0 2024-06-10T00:15:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb2bc06be30 msgr2=0x7fb2bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb2bc06be30 0x7fb2bc06e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0033000 tx=0x7fb2c0009000 comp rx=0 tx=0).stop 2024-06-10T00:15:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d1fc0 msgr2=0x7fb2d015c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d1fc0 0x7fb2d015c150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c430 tx=0x7fb2c400c8f0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 shutdown_connections 2024-06-10T00:15:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb2bc06be30 0x7fb2bc06e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2d00d2680 0x7fb2d015cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d00d1fc0 0x7fb2d015c150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 --2- 172.21.15.79:0/2911356356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2d00cef70 0x7fb2d01f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 >> 172.21.15.79:0/2911356356 conn(0x7fb2d009d3f0 msgr2=0x7fb2d015a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 shutdown_connections 2024-06-10T00:15:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.800+0000 7fb2d614c640 1 -- 172.21.15.79:0/2911356356 wait complete. 2024-06-10T00:15:21.812 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:15:21.812 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:21.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.968+0000 7effadd96640 1 Processor -- start 2024-06-10T00:15:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.968+0000 7effadd96640 1 -- start start 2024-06-10T00:15:21.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effadd96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 0x7effa806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effadd96640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effa806ea20 0x7effa80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effadd96640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa80cf620 con 0x7effa80cf190 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effadd96640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7effa806ee60 con 0x7effa806ea20 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effadd96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effa806d130 con 0x7effa80ae910 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7effa80cf190 0x7effa815ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58854/0 (socket says 172.21.15.79:58854) 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa7fff640 1 -- 172.21.15.79:0/2229616864 learned_addr learned my addr 172.21.15.79:0/2229616864 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073788122 0 0) 0x7effa80cf620 con 0x7effa80cf190 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa77fe640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 0x7effa806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff90005730 con 0x7effa80cf190 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa6ffd640 1 --2- 172.21.15.79:0/2229616864 >> v2:172.21.15.117:3300/0 conn(0x7effa806ea20 0x7effa80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3884419745 0 0) 0x7eff90005730 con 0x7effa80cf190 2024-06-10T00:15:21.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 msgr2=0x7effa806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa67fc640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 0x7effa806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 >> v2:172.21.15.117:3300/0 conn(0x7effa806ea20 msgr2=0x7effa80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa67fc640 1 --2- 172.21.15.79:0/2229616864 >> v2:172.21.15.117:3300/0 conn(0x7effa806ea20 0x7effa80cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.969+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa806d410 con 0x7effa80cf190 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7effa0001670 con 0x7effa80cf190 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 >> v1:172.21.15.79:6789/0 conn(0x7effa80cf190 legacy=0x7effa815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa67fc640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90005bc0 0x7eff90005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa67fc640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 0x7eff90006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa67fc640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff90006f50 0x7eff900073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effa806ee60 con 0x7eff90006f50 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effa806d130 con 0x7eff90005bc0 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7eff9000dbd0 con 0x7effa80ae910 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa7fff640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff90006f50 0x7eff900073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa77fe640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90005bc0 0x7eff90005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa6ffd640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 0x7eff90006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa7fff640 1 -- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 msgr2=0x7eff90006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa7fff640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 0x7eff90006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa7fff640 1 -- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90005bc0 msgr2=0x7eff90005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa7fff640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90005bc0 0x7eff90005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa7fff640 1 -- 172.21.15.79:0/2229616864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff90005730 con 0x7eff90006f50 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.970+0000 7effa6ffd640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa80ae910 0x7eff90006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effa7fff640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff90006f50 0x7eff900073d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7effa000c240 tx=0x7eff90007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3776d293d71416 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0007d10 con 0x7eff90006f50 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa0005ad0 con 0x7eff90006f50 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effa67fc640 1 -- 172.21.15.79:0/2229616864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0007070 con 0x7eff90006f50 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effadd96640 1 -- 172.21.15.79:0/2229616864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff90006f50 msgr2=0x7eff900073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effadd96640 1 --2- 172.21.15.79:0/2229616864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff90006f50 0x7eff900073d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7effa000c240 tx=0x7eff90007a40 comp rx=0 tx=0).stop 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effa7fff640 1 -- 172.21.15.79:0/2229616864 reap_dead start 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effadd96640 1 -- 172.21.15.79:0/2229616864 shutdown_connections 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effadd96640 1 -- 172.21.15.79:0/2229616864 >> 172.21.15.79:0/2229616864 conn(0x7effa80b19f0 msgr2=0x7effa80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effadd96640 1 -- 172.21.15.79:0/2229616864 shutdown_connections 2024-06-10T00:15:21.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.971+0000 7effadd96640 1 -- 172.21.15.79:0/2229616864 wait complete. 2024-06-10T00:15:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.973+0000 7effadd96640 1 Processor -- start 2024-06-10T00:15:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.973+0000 7effadd96640 1 -- start start 2024-06-10T00:15:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effadd96640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90006f50 0x7effa809bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effadd96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814b710 0x7effa80b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effadd96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa814bb90 0x7effa80b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effadd96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effa80aecf0 con 0x7effa814bb90 2024-06-10T00:15:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effadd96640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effa806d9d0 con 0x7eff90006f50 2024-06-10T00:15:21.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effadd96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effa80add50 con 0x7effa814b710 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa814bb90 0x7effa80b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa814bb90 0x7effa80b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45978/0 (socket says 172.21.15.79:45978) 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 -- 172.21.15.79:0/1299146711 learned_addr learned my addr 172.21.15.79:0/1299146711 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa6ffd640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814b710 0x7effa80b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa77fe640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90006f50 0x7effa809bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 -- 172.21.15.79:0/1299146711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814b710 msgr2=0x7effa80b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814b710 0x7effa80b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 -- 172.21.15.79:0/1299146711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90006f50 msgr2=0x7effa809bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90006f50 0x7effa809bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 -- 172.21.15.79:0/1299146711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa814c0f0 con 0x7effa814bb90 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.974+0000 7effa7fff640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa814bb90 0x7effa80b06a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7effa000c360 tx=0x7effa806d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.975+0000 7eff8ffff640 1 -- 172.21.15.79:0/1299146711 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0007d10 con 0x7effa814bb90 2024-06-10T00:15:21.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.975+0000 7eff8ffff640 1 -- 172.21.15.79:0/1299146711 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa0007280 con 0x7effa814bb90 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.975+0000 7eff8ffff640 1 -- 172.21.15.79:0/1299146711 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0007470 con 0x7effa814bb90 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.975+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa814c3d0 con 0x7effa814bb90 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.975+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa814c990 con 0x7effa814bb90 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.976+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa814cd70 con 0x7effa814bb90 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.976+0000 7eff8ffff640 1 -- 172.21.15.79:0/1299146711 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effa0046020 con 0x7effa814bb90 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.976+0000 7eff8ffff640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7eff9406be30 0x7eff9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.976+0000 7eff8ffff640 1 -- 172.21.15.79:0/1299146711 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7effa00aaf90 con 0x7effa814bb90 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.977+0000 7effa77fe640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7eff9406be30 0x7eff9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:21.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.977+0000 7effa77fe640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7eff9406be30 0x7eff9406e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff98014450 tx=0x7eff9800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:21.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:21.981+0000 7eff8ffff640 1 -- 172.21.15.79:0/1299146711 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7effa814cd70 con 0x7effa814bb90 2024-06-10T00:15:22.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.170+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7effa80cdbe0 con 0x7effa814bb90 2024-06-10T00:15:22.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.170+0000 7eff8ffff640 1 -- 172.21.15.79:0/1299146711 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7effa0079120 con 0x7effa814bb90 2024-06-10T00:15:22.171 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7eff9406be30 msgr2=0x7eff9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7eff9406be30 0x7eff9406e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff98014450 tx=0x7eff9800b040 comp rx=0 tx=0).stop 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa814bb90 msgr2=0x7effa80b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa814bb90 0x7effa80b06a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7effa000c360 tx=0x7effa806d5e0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 shutdown_connections 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7eff9406be30 0x7eff9406e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa814bb90 0x7effa80b06a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814b710 0x7effa80b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 --2- 172.21.15.79:0/1299146711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff90006f50 0x7effa809bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 >> 172.21.15.79:0/1299146711 conn(0x7effa80b19f0 msgr2=0x7effa815a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 shutdown_connections 2024-06-10T00:15:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.173+0000 7effadd96640 1 -- 172.21.15.79:0/1299146711 wait complete. 2024-06-10T00:15:22.184 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:15:22.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:22.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:22.209 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:22.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:15:22.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:22.211 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:15:22.265 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:15:22.265 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:22.284 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:15:22.284 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:22.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:22.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.445+0000 7fe647ebd640 1 Processor -- start 2024-06-10T00:15:22.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.446+0000 7fe647ebd640 1 -- start start 2024-06-10T00:15:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.446+0000 7fe647ebd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe64015e1a0 0x7fe64006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.446+0000 7fe647ebd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6400b4ac0 0x7fe64006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.446+0000 7fe647ebd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe640162d00 con 0x7fe640162800 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.446+0000 7fe647ebd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe6400b3620 con 0x7fe64015e1a0 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.446+0000 7fe647ebd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe6400ae330 con 0x7fe6400b4ac0 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.446+0000 7fe645c59640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe64015e1a0 0x7fe64006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.447+0000 7fe645c59640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe64015e1a0 0x7fe64006c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45994/0 (socket says 172.21.15.79:45994) 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.447+0000 7fe645c59640 1 -- 172.21.15.79:0/1350865726 learned_addr learned my addr 172.21.15.79:0/1350865726 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.447+0000 7fe645c59640 1 -- 172.21.15.79:0/1350865726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6400b4ac0 msgr2=0x7fe64006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.447+0000 7fe645c59640 1 --2- 172.21.15.79:0/1350865726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6400b4ac0 0x7fe64006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.447+0000 7fe645c59640 1 -- 172.21.15.79:0/1350865726 >> v1:172.21.15.117:6789/0 conn(0x7fe640162800 legacy=0x7fe64015e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.447+0000 7fe645c59640 1 -- 172.21.15.79:0/1350865726 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6400ae610 con 0x7fe64015e1a0 2024-06-10T00:15:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.447+0000 7fe645c59640 1 --2- 172.21.15.79:0/1350865726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe64015e1a0 0x7fe64006c3d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe630009e50 tx=0x7fe63002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b494b5bf4c004e47 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe644c57640 1 -- 172.21.15.79:0/1350865726 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630036070 con 0x7fe64015e1a0 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe644c57640 1 -- 172.21.15.79:0/1350865726 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe630031600 con 0x7fe64015e1a0 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe644c57640 1 -- 172.21.15.79:0/1350865726 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300319d0 con 0x7fe64015e1a0 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe647ebd640 1 -- 172.21.15.79:0/1350865726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe64015e1a0 msgr2=0x7fe64006c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe647ebd640 1 --2- 172.21.15.79:0/1350865726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe64015e1a0 0x7fe64006c3d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe630009e50 tx=0x7fe63002a6c0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe647ebd640 1 -- 172.21.15.79:0/1350865726 shutdown_connections 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe647ebd640 1 --2- 172.21.15.79:0/1350865726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6400b4ac0 0x7fe64006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe647ebd640 1 --2- 172.21.15.79:0/1350865726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe64015e1a0 0x7fe64006c3d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe647ebd640 1 -- 172.21.15.79:0/1350865726 >> 172.21.15.79:0/1350865726 conn(0x7fe640071850 msgr2=0x7fe640071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe647ebd640 1 -- 172.21.15.79:0/1350865726 shutdown_connections 2024-06-10T00:15:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.448+0000 7fe647ebd640 1 -- 172.21.15.79:0/1350865726 wait complete. 2024-06-10T00:15:22.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.449+0000 7fe647ebd640 1 Processor -- start 2024-06-10T00:15:22.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.449+0000 7fe647ebd640 1 -- start start 2024-06-10T00:15:22.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe647ebd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6400b4ac0 0x7fe6401486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe647ebd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64015e1a0 0x7fe640148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe647ebd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640162800 0x7fe640157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe647ebd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6400b58c0 con 0x7fe6400b4ac0 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe647ebd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6400b5740 con 0x7fe64015e1a0 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe647ebd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe640072580 con 0x7fe640162800 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe645c59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6400b4ac0 0x7fe6401486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe645c59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6400b4ac0 0x7fe6401486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46002/0 (socket says 172.21.15.79:46002) 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe645c59640 1 -- 172.21.15.79:0/767731043 learned_addr learned my addr 172.21.15.79:0/767731043 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe645c59640 1 -- 172.21.15.79:0/767731043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640162800 msgr2=0x7fe640157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.450+0000 7fe64645a640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640162800 0x7fe640157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe645458640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64015e1a0 0x7fe640148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe645c59640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640162800 0x7fe640157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe645c59640 1 -- 172.21.15.79:0/767731043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64015e1a0 msgr2=0x7fe640148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe645c59640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64015e1a0 0x7fe640148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe645c59640 1 -- 172.21.15.79:0/767731043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6401554e0 con 0x7fe6400b4ac0 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe645c59640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6400b4ac0 0x7fe6401486f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe630009e50 tx=0x7fe630004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe63e7fc640 1 -- 172.21.15.79:0/767731043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630041020 con 0x7fe6400b4ac0 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe63e7fc640 1 -- 172.21.15.79:0/767731043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe630007800 con 0x7fe6400b4ac0 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6401557c0 con 0x7fe6400b4ac0 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe63e7fc640 1 -- 172.21.15.79:0/767731043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630036040 con 0x7fe6400b4ac0 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.451+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe640149460 con 0x7fe6400b4ac0 2024-06-10T00:15:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.452+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe640155990 con 0x7fe6400b4ac0 2024-06-10T00:15:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.452+0000 7fe63e7fc640 1 -- 172.21.15.79:0/767731043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe630044020 con 0x7fe6400b4ac0 2024-06-10T00:15:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.453+0000 7fe63e7fc640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe62c06be30 0x7fe62c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.453+0000 7fe63e7fc640 1 -- 172.21.15.79:0/767731043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe6300ac050 con 0x7fe6400b4ac0 2024-06-10T00:15:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.453+0000 7fe645458640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe62c06be30 0x7fe62c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.453+0000 7fe645458640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe62c06be30 0x7fe62c06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe640155130 tx=0x7fe634008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:22.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.457+0000 7fe63e7fc640 1 -- 172.21.15.79:0/767731043 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe63004b030 con 0x7fe6400b4ac0 2024-06-10T00:15:22.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.643+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe6400af870 con 0x7fe6400b4ac0 2024-06-10T00:15:22.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.643+0000 7fe63e7fc640 1 -- 172.21.15.79:0/767731043 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fe6400af870 con 0x7fe6400b4ac0 2024-06-10T00:15:22.644 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:22.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe62c06be30 msgr2=0x7fe62c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe62c06be30 0x7fe62c06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe640155130 tx=0x7fe634008040 comp rx=0 tx=0).stop 2024-06-10T00:15:22.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6400b4ac0 msgr2=0x7fe6401486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6400b4ac0 0x7fe6401486f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe630009e50 tx=0x7fe630004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 shutdown_connections 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe62c06be30 0x7fe62c06e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640162800 0x7fe640157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64015e1a0 0x7fe640148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 --2- 172.21.15.79:0/767731043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6400b4ac0 0x7fe6401486f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 >> 172.21.15.79:0/767731043 conn(0x7fe640071850 msgr2=0x7fe640071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 shutdown_connections 2024-06-10T00:15:22.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.645+0000 7fe647ebd640 1 -- 172.21.15.79:0/767731043 wait complete. 2024-06-10T00:15:22.657 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:15:22.657 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:22.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.776+0000 7f913fa2c640 1 Processor -- start 2024-06-10T00:15:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.777+0000 7f913fa2c640 1 -- start start 2024-06-10T00:15:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.777+0000 7f913fa2c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f913815a870 0x7f913806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.777+0000 7f913fa2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f91380b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.777+0000 7f913fa2c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913806e390 con 0x7f91380af3d0 2024-06-10T00:15:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.777+0000 7f913fa2c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f913815ac50 con 0x7f913815a870 2024-06-10T00:15:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.777+0000 7f913fa2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f913806cdb0 con 0x7f91380aef70 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913d7c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f913815a870 0x7f913806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913d7c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f913815a870 0x7f913806de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46012/0 (socket says 172.21.15.79:46012) 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913d7c8640 1 -- 172.21.15.79:0/184328909 learned_addr learned my addr 172.21.15.79:0/184328909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913dfc9640 1 --1- 172.21.15.79:0/184328909 >> v1:172.21.15.79:6789/0 conn(0x7f91380af3d0 0x7f91380cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58856/0 (socket says 172.21.15.79:58856) 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913cfc7640 1 --2- 172.21.15.79:0/184328909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f91380b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913d7c8640 1 -- 172.21.15.79:0/184328909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 msgr2=0x7f91380b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913d7c8640 1 --2- 172.21.15.79:0/184328909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f91380b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913d7c8640 1 -- 172.21.15.79:0/184328909 >> v1:172.21.15.79:6789/0 conn(0x7f91380af3d0 legacy=0x7f91380cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913d7c8640 1 -- 172.21.15.79:0/184328909 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913806d090 con 0x7f913815a870 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f912ffff640 1 -- 172.21.15.79:0/184328909 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377341820 0 0) 0x7f913806e390 con 0x7f91380af3d0 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.778+0000 7f913cfc7640 1 --2- 172.21.15.79:0/184328909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f91380b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913d7c8640 1 --2- 172.21.15.79:0/184328909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913815a870 0x7f913806de50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f913400d150 tx=0x7f913402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39201337ed56ef4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f912ffff640 1 -- 172.21.15.79:0/184328909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134039070 con 0x7f913815a870 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f912ffff640 1 -- 172.21.15.79:0/184328909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9134009600 con 0x7f913815a870 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f912ffff640 1 -- 172.21.15.79:0/184328909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91340099d0 con 0x7f913815a870 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913fa2c640 1 -- 172.21.15.79:0/184328909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913815a870 msgr2=0x7f913806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913fa2c640 1 --2- 172.21.15.79:0/184328909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913815a870 0x7f913806de50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f913400d150 tx=0x7f913402c890 comp rx=0 tx=0).stop 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913fa2c640 1 -- 172.21.15.79:0/184328909 shutdown_connections 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913fa2c640 1 --2- 172.21.15.79:0/184328909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f91380b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913fa2c640 1 --2- 172.21.15.79:0/184328909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913815a870 0x7f913806de50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913fa2c640 1 -- 172.21.15.79:0/184328909 >> 172.21.15.79:0/184328909 conn(0x7f91380b19f0 msgr2=0x7f91380b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913fa2c640 1 -- 172.21.15.79:0/184328909 shutdown_connections 2024-06-10T00:15:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.779+0000 7f913fa2c640 1 -- 172.21.15.79:0/184328909 wait complete. 2024-06-10T00:15:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913fa2c640 1 Processor -- start 2024-06-10T00:15:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913fa2c640 1 -- start start 2024-06-10T00:15:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913fa2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f9138071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913fa2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91380af3d0 0x7f9138072920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913fa2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913815a870 0x7f91381594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913fa2c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f913806d930 con 0x7f91380af3d0 2024-06-10T00:15:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913fa2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f913806d650 con 0x7f913815a870 2024-06-10T00:15:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913fa2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f91380b2e40 con 0x7f91380aef70 2024-06-10T00:15:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913cfc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91380af3d0 0x7f9138072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913cfc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91380af3d0 0x7f9138072920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46018/0 (socket says 172.21.15.79:46018) 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.781+0000 7f913cfc7640 1 -- 172.21.15.79:0/915956993 learned_addr learned my addr 172.21.15.79:0/915956993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913d7c8640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f9138071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913dfc9640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913815a870 0x7f91381594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913cfc7640 1 -- 172.21.15.79:0/915956993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 msgr2=0x7f9138071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913cfc7640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f9138071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913cfc7640 1 -- 172.21.15.79:0/915956993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913815a870 msgr2=0x7f91381594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913cfc7640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913815a870 0x7f91381594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913cfc7640 1 -- 172.21.15.79:0/915956993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9138071880 con 0x7f91380af3d0 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913cfc7640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91380af3d0 0x7f9138072920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f912800c820 tx=0x7f912800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f912dffb640 1 -- 172.21.15.79:0/915956993 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128015070 con 0x7f91380af3d0 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f912dffb640 1 -- 172.21.15.79:0/915956993 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9128007a30 con 0x7f91380af3d0 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f912dffb640 1 -- 172.21.15.79:0/915956993 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128007de0 con 0x7f91380af3d0 2024-06-10T00:15:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9138071b60 con 0x7f91380af3d0 2024-06-10T00:15:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.782+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9138072120 con 0x7f91380af3d0 2024-06-10T00:15:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.783+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9138068430 con 0x7f91380af3d0 2024-06-10T00:15:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.784+0000 7f912dffb640 1 -- 172.21.15.79:0/915956993 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9128018070 con 0x7f91380af3d0 2024-06-10T00:15:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.784+0000 7f912dffb640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f911c06be30 0x7f911c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.784+0000 7f912dffb640 1 -- 172.21.15.79:0/915956993 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f912808b030 con 0x7f91380af3d0 2024-06-10T00:15:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.784+0000 7f913d7c8640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f911c06be30 0x7f911c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.784+0000 7f913d7c8640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f911c06be30 0x7f911c06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9134036000 tx=0x7f913400b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.788+0000 7f912dffb640 1 -- 172.21.15.79:0/915956993 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9128059730 con 0x7f91380af3d0 2024-06-10T00:15:22.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.976+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91380b2650 con 0x7f91380af3d0 2024-06-10T00:15:22.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.976+0000 7f912dffb640 1 -- 172.21.15.79:0/915956993 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f9128059030 con 0x7f91380af3d0 2024-06-10T00:15:22.977 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f911c06be30 msgr2=0x7f911c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f911c06be30 0x7f911c06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9134036000 tx=0x7f913400b000 comp rx=0 tx=0).stop 2024-06-10T00:15:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91380af3d0 msgr2=0x7f9138072920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91380af3d0 0x7f9138072920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f912800c820 tx=0x7f912800cce0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 shutdown_connections 2024-06-10T00:15:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f911c06be30 0x7f911c06e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913815a870 0x7f91381594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91380af3d0 0x7f9138072920 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 --2- 172.21.15.79:0/915956993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91380aef70 0x7f9138071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 >> 172.21.15.79:0/915956993 conn(0x7f91380b19f0 msgr2=0x7f9138151820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 shutdown_connections 2024-06-10T00:15:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:22.978+0000 7f913fa2c640 1 -- 172.21.15.79:0/915956993 wait complete. 2024-06-10T00:15:22.990 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-06-10T00:15:22.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:22.990 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-06-10T00:15:23.020 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:23.020 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:15:23.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:23.020 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-10T00:15:23.091 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:15:23.091 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:23.107 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:15:23.107 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:23.164 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.304+0000 7fa2a0709640 1 Processor -- start 2024-06-10T00:15:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.304+0000 7fa2a0709640 1 -- start start 2024-06-10T00:15:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.305+0000 7fa2a0709640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2980ae910 0x7fa29806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.305+0000 7fa2a0709640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa29806ea20 0x7fa2980cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.305+0000 7fa2a0709640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980cf620 con 0x7fa2980cf190 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.305+0000 7fa2a0709640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa29806ee60 con 0x7fa2980ae910 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.305+0000 7fa2a0709640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa29806d130 con 0x7fa29806ea20 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.305+0000 7fa29e4a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2980ae910 0x7fa29806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.305+0000 7fa29e4a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2980ae910 0x7fa29806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46020/0 (socket says 172.21.15.79:46020) 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.305+0000 7fa29e4a5640 1 -- 172.21.15.79:0/2910997745 learned_addr learned my addr 172.21.15.79:0/2910997745 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.306+0000 7fa29e4a5640 1 -- 172.21.15.79:0/2910997745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa29806ea20 msgr2=0x7fa2980cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.306+0000 7fa29e4a5640 1 --2- 172.21.15.79:0/2910997745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa29806ea20 0x7fa2980cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.306+0000 7fa29e4a5640 1 -- 172.21.15.79:0/2910997745 >> v1:172.21.15.117:6789/0 conn(0x7fa2980cf190 legacy=0x7fa29815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.306+0000 7fa29e4a5640 1 -- 172.21.15.79:0/2910997745 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29806d410 con 0x7fa2980ae910 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.306+0000 7fa29e4a5640 1 --2- 172.21.15.79:0/2910997745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980ae910 0x7fa29806e4e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa29400d180 tx=0x7fa29402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd492e9a6a03fba2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.306+0000 7fa29d4a3640 1 -- 172.21.15.79:0/2910997745 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294039070 con 0x7fa2980ae910 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa29d4a3640 1 -- 172.21.15.79:0/2910997745 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29400b2d0 con 0x7fa2980ae910 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa29d4a3640 1 -- 172.21.15.79:0/2910997745 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29400b480 con 0x7fa2980ae910 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa2a0709640 1 -- 172.21.15.79:0/2910997745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980ae910 msgr2=0x7fa29806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa2a0709640 1 --2- 172.21.15.79:0/2910997745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980ae910 0x7fa29806e4e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa29400d180 tx=0x7fa29402c870 comp rx=0 tx=0).stop 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa2a0709640 1 -- 172.21.15.79:0/2910997745 shutdown_connections 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa2a0709640 1 --2- 172.21.15.79:0/2910997745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa29806ea20 0x7fa2980cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa2a0709640 1 --2- 172.21.15.79:0/2910997745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980ae910 0x7fa29806e4e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa2a0709640 1 -- 172.21.15.79:0/2910997745 >> 172.21.15.79:0/2910997745 conn(0x7fa2980b19f0 msgr2=0x7fa2980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa2a0709640 1 -- 172.21.15.79:0/2910997745 shutdown_connections 2024-06-10T00:15:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.307+0000 7fa2a0709640 1 -- 172.21.15.79:0/2910997745 wait complete. 2024-06-10T00:15:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.308+0000 7fa2a0709640 1 Processor -- start 2024-06-10T00:15:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.308+0000 7fa2a0709640 1 -- start start 2024-06-10T00:15:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa2a0709640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29806ea20 0x7fa298148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa2a0709640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2980ae910 0x7fa298145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa2a0709640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980cf190 0x7fa29809c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa2a0709640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2980aecf0 con 0x7fa2980cf190 2024-06-10T00:15:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa2a0709640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa29806d9d0 con 0x7fa29806ea20 2024-06-10T00:15:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa2a0709640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2980add50 con 0x7fa2980ae910 2024-06-10T00:15:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29eca6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980cf190 0x7fa29809c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29eca6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980cf190 0x7fa29809c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46028/0 (socket says 172.21.15.79:46028) 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29eca6640 1 -- 172.21.15.79:0/3191393150 learned_addr learned my addr 172.21.15.79:0/3191393150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29e4a5640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29806ea20 0x7fa298148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29dca4640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2980ae910 0x7fa298145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29eca6640 1 -- 172.21.15.79:0/3191393150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2980ae910 msgr2=0x7fa298145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29eca6640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2980ae910 0x7fa298145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29eca6640 1 -- 172.21.15.79:0/3191393150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29806ea20 msgr2=0x7fa298148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29eca6640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29806ea20 0x7fa298148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.309+0000 7fa29eca6640 1 -- 172.21.15.79:0/3191393150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29814b8c0 con 0x7fa2980cf190 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.310+0000 7fa29eca6640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980cf190 0x7fa29809c6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa29000c390 tx=0x7fa29000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.310+0000 7fa28effd640 1 -- 172.21.15.79:0/3191393150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa290017070 con 0x7fa2980cf190 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.310+0000 7fa28effd640 1 -- 172.21.15.79:0/3191393150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2900035f0 con 0x7fa2980cf190 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.310+0000 7fa28effd640 1 -- 172.21.15.79:0/3191393150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa290003a20 con 0x7fa2980cf190 2024-06-10T00:15:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.310+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29809cc10 con 0x7fa2980cf190 2024-06-10T00:15:23.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.310+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29809d1c0 con 0x7fa2980cf190 2024-06-10T00:15:23.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.311+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa298068430 con 0x7fa2980cf190 2024-06-10T00:15:23.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.311+0000 7fa28effd640 1 -- 172.21.15.79:0/3191393150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa29001a070 con 0x7fa2980cf190 2024-06-10T00:15:23.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.312+0000 7fa28effd640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa27c06be30 0x7fa27c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.312+0000 7fa28effd640 1 -- 172.21.15.79:0/3191393150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa29008a490 con 0x7fa2980cf190 2024-06-10T00:15:23.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.312+0000 7fa29e4a5640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa27c06be30 0x7fa27c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.312+0000 7fa29e4a5640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa27c06be30 0x7fa27c06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa294036000 tx=0x7fa29400b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:23.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.316+0000 7fa28effd640 1 -- 172.21.15.79:0/3191393150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa290058540 con 0x7fa2980cf190 2024-06-10T00:15:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.500+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2980b17b0 con 0x7fa2980cf190 2024-06-10T00:15:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.500+0000 7fa28effd640 1 -- 172.21.15.79:0/3191393150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fa29005c840 con 0x7fa2980cf190 2024-06-10T00:15:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa27c06be30 msgr2=0x7fa27c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa27c06be30 0x7fa27c06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa294036000 tx=0x7fa29400b000 comp rx=0 tx=0).stop 2024-06-10T00:15:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980cf190 msgr2=0x7fa29809c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980cf190 0x7fa29809c6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa29000c390 tx=0x7fa29000c850 comp rx=0 tx=0).stop 2024-06-10T00:15:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 shutdown_connections 2024-06-10T00:15:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa27c06be30 0x7fa27c06e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2980cf190 0x7fa29809c6d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2980ae910 0x7fa298145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 --2- 172.21.15.79:0/3191393150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29806ea20 0x7fa298148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 >> 172.21.15.79:0/3191393150 conn(0x7fa2980b19f0 msgr2=0x7fa298159500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:23.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 shutdown_connections 2024-06-10T00:15:23.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.502+0000 7fa2a0709640 1 -- 172.21.15.79:0/3191393150 wait complete. 2024-06-10T00:15:23.514 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:15:23.514 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:23.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:23.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.669+0000 7f6188196640 1 Processor -- start 2024-06-10T00:15:23.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.669+0000 7f6188196640 1 -- start start 2024-06-10T00:15:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6188196640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61801553c0 0x7f61800cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6188196640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61800cec50 0x7f61800cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6188196640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61800b31a0 con 0x7f61800b2cf0 2024-06-10T00:15:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6188196640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f61800b3420 con 0x7f61801553c0 2024-06-10T00:15:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6188196640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f61800cc750 con 0x7f61800cec50 2024-06-10T00:15:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6185f32640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61801553c0 0x7f61800cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6185731640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f61800b2cf0 0x7f618015beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58864/0 (socket says 172.21.15.79:58864) 2024-06-10T00:15:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6185731640 1 -- 172.21.15.79:0/2924305872 learned_addr learned my addr 172.21.15.79:0/2924305872 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6186733640 1 --2- 172.21.15.79:0/2924305872 >> v2:172.21.15.117:3300/0 conn(0x7f61800cec50 0x7f61800cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6185f32640 1 -- 172.21.15.79:0/2924305872 >> v2:172.21.15.117:3300/0 conn(0x7f61800cec50 msgr2=0x7f61800cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6185f32640 1 --2- 172.21.15.79:0/2924305872 >> v2:172.21.15.117:3300/0 conn(0x7f61800cec50 0x7f61800cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6185f32640 1 -- 172.21.15.79:0/2924305872 >> v1:172.21.15.79:6789/0 conn(0x7f61800b2cf0 legacy=0x7f618015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6185f32640 1 -- 172.21.15.79:0/2924305872 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61800cca30 con 0x7f61801553c0 2024-06-10T00:15:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6184f30640 1 -- 172.21.15.79:0/2924305872 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114644932 0 0) 0x7f6170001110 con 0x7f61800b2cf0 2024-06-10T00:15:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6185f32640 1 --2- 172.21.15.79:0/2924305872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61801553c0 0x7f61800cd230 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097a0 tx=0x7f617c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6456c4b9e7c17949 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6184f30640 1 -- 172.21.15.79:0/2924305872 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c037070 con 0x7f61801553c0 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6184f30640 1 -- 172.21.15.79:0/2924305872 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c032440 con 0x7f61801553c0 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.671+0000 7f6184f30640 1 -- 172.21.15.79:0/2924305872 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c032810 con 0x7f61801553c0 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.672+0000 7f6188196640 1 -- 172.21.15.79:0/2924305872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61801553c0 msgr2=0x7f61800cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.672+0000 7f6188196640 1 --2- 172.21.15.79:0/2924305872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61801553c0 0x7f61800cd230 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097a0 tx=0x7f617c02a1e0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.672+0000 7f6188196640 1 -- 172.21.15.79:0/2924305872 shutdown_connections 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.672+0000 7f6188196640 1 --2- 172.21.15.79:0/2924305872 >> v2:172.21.15.117:3300/0 conn(0x7f61800cec50 0x7f61800cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.672+0000 7f6188196640 1 --2- 172.21.15.79:0/2924305872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61801553c0 0x7f61800cd230 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.672+0000 7f6188196640 1 -- 172.21.15.79:0/2924305872 >> 172.21.15.79:0/2924305872 conn(0x7f61800b19f0 msgr2=0x7f61800b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.672+0000 7f6188196640 1 -- 172.21.15.79:0/2924305872 shutdown_connections 2024-06-10T00:15:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.672+0000 7f6188196640 1 -- 172.21.15.79:0/2924305872 wait complete. 2024-06-10T00:15:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.673+0000 7f6188196640 1 Processor -- start 2024-06-10T00:15:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.673+0000 7f6188196640 1 -- start start 2024-06-10T00:15:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6188196640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800b2cf0 0x7f61801467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6188196640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61800cec50 0x7f618009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6188196640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61801553c0 0x7f6180146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6188196640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61801557a0 con 0x7f61800b2cf0 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6188196640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61800b3700 con 0x7f61800cec50 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6188196640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6180155920 con 0x7f61801553c0 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800b2cf0 0x7f61801467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800b2cf0 0x7f61801467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46052/0 (socket says 172.21.15.79:46052) 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 -- 172.21.15.79:0/3311685497 learned_addr learned my addr 172.21.15.79:0/3311685497 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 -- 172.21.15.79:0/3311685497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61801553c0 msgr2=0x7f6180146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61801553c0 0x7f6180146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 -- 172.21.15.79:0/3311685497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61800cec50 msgr2=0x7f618009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61800cec50 0x7f618009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 -- 172.21.15.79:0/3311685497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618015d5b0 con 0x7f61800b2cf0 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6185f32640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800b2cf0 0x7f61801467c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f617c0098c0 tx=0x7f617c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f61767fc640 1 -- 172.21.15.79:0/3311685497 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c037040 con 0x7f61800b2cf0 2024-06-10T00:15:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f61767fc640 1 -- 172.21.15.79:0/3311685497 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c030770 con 0x7f61800b2cf0 2024-06-10T00:15:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618015d890 con 0x7f61800b2cf0 2024-06-10T00:15:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f61767fc640 1 -- 172.21.15.79:0/3311685497 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c030b40 con 0x7f61800b2cf0 2024-06-10T00:15:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.674+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618015de50 con 0x7f61800b2cf0 2024-06-10T00:15:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.676+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6180068430 con 0x7f61800b2cf0 2024-06-10T00:15:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.676+0000 7f61767fc640 1 -- 172.21.15.79:0/3311685497 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f617c044020 con 0x7f61800b2cf0 2024-06-10T00:15:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.676+0000 7f61767fc640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f616406be30 0x7f616406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.676+0000 7f61767fc640 1 -- 172.21.15.79:0/3311685497 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f617c0ab720 con 0x7f61800b2cf0 2024-06-10T00:15:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.676+0000 7f6185731640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f616406be30 0x7f616406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.677+0000 7f6185731640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f616406be30 0x7f616406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61800acf60 tx=0x7f6170001310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:23.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.681+0000 7f61767fc640 1 -- 172.21.15.79:0/3311685497 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f617c032e20 con 0x7f61800b2cf0 2024-06-10T00:15:23.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.866+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f618006e6d0 con 0x7f61800b2cf0 2024-06-10T00:15:23.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.866+0000 7f61767fc640 1 -- 172.21.15.79:0/3311685497 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f617c0313a0 con 0x7f61800b2cf0 2024-06-10T00:15:23.867 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:23.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f616406be30 msgr2=0x7f616406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f616406be30 0x7f616406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61800acf60 tx=0x7f6170001310 comp rx=0 tx=0).stop 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800b2cf0 msgr2=0x7f61801467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800b2cf0 0x7f61801467c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f617c0098c0 tx=0x7f617c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 shutdown_connections 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f616406be30 0x7f616406e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61801553c0 0x7f6180146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61800cec50 0x7f618009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 --2- 172.21.15.79:0/3311685497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800b2cf0 0x7f61801467c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.868+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 >> 172.21.15.79:0/3311685497 conn(0x7f61800b19f0 msgr2=0x7f61800b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.869+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 shutdown_connections 2024-06-10T00:15:23.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:23.869+0000 7f6188196640 1 -- 172.21.15.79:0/3311685497 wait complete. 2024-06-10T00:15:23.880 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:15:23.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:23.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-06-10T00:15:23.906 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:23.906 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:15:23.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:23.906 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-10T00:15:23.962 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:15:23.962 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:23.982 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:15:23.982 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:24.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.140+0000 7fce12953640 1 Processor -- start 2024-06-10T00:15:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.140+0000 7fce12953640 1 -- start start 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce12953640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce0c0ca770 0x7fce0c161d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce12953640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c0714a0 con 0x7fce0c1617f0 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce12953640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c0ccba0 con 0x7fce0c162270 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce12953640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fce0c1626e0 con 0x7fce0c0ca770 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce0b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce0c0ca770 0x7fce0c161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce0bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fce0c1617f0 0x7fce0c06ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58876/0 (socket says 172.21.15.79:58876) 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce0bfff640 1 -- 172.21.15.79:0/2402002493 learned_addr learned my addr 172.21.15.79:0/2402002493 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce0b7fe640 1 -- 172.21.15.79:0/2402002493 >> v1:172.21.15.117:6789/0 conn(0x7fce0c162270 legacy=0x7fce0c0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce0b7fe640 1 -- 172.21.15.79:0/2402002493 >> v1:172.21.15.79:6789/0 conn(0x7fce0c1617f0 legacy=0x7fce0c06ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce0affd640 1 -- 172.21.15.79:0/2402002493 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222217581 0 0) 0x7fce0c0714a0 con 0x7fce0c1617f0 2024-06-10T00:15:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.141+0000 7fce0b7fe640 1 -- 172.21.15.79:0/2402002493 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c0cce80 con 0x7fce0c0ca770 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce0b7fe640 1 --2- 172.21.15.79:0/2402002493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c0ca770 0x7fce0c161d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0097a0 tx=0x7fcdfc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17ac271defff251 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce0affd640 1 -- 172.21.15.79:0/2402002493 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc037070 con 0x7fce0c0ca770 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce0affd640 1 -- 172.21.15.79:0/2402002493 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc02ae50 con 0x7fce0c0ca770 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce0affd640 1 -- 172.21.15.79:0/2402002493 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc032660 con 0x7fce0c0ca770 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce12953640 1 -- 172.21.15.79:0/2402002493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c0ca770 msgr2=0x7fce0c161d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce12953640 1 --2- 172.21.15.79:0/2402002493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c0ca770 0x7fce0c161d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0097a0 tx=0x7fcdfc02a140 comp rx=0 tx=0).stop 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce12953640 1 -- 172.21.15.79:0/2402002493 shutdown_connections 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce12953640 1 --2- 172.21.15.79:0/2402002493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c0ca770 0x7fce0c161d30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce12953640 1 -- 172.21.15.79:0/2402002493 >> 172.21.15.79:0/2402002493 conn(0x7fce0c0b1bb0 msgr2=0x7fce0c0b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce12953640 1 -- 172.21.15.79:0/2402002493 shutdown_connections 2024-06-10T00:15:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.142+0000 7fce12953640 1 -- 172.21.15.79:0/2402002493 wait complete. 2024-06-10T00:15:24.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.144+0000 7fce12953640 1 Processor -- start 2024-06-10T00:15:24.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.144+0000 7fce12953640 1 -- start start 2024-06-10T00:15:24.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce12953640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0ca770 0x7fce0c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce12953640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c1617f0 0x7fce0c0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce12953640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c162270 0x7fce0c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce12953640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c0720b0 con 0x7fce0c162270 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce12953640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c0cd440 con 0x7fce0c0ca770 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce12953640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce0c072230 con 0x7fce0c1617f0 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c162270 0x7fce0c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c162270 0x7fce0c0ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46074/0 (socket says 172.21.15.79:46074) 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 -- 172.21.15.79:0/172839844 learned_addr learned my addr 172.21.15.79:0/172839844 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce0b7fe640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c1617f0 0x7fce0c0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce0bfff640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0ca770 0x7fce0c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 -- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c1617f0 msgr2=0x7fce0c0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c1617f0 0x7fce0c0c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 -- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0ca770 msgr2=0x7fce0c0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0ca770 0x7fce0c0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 -- 172.21.15.79:0/172839844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c0b51b0 con 0x7fce0c162270 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce0b7fe640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c1617f0 0x7fce0c0c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce0bfff640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0ca770 0x7fce0c0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce10ef0640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c162270 0x7fce0c0ae2c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fce0400b990 tx=0x7fce0400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce08ff9640 1 -- 172.21.15.79:0/172839844 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04019070 con 0x7fce0c162270 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce08ff9640 1 -- 172.21.15.79:0/172839844 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0400cba0 con 0x7fce0c162270 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0c0b5490 con 0x7fce0c162270 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce08ff9640 1 -- 172.21.15.79:0/172839844 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04014440 con 0x7fce0c162270 2024-06-10T00:15:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.145+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0c0b5a50 con 0x7fce0c162270 2024-06-10T00:15:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.146+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0c068430 con 0x7fce0c162270 2024-06-10T00:15:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.147+0000 7fce08ff9640 1 -- 172.21.15.79:0/172839844 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce0401c070 con 0x7fce0c162270 2024-06-10T00:15:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.147+0000 7fce08ff9640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcdec06be30 0x7fcdec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.147+0000 7fce08ff9640 1 -- 172.21.15.79:0/172839844 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7fce0408b000 con 0x7fce0c162270 2024-06-10T00:15:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.147+0000 7fce0bfff640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcdec06be30 0x7fcdec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.148+0000 7fce0bfff640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcdec06be30 0x7fcdec06e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4000f60 tx=0x7fcdf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.152+0000 7fce08ff9640 1 -- 172.21.15.79:0/172839844 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fce040595b0 con 0x7fce0c162270 2024-06-10T00:15:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.338+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fce0c06e890 con 0x7fce0c162270 2024-06-10T00:15:24.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.338+0000 7fce08ff9640 1 -- 172.21.15.79:0/172839844 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fce04058eb0 con 0x7fce0c162270 2024-06-10T00:15:24.339 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:24.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcdec06be30 msgr2=0x7fcdec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcdec06be30 0x7fcdec06e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4000f60 tx=0x7fcdf4009040 comp rx=0 tx=0).stop 2024-06-10T00:15:24.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c162270 msgr2=0x7fce0c0ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c162270 0x7fce0c0ae2c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fce0400b990 tx=0x7fce0400be50 comp rx=0 tx=0).stop 2024-06-10T00:15:24.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 shutdown_connections 2024-06-10T00:15:24.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcdec06be30 0x7fcdec06e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce0c162270 0x7fce0c0ae2c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c1617f0 0x7fce0c0c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 --2- 172.21.15.79:0/172839844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0ca770 0x7fce0c0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 >> 172.21.15.79:0/172839844 conn(0x7fce0c0b1bb0 msgr2=0x7fce0c0af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:24.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 shutdown_connections 2024-06-10T00:15:24.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.340+0000 7fce12953640 1 -- 172.21.15.79:0/172839844 wait complete. 2024-06-10T00:15:24.352 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:15:24.352 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:24.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.471+0000 7feb1542a640 1 Processor -- start 2024-06-10T00:15:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.471+0000 7feb1542a640 1 -- start start 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.471+0000 7feb1542a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 0x7feb100cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.471+0000 7feb1542a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1015f5e0 con 0x7feb1015f1a0 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.471+0000 7feb1542a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb100d2450 con 0x7feb100d2680 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.471+0000 7feb1542a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb100d13e0 con 0x7feb100d1fc0 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0e7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feb1015f1a0 0x7feb100cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58878/0 (socket says 172.21.15.79:58878) 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0e7fc640 1 -- 172.21.15.79:0/3493968700 learned_addr learned my addr 172.21.15.79:0/3493968700 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0f7fe640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 0x7feb100cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916874528 0 0) 0x7feb1015f5e0 con 0x7feb1015f1a0 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaf8003520 con 0x7feb1015f1a0 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1747643406 0 0) 0x7feaf8003520 con 0x7feb1015f1a0 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 msgr2=0x7feb100cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 0x7feb100cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 >> v1:172.21.15.117:6789/0 conn(0x7feb100d2680 legacy=0x7feb100d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb100d0ad0 con 0x7feb1015f1a0 2024-06-10T00:15:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7feb04001670 con 0x7feb1015f1a0 2024-06-10T00:15:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 >> v1:172.21.15.79:6789/0 conn(0x7feb1015f1a0 legacy=0x7feb100cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feaf8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf8004800 0x7feaf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 0x7feaf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb100d13e0 con 0x7feaf80039e0 2024-06-10T00:15:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feaf800ba70 con 0x7feaf8004800 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feaf800bc70 con 0x7feb100d1fc0 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0effd640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feaf8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0e7fc640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf8004800 0x7feaf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0f7fe640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 0x7feaf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0effd640 1 -- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 msgr2=0x7feaf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0effd640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 0x7feaf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0effd640 1 -- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf8004800 msgr2=0x7feaf8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.472+0000 7feb0effd640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf8004800 0x7feaf8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.473+0000 7feb0effd640 1 -- 172.21.15.79:0/3493968700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf8003520 con 0x7feaf80039e0 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.473+0000 7feb0f7fe640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100d1fc0 0x7feaf80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.473+0000 7feb0e7fc640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf8004800 0x7feaf8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.473+0000 7feb0effd640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feaf8003e00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feb00001720 tx=0x7feaf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c956cea79fc15c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.473+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00001370 con 0x7feaf80039e0 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.473+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb000052d0 con 0x7feaf80039e0 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.473+0000 7feb0dffb640 1 -- 172.21.15.79:0/3493968700 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0002ab90 con 0x7feaf80039e0 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.474+0000 7feb1542a640 1 -- 172.21.15.79:0/3493968700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 msgr2=0x7feaf8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.474+0000 7feb1542a640 1 --2- 172.21.15.79:0/3493968700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feaf8003e00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feb00001720 tx=0x7feaf8005830 comp rx=0 tx=0).stop 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.474+0000 7feb0f7fe640 1 -- 172.21.15.79:0/3493968700 reap_dead start 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.474+0000 7feb1542a640 1 -- 172.21.15.79:0/3493968700 shutdown_connections 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.474+0000 7feb1542a640 1 -- 172.21.15.79:0/3493968700 >> 172.21.15.79:0/3493968700 conn(0x7feb1009d3f0 msgr2=0x7feb100d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.474+0000 7feb1542a640 1 -- 172.21.15.79:0/3493968700 shutdown_connections 2024-06-10T00:15:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.474+0000 7feb1542a640 1 -- 172.21.15.79:0/3493968700 wait complete. 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.475+0000 7feb1542a640 1 Processor -- start 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.475+0000 7feb1542a640 1 -- start start 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb1542a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feb100b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb1542a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100b8530 0x7feb100cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb1542a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100cd780 0x7feb1015c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb1542a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb100d1070 con 0x7feaf80039e0 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb1542a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feb100d0d90 con 0x7feb100cd780 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb1542a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb100d4f00 con 0x7feb100b8530 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feb100b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feb100b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46106/0 (socket says 172.21.15.79:46106) 2024-06-10T00:15:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 -- 172.21.15.79:0/1603758341 learned_addr learned my addr 172.21.15.79:0/1603758341 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0f7fe640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100cd780 0x7feb1015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0e7fc640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100b8530 0x7feb100cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 -- 172.21.15.79:0/1603758341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100b8530 msgr2=0x7feb100cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100b8530 0x7feb100cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 -- 172.21.15.79:0/1603758341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100cd780 msgr2=0x7feb1015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100cd780 0x7feb1015c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 -- 172.21.15.79:0/1603758341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1015b2d0 con 0x7feaf80039e0 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.476+0000 7feb0effd640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feb100b99f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb00001840 tx=0x7feb00001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.477+0000 7feaf77fe640 1 -- 172.21.15.79:0/1603758341 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00042070 con 0x7feaf80039e0 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.477+0000 7feaf77fe640 1 -- 172.21.15.79:0/1603758341 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb00005480 con 0x7feaf80039e0 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.477+0000 7feaf77fe640 1 -- 172.21.15.79:0/1603758341 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00037040 con 0x7feaf80039e0 2024-06-10T00:15:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.477+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb100b9340 con 0x7feaf80039e0 2024-06-10T00:15:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.477+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb1015af80 con 0x7feaf80039e0 2024-06-10T00:15:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.478+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb10068430 con 0x7feaf80039e0 2024-06-10T00:15:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.478+0000 7feaf77fe640 1 -- 172.21.15.79:0/1603758341 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb00045070 con 0x7feaf80039e0 2024-06-10T00:15:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.479+0000 7feaf77fe640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feafc06be60 0x7feafc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.479+0000 7feaf77fe640 1 -- 172.21.15.79:0/1603758341 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7feb000aa9c0 con 0x7feaf80039e0 2024-06-10T00:15:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.479+0000 7feb0e7fc640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feafc06be60 0x7feafc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.479+0000 7feb0e7fc640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feafc06be60 0x7feafc06e320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb04001bf0 tx=0x7feb04001b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.484+0000 7feaf77fe640 1 -- 172.21.15.79:0/1603758341 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7feb000ace20 con 0x7feaf80039e0 2024-06-10T00:15:24.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.668+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feb100d04e0 con 0x7feaf80039e0 2024-06-10T00:15:24.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.669+0000 7feaf77fe640 1 -- 172.21.15.79:0/1603758341 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7feb00079000 con 0x7feaf80039e0 2024-06-10T00:15:24.668 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:24.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feafc06be60 msgr2=0x7feafc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feafc06be60 0x7feafc06e320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb04001bf0 tx=0x7feb04001b80 comp rx=0 tx=0).stop 2024-06-10T00:15:24.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 msgr2=0x7feb100b99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feb100b99f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb00001840 tx=0x7feb00001120 comp rx=0 tx=0).stop 2024-06-10T00:15:24.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 shutdown_connections 2024-06-10T00:15:24.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feafc06be60 0x7feafc06e320 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100cd780 0x7feb1015c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100b8530 0x7feb100cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 --2- 172.21.15.79:0/1603758341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80039e0 0x7feb100b99f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 >> 172.21.15.79:0/1603758341 conn(0x7feb1009d3f0 msgr2=0x7feb10161480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:24.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 shutdown_connections 2024-06-10T00:15:24.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.671+0000 7feb1542a640 1 -- 172.21.15.79:0/1603758341 wait complete. 2024-06-10T00:15:24.682 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-06-10T00:15:24.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:24.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-06-10T00:15:24.713 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:24.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:15:24.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:24.713 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-10T00:15:24.771 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-10T00:15:24.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.872+0000 7f1b06d4f640 1 Processor -- start 2024-06-10T00:15:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.872+0000 7f1b06d4f640 1 -- start start 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b06d4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0006d9b0 0x7f1b000cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b06d4f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b0015d8b0 0x7f1b0015dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b06d4f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b0006deb0 con 0x7f1b0015c240 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b06d4f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0015d630 con 0x7f1b0015d8b0 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b06d4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0006e190 con 0x7f1b0006d9b0 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b052ec640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b0015d8b0 0x7f1b0015dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b052ec640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b0015d8b0 0x7f1b0015dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46122/0 (socket says 172.21.15.79:46122) 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b052ec640 1 -- 172.21.15.79:0/2088959806 learned_addr learned my addr 172.21.15.79:0/2088959806 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b052ec640 1 -- 172.21.15.79:0/2088959806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0006d9b0 msgr2=0x7f1b000cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b052ec640 1 --2- 172.21.15.79:0/2088959806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0006d9b0 0x7f1b000cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b052ec640 1 -- 172.21.15.79:0/2088959806 >> v1:172.21.15.117:6789/0 conn(0x7f1b0015c240 legacy=0x7f1b0006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.873+0000 7f1b052ec640 1 -- 172.21.15.79:0/2088959806 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0006e470 con 0x7f1b0015d8b0 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b052ec640 1 --2- 172.21.15.79:0/2088959806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d8b0 0x7f1b0015dd00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009e50 tx=0x7f1af802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c16096dc53316cb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1aff7fe640 1 -- 172.21.15.79:0/2088959806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8036070 con 0x7f1b0015d8b0 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1aff7fe640 1 -- 172.21.15.79:0/2088959806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af8031600 con 0x7f1b0015d8b0 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1aff7fe640 1 -- 172.21.15.79:0/2088959806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af80319d0 con 0x7f1b0015d8b0 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b06d4f640 1 -- 172.21.15.79:0/2088959806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d8b0 msgr2=0x7f1b0015dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/2088959806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d8b0 0x7f1b0015dd00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009e50 tx=0x7f1af802a6c0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b06d4f640 1 -- 172.21.15.79:0/2088959806 shutdown_connections 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/2088959806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d8b0 0x7f1b0015dd00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/2088959806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0006d9b0 0x7f1b000cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b06d4f640 1 -- 172.21.15.79:0/2088959806 >> 172.21.15.79:0/2088959806 conn(0x7f1b00071950 msgr2=0x7f1b00071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b06d4f640 1 -- 172.21.15.79:0/2088959806 shutdown_connections 2024-06-10T00:15:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.874+0000 7f1b06d4f640 1 -- 172.21.15.79:0/2088959806 wait complete. 2024-06-10T00:15:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.876+0000 7f1b06d4f640 1 Processor -- start 2024-06-10T00:15:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.876+0000 7f1b06d4f640 1 -- start start 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.876+0000 7f1b06d4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006d9b0 0x7f1b000b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.876+0000 7f1b06d4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0015c240 0x7f1b00153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.876+0000 7f1b06d4f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0015d8b0 0x7f1b00154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b06d4f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b000aff60 con 0x7f1b0006d9b0 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b06d4f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0006ea30 con 0x7f1b0015d8b0 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b06d4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0006f660 con 0x7f1b0015c240 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006d9b0 0x7f1b000b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006d9b0 0x7f1b000b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46134/0 (socket says 172.21.15.79:46134) 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 -- 172.21.15.79:0/1474525826 learned_addr learned my addr 172.21.15.79:0/1474525826 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1afffff640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0015c240 0x7f1b00153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b052ec640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0015d8b0 0x7f1b00154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 -- 172.21.15.79:0/1474525826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0015c240 msgr2=0x7f1b00153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0015c240 0x7f1b00153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 -- 172.21.15.79:0/1474525826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0015d8b0 msgr2=0x7f1b00154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0015d8b0 0x7f1b00154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 -- 172.21.15.79:0/1474525826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b000b0910 con 0x7f1b0006d9b0 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b04aeb640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006d9b0 0x7f1b000b00e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c440 tx=0x7f1af400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1afd7fa640 1 -- 172.21.15.79:0/1474525826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4017070 con 0x7f1b0006d9b0 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1afd7fa640 1 -- 172.21.15.79:0/1474525826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af40035f0 con 0x7f1b0006d9b0 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1afd7fa640 1 -- 172.21.15.79:0/1474525826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af40039e0 con 0x7f1b0006d9b0 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b000b0bf0 con 0x7f1b0006d9b0 2024-06-10T00:15:24.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.877+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b000b11b0 con 0x7f1b0006d9b0 2024-06-10T00:15:24.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.878+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0015dd00 con 0x7f1b0006d9b0 2024-06-10T00:15:24.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.879+0000 7f1afd7fa640 1 -- 172.21.15.79:0/1474525826 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1af401a070 con 0x7f1b0006d9b0 2024-06-10T00:15:24.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.879+0000 7f1afd7fa640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ae406be30 0x7f1ae406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:24.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.879+0000 7f1afffff640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ae406be30 0x7f1ae406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:24.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.879+0000 7f1afd7fa640 1 -- 172.21.15.79:0/1474525826 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f1af408a570 con 0x7f1b0006d9b0 2024-06-10T00:15:24.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.880+0000 7f1afffff640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ae406be30 0x7f1ae406e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b001f53f0 tx=0x7f1aec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:24.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:24.884+0000 7f1afd7fa640 1 -- 172.21.15.79:0/1474525826 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1b0015dd00 con 0x7f1b0006d9b0 2024-06-10T00:15:25.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.106+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b00068430 con 0x7f1b0006d9b0 2024-06-10T00:15:25.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.107+0000 7f1afd7fa640 1 -- 172.21.15.79:0/1474525826 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7f1af4058bb0 con 0x7f1b0006d9b0 2024-06-10T00:15:25.107 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:25.107 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:15:01.280562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:15:25.107 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-06-10T00:15:25.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ae406be30 msgr2=0x7f1ae406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ae406be30 0x7f1ae406e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b001f53f0 tx=0x7f1aec008040 comp rx=0 tx=0).stop 2024-06-10T00:15:25.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006d9b0 msgr2=0x7f1b000b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006d9b0 0x7f1b000b00e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c440 tx=0x7f1af400c900 comp rx=0 tx=0).stop 2024-06-10T00:15:25.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 shutdown_connections 2024-06-10T00:15:25.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ae406be30 0x7f1ae406e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0015d8b0 0x7f1b00154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0015c240 0x7f1b00153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 --2- 172.21.15.79:0/1474525826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006d9b0 0x7f1b000b00e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 >> 172.21.15.79:0/1474525826 conn(0x7f1b00071950 msgr2=0x7f1b00150030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:25.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 shutdown_connections 2024-06-10T00:15:25.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.109+0000 7f1b06d4f640 1 -- 172.21.15.79:0/1474525826 wait complete. 2024-06-10T00:15:25.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:25.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.219+0000 7f2f07942640 1 Processor -- start 2024-06-10T00:15:25.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.220+0000 7f2f07942640 1 -- start start 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.220+0000 7f2f07942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f000d1fc0 0x7f2f000cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.220+0000 7f2f07942640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f0015f5e0 con 0x7f2f000d2680 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.220+0000 7f2f07942640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f000d2450 con 0x7f2f0015f1a0 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.220+0000 7f2f07942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2f000d13e0 con 0x7f2f000d1fc0 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.220+0000 7f2f056de640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2f000d2680 0x7f2f000d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58884/0 (socket says 172.21.15.79:58884) 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.220+0000 7f2f056de640 1 -- 172.21.15.79:0/1393404514 learned_addr learned my addr 172.21.15.79:0/1393404514 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285920991 0 0) 0x7f2f0015f5e0 con 0x7f2f000d2680 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eec003520 con 0x7f2f000d2680 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2f05edf640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f000d1fc0 0x7f2f000cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3265147475 0 0) 0x7f2eec003520 con 0x7f2f000d2680 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f000d1fc0 msgr2=0x7f2f000cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f000d1fc0 0x7f2f000cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 >> v1:172.21.15.117:6789/0 conn(0x7f2f0015f1a0 legacy=0x7f2f000cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f000d0ad0 con 0x7f2f000d2680 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f2efc001670 con 0x7f2f000d2680 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 >> v1:172.21.15.79:6789/0 conn(0x7f2f000d2680 legacy=0x7f2f000d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f000d1fc0 0x7f2eec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2eec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eec004d40 0x7f2eec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000d13e0 con 0x7f2eec003fb0 2024-06-10T00:15:25.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00bb00 con 0x7f2eec004d40 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2eec00bd00 con 0x7f2f000d1fc0 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2f04edd640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2eec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2f056de640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f000d1fc0 0x7f2eec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.221+0000 7f2f05edf640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eec004d40 0x7f2eec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2f04edd640 1 -- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f000d1fc0 msgr2=0x7f2eec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2f04edd640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f000d1fc0 0x7f2eec0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2f04edd640 1 -- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eec004d40 msgr2=0x7f2eec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2f04edd640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eec004d40 0x7f2eec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2f04edd640 1 -- 172.21.15.79:0/1393404514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eec003520 con 0x7f2eec003fb0 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2f04edd640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2eec004800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0001750 tx=0x7f2eec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff99860571f96668 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0001370 con 0x7f2eec003fb0 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef00052d0 con 0x7f2eec003fb0 2024-06-10T00:15:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.222+0000 7f2ef7fff640 1 -- 172.21.15.79:0/1393404514 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef002ab20 con 0x7f2eec003fb0 2024-06-10T00:15:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.223+0000 7f2f07942640 1 -- 172.21.15.79:0/1393404514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 msgr2=0x7f2eec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.223+0000 7f2f07942640 1 --2- 172.21.15.79:0/1393404514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2eec004800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0001750 tx=0x7f2eec005830 comp rx=0 tx=0).stop 2024-06-10T00:15:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.223+0000 7f2f05edf640 1 -- 172.21.15.79:0/1393404514 reap_dead start 2024-06-10T00:15:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.223+0000 7f2f07942640 1 -- 172.21.15.79:0/1393404514 shutdown_connections 2024-06-10T00:15:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.223+0000 7f2f07942640 1 -- 172.21.15.79:0/1393404514 >> 172.21.15.79:0/1393404514 conn(0x7f2f0009d3f0 msgr2=0x7f2f000d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.223+0000 7f2f07942640 1 -- 172.21.15.79:0/1393404514 shutdown_connections 2024-06-10T00:15:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.223+0000 7f2f07942640 1 -- 172.21.15.79:0/1393404514 wait complete. 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.224+0000 7f2f07942640 1 Processor -- start 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.224+0000 7f2f07942640 1 -- start start 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f07942640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2f0015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f07942640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f0015cf60 0x7f2f0015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f07942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0009e370 0x7f2f0009e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f07942640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000d1070 con 0x7f2eec003fb0 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f07942640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000d0d90 con 0x7f2f0015cf60 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f07942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2f000d4f00 con 0x7f2f0009e370 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2f0015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2f0015a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46150/0 (socket says 172.21.15.79:46150) 2024-06-10T00:15:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 -- 172.21.15.79:0/3038482900 learned_addr learned my addr 172.21.15.79:0/3038482900 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f05edf640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0009e370 0x7f2f0009e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f04edd640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f0015cf60 0x7f2f0015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 -- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0009e370 msgr2=0x7f2f0009e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0009e370 0x7f2f0009e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 -- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f0015cf60 msgr2=0x7f2f0015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f0015cf60 0x7f2f0015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 -- 172.21.15.79:0/3038482900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0015a7d0 con 0x7f2eec003fb0 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f05edf640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0009e370 0x7f2f0009e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f04edd640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f0015cf60 0x7f2f0015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f056de640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2f0015a290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0072c0 tx=0x7f2efc007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2ef5ffb640 1 -- 172.21.15.79:0/3038482900 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00f960 con 0x7f2eec003fb0 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2ef5ffb640 1 -- 172.21.15.79:0/3038482900 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2efc018070 con 0x7f2eec003fb0 2024-06-10T00:15:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0009f0a0 con 0x7f2eec003fb0 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.225+0000 7f2ef5ffb640 1 -- 172.21.15.79:0/3038482900 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00fd40 con 0x7f2eec003fb0 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.226+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0009f660 con 0x7f2eec003fb0 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.227+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f00068430 con 0x7f2eec003fb0 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.227+0000 7f2ef5ffb640 1 -- 172.21.15.79:0/3038482900 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2efc01d460 con 0x7f2eec003fb0 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.228+0000 7f2ef5ffb640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ee406be60 0x7f2ee406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.228+0000 7f2f04edd640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ee406be60 0x7f2ee406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.228+0000 7f2ef5ffb640 1 -- 172.21.15.79:0/3038482900 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2efc08b270 con 0x7f2eec003fb0 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.228+0000 7f2f04edd640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ee406be60 0x7f2ee406e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0032000 tx=0x7f2ef002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.232+0000 7f2ef5ffb640 1 -- 172.21.15.79:0/3038482900 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2efc0598b0 con 0x7f2eec003fb0 2024-06-10T00:15:25.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.442+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f000d04e0 con 0x7f2eec003fb0 2024-06-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.442+0000 7f2ef5ffb640 1 -- 172.21.15.79:0/3038482900 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7f2efc0591b0 con 0x7f2eec003fb0 2024-06-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:15:01.280562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-06-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ee406be60 msgr2=0x7f2ee406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ee406be60 0x7f2ee406e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0032000 tx=0x7f2ef002e000 comp rx=0 tx=0).stop 2024-06-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 msgr2=0x7f2f0015a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2f0015a290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0072c0 tx=0x7f2efc007780 comp rx=0 tx=0).stop 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 shutdown_connections 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ee406be60 0x7f2ee406e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0009e370 0x7f2f0009e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f0015cf60 0x7f2f0015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 --2- 172.21.15.79:0/3038482900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eec003fb0 0x7f2f0015a290 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 >> 172.21.15.79:0/3038482900 conn(0x7f2f0009d3f0 msgr2=0x7f2f00161020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 shutdown_connections 2024-06-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.444+0000 7f2f07942640 1 -- 172.21.15.79:0/3038482900 wait complete. 2024-06-10T00:15:25.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:25.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.554+0000 7fb7899e9640 1 Processor -- start 2024-06-10T00:15:25.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.554+0000 7fb7899e9640 1 -- start start 2024-06-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.555+0000 7fb7899e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7840add50 0x7fb784165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.555+0000 7fb7899e9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78406d130 con 0x7fb78406ebf0 2024-06-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.555+0000 7fb7899e9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78406d410 con 0x7fb7840ae910 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.555+0000 7fb7899e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb78406d6f0 con 0x7fb7840add50 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.555+0000 7fb77a7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb78406ebf0 0x7fb7840cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58890/0 (socket says 172.21.15.79:58890) 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.555+0000 7fb77a7fc640 1 -- 172.21.15.79:0/1048117368 learned_addr learned my addr 172.21.15.79:0/1048117368 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.555+0000 7fb7837fe640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7840add50 0x7fb784165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.555+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1424692041 0 0) 0x7fb78406d130 con 0x7fb78406ebf0 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb770003520 con 0x7fb78406ebf0 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3315737944 0 0) 0x7fb770003520 con 0x7fb78406ebf0 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7840add50 msgr2=0x7fb784165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7840add50 0x7fb784165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 >> v1:172.21.15.117:6789/0 conn(0x7fb7840ae910 legacy=0x7fb78406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78406d9d0 con 0x7fb78406ebf0 2024-06-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fb76c001670 con 0x7fb78406ebf0 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 >> v1:172.21.15.79:6789/0 conn(0x7fb78406ebf0 legacy=0x7fb7840cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb770003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb770004390 0x7fb770004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7840add50 0x7fb770005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb78406d6f0 con 0x7fb7700039e0 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb77000baa0 con 0x7fb770004390 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb77000deb0 con 0x7fb7840add50 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb782ffd640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb770003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb77a7fc640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb770004390 0x7fb770004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb7837fe640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7840add50 0x7fb770005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb782ffd640 1 -- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7840add50 msgr2=0x7fb770005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb782ffd640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7840add50 0x7fb770005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb782ffd640 1 -- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb770004390 msgr2=0x7fb770004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb782ffd640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb770004390 0x7fb770004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.556+0000 7fb782ffd640 1 -- 172.21.15.79:0/1048117368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb770003520 con 0x7fb7700039e0 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.557+0000 7fb782ffd640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb770003dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb774001860 tx=0x7fb770005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b29648fe87750b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.557+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774037070 con 0x7fb7700039e0 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.557+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77402ac30 con 0x7fb7700039e0 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.557+0000 7fb7827fc640 1 -- 172.21.15.79:0/1048117368 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774001430 con 0x7fb7700039e0 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.557+0000 7fb7899e9640 1 -- 172.21.15.79:0/1048117368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 msgr2=0x7fb770003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.557+0000 7fb7899e9640 1 --2- 172.21.15.79:0/1048117368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb770003dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb774001860 tx=0x7fb770005830 comp rx=0 tx=0).stop 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.558+0000 7fb7837fe640 1 -- 172.21.15.79:0/1048117368 reap_dead start 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.558+0000 7fb7899e9640 1 -- 172.21.15.79:0/1048117368 shutdown_connections 2024-06-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.558+0000 7fb7899e9640 1 -- 172.21.15.79:0/1048117368 >> 172.21.15.79:0/1048117368 conn(0x7fb7840b19f0 msgr2=0x7fb7840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:25.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.558+0000 7fb7899e9640 1 -- 172.21.15.79:0/1048117368 shutdown_connections 2024-06-10T00:15:25.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.558+0000 7fb7899e9640 1 -- 172.21.15.79:0/1048117368 wait complete. 2024-06-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.559+0000 7fb7899e9640 1 Processor -- start 2024-06-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.559+0000 7fb7899e9640 1 -- start start 2024-06-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb7899e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb78414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb7899e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7840b2ae0 0x7fb7840b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb7899e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb78409aa10 0x7fb78409ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb7899e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840cf4e0 con 0x7fb7700039e0 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb7899e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840cf360 con 0x7fb7840b2ae0 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb7899e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb7840cf660 con 0x7fb78409aa10 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb78414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb78414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46170/0 (socket says 172.21.15.79:46170) 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 -- 172.21.15.79:0/2125572850 learned_addr learned my addr 172.21.15.79:0/2125572850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 -- 172.21.15.79:0/2125572850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb78409aa10 msgr2=0x7fb78409ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb78409aa10 0x7fb78409ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 -- 172.21.15.79:0/2125572850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7840b2ae0 msgr2=0x7fb7840b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7840b2ae0 0x7fb7840b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 -- 172.21.15.79:0/2125572850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7840c9a20 con 0x7fb7700039e0 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb782ffd640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb78414d950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb774001950 tx=0x7fb774001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb780ff9640 1 -- 172.21.15.79:0/2125572850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774040020 con 0x7fb7700039e0 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb780ff9640 1 -- 172.21.15.79:0/2125572850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb774005270 con 0x7fb7700039e0 2024-06-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78409b740 con 0x7fb7700039e0 2024-06-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb780ff9640 1 -- 172.21.15.79:0/2125572850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774037040 con 0x7fb7700039e0 2024-06-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.560+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78409bd00 con 0x7fb7700039e0 2024-06-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.561+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb784068430 con 0x7fb7700039e0 2024-06-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.562+0000 7fb780ff9640 1 -- 172.21.15.79:0/2125572850 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb774043020 con 0x7fb7700039e0 2024-06-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.562+0000 7fb780ff9640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb76406be60 0x7fb76406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.562+0000 7fb780ff9640 1 -- 172.21.15.79:0/2125572850 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb7740ab3e0 con 0x7fb7700039e0 2024-06-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.562+0000 7fb77a7fc640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb76406be60 0x7fb76406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.563+0000 7fb77a7fc640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb76406be60 0x7fb76406e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb76c000f60 tx=0x7fb76c001000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.567+0000 7fb780ff9640 1 -- 172.21.15.79:0/2125572850 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb77404a020 con 0x7fb7700039e0 2024-06-10T00:15:25.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.741+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7840ceed0 con 0x7fb7700039e0 2024-06-10T00:15:25.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.742+0000 7fb780ff9640 1 -- 172.21.15.79:0/2125572850 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18852 (secure 0 0 0) 0x7fb774079a20 con 0x7fb7700039e0 2024-06-10T00:15:25.742 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:25.743 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:15:24.992519+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb76406be60 msgr2=0x7fb76406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb76406be60 0x7fb76406e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb76c000f60 tx=0x7fb76c001000 comp rx=0 tx=0).stop 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 msgr2=0x7fb78414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb78414d950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb774001950 tx=0x7fb774001230 comp rx=0 tx=0).stop 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 shutdown_connections 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb76406be60 0x7fb76406e320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb78409aa10 0x7fb78409ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7840b2ae0 0x7fb7840b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 --2- 172.21.15.79:0/2125572850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7700039e0 0x7fb78414d950 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 >> 172.21.15.79:0/2125572850 conn(0x7fb7840b19f0 msgr2=0x7fb7840725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:25.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 shutdown_connections 2024-06-10T00:15:25.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.745+0000 7fb7899e9640 1 -- 172.21.15.79:0/2125572850 wait complete. 2024-06-10T00:15:25.756 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:15:25.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:25.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.855+0000 7f6140cba640 1 Processor -- start 2024-06-10T00:15:25.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.855+0000 7f6140cba640 1 -- start start 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.855+0000 7f6140cba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f613c0d2680 0x7f613c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.855+0000 7f6140cba640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f613c0d1fc0 0x7f613c0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.855+0000 7f6140cba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c0d2fa0 con 0x7f613c161fa0 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f6140cba640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f613c0cff80 con 0x7f613c0d2680 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f6140cba640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f613c0d13e0 con 0x7f613c0d1fc0 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f613a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f613c0d2680 0x7f613c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f613ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f613c161fa0 0x7f613c1623d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58902/0 (socket says 172.21.15.79:58902) 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f613ad9d640 1 -- 172.21.15.79:0/1853484127 learned_addr learned my addr 172.21.15.79:0/1853484127 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f6133fff640 1 --2- 172.21.15.79:0/1853484127 >> v2:172.21.15.117:3300/0 conn(0x7f613c0d1fc0 0x7f613c0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f613a59c640 1 -- 172.21.15.79:0/1853484127 >> v2:172.21.15.117:3300/0 conn(0x7f613c0d1fc0 msgr2=0x7f613c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f613a59c640 1 --2- 172.21.15.79:0/1853484127 >> v2:172.21.15.117:3300/0 conn(0x7f613c0d1fc0 0x7f613c0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f613a59c640 1 -- 172.21.15.79:0/1853484127 >> v1:172.21.15.79:6789/0 conn(0x7f613c161fa0 legacy=0x7f613c1623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.856+0000 7f613a59c640 1 -- 172.21.15.79:0/1853484127 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c0d0ad0 con 0x7f613c0d2680 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f613a59c640 1 --2- 172.21.15.79:0/1853484127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c15f1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f613c0c7960 tx=0x7f612c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920761d87d36736a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6139d9b640 1 -- 172.21.15.79:0/1853484127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c037070 con 0x7f613c0d2680 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6139d9b640 1 -- 172.21.15.79:0/1853484127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f612c032440 con 0x7f613c0d2680 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6139d9b640 1 -- 172.21.15.79:0/1853484127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c032810 con 0x7f613c0d2680 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6140cba640 1 -- 172.21.15.79:0/1853484127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 msgr2=0x7f613c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6140cba640 1 --2- 172.21.15.79:0/1853484127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c15f1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f613c0c7960 tx=0x7f612c02a1a0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6140cba640 1 -- 172.21.15.79:0/1853484127 shutdown_connections 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6140cba640 1 --2- 172.21.15.79:0/1853484127 >> v2:172.21.15.117:3300/0 conn(0x7f613c0d1fc0 0x7f613c0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6140cba640 1 --2- 172.21.15.79:0/1853484127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c15f1a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6140cba640 1 -- 172.21.15.79:0/1853484127 >> 172.21.15.79:0/1853484127 conn(0x7f613c09d3f0 msgr2=0x7f613c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:25.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6140cba640 1 -- 172.21.15.79:0/1853484127 shutdown_connections 2024-06-10T00:15:25.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.857+0000 7f6140cba640 1 -- 172.21.15.79:0/1853484127 wait complete. 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.859+0000 7f6140cba640 1 Processor -- start 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.859+0000 7f6140cba640 1 -- start start 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.859+0000 7f6140cba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c0d1fc0 0x7f613c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.859+0000 7f6140cba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.859+0000 7f6140cba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f613c161fa0 0x7f613c151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.859+0000 7f6140cba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0d1070 con 0x7f613c0d2680 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.859+0000 7f6140cba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0d0d90 con 0x7f613c0d1fc0 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.859+0000 7f6140cba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f613c0d2400 con 0x7f613c161fa0 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c0cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46188/0 (socket says 172.21.15.79:46188) 2024-06-10T00:15:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 -- 172.21.15.79:0/851109995 learned_addr learned my addr 172.21.15.79:0/851109995 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f613a59c640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c0d1fc0 0x7f613c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 -- 172.21.15.79:0/851109995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f613c161fa0 msgr2=0x7f613c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f613c161fa0 0x7f613c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 -- 172.21.15.79:0/851109995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c0d1fc0 msgr2=0x7f613c1f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c0d1fc0 0x7f613c1f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 -- 172.21.15.79:0/851109995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c0b81d0 con 0x7f613c0d2680 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f613a59c640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c0d1fc0 0x7f613c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6133fff640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c0cd5d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f612400d800 tx=0x7f612400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6132ffd640 1 -- 172.21.15.79:0/851109995 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612400b6c0 con 0x7f613c0d2680 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6132ffd640 1 -- 172.21.15.79:0/851109995 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6124019070 con 0x7f613c0d2680 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c0b84b0 con 0x7f613c0d2680 2024-06-10T00:15:25.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6132ffd640 1 -- 172.21.15.79:0/851109995 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612400ba80 con 0x7f613c0d2680 2024-06-10T00:15:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.860+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c0b8a70 con 0x7f613c0d2680 2024-06-10T00:15:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.861+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613c068430 con 0x7f613c0d2680 2024-06-10T00:15:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.862+0000 7f6132ffd640 1 -- 172.21.15.79:0/851109995 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f612400bc20 con 0x7f613c0d2680 2024-06-10T00:15:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.862+0000 7f6132ffd640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f611c06be30 0x7f611c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.862+0000 7f6132ffd640 1 -- 172.21.15.79:0/851109995 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f612408b690 con 0x7f613c0d2680 2024-06-10T00:15:25.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.862+0000 7f613a59c640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f611c06be30 0x7f611c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:25.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.862+0000 7f613a59c640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f611c06be30 0x7f611c06e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f612c034000 tx=0x7f612c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:25.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:25.866+0000 7f6132ffd640 1 -- 172.21.15.79:0/851109995 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6124059cd0 con 0x7f613c0d2680 2024-06-10T00:15:26.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.078+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f613c161d80 con 0x7f613c0d2680 2024-06-10T00:15:26.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.078+0000 7f6132ffd640 1 -- 172.21.15.79:0/851109995 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7f61240595d0 con 0x7f613c0d2680 2024-06-10T00:15:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:26.078 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:15:01.280562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:15:26.078 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-06-10T00:15:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f611c06be30 msgr2=0x7f611c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f611c06be30 0x7f611c06e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f612c034000 tx=0x7f612c02e000 comp rx=0 tx=0).stop 2024-06-10T00:15:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 msgr2=0x7f613c0cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c0cd5d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f612400d800 tx=0x7f612400dcc0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 shutdown_connections 2024-06-10T00:15:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f611c06be30 0x7f611c06e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f613c161fa0 0x7f613c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f613c0d2680 0x7f613c0cd5d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 --2- 172.21.15.79:0/851109995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c0d1fc0 0x7f613c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 >> 172.21.15.79:0/851109995 conn(0x7f613c09d3f0 msgr2=0x7f613c15fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 shutdown_connections 2024-06-10T00:15:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.080+0000 7f6140cba640 1 -- 172.21.15.79:0/851109995 wait complete. 2024-06-10T00:15:26.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.192+0000 7ff9f7914640 1 Processor -- start 2024-06-10T00:15:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.192+0000 7ff9f7914640 1 -- start start 2024-06-10T00:15:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f7914640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9f00cf360 0x7ff9f00b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f7914640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f00b3420 con 0x7ff9f01553c0 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f7914640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f00cc750 con 0x7ff9f00cd230 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f7914640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f00cca30 con 0x7ff9f00cf360 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f5eb1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9f00cf360 0x7ff9f00b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f56b0640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff9f01553c0 0x7ff9f015beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58912/0 (socket says 172.21.15.79:58912) 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f5eb1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9f00cf360 0x7ff9f00b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46204/0 (socket says 172.21.15.79:46204) 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f56b0640 1 -- 172.21.15.79:0/3813909070 learned_addr learned my addr 172.21.15.79:0/3813909070 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f5eb1640 1 -- 172.21.15.79:0/3813909070 >> v1:172.21.15.117:6789/0 conn(0x7ff9f00cd230 legacy=0x7ff9f00cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f5eb1640 1 -- 172.21.15.79:0/3813909070 >> v1:172.21.15.79:6789/0 conn(0x7ff9f01553c0 legacy=0x7ff9f015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.193+0000 7ff9f5eb1640 1 -- 172.21.15.79:0/3813909070 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00ccd10 con 0x7ff9f00cf360 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9f5eb1640 1 --2- 172.21.15.79:0/3813909070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f00b2cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009d90 tx=0x7ff9e802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a86bce13d9e856 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9e3fff640 1 -- 172.21.15.79:0/3813909070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007740 con 0x7ff9f00cf360 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9e3fff640 1 -- 172.21.15.79:0/3813909070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e80078e0 con 0x7ff9f00cf360 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9e3fff640 1 -- 172.21.15.79:0/3813909070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007cb0 con 0x7ff9f00cf360 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9f7914640 1 -- 172.21.15.79:0/3813909070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 msgr2=0x7ff9f00b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9f7914640 1 --2- 172.21.15.79:0/3813909070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f00b2cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009d90 tx=0x7ff9e802a6a0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9f7914640 1 -- 172.21.15.79:0/3813909070 shutdown_connections 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9f7914640 1 --2- 172.21.15.79:0/3813909070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f00b2cf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9f7914640 1 -- 172.21.15.79:0/3813909070 >> 172.21.15.79:0/3813909070 conn(0x7ff9f00b19f0 msgr2=0x7ff9f00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9f7914640 1 -- 172.21.15.79:0/3813909070 shutdown_connections 2024-06-10T00:15:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.194+0000 7ff9f7914640 1 -- 172.21.15.79:0/3813909070 wait complete. 2024-06-10T00:15:26.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f7914640 1 Processor -- start 2024-06-10T00:15:26.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f7914640 1 -- start start 2024-06-10T00:15:26.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f7914640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9f00cd230 0x7ff9f0143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f7914640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f7914640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9f01553c0 0x7ff9f015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f7914640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f0155920 con 0x7ff9f00cf360 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f7914640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01557a0 con 0x7ff9f00cd230 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f7914640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f0071030 con 0x7ff9f01553c0 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f4eaf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.196+0000 7ff9f4eaf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f015beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46210/0 (socket says 172.21.15.79:46210) 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f4eaf640 1 -- 172.21.15.79:0/2935210312 learned_addr learned my addr 172.21.15.79:0/2935210312 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f56b0640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9f00cd230 0x7ff9f0143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f5eb1640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9f01553c0 0x7ff9f015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f4eaf640 1 -- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9f01553c0 msgr2=0x7ff9f015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f4eaf640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9f01553c0 0x7ff9f015c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f4eaf640 1 -- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9f00cd230 msgr2=0x7ff9f0143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f4eaf640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9f00cd230 0x7ff9f0143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f4eaf640 1 -- 172.21.15.79:0/2935210312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f009abb0 con 0x7ff9f00cf360 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f56b0640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9f00cd230 0x7ff9f0143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f4eaf640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f015beb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400c440 tx=0x7ff9e400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9e1ffb640 1 -- 172.21.15.79:0/2935210312 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4017070 con 0x7ff9f00cf360 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9e1ffb640 1 -- 172.21.15.79:0/2935210312 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e40035f0 con 0x7ff9f00cf360 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f009ae50 con 0x7ff9f00cf360 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9e1ffb640 1 -- 172.21.15.79:0/2935210312 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40039e0 con 0x7ff9f00cf360 2024-06-10T00:15:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.197+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f009b930 con 0x7ff9f00cf360 2024-06-10T00:15:26.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.198+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f0067d20 con 0x7ff9f00cf360 2024-06-10T00:15:26.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.198+0000 7ff9e1ffb640 1 -- 172.21.15.79:0/2935210312 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9e401a070 con 0x7ff9f00cf360 2024-06-10T00:15:26.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.199+0000 7ff9e1ffb640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9d406be30 0x7ff9d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.199+0000 7ff9e1ffb640 1 -- 172.21.15.79:0/2935210312 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff9e408a550 con 0x7ff9f00cf360 2024-06-10T00:15:26.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.199+0000 7ff9f56b0640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9d406be30 0x7ff9d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.199+0000 7ff9f56b0640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9d406be30 0x7ff9d406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec000f60 tx=0x7ff9ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.203+0000 7ff9e1ffb640 1 -- 172.21.15.79:0/2935210312 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff9f0067d20 con 0x7ff9f00cf360 2024-06-10T00:15:26.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.413+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9f0153d50 con 0x7ff9f00cf360 2024-06-10T00:15:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.413+0000 7ff9e1ffb640 1 -- 172.21.15.79:0/2935210312 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7ff9e4058b90 con 0x7ff9f00cf360 2024-06-10T00:15:26.413 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:26.413 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2465287492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2465287492},{"type":"v1","addr":"172.21.15.117:6834","nonce":2465287492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4129123085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4129123085},{"type":"v1","addr":"172.21.15.79:6835","nonce":4129123085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/74596944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":74596944},{"type":"v1","addr":"172.21.15.79:6837","nonce":74596944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:14:42.196314+0000","modified":"2024-06-10T00:15:01.280562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/4113284767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4113284767},{"type":"v1","addr":"172.21.15.117:6835","nonce":4113284767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-10T00:15:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-06-10T00:15:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9d406be30 msgr2=0x7ff9d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9d406be30 0x7ff9d406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec000f60 tx=0x7ff9ec009040 comp rx=0 tx=0).stop 2024-06-10T00:15:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 msgr2=0x7ff9f015beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f015beb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400c440 tx=0x7ff9e400c900 comp rx=0 tx=0).stop 2024-06-10T00:15:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 shutdown_connections 2024-06-10T00:15:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9d406be30 0x7ff9d406e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9f01553c0 0x7ff9f015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f00cf360 0x7ff9f015beb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 --2- 172.21.15.79:0/2935210312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9f00cd230 0x7ff9f0143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 >> 172.21.15.79:0/2935210312 conn(0x7ff9f00b19f0 msgr2=0x7ff9f015ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 shutdown_connections 2024-06-10T00:15:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.415+0000 7ff9f7914640 1 -- 172.21.15.79:0/2935210312 wait complete. 2024-06-10T00:15:26.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:26.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.527+0000 7f4a96729640 1 Processor -- start 2024-06-10T00:15:26.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.527+0000 7f4a96729640 1 -- start start 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a96729640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a9015f970 0x7f4a9009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a96729640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a900703f0 0x7f4a9009af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a96729640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9015fd50 con 0x7f4a900711b0 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a96729640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9009b9c0 con 0x7f4a9015f970 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a96729640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4a900d06c0 con 0x7f4a900703f0 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a9015f970 0x7f4a9009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4a900711b0 0x7f4a900cd3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58914/0 (socket says 172.21.15.79:58914) 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a9015f970 0x7f4a9009aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46216/0 (socket says 172.21.15.79:46216) 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8f7fe640 1 -- 172.21.15.79:0/3723752600 learned_addr learned my addr 172.21.15.79:0/3723752600 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a94cc6640 1 --2- 172.21.15.79:0/3723752600 >> v2:172.21.15.117:3300/0 conn(0x7f4a900703f0 0x7f4a9009af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8ffff640 1 -- 172.21.15.79:0/3723752600 >> v2:172.21.15.117:3300/0 conn(0x7f4a900703f0 msgr2=0x7f4a9009af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8ffff640 1 --2- 172.21.15.79:0/3723752600 >> v2:172.21.15.117:3300/0 conn(0x7f4a900703f0 0x7f4a9009af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8ffff640 1 -- 172.21.15.79:0/3723752600 >> v1:172.21.15.79:6789/0 conn(0x7f4a900711b0 legacy=0x7f4a900cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8ffff640 1 -- 172.21.15.79:0/3723752600 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a900708e0 con 0x7f4a9015f970 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.528+0000 7f4a8effd640 1 -- 172.21.15.79:0/3723752600 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467916783 0 0) 0x7f4a84001110 con 0x7f4a900711b0 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a8ffff640 1 --2- 172.21.15.79:0/3723752600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a9009aa10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a90072580 tx=0x7f4a8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4ff6bcfa615e82 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a8effd640 1 -- 172.21.15.79:0/3723752600 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80037070 con 0x7f4a9015f970 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a8effd640 1 -- 172.21.15.79:0/3723752600 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a80032440 con 0x7f4a9015f970 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a8effd640 1 -- 172.21.15.79:0/3723752600 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80032810 con 0x7f4a9015f970 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a96729640 1 -- 172.21.15.79:0/3723752600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 msgr2=0x7f4a9009aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a96729640 1 --2- 172.21.15.79:0/3723752600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a9009aa10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a90072580 tx=0x7f4a8002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a96729640 1 -- 172.21.15.79:0/3723752600 shutdown_connections 2024-06-10T00:15:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a96729640 1 --2- 172.21.15.79:0/3723752600 >> v2:172.21.15.117:3300/0 conn(0x7f4a900703f0 0x7f4a9009af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a96729640 1 --2- 172.21.15.79:0/3723752600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a9009aa10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.529+0000 7f4a96729640 1 -- 172.21.15.79:0/3723752600 >> 172.21.15.79:0/3723752600 conn(0x7f4a900d1eb0 msgr2=0x7f4a900d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.530+0000 7f4a96729640 1 -- 172.21.15.79:0/3723752600 shutdown_connections 2024-06-10T00:15:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.530+0000 7f4a96729640 1 -- 172.21.15.79:0/3723752600 wait complete. 2024-06-10T00:15:26.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.531+0000 7f4a96729640 1 Processor -- start 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.531+0000 7f4a96729640 1 -- start start 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a96729640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a900703f0 0x7f4a901591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a96729640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a900711b0 0x7f4a90158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a96729640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a900c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a96729640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4a90070d00 con 0x7f4a9015f970 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a96729640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9009b490 con 0x7f4a900711b0 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a96729640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4a90070e80 con 0x7f4a900703f0 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a900c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a900c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46224/0 (socket says 172.21.15.79:46224) 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 -- 172.21.15.79:0/1735930081 learned_addr learned my addr 172.21.15.79:0/1735930081 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a8f7fe640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a900711b0 0x7f4a90158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a8ffff640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a900703f0 0x7f4a901591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 -- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a900703f0 msgr2=0x7f4a901591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a900703f0 0x7f4a901591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 -- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a900711b0 msgr2=0x7f4a90158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a900711b0 0x7f4a90158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 -- 172.21.15.79:0/1735930081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a900b0c40 con 0x7f4a9015f970 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a8f7fe640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a900711b0 0x7f4a90158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a8ffff640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a900703f0 0x7f4a901591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a94cc6640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a900c9c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a88007e70 tx=0x7f4a8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a8cff9640 1 -- 172.21.15.79:0/1735930081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88014620 con 0x7f4a9015f970 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a8cff9640 1 -- 172.21.15.79:0/1735930081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a88019070 con 0x7f4a9015f970 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a8cff9640 1 -- 172.21.15.79:0/1735930081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88014a20 con 0x7f4a9015f970 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a900c9120 con 0x7f4a9015f970 2024-06-10T00:15:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.532+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a90158f40 con 0x7f4a9015f970 2024-06-10T00:15:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.533+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a90068430 con 0x7f4a9015f970 2024-06-10T00:15:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.534+0000 7f4a8cff9640 1 -- 172.21.15.79:0/1735930081 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a88014bc0 con 0x7f4a9015f970 2024-06-10T00:15:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.534+0000 7f4a8cff9640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a7c06be60 0x7f4a7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.534+0000 7f4a8ffff640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a7c06be60 0x7f4a7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.534+0000 7f4a8cff9640 1 -- 172.21.15.79:0/1735930081 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4a8808bbd0 con 0x7f4a9015f970 2024-06-10T00:15:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.535+0000 7f4a8ffff640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a7c06be60 0x7f4a7c06e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a80034000 tx=0x7f4a8002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.538+0000 7f4a8cff9640 1 -- 172.21.15.79:0/1735930081 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4a8805a180 con 0x7f4a9015f970 2024-06-10T00:15:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.711+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a900cf950 con 0x7f4a9015f970 2024-06-10T00:15:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.713+0000 7f4a8cff9640 1 -- 172.21.15.79:0/1735930081 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18852 (secure 0 0 0) 0x7f4a88059a80 con 0x7f4a9015f970 2024-06-10T00:15:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:26.713 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:15:24.992519+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:14:39.913263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-10T00:14:41.170269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-10T00:14:44.884399+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a7c06be60 msgr2=0x7f4a7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a7c06be60 0x7f4a7c06e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a80034000 tx=0x7f4a8002e000 comp rx=0 tx=0).stop 2024-06-10T00:15:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 msgr2=0x7f4a900c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a900c9c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a88007e70 tx=0x7f4a8800e4b0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 shutdown_connections 2024-06-10T00:15:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a7c06be60 0x7f4a7c06e320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a9015f970 0x7f4a900c9c00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a900711b0 0x7f4a90158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 --2- 172.21.15.79:0/1735930081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a900703f0 0x7f4a901591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 >> 172.21.15.79:0/1735930081 conn(0x7f4a900d1eb0 msgr2=0x7f4a900b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 shutdown_connections 2024-06-10T00:15:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.715+0000 7f4a96729640 1 -- 172.21.15.79:0/1735930081 wait complete. 2024-06-10T00:15:26.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:15:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.826+0000 7f31234ae640 1 Processor -- start 2024-06-10T00:15:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.826+0000 7f31234ae640 1 -- start start 2024-06-10T00:15:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f31234ae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f311c0cf360 0x7f311c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f31234ae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f311c0b3420 con 0x7f311c1553c0 2024-06-10T00:15:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f31234ae640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f311c0cc750 con 0x7f311c0cd230 2024-06-10T00:15:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f31234ae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f311c0cca30 con 0x7f311c0cf360 2024-06-10T00:15:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f312124a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f311c1553c0 0x7f311c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58920/0 (socket says 172.21.15.79:58920) 2024-06-10T00:15:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f312124a640 1 -- 172.21.15.79:0/4077582605 learned_addr learned my addr 172.21.15.79:0/4077582605 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f3121a4b640 1 --2- 172.21.15.79:0/4077582605 >> v2:172.21.15.79:3300/0 conn(0x7f311c0cf360 0x7f311c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f3113fff640 1 -- 172.21.15.79:0/4077582605 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114809466 0 0) 0x7f311c0b3420 con 0x7f311c1553c0 2024-06-10T00:15:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f3113fff640 1 -- 172.21.15.79:0/4077582605 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3108003520 con 0x7f311c1553c0 2024-06-10T00:15:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f3121a4b640 1 -- 172.21.15.79:0/4077582605 >> v1:172.21.15.117:6789/0 conn(0x7f311c0cd230 legacy=0x7f311c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f3121a4b640 1 -- 172.21.15.79:0/4077582605 >> v1:172.21.15.79:6789/0 conn(0x7f311c1553c0 legacy=0x7f311c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.827+0000 7f3121a4b640 1 -- 172.21.15.79:0/4077582605 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c0ccd10 con 0x7f311c0cf360 2024-06-10T00:15:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.828+0000 7f3121a4b640 1 --2- 172.21.15.79:0/4077582605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c0b2cf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3114009d90 tx=0x7f311402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea184e5d1b240024 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.828+0000 7f3113fff640 1 -- 172.21.15.79:0/4077582605 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114007740 con 0x7f311c0cf360 2024-06-10T00:15:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.828+0000 7f3113fff640 1 -- 172.21.15.79:0/4077582605 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31140078e0 con 0x7f311c0cf360 2024-06-10T00:15:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.828+0000 7f3113fff640 1 -- 172.21.15.79:0/4077582605 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114007cb0 con 0x7f311c0cf360 2024-06-10T00:15:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.829+0000 7f31234ae640 1 -- 172.21.15.79:0/4077582605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 msgr2=0x7f311c0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.829+0000 7f31234ae640 1 --2- 172.21.15.79:0/4077582605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c0b2cf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3114009d90 tx=0x7f311402a6a0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.829+0000 7f31234ae640 1 -- 172.21.15.79:0/4077582605 shutdown_connections 2024-06-10T00:15:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.829+0000 7f31234ae640 1 --2- 172.21.15.79:0/4077582605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c0b2cf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.829+0000 7f31234ae640 1 -- 172.21.15.79:0/4077582605 >> 172.21.15.79:0/4077582605 conn(0x7f311c0b19f0 msgr2=0x7f311c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.829+0000 7f31234ae640 1 -- 172.21.15.79:0/4077582605 shutdown_connections 2024-06-10T00:15:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.829+0000 7f31234ae640 1 -- 172.21.15.79:0/4077582605 wait complete. 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.830+0000 7f31234ae640 1 Processor -- start 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.830+0000 7f31234ae640 1 -- start start 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f31234ae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0cd230 0x7f311c1f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f31234ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c1ede70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f31234ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c1553c0 0x7f311c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f31234ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f311c155920 con 0x7f311c0cf360 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f31234ae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1557a0 con 0x7f311c1553c0 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f31234ae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f311c071030 con 0x7f311c0cd230 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c1ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c1ede70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46238/0 (socket says 172.21.15.79:46238) 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 -- 172.21.15.79:0/4257119449 learned_addr learned my addr 172.21.15.79:0/4257119449 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3121a4b640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c1553c0 0x7f311c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f312124a640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0cd230 0x7f311c1f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 -- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0cd230 msgr2=0x7f311c1f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0cd230 0x7f311c1f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 -- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c1553c0 msgr2=0x7f311c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c1553c0 0x7f311c159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 -- 172.21.15.79:0/4257119449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c1f7a90 con 0x7f311c0cf360 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3121a4b640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c1553c0 0x7f311c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3120a49640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c1ede70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c430 tx=0x7f310c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.831+0000 7f3111ffb640 1 -- 172.21.15.79:0/4257119449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c011790 con 0x7f311c0cf360 2024-06-10T00:15:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.832+0000 7f3111ffb640 1 -- 172.21.15.79:0/4257119449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c017070 con 0x7f311c0cf360 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.832+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c1f7d70 con 0x7f311c0cf360 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.832+0000 7f3111ffb640 1 -- 172.21.15.79:0/4257119449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c011b70 con 0x7f311c0cf360 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.832+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1f8330 con 0x7f311c0cf360 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.833+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311c068430 con 0x7f311c0cf360 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.833+0000 7f3111ffb640 1 -- 172.21.15.79:0/4257119449 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f310c011d10 con 0x7f311c0cf360 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.833+0000 7f3111ffb640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.834+0000 7f3111ffb640 1 -- 172.21.15.79:0/4257119449 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f310c08b0d0 con 0x7f311c0cf360 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.834+0000 7f312124a640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:26.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.834+0000 7f312124a640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f310006be30 0x7f310006e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3118000f60 tx=0x7f3118009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:26.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:26.838+0000 7f3111ffb640 1 -- 172.21.15.79:0/4257119449 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f310c059680 con 0x7f311c0cf360 2024-06-10T00:15:27.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.055+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f311c0713c0 con 0x7f311c0cf360 2024-06-10T00:15:27.055 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:15:27.055+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:15:27.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.057+0000 7f3111ffb640 1 -- 172.21.15.79:0/4257119449 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f310c058f80 con 0x7f311c0cf360 2024-06-10T00:15:27.056 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:15:27.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f310006be30 msgr2=0x7f310006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:27.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f310006be30 0x7f310006e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3118000f60 tx=0x7f3118009040 comp rx=0 tx=0).stop 2024-06-10T00:15:27.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 msgr2=0x7f311c1ede70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:27.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c1ede70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c430 tx=0x7f310c00c8f0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 shutdown_connections 2024-06-10T00:15:27.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f311c1553c0 0x7f311c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c0cf360 0x7f311c1ede70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 --2- 172.21.15.79:0/4257119449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f311c0cd230 0x7f311c1f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 >> 172.21.15.79:0/4257119449 conn(0x7f311c0b19f0 msgr2=0x7f311c0ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:27.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 shutdown_connections 2024-06-10T00:15:27.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.059+0000 7f31234ae640 1 -- 172.21.15.79:0/4257119449 wait complete. 2024-06-10T00:15:27.061 INFO:tasks.ceph.mds.d.smithi117.stderr: -3255> 2024-06-10T00:14:47.694+0000 7f18a9043640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:15:27.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-10T00:15:27.094 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:15:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.172+0000 7f4c61942640 1 Processor -- start 2024-06-10T00:15:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.172+0000 7f4c61942640 1 -- start start 2024-06-10T00:15:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c61942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0b3b40 0x7f4c5c0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c61942640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4c5c0d0730 0x7f4c5c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c61942640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c15c870 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c61942640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4c5c15cb50 con 0x7f4c5c0d0730 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c61942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5c15ce30 con 0x7f4c5c0b3b40 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c5a7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4c5c0b48e0 0x7f4c5c0d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58930/0 (socket says 172.21.15.79:58930) 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c5a7fc640 1 -- 172.21.15.79:0/1133470606 learned_addr learned my addr 172.21.15.79:0/1133470606 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c5affd640 1 --2- 172.21.15.79:0/1133470606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0b3b40 0x7f4c5c0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c5b7fe640 1 --2- 172.21.15.79:0/1133470606 >> v2:172.21.15.117:3300/0 conn(0x7f4c5c0d0730 0x7f4c5c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c59ffb640 1 -- 172.21.15.79:0/1133470606 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824591087 0 0) 0x7f4c5c15c870 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.173+0000 7f4c59ffb640 1 -- 172.21.15.79:0/1133470606 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c44003520 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.174+0000 7f4c5b7fe640 1 -- 172.21.15.79:0/1133470606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0b3b40 msgr2=0x7f4c5c0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.174+0000 7f4c5b7fe640 1 --2- 172.21.15.79:0/1133470606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0b3b40 0x7f4c5c0b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.174+0000 7f4c59ffb640 1 -- 172.21.15.79:0/1133470606 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2058832886 0 0) 0x7f4c44003520 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.174+0000 7f4c5b7fe640 1 -- 172.21.15.79:0/1133470606 >> v1:172.21.15.79:6789/0 conn(0x7f4c5c0b48e0 legacy=0x7f4c5c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.174+0000 7f4c5b7fe640 1 -- 172.21.15.79:0/1133470606 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c15d110 con 0x7f4c5c0d0730 2024-06-10T00:15:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.174+0000 7f4c5b7fe640 1 --2- 172.21.15.79:0/1133470606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0d0730 0x7f4c5c0b4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009d90 tx=0x7f4c5402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df94fce05e7b7039 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.174+0000 7f4c59ffb640 1 -- 172.21.15.79:0/1133470606 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50001670 con 0x7f4c5c0d0730 2024-06-10T00:15:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c59ffb640 1 -- 172.21.15.79:0/1133470606 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c54007540 con 0x7f4c5c0d0730 2024-06-10T00:15:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c59ffb640 1 -- 172.21.15.79:0/1133470606 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c54007910 con 0x7f4c5c0d0730 2024-06-10T00:15:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c61942640 1 -- 172.21.15.79:0/1133470606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0d0730 msgr2=0x7f4c5c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c61942640 1 --2- 172.21.15.79:0/1133470606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0d0730 0x7f4c5c0b4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009d90 tx=0x7f4c5402a5f0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c61942640 1 -- 172.21.15.79:0/1133470606 shutdown_connections 2024-06-10T00:15:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c61942640 1 --2- 172.21.15.79:0/1133470606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0d0730 0x7f4c5c0b4d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c61942640 1 --2- 172.21.15.79:0/1133470606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0b3b40 0x7f4c5c0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c61942640 1 -- 172.21.15.79:0/1133470606 >> 172.21.15.79:0/1133470606 conn(0x7f4c5c0b1d10 msgr2=0x7f4c5c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c61942640 1 -- 172.21.15.79:0/1133470606 shutdown_connections 2024-06-10T00:15:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.175+0000 7f4c61942640 1 -- 172.21.15.79:0/1133470606 wait complete. 2024-06-10T00:15:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.176+0000 7f4c61942640 1 Processor -- start 2024-06-10T00:15:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.176+0000 7f4c61942640 1 -- start start 2024-06-10T00:15:27.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c61942640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0b3b40 0x7f4c5c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:27.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c61942640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5c0b48e0 0x7f4c5c1449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c61942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0d0730 0x7f4c5c1473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c61942640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c15c490 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c61942640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c0b3f20 con 0x7f4c5c0b3b40 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c61942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5c15c610 con 0x7f4c5c0d0730 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c5a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5c0b48e0 0x7f4c5c1449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c5a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5c0b48e0 0x7f4c5c1449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46252/0 (socket says 172.21.15.79:46252) 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c5a7fc640 1 -- 172.21.15.79:0/3969012796 learned_addr learned my addr 172.21.15.79:0/3969012796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c5affd640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0b3b40 0x7f4c5c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.177+0000 7f4c5b7fe640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0d0730 0x7f4c5c1473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c5a7fc640 1 -- 172.21.15.79:0/3969012796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0d0730 msgr2=0x7f4c5c1473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c5a7fc640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0d0730 0x7f4c5c1473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c5a7fc640 1 -- 172.21.15.79:0/3969012796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0b3b40 msgr2=0x7f4c5c15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c5a7fc640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0b3b40 0x7f4c5c15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c5a7fc640 1 -- 172.21.15.79:0/3969012796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c15aec0 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c5a7fc640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5c0b48e0 0x7f4c5c1449f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c780 tx=0x7f4c5000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c43fff640 1 -- 172.21.15.79:0/3969012796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50017070 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c43fff640 1 -- 172.21.15.79:0/3969012796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c50005ad0 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c43fff640 1 -- 172.21.15.79:0/3969012796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50007070 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5c15b1a0 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.178+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5c154450 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.179+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5c15b590 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.179+0000 7f4c43fff640 1 -- 172.21.15.79:0/3969012796 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c5001a070 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.180+0000 7f4c43fff640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c4806be30 0x7f4c4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.180+0000 7f4c5affd640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c4806be30 0x7f4c4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.180+0000 7f4c43fff640 1 -- 172.21.15.79:0/3969012796 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f4c5008a700 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.180+0000 7f4c5affd640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c4806be30 0x7f4c4806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009aa0 tx=0x7f4c4c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:27.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.184+0000 7f4c43fff640 1 -- 172.21.15.79:0/3969012796 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4c50058690 con 0x7f4c5c0b48e0 2024-06-10T00:15:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:27.394+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4c5c1546b0 con 0x7f4c5c0b48e0 2024-06-10T00:15:28.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.058+0000 7f4c43fff640 1 -- 172.21.15.79:0/3969012796 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f4c5005c990 con 0x7f4c5c0b48e0 2024-06-10T00:15:28.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.060+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c4806be30 msgr2=0x7f4c4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:28.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.060+0000 7f4c61942640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c4806be30 0x7f4c4806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009aa0 tx=0x7f4c4c009190 comp rx=0 tx=0).stop 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.060+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5c0b48e0 msgr2=0x7f4c5c1449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.060+0000 7f4c61942640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5c0b48e0 0x7f4c5c1449f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c780 tx=0x7f4c5000cc40 comp rx=0 tx=0).stop 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.060+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 shutdown_connections 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.060+0000 7f4c61942640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c4806be30 0x7f4c4806e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.061+0000 7f4c61942640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c5c0d0730 0x7f4c5c1473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.061+0000 7f4c61942640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c5c0b48e0 0x7f4c5c1449f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.061+0000 7f4c61942640 1 --2- 172.21.15.79:0/3969012796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c5c0b3b40 0x7f4c5c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.061+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 >> 172.21.15.79:0/3969012796 conn(0x7f4c5c0b1d10 msgr2=0x7f4c5c0cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.061+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 shutdown_connections 2024-06-10T00:15:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.061+0000 7f4c61942640 1 -- 172.21.15.79:0/3969012796 wait complete. 2024-06-10T00:15:28.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-10T00:15:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.184+0000 7f5845ff9640 1 Processor -- start 2024-06-10T00:15:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.184+0000 7f5845ff9640 1 -- start start 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f5845ff9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f584015e670 0x7f58400d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f5845ff9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584015ec90 con 0x7f58400d1f30 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f5845ff9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584015ef70 con 0x7f58400d0e00 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f5845ff9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f584015fa50 con 0x7f584015e670 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f583f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f584015e670 0x7f58400d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f583effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f58400d1f30 0x7f58400d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41068/0 (socket says 172.21.15.79:41068) 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f583effd640 1 -- 172.21.15.79:0/803913714 learned_addr learned my addr 172.21.15.79:0/803913714 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f583f7fe640 1 -- 172.21.15.79:0/803913714 >> v1:172.21.15.117:6789/0 conn(0x7f58400d0e00 legacy=0x7f58400cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f583f7fe640 1 -- 172.21.15.79:0/803913714 >> v1:172.21.15.79:6789/0 conn(0x7f58400d1f30 legacy=0x7f58400d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f583f7fe640 1 -- 172.21.15.79:0/803913714 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584015f250 con 0x7f584015e670 2024-06-10T00:15:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.185+0000 7f583e7fc640 1 -- 172.21.15.79:0/803913714 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149110911 0 0) 0x7f584015ec90 con 0x7f58400d1f30 2024-06-10T00:15:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f583f7fe640 1 --2- 172.21.15.79:0/803913714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f584015e670 0x7f58400d49f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f58300097a0 tx=0x7f583002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a3b90a510448e6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f583e7fc640 1 -- 172.21.15.79:0/803913714 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830037070 con 0x7f584015e670 2024-06-10T00:15:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f583e7fc640 1 -- 172.21.15.79:0/803913714 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5830032640 con 0x7f584015e670 2024-06-10T00:15:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f583e7fc640 1 -- 172.21.15.79:0/803913714 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830032a10 con 0x7f584015e670 2024-06-10T00:15:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f5845ff9640 1 -- 172.21.15.79:0/803913714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f584015e670 msgr2=0x7f58400d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f5845ff9640 1 --2- 172.21.15.79:0/803913714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f584015e670 0x7f58400d49f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f58300097a0 tx=0x7f583002a2c0 comp rx=0 tx=0).stop 2024-06-10T00:15:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f5845ff9640 1 -- 172.21.15.79:0/803913714 shutdown_connections 2024-06-10T00:15:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f5845ff9640 1 --2- 172.21.15.79:0/803913714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f584015e670 0x7f58400d49f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f5845ff9640 1 -- 172.21.15.79:0/803913714 >> 172.21.15.79:0/803913714 conn(0x7f584009d400 msgr2=0x7f58400d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f5845ff9640 1 -- 172.21.15.79:0/803913714 shutdown_connections 2024-06-10T00:15:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.186+0000 7f5845ff9640 1 -- 172.21.15.79:0/803913714 wait complete. 2024-06-10T00:15:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.188+0000 7f5845ff9640 1 Processor -- start 2024-06-10T00:15:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.188+0000 7f5845ff9640 1 -- start start 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.188+0000 7f5845ff9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58400d0e00 0x7f5840156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.188+0000 7f5845ff9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58400d1f30 0x7f58400c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.188+0000 7f5845ff9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f584015e670 0x7f58400b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.188+0000 7f5845ff9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f58400d2370 con 0x7f58400d0e00 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.188+0000 7f5845ff9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f584015ea50 con 0x7f584015e670 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.188+0000 7f5845ff9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f58400cf2e0 con 0x7f58400d1f30 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58400d0e00 0x7f5840156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58400d0e00 0x7f5840156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53052/0 (socket says 172.21.15.79:53052) 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 -- 172.21.15.79:0/275673491 learned_addr learned my addr 172.21.15.79:0/275673491 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583effd640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58400d1f30 0x7f58400c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583ffff640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f584015e670 0x7f58400b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 -- 172.21.15.79:0/275673491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58400d1f30 msgr2=0x7f58400c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58400d1f30 0x7f58400c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 -- 172.21.15.79:0/275673491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f584015e670 msgr2=0x7f58400b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f584015e670 0x7f58400b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 -- 172.21.15.79:0/275673491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58400b94e0 con 0x7f58400d0e00 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f583f7fe640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58400d0e00 0x7f5840156e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f58300098c0 tx=0x7f58300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f5827fff640 1 -- 172.21.15.79:0/275673491 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830041070 con 0x7f58400d0e00 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f5827fff640 1 -- 172.21.15.79:0/275673491 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583003c930 con 0x7f58400d0e00 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f5827fff640 1 -- 172.21.15.79:0/275673491 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830037040 con 0x7f58400d0e00 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58400b97c0 con 0x7f58400d0e00 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.189+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58400b7b70 con 0x7f58400d0e00 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.190+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5840068540 con 0x7f58400d0e00 2024-06-10T00:15:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.191+0000 7f5827fff640 1 -- 172.21.15.79:0/275673491 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5830044070 con 0x7f58400d0e00 2024-06-10T00:15:28.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.191+0000 7f5827fff640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f582c06be30 0x7f582c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:28.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.191+0000 7f5827fff640 1 -- 172.21.15.79:0/275673491 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f58300ac0e0 con 0x7f58400d0e00 2024-06-10T00:15:28.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.191+0000 7f583effd640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f582c06be30 0x7f582c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:28.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.191+0000 7f583effd640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f582c06be30 0x7f582c06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f58400d0b80 tx=0x7f5834007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:28.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.195+0000 7f5827fff640 1 -- 172.21.15.79:0/275673491 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f583007a750 con 0x7f58400d0e00 2024-06-10T00:15:28.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:28.371+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f58400b7d40 con 0x7f58400d0e00 2024-06-10T00:15:29.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.067+0000 7f5827fff640 1 -- 172.21.15.79:0/275673491 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f583007a050 con 0x7f58400d0e00 2024-06-10T00:15:29.067 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.070+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f582c06be30 msgr2=0x7f582c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.070+0000 7f5845ff9640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f582c06be30 0x7f582c06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f58400d0b80 tx=0x7f5834007b90 comp rx=0 tx=0).stop 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.070+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58400d0e00 msgr2=0x7f5840156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.070+0000 7f5845ff9640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58400d0e00 0x7f5840156e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f58300098c0 tx=0x7f58300046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.071+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 shutdown_connections 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.071+0000 7f5845ff9640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f582c06be30 0x7f582c06e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.071+0000 7f5845ff9640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f584015e670 0x7f58400b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.071+0000 7f5845ff9640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58400d1f30 0x7f58400c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.071+0000 7f5845ff9640 1 --2- 172.21.15.79:0/275673491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58400d0e00 0x7f5840156e60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.071+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 >> 172.21.15.79:0/275673491 conn(0x7f584009d400 msgr2=0x7f58400d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.071+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 shutdown_connections 2024-06-10T00:15:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.071+0000 7f5845ff9640 1 -- 172.21.15.79:0/275673491 wait complete. 2024-06-10T00:15:29.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-10T00:15:29.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.194+0000 7f37e3c7d640 1 Processor -- start 2024-06-10T00:15:29.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.194+0000 7f37e3c7d640 1 -- start start 2024-06-10T00:15:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e3c7d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f37dc15be50 0x7f37dc071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e3c7d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37dc0720d0 0x7f37dc0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e3c7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15c740 0x7f37dc0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e3c7d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc0b3020 con 0x7f37dc0720d0 2024-06-10T00:15:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e3c7d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc072570 con 0x7f37dc15be50 2024-06-10T00:15:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e3c7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc072850 con 0x7f37dc15c740 2024-06-10T00:15:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1218640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37dc0720d0 0x7f37dc0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1218640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37dc0720d0 0x7f37dc0cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53066/0 (socket says 172.21.15.79:53066) 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1218640 1 -- 172.21.15.79:0/3508304724 learned_addr learned my addr 172.21.15.79:0/3508304724 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e221a640 1 --2- 172.21.15.79:0/3508304724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15c740 0x7f37dc0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1a19640 1 --2- 172.21.15.79:0/3508304724 >> v2:172.21.15.117:3300/0 conn(0x7f37dc15be50 0x7f37dc071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1218640 1 -- 172.21.15.79:0/3508304724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15c740 msgr2=0x7f37dc0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1218640 1 --2- 172.21.15.79:0/3508304724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15c740 0x7f37dc0ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1218640 1 -- 172.21.15.79:0/3508304724 >> v2:172.21.15.117:3300/0 conn(0x7f37dc15be50 msgr2=0x7f37dc071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1218640 1 --2- 172.21.15.79:0/3508304724 >> v2:172.21.15.117:3300/0 conn(0x7f37dc15be50 0x7f37dc071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.195+0000 7f37e1218640 1 -- 172.21.15.79:0/3508304724 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc072b30 con 0x7f37dc0720d0 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.196+0000 7f37e1218640 1 --2- 172.21.15.79:0/3508304724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc0cc620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37dc072a60 tx=0x7f37cc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b80358dce78ebf9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.196+0000 7f37e0a17640 1 -- 172.21.15.79:0/3508304724 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc037070 con 0x7f37dc0720d0 2024-06-10T00:15:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.196+0000 7f37e0a17640 1 -- 172.21.15.79:0/3508304724 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc032440 con 0x7f37dc0720d0 2024-06-10T00:15:29.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.196+0000 7f37e0a17640 1 -- 172.21.15.79:0/3508304724 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc032810 con 0x7f37dc0720d0 2024-06-10T00:15:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 -- 172.21.15.79:0/3508304724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 msgr2=0x7f37dc0cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/3508304724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc0cc620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37dc072a60 tx=0x7f37cc02a1c0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 -- 172.21.15.79:0/3508304724 shutdown_connections 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/3508304724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15c740 0x7f37dc0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/3508304724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc0cc620 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/3508304724 >> v2:172.21.15.117:3300/0 conn(0x7f37dc15be50 0x7f37dc071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 -- 172.21.15.79:0/3508304724 >> 172.21.15.79:0/3508304724 conn(0x7f37dc0b1980 msgr2=0x7f37dc0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 -- 172.21.15.79:0/3508304724 shutdown_connections 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.197+0000 7f37e3c7d640 1 -- 172.21.15.79:0/3508304724 wait complete. 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.198+0000 7f37e3c7d640 1 Processor -- start 2024-06-10T00:15:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.198+0000 7f37e3c7d640 1 -- start start 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e3c7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc1ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e3c7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15be50 0x7f37dc14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e3c7d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc15c740 0x7f37dc14e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e3c7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc15c3b0 con 0x7f37dc0720d0 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e3c7d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc15c230 con 0x7f37dc15c740 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e3c7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc15c530 con 0x7f37dc15be50 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc1ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc1ef0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53072/0 (socket says 172.21.15.79:53072) 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 -- 172.21.15.79:0/2821698675 learned_addr learned my addr 172.21.15.79:0/2821698675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1218640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15be50 0x7f37dc14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e221a640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc15c740 0x7f37dc14e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 -- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15be50 msgr2=0x7f37dc14e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15be50 0x7f37dc14e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 -- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc15c740 msgr2=0x7f37dc14e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc15c740 0x7f37dc14e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 -- 172.21.15.79:0/2821698675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc151290 con 0x7f37dc0720d0 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1218640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15be50 0x7f37dc14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e221a640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc15c740 0x7f37dc14e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.199+0000 7f37e1a19640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc1ef0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f37d800d830 tx=0x7f37d800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.200+0000 7f37d27fc640 1 -- 172.21.15.79:0/2821698675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d800b6c0 con 0x7f37dc0720d0 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.200+0000 7f37d27fc640 1 -- 172.21.15.79:0/2821698675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8019070 con 0x7f37dc0720d0 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.200+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc151570 con 0x7f37dc0720d0 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.200+0000 7f37d27fc640 1 -- 172.21.15.79:0/2821698675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d800ba80 con 0x7f37dc0720d0 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.200+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc15e130 con 0x7f37dc0720d0 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.200+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc068540 con 0x7f37dc0720d0 2024-06-10T00:15:29.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.201+0000 7f37d27fc640 1 -- 172.21.15.79:0/2821698675 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37d801e460 con 0x7f37dc0720d0 2024-06-10T00:15:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.201+0000 7f37d27fc640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f37c006be30 0x7f37c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.202+0000 7f37d27fc640 1 -- 172.21.15.79:0/2821698675 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6383+0+0 (secure 0 0 0) 0x7f37d808b760 con 0x7f37dc0720d0 2024-06-10T00:15:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.202+0000 7f37e1218640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f37c006be30 0x7f37c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.202+0000 7f37e1218640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f37c006be30 0x7f37c006e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37cc034000 tx=0x7f37cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:29.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.206+0000 7f37d27fc640 1 -- 172.21.15.79:0/2821698675 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f37d8059f00 con 0x7f37dc0720d0 2024-06-10T00:15:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:29.380+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f37dc1580b0 con 0x7f37dc0720d0 2024-06-10T00:15:30.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.074+0000 7f37d27fc640 1 -- 172.21.15.79:0/2821698675 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f37d8059800 con 0x7f37dc0720d0 2024-06-10T00:15:30.074 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-06-10T00:15:30.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f37c006be30 msgr2=0x7f37c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:30.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f37c006be30 0x7f37c006e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37cc034000 tx=0x7f37cc02e000 comp rx=0 tx=0).stop 2024-06-10T00:15:30.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 msgr2=0x7f37dc1ef0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:30.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc1ef0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f37d800d830 tx=0x7f37d800dcf0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 shutdown_connections 2024-06-10T00:15:30.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f37c006be30 0x7f37c006e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc15c740 0x7f37dc14e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37dc15be50 0x7f37dc14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 --2- 172.21.15.79:0/2821698675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37dc0720d0 0x7f37dc1ef0a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.078+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 >> 172.21.15.79:0/2821698675 conn(0x7f37dc0b1980 msgr2=0x7f37dc0af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:30.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.079+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 shutdown_connections 2024-06-10T00:15:30.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.079+0000 7f37e3c7d640 1 -- 172.21.15.79:0/2821698675 wait complete. 2024-06-10T00:15:30.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-06-10T00:15:30.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.199+0000 7fad3e4ee640 1 Processor -- start 2024-06-10T00:15:30.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.199+0000 7fad3e4ee640 1 -- start start 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.199+0000 7fad3e4ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad3815be50 0x7fad38071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.199+0000 7fad3e4ee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad38072570 con 0x7fad380ccd30 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.199+0000 7fad3e4ee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad38072850 con 0x7fad380720d0 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.199+0000 7fad3e4ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fad380b3020 con 0x7fad3815be50 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.200+0000 7fad37fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad3815be50 0x7fad38071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.200+0000 7fad3ca8b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fad380ccd30 0x7fad380b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41080/0 (socket says 172.21.15.79:41080) 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.200+0000 7fad3ca8b640 1 -- 172.21.15.79:0/2861977515 learned_addr learned my addr 172.21.15.79:0/2861977515 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.200+0000 7fad37fff640 1 -- 172.21.15.79:0/2861977515 >> v1:172.21.15.117:6789/0 conn(0x7fad380720d0 legacy=0x7fad380cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.200+0000 7fad37fff640 1 -- 172.21.15.79:0/2861977515 >> v1:172.21.15.79:6789/0 conn(0x7fad380ccd30 legacy=0x7fad380b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.200+0000 7fad36ffd640 1 -- 172.21.15.79:0/2861977515 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 177644130 0 0) 0x7fad38072570 con 0x7fad380ccd30 2024-06-10T00:15:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.200+0000 7fad37fff640 1 -- 172.21.15.79:0/2861977515 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad38072b30 con 0x7fad3815be50 2024-06-10T00:15:30.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad37fff640 1 --2- 172.21.15.79:0/2861977515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3815be50 0x7fad38071b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fad280097a0 tx=0x7fad2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eda597e66eb646e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:30.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad36ffd640 1 -- 172.21.15.79:0/2861977515 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28037070 con 0x7fad3815be50 2024-06-10T00:15:30.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad36ffd640 1 -- 172.21.15.79:0/2861977515 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad28032440 con 0x7fad3815be50 2024-06-10T00:15:30.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad36ffd640 1 -- 172.21.15.79:0/2861977515 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28032810 con 0x7fad3815be50 2024-06-10T00:15:30.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad3e4ee640 1 -- 172.21.15.79:0/2861977515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3815be50 msgr2=0x7fad38071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:30.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad3e4ee640 1 --2- 172.21.15.79:0/2861977515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3815be50 0x7fad38071b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fad280097a0 tx=0x7fad2802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad3e4ee640 1 -- 172.21.15.79:0/2861977515 shutdown_connections 2024-06-10T00:15:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad3e4ee640 1 --2- 172.21.15.79:0/2861977515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3815be50 0x7fad38071b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad3e4ee640 1 -- 172.21.15.79:0/2861977515 >> 172.21.15.79:0/2861977515 conn(0x7fad380b1980 msgr2=0x7fad380b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad3e4ee640 1 -- 172.21.15.79:0/2861977515 shutdown_connections 2024-06-10T00:15:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.201+0000 7fad3e4ee640 1 -- 172.21.15.79:0/2861977515 wait complete. 2024-06-10T00:15:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.202+0000 7fad3e4ee640 1 Processor -- start 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad3e4ee640 1 -- start start 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad3e4ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad380720d0 0x7fad3814e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad3e4ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad380ccd30 0x7fad380cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad3e4ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3815be50 0x7fad380d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad3e4ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad3815c950 con 0x7fad380720d0 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad3e4ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad38072ed0 con 0x7fad380ccd30 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad3e4ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fad3815c230 con 0x7fad3815be50 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad380720d0 0x7fad3814e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad380720d0 0x7fad3814e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53086/0 (socket says 172.21.15.79:53086) 2024-06-10T00:15:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.203+0000 7fad37fff640 1 -- 172.21.15.79:0/101529346 learned_addr learned my addr 172.21.15.79:0/101529346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad37fff640 1 -- 172.21.15.79:0/101529346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3815be50 msgr2=0x7fad380d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad37fff640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3815be50 0x7fad380d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad37fff640 1 -- 172.21.15.79:0/101529346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad380ccd30 msgr2=0x7fad380cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad37fff640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad380ccd30 0x7fad380cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad37fff640 1 -- 172.21.15.79:0/101529346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad380d09e0 con 0x7fad380720d0 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad37fff640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad380720d0 0x7fad3814e6c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fad280097a0 tx=0x7fad280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad34ff9640 1 -- 172.21.15.79:0/101529346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28041070 con 0x7fad380720d0 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad34ff9640 1 -- 172.21.15.79:0/101529346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2803c890 con 0x7fad380720d0 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad380cf140 con 0x7fad380720d0 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad34ff9640 1 -- 172.21.15.79:0/101529346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28037040 con 0x7fad380720d0 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.204+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad38152710 con 0x7fad380720d0 2024-06-10T00:15:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.205+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad38068540 con 0x7fad380720d0 2024-06-10T00:15:30.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.206+0000 7fad34ff9640 1 -- 172.21.15.79:0/101529346 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad28044070 con 0x7fad380720d0 2024-06-10T00:15:30.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.206+0000 7fad34ff9640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2406be30 0x7fad2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:30.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.206+0000 7fad34ff9640 1 -- 172.21.15.79:0/101529346 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7fad280abba0 con 0x7fad380720d0 2024-06-10T00:15:30.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.206+0000 7fad377fe640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2406be30 0x7fad2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:30.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.206+0000 7fad377fe640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2406be30 0x7fad2406e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad3815afc0 tx=0x7fad2c0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:30.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.210+0000 7fad34ff9640 1 -- 172.21.15.79:0/101529346 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fad380d09e0 con 0x7fad380720d0 2024-06-10T00:15:30.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:30.384+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fad380ad530 con 0x7fad380720d0 2024-06-10T00:15:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.075+0000 7fad34ff9640 1 -- 172.21.15.79:0/101529346 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7fad2807a5e0 con 0x7fad380720d0 2024-06-10T00:15:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data_ec' removed 2024-06-10T00:15:31.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2406be30 msgr2=0x7fad2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:31.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2406be30 0x7fad2406e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad3815afc0 tx=0x7fad2c0079b0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad380720d0 msgr2=0x7fad3814e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad380720d0 0x7fad3814e6c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fad280097a0 tx=0x7fad280046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 shutdown_connections 2024-06-10T00:15:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2406be30 0x7fad2406e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3815be50 0x7fad380d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad380ccd30 0x7fad380cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 --2- 172.21.15.79:0/101529346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad380720d0 0x7fad3814e6c0 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fad280097a0 tx=0x7fad280046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 >> 172.21.15.79:0/101529346 conn(0x7fad380b1980 msgr2=0x7fad3809ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.079+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 shutdown_connections 2024-06-10T00:15:31.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.080+0000 7fad3e4ee640 1 -- 172.21.15.79:0/101529346 wait complete. 2024-06-10T00:15:31.093 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-10T00:15:31.093 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-10T00:15:31.093 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-10T00:15:31.093 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:31.093 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-10T00:15:31.093 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-10T00:15:31.094 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-10T00:15:31.094 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:31.094 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-10T00:15:31.094 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-10T00:15:31.094 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-10T00:15:31.094 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:31.094 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-10T00:15:31.094 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-10T00:15:31.095 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-10T00:15:31.095 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:31.105 INFO:tasks.ceph.mds.c:Stopped 2024-06-10T00:15:31.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-10T00:15:31.106 INFO:tasks.ceph.mds.a:Stopped 2024-06-10T00:15:31.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-10T00:15:31.107 INFO:tasks.ceph.mds.b:Stopped 2024-06-10T00:15:31.107 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-10T00:15:31.108 INFO:tasks.ceph.mds.d:Stopped 2024-06-10T00:15:31.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-10T00:15:31.148 INFO:tasks.ceph.mds.c:Started 2024-06-10T00:15:31.149 INFO:tasks.ceph.mds.a:Started 2024-06-10T00:15:31.149 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:31.149 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:31.150 INFO:tasks.ceph.mds.b:Started 2024-06-10T00:15:31.150 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:31.151 INFO:tasks.ceph.mds.d:Started 2024-06-10T00:15:31.151 DEBUG:teuthology.parallel:result is None 2024-06-10T00:15:31.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-10T00:15:31.225 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:15:31.225 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:15:31.232 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:15:31.232 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:15:31.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.256+0000 7fcc29f3b640 1 Processor -- start 2024-06-10T00:15:31.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.256+0000 7fcc29f3b640 1 -- start start 2024-06-10T00:15:31.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc29f3b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc240d2680 0x7fcc2415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:31.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc29f3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcc240d1fc0 0x7fcc240d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:31.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc29f3b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc240d2fa0 con 0x7fcc24161fa0 2024-06-10T00:15:31.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc29f3b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcc240cff80 con 0x7fcc240d1fc0 2024-06-10T00:15:31.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc29f3b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc240d13e0 con 0x7fcc240d2680 2024-06-10T00:15:31.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc22ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcc240d1fc0 0x7fcc240d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:31.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc23fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcc24161fa0 0x7fcc24162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41110/0 (socket says 172.21.15.79:41110) 2024-06-10T00:15:31.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc23fff640 1 -- 172.21.15.79:0/3625322303 learned_addr learned my addr 172.21.15.79:0/3625322303 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc237fe640 1 --2- 172.21.15.79:0/3625322303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc240d2680 0x7fcc2415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc22ffd640 1 -- 172.21.15.79:0/3625322303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc240d2680 msgr2=0x7fcc2415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc22ffd640 1 --2- 172.21.15.79:0/3625322303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc240d2680 0x7fcc2415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc22ffd640 1 -- 172.21.15.79:0/3625322303 >> v1:172.21.15.79:6789/0 conn(0x7fcc24161fa0 legacy=0x7fcc24162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc227fc640 1 -- 172.21.15.79:0/3625322303 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525797468 0 0) 0x7fcc240d2fa0 con 0x7fcc24161fa0 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.257+0000 7fcc22ffd640 1 -- 172.21.15.79:0/3625322303 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc240d0ad0 con 0x7fcc240d1fc0 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.258+0000 7fcc22ffd640 1 --2- 172.21.15.79:0/3625322303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240d2a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcc180097a0 tx=0x7fcc1802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1326f11e7a5b01 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.258+0000 7fcc227fc640 1 -- 172.21.15.79:0/3625322303 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18037070 con 0x7fcc240d1fc0 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.258+0000 7fcc227fc640 1 -- 172.21.15.79:0/3625322303 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18032440 con 0x7fcc240d1fc0 2024-06-10T00:15:31.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.258+0000 7fcc227fc640 1 -- 172.21.15.79:0/3625322303 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18032810 con 0x7fcc240d1fc0 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.259+0000 7fcc29f3b640 1 -- 172.21.15.79:0/3625322303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 msgr2=0x7fcc240d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.259+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/3625322303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240d2a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcc180097a0 tx=0x7fcc1802a180 comp rx=0 tx=0).stop 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.259+0000 7fcc29f3b640 1 -- 172.21.15.79:0/3625322303 shutdown_connections 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.259+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/3625322303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240d2a60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.259+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/3625322303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc240d2680 0x7fcc2415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.259+0000 7fcc29f3b640 1 -- 172.21.15.79:0/3625322303 >> 172.21.15.79:0/3625322303 conn(0x7fcc2409d3f0 msgr2=0x7fcc240d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.259+0000 7fcc29f3b640 1 -- 172.21.15.79:0/3625322303 shutdown_connections 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.259+0000 7fcc29f3b640 1 -- 172.21.15.79:0/3625322303 wait complete. 2024-06-10T00:15:31.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.260+0000 7fcc29f3b640 1 Processor -- start 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.260+0000 7fcc29f3b640 1 -- start start 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc29f3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc29f3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc240d2680 0x7fcc2415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc29f3b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc24161fa0 0x7fcc240cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc29f3b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcc240d1070 con 0x7fcc240d1fc0 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc29f3b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc240d0d90 con 0x7fcc240d2680 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc29f3b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc240d2400 con 0x7fcc24161fa0 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240b9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53144/0 (socket says 172.21.15.79:53144) 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 -- 172.21.15.79:0/1041690720 learned_addr learned my addr 172.21.15.79:0/1041690720 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc22ffd640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc240d2680 0x7fcc2415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc23fff640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc24161fa0 0x7fcc240cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 -- 172.21.15.79:0/1041690720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc24161fa0 msgr2=0x7fcc240cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc24161fa0 0x7fcc240cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 -- 172.21.15.79:0/1041690720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc240d2680 msgr2=0x7fcc2415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc240d2680 0x7fcc2415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 -- 172.21.15.79:0/1041690720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc240b87a0 con 0x7fcc240d1fc0 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.261+0000 7fcc237fe640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240b9840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400e9b0 tx=0x7fcc1400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.262+0000 7fcc0bfff640 1 -- 172.21.15.79:0/1041690720 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14017070 con 0x7fcc240d1fc0 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.262+0000 7fcc0bfff640 1 -- 172.21.15.79:0/1041690720 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1400c9a0 con 0x7fcc240d1fc0 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.262+0000 7fcc0bfff640 1 -- 172.21.15.79:0/1041690720 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400cd90 con 0x7fcc240d1fc0 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.262+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc240b8a80 con 0x7fcc240d1fc0 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.262+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc240b9040 con 0x7fcc240d1fc0 2024-06-10T00:15:31.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.263+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc24068430 con 0x7fcc240d1fc0 2024-06-10T00:15:31.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.263+0000 7fcc0bfff640 1 -- 172.21.15.79:0/1041690720 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc1401a070 con 0x7fcc240d1fc0 2024-06-10T00:15:31.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.263+0000 7fcc0bfff640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc1006be30 0x7fcc1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:31.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.264+0000 7fcc0bfff640 1 -- 172.21.15.79:0/1041690720 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7fcc1408b100 con 0x7fcc240d1fc0 2024-06-10T00:15:31.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.264+0000 7fcc22ffd640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc1006be30 0x7fcc1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:31.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.264+0000 7fcc22ffd640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc1006be30 0x7fcc1006e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcc18034000 tx=0x7fcc1802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:31.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.268+0000 7fcc0bfff640 1 -- 172.21.15.79:0/1041690720 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcc14059b90 con 0x7fcc240d1fc0 2024-06-10T00:15:31.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:31.456+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcc240d04e0 con 0x7fcc240d1fc0 2024-06-10T00:15:32.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.088+0000 7fcc0bfff640 1 -- 172.21.15.79:0/1041690720 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7fcc14059490 con 0x7fcc240d1fc0 2024-06-10T00:15:32.088 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc1006be30 msgr2=0x7fcc1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc1006be30 0x7fcc1006e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcc18034000 tx=0x7fcc1802e000 comp rx=0 tx=0).stop 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 msgr2=0x7fcc240b9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240b9840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400e9b0 tx=0x7fcc1400ee70 comp rx=0 tx=0).stop 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 shutdown_connections 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcc1006be30 0x7fcc1006e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc24161fa0 0x7fcc240cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc240d2680 0x7fcc2415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 --2- 172.21.15.79:0/1041690720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc240d1fc0 0x7fcc240b9840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 >> 172.21.15.79:0/1041690720 conn(0x7fcc2409d3f0 msgr2=0x7fcc241605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 shutdown_connections 2024-06-10T00:15:32.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.091+0000 7fcc29f3b640 1 -- 172.21.15.79:0/1041690720 wait complete. 2024-06-10T00:15:32.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-10T00:15:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.204+0000 7f9024e95640 1 Processor -- start 2024-06-10T00:15:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.204+0000 7f9024e95640 1 -- start start 2024-06-10T00:15:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f9024e95640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90200aef70 0x7f90200b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f9024e95640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f90200b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f9024e95640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902015ac50 con 0x7f902015a870 2024-06-10T00:15:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f9024e95640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f90200b4fe0 con 0x7f90200aef70 2024-06-10T00:15:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f9024e95640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f902006cdb0 con 0x7f90200af3b0 2024-06-10T00:15:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f901ed9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f90200b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f901dd9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90200aef70 0x7f90200b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f901ed9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f90200b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:53312/0 (socket says 172.21.15.79:53312) 2024-06-10T00:15:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f901ed9d640 1 -- 172.21.15.79:0/3984496139 learned_addr learned my addr 172.21.15.79:0/3984496139 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f901dd9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90200aef70 0x7f90200b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:38772/0 (socket says 172.21.15.79:38772) 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.205+0000 7f901e59c640 1 --1- 172.21.15.79:0/3984496139 >> v1:172.21.15.117:6789/0 conn(0x7f902015a870 0x7f902006de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:60378/0 (socket says 172.21.15.79:60378) 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.206+0000 7f901dd9b640 1 -- 172.21.15.79:0/3984496139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 msgr2=0x7f90200b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.206+0000 7f901dd9b640 1 --2- 172.21.15.79:0/3984496139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f90200b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.206+0000 7f901dd9b640 1 -- 172.21.15.79:0/3984496139 >> v1:172.21.15.117:6789/0 conn(0x7f902015a870 legacy=0x7f902006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.206+0000 7f901dd9b640 1 -- 172.21.15.79:0/3984496139 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902006d090 con 0x7f90200aef70 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.206+0000 7f901ed9d640 1 --2- 172.21.15.79:0/3984496139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f90200b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.206+0000 7f901dd9b640 1 --2- 172.21.15.79:0/3984496139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 0x7f90200b4560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90140097a0 tx=0x7f901402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff356ff41dd4d60 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f901d59a640 1 -- 172.21.15.79:0/3984496139 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014037070 con 0x7f90200aef70 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f901d59a640 1 -- 172.21.15.79:0/3984496139 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901402adb0 con 0x7f90200aef70 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f901d59a640 1 -- 172.21.15.79:0/3984496139 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014032660 con 0x7f90200aef70 2024-06-10T00:15:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f9024e95640 1 -- 172.21.15.79:0/3984496139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 msgr2=0x7f90200b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f9024e95640 1 --2- 172.21.15.79:0/3984496139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 0x7f90200b4560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90140097a0 tx=0x7f901402a060 comp rx=0 tx=0).stop 2024-06-10T00:15:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f9024e95640 1 -- 172.21.15.79:0/3984496139 shutdown_connections 2024-06-10T00:15:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f9024e95640 1 --2- 172.21.15.79:0/3984496139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f90200b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f9024e95640 1 --2- 172.21.15.79:0/3984496139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 0x7f90200b4560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f9024e95640 1 -- 172.21.15.79:0/3984496139 >> 172.21.15.79:0/3984496139 conn(0x7f90200b19f0 msgr2=0x7f90200b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f9024e95640 1 -- 172.21.15.79:0/3984496139 shutdown_connections 2024-06-10T00:15:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.207+0000 7f9024e95640 1 -- 172.21.15.79:0/3984496139 wait complete. 2024-06-10T00:15:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.208+0000 7f9024e95640 1 Processor -- start 2024-06-10T00:15:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f9024e95640 1 -- start start 2024-06-10T00:15:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f9024e95640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 0x7f9020154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f9024e95640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f902015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f9024e95640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902015a870 0x7f90200cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f9024e95640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f902006d930 con 0x7f902015a870 2024-06-10T00:15:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f9024e95640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f902006d650 con 0x7f90200aef70 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f9024e95640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90200b2e40 con 0x7f90200af3b0 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f901ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902015a870 0x7f90200cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f901ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902015a870 0x7f90200cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53156/0 (socket says 172.21.15.79:53156) 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.209+0000 7f901ed9d640 1 -- 172.21.15.79:0/3397968447 learned_addr learned my addr 172.21.15.79:0/3397968447 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901e59c640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 0x7f9020154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901dd9b640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f902015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901ed9d640 1 -- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 msgr2=0x7f902015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901ed9d640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f902015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901ed9d640 1 -- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 msgr2=0x7f9020154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901ed9d640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 0x7f9020154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901ed9d640 1 -- 172.21.15.79:0/3397968447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9020154f70 con 0x7f902015a870 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901e59c640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 0x7f9020154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f901ed9d640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902015a870 0x7f90200cdb40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9018009e20 tx=0x7f90180075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f900effd640 1 -- 172.21.15.79:0/3397968447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018003990 con 0x7f902015a870 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f900effd640 1 -- 172.21.15.79:0/3397968447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9018003b30 con 0x7f902015a870 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f900effd640 1 -- 172.21.15.79:0/3397968447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018004020 con 0x7f902015a870 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902009ab40 con 0x7f902015a870 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.210+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902009b100 con 0x7f902015a870 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.211+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9020068430 con 0x7f902015a870 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.211+0000 7f900effd640 1 -- 172.21.15.79:0/3397968447 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9018005d10 con 0x7f902015a870 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.212+0000 7f900effd640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f900006be30 0x7f900006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.212+0000 7f900effd640 1 -- 172.21.15.79:0/3397968447 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f901808ad80 con 0x7f902015a870 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.212+0000 7f901e59c640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f900006be30 0x7f900006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.212+0000 7f901e59c640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f900006be30 0x7f900006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9010000f60 tx=0x7f9010009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.216+0000 7f900effd640 1 -- 172.21.15.79:0/3397968447 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9018022020 con 0x7f902015a870 2024-06-10T00:15:32.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.457+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f90200b2650 con 0x7f902015a870 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.457+0000 7f900effd640 1 -- 172.21.15.79:0/3397968447 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f9018011070 con 0x7f902015a870 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA==", 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow==", 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ==", 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw==", 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-06-10T00:15:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw==", 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg==", 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:15:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg==", 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g==", 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw==", 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:15:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw==", 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ==", 2024-06-10T00:15:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA==", 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw==", 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-06-10T00:15:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA==", 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A==", 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:15:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw==", 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:15:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmQYVlARAAk+Jo8bykvpKKZY5XAPe2ZA==", 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mds", 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBaRWZmrve+OhAAxrVdl3lrSlHP7kTD5bE9Mw==", 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mds" 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mgr", 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBaRWZmNAC/OhAA1x0xRvY+xREh+HVnU07rOQ==", 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mgr" 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-osd", 2024-06-10T00:15:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBaRWZmZge/OhAAUp3cB47eE+Hh3GKaojRT1A==", 2024-06-10T00:15:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-osd" 2024-06-10T00:15:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd", 2024-06-10T00:15:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBaRWZmKA6/OhAAzArq774h6QpsHUfEPnwqCA==", 2024-06-10T00:15:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd" 2024-06-10T00:15:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-06-10T00:15:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBaRWZmJSK/OhAAcAjuRb84Aqb9sHrNcGt9WA==", 2024-06-10T00:15:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-06-10T00:15:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rgw", 2024-06-10T00:15:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBaRWZmKCm/OhAAkTTDYR0jYc043fvmjmHbUg==", 2024-06-10T00:15:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rgw" 2024-06-10T00:15:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-06-10T00:15:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA==", 2024-06-10T00:15:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:15:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:15:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-06-10T00:15:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw==", 2024-06-10T00:15:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:15:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:15:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:15:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:15:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-10T00:15:32.478 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:15:32.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f900006be30 msgr2=0x7f900006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f900006be30 0x7f900006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9010000f60 tx=0x7f9010009040 comp rx=0 tx=0).stop 2024-06-10T00:15:32.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902015a870 msgr2=0x7f90200cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902015a870 0x7f90200cdb40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9018009e20 tx=0x7f90180075c0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 shutdown_connections 2024-06-10T00:15:32.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f900006be30 0x7f900006e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902015a870 0x7f90200cdb40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200af3b0 0x7f902015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 --2- 172.21.15.79:0/3397968447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200aef70 0x7f9020154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 >> 172.21.15.79:0/3397968447 conn(0x7f90200b19f0 msgr2=0x7f90200cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:32.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 shutdown_connections 2024-06-10T00:15:32.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.459+0000 7f9024e95640 1 -- 172.21.15.79:0/3397968447 wait complete. 2024-06-10T00:15:32.482 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-06-10T00:15:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.583+0000 7fe8fcc9a640 1 Processor -- start 2024-06-10T00:15:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.583+0000 7fe8fcc9a640 1 -- start start 2024-06-10T00:15:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.584+0000 7fe8fcc9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8f80d1fc0 0x7fe8f80cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.584+0000 7fe8fcc9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f815f5e0 con 0x7fe8f815f1a0 2024-06-10T00:15:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.584+0000 7fe8fcc9a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f80d2450 con 0x7fe8f80d2680 2024-06-10T00:15:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.584+0000 7fe8fcc9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80d13e0 con 0x7fe8f80d1fc0 2024-06-10T00:15:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.584+0000 7fe8f5d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe8f815f1a0 0x7fe8f80cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41122/0 (socket says 172.21.15.79:41122) 2024-06-10T00:15:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.584+0000 7fe8f5d9b640 1 -- 172.21.15.79:0/1992945374 learned_addr learned my addr 172.21.15.79:0/1992945374 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f6d9d640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8f80d1fc0 0x7fe8f80cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3472376909 0 0) 0x7fe8f815f5e0 con 0x7fe8f815f1a0 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e0003520 con 0x7fe8f815f1a0 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 463903515 0 0) 0x7fe8e0003520 con 0x7fe8f815f1a0 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8f80d1fc0 msgr2=0x7fe8f80cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8f80d1fc0 0x7fe8f80cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 >> v1:172.21.15.117:6789/0 conn(0x7fe8f80d2680 legacy=0x7fe8f80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80d0ad0 con 0x7fe8f815f1a0 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fe8ec001670 con 0x7fe8f815f1a0 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 >> v1:172.21.15.79:6789/0 conn(0x7fe8f815f1a0 legacy=0x7fe8f80cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e00039e0 0x7fe8e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0004390 0x7fe8e0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8f80d1fc0 0x7fe8e00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80d13e0 con 0x7fe8e00039e0 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e000b9c0 con 0x7fe8e0004390 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e000bbc0 con 0x7fe8f80d1fc0 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f659c640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e00039e0 0x7fe8e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f5d9b640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0004390 0x7fe8e0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f6d9d640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8f80d1fc0 0x7fe8e00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f659c640 1 -- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8f80d1fc0 msgr2=0x7fe8e00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f659c640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8f80d1fc0 0x7fe8e00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f659c640 1 -- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0004390 msgr2=0x7fe8e0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f659c640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0004390 0x7fe8e0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f659c640 1 -- 172.21.15.79:0/1992945374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e0003520 con 0x7fe8e00039e0 2024-06-10T00:15:32.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.585+0000 7fe8f5d9b640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0004390 0x7fe8e0004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.586+0000 7fe8f659c640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e00039e0 0x7fe8e0003dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8001f60 tx=0x7fe8e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e235cf80f1b04 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.586+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8001b30 con 0x7fe8e00039e0 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.586+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e8031620 con 0x7fe8e00039e0 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.586+0000 7fe8f559a640 1 -- 172.21.15.79:0/1992945374 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8031a10 con 0x7fe8e00039e0 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.587+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/1992945374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e00039e0 msgr2=0x7fe8e0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.587+0000 7fe8fcc9a640 1 --2- 172.21.15.79:0/1992945374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e00039e0 0x7fe8e0003dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8001f60 tx=0x7fe8e0005830 comp rx=0 tx=0).stop 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.587+0000 7fe8f6d9d640 1 -- 172.21.15.79:0/1992945374 reap_dead start 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.587+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/1992945374 shutdown_connections 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.587+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/1992945374 >> 172.21.15.79:0/1992945374 conn(0x7fe8f809d3f0 msgr2=0x7fe8f80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.587+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/1992945374 shutdown_connections 2024-06-10T00:15:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.587+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/1992945374 wait complete. 2024-06-10T00:15:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.588+0000 7fe8fcc9a640 1 Processor -- start 2024-06-10T00:15:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.588+0000 7fe8fcc9a640 1 -- start start 2024-06-10T00:15:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8fcc9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8e00039e0 0x7fe8f814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8fcc9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80b80f0 0x7fe8f80c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8fcc9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f80b8550 0x7fe8f80b9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8fcc9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80d1070 con 0x7fe8f80b80f0 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8fcc9a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80d0d90 con 0x7fe8f80b8550 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8fcc9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80d4f00 con 0x7fe8e00039e0 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80b80f0 0x7fe8f80c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80b80f0 0x7fe8f80c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53170/0 (socket says 172.21.15.79:53170) 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f5d9b640 1 -- 172.21.15.79:0/2371447220 learned_addr learned my addr 172.21.15.79:0/2371447220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f659c640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8e00039e0 0x7fe8f814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f6d9d640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f80b8550 0x7fe8f80b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f5d9b640 1 -- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8e00039e0 msgr2=0x7fe8f814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f5d9b640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8e00039e0 0x7fe8f814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f5d9b640 1 -- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f80b8550 msgr2=0x7fe8f80b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f5d9b640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f80b8550 0x7fe8f80b9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f5d9b640 1 -- 172.21.15.79:0/2371447220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80b7050 con 0x7fe8f80b80f0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.589+0000 7fe8f6d9d640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f80b8550 0x7fe8f80b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.590+0000 7fe8f5d9b640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80b80f0 0x7fe8f80c9ed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00e860 tx=0x7fe8ec00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.590+0000 7fe8e6ffd640 1 -- 172.21.15.79:0/2371447220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec00c8d0 con 0x7fe8f80b80f0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.590+0000 7fe8e6ffd640 1 -- 172.21.15.79:0/2371447220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec018070 con 0x7fe8f80b80f0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.590+0000 7fe8e6ffd640 1 -- 172.21.15.79:0/2371447220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec00cc70 con 0x7fe8f80b80f0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.590+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f80b7330 con 0x7fe8f80b80f0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.590+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f80b78f0 con 0x7fe8f80b80f0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.591+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f8068430 con 0x7fe8f80b80f0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.591+0000 7fe8e6ffd640 1 -- 172.21.15.79:0/2371447220 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8ec01d460 con 0x7fe8f80b80f0 2024-06-10T00:15:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.591+0000 7fe8e6ffd640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.592+0000 7fe8e6ffd640 1 -- 172.21.15.79:0/2371447220 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fe8ec08aaf0 con 0x7fe8f80b80f0 2024-06-10T00:15:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.592+0000 7fe8f659c640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.592+0000 7fe8f659c640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe8d806be30 0x7fe8d806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8001f60 tx=0x7fe8e802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.596+0000 7fe8e6ffd640 1 -- 172.21.15.79:0/2371447220 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe8ec0595d0 con 0x7fe8f80b80f0 2024-06-10T00:15:32.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.834+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fe8f80d04e0 con 0x7fe8f80b80f0 2024-06-10T00:15:32.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.836+0000 7fe8e6ffd640 1 -- 172.21.15.79:0/2371447220 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fe8ec058ed0 con 0x7fe8f80b80f0 2024-06-10T00:15:32.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe8d806be30 msgr2=0x7fe8d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe8d806be30 0x7fe8d806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8001f60 tx=0x7fe8e802f000 comp rx=0 tx=0).stop 2024-06-10T00:15:32.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80b80f0 msgr2=0x7fe8f80c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80b80f0 0x7fe8f80c9ed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00e860 tx=0x7fe8ec00ed20 comp rx=0 tx=0).stop 2024-06-10T00:15:32.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 shutdown_connections 2024-06-10T00:15:32.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f80b8550 0x7fe8f80b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80b80f0 0x7fe8f80c9ed0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 --2- 172.21.15.79:0/2371447220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8e00039e0 0x7fe8f814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 >> 172.21.15.79:0/2371447220 conn(0x7fe8f809d3f0 msgr2=0x7fe8f8160b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:32.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 shutdown_connections 2024-06-10T00:15:32.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.838+0000 7fe8fcc9a640 1 -- 172.21.15.79:0/2371447220 wait complete. 2024-06-10T00:15:32.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-06-10T00:15:32.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.950+0000 7fb2adcdf640 1 Processor -- start 2024-06-10T00:15:32.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.950+0000 7fb2adcdf640 1 -- start start 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.950+0000 7fb2adcdf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb2a815f1a0 0x7fb2a80d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.950+0000 7fb2adcdf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a815f5e0 con 0x7fb2a80d2680 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.950+0000 7fb2adcdf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a80d0ad0 con 0x7fb2a80cef70 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.950+0000 7fb2adcdf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb2a80d13e0 con 0x7fb2a815f1a0 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb2a80d2680 0x7fb2a80d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41128/0 (socket says 172.21.15.79:41128) 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a77fe640 1 -- 172.21.15.79:0/3633764337 learned_addr learned my addr 172.21.15.79:0/3633764337 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63466384 0 0) 0x7fb2a815f5e0 con 0x7fb2a80d2680 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb294003520 con 0x7fb2a80d2680 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb29ffff640 1 --2- 172.21.15.79:0/3633764337 >> v2:172.21.15.117:3300/0 conn(0x7fb2a815f1a0 0x7fb2a80d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1258749658 0 0) 0x7fb294003520 con 0x7fb2a80d2680 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 >> v2:172.21.15.117:3300/0 conn(0x7fb2a815f1a0 msgr2=0x7fb2a80d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 --2- 172.21.15.79:0/3633764337 >> v2:172.21.15.117:3300/0 conn(0x7fb2a815f1a0 0x7fb2a80d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 >> v1:172.21.15.117:6789/0 conn(0x7fb2a80cef70 legacy=0x7fb2a80cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a815f890 con 0x7fb2a80d2680 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fb298001670 con 0x7fb2a80d2680 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 >> v1:172.21.15.79:6789/0 conn(0x7fb2a80d2680 legacy=0x7fb2a80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2940039b0 0x7fb294003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb294004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2940051c0 0x7fb29400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a80d13e0 con 0x7fb294004800 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb29400c060 con 0x7fb2940039b0 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb29400c260 con 0x7fb2940051c0 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb29ffff640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb294004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a77fe640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2940039b0 0x7fb294003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.951+0000 7fb2a7fff640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2940051c0 0x7fb29400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb29ffff640 1 -- 172.21.15.79:0/3633764337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2940051c0 msgr2=0x7fb29400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb29ffff640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2940051c0 0x7fb29400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb29ffff640 1 -- 172.21.15.79:0/3633764337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2940039b0 msgr2=0x7fb294003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb29ffff640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2940039b0 0x7fb294003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb29ffff640 1 -- 172.21.15.79:0/3633764337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb294003520 con 0x7fb294004800 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb2a7fff640 1 -- 172.21.15.79:0/3633764337 reap_dead start 2024-06-10T00:15:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb29ffff640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb294004c80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb290009ac0 tx=0x7fb294005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4274a9f4e8b288f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290036070 con 0x7fb294004800 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb290031400 con 0x7fb294004800 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.952+0000 7fb2a6ffd640 1 -- 172.21.15.79:0/3633764337 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290009690 con 0x7fb294004800 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.953+0000 7fb2adcdf640 1 -- 172.21.15.79:0/3633764337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 msgr2=0x7fb294004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.953+0000 7fb2adcdf640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb294004c80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb290009ac0 tx=0x7fb294005830 comp rx=0 tx=0).stop 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.953+0000 7fb2adcdf640 1 -- 172.21.15.79:0/3633764337 shutdown_connections 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.953+0000 7fb2adcdf640 1 --2- 172.21.15.79:0/3633764337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb294004c80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.953+0000 7fb2adcdf640 1 -- 172.21.15.79:0/3633764337 >> 172.21.15.79:0/3633764337 conn(0x7fb2a809d3f0 msgr2=0x7fb2a80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.953+0000 7fb2adcdf640 1 -- 172.21.15.79:0/3633764337 shutdown_connections 2024-06-10T00:15:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.953+0000 7fb2adcdf640 1 -- 172.21.15.79:0/3633764337 wait complete. 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.954+0000 7fb2adcdf640 1 Processor -- start 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.954+0000 7fb2adcdf640 1 -- start start 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2adcdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb2a80cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2adcdf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a8151750 0x7fb2a815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2adcdf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a80c91f0 0x7fb2a80c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2adcdf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a80d4f00 con 0x7fb294004800 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2adcdf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a80d1070 con 0x7fb2a8151750 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2adcdf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a80d1870 con 0x7fb2a80c91f0 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb2a80cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb2a80cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53190/0 (socket says 172.21.15.79:53190) 2024-06-10T00:15:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 -- 172.21.15.79:0/800775906 learned_addr learned my addr 172.21.15.79:0/800775906 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a7fff640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a80c91f0 0x7fb2a80c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb29ffff640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a8151750 0x7fb2a815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 -- 172.21.15.79:0/800775906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a80c91f0 msgr2=0x7fb2a80c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a80c91f0 0x7fb2a80c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 -- 172.21.15.79:0/800775906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a8151750 msgr2=0x7fb2a815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a8151750 0x7fb2a815e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 -- 172.21.15.79:0/800775906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a80ccbc0 con 0x7fb294004800 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.955+0000 7fb2a77fe640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb2a80cdaa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb298007290 tx=0x7fb298007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.956+0000 7fb2a4ff9640 1 -- 172.21.15.79:0/800775906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29800f860 con 0x7fb294004800 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.956+0000 7fb2a4ff9640 1 -- 172.21.15.79:0/800775906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb298018070 con 0x7fb294004800 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.956+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a80cc8e0 con 0x7fb294004800 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.956+0000 7fb2a4ff9640 1 -- 172.21.15.79:0/800775906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29800fc60 con 0x7fb294004800 2024-06-10T00:15:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.956+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a80cd2a0 con 0x7fb294004800 2024-06-10T00:15:32.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.957+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a8068430 con 0x7fb294004800 2024-06-10T00:15:32.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.957+0000 7fb2a4ff9640 1 -- 172.21.15.79:0/800775906 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb29801d460 con 0x7fb294004800 2024-06-10T00:15:32.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.957+0000 7fb2a4ff9640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb28806be30 0x7fb28806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:32.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.958+0000 7fb29ffff640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb28806be30 0x7fb28806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:32.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.958+0000 7fb2a4ff9640 1 -- 172.21.15.79:0/800775906 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fb29808ab70 con 0x7fb294004800 2024-06-10T00:15:32.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.958+0000 7fb29ffff640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb28806be30 0x7fb28806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb290033000 tx=0x7fb290008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:32.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:32.962+0000 7fb2a4ff9640 1 -- 172.21.15.79:0/800775906 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb298059090 con 0x7fb294004800 2024-06-10T00:15:33.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.207+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fb2a80d04e0 con 0x7fb294004800 2024-06-10T00:15:33.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.209+0000 7fb2a4ff9640 1 -- 172.21.15.79:0/800775906 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fb29805d390 con 0x7fb294004800 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb28806be30 msgr2=0x7fb28806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb28806be30 0x7fb28806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb290033000 tx=0x7fb290008030 comp rx=0 tx=0).stop 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 msgr2=0x7fb2a80cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb2a80cdaa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb298007290 tx=0x7fb298007750 comp rx=0 tx=0).stop 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 shutdown_connections 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb28806be30 0x7fb28806e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a80c91f0 0x7fb2a80c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a8151750 0x7fb2a815e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 --2- 172.21.15.79:0/800775906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb294004800 0x7fb2a80cdaa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 >> 172.21.15.79:0/800775906 conn(0x7fb2a809d3f0 msgr2=0x7fb2a80d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 shutdown_connections 2024-06-10T00:15:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.211+0000 7fb2adcdf640 1 -- 172.21.15.79:0/800775906 wait complete. 2024-06-10T00:15:33.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-06-10T00:15:33.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.322+0000 7fce41810640 1 Processor -- start 2024-06-10T00:15:33.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.322+0000 7fce41810640 1 -- start start 2024-06-10T00:15:33.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce41810640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce3c0cd230 0x7fce3c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce41810640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c0cec50 0x7fce3c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce41810640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3c0b3420 con 0x7fce3c1553c0 2024-06-10T00:15:33.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce41810640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fce3c0cc750 con 0x7fce3c0cd230 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce41810640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c0cca30 con 0x7fce3c0cec50 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce3a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce3c0cd230 0x7fce3c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce3b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c0cec50 0x7fce3c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce3a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce3c0cd230 0x7fce3c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:38830/0 (socket says 172.21.15.79:38830) 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.323+0000 7fce3a7fc640 1 -- 172.21.15.79:0/1339252451 learned_addr learned my addr 172.21.15.79:0/1339252451 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.324+0000 7fce3b7fe640 1 -- 172.21.15.79:0/1339252451 >> v2:172.21.15.117:3300/0 conn(0x7fce3c0cd230 msgr2=0x7fce3c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.324+0000 7fce3b7fe640 1 --2- 172.21.15.79:0/1339252451 >> v2:172.21.15.117:3300/0 conn(0x7fce3c0cd230 0x7fce3c0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.324+0000 7fce3b7fe640 1 -- 172.21.15.79:0/1339252451 >> v1:172.21.15.117:6789/0 conn(0x7fce3c1553c0 legacy=0x7fce3c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.324+0000 7fce3b7fe640 1 -- 172.21.15.79:0/1339252451 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c0ccd10 con 0x7fce3c0cec50 2024-06-10T00:15:33.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.324+0000 7fce3a7fc640 1 --2- 172.21.15.79:0/1339252451 >> v2:172.21.15.117:3300/0 conn(0x7fce3c0cd230 0x7fce3c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:33.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce3b7fe640 1 --2- 172.21.15.79:0/1339252451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c0cec50 0x7fce3c0cf0e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fce34009d90 tx=0x7fce3402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf8220e39275519a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce39ffb640 1 -- 172.21.15.79:0/1339252451 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34007740 con 0x7fce3c0cec50 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce39ffb640 1 -- 172.21.15.79:0/1339252451 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce340078e0 con 0x7fce3c0cec50 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce39ffb640 1 -- 172.21.15.79:0/1339252451 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34007cb0 con 0x7fce3c0cec50 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce41810640 1 -- 172.21.15.79:0/1339252451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c0cec50 msgr2=0x7fce3c0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce41810640 1 --2- 172.21.15.79:0/1339252451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c0cec50 0x7fce3c0cf0e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fce34009d90 tx=0x7fce3402a660 comp rx=0 tx=0).stop 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce41810640 1 -- 172.21.15.79:0/1339252451 shutdown_connections 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce41810640 1 --2- 172.21.15.79:0/1339252451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c0cec50 0x7fce3c0cf0e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce41810640 1 --2- 172.21.15.79:0/1339252451 >> v2:172.21.15.117:3300/0 conn(0x7fce3c0cd230 0x7fce3c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce41810640 1 -- 172.21.15.79:0/1339252451 >> 172.21.15.79:0/1339252451 conn(0x7fce3c0b19f0 msgr2=0x7fce3c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce41810640 1 -- 172.21.15.79:0/1339252451 shutdown_connections 2024-06-10T00:15:33.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.325+0000 7fce41810640 1 -- 172.21.15.79:0/1339252451 wait complete. 2024-06-10T00:15:33.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.326+0000 7fce41810640 1 Processor -- start 2024-06-10T00:15:33.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.327+0000 7fce41810640 1 -- start start 2024-06-10T00:15:33.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.327+0000 7fce41810640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c0cd230 0x7fce3c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.327+0000 7fce41810640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3c0cec50 0x7fce3c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.327+0000 7fce41810640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c1553c0 0x7fce3c145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.327+0000 7fce41810640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c155920 con 0x7fce3c0cec50 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.327+0000 7fce41810640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1557a0 con 0x7fce3c0cd230 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.327+0000 7fce41810640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c071030 con 0x7fce3c1553c0 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.327+0000 7fce3a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3c0cec50 0x7fce3c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3c0cec50 0x7fce3c0cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53204/0 (socket says 172.21.15.79:53204) 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3a7fc640 1 -- 172.21.15.79:0/3416157806 learned_addr learned my addr 172.21.15.79:0/3416157806 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3affd640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c0cd230 0x7fce3c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3b7fe640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c1553c0 0x7fce3c145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3a7fc640 1 -- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c1553c0 msgr2=0x7fce3c145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3a7fc640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c1553c0 0x7fce3c145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3a7fc640 1 -- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c0cd230 msgr2=0x7fce3c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3a7fc640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c0cd230 0x7fce3c15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3a7fc640 1 -- 172.21.15.79:0/3416157806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c15d2f0 con 0x7fce3c0cec50 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3b7fe640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c1553c0 0x7fce3c145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3affd640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c0cd230 0x7fce3c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce3a7fc640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3c0cec50 0x7fce3c0cddb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce30010f40 tx=0x7fce3000e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce23fff640 1 -- 172.21.15.79:0/3416157806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3001e070 con 0x7fce3c0cec50 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce23fff640 1 -- 172.21.15.79:0/3416157806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce30011860 con 0x7fce3c0cec50 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c15c6e0 con 0x7fce3c0cec50 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce23fff640 1 -- 172.21.15.79:0/3416157806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30011c10 con 0x7fce3c0cec50 2024-06-10T00:15:33.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.328+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c15cf80 con 0x7fce3c0cec50 2024-06-10T00:15:33.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.329+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c15cad0 con 0x7fce3c0cec50 2024-06-10T00:15:33.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.330+0000 7fce23fff640 1 -- 172.21.15.79:0/3416157806 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce30021070 con 0x7fce3c0cec50 2024-06-10T00:15:33.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.330+0000 7fce23fff640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce2806be30 0x7fce2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.330+0000 7fce23fff640 1 -- 172.21.15.79:0/3416157806 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fce3008d850 con 0x7fce3c0cec50 2024-06-10T00:15:33.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.330+0000 7fce3affd640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce2806be30 0x7fce2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.330+0000 7fce3affd640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce2806be30 0x7fce2806e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce2c001660 tx=0x7fce2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:33.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.334+0000 7fce23fff640 1 -- 172.21.15.79:0/3416157806 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fce3005c340 con 0x7fce3c0cec50 2024-06-10T00:15:33.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.578+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fce3c154d30 con 0x7fce3c0cec50 2024-06-10T00:15:33.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.580+0000 7fce23fff640 1 -- 172.21.15.79:0/3416157806 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fce3005bc40 con 0x7fce3c0cec50 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce2806be30 msgr2=0x7fce2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce2806be30 0x7fce2806e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce2c001660 tx=0x7fce2c009040 comp rx=0 tx=0).stop 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3c0cec50 msgr2=0x7fce3c0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3c0cec50 0x7fce3c0cddb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce30010f40 tx=0x7fce3000e7f0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 shutdown_connections 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce2806be30 0x7fce2806e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c1553c0 0x7fce3c145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3c0cec50 0x7fce3c0cddb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 --2- 172.21.15.79:0/3416157806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c0cd230 0x7fce3c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 >> 172.21.15.79:0/3416157806 conn(0x7fce3c0b19f0 msgr2=0x7fce3c0b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:33.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 shutdown_connections 2024-06-10T00:15:33.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.582+0000 7fce41810640 1 -- 172.21.15.79:0/3416157806 wait complete. 2024-06-10T00:15:33.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-06-10T00:15:33.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.693+0000 7fa4d6d14640 1 Processor -- start 2024-06-10T00:15:33.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.693+0000 7fa4d6d14640 1 -- start start 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.693+0000 7fa4d6d14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa4d015f1a0 0x7fa4d00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.693+0000 7fa4d6d14640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d015f5e0 con 0x7fa4d00cef70 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.693+0000 7fa4d6d14640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d00d0ad0 con 0x7fa4d00d2680 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.693+0000 7fa4d6d14640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d00d13e0 con 0x7fa4d015f1a0 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4d52b1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa4d00cef70 0x7fa4d00cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41132/0 (socket says 172.21.15.79:41132) 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4d52b1640 1 -- 172.21.15.79:0/4051359454 learned_addr learned my addr 172.21.15.79:0/4051359454 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725271274 0 0) 0x7fa4d015f5e0 con 0x7fa4d00cef70 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c0003520 con 0x7fa4d00cef70 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cffff640 1 --2- 172.21.15.79:0/4051359454 >> v2:172.21.15.117:3300/0 conn(0x7fa4d015f1a0 0x7fa4d00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1229476129 0 0) 0x7fa4c0003520 con 0x7fa4d00cef70 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 >> v2:172.21.15.117:3300/0 conn(0x7fa4d015f1a0 msgr2=0x7fa4d00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 --2- 172.21.15.79:0/4051359454 >> v2:172.21.15.117:3300/0 conn(0x7fa4d015f1a0 0x7fa4d00d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 >> v1:172.21.15.117:6789/0 conn(0x7fa4d00d2680 legacy=0x7fa4d00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d015f890 con 0x7fa4d00cef70 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fa4c80019f0 con 0x7fa4d00cef70 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 >> v1:172.21.15.79:6789/0 conn(0x7fa4d00cef70 legacy=0x7fa4d00cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c00039b0 0x7fa4c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4c0004800 0x7fa4c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d00d13e0 con 0x7fa4c00051c0 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c000c060 con 0x7fa4c00039b0 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c000c260 con 0x7fa4c0004800 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4d52b1640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4d4ab0640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c00039b0 0x7fa4c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.694+0000 7fa4cffff640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4c0004800 0x7fa4c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4d52b1640 1 -- 172.21.15.79:0/4051359454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4c0004800 msgr2=0x7fa4c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4d52b1640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4c0004800 0x7fa4c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4d52b1640 1 -- 172.21.15.79:0/4051359454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c00039b0 msgr2=0x7fa4c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4d52b1640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c00039b0 0x7fa4c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4d52b1640 1 -- 172.21.15.79:0/4051359454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c0003520 con 0x7fa4c00051c0 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4d52b1640 1 -- 172.21.15.79:0/4051359454 reap_dead start 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4d52b1640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4c000b9c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800a860 tx=0x7fa4c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fee0fc52d10763 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800a480 con 0x7fa4c00051c0 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c802f070 con 0x7fa4c00051c0 2024-06-10T00:15:33.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.695+0000 7fa4cf7fe640 1 -- 172.21.15.79:0/4051359454 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c802bcc0 con 0x7fa4c00051c0 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.696+0000 7fa4d6d14640 1 -- 172.21.15.79:0/4051359454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 msgr2=0x7fa4c000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.696+0000 7fa4d6d14640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4c000b9c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800a860 tx=0x7fa4c0005830 comp rx=0 tx=0).stop 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.696+0000 7fa4d6d14640 1 -- 172.21.15.79:0/4051359454 shutdown_connections 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.696+0000 7fa4d6d14640 1 --2- 172.21.15.79:0/4051359454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4c000b9c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.696+0000 7fa4d6d14640 1 -- 172.21.15.79:0/4051359454 >> 172.21.15.79:0/4051359454 conn(0x7fa4d009d3f0 msgr2=0x7fa4d00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.696+0000 7fa4d6d14640 1 -- 172.21.15.79:0/4051359454 shutdown_connections 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.696+0000 7fa4d6d14640 1 -- 172.21.15.79:0/4051359454 wait complete. 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.697+0000 7fa4d6d14640 1 Processor -- start 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.697+0000 7fa4d6d14640 1 -- start start 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d6d14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4d00c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d6d14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4d0155820 0x7fa4d01551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d6d14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4d00cb190 0x7fa4d015c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d6d14640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d00d4f00 con 0x7fa4c00051c0 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d6d14640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d00d1070 con 0x7fa4d00cb190 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d6d14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d00d1870 con 0x7fa4d0155820 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d4ab0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4d00c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d4ab0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4d00c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53222/0 (socket says 172.21.15.79:53222) 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d4ab0640 1 -- 172.21.15.79:0/3173720433 learned_addr learned my addr 172.21.15.79:0/3173720433 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4cffff640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4d0155820 0x7fa4d01551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d52b1640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4d00cb190 0x7fa4d015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d4ab0640 1 -- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4d0155820 msgr2=0x7fa4d01551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d4ab0640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4d0155820 0x7fa4d01551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d4ab0640 1 -- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4d00cb190 msgr2=0x7fa4d015c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d4ab0640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4d00cb190 0x7fa4d015c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4d4ab0640 1 -- 172.21.15.79:0/3173720433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d015b870 con 0x7fa4c00051c0 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.698+0000 7fa4cffff640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4d0155820 0x7fa4d01551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.699+0000 7fa4d4ab0640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4d00c8c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400f650 tx=0x7fa4c400fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.699+0000 7fa4cd7fa640 1 -- 172.21.15.79:0/3173720433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40050d0 con 0x7fa4c00051c0 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.699+0000 7fa4cd7fa640 1 -- 172.21.15.79:0/3173720433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c4018070 con 0x7fa4c00051c0 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.699+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d00cce20 con 0x7fa4c00051c0 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.699+0000 7fa4cd7fa640 1 -- 172.21.15.79:0/3173720433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4005490 con 0x7fa4c00051c0 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.699+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d00cd0e0 con 0x7fa4c00051c0 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.700+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d015b1f0 con 0x7fa4c00051c0 2024-06-10T00:15:33.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.700+0000 7fa4cd7fa640 1 -- 172.21.15.79:0/3173720433 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4c400d6d0 con 0x7fa4c00051c0 2024-06-10T00:15:33.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.701+0000 7fa4cd7fa640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4b406be30 0x7fa4b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:33.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.701+0000 7fa4cd7fa640 1 -- 172.21.15.79:0/3173720433 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fa4c408a8f0 con 0x7fa4c00051c0 2024-06-10T00:15:33.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.701+0000 7fa4cffff640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4b406be30 0x7fa4b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:33.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.701+0000 7fa4cffff640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4b406be30 0x7fa4b406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4d015b690 tx=0x7fa4bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:33.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.705+0000 7fa4cd7fa640 1 -- 172.21.15.79:0/3173720433 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa4d015b1f0 con 0x7fa4c00051c0 2024-06-10T00:15:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.944+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fa4d0068430 con 0x7fa4c00051c0 2024-06-10T00:15:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.946+0000 7fa4cd7fa640 1 -- 172.21.15.79:0/3173720433 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa4c40594f0 con 0x7fa4c00051c0 2024-06-10T00:15:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4b406be30 msgr2=0x7fa4b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4b406be30 0x7fa4b406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4d015b690 tx=0x7fa4bc008040 comp rx=0 tx=0).stop 2024-06-10T00:15:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 msgr2=0x7fa4d00c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4d00c8c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400f650 tx=0x7fa4c400fb10 comp rx=0 tx=0).stop 2024-06-10T00:15:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 shutdown_connections 2024-06-10T00:15:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4b406be30 0x7fa4b406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4d00cb190 0x7fa4d015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4d0155820 0x7fa4d01551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 --2- 172.21.15.79:0/3173720433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00051c0 0x7fa4d00c8c40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 >> 172.21.15.79:0/3173720433 conn(0x7fa4d009d3f0 msgr2=0x7fa4d00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 shutdown_connections 2024-06-10T00:15:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:33.948+0000 7fa4d6d14640 1 -- 172.21.15.79:0/3173720433 wait complete. 2024-06-10T00:15:33.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-06-10T00:15:34.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.060+0000 7f0d42384640 1 Processor -- start 2024-06-10T00:15:34.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.060+0000 7f0d42384640 1 -- start start 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d42384640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0ae910 0x7f0d3c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d42384640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d3c06ea20 0x7f0d3c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d42384640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d3c0cf190 0x7f0d3c15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d42384640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3c06ee60 con 0x7f0d3c0cf190 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d42384640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3c0cf620 con 0x7f0d3c06ea20 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d42384640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c06d130 con 0x7f0d3c0ae910 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d40921640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d3c0cf190 0x7f0d3c15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d40921640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d3c0cf190 0x7f0d3c15ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53238/0 (socket says 172.21.15.79:53238) 2024-06-10T00:15:34.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d40921640 1 -- 172.21.15.79:0/2080536345 learned_addr learned my addr 172.21.15.79:0/2080536345 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d3bfff640 1 --2- 172.21.15.79:0/2080536345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0ae910 0x7f0d3c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d3b7fe640 1 --2- 172.21.15.79:0/2080536345 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c06ea20 0x7f0d3c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d40921640 1 -- 172.21.15.79:0/2080536345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0ae910 msgr2=0x7f0d3c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d40921640 1 --2- 172.21.15.79:0/2080536345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0ae910 0x7f0d3c06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d40921640 1 -- 172.21.15.79:0/2080536345 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c06ea20 msgr2=0x7f0d3c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d40921640 1 --2- 172.21.15.79:0/2080536345 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c06ea20 0x7f0d3c0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d40921640 1 -- 172.21.15.79:0/2080536345 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c06d410 con 0x7f0d3c0cf190 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.061+0000 7f0d3b7fe640 1 --2- 172.21.15.79:0/2080536345 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c06ea20 0x7f0d3c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.062+0000 7f0d40921640 1 --2- 172.21.15.79:0/2080536345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0cf190 0x7f0d3c15ead0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009e50 tx=0x7f0d3402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954e5fb3c3a32aba server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.062+0000 7f0d3affd640 1 -- 172.21.15.79:0/2080536345 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34036070 con 0x7f0d3c0cf190 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.062+0000 7f0d3affd640 1 -- 172.21.15.79:0/2080536345 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d34031600 con 0x7f0d3c0cf190 2024-06-10T00:15:34.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.062+0000 7f0d3affd640 1 -- 172.21.15.79:0/2080536345 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340319d0 con 0x7f0d3c0cf190 2024-06-10T00:15:34.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 -- 172.21.15.79:0/2080536345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0cf190 msgr2=0x7f0d3c15ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 --2- 172.21.15.79:0/2080536345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0cf190 0x7f0d3c15ead0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009e50 tx=0x7f0d3402a630 comp rx=0 tx=0).stop 2024-06-10T00:15:34.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 -- 172.21.15.79:0/2080536345 shutdown_connections 2024-06-10T00:15:34.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 --2- 172.21.15.79:0/2080536345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0cf190 0x7f0d3c15ead0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 --2- 172.21.15.79:0/2080536345 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c06ea20 0x7f0d3c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 --2- 172.21.15.79:0/2080536345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0ae910 0x7f0d3c06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 -- 172.21.15.79:0/2080536345 >> 172.21.15.79:0/2080536345 conn(0x7f0d3c0b19f0 msgr2=0x7f0d3c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 -- 172.21.15.79:0/2080536345 shutdown_connections 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.063+0000 7f0d42384640 1 -- 172.21.15.79:0/2080536345 wait complete. 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.064+0000 7f0d42384640 1 Processor -- start 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.064+0000 7f0d42384640 1 -- start start 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d42384640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c06ea20 0x7f0d3c1f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d42384640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0ae910 0x7f0d3c0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d42384640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0cf190 0x7f0d3c14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d42384640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0aecf0 con 0x7f0d3c0ae910 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d42384640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c06d9d0 con 0x7f0d3c06ea20 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d42384640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c15f010 con 0x7f0d3c0cf190 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0ae910 0x7f0d3c0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0ae910 0x7f0d3c0c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53244/0 (socket says 172.21.15.79:53244) 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 -- 172.21.15.79:0/1602341897 learned_addr learned my addr 172.21.15.79:0/1602341897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d40921640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0cf190 0x7f0d3c14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3bfff640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c06ea20 0x7f0d3c1f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 -- 172.21.15.79:0/1602341897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0cf190 msgr2=0x7f0d3c14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0cf190 0x7f0d3c14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 -- 172.21.15.79:0/1602341897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c06ea20 msgr2=0x7f0d3c1f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c06ea20 0x7f0d3c1f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 -- 172.21.15.79:0/1602341897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c14ff20 con 0x7f0d3c0ae910 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.065+0000 7f0d3b7fe640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0ae910 0x7f0d3c0c9070 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c820 tx=0x7f0d3000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.066+0000 7f0d38ff9640 1 -- 172.21.15.79:0/1602341897 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30015070 con 0x7f0d3c0ae910 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.066+0000 7f0d38ff9640 1 -- 172.21.15.79:0/1602341897 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30007a30 con 0x7f0d3c0ae910 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.066+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c0c97e0 con 0x7f0d3c0ae910 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.066+0000 7f0d38ff9640 1 -- 172.21.15.79:0/1602341897 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30007e20 con 0x7f0d3c0ae910 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.066+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c0c9da0 con 0x7f0d3c0ae910 2024-06-10T00:15:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.067+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3c068410 con 0x7f0d3c0ae910 2024-06-10T00:15:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.067+0000 7f0d38ff9640 1 -- 172.21.15.79:0/1602341897 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d30018070 con 0x7f0d3c0ae910 2024-06-10T00:15:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.067+0000 7f0d38ff9640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d2806be30 0x7f0d2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.068+0000 7f0d38ff9640 1 -- 172.21.15.79:0/1602341897 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f0d3008aa70 con 0x7f0d3c0ae910 2024-06-10T00:15:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.068+0000 7f0d3bfff640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d2806be30 0x7f0d2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.068+0000 7f0d3bfff640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d2806be30 0x7f0d2806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c006fd0 tx=0x7f0d2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.072+0000 7f0d38ff9640 1 -- 172.21.15.79:0/1602341897 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0d30058fa0 con 0x7f0d3c0ae910 2024-06-10T00:15:34.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.313+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f0d3c0b36b0 con 0x7f0d3c0ae910 2024-06-10T00:15:34.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.315+0000 7f0d38ff9640 1 -- 172.21.15.79:0/1602341897 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f0d3005d2a0 con 0x7f0d3c0ae910 2024-06-10T00:15:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d2806be30 msgr2=0x7f0d2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d2806be30 0x7f0d2806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c006fd0 tx=0x7f0d2c008040 comp rx=0 tx=0).stop 2024-06-10T00:15:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0ae910 msgr2=0x7f0d3c0c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0ae910 0x7f0d3c0c9070 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c820 tx=0x7f0d3000cce0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 shutdown_connections 2024-06-10T00:15:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d2806be30 0x7f0d2806e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0cf190 0x7f0d3c14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c0ae910 0x7f0d3c0c9070 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 --2- 172.21.15.79:0/1602341897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c06ea20 0x7f0d3c1f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 >> 172.21.15.79:0/1602341897 conn(0x7f0d3c0b19f0 msgr2=0x7f0d3c072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 shutdown_connections 2024-06-10T00:15:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.317+0000 7f0d42384640 1 -- 172.21.15.79:0/1602341897 wait complete. 2024-06-10T00:15:34.328 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-06-10T00:15:34.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.429+0000 7f1be54e7640 1 Processor -- start 2024-06-10T00:15:34.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.429+0000 7f1be54e7640 1 -- start start 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1be54e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be015f1a0 0x7f1be00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1be54e7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1be00cef70 0x7f1be00cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1be54e7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be015f5e0 con 0x7f1be00d2680 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1be54e7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1be00d13e0 con 0x7f1be00cef70 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1be54e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1be00d0ad0 con 0x7f1be015f1a0 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bdf7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1be00cef70 0x7f1be00cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bdeffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1be00d2680 0x7f1be00d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41136/0 (socket says 172.21.15.79:41136) 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bdeffd640 1 -- 172.21.15.79:0/3820069937 learned_addr learned my addr 172.21.15.79:0/3820069937 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:34.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bde7fc640 1 --2- 172.21.15.79:0/3820069937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be015f1a0 0x7f1be00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bdf7fe640 1 -- 172.21.15.79:0/3820069937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be015f1a0 msgr2=0x7f1be00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bdf7fe640 1 --2- 172.21.15.79:0/3820069937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be015f1a0 0x7f1be00d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bdf7fe640 1 -- 172.21.15.79:0/3820069937 >> v1:172.21.15.79:6789/0 conn(0x7f1be00d2680 legacy=0x7f1be00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bdf7fe640 1 -- 172.21.15.79:0/3820069937 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be015f890 con 0x7f1be00cef70 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bddffb640 1 -- 172.21.15.79:0/3820069937 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568265982 0 0) 0x7f1be015f5e0 con 0x7f1be00d2680 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.430+0000 7f1bde7fc640 1 --2- 172.21.15.79:0/3820069937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be015f1a0 0x7f1be00d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.431+0000 7f1bdf7fe640 1 --2- 172.21.15.79:0/3820069937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cf400 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009d90 tx=0x7f1bd802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45585b92c267bd93 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.431+0000 7f1bddffb640 1 -- 172.21.15.79:0/3820069937 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8007740 con 0x7f1be00cef70 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.431+0000 7f1bddffb640 1 -- 172.21.15.79:0/3820069937 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd80078e0 con 0x7f1be00cef70 2024-06-10T00:15:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.431+0000 7f1bddffb640 1 -- 172.21.15.79:0/3820069937 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8007cb0 con 0x7f1be00cef70 2024-06-10T00:15:34.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.432+0000 7f1be54e7640 1 -- 172.21.15.79:0/3820069937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 msgr2=0x7f1be00cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.432+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3820069937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cf400 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009d90 tx=0x7f1bd802a660 comp rx=0 tx=0).stop 2024-06-10T00:15:34.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.432+0000 7f1be54e7640 1 -- 172.21.15.79:0/3820069937 shutdown_connections 2024-06-10T00:15:34.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.432+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3820069937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cf400 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.432+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3820069937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be015f1a0 0x7f1be00d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.432+0000 7f1be54e7640 1 -- 172.21.15.79:0/3820069937 >> 172.21.15.79:0/3820069937 conn(0x7f1be009d3f0 msgr2=0x7f1be00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.432+0000 7f1be54e7640 1 -- 172.21.15.79:0/3820069937 shutdown_connections 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.432+0000 7f1be54e7640 1 -- 172.21.15.79:0/3820069937 wait complete. 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.433+0000 7f1be54e7640 1 Processor -- start 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.433+0000 7f1be54e7640 1 -- start start 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1be54e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1be54e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be00d2680 0x7f1be0145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1be54e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1be015f1a0 0x7f1be0146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1be54e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00d4f00 con 0x7f1be00cef70 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1be54e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00d1070 con 0x7f1be015f1a0 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1be54e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1be00d1870 con 0x7f1be00d2680 2024-06-10T00:15:34.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53258/0 (socket says 172.21.15.79:53258) 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdeffd640 1 -- 172.21.15.79:0/3145548426 learned_addr learned my addr 172.21.15.79:0/3145548426 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bde7fc640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be00d2680 0x7f1be0145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdeffd640 1 -- 172.21.15.79:0/3145548426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be00d2680 msgr2=0x7f1be0145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdeffd640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be00d2680 0x7f1be0145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdeffd640 1 -- 172.21.15.79:0/3145548426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1be015f1a0 msgr2=0x7f1be0146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdf7fe640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1be015f1a0 0x7f1be0146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdeffd640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1be015f1a0 0x7f1be0146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.434+0000 7f1bdeffd640 1 -- 172.21.15.79:0/3145548426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be00cb6d0 con 0x7f1be00cef70 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.435+0000 7f1bdeffd640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cb190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000c4d0 tx=0x7f1bd000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.435+0000 7f1bc77fe640 1 -- 172.21.15.79:0/3145548426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0018070 con 0x7f1be00cef70 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.435+0000 7f1bc77fe640 1 -- 172.21.15.79:0/3145548426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd0007500 con 0x7f1be00cef70 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.435+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be015c580 con 0x7f1be00cef70 2024-06-10T00:15:34.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.435+0000 7f1bc77fe640 1 -- 172.21.15.79:0/3145548426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0004a20 con 0x7f1be00cef70 2024-06-10T00:15:34.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.435+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be015cb40 con 0x7f1be00cef70 2024-06-10T00:15:34.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.436+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be0073620 con 0x7f1be00cef70 2024-06-10T00:15:34.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.436+0000 7f1bc77fe640 1 -- 172.21.15.79:0/3145548426 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bd001b070 con 0x7f1be00cef70 2024-06-10T00:15:34.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.437+0000 7f1bc77fe640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1bcc06be30 0x7f1bcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.437+0000 7f1bc77fe640 1 -- 172.21.15.79:0/3145548426 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f1bd0089f00 con 0x7f1be00cef70 2024-06-10T00:15:34.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.437+0000 7f1bde7fc640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1bcc06be30 0x7f1bcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.437+0000 7f1bde7fc640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1bcc06be30 0x7f1bcc06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1be01f7d90 tx=0x7f1bd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.441+0000 7f1bc77fe640 1 -- 172.21.15.79:0/3145548426 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1be0073620 con 0x7f1be00cef70 2024-06-10T00:15:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.679+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f1be0068430 con 0x7f1be00cef70 2024-06-10T00:15:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.681+0000 7f1bc77fe640 1 -- 172.21.15.79:0/3145548426 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f1bd0058b00 con 0x7f1be00cef70 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1bcc06be30 msgr2=0x7f1bcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1bcc06be30 0x7f1bcc06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1be01f7d90 tx=0x7f1bd4008040 comp rx=0 tx=0).stop 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 msgr2=0x7f1be00cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cb190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000c4d0 tx=0x7f1bd000c990 comp rx=0 tx=0).stop 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 shutdown_connections 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1bcc06be30 0x7f1bcc06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1be015f1a0 0x7f1be0146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1be00d2680 0x7f1be0145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 --2- 172.21.15.79:0/3145548426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1be00cef70 0x7f1be00cb190 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.683+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 >> 172.21.15.79:0/3145548426 conn(0x7f1be009d3f0 msgr2=0x7f1be00d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.684+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 shutdown_connections 2024-06-10T00:15:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.684+0000 7f1be54e7640 1 -- 172.21.15.79:0/3145548426 wait complete. 2024-06-10T00:15:34.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-10T00:15:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.793+0000 7f32f6af5640 1 Processor -- start 2024-06-10T00:15:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.793+0000 7f32f6af5640 1 -- start start 2024-06-10T00:15:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32f6af5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32f01553c0 0x7f32f00cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32f6af5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32f00b2cf0 0x7f32f015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32f6af5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32f00cec50 0x7f32f00cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32f6af5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f32f00b31a0 con 0x7f32f00b2cf0 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32f6af5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f32f015c3f0 con 0x7f32f01553c0 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32f6af5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32f00b3420 con 0x7f32f00cec50 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32e7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32f00b2cf0 0x7f32f015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32e7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32f00b2cf0 0x7f32f015beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53268/0 (socket says 172.21.15.79:53268) 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32e7fff640 1 -- 172.21.15.79:0/957330220 learned_addr learned my addr 172.21.15.79:0/957330220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32e7fff640 1 -- 172.21.15.79:0/957330220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32f00cec50 msgr2=0x7f32f00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32f4891640 1 --2- 172.21.15.79:0/957330220 >> v2:172.21.15.117:3300/0 conn(0x7f32f01553c0 0x7f32f00cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32e7fff640 1 --2- 172.21.15.79:0/957330220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32f00cec50 0x7f32f00cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32e7fff640 1 -- 172.21.15.79:0/957330220 >> v2:172.21.15.117:3300/0 conn(0x7f32f01553c0 msgr2=0x7f32f00cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32e7fff640 1 --2- 172.21.15.79:0/957330220 >> v2:172.21.15.117:3300/0 conn(0x7f32f01553c0 0x7f32f00cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32e7fff640 1 -- 172.21.15.79:0/957330220 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f00cc750 con 0x7f32f00b2cf0 2024-06-10T00:15:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.794+0000 7f32f4891640 1 --2- 172.21.15.79:0/957330220 >> v2:172.21.15.117:3300/0 conn(0x7f32f01553c0 0x7f32f00cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.795+0000 7f32e7fff640 1 --2- 172.21.15.79:0/957330220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f015beb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f32f00cd990 tx=0x7f32e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95566ff9e64bb0fe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.795+0000 7f32e77fe640 1 -- 172.21.15.79:0/957330220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0037070 con 0x7f32f00b2cf0 2024-06-10T00:15:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.795+0000 7f32e77fe640 1 -- 172.21.15.79:0/957330220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e0032440 con 0x7f32f00b2cf0 2024-06-10T00:15:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.795+0000 7f32e77fe640 1 -- 172.21.15.79:0/957330220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0032810 con 0x7f32f00b2cf0 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.795+0000 7f32f6af5640 1 -- 172.21.15.79:0/957330220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 msgr2=0x7f32f015beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.795+0000 7f32f6af5640 1 --2- 172.21.15.79:0/957330220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f015beb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f32f00cd990 tx=0x7f32e002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.796+0000 7f32f6af5640 1 -- 172.21.15.79:0/957330220 shutdown_connections 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.796+0000 7f32f6af5640 1 --2- 172.21.15.79:0/957330220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32f00cec50 0x7f32f00cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.796+0000 7f32f6af5640 1 --2- 172.21.15.79:0/957330220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f015beb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.796+0000 7f32f6af5640 1 --2- 172.21.15.79:0/957330220 >> v2:172.21.15.117:3300/0 conn(0x7f32f01553c0 0x7f32f00cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.796+0000 7f32f6af5640 1 -- 172.21.15.79:0/957330220 >> 172.21.15.79:0/957330220 conn(0x7f32f00b19f0 msgr2=0x7f32f00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.796+0000 7f32f6af5640 1 -- 172.21.15.79:0/957330220 shutdown_connections 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.796+0000 7f32f6af5640 1 -- 172.21.15.79:0/957330220 wait complete. 2024-06-10T00:15:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.797+0000 7f32f6af5640 1 Processor -- start 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.797+0000 7f32f6af5640 1 -- start start 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f6af5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f0149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f6af5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32f00cec50 0x7f32f015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f6af5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32f01553c0 0x7f32f0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f6af5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00b3700 con 0x7f32f00b2cf0 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f6af5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00ccd10 con 0x7f32f01553c0 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f6af5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32f01557a0 con 0x7f32f00cec50 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f0149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f0149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53278/0 (socket says 172.21.15.79:53278) 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 -- 172.21.15.79:0/3761677391 learned_addr learned my addr 172.21.15.79:0/3761677391 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 -- 172.21.15.79:0/3761677391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32f00cec50 msgr2=0x7f32f015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32f00cec50 0x7f32f015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 -- 172.21.15.79:0/3761677391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32f01553c0 msgr2=0x7f32f0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f5092640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32f01553c0 0x7f32f0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32f01553c0 0x7f32f0156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 -- 172.21.15.79:0/3761677391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f015dca0 con 0x7f32f00b2cf0 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f4891640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f0149d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c7f0 tx=0x7f32ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32e57fa640 1 -- 172.21.15.79:0/3761677391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec015070 con 0x7f32f00b2cf0 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32e57fa640 1 -- 172.21.15.79:0/3761677391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ec007820 con 0x7f32f00b2cf0 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32e57fa640 1 -- 172.21.15.79:0/3761677391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec007bd0 con 0x7f32f00b2cf0 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f015df80 con 0x7f32f00b2cf0 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.798+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f015e540 con 0x7f32f00b2cf0 2024-06-10T00:15:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.799+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f0068430 con 0x7f32f00b2cf0 2024-06-10T00:15:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.800+0000 7f32e57fa640 1 -- 172.21.15.79:0/3761677391 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32ec018070 con 0x7f32f00b2cf0 2024-06-10T00:15:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.800+0000 7f32e57fa640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32dc06be30 0x7f32dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.800+0000 7f32e57fa640 1 -- 172.21.15.79:0/3761677391 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f32ec08adc0 con 0x7f32f00b2cf0 2024-06-10T00:15:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.800+0000 7f32e7fff640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32dc06be30 0x7f32dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.801+0000 7f32e7fff640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32dc06be30 0x7f32dc06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32e0034000 tx=0x7f32e002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:34.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.804+0000 7f32e57fa640 1 -- 172.21.15.79:0/3761677391 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f32ec059930 con 0x7f32f00b2cf0 2024-06-10T00:15:34.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.977+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f32f015bfe0 con 0x7f32f00b2cf0 2024-06-10T00:15:34.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.978+0000 7f32e57fa640 1 -- 172.21.15.79:0/3761677391 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7f32ec059230 con 0x7f32f00b2cf0 2024-06-10T00:15:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:34.978 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:15:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:15:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-06-10T00:15:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-06-10T00:15:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:34.978 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:15:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.979+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32dc06be30 msgr2=0x7f32dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.979+0000 7f32f6af5640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32dc06be30 0x7f32dc06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32e0034000 tx=0x7f32e002c000 comp rx=0 tx=0).stop 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.979+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 msgr2=0x7f32f0149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.979+0000 7f32f6af5640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f0149d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c7f0 tx=0x7f32ec00ccb0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.980+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 shutdown_connections 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.980+0000 7f32f6af5640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32dc06be30 0x7f32dc06e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.980+0000 7f32f6af5640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32f01553c0 0x7f32f0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.980+0000 7f32f6af5640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32f00cec50 0x7f32f015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.980+0000 7f32f6af5640 1 --2- 172.21.15.79:0/3761677391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00b2cf0 0x7f32f0149d40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.980+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 >> 172.21.15.79:0/3761677391 conn(0x7f32f00b19f0 msgr2=0x7f32f00cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.980+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 shutdown_connections 2024-06-10T00:15:34.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:34.980+0000 7f32f6af5640 1 -- 172.21.15.79:0/3761677391 wait complete. 2024-06-10T00:15:34.990 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-10T00:15:34.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-10T00:15:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.093+0000 7f35efada640 1 Processor -- start 2024-06-10T00:15:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.094+0000 7f35efada640 1 -- start start 2024-06-10T00:15:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.094+0000 7f35efada640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35e815e670 0x7f35e80d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35efada640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e815ec90 con 0x7f35e80d0e00 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35efada640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e815ef70 con 0x7f35e80d1f30 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35efada640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f35e815fa50 con 0x7f35e815e670 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35ed876640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35e815e670 0x7f35e80d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35ee077640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f35e80d0e00 0x7f35e80cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41140/0 (socket says 172.21.15.79:41140) 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35ee077640 1 -- 172.21.15.79:0/1503550559 learned_addr learned my addr 172.21.15.79:0/1503550559 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35ed876640 1 -- 172.21.15.79:0/1503550559 >> v1:172.21.15.117:6789/0 conn(0x7f35e80d1f30 legacy=0x7f35e80d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35ed876640 1 -- 172.21.15.79:0/1503550559 >> v1:172.21.15.79:6789/0 conn(0x7f35e80d0e00 legacy=0x7f35e80cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35ed876640 1 -- 172.21.15.79:0/1503550559 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e815f250 con 0x7f35e815e670 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.095+0000 7f35ec874640 1 -- 172.21.15.79:0/1503550559 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184930416 0 0) 0x7f35e815ec90 con 0x7f35e80d0e00 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35ed876640 1 --2- 172.21.15.79:0/1503550559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e815e670 0x7f35e80d49f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f35e00097a0 tx=0x7f35e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a490d4ddaee1558 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35ec874640 1 -- 172.21.15.79:0/1503550559 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0037070 con 0x7f35e815e670 2024-06-10T00:15:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35ec874640 1 -- 172.21.15.79:0/1503550559 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e0032440 con 0x7f35e815e670 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35ec874640 1 -- 172.21.15.79:0/1503550559 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0032810 con 0x7f35e815e670 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35efada640 1 -- 172.21.15.79:0/1503550559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e815e670 msgr2=0x7f35e80d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35efada640 1 --2- 172.21.15.79:0/1503550559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e815e670 0x7f35e80d49f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f35e00097a0 tx=0x7f35e002a270 comp rx=0 tx=0).stop 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35efada640 1 -- 172.21.15.79:0/1503550559 shutdown_connections 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35efada640 1 --2- 172.21.15.79:0/1503550559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e815e670 0x7f35e80d49f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35efada640 1 -- 172.21.15.79:0/1503550559 >> 172.21.15.79:0/1503550559 conn(0x7f35e809d400 msgr2=0x7f35e80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35efada640 1 -- 172.21.15.79:0/1503550559 shutdown_connections 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.096+0000 7f35efada640 1 -- 172.21.15.79:0/1503550559 wait complete. 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35efada640 1 Processor -- start 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35efada640 1 -- start start 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35efada640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e80d0e00 0x7f35e80c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35efada640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80d1f30 0x7f35e815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35efada640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815e670 0x7f35e80b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35efada640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80d2370 con 0x7f35e80d0e00 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35efada640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35e815ea50 con 0x7f35e80d1f30 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35efada640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80cf2e0 con 0x7f35e815e670 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35ed876640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e80d0e00 0x7f35e80c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35ed876640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e80d0e00 0x7f35e80c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53306/0 (socket says 172.21.15.79:53306) 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.098+0000 7f35ed876640 1 -- 172.21.15.79:0/2701660642 learned_addr learned my addr 172.21.15.79:0/2701660642 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ed075640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80d1f30 0x7f35e815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ee077640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815e670 0x7f35e80b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ed876640 1 -- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815e670 msgr2=0x7f35e80b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ed876640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815e670 0x7f35e80b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ed876640 1 -- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80d1f30 msgr2=0x7f35e815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ed876640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80d1f30 0x7f35e815c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ed876640 1 -- 172.21.15.79:0/2701660642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e80b6f30 con 0x7f35e80d0e00 2024-06-10T00:15:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ed075640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80d1f30 0x7f35e815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35ed876640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e80d0e00 0x7f35e80c9f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f35e00097a0 tx=0x7f35e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35e67fc640 1 -- 172.21.15.79:0/2701660642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0041070 con 0x7f35e80d0e00 2024-06-10T00:15:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35e67fc640 1 -- 172.21.15.79:0/2701660642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e003c870 con 0x7f35e80d0e00 2024-06-10T00:15:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e80b7210 con 0x7f35e80d0e00 2024-06-10T00:15:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35e67fc640 1 -- 172.21.15.79:0/2701660642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0037040 con 0x7f35e80d0e00 2024-06-10T00:15:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.099+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e80b77d0 con 0x7f35e80d0e00 2024-06-10T00:15:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.100+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e8068540 con 0x7f35e80d0e00 2024-06-10T00:15:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.101+0000 7f35e67fc640 1 -- 172.21.15.79:0/2701660642 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35e0044070 con 0x7f35e80d0e00 2024-06-10T00:15:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.101+0000 7f35e67fc640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35d406be60 0x7f35d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.101+0000 7f35ed075640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35d406be60 0x7f35d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.101+0000 7f35e67fc640 1 -- 172.21.15.79:0/2701660642 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f35e00aba40 con 0x7f35e80d0e00 2024-06-10T00:15:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.102+0000 7f35ed075640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35d406be60 0x7f35d406e320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35e80c7b10 tx=0x7f35dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:35.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.107+0000 7f35e67fc640 1 -- 172.21.15.79:0/2701660642 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f35e007a000 con 0x7f35e80d0e00 2024-06-10T00:15:35.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:35.283+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f35e80d47d0 con 0x7f35e80d0e00 2024-06-10T00:15:36.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.106+0000 7f35e67fc640 1 -- 172.21.15.79:0/2701660642 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7f35e007e300 con 0x7f35e80d0e00 2024-06-10T00:15:36.106 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-06-10T00:15:36.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35d406be60 msgr2=0x7f35d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:36.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35d406be60 0x7f35d406e320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35e80c7b10 tx=0x7f35dc009040 comp rx=0 tx=0).stop 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e80d0e00 msgr2=0x7f35e80c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e80d0e00 0x7f35e80c9f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f35e00097a0 tx=0x7f35e00046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 shutdown_connections 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35d406be60 0x7f35d406e320 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815e670 0x7f35e80b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80d1f30 0x7f35e815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 --2- 172.21.15.79:0/2701660642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e80d0e00 0x7f35e80c9f90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.108+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 >> 172.21.15.79:0/2701660642 conn(0x7f35e809d400 msgr2=0x7f35e80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.109+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 shutdown_connections 2024-06-10T00:15:36.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.109+0000 7f35efada640 1 -- 172.21.15.79:0/2701660642 wait complete. 2024-06-10T00:15:36.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-10T00:15:36.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.233+0000 7f67543ce640 1 Processor -- start 2024-06-10T00:15:36.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.233+0000 7f67543ce640 1 -- start start 2024-06-10T00:15:36.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.234+0000 7f67543ce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f674c0d11f0 0x7f674c0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:36.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.234+0000 7f67543ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 0x7f674c0d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:36.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.234+0000 7f67543ce640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f674c0cf9a0 con 0x7f674c15e1c0 2024-06-10T00:15:36.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.234+0000 7f67543ce640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f674c0cfc70 con 0x7f674c0d11f0 2024-06-10T00:15:36.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.234+0000 7f67543ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f674c0cff50 con 0x7f674c0b2f60 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f675296b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 0x7f674c0d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f6751969640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f674c0d11f0 0x7f674c0d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f6751969640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f674c0d11f0 0x7f674c0d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:38934/0 (socket says 172.21.15.79:38934) 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f6751969640 1 -- 172.21.15.79:0/2381482396 learned_addr learned my addr 172.21.15.79:0/2381482396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f675216a640 1 --1- 172.21.15.79:0/2381482396 >> v1:172.21.15.117:6789/0 conn(0x7f674c15e1c0 0x7f674c0d0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:60424/0 (socket says 172.21.15.79:60424) 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f6751969640 1 -- 172.21.15.79:0/2381482396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 msgr2=0x7f674c0d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f6751969640 1 --2- 172.21.15.79:0/2381482396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 0x7f674c0d2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f6751969640 1 -- 172.21.15.79:0/2381482396 >> v1:172.21.15.117:6789/0 conn(0x7f674c15e1c0 legacy=0x7f674c0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f6751969640 1 -- 172.21.15.79:0/2381482396 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c0d0230 con 0x7f674c0d11f0 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.235+0000 7f6751168640 1 -- 172.21.15.79:0/2381482396 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789222075 0 0) 0x7f674c0cf9a0 con 0x7f674c15e1c0 2024-06-10T00:15:36.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.236+0000 7f6751969640 1 --2- 172.21.15.79:0/2381482396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c0d11f0 0x7f674c0d4bc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f673c009870 tx=0x7f673c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b47a129ea2f6e8d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:36.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.236+0000 7f6751168640 1 -- 172.21.15.79:0/2381482396 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c037070 con 0x7f674c0d11f0 2024-06-10T00:15:36.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.236+0000 7f6751168640 1 -- 172.21.15.79:0/2381482396 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c032440 con 0x7f674c0d11f0 2024-06-10T00:15:36.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.236+0000 7f6751168640 1 -- 172.21.15.79:0/2381482396 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c032810 con 0x7f674c0d11f0 2024-06-10T00:15:36.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.237+0000 7f67543ce640 1 -- 172.21.15.79:0/2381482396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c0d11f0 msgr2=0x7f674c0d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:36.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.237+0000 7f67543ce640 1 --2- 172.21.15.79:0/2381482396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c0d11f0 0x7f674c0d4bc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f673c009870 tx=0x7f673c02a270 comp rx=0 tx=0).stop 2024-06-10T00:15:36.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.237+0000 7f67543ce640 1 -- 172.21.15.79:0/2381482396 shutdown_connections 2024-06-10T00:15:36.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.237+0000 7f67543ce640 1 --2- 172.21.15.79:0/2381482396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 0x7f674c0d2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.237+0000 7f67543ce640 1 --2- 172.21.15.79:0/2381482396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c0d11f0 0x7f674c0d4bc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.237+0000 7f67543ce640 1 -- 172.21.15.79:0/2381482396 >> 172.21.15.79:0/2381482396 conn(0x7f674c09d3e0 msgr2=0x7f674c0d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:36.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.237+0000 7f67543ce640 1 -- 172.21.15.79:0/2381482396 shutdown_connections 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.237+0000 7f67543ce640 1 -- 172.21.15.79:0/2381482396 wait complete. 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.238+0000 7f67543ce640 1 Processor -- start 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.238+0000 7f67543ce640 1 -- start start 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f67543ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 0x7f674c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f67543ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674c0d11f0 0x7f674c0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f67543ce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c15e1c0 0x7f674c0ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f67543ce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f674c0b0cd0 con 0x7f674c0d11f0 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f67543ce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f674c0d1d40 con 0x7f674c15e1c0 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f67543ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f674c0b0e50 con 0x7f674c0b2f60 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674c0d11f0 0x7f674c0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674c0d11f0 0x7f674c0c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53314/0 (socket says 172.21.15.79:53314) 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 -- 172.21.15.79:0/1760337812 learned_addr learned my addr 172.21.15.79:0/1760337812 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f675216a640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 0x7f674c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f675296b640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c15e1c0 0x7f674c0ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 -- 172.21.15.79:0/1760337812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 msgr2=0x7f674c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 0x7f674c0c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 -- 172.21.15.79:0/1760337812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c15e1c0 msgr2=0x7f674c0ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c15e1c0 0x7f674c0ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 -- 172.21.15.79:0/1760337812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c157b70 con 0x7f674c0d11f0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6751969640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674c0d11f0 0x7f674c0c7c00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f673c035040 tx=0x7f673c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6742ffd640 1 -- 172.21.15.79:0/1760337812 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c037040 con 0x7f674c0d11f0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674c0c8270 con 0x7f674c0d11f0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6742ffd640 1 -- 172.21.15.79:0/1760337812 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c004030 con 0x7f674c0d11f0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f6742ffd640 1 -- 172.21.15.79:0/1760337812 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c004420 con 0x7f674c0d11f0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.239+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674c0c8830 con 0x7f674c0d11f0 2024-06-10T00:15:36.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.240+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f674c0683c0 con 0x7f674c0d11f0 2024-06-10T00:15:36.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.241+0000 7f6742ffd640 1 -- 172.21.15.79:0/1760337812 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f673c03a070 con 0x7f674c0d11f0 2024-06-10T00:15:36.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.242+0000 7f6742ffd640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f673006be30 0x7f673006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:36.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.242+0000 7f675216a640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f673006be30 0x7f673006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:36.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.242+0000 7f6742ffd640 1 -- 172.21.15.79:0/1760337812 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7f673c0ab3e0 con 0x7f674c0d11f0 2024-06-10T00:15:36.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.242+0000 7f675216a640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f673006be30 0x7f673006e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6748000f60 tx=0x7f6748009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:36.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.246+0000 7f6742ffd640 1 -- 172.21.15.79:0/1760337812 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f673c041020 con 0x7f674c0d11f0 2024-06-10T00:15:36.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:36.421+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f674c08c0c0 con 0x7f674c0d11f0 2024-06-10T00:15:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.108+0000 7f6742ffd640 1 -- 172.21.15.79:0/1760337812 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7f673c079df0 con 0x7f674c0d11f0 2024-06-10T00:15:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-06-10T00:15:37.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f673006be30 msgr2=0x7f673006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f673006be30 0x7f673006e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6748000f60 tx=0x7f6748009040 comp rx=0 tx=0).stop 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674c0d11f0 msgr2=0x7f674c0c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674c0d11f0 0x7f674c0c7c00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f673c035040 tx=0x7f673c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 shutdown_connections 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f673006be30 0x7f673006e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f674c15e1c0 0x7f674c0ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674c0d11f0 0x7f674c0c7c00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 --2- 172.21.15.79:0/1760337812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674c0b2f60 0x7f674c0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.111+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 >> 172.21.15.79:0/1760337812 conn(0x7f674c09d3e0 msgr2=0x7f674c0b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.112+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 shutdown_connections 2024-06-10T00:15:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.112+0000 7f67543ce640 1 -- 172.21.15.79:0/1760337812 wait complete. 2024-06-10T00:15:37.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-10T00:15:37.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.243+0000 7f757ce3f640 1 Processor -- start 2024-06-10T00:15:37.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.243+0000 7f757ce3f640 1 -- start start 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f757ce3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780b3800 0x7f75780cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f757ce3f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75780cf190 0x7f75780d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f757ce3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75780b3c80 con 0x7f75780d08f0 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f757ce3f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f75780d1c80 con 0x7f75780cf190 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f757ce3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75780cf620 con 0x7f75780b3800 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f7576d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75780cf190 0x7f75780d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f757659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f75780d08f0 0x7f75780d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41142/0 (socket says 172.21.15.79:41142) 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f757659c640 1 -- 172.21.15.79:0/3553874926 learned_addr learned my addr 172.21.15.79:0/3553874926 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f756dd9b640 1 --2- 172.21.15.79:0/3553874926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780b3800 0x7f75780cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f7576d9d640 1 -- 172.21.15.79:0/3553874926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780b3800 msgr2=0x7f75780cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:37.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f7576d9d640 1 --2- 172.21.15.79:0/3553874926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780b3800 0x7f75780cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f7576d9d640 1 -- 172.21.15.79:0/3553874926 >> v1:172.21.15.79:6789/0 conn(0x7f75780d08f0 legacy=0x7f75780d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:37.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f7575d9b640 1 -- 172.21.15.79:0/3553874926 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2138234789 0 0) 0x7f7568001110 con 0x7f75780d08f0 2024-06-10T00:15:37.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.244+0000 7f7576d9d640 1 -- 172.21.15.79:0/3553874926 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75780cf8a0 con 0x7f75780cf190 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f7576d9d640 1 --2- 172.21.15.79:0/3553874926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780cf190 0x7f75780d23f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9383fb0fada1e3d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f7575d9b640 1 -- 172.21.15.79:0/3553874926 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570007740 con 0x7f75780cf190 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f7575d9b640 1 -- 172.21.15.79:0/3553874926 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75700078e0 con 0x7f75780cf190 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f7575d9b640 1 -- 172.21.15.79:0/3553874926 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570007cb0 con 0x7f75780cf190 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f757ce3f640 1 -- 172.21.15.79:0/3553874926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780cf190 msgr2=0x7f75780d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f757ce3f640 1 --2- 172.21.15.79:0/3553874926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780cf190 0x7f75780d23f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757002a660 comp rx=0 tx=0).stop 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f757ce3f640 1 -- 172.21.15.79:0/3553874926 shutdown_connections 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f757ce3f640 1 --2- 172.21.15.79:0/3553874926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780cf190 0x7f75780d23f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f757ce3f640 1 --2- 172.21.15.79:0/3553874926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780b3800 0x7f75780cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f757ce3f640 1 -- 172.21.15.79:0/3553874926 >> 172.21.15.79:0/3553874926 conn(0x7f757809d3c0 msgr2=0x7f75780d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:37.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.245+0000 7f757ce3f640 1 -- 172.21.15.79:0/3553874926 shutdown_connections 2024-06-10T00:15:37.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.246+0000 7f757ce3f640 1 -- 172.21.15.79:0/3553874926 wait complete. 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.247+0000 7f757ce3f640 1 Processor -- start 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.247+0000 7f757ce3f640 1 -- start start 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757ce3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780b3800 0x7f75780cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757ce3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780cf190 0x7f75780b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757ce3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75780d08f0 0x7f75780b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757ce3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75780d1ed0 con 0x7f75780b3800 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757ce3f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75780cfe60 con 0x7f75780d08f0 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757ce3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75780b50c0 con 0x7f75780cf190 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780b3800 0x7f75780cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780b3800 0x7f75780cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53330/0 (socket says 172.21.15.79:53330) 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 -- 172.21.15.79:0/2645038450 learned_addr learned my addr 172.21.15.79:0/2645038450 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f756dd9b640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780cf190 0x7f75780b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:37.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f7576d9d640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75780d08f0 0x7f75780b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 -- 172.21.15.79:0/2645038450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780cf190 msgr2=0x7f75780b8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780cf190 0x7f75780b8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 -- 172.21.15.79:0/2645038450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75780d08f0 msgr2=0x7f75780b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75780d08f0 0x7f75780b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 -- 172.21.15.79:0/2645038450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75780ce480 con 0x7f75780b3800 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f757659c640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780b3800 0x7f75780cdf40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f756800c7b0 tx=0x7f756800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f756f7fe640 1 -- 172.21.15.79:0/2645038450 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568018070 con 0x7f75780b3800 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.248+0000 7f756f7fe640 1 -- 172.21.15.79:0/2645038450 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75680072d0 con 0x7f75780b3800 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.249+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7578158d00 con 0x7f75780b3800 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.249+0000 7f756f7fe640 1 -- 172.21.15.79:0/2645038450 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75680047e0 con 0x7f75780b3800 2024-06-10T00:15:37.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.249+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75781592c0 con 0x7f75780b3800 2024-06-10T00:15:37.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.249+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75780683c0 con 0x7f75780b3800 2024-06-10T00:15:37.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.250+0000 7f756f7fe640 1 -- 172.21.15.79:0/2645038450 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f756801b070 con 0x7f75780b3800 2024-06-10T00:15:37.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.250+0000 7f756f7fe640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f755806be30 0x7f755806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:37.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.251+0000 7f756f7fe640 1 -- 172.21.15.79:0/2645038450 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7f756808a200 con 0x7f75780b3800 2024-06-10T00:15:37.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.251+0000 7f756dd9b640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f755806be30 0x7f755806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:37.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.251+0000 7f756dd9b640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f755806be30 0x7f755806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7560006fd0 tx=0x7f7560008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:37.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.255+0000 7f756f7fe640 1 -- 172.21.15.79:0/2645038450 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f75780b3c80 con 0x7f75780b3800 2024-06-10T00:15:37.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:37.463+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f75780d1730 con 0x7f75780b3800 2024-06-10T00:15:38.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.127+0000 7f756f7fe640 1 -- 172.21.15.79:0/2645038450 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f7568058b10 con 0x7f75780b3800 2024-06-10T00:15:38.139 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 5 and data pool 6 2024-06-10T00:15:38.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f755806be30 msgr2=0x7f755806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f755806be30 0x7f755806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7560006fd0 tx=0x7f7560008040 comp rx=0 tx=0).stop 2024-06-10T00:15:38.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780b3800 msgr2=0x7f75780cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780b3800 0x7f75780cdf40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f756800c7b0 tx=0x7f756800cc70 comp rx=0 tx=0).stop 2024-06-10T00:15:38.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 shutdown_connections 2024-06-10T00:15:38.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f755806be30 0x7f755806e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75780d08f0 0x7f75780b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75780cf190 0x7f75780b8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 --2- 172.21.15.79:0/2645038450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75780b3800 0x7f75780cdf40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 >> 172.21.15.79:0/2645038450 conn(0x7f757809d3c0 msgr2=0x7f75780b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:38.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 shutdown_connections 2024-06-10T00:15:38.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.144+0000 7f757ce3f640 1 -- 172.21.15.79:0/2645038450 wait complete. 2024-06-10T00:15:38.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:38.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.257+0000 7fe832031640 1 Processor -- start 2024-06-10T00:15:38.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.257+0000 7fe832031640 1 -- start start 2024-06-10T00:15:38.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe832031640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe82c15a870 0x7fe82c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe832031640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe82c0af3d0 0x7fe82c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe832031640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82c06e390 con 0x7fe82c0aef70 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe832031640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c15ac50 con 0x7fe82c15a870 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe832031640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c06cdb0 con 0x7fe82c0af3d0 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe82b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe82c15a870 0x7fe82c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe82affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe82c0aef70 0x7fe82c0b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44906/0 (socket says 172.21.15.79:44906) 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe82affd640 1 -- 172.21.15.79:0/4227489533 learned_addr learned my addr 172.21.15.79:0/4227489533 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe82b7fe640 1 -- 172.21.15.79:0/4227489533 >> v2:172.21.15.117:3300/0 conn(0x7fe82c0af3d0 msgr2=0x7fe82c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe82b7fe640 1 --2- 172.21.15.79:0/4227489533 >> v2:172.21.15.117:3300/0 conn(0x7fe82c0af3d0 0x7fe82c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe82b7fe640 1 -- 172.21.15.79:0/4227489533 >> v1:172.21.15.79:6789/0 conn(0x7fe82c0aef70 legacy=0x7fe82c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe82b7fe640 1 -- 172.21.15.79:0/4227489533 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c06d090 con 0x7fe82c15a870 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.258+0000 7fe82a7fc640 1 -- 172.21.15.79:0/4227489533 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2695060615 0 0) 0x7fe82c06e390 con 0x7fe82c0aef70 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.259+0000 7fe82b7fe640 1 --2- 172.21.15.79:0/4227489533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c06de50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe82c06c8b0 tx=0x7fe81c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bb48b0ea58adc7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.259+0000 7fe82a7fc640 1 -- 172.21.15.79:0/4227489533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c037070 con 0x7fe82c15a870 2024-06-10T00:15:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.259+0000 7fe82a7fc640 1 -- 172.21.15.79:0/4227489533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c02ae50 con 0x7fe82c15a870 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.259+0000 7fe82a7fc640 1 -- 172.21.15.79:0/4227489533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c032660 con 0x7fe82c15a870 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.260+0000 7fe832031640 1 -- 172.21.15.79:0/4227489533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 msgr2=0x7fe82c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.260+0000 7fe832031640 1 --2- 172.21.15.79:0/4227489533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c06de50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe82c06c8b0 tx=0x7fe81c02a140 comp rx=0 tx=0).stop 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.260+0000 7fe832031640 1 -- 172.21.15.79:0/4227489533 shutdown_connections 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.260+0000 7fe832031640 1 --2- 172.21.15.79:0/4227489533 >> v2:172.21.15.117:3300/0 conn(0x7fe82c0af3d0 0x7fe82c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.260+0000 7fe832031640 1 --2- 172.21.15.79:0/4227489533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c06de50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.260+0000 7fe832031640 1 -- 172.21.15.79:0/4227489533 >> 172.21.15.79:0/4227489533 conn(0x7fe82c0b19f0 msgr2=0x7fe82c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.260+0000 7fe832031640 1 -- 172.21.15.79:0/4227489533 shutdown_connections 2024-06-10T00:15:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.260+0000 7fe832031640 1 -- 172.21.15.79:0/4227489533 wait complete. 2024-06-10T00:15:38.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.261+0000 7fe832031640 1 Processor -- start 2024-06-10T00:15:38.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.261+0000 7fe832031640 1 -- start start 2024-06-10T00:15:38.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe832031640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82c0aef70 0x7fe82c15c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe832031640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82c0af3d0 0x7fe82c15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe832031640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c0ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe832031640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c06d930 con 0x7fe82c15a870 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe832031640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c06d650 con 0x7fe82c0af3d0 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe832031640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c0b2e40 con 0x7fe82c0aef70 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c0ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c0ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44922/0 (socket says 172.21.15.79:44922) 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 -- 172.21.15.79:0/1269875132 learned_addr learned my addr 172.21.15.79:0/1269875132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82affd640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82c0af3d0 0x7fe82c15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82b7fe640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82c0aef70 0x7fe82c15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 -- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82c0aef70 msgr2=0x7fe82c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82c0aef70 0x7fe82c15c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 -- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82c0af3d0 msgr2=0x7fe82c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82c0af3d0 0x7fe82c15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 -- 172.21.15.79:0/1269875132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c09d810 con 0x7fe82c15a870 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82affd640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82c0af3d0 0x7fe82c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82b7fe640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82c0aef70 0x7fe82c15c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe82bfff640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c0ae680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b970 tx=0x7fe82400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe813fff640 1 -- 172.21.15.79:0/1269875132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824019070 con 0x7fe82c15a870 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe813fff640 1 -- 172.21.15.79:0/1269875132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe82400cb60 con 0x7fe82c15a870 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c09cf70 con 0x7fe82c15a870 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe813fff640 1 -- 172.21.15.79:0/1269875132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824014440 con 0x7fe82c15a870 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.262+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c09d530 con 0x7fe82c15a870 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.264+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c0b01e0 con 0x7fe82c15a870 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.264+0000 7fe813fff640 1 -- 172.21.15.79:0/1269875132 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe82401c070 con 0x7fe82c15a870 2024-06-10T00:15:38.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.265+0000 7fe813fff640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe81806be30 0x7fe81806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.265+0000 7fe82b7fe640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe81806be30 0x7fe81806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.265+0000 7fe813fff640 1 -- 172.21.15.79:0/1269875132 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fe82408acc0 con 0x7fe82c15a870 2024-06-10T00:15:38.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.265+0000 7fe82b7fe640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe81806be30 0x7fe81806e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe81c034000 tx=0x7fe81c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.269+0000 7fe813fff640 1 -- 172.21.15.79:0/1269875132 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe82c0b01e0 con 0x7fe82c15a870 2024-06-10T00:15:38.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.446+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe82c0cd420 con 0x7fe82c15a870 2024-06-10T00:15:38.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.447+0000 7fe813fff640 1 -- 172.21.15.79:0/1269875132 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16907 (secure 0 0 0) 0x7fe82c0cd420 con 0x7fe82c15a870 2024-06-10T00:15:38.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:38.447 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":37,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:15:37.464906+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:15:35.302215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-10T00:15:36.439347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe81806be30 msgr2=0x7fe81806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe81806be30 0x7fe81806e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe81c034000 tx=0x7fe81c02e000 comp rx=0 tx=0).stop 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 msgr2=0x7fe82c0ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c0ae680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b970 tx=0x7fe82400be30 comp rx=0 tx=0).stop 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 shutdown_connections 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe81806be30 0x7fe81806e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe82c15a870 0x7fe82c0ae680 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82c0af3d0 0x7fe82c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 --2- 172.21.15.79:0/1269875132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82c0aef70 0x7fe82c15c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 >> 172.21.15.79:0/1269875132 conn(0x7fe82c0b19f0 msgr2=0x7fe82c154880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:38.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 shutdown_connections 2024-06-10T00:15:38.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.449+0000 7fe832031640 1 -- 172.21.15.79:0/1269875132 wait complete. 2024-06-10T00:15:38.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:38.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.559+0000 7f930b163640 1 Processor -- start 2024-06-10T00:15:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.559+0000 7f930b163640 1 -- start start 2024-06-10T00:15:38.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.559+0000 7f930b163640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93040ae910 0x7f930406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.559+0000 7f930b163640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f930406ea20 0x7f93040cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.559+0000 7f930b163640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f930406d130 con 0x7f93040cf190 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f930b163640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f930406ee90 con 0x7f93040ae910 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f930b163640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f930406d410 con 0x7f930406ea20 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9308eff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93040ae910 0x7f930406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9308eff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93040ae910 0x7f930406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44930/0 (socket says 172.21.15.79:44930) 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9308eff640 1 -- 172.21.15.79:0/1001326665 learned_addr learned my addr 172.21.15.79:0/1001326665 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9303fff640 1 --2- 172.21.15.79:0/1001326665 >> v2:172.21.15.117:3300/0 conn(0x7f930406ea20 0x7f93040cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9308eff640 1 -- 172.21.15.79:0/1001326665 >> v2:172.21.15.117:3300/0 conn(0x7f930406ea20 msgr2=0x7f93040cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9308eff640 1 --2- 172.21.15.79:0/1001326665 >> v2:172.21.15.117:3300/0 conn(0x7f930406ea20 0x7f93040cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9308eff640 1 -- 172.21.15.79:0/1001326665 >> v1:172.21.15.117:6789/0 conn(0x7f93040cf190 legacy=0x7f930415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9308eff640 1 -- 172.21.15.79:0/1001326665 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930406d6f0 con 0x7f93040ae910 2024-06-10T00:15:38.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.560+0000 7f9303fff640 1 --2- 172.21.15.79:0/1001326665 >> v2:172.21.15.117:3300/0 conn(0x7f930406ea20 0x7f93040cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:38.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f9308eff640 1 --2- 172.21.15.79:0/1001326665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93040ae910 0x7f930406e4e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9304070c80 tx=0x7f92f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb62d160bbb7f671 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f93037fe640 1 -- 172.21.15.79:0/1001326665 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8037070 con 0x7f93040ae910 2024-06-10T00:15:38.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f93037fe640 1 -- 172.21.15.79:0/1001326665 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f8032440 con 0x7f93040ae910 2024-06-10T00:15:38.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f93037fe640 1 -- 172.21.15.79:0/1001326665 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8032810 con 0x7f93040ae910 2024-06-10T00:15:38.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f930b163640 1 -- 172.21.15.79:0/1001326665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93040ae910 msgr2=0x7f930406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f930b163640 1 --2- 172.21.15.79:0/1001326665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93040ae910 0x7f930406e4e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9304070c80 tx=0x7f92f802a1a0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f930b163640 1 -- 172.21.15.79:0/1001326665 shutdown_connections 2024-06-10T00:15:38.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f930b163640 1 --2- 172.21.15.79:0/1001326665 >> v2:172.21.15.117:3300/0 conn(0x7f930406ea20 0x7f93040cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f930b163640 1 --2- 172.21.15.79:0/1001326665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93040ae910 0x7f930406e4e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f930b163640 1 -- 172.21.15.79:0/1001326665 >> 172.21.15.79:0/1001326665 conn(0x7f93040b19f0 msgr2=0x7f93040b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f930b163640 1 -- 172.21.15.79:0/1001326665 shutdown_connections 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.561+0000 7f930b163640 1 -- 172.21.15.79:0/1001326665 wait complete. 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.563+0000 7f930b163640 1 Processor -- start 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.563+0000 7f930b163640 1 -- start start 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.563+0000 7f930b163640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406ea20 0x7f9304155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.563+0000 7f930b163640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93040ae910 0x7f930414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.563+0000 7f930b163640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93040cf190 0x7f930415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.563+0000 7f930b163640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93040aecf0 con 0x7f930406ea20 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.563+0000 7f930b163640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93040cf5e0 con 0x7f93040cf190 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.563+0000 7f930b163640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93040add50 con 0x7f93040ae910 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406ea20 0x7f9304155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406ea20 0x7f9304155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44944/0 (socket says 172.21.15.79:44944) 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 -- 172.21.15.79:0/1709764577 learned_addr learned my addr 172.21.15.79:0/1709764577 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9309700640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93040cf190 0x7f930415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9303fff640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93040ae910 0x7f930414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 -- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93040ae910 msgr2=0x7f930414dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93040ae910 0x7f930414dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 -- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93040cf190 msgr2=0x7f930415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93040cf190 0x7f930415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 -- 172.21.15.79:0/1709764577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930415e410 con 0x7f930406ea20 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9303fff640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93040ae910 0x7f930414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f9308eff640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406ea20 0x7f9304155f10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f92f8000c00 tx=0x7f92f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f93017fa640 1 -- 172.21.15.79:0/1709764577 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8041070 con 0x7f930406ea20 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f93017fa640 1 -- 172.21.15.79:0/1709764577 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f803c870 con 0x7f930406ea20 2024-06-10T00:15:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930415ce30 con 0x7f930406ea20 2024-06-10T00:15:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f93017fa640 1 -- 172.21.15.79:0/1709764577 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8037040 con 0x7f930406ea20 2024-06-10T00:15:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.564+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930415d3f0 con 0x7f930406ea20 2024-06-10T00:15:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.565+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9304068430 con 0x7f930406ea20 2024-06-10T00:15:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.566+0000 7f93017fa640 1 -- 172.21.15.79:0/1709764577 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92f8044070 con 0x7f930406ea20 2024-06-10T00:15:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.566+0000 7f93017fa640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f92e806be60 0x7f92e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.566+0000 7f9303fff640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f92e806be60 0x7f92e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.566+0000 7f93017fa640 1 -- 172.21.15.79:0/1709764577 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f92f80abbd0 con 0x7f930406ea20 2024-06-10T00:15:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.567+0000 7f9303fff640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f92e806be60 0x7f92e806e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f930409da80 tx=0x7f92f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.570+0000 7f93017fa640 1 -- 172.21.15.79:0/1709764577 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f92f8079ec0 con 0x7f930406ea20 2024-06-10T00:15:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.746+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9304072be0 con 0x7f930406ea20 2024-06-10T00:15:38.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.747+0000 7f93017fa640 1 -- 172.21.15.79:0/1709764577 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16907 (secure 0 0 0) 0x7f92f807e1c0 con 0x7f930406ea20 2024-06-10T00:15:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:38.747 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":37,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:15:37.464906+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:15:35.302215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-10T00:15:36.439347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f92e806be60 msgr2=0x7f92e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f92e806be60 0x7f92e806e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f930409da80 tx=0x7f92f0008040 comp rx=0 tx=0).stop 2024-06-10T00:15:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406ea20 msgr2=0x7f9304155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406ea20 0x7f9304155f10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f92f8000c00 tx=0x7f92f80046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 shutdown_connections 2024-06-10T00:15:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f92e806be60 0x7f92e806e320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93040cf190 0x7f930415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93040ae910 0x7f930414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 --2- 172.21.15.79:0/1709764577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406ea20 0x7f9304155f10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 >> 172.21.15.79:0/1709764577 conn(0x7f93040b19f0 msgr2=0x7f93041529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 shutdown_connections 2024-06-10T00:15:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.749+0000 7f930b163640 1 -- 172.21.15.79:0/1709764577 wait complete. 2024-06-10T00:15:38.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-10T00:15:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.862+0000 7fc0a3d10640 1 Processor -- start 2024-06-10T00:15:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.862+0000 7fc0a3d10640 1 -- start start 2024-06-10T00:15:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a3d10640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc09c155320 0x7fc09c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a3d10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0b34e0 0x7fc09c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a3d10640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc09c0d0560 0x7fc09c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a3d10640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc09c155700 con 0x7fc09c155320 2024-06-10T00:15:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a3d10640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc09c15b6b0 con 0x7fc09c0d0560 2024-06-10T00:15:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a3d10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc09c15b990 con 0x7fc09c0b34e0 2024-06-10T00:15:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a1aac640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc09c155320 0x7fc09c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a1aac640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc09c155320 0x7fc09c0b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44956/0 (socket says 172.21.15.79:44956) 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.863+0000 7fc0a1aac640 1 -- 172.21.15.79:0/1977141774 learned_addr learned my addr 172.21.15.79:0/1977141774 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a22ad640 1 --2- 172.21.15.79:0/1977141774 >> v2:172.21.15.117:3300/0 conn(0x7fc09c0d0560 0x7fc09c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a12ab640 1 --2- 172.21.15.79:0/1977141774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0b34e0 0x7fc09c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a1aac640 1 -- 172.21.15.79:0/1977141774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0b34e0 msgr2=0x7fc09c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a1aac640 1 --2- 172.21.15.79:0/1977141774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0b34e0 0x7fc09c0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a1aac640 1 -- 172.21.15.79:0/1977141774 >> v2:172.21.15.117:3300/0 conn(0x7fc09c0d0560 msgr2=0x7fc09c06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a1aac640 1 --2- 172.21.15.79:0/1977141774 >> v2:172.21.15.117:3300/0 conn(0x7fc09c0d0560 0x7fc09c06e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a1aac640 1 -- 172.21.15.79:0/1977141774 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09c15bc70 con 0x7fc09c155320 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a1aac640 1 --2- 172.21.15.79:0/1977141774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c155320 0x7fc09c0b2fa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc09c158e20 tx=0x7fc09802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e970150a552df479 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.864+0000 7fc0a0aaa640 1 -- 172.21.15.79:0/1977141774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098037070 con 0x7fc09c155320 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a0aaa640 1 -- 172.21.15.79:0/1977141774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc098032440 con 0x7fc09c155320 2024-06-10T00:15:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a0aaa640 1 -- 172.21.15.79:0/1977141774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098032810 con 0x7fc09c155320 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 -- 172.21.15.79:0/1977141774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c155320 msgr2=0x7fc09c0b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/1977141774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c155320 0x7fc09c0b2fa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc09c158e20 tx=0x7fc09802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 -- 172.21.15.79:0/1977141774 shutdown_connections 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/1977141774 >> v2:172.21.15.117:3300/0 conn(0x7fc09c0d0560 0x7fc09c06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/1977141774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0b34e0 0x7fc09c0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/1977141774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c155320 0x7fc09c0b2fa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 -- 172.21.15.79:0/1977141774 >> 172.21.15.79:0/1977141774 conn(0x7fc09c0b1d10 msgr2=0x7fc09c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 -- 172.21.15.79:0/1977141774 shutdown_connections 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.865+0000 7fc0a3d10640 1 -- 172.21.15.79:0/1977141774 wait complete. 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.866+0000 7fc0a3d10640 1 Processor -- start 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.866+0000 7fc0a3d10640 1 -- start start 2024-06-10T00:15:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a3d10640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c0b34e0 0x7fc09c1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a3d10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0d0560 0x7fc09c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a3d10640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc09c155320 0x7fc09c15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a3d10640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c15b470 con 0x7fc09c0b34e0 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a3d10640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c15b2f0 con 0x7fc09c155320 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a3d10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc09c06e730 con 0x7fc09c0d0560 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a1aac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c0b34e0 0x7fc09c1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a1aac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c0b34e0 0x7fc09c1506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44960/0 (socket says 172.21.15.79:44960) 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a1aac640 1 -- 172.21.15.79:0/3510915944 learned_addr learned my addr 172.21.15.79:0/3510915944 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a22ad640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc09c155320 0x7fc09c15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a12ab640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0d0560 0x7fc09c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a1aac640 1 -- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0d0560 msgr2=0x7fc09c15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a1aac640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0d0560 0x7fc09c15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a1aac640 1 -- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc09c155320 msgr2=0x7fc09c15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a1aac640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc09c155320 0x7fc09c15d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.867+0000 7fc0a1aac640 1 -- 172.21.15.79:0/3510915944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09c157410 con 0x7fc09c0b34e0 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.868+0000 7fc0a22ad640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc09c155320 0x7fc09c15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.868+0000 7fc0a1aac640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c0b34e0 0x7fc09c1506e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc09802a220 tx=0x7fc0980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.868+0000 7fc0927fc640 1 -- 172.21.15.79:0/3510915944 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098041020 con 0x7fc09c0b34e0 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.868+0000 7fc0927fc640 1 -- 172.21.15.79:0/3510915944 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0980306c0 con 0x7fc09c0b34e0 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.868+0000 7fc0927fc640 1 -- 172.21.15.79:0/3510915944 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098037040 con 0x7fc09c0b34e0 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.868+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09c1576f0 con 0x7fc09c0b34e0 2024-06-10T00:15:38.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.868+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09c157cb0 con 0x7fc09c0b34e0 2024-06-10T00:15:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.869+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09c0683c0 con 0x7fc09c0b34e0 2024-06-10T00:15:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.869+0000 7fc0927fc640 1 -- 172.21.15.79:0/3510915944 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc098044020 con 0x7fc09c0b34e0 2024-06-10T00:15:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.870+0000 7fc0927fc640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc08006be30 0x7fc08006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.870+0000 7fc0927fc640 1 -- 172.21.15.79:0/3510915944 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fc0980ab8b0 con 0x7fc09c0b34e0 2024-06-10T00:15:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.870+0000 7fc0a12ab640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc08006be30 0x7fc08006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.870+0000 7fc0a12ab640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc08006be30 0x7fc08006e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc09c154450 tx=0x7fc08c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:38.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:38.874+0000 7fc0927fc640 1 -- 172.21.15.79:0/3510915944 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc09804b030 con 0x7fc09c0b34e0 2024-06-10T00:15:39.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.083+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc09c06e510 con 0x7fc09c0b34e0 2024-06-10T00:15:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.782+0000 7fc0927fc640 1 -- 172.21.15.79:0/3510915944 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7fc09807a0d0 con 0x7fc09c0b34e0 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc08006be30 msgr2=0x7fc08006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc08006be30 0x7fc08006e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc09c154450 tx=0x7fc08c008040 comp rx=0 tx=0).stop 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c0b34e0 msgr2=0x7fc09c1506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c0b34e0 0x7fc09c1506e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc09802a220 tx=0x7fc0980046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 shutdown_connections 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc08006be30 0x7fc08006e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc09c155320 0x7fc09c15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc09c0d0560 0x7fc09c15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 --2- 172.21.15.79:0/3510915944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09c0b34e0 0x7fc09c1506e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 >> 172.21.15.79:0/3510915944 conn(0x7fc09c0b1d10 msgr2=0x7fc09c159650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 shutdown_connections 2024-06-10T00:15:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.785+0000 7fc0a3d10640 1 -- 172.21.15.79:0/3510915944 wait complete. 2024-06-10T00:15:39.797 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-10T00:15:39.798 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-10T00:15:39.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.905+0000 7f60aac58640 1 Processor -- start 2024-06-10T00:15:39.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.905+0000 7f60aac58640 1 -- start start 2024-06-10T00:15:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.906+0000 7f60aac58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a40d0730 0x7f60a406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.906+0000 7f60aac58640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a40b3080 con 0x7f60a40b3b40 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.906+0000 7f60aac58640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a415c870 con 0x7f60a40b2bf0 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.906+0000 7f60aac58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60a415cb50 con 0x7f60a40d0730 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.906+0000 7f60a89f4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f60a40b3b40 0x7f60a40b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44908/0 (socket says 172.21.15.79:44908) 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.906+0000 7f60a89f4640 1 -- 172.21.15.79:0/3944765511 learned_addr learned my addr 172.21.15.79:0/3944765511 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766431901 0 0) 0x7f60a40b3080 con 0x7f60a40b3b40 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f608c003520 con 0x7f60a40b3b40 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f60a91f5640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a40d0730 0x7f60a406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3005274890 0 0) 0x7f608c003520 con 0x7f60a40b3b40 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a40d0730 msgr2=0x7f60a406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a40d0730 0x7f60a406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 >> v1:172.21.15.117:6789/0 conn(0x7f60a40b2bf0 legacy=0x7f60a40d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a415ce30 con 0x7f60a40b3b40 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f60a0001670 con 0x7f60a40b3b40 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 >> v1:172.21.15.79:6789/0 conn(0x7f60a40b3b40 legacy=0x7f60a40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c0039e0 0x7f608c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a40d0730 0x7f608c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f608c004d40 0x7f608c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60a415cb50 con 0x7f608c004d40 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f608c00bb80 con 0x7f608c0039e0 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f608c00bd80 con 0x7f60a40d0730 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f60a91f5640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f608c004d40 0x7f608c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f60a89f4640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c0039e0 0x7f608c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f609bfff640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a40d0730 0x7f608c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f60a91f5640 1 -- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a40d0730 msgr2=0x7f608c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f60a91f5640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a40d0730 0x7f608c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f60a91f5640 1 -- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c0039e0 msgr2=0x7f608c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f60a91f5640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c0039e0 0x7f608c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.907+0000 7f60a91f5640 1 -- 172.21.15.79:0/3944765511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c003520 con 0x7f608c004d40 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.908+0000 7f60a91f5640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f608c004d40 0x7f608c0051c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f609c007360 tx=0x7f608c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d581267ad1c78b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.908+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c009be0 con 0x7f608c004d40 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.908+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c036600 con 0x7f608c004d40 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.908+0000 7f609b7fe640 1 -- 172.21.15.79:0/3944765511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c0369d0 con 0x7f608c004d40 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.909+0000 7f60aac58640 1 -- 172.21.15.79:0/3944765511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f608c004d40 msgr2=0x7f608c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.909+0000 7f60aac58640 1 --2- 172.21.15.79:0/3944765511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f608c004d40 0x7f608c0051c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f609c007360 tx=0x7f608c005830 comp rx=0 tx=0).stop 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.909+0000 7f60a91f5640 1 -- 172.21.15.79:0/3944765511 reap_dead start 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.909+0000 7f60aac58640 1 -- 172.21.15.79:0/3944765511 shutdown_connections 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.909+0000 7f60aac58640 1 -- 172.21.15.79:0/3944765511 >> 172.21.15.79:0/3944765511 conn(0x7f60a40b1d10 msgr2=0x7f60a40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.909+0000 7f60aac58640 1 -- 172.21.15.79:0/3944765511 shutdown_connections 2024-06-10T00:15:39.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.909+0000 7f60aac58640 1 -- 172.21.15.79:0/3944765511 wait complete. 2024-06-10T00:15:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.910+0000 7f60aac58640 1 Processor -- start 2024-06-10T00:15:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.910+0000 7f60aac58640 1 -- start start 2024-06-10T00:15:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60aac58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c004d40 0x7f60a41e5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60aac58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a409c470 0x7f60a409c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60aac58640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a414b0a0 0x7f60a414b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60aac58640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60a40b3f20 con 0x7f60a414b0a0 2024-06-10T00:15:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60aac58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60a415d3f0 con 0x7f608c004d40 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60aac58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60a40b4ff0 con 0x7f60a409c470 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a414b0a0 0x7f60a414b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a414b0a0 0x7f60a414b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44976/0 (socket says 172.21.15.79:44976) 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 -- 172.21.15.79:0/4033333601 learned_addr learned my addr 172.21.15.79:0/4033333601 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f609bfff640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a409c470 0x7f60a409c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a89f4640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c004d40 0x7f60a41e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 -- 172.21.15.79:0/4033333601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a409c470 msgr2=0x7f60a409c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a409c470 0x7f60a409c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 -- 172.21.15.79:0/4033333601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c004d40 msgr2=0x7f60a41e5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c004d40 0x7f60a41e5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 -- 172.21.15.79:0/4033333601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a4158ab0 con 0x7f60a414b0a0 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.911+0000 7f60a91f5640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a414b0a0 0x7f60a414b520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f609c007480 tx=0x7f609c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.912+0000 7f60997fa640 1 -- 172.21.15.79:0/4033333601 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c045070 con 0x7f60a414b0a0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.912+0000 7f60997fa640 1 -- 172.21.15.79:0/4033333601 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c003990 con 0x7f60a414b0a0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.912+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a409cfe0 con 0x7f60a414b0a0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.912+0000 7f60997fa640 1 -- 172.21.15.79:0/4033333601 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c009be0 con 0x7f60a414b0a0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.912+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a41e2650 con 0x7f60a414b0a0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.913+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a40683c0 con 0x7f60a414b0a0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.913+0000 7f60997fa640 1 -- 172.21.15.79:0/4033333601 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f609c048070 con 0x7f60a414b0a0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.913+0000 7f60997fa640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609006be30 0x7f609006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.914+0000 7f60997fa640 1 -- 172.21.15.79:0/4033333601 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f609c0ab3a0 con 0x7f60a414b0a0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.914+0000 7f60a89f4640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609006be30 0x7f609006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.914+0000 7f60a89f4640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609006be30 0x7f609006e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f60a0000c00 tx=0x7f60a00078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:39.918+0000 7f60997fa640 1 -- 172.21.15.79:0/4033333601 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f609c03d070 con 0x7f60a414b0a0 2024-06-10T00:15:40.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.129+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f60a40cc6b0 con 0x7f60a414b0a0 2024-06-10T00:15:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.783+0000 7f60997fa640 1 -- 172.21.15.79:0/4033333601 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f609c032030 con 0x7f60a414b0a0 2024-06-10T00:15:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.785+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609006be30 msgr2=0x7f609006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.785+0000 7f60aac58640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609006be30 0x7f609006e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f60a0000c00 tx=0x7f60a00078f0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.785+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a414b0a0 msgr2=0x7f60a414b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.785+0000 7f60aac58640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a414b0a0 0x7f60a414b520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f609c007480 tx=0x7f609c004ab0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.786+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 shutdown_connections 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.786+0000 7f60aac58640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609006be30 0x7f609006e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.786+0000 7f60aac58640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60a414b0a0 0x7f60a414b520 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.786+0000 7f60aac58640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60a409c470 0x7f60a409c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.786+0000 7f60aac58640 1 --2- 172.21.15.79:0/4033333601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f608c004d40 0x7f60a41e5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.786+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 >> 172.21.15.79:0/4033333601 conn(0x7f60a40b1d10 msgr2=0x7f60a415a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.786+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 shutdown_connections 2024-06-10T00:15:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.786+0000 7f60aac58640 1 -- 172.21.15.79:0/4033333601 wait complete. 2024-06-10T00:15:40.797 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-10T00:15:40.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.897+0000 7fc1f09ed640 1 Processor -- start 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.897+0000 7fc1f09ed640 1 -- start start 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1f09ed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc1ec0cc6d0 0x7fc1ec0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1f09ed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1ec071c60 0x7fc1ec072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1f09ed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec0ccff0 con 0x7fc1ec0b36c0 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1f09ed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc1ec072820 con 0x7fc1ec071c60 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1f09ed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc1ec072b00 con 0x7fc1ec0cc6d0 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1e9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1ec071c60 0x7fc1ec072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1e9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1ec071c60 0x7fc1ec072110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44992/0 (socket says 172.21.15.79:44992) 2024-06-10T00:15:40.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1e9d9b640 1 -- 172.21.15.79:0/3157394156 learned_addr learned my addr 172.21.15.79:0/3157394156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1e9d9b640 1 -- 172.21.15.79:0/3157394156 >> v2:172.21.15.117:3300/0 conn(0x7fc1ec0cc6d0 msgr2=0x7fc1ec0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1e9d9b640 1 --2- 172.21.15.79:0/3157394156 >> v2:172.21.15.117:3300/0 conn(0x7fc1ec0cc6d0 0x7fc1ec0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1e9d9b640 1 -- 172.21.15.79:0/3157394156 >> v1:172.21.15.117:6789/0 conn(0x7fc1ec0b36c0 legacy=0x7fc1ec0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.898+0000 7fc1e9d9b640 1 -- 172.21.15.79:0/3157394156 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec072de0 con 0x7fc1ec071c60 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.899+0000 7fc1e9d9b640 1 --2- 172.21.15.79:0/3157394156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec072110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec09e090 tx=0x7fc1e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a420b81c30feb5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.899+0000 7fc1e959a640 1 -- 172.21.15.79:0/3157394156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0037070 con 0x7fc1ec071c60 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.899+0000 7fc1e959a640 1 -- 172.21.15.79:0/3157394156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e0032440 con 0x7fc1ec071c60 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.899+0000 7fc1e959a640 1 -- 172.21.15.79:0/3157394156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0032810 con 0x7fc1ec071c60 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.900+0000 7fc1f09ed640 1 -- 172.21.15.79:0/3157394156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 msgr2=0x7fc1ec072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.900+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/3157394156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec072110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec09e090 tx=0x7fc1e002a230 comp rx=0 tx=0).stop 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.900+0000 7fc1f09ed640 1 -- 172.21.15.79:0/3157394156 shutdown_connections 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.900+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/3157394156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec072110 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.900+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/3157394156 >> v2:172.21.15.117:3300/0 conn(0x7fc1ec0cc6d0 0x7fc1ec0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.900+0000 7fc1f09ed640 1 -- 172.21.15.79:0/3157394156 >> 172.21.15.79:0/3157394156 conn(0x7fc1ec0b19f0 msgr2=0x7fc1ec0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:40.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.900+0000 7fc1f09ed640 1 -- 172.21.15.79:0/3157394156 shutdown_connections 2024-06-10T00:15:40.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.900+0000 7fc1f09ed640 1 -- 172.21.15.79:0/3157394156 wait complete. 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.901+0000 7fc1f09ed640 1 Processor -- start 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.901+0000 7fc1f09ed640 1 -- start start 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1f09ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec1f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1f09ed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1ec0b36c0 0x7fc1ec15c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1f09ed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1ec0cc6d0 0x7fc1ec15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1f09ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec159f60 con 0x7fc1ec071c60 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1f09ed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec15c890 con 0x7fc1ec0cc6d0 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1f09ed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec0b4200 con 0x7fc1ec0b36c0 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ea59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec1f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ea59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec1f2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44994/0 (socket says 172.21.15.79:44994) 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ea59c640 1 -- 172.21.15.79:0/540860406 learned_addr learned my addr 172.21.15.79:0/540860406 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:40.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ead9d640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1ec0cc6d0 0x7fc1ec15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1e9d9b640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1ec0b36c0 0x7fc1ec15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ea59c640 1 -- 172.21.15.79:0/540860406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1ec0b36c0 msgr2=0x7fc1ec15c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ea59c640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1ec0b36c0 0x7fc1ec15c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ea59c640 1 -- 172.21.15.79:0/540860406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1ec0cc6d0 msgr2=0x7fc1ec15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ea59c640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1ec0cc6d0 0x7fc1ec15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.902+0000 7fc1ea59c640 1 -- 172.21.15.79:0/540860406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec1f2ab0 con 0x7fc1ec071c60 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.903+0000 7fc1ea59c640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec1f2220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00b410 tx=0x7fc1dc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.903+0000 7fc1daffd640 1 -- 172.21.15.79:0/540860406 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc015020 con 0x7fc1ec071c60 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.903+0000 7fc1daffd640 1 -- 172.21.15.79:0/540860406 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1dc011850 con 0x7fc1ec071c60 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.903+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec1f2d90 con 0x7fc1ec071c60 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.903+0000 7fc1daffd640 1 -- 172.21.15.79:0/540860406 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc011c40 con 0x7fc1ec071c60 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.903+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec1f2760 con 0x7fc1ec071c60 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.904+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ec15a0e0 con 0x7fc1ec071c60 2024-06-10T00:15:40.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.904+0000 7fc1daffd640 1 -- 172.21.15.79:0/540860406 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1dc018020 con 0x7fc1ec071c60 2024-06-10T00:15:40.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.905+0000 7fc1daffd640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:40.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.905+0000 7fc1daffd640 1 -- 172.21.15.79:0/540860406 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fc1dc08af30 con 0x7fc1ec071c60 2024-06-10T00:15:40.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.905+0000 7fc1e9d9b640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:40.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.905+0000 7fc1e9d9b640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0034000 tx=0x7fc1e002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:40.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:40.909+0000 7fc1daffd640 1 -- 172.21.15.79:0/540860406 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc1dc01f020 con 0x7fc1ec071c60 2024-06-10T00:15:41.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.116+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1ec068430 con 0x7fc1ec071c60 2024-06-10T00:15:41.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.117+0000 7fc1daffd640 1 -- 172.21.15.79:0/540860406 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7fc1dc0172c0 con 0x7fc1ec071c60 2024-06-10T00:15:41.117 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:41.117 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:15:37.465229+0000","modified":"2024-06-10T00:15:40.130979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3860098569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3860098569},{"type":"v1","addr":"172.21.15.79:6837","nonce":3860098569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4968,"qdb_cluster":[4968]},"id":2}]} 2024-06-10T00:15:41.117 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 msgr2=0x7fc1cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0034000 tx=0x7fc1e002e000 comp rx=0 tx=0).stop 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 msgr2=0x7fc1ec1f2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec1f2220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00b410 tx=0x7fc1dc00b8d0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 shutdown_connections 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1cc06be30 0x7fc1cc06e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1ec0cc6d0 0x7fc1ec15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1ec0b36c0 0x7fc1ec15c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 --2- 172.21.15.79:0/540860406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ec071c60 0x7fc1ec1f2220 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 >> 172.21.15.79:0/540860406 conn(0x7fc1ec0b19f0 msgr2=0x7fc1ec0afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:41.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 shutdown_connections 2024-06-10T00:15:41.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.119+0000 7fc1f09ed640 1 -- 172.21.15.79:0/540860406 wait complete. 2024-06-10T00:15:41.130 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:15:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.230+0000 7f0b45314640 1 Processor -- start 2024-06-10T00:15:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.230+0000 7f0b45314640 1 -- start start 2024-06-10T00:15:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b45314640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b4015c240 0x7f0b400cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b45314640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b4006d9b0 0x7f0b4006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b45314640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4006deb0 con 0x7f0b4006f490 2024-06-10T00:15:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b45314640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4015d630 con 0x7f0b4006d9b0 2024-06-10T00:15:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b45314640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4006e190 con 0x7f0b4015c240 2024-06-10T00:15:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b3e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b4006d9b0 0x7f0b4006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b3e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b4006d9b0 0x7f0b4006ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45010/0 (socket says 172.21.15.79:45010) 2024-06-10T00:15:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b3e7fc640 1 -- 172.21.15.79:0/220198113 learned_addr learned my addr 172.21.15.79:0/220198113 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b3e7fc640 1 -- 172.21.15.79:0/220198113 >> v2:172.21.15.117:3300/0 conn(0x7f0b4015c240 msgr2=0x7f0b400cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b3e7fc640 1 --2- 172.21.15.79:0/220198113 >> v2:172.21.15.117:3300/0 conn(0x7f0b4015c240 0x7f0b400cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b3e7fc640 1 -- 172.21.15.79:0/220198113 >> v1:172.21.15.117:6789/0 conn(0x7f0b4006f490 legacy=0x7f0b4015d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.231+0000 7f0b3e7fc640 1 -- 172.21.15.79:0/220198113 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4006e470 con 0x7f0b4006d9b0 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.232+0000 7f0b3e7fc640 1 --2- 172.21.15.79:0/220198113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006d9b0 0x7f0b4006ef50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0b400b5c80 tx=0x7f0b3402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9405bb4bb8826b59 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.232+0000 7f0b3dffb640 1 -- 172.21.15.79:0/220198113 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34037070 con 0x7f0b4006d9b0 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.232+0000 7f0b3dffb640 1 -- 172.21.15.79:0/220198113 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b34032440 con 0x7f0b4006d9b0 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.232+0000 7f0b3dffb640 1 -- 172.21.15.79:0/220198113 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34032810 con 0x7f0b4006d9b0 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.233+0000 7f0b45314640 1 -- 172.21.15.79:0/220198113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006d9b0 msgr2=0x7f0b4006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.233+0000 7f0b45314640 1 --2- 172.21.15.79:0/220198113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006d9b0 0x7f0b4006ef50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0b400b5c80 tx=0x7f0b3402a230 comp rx=0 tx=0).stop 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.233+0000 7f0b45314640 1 -- 172.21.15.79:0/220198113 shutdown_connections 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.233+0000 7f0b45314640 1 --2- 172.21.15.79:0/220198113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006d9b0 0x7f0b4006ef50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.233+0000 7f0b45314640 1 --2- 172.21.15.79:0/220198113 >> v2:172.21.15.117:3300/0 conn(0x7f0b4015c240 0x7f0b400cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.233+0000 7f0b45314640 1 -- 172.21.15.79:0/220198113 >> 172.21.15.79:0/220198113 conn(0x7f0b40071950 msgr2=0x7f0b40071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.233+0000 7f0b45314640 1 -- 172.21.15.79:0/220198113 shutdown_connections 2024-06-10T00:15:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.233+0000 7f0b45314640 1 -- 172.21.15.79:0/220198113 wait complete. 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.234+0000 7f0b45314640 1 Processor -- start 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.234+0000 7f0b45314640 1 -- start start 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b45314640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4006d9b0 0x7f0b4014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b45314640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006f490 0x7f0b40147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b45314640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4015c240 0x7f0b4014d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b45314640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b400aff60 con 0x7f0b4006f490 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b45314640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4006ea30 con 0x7f0b4015c240 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b45314640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4015dfc0 con 0x7f0b4006d9b0 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006f490 0x7f0b40147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006f490 0x7f0b40147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45024/0 (socket says 172.21.15.79:45024) 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 -- 172.21.15.79:0/782753526 learned_addr learned my addr 172.21.15.79:0/782753526 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3effd640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4006d9b0 0x7f0b4014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 -- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4006d9b0 msgr2=0x7f0b4014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3f7fe640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4015c240 0x7f0b4014d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4006d9b0 0x7f0b4014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 -- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4015c240 msgr2=0x7f0b4014d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4015c240 0x7f0b4014d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 -- 172.21.15.79:0/782753526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4014e250 con 0x7f0b4006f490 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3f7fe640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4015c240 0x7f0b4014d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b3e7fc640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006f490 0x7f0b40147d40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0b3402a270 tx=0x7f0b340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.235+0000 7f0b277fe640 1 -- 172.21.15.79:0/782753526 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34041070 con 0x7f0b4006f490 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.236+0000 7f0b277fe640 1 -- 172.21.15.79:0/782753526 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b3403c870 con 0x7f0b4006f490 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.236+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4014e530 con 0x7f0b4006f490 2024-06-10T00:15:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.236+0000 7f0b277fe640 1 -- 172.21.15.79:0/782753526 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34037040 con 0x7f0b4006f490 2024-06-10T00:15:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.236+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4014eaf0 con 0x7f0b4006f490 2024-06-10T00:15:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.236+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b40068430 con 0x7f0b4006f490 2024-06-10T00:15:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.237+0000 7f0b277fe640 1 -- 172.21.15.79:0/782753526 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b34044070 con 0x7f0b4006f490 2024-06-10T00:15:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.237+0000 7f0b277fe640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.237+0000 7f0b277fe640 1 -- 172.21.15.79:0/782753526 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f0b340abbe0 con 0x7f0b4006f490 2024-06-10T00:15:41.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.238+0000 7f0b3effd640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.238+0000 7f0b3effd640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b30007dc0 tx=0x7f0b300072f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.242+0000 7f0b277fe640 1 -- 172.21.15.79:0/782753526 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0b3407a520 con 0x7f0b4006f490 2024-06-10T00:15:41.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.415+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b40156910 con 0x7f0b4006f490 2024-06-10T00:15:41.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.416+0000 7f0b277fe640 1 -- 172.21.15.79:0/782753526 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16894 (secure 0 0 0) 0x7f0b34079e20 con 0x7f0b4006f490 2024-06-10T00:15:41.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:41.416 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:15:39.128132+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:15:35.302215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-10T00:15:36.439347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:15:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0b2c06be30 msgr2=0x7f0b2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b30007dc0 tx=0x7f0b300072f0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006f490 msgr2=0x7f0b40147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006f490 0x7f0b40147d40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0b3402a270 tx=0x7f0b340046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 shutdown_connections 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4015c240 0x7f0b4014d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b4006f490 0x7f0b40147d40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 --2- 172.21.15.79:0/782753526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4006d9b0 0x7f0b4014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 >> 172.21.15.79:0/782753526 conn(0x7f0b40071950 msgr2=0x7f0b4015b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 shutdown_connections 2024-06-10T00:15:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.418+0000 7f0b45314640 1 -- 172.21.15.79:0/782753526 wait complete. 2024-06-10T00:15:41.429 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:15:41.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:41.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.529+0000 7f1c5a389640 1 Processor -- start 2024-06-10T00:15:41.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.529+0000 7f1c5a389640 1 -- start start 2024-06-10T00:15:41.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c5a389640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540ae910 0x7f1c5406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c5a389640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5406d130 con 0x7f1c540cf360 2024-06-10T00:15:41.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c5a389640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5406d410 con 0x7f1c5406ea20 2024-06-10T00:15:41.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c5a389640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5406ee60 con 0x7f1c540ae910 2024-06-10T00:15:41.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c58926640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1c540cf360 0x7f1c540acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44914/0 (socket says 172.21.15.79:44914) 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c58926640 1 -- 172.21.15.79:0/4156209986 learned_addr learned my addr 172.21.15.79:0/4156209986 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c53fff640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540ae910 0x7f1c5406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1259572900 0 0) 0x7f1c5406d130 con 0x7f1c540cf360 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c3c003520 con 0x7f1c540cf360 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678618581 0 0) 0x7f1c5406d410 con 0x7f1c5406ea20 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.530+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c5406d130 con 0x7f1c5406ea20 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2652085715 0 0) 0x7f1c3c003520 con 0x7f1c540cf360 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540ae910 msgr2=0x7f1c5406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540ae910 0x7f1c5406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 >> v1:172.21.15.117:6789/0 conn(0x7f1c5406ea20 legacy=0x7f1c540cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5406d6f0 con 0x7f1c540cf360 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f1c4c0019f0 con 0x7f1c540cf360 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 >> v1:172.21.15.79:6789/0 conn(0x7f1c540cf360 legacy=0x7f1c540acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c3c003b70 0x7f1c3c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c004800 0x7f1c3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0051c0 0x7f1c3c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5406ee60 con 0x7f1c3c003b70 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c00e240 con 0x7f1c3c004800 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3c00e440 con 0x7f1c3c0051c0 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c53fff640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540ae910 0x7f1c5406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c53fff640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c3c003b70 0x7f1c3c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c537fe640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c004800 0x7f1c3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c58926640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0051c0 0x7f1c3c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c53fff640 1 -- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0051c0 msgr2=0x7f1c3c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c53fff640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0051c0 0x7f1c3c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c53fff640 1 -- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c004800 msgr2=0x7f1c3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c53fff640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c004800 0x7f1c3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.531+0000 7f1c53fff640 1 -- 172.21.15.79:0/4156209986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c003520 con 0x7f1c3c003b70 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c53fff640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c3c003b70 0x7f1c3c003f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1c54070a40 tx=0x7f1c3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ea8901f7eb720a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44036070 con 0x7f1c3c003b70 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c44004030 con 0x7f1c3c003b70 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c52ffd640 1 -- 172.21.15.79:0/4156209986 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c440097d0 con 0x7f1c3c003b70 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c5a389640 1 -- 172.21.15.79:0/4156209986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c3c003b70 msgr2=0x7f1c3c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c5a389640 1 --2- 172.21.15.79:0/4156209986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c3c003b70 0x7f1c3c003f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1c54070a40 tx=0x7f1c3c005830 comp rx=0 tx=0).stop 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c58926640 1 -- 172.21.15.79:0/4156209986 reap_dead start 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c5a389640 1 -- 172.21.15.79:0/4156209986 shutdown_connections 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c5a389640 1 -- 172.21.15.79:0/4156209986 >> 172.21.15.79:0/4156209986 conn(0x7f1c540b19f0 msgr2=0x7f1c540b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.532+0000 7f1c5a389640 1 -- 172.21.15.79:0/4156209986 shutdown_connections 2024-06-10T00:15:41.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.533+0000 7f1c5a389640 1 -- 172.21.15.79:0/4156209986 wait complete. 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.534+0000 7f1c5a389640 1 Processor -- start 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.534+0000 7f1c5a389640 1 -- start start 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.534+0000 7f1c5a389640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c003b70 0x7f1c5414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c5a389640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c54151a70 0x7f1c54157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c5a389640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c54151ed0 0x7f1c54158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c5a389640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5406e4e0 con 0x7f1c54151a70 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c5a389640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c540aecf0 con 0x7f1c3c003b70 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c5a389640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5406e660 con 0x7f1c54151ed0 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c54151a70 0x7f1c54157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c54151a70 0x7f1c54157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45036/0 (socket says 172.21.15.79:45036) 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 -- 172.21.15.79:0/3252322487 learned_addr learned my addr 172.21.15.79:0/3252322487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:41.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 -- 172.21.15.79:0/3252322487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c54151ed0 msgr2=0x7f1c54158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c54151ed0 0x7f1c54158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 -- 172.21.15.79:0/3252322487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c003b70 msgr2=0x7f1c5414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c003b70 0x7f1c5414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 -- 172.21.15.79:0/3252322487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c54150a40 con 0x7f1c54151a70 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c537fe640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c54151a70 0x7f1c54157d40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800f7d0 tx=0x7f1c4800fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c50ff9640 1 -- 172.21.15.79:0/3252322487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4800fe80 con 0x7f1c54151a70 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c50ff9640 1 -- 172.21.15.79:0/3252322487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c48018070 con 0x7f1c54151a70 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c54150cb0 con 0x7f1c54151a70 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c50ff9640 1 -- 172.21.15.79:0/3252322487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4800d6b0 con 0x7f1c54151a70 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.535+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c54151270 con 0x7f1c54151a70 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.536+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c54072e70 con 0x7f1c54151a70 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.537+0000 7f1c50ff9640 1 -- 172.21.15.79:0/3252322487 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c4800d850 con 0x7f1c54151a70 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.537+0000 7f1c50ff9640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c4006be60 0x7f1c4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.537+0000 7f1c53fff640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c4006be60 0x7f1c4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.537+0000 7f1c50ff9640 1 -- 172.21.15.79:0/3252322487 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f1c4808af70 con 0x7f1c54151a70 2024-06-10T00:15:41.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.538+0000 7f1c53fff640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c4006be60 0x7f1c4006e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1c44033000 tx=0x7f1c4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.542+0000 7f1c50ff9640 1 -- 172.21.15.79:0/3252322487 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1c54072e70 con 0x7f1c54151a70 2024-06-10T00:15:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.710+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c540b3ac0 con 0x7f1c4006be60 2024-06-10T00:15:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.716+0000 7f1c50ff9640 1 -- 172.21.15.79:0/3252322487 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240049 (secure 0 0 0) 0x7f1c540b3ac0 con 0x7f1c4006be60 2024-06-10T00:15:41.718 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c4006be60 msgr2=0x7f1c4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c4006be60 0x7f1c4006e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1c44033000 tx=0x7f1c4402e000 comp rx=0 tx=0).stop 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c54151a70 msgr2=0x7f1c54157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c54151a70 0x7f1c54157d40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800f7d0 tx=0x7f1c4800fc90 comp rx=0 tx=0).stop 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 shutdown_connections 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c4006be60 0x7f1c4006e320 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c54151ed0 0x7f1c54158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c54151a70 0x7f1c54157d40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 --2- 172.21.15.79:0/3252322487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c003b70 0x7f1c5414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 >> 172.21.15.79:0/3252322487 conn(0x7f1c540b19f0 msgr2=0x7f1c540723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 shutdown_connections 2024-06-10T00:15:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.719+0000 7f1c5a389640 1 -- 172.21.15.79:0/3252322487 wait complete. 2024-06-10T00:15:41.729 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-06-10T00:15:41.158082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220424,"kb_used_data":4212,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754296,"statfs":{"total":773094113280,"available":772868399104,"internally_reserved":0,"allocated":4313088,"data_stored":2493289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.050645"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113274+0000","last_change":"2024-06-10T00:15:36.113274+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113274+0000","last_undegraded":"2024-06-10T00:15:36.113274+0000","last_fullsized":"2024-06-10T00:15:36.113274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113805+0000","last_change":"2024-06-10T00:15:36.113805+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113805+0000","last_undegraded":"2024-06-10T00:15:36.113805+0000","last_fullsized":"2024-06-10T00:15:36.113805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110469+0000","last_change":"2024-06-10T00:15:36.110469+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110469+0000","last_undegraded":"2024-06-10T00:15:36.110469+0000","last_fullsized":"2024-06-10T00:15:36.110469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110361+0000","last_change":"2024-06-10T00:15:36.110361+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110361+0000","last_undegraded":"2024-06-10T00:15:36.110361+0000","last_fullsized":"2024-06-10T00:15:36.110361+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111587+0000","last_change":"2024-06-10T00:15:36.111587+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111587+0000","last_undegraded":"2024-06-10T00:15:36.111587+0000","last_fullsized":"2024-06-10T00:15:36.111587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115247+0000","last_change":"2024-06-10T00:15:36.115247+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115247+0000","last_undegraded":"2024-06-10T00:15:36.115247+0000","last_fullsized":"2024-06-10T00:15:36.115247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110473+0000","last_change":"2024-06-10T00:15:36.110473+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110473+0000","last_undegraded":"2024-06-10T00:15:36.110473+0000","last_fullsized":"2024-06-10T00:15:36.110473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110397+0000","last_change":"2024-06-10T00:15:36.110397+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110397+0000","last_undegraded":"2024-06-10T00:15:36.110397+0000","last_fullsized":"2024-06-10T00:15:36.110397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112578+0000","last_change":"2024-06-10T00:15:36.112578+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112578+0000","last_undegraded":"2024-06-10T00:15:36.112578+0000","last_fullsized":"2024-06-10T00:15:36.112578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111074+0000","last_change":"2024-06-10T00:15:36.111074+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111074+0000","last_undegraded":"2024-06-10T00:15:36.111074+0000","last_fullsized":"2024-06-10T00:15:36.111074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110848+0000","last_change":"2024-06-10T00:15:36.110848+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110848+0000","last_undegraded":"2024-06-10T00:15:36.110848+0000","last_fullsized":"2024-06-10T00:15:36.110848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112427+0000","last_change":"2024-06-10T00:15:36.112427+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112427+0000","last_undegraded":"2024-06-10T00:15:36.112427+0000","last_fullsized":"2024-06-10T00:15:36.112427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112424+0000","last_change":"2024-06-10T00:15:36.112424+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112424+0000","last_undegraded":"2024-06-10T00:15:36.112424+0000","last_fullsized":"2024-06-10T00:15:36.112424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110443+0000","last_change":"2024-06-10T00:15:36.110443+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110443+0000","last_undegraded":"2024-06-10T00:15:36.110443+0000","last_fullsized":"2024-06-10T00:15:36.110443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113604+0000","last_change":"2024-06-10T00:15:36.113604+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113604+0000","last_undegraded":"2024-06-10T00:15:36.113604+0000","last_fullsized":"2024-06-10T00:15:36.113604+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115240+0000","last_change":"2024-06-10T00:15:36.115240+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115240+0000","last_undegraded":"2024-06-10T00:15:36.115240+0000","last_fullsized":"2024-06-10T00:15:36.115240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111438+0000","last_change":"2024-06-10T00:15:36.111438+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111438+0000","last_undegraded":"2024-06-10T00:15:36.111438+0000","last_fullsized":"2024-06-10T00:15:36.111438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110371+0000","last_change":"2024-06-10T00:15:36.110371+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110371+0000","last_undegraded":"2024-06-10T00:15:36.110371+0000","last_fullsized":"2024-06-10T00:15:36.110371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117964+0000","last_change":"2024-06-10T00:15:36.117964+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117964+0000","last_undegraded":"2024-06-10T00:15:36.117964+0000","last_fullsized":"2024-06-10T00:15:36.117964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110445+0000","last_change":"2024-06-10T00:15:36.110445+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110445+0000","last_undegraded":"2024-06-10T00:15:36.110445+0000","last_fullsized":"2024-06-10T00:15:36.110445+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117886+0000","last_change":"2024-06-10T00:15:36.117886+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117886+0000","last_undegraded":"2024-06-10T00:15:36.117886+0000","last_fullsized":"2024-06-10T00:15:36.117886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117933+0000","last_change":"2024-06-10T00:15:36.117933+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117933+0000","last_undegraded":"2024-06-10T00:15:36.117933+0000","last_fullsized":"2024-06-10T00:15:36.117933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115209+0000","last_change":"2024-06-10T00:15:36.115209+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115209+0000","last_undegraded":"2024-06-10T00:15:36.115209+0000","last_fullsized":"2024-06-10T00:15:36.115209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117869+0000","last_change":"2024-06-10T00:15:36.117869+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117869+0000","last_undegraded":"2024-06-10T00:15:36.117869+0000","last_fullsized":"2024-06-10T00:15:36.117869+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110963+0000","last_change":"2024-06-10T00:15:36.110963+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110963+0000","last_undegraded":"2024-06-10T00:15:36.110963+0000","last_fullsized":"2024-06-10T00:15:36.110963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.118015+0000","last_change":"2024-06-10T00:15:36.118015+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.118015+0000","last_undegraded":"2024-06-10T00:15:36.118015+0000","last_fullsized":"2024-06-10T00:15:36.118015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113786+0000","last_change":"2024-06-10T00:15:36.113786+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113786+0000","last_undegraded":"2024-06-10T00:15:36.113786+0000","last_fullsized":"2024-06-10T00:15:36.113786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113745+0000","last_change":"2024-06-10T00:15:36.113745+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113745+0000","last_undegraded":"2024-06-10T00:15:36.113745+0000","last_fullsized":"2024-06-10T00:15:36.113745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113289+0000","last_change":"2024-06-10T00:15:36.113289+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113289+0000","last_undegraded":"2024-06-10T00:15:36.113289+0000","last_fullsized":"2024-06-10T00:15:36.113289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110396+0000","last_change":"2024-06-10T00:15:36.110396+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110396+0000","last_undegraded":"2024-06-10T00:15:36.110396+0000","last_fullsized":"2024-06-10T00:15:36.110396+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112402+0000","last_change":"2024-06-10T00:15:36.112402+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112402+0000","last_undegraded":"2024-06-10T00:15:36.112402+0000","last_fullsized":"2024-06-10T00:15:36.112402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115332+0000","last_change":"2024-06-10T00:15:36.115332+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115332+0000","last_undegraded":"2024-06-10T00:15:36.115332+0000","last_fullsized":"2024-06-10T00:15:36.115332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-10T00:15:36.115737+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:15:36.115737+0000","last_peered":"2024-06-10T00:15:36.115737+0000","last_clean":"2024-06-10T00:15:36.115737+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:15:36.115737+0000","last_undegraded":"2024-06-10T00:15:36.115737+0000","last_fullsized":"2024-06-10T00:15:36.115737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:41.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.870+0000 7fe107431640 1 Processor -- start 2024-06-10T00:15:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.871+0000 7fe107431640 1 -- start start 2024-06-10T00:15:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.871+0000 7fe107431640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 0x7fe1000d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe107431640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1000cef70 0x7fe1000cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe107431640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe10015f5e0 con 0x7fe1000d2680 2024-06-10T00:15:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe107431640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe1000d13e0 con 0x7fe1000cef70 2024-06-10T00:15:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe107431640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1000d0ad0 con 0x7fe10015f1a0 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe1051cd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe1000d2680 0x7fe1000d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44924/0 (socket says 172.21.15.79:44924) 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe1051cd640 1 -- 172.21.15.79:0/1951044245 learned_addr learned my addr 172.21.15.79:0/1951044245 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906314301 0 0) 0x7fe10015f5e0 con 0x7fe1000d2680 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe1059ce640 1 --2- 172.21.15.79:0/1951044245 >> v2:172.21.15.117:3300/0 conn(0x7fe1000cef70 0x7fe1000cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0ec003520 con 0x7fe1000d2680 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe1049cc640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 0x7fe1000d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3952482376 0 0) 0x7fe0ec003520 con 0x7fe1000d2680 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 msgr2=0x7fe1000d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 0x7fe1000d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 >> v2:172.21.15.117:3300/0 conn(0x7fe1000cef70 msgr2=0x7fe1000cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 --2- 172.21.15.79:0/1951044245 >> v2:172.21.15.117:3300/0 conn(0x7fe1000cef70 0x7fe1000cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10015f890 con 0x7fe1000d2680 2024-06-10T00:15:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fe0f4001670 con 0x7fe1000d2680 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe1049cc640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 0x7fe1000d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 >> v1:172.21.15.79:6789/0 conn(0x7fe1000d2680 legacy=0x7fe1000d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0ec0039b0 0x7fe0ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe0ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 0x7fe0ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000d13e0 con 0x7fe0ec004800 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000d0ad0 con 0x7fe0ec0039b0 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ec00b9c0 con 0x7fe10015f1a0 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe1049cc640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe0ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe1051cd640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0ec0039b0 0x7fe0ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.872+0000 7fe1059ce640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 0x7fe0ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.873+0000 7fe1049cc640 1 -- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 msgr2=0x7fe0ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.873+0000 7fe1049cc640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 0x7fe0ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.873+0000 7fe1049cc640 1 -- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0ec0039b0 msgr2=0x7fe0ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.873+0000 7fe1049cc640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0ec0039b0 0x7fe0ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.873+0000 7fe1049cc640 1 -- 172.21.15.79:0/1951044245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec003520 con 0x7fe0ec004800 2024-06-10T00:15:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.873+0000 7fe1059ce640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10015f1a0 0x7fe0ec0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.873+0000 7fe1049cc640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe0ec004c80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0098d0 tx=0x7fe0ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4277aad8767b77 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00f040 con 0x7fe0ec004800 2024-06-10T00:15:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0fc02ad00 con 0x7fe0ec004800 2024-06-10T00:15:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe0f3fff640 1 -- 172.21.15.79:0/1951044245 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc004250 con 0x7fe0ec004800 2024-06-10T00:15:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe107431640 1 -- 172.21.15.79:0/1951044245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 msgr2=0x7fe0ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe107431640 1 --2- 172.21.15.79:0/1951044245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe0ec004c80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0098d0 tx=0x7fe0ec005830 comp rx=0 tx=0).stop 2024-06-10T00:15:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe1059ce640 1 -- 172.21.15.79:0/1951044245 reap_dead start 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe107431640 1 -- 172.21.15.79:0/1951044245 shutdown_connections 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe107431640 1 -- 172.21.15.79:0/1951044245 >> 172.21.15.79:0/1951044245 conn(0x7fe10009d3f0 msgr2=0x7fe1000d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe107431640 1 -- 172.21.15.79:0/1951044245 shutdown_connections 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.874+0000 7fe107431640 1 -- 172.21.15.79:0/1951044245 wait complete. 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.875+0000 7fe107431640 1 Processor -- start 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.875+0000 7fe107431640 1 -- start start 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe107431640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe10015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe107431640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe100151cb0 0x7fe1000ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe107431640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000ca1a0 0x7fe1000ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe107431640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000d4f00 con 0x7fe0ec004800 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe107431640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000d1070 con 0x7fe1000ca1a0 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe107431640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1000d1870 con 0x7fe100151cb0 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe1051cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe10015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe1051cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe10015b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45056/0 (socket says 172.21.15.79:45056) 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe1051cd640 1 -- 172.21.15.79:0/3970224178 learned_addr learned my addr 172.21.15.79:0/3970224178 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe1059ce640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000ca1a0 0x7fe1000ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.876+0000 7fe1049cc640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe100151cb0 0x7fe1000ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe1051cd640 1 -- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe100151cb0 msgr2=0x7fe1000ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe1051cd640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe100151cb0 0x7fe1000ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe1051cd640 1 -- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000ca1a0 msgr2=0x7fe1000ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe1051cd640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000ca1a0 0x7fe1000ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe1051cd640 1 -- 172.21.15.79:0/3970224178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1000c9100 con 0x7fe0ec004800 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe1059ce640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000ca1a0 0x7fe1000ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe1051cd640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe10015b5d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4007340 tx=0x7fe0f4007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe0f1ffb640 1 -- 172.21.15.79:0/3970224178 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f401a070 con 0x7fe0ec004800 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe0f1ffb640 1 -- 172.21.15.79:0/3970224178 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f400f860 con 0x7fe0ec004800 2024-06-10T00:15:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1000c93e0 con 0x7fe0ec004800 2024-06-10T00:15:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe0f1ffb640 1 -- 172.21.15.79:0/3970224178 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400fc50 con 0x7fe0ec004800 2024-06-10T00:15:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.877+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1000c99a0 con 0x7fe0ec004800 2024-06-10T00:15:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.878+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1000b9e20 con 0x7fe0ec004800 2024-06-10T00:15:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.878+0000 7fe0f1ffb640 1 -- 172.21.15.79:0/3970224178 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0f401e3f0 con 0x7fe0ec004800 2024-06-10T00:15:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.879+0000 7fe0f1ffb640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe0e406be60 0x7fe0e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.879+0000 7fe1049cc640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe0e406be60 0x7fe0e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.879+0000 7fe0f1ffb640 1 -- 172.21.15.79:0/3970224178 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe0f408a740 con 0x7fe0ec004800 2024-06-10T00:15:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.879+0000 7fe1049cc640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe0e406be60 0x7fe0e406e320 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc033000 tx=0x7fe0fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:41.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:41.883+0000 7fe0f1ffb640 1 -- 172.21.15.79:0/3970224178 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe1000b9e20 con 0x7fe0ec004800 2024-06-10T00:15:42.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.053+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe10015e7e0 con 0x7fe0e406be60 2024-06-10T00:15:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.059+0000 7fe0f1ffb640 1 -- 172.21.15.79:0/3970224178 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240049 (secure 0 0 0) 0x7fe10015e7e0 con 0x7fe0e406be60 2024-06-10T00:15:42.061 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe0e406be60 msgr2=0x7fe0e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe0e406be60 0x7fe0e406e320 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc033000 tx=0x7fe0fc02e000 comp rx=0 tx=0).stop 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 msgr2=0x7fe10015b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe10015b5d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4007340 tx=0x7fe0f4007800 comp rx=0 tx=0).stop 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 shutdown_connections 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe0e406be60 0x7fe0e406e320 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000ca1a0 0x7fe1000ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe100151cb0 0x7fe1000ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 --2- 172.21.15.79:0/3970224178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0ec004800 0x7fe10015b5d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 >> 172.21.15.79:0/3970224178 conn(0x7fe10009d3f0 msgr2=0x7fe100153820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 shutdown_connections 2024-06-10T00:15:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.062+0000 7fe107431640 1 -- 172.21.15.79:0/3970224178 wait complete. 2024-06-10T00:15:42.072 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-06-10T00:15:41.158082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220424,"kb_used_data":4212,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754296,"statfs":{"total":773094113280,"available":772868399104,"internally_reserved":0,"allocated":4313088,"data_stored":2493289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.050645"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113274+0000","last_change":"2024-06-10T00:15:36.113274+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113274+0000","last_undegraded":"2024-06-10T00:15:36.113274+0000","last_fullsized":"2024-06-10T00:15:36.113274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113805+0000","last_change":"2024-06-10T00:15:36.113805+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113805+0000","last_undegraded":"2024-06-10T00:15:36.113805+0000","last_fullsized":"2024-06-10T00:15:36.113805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110469+0000","last_change":"2024-06-10T00:15:36.110469+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110469+0000","last_undegraded":"2024-06-10T00:15:36.110469+0000","last_fullsized":"2024-06-10T00:15:36.110469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110361+0000","last_change":"2024-06-10T00:15:36.110361+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110361+0000","last_undegraded":"2024-06-10T00:15:36.110361+0000","last_fullsized":"2024-06-10T00:15:36.110361+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111587+0000","last_change":"2024-06-10T00:15:36.111587+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111587+0000","last_undegraded":"2024-06-10T00:15:36.111587+0000","last_fullsized":"2024-06-10T00:15:36.111587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115247+0000","last_change":"2024-06-10T00:15:36.115247+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115247+0000","last_undegraded":"2024-06-10T00:15:36.115247+0000","last_fullsized":"2024-06-10T00:15:36.115247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110473+0000","last_change":"2024-06-10T00:15:36.110473+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110473+0000","last_undegraded":"2024-06-10T00:15:36.110473+0000","last_fullsized":"2024-06-10T00:15:36.110473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110397+0000","last_change":"2024-06-10T00:15:36.110397+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110397+0000","last_undegraded":"2024-06-10T00:15:36.110397+0000","last_fullsized":"2024-06-10T00:15:36.110397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112578+0000","last_change":"2024-06-10T00:15:36.112578+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112578+0000","last_undegraded":"2024-06-10T00:15:36.112578+0000","last_fullsized":"2024-06-10T00:15:36.112578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111074+0000","last_change":"2024-06-10T00:15:36.111074+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111074+0000","last_undegraded":"2024-06-10T00:15:36.111074+0000","last_fullsized":"2024-06-10T00:15:36.111074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110848+0000","last_change":"2024-06-10T00:15:36.110848+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110848+0000","last_undegraded":"2024-06-10T00:15:36.110848+0000","last_fullsized":"2024-06-10T00:15:36.110848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112427+0000","last_change":"2024-06-10T00:15:36.112427+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112427+0000","last_undegraded":"2024-06-10T00:15:36.112427+0000","last_fullsized":"2024-06-10T00:15:36.112427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112424+0000","last_change":"2024-06-10T00:15:36.112424+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112424+0000","last_undegraded":"2024-06-10T00:15:36.112424+0000","last_fullsized":"2024-06-10T00:15:36.112424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110443+0000","last_change":"2024-06-10T00:15:36.110443+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110443+0000","last_undegraded":"2024-06-10T00:15:36.110443+0000","last_fullsized":"2024-06-10T00:15:36.110443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113604+0000","last_change":"2024-06-10T00:15:36.113604+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113604+0000","last_undegraded":"2024-06-10T00:15:36.113604+0000","last_fullsized":"2024-06-10T00:15:36.113604+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115240+0000","last_change":"2024-06-10T00:15:36.115240+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115240+0000","last_undegraded":"2024-06-10T00:15:36.115240+0000","last_fullsized":"2024-06-10T00:15:36.115240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111438+0000","last_change":"2024-06-10T00:15:36.111438+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111438+0000","last_undegraded":"2024-06-10T00:15:36.111438+0000","last_fullsized":"2024-06-10T00:15:36.111438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110371+0000","last_change":"2024-06-10T00:15:36.110371+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110371+0000","last_undegraded":"2024-06-10T00:15:36.110371+0000","last_fullsized":"2024-06-10T00:15:36.110371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117964+0000","last_change":"2024-06-10T00:15:36.117964+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117964+0000","last_undegraded":"2024-06-10T00:15:36.117964+0000","last_fullsized":"2024-06-10T00:15:36.117964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110445+0000","last_change":"2024-06-10T00:15:36.110445+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110445+0000","last_undegraded":"2024-06-10T00:15:36.110445+0000","last_fullsized":"2024-06-10T00:15:36.110445+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117886+0000","last_change":"2024-06-10T00:15:36.117886+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117886+0000","last_undegraded":"2024-06-10T00:15:36.117886+0000","last_fullsized":"2024-06-10T00:15:36.117886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117933+0000","last_change":"2024-06-10T00:15:36.117933+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117933+0000","last_undegraded":"2024-06-10T00:15:36.117933+0000","last_fullsized":"2024-06-10T00:15:36.117933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115209+0000","last_change":"2024-06-10T00:15:36.115209+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115209+0000","last_undegraded":"2024-06-10T00:15:36.115209+0000","last_fullsized":"2024-06-10T00:15:36.115209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117869+0000","last_change":"2024-06-10T00:15:36.117869+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117869+0000","last_undegraded":"2024-06-10T00:15:36.117869+0000","last_fullsized":"2024-06-10T00:15:36.117869+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110963+0000","last_change":"2024-06-10T00:15:36.110963+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110963+0000","last_undegraded":"2024-06-10T00:15:36.110963+0000","last_fullsized":"2024-06-10T00:15:36.110963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.118015+0000","last_change":"2024-06-10T00:15:36.118015+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.118015+0000","last_undegraded":"2024-06-10T00:15:36.118015+0000","last_fullsized":"2024-06-10T00:15:36.118015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113786+0000","last_change":"2024-06-10T00:15:36.113786+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113786+0000","last_undegraded":"2024-06-10T00:15:36.113786+0000","last_fullsized":"2024-06-10T00:15:36.113786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113745+0000","last_change":"2024-06-10T00:15:36.113745+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113745+0000","last_undegraded":"2024-06-10T00:15:36.113745+0000","last_fullsized":"2024-06-10T00:15:36.113745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113289+0000","last_change":"2024-06-10T00:15:36.113289+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113289+0000","last_undegraded":"2024-06-10T00:15:36.113289+0000","last_fullsized":"2024-06-10T00:15:36.113289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110396+0000","last_change":"2024-06-10T00:15:36.110396+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110396+0000","last_undegraded":"2024-06-10T00:15:36.110396+0000","last_fullsized":"2024-06-10T00:15:36.110396+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112402+0000","last_change":"2024-06-10T00:15:36.112402+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112402+0000","last_undegraded":"2024-06-10T00:15:36.112402+0000","last_fullsized":"2024-06-10T00:15:36.112402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115332+0000","last_change":"2024-06-10T00:15:36.115332+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115332+0000","last_undegraded":"2024-06-10T00:15:36.115332+0000","last_fullsized":"2024-06-10T00:15:36.115332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-10T00:15:36.115737+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:15:36.115737+0000","last_peered":"2024-06-10T00:15:36.115737+0000","last_clean":"2024-06-10T00:15:36.115737+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:15:36.115737+0000","last_undegraded":"2024-06-10T00:15:36.115737+0000","last_fullsized":"2024-06-10T00:15:36.115737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:42.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:42.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.213+0000 7fe668990640 1 Processor -- start 2024-06-10T00:15:42.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.213+0000 7fe668990640 1 -- start start 2024-06-10T00:15:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.214+0000 7fe668990640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe664154fc0 0x7fe6641553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.214+0000 7fe668990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe664162b00 0x7fe66406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.214+0000 7fe668990640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66415f5c0 con 0x7fe66406b900 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.214+0000 7fe668990640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe6640d03a0 con 0x7fe664154fc0 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.214+0000 7fe668990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe664162020 con 0x7fe664162b00 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.214+0000 7fe66259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe664154fc0 0x7fe6641553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.214+0000 7fe662d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe66406b900 0x7fe6640afde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44928/0 (socket says 172.21.15.79:44928) 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.214+0000 7fe662d9d640 1 -- 172.21.15.79:0/799824446 learned_addr learned my addr 172.21.15.79:0/799824446 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.215+0000 7fe661d9b640 1 --2- 172.21.15.79:0/799824446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe664162b00 0x7fe66406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.215+0000 7fe66259c640 1 -- 172.21.15.79:0/799824446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe664162b00 msgr2=0x7fe66406b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.215+0000 7fe66259c640 1 --2- 172.21.15.79:0/799824446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe664162b00 0x7fe66406b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.215+0000 7fe66259c640 1 -- 172.21.15.79:0/799824446 >> v1:172.21.15.79:6789/0 conn(0x7fe66406b900 legacy=0x7fe6640afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.215+0000 7fe66159a640 1 -- 172.21.15.79:0/799824446 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935036484 0 0) 0x7fe66415f5c0 con 0x7fe66406b900 2024-06-10T00:15:42.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.215+0000 7fe66259c640 1 -- 172.21.15.79:0/799824446 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe664162300 con 0x7fe664154fc0 2024-06-10T00:15:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.215+0000 7fe66259c640 1 --2- 172.21.15.79:0/799824446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664154fc0 0x7fe6641553a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe654009d90 tx=0x7fe65402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23110739d9da673 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe66159a640 1 -- 172.21.15.79:0/799824446 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654007740 con 0x7fe664154fc0 2024-06-10T00:15:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe66159a640 1 -- 172.21.15.79:0/799824446 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6540078e0 con 0x7fe664154fc0 2024-06-10T00:15:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe66159a640 1 -- 172.21.15.79:0/799824446 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654007cb0 con 0x7fe664154fc0 2024-06-10T00:15:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe668990640 1 -- 172.21.15.79:0/799824446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664154fc0 msgr2=0x7fe6641553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe668990640 1 --2- 172.21.15.79:0/799824446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664154fc0 0x7fe6641553a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe654009d90 tx=0x7fe65402a660 comp rx=0 tx=0).stop 2024-06-10T00:15:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe668990640 1 -- 172.21.15.79:0/799824446 shutdown_connections 2024-06-10T00:15:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe668990640 1 --2- 172.21.15.79:0/799824446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe664162b00 0x7fe66406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe668990640 1 --2- 172.21.15.79:0/799824446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664154fc0 0x7fe6641553a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe668990640 1 -- 172.21.15.79:0/799824446 >> 172.21.15.79:0/799824446 conn(0x7fe6640b2ae0 msgr2=0x7fe6640b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe668990640 1 -- 172.21.15.79:0/799824446 shutdown_connections 2024-06-10T00:15:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.216+0000 7fe668990640 1 -- 172.21.15.79:0/799824446 wait complete. 2024-06-10T00:15:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe668990640 1 Processor -- start 2024-06-10T00:15:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe668990640 1 -- start start 2024-06-10T00:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe668990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66406b900 0x7fe6641e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe668990640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe664154fc0 0x7fe664147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe668990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664162b00 0x7fe6641e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe668990640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6640b0670 con 0x7fe664162b00 2024-06-10T00:15:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe668990640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6640b04f0 con 0x7fe664154fc0 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe668990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe6640b07f0 con 0x7fe66406b900 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe662d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664162b00 0x7fe6641e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe662d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664162b00 0x7fe6641e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45072/0 (socket says 172.21.15.79:45072) 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.218+0000 7fe662d9d640 1 -- 172.21.15.79:0/4192914554 learned_addr learned my addr 172.21.15.79:0/4192914554 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe66259c640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66406b900 0x7fe6641e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe661d9b640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe664154fc0 0x7fe664147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe662d9d640 1 -- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66406b900 msgr2=0x7fe6641e7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe662d9d640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66406b900 0x7fe6641e7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe662d9d640 1 -- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe664154fc0 msgr2=0x7fe664147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe662d9d640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe664154fc0 0x7fe664147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe662d9d640 1 -- 172.21.15.79:0/4192914554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6640b5540 con 0x7fe664162b00 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe66259c640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66406b900 0x7fe6641e7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe662d9d640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664162b00 0x7fe6641e85c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00c450 tx=0x7fe65c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe652ffd640 1 -- 172.21.15.79:0/4192914554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c018070 con 0x7fe664162b00 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe652ffd640 1 -- 172.21.15.79:0/4192914554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65c007500 con 0x7fe664162b00 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6640b4930 con 0x7fe664162b00 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe652ffd640 1 -- 172.21.15.79:0/4192914554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c004a20 con 0x7fe664162b00 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.219+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6640b4ef0 con 0x7fe664162b00 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.220+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe664068430 con 0x7fe664162b00 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.220+0000 7fe652ffd640 1 -- 172.21.15.79:0/4192914554 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe65c01b070 con 0x7fe664162b00 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.221+0000 7fe652ffd640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe64406be30 0x7fe64406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.221+0000 7fe652ffd640 1 -- 172.21.15.79:0/4192914554 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe65c08a2c0 con 0x7fe664162b00 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.221+0000 7fe66259c640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe64406be30 0x7fe64406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.221+0000 7fe66259c640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe64406be30 0x7fe64406e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe654034000 tx=0x7fe65402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.225+0000 7fe652ffd640 1 -- 172.21.15.79:0/4192914554 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe65c058b10 con 0x7fe664162b00 2024-06-10T00:15:42.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.397+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6640b5290 con 0x7fe64406be30 2024-06-10T00:15:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.402+0000 7fe652ffd640 1 -- 172.21.15.79:0/4192914554 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240049 (secure 0 0 0) 0x7fe6640b5290 con 0x7fe64406be30 2024-06-10T00:15:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:42.405 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe64406be30 msgr2=0x7fe64406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe64406be30 0x7fe64406e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe654034000 tx=0x7fe65402f000 comp rx=0 tx=0).stop 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664162b00 msgr2=0x7fe6641e85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664162b00 0x7fe6641e85c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00c450 tx=0x7fe65c00c910 comp rx=0 tx=0).stop 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 shutdown_connections 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe64406be30 0x7fe64406e2f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe664162b00 0x7fe6641e85c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe664154fc0 0x7fe664147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 --2- 172.21.15.79:0/4192914554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66406b900 0x7fe6641e7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 >> 172.21.15.79:0/4192914554 conn(0x7fe6640b2ae0 msgr2=0x7fe6640cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 shutdown_connections 2024-06-10T00:15:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.405+0000 7fe668990640 1 -- 172.21.15.79:0/4192914554 wait complete. 2024-06-10T00:15:42.416 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-06-10T00:15:41.158082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220424,"kb_used_data":4212,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754296,"statfs":{"total":773094113280,"available":772868399104,"internally_reserved":0,"allocated":4313088,"data_stored":2493289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.050645"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113274+0000","last_change":"2024-06-10T00:15:36.113274+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113274+0000","last_undegraded":"2024-06-10T00:15:36.113274+0000","last_fullsized":"2024-06-10T00:15:36.113274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113805+0000","last_change":"2024-06-10T00:15:36.113805+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113805+0000","last_undegraded":"2024-06-10T00:15:36.113805+0000","last_fullsized":"2024-06-10T00:15:36.113805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110469+0000","last_change":"2024-06-10T00:15:36.110469+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110469+0000","last_undegraded":"2024-06-10T00:15:36.110469+0000","last_fullsized":"2024-06-10T00:15:36.110469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110361+0000","last_change":"2024-06-10T00:15:36.110361+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110361+0000","last_undegraded":"2024-06-10T00:15:36.110361+0000","last_fullsized":"2024-06-10T00:15:36.110361+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111587+0000","last_change":"2024-06-10T00:15:36.111587+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111587+0000","last_undegraded":"2024-06-10T00:15:36.111587+0000","last_fullsized":"2024-06-10T00:15:36.111587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115247+0000","last_change":"2024-06-10T00:15:36.115247+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115247+0000","last_undegraded":"2024-06-10T00:15:36.115247+0000","last_fullsized":"2024-06-10T00:15:36.115247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110473+0000","last_change":"2024-06-10T00:15:36.110473+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110473+0000","last_undegraded":"2024-06-10T00:15:36.110473+0000","last_fullsized":"2024-06-10T00:15:36.110473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110397+0000","last_change":"2024-06-10T00:15:36.110397+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110397+0000","last_undegraded":"2024-06-10T00:15:36.110397+0000","last_fullsized":"2024-06-10T00:15:36.110397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112578+0000","last_change":"2024-06-10T00:15:36.112578+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112578+0000","last_undegraded":"2024-06-10T00:15:36.112578+0000","last_fullsized":"2024-06-10T00:15:36.112578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111074+0000","last_change":"2024-06-10T00:15:36.111074+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111074+0000","last_undegraded":"2024-06-10T00:15:36.111074+0000","last_fullsized":"2024-06-10T00:15:36.111074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110848+0000","last_change":"2024-06-10T00:15:36.110848+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110848+0000","last_undegraded":"2024-06-10T00:15:36.110848+0000","last_fullsized":"2024-06-10T00:15:36.110848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112427+0000","last_change":"2024-06-10T00:15:36.112427+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112427+0000","last_undegraded":"2024-06-10T00:15:36.112427+0000","last_fullsized":"2024-06-10T00:15:36.112427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112424+0000","last_change":"2024-06-10T00:15:36.112424+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112424+0000","last_undegraded":"2024-06-10T00:15:36.112424+0000","last_fullsized":"2024-06-10T00:15:36.112424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110443+0000","last_change":"2024-06-10T00:15:36.110443+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110443+0000","last_undegraded":"2024-06-10T00:15:36.110443+0000","last_fullsized":"2024-06-10T00:15:36.110443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113604+0000","last_change":"2024-06-10T00:15:36.113604+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113604+0000","last_undegraded":"2024-06-10T00:15:36.113604+0000","last_fullsized":"2024-06-10T00:15:36.113604+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115240+0000","last_change":"2024-06-10T00:15:36.115240+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115240+0000","last_undegraded":"2024-06-10T00:15:36.115240+0000","last_fullsized":"2024-06-10T00:15:36.115240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111438+0000","last_change":"2024-06-10T00:15:36.111438+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111438+0000","last_undegraded":"2024-06-10T00:15:36.111438+0000","last_fullsized":"2024-06-10T00:15:36.111438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110371+0000","last_change":"2024-06-10T00:15:36.110371+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110371+0000","last_undegraded":"2024-06-10T00:15:36.110371+0000","last_fullsized":"2024-06-10T00:15:36.110371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117964+0000","last_change":"2024-06-10T00:15:36.117964+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117964+0000","last_undegraded":"2024-06-10T00:15:36.117964+0000","last_fullsized":"2024-06-10T00:15:36.117964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110445+0000","last_change":"2024-06-10T00:15:36.110445+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110445+0000","last_undegraded":"2024-06-10T00:15:36.110445+0000","last_fullsized":"2024-06-10T00:15:36.110445+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117886+0000","last_change":"2024-06-10T00:15:36.117886+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117886+0000","last_undegraded":"2024-06-10T00:15:36.117886+0000","last_fullsized":"2024-06-10T00:15:36.117886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117933+0000","last_change":"2024-06-10T00:15:36.117933+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117933+0000","last_undegraded":"2024-06-10T00:15:36.117933+0000","last_fullsized":"2024-06-10T00:15:36.117933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115209+0000","last_change":"2024-06-10T00:15:36.115209+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115209+0000","last_undegraded":"2024-06-10T00:15:36.115209+0000","last_fullsized":"2024-06-10T00:15:36.115209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117869+0000","last_change":"2024-06-10T00:15:36.117869+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117869+0000","last_undegraded":"2024-06-10T00:15:36.117869+0000","last_fullsized":"2024-06-10T00:15:36.117869+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110963+0000","last_change":"2024-06-10T00:15:36.110963+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110963+0000","last_undegraded":"2024-06-10T00:15:36.110963+0000","last_fullsized":"2024-06-10T00:15:36.110963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.118015+0000","last_change":"2024-06-10T00:15:36.118015+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.118015+0000","last_undegraded":"2024-06-10T00:15:36.118015+0000","last_fullsized":"2024-06-10T00:15:36.118015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113786+0000","last_change":"2024-06-10T00:15:36.113786+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113786+0000","last_undegraded":"2024-06-10T00:15:36.113786+0000","last_fullsized":"2024-06-10T00:15:36.113786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113745+0000","last_change":"2024-06-10T00:15:36.113745+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113745+0000","last_undegraded":"2024-06-10T00:15:36.113745+0000","last_fullsized":"2024-06-10T00:15:36.113745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113289+0000","last_change":"2024-06-10T00:15:36.113289+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113289+0000","last_undegraded":"2024-06-10T00:15:36.113289+0000","last_fullsized":"2024-06-10T00:15:36.113289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110396+0000","last_change":"2024-06-10T00:15:36.110396+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110396+0000","last_undegraded":"2024-06-10T00:15:36.110396+0000","last_fullsized":"2024-06-10T00:15:36.110396+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112402+0000","last_change":"2024-06-10T00:15:36.112402+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112402+0000","last_undegraded":"2024-06-10T00:15:36.112402+0000","last_fullsized":"2024-06-10T00:15:36.112402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115332+0000","last_change":"2024-06-10T00:15:36.115332+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115332+0000","last_undegraded":"2024-06-10T00:15:36.115332+0000","last_fullsized":"2024-06-10T00:15:36.115332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-10T00:15:36.115737+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:15:36.115737+0000","last_peered":"2024-06-10T00:15:36.115737+0000","last_clean":"2024-06-10T00:15:36.115737+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:15:36.115737+0000","last_undegraded":"2024-06-10T00:15:36.115737+0000","last_fullsized":"2024-06-10T00:15:36.115737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:42.419 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.420 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.421 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-06-10T00:15:42.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-06-10T00:15:42.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.424 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.113274+0000', 'last_change': '2024-06-10T00:15:36.113274+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.113274+0000', 'last_undegraded': '2024-06-10T00:15:36.113274+0000', 'last_fullsized': '2024-06-10T00:15:36.113274+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:15:42.425 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.113805+0000', 'last_change': '2024-06-10T00:15:36.113805+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.113805+0000', 'last_undegraded': '2024-06-10T00:15:36.113805+0000', 'last_fullsized': '2024-06-10T00:15:36.113805+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110469+0000', 'last_change': '2024-06-10T00:15:36.110469+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110469+0000', 'last_undegraded': '2024-06-10T00:15:36.110469+0000', 'last_fullsized': '2024-06-10T00:15:36.110469+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-06-10T00:15:42.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110361+0000', 'last_change': '2024-06-10T00:15:36.110361+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110361+0000', 'last_undegraded': '2024-06-10T00:15:36.110361+0000', 'last_fullsized': '2024-06-10T00:15:36.110361+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.111587+0000', 'last_change': '2024-06-10T00:15:36.111587+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.111587+0000', 'last_undegraded': '2024-06-10T00:15:36.111587+0000', 'last_fullsized': '2024-06-10T00:15:36.111587+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.115247+0000', 'last_change': '2024-06-10T00:15:36.115247+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.115247+0000', 'last_undegraded': '2024-06-10T00:15:36.115247+0000', 'last_fullsized': '2024-06-10T00:15:36.115247+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:15:42.427 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-06-10T00:15:42.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.428 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-06-10T00:15:42.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110473+0000', 'last_change': '2024-06-10T00:15:36.110473+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110473+0000', 'last_undegraded': '2024-06-10T00:15:36.110473+0000', 'last_fullsized': '2024-06-10T00:15:36.110473+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:15:42.428 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-06-10T00:15:42.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.428 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-06-10T00:15:42.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110397+0000', 'last_change': '2024-06-10T00:15:36.110397+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110397+0000', 'last_undegraded': '2024-06-10T00:15:36.110397+0000', 'last_fullsized': '2024-06-10T00:15:36.110397+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:15:42.428 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.112578+0000', 'last_change': '2024-06-10T00:15:36.112578+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.112578+0000', 'last_undegraded': '2024-06-10T00:15:36.112578+0000', 'last_fullsized': '2024-06-10T00:15:36.112578+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.111074+0000', 'last_change': '2024-06-10T00:15:36.111074+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.111074+0000', 'last_undegraded': '2024-06-10T00:15:36.111074+0000', 'last_fullsized': '2024-06-10T00:15:36.111074+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110848+0000', 'last_change': '2024-06-10T00:15:36.110848+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110848+0000', 'last_undegraded': '2024-06-10T00:15:36.110848+0000', 'last_fullsized': '2024-06-10T00:15:36.110848+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:15:42.429 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.112427+0000', 'last_change': '2024-06-10T00:15:36.112427+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.112427+0000', 'last_undegraded': '2024-06-10T00:15:36.112427+0000', 'last_fullsized': '2024-06-10T00:15:36.112427+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.112424+0000', 'last_change': '2024-06-10T00:15:36.112424+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.112424+0000', 'last_undegraded': '2024-06-10T00:15:36.112424+0000', 'last_fullsized': '2024-06-10T00:15:36.112424+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-06-10T00:15:42.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110443+0000', 'last_change': '2024-06-10T00:15:36.110443+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110443+0000', 'last_undegraded': '2024-06-10T00:15:36.110443+0000', 'last_fullsized': '2024-06-10T00:15:36.110443+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.113604+0000', 'last_change': '2024-06-10T00:15:36.113604+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.113604+0000', 'last_undegraded': '2024-06-10T00:15:36.113604+0000', 'last_fullsized': '2024-06-10T00:15:36.113604+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.115240+0000', 'last_change': '2024-06-10T00:15:36.115240+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.115240+0000', 'last_undegraded': '2024-06-10T00:15:36.115240+0000', 'last_fullsized': '2024-06-10T00:15:36.115240+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-06-10T00:15:42.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.111438+0000', 'last_change': '2024-06-10T00:15:36.111438+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.111438+0000', 'last_undegraded': '2024-06-10T00:15:36.111438+0000', 'last_fullsized': '2024-06-10T00:15:36.111438+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110371+0000', 'last_change': '2024-06-10T00:15:36.110371+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110371+0000', 'last_undegraded': '2024-06-10T00:15:36.110371+0000', 'last_fullsized': '2024-06-10T00:15:36.110371+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.117964+0000', 'last_change': '2024-06-10T00:15:36.117964+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.117964+0000', 'last_undegraded': '2024-06-10T00:15:36.117964+0000', 'last_fullsized': '2024-06-10T00:15:36.117964+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.432 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110445+0000', 'last_change': '2024-06-10T00:15:36.110445+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110445+0000', 'last_undegraded': '2024-06-10T00:15:36.110445+0000', 'last_fullsized': '2024-06-10T00:15:36.110445+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.117886+0000', 'last_change': '2024-06-10T00:15:36.117886+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.117886+0000', 'last_undegraded': '2024-06-10T00:15:36.117886+0000', 'last_fullsized': '2024-06-10T00:15:36.117886+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.117933+0000', 'last_change': '2024-06-10T00:15:36.117933+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.117933+0000', 'last_undegraded': '2024-06-10T00:15:36.117933+0000', 'last_fullsized': '2024-06-10T00:15:36.117933+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-06-10T00:15:42.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.115209+0000', 'last_change': '2024-06-10T00:15:36.115209+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.115209+0000', 'last_undegraded': '2024-06-10T00:15:36.115209+0000', 'last_fullsized': '2024-06-10T00:15:36.115209+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.117869+0000', 'last_change': '2024-06-10T00:15:36.117869+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.117869+0000', 'last_undegraded': '2024-06-10T00:15:36.117869+0000', 'last_fullsized': '2024-06-10T00:15:36.117869+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110963+0000', 'last_change': '2024-06-10T00:15:36.110963+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110963+0000', 'last_undegraded': '2024-06-10T00:15:36.110963+0000', 'last_fullsized': '2024-06-10T00:15:36.110963+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-06-10T00:15:42.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.118015+0000', 'last_change': '2024-06-10T00:15:36.118015+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.118015+0000', 'last_undegraded': '2024-06-10T00:15:36.118015+0000', 'last_fullsized': '2024-06-10T00:15:36.118015+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.113786+0000', 'last_change': '2024-06-10T00:15:36.113786+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.113786+0000', 'last_undegraded': '2024-06-10T00:15:36.113786+0000', 'last_fullsized': '2024-06-10T00:15:36.113786+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.113745+0000', 'last_change': '2024-06-10T00:15:36.113745+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.113745+0000', 'last_undegraded': '2024-06-10T00:15:36.113745+0000', 'last_fullsized': '2024-06-10T00:15:36.113745+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-06-10T00:15:42.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.113289+0000', 'last_change': '2024-06-10T00:15:36.113289+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.113289+0000', 'last_undegraded': '2024-06-10T00:15:36.113289+0000', 'last_fullsized': '2024-06-10T00:15:36.113289+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.110396+0000', 'last_change': '2024-06-10T00:15:36.110396+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.110396+0000', 'last_undegraded': '2024-06-10T00:15:36.110396+0000', 'last_fullsized': '2024-06-10T00:15:36.110396+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.112402+0000', 'last_change': '2024-06-10T00:15:36.112402+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.112402+0000', 'last_undegraded': '2024-06-10T00:15:36.112402+0000', 'last_fullsized': '2024-06-10T00:15:36.112402+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:15:37.106977+0000', 'last_change': '2024-06-10T00:15:37.106977+0000', 'last_active': '2024-06-10T00:15:37.106977+0000', 'last_peered': '2024-06-10T00:15:37.106977+0000', 'last_clean': '2024-06-10T00:15:37.106977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:37.106977+0000', 'last_undegraded': '2024-06-10T00:15:37.106977+0000', 'last_fullsized': '2024-06-10T00:15:37.106977+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:37.106977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-06-10T00:15:42.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:15:36.115332+0000', 'last_change': '2024-06-10T00:15:36.115332+0000', 'last_active': '2024-06-10T00:15:36.102063+0000', 'last_peered': '2024-06-10T00:15:36.102063+0000', 'last_clean': '2024-06-10T00:15:36.102063+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:15:36.115332+0000', 'last_undegraded': '2024-06-10T00:15:36.115332+0000', 'last_fullsized': '2024-06-10T00:15:36.115332+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'last_clean_scrub_stamp': '2024-06-10T00:15:36.102063+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:15:42.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-10T00:15:42.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.555+0000 7f03b6f9e640 1 Processor -- start 2024-06-10T00:15:42.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.555+0000 7f03b6f9e640 1 -- start start 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.555+0000 7f03b6f9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b015f1a0 0x7f03b00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.555+0000 7f03b6f9e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f03b00cef70 0x7f03b00cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.555+0000 7f03b6f9e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b015f5e0 con 0x7f03b00d2680 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.555+0000 7f03b6f9e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f03b00d13e0 con 0x7f03b00cef70 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.555+0000 7f03b6f9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03b00d0ad0 con 0x7f03b015f1a0 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.556+0000 7f03b553b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f03b00cef70 0x7f03b00cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.556+0000 7f03b553b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f03b00cef70 0x7f03b00cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45088/0 (socket says 172.21.15.79:45088) 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.556+0000 7f03b553b640 1 -- 172.21.15.79:0/1588582522 learned_addr learned my addr 172.21.15.79:0/1588582522 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.556+0000 7f03affff640 1 --2- 172.21.15.79:0/1588582522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b015f1a0 0x7f03b00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.556+0000 7f03b553b640 1 -- 172.21.15.79:0/1588582522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b015f1a0 msgr2=0x7f03b00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.556+0000 7f03b553b640 1 --2- 172.21.15.79:0/1588582522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b015f1a0 0x7f03b00d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.556+0000 7f03b553b640 1 -- 172.21.15.79:0/1588582522 >> v1:172.21.15.117:6789/0 conn(0x7f03b00d2680 legacy=0x7f03b00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:42.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.556+0000 7f03b553b640 1 -- 172.21.15.79:0/1588582522 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b015f890 con 0x7f03b00cef70 2024-06-10T00:15:42.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b553b640 1 --2- 172.21.15.79:0/1588582522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00cef70 0x7f03b00cf400 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0398009870 tx=0x7f039802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ff982e34c1da62 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03af7fe640 1 -- 172.21.15.79:0/1588582522 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398037070 con 0x7f03b00cef70 2024-06-10T00:15:42.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03af7fe640 1 -- 172.21.15.79:0/1588582522 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0398032440 con 0x7f03b00cef70 2024-06-10T00:15:42.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03af7fe640 1 -- 172.21.15.79:0/1588582522 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398032810 con 0x7f03b00cef70 2024-06-10T00:15:42.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b6f9e640 1 -- 172.21.15.79:0/1588582522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00cef70 msgr2=0x7f03b00cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/1588582522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00cef70 0x7f03b00cf400 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0398009870 tx=0x7f039802a210 comp rx=0 tx=0).stop 2024-06-10T00:15:42.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b6f9e640 1 -- 172.21.15.79:0/1588582522 shutdown_connections 2024-06-10T00:15:42.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/1588582522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00cef70 0x7f03b00cf400 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/1588582522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b015f1a0 0x7f03b00d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b6f9e640 1 -- 172.21.15.79:0/1588582522 >> 172.21.15.79:0/1588582522 conn(0x7f03b009d3f0 msgr2=0x7f03b00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:42.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b6f9e640 1 -- 172.21.15.79:0/1588582522 shutdown_connections 2024-06-10T00:15:42.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.557+0000 7f03b6f9e640 1 -- 172.21.15.79:0/1588582522 wait complete. 2024-06-10T00:15:42.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.558+0000 7f03b6f9e640 1 Processor -- start 2024-06-10T00:15:42.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03b6f9e640 1 -- start start 2024-06-10T00:15:42.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03b6f9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00cef70 0x7f03b00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03b6f9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00d2680 0x7f03b00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03b6f9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b015f1a0 0x7f03b00b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03b6f9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f03b00d4f00 con 0x7f03b00d2680 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03b6f9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03b00d1070 con 0x7f03b015f1a0 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03b6f9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03b00d1870 con 0x7f03b00cef70 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00d2680 0x7f03b00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00d2680 0x7f03b00b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45092/0 (socket says 172.21.15.79:45092) 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.559+0000 7f03affff640 1 -- 172.21.15.79:0/2271071161 learned_addr learned my addr 172.21.15.79:0/2271071161 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03b4d3a640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00cef70 0x7f03b00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03b553b640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b015f1a0 0x7f03b00b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03affff640 1 -- 172.21.15.79:0/2271071161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00cef70 msgr2=0x7f03b00b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03affff640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00cef70 0x7f03b00b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03affff640 1 -- 172.21.15.79:0/2271071161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b015f1a0 msgr2=0x7f03b00b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03affff640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b015f1a0 0x7f03b00b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03affff640 1 -- 172.21.15.79:0/2271071161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b015dcc0 con 0x7f03b00d2680 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03affff640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00d2680 0x7f03b00b1ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f03a000ccd0 tx=0x7f03a000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03ad7fa640 1 -- 172.21.15.79:0/2271071161 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0003990 con 0x7f03b00d2680 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03ad7fa640 1 -- 172.21.15.79:0/2271071161 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a0003b30 con 0x7f03b00d2680 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b015dfa0 con 0x7f03b00d2680 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03ad7fa640 1 -- 172.21.15.79:0/2271071161 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0004020 con 0x7f03b00d2680 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.560+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b00c8250 con 0x7f03b00d2680 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.561+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b0068430 con 0x7f03b00d2680 2024-06-10T00:15:42.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.561+0000 7f03ad7fa640 1 -- 172.21.15.79:0/2271071161 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03a00041c0 con 0x7f03b00d2680 2024-06-10T00:15:42.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.562+0000 7f03ad7fa640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f039006be30 0x7f039006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.562+0000 7f03ad7fa640 1 -- 172.21.15.79:0/2271071161 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f03a008b4a0 con 0x7f03b00d2680 2024-06-10T00:15:42.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.562+0000 7f03b4d3a640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f039006be30 0x7f039006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.562+0000 7f03b4d3a640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f039006be30 0x7f039006e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03a8004ea0 tx=0x7f03a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.566+0000 7f03ad7fa640 1 -- 172.21.15.79:0/2271071161 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f03a0014030 con 0x7f03b00d2680 2024-06-10T00:15:42.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.809+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f03b00c8420 con 0x7f03b00d2680 2024-06-10T00:15:42.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.809+0000 7f03ad7fa640 1 -- 172.21.15.79:0/2271071161 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1656 (secure 0 0 0) 0x7f03a0059d50 con 0x7f03b00d2680 2024-06-10T00:15:42.809 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:42.809 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1717978470,"num_in_osds":8,"osd_in_since":1717978461,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225714176,"bytes_avail":772868399104,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4968}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-06-10T00:15:33.157089+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-06-10T00:15:42.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.811+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f039006be30 msgr2=0x7f039006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.811+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f039006be30 0x7f039006e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03a8004ea0 tx=0x7f03a8009040 comp rx=0 tx=0).stop 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.811+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00d2680 msgr2=0x7f03b00b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.811+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00d2680 0x7f03b00b1ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f03a000ccd0 tx=0x7f03a000a5c0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.812+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 shutdown_connections 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.812+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f039006be30 0x7f039006e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.812+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b015f1a0 0x7f03b00b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.812+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03b00d2680 0x7f03b00b1ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.812+0000 7f03b6f9e640 1 --2- 172.21.15.79:0/2271071161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00cef70 0x7f03b00b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.812+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 >> 172.21.15.79:0/2271071161 conn(0x7f03b009d3f0 msgr2=0x7f03b015e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.812+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 shutdown_connections 2024-06-10T00:15:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.812+0000 7f03b6f9e640 1 -- 172.21.15.79:0/2271071161 wait complete. 2024-06-10T00:15:42.822 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-10T00:15:42.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:42.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.921+0000 7f687bd89640 1 Processor -- start 2024-06-10T00:15:42.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.922+0000 7f687bd89640 1 -- start start 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.922+0000 7f687bd89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6874156830 0x7f6874071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f687bd89640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68740725f0 con 0x7f687415c7f0 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f687bd89640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68740728d0 con 0x7f6874072130 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f687bd89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f68740b3090 con 0x7f6874156830 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f687a326640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f687415c7f0 0x7f6874165cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44932/0 (socket says 172.21.15.79:44932) 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f687a326640 1 -- 172.21.15.79:0/2399855239 learned_addr learned my addr 172.21.15.79:0/2399855239 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6879b25640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6874156830 0x7f6874071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188984302 0 0) 0x7f68740725f0 con 0x7f687415c7f0 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f685c003520 con 0x7f687415c7f0 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763979267 0 0) 0x7f68740728d0 con 0x7f6874072130 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68740725f0 con 0x7f6874072130 2024-06-10T00:15:42.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2224480324 0 0) 0x7f685c003520 con 0x7f687415c7f0 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6874156830 msgr2=0x7f6874071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6874156830 0x7f6874071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 >> v1:172.21.15.117:6789/0 conn(0x7f6874072130 legacy=0x7f68740cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6874072bb0 con 0x7f687415c7f0 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f68640019f0 con 0x7f687415c7f0 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 >> v1:172.21.15.79:6789/0 conn(0x7f687415c7f0 legacy=0x7f6874165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6874156830 0x7f685c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c004120 0x7f685c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004d40 0x7f685c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f68740b3090 con 0x7f685c004120 2024-06-10T00:15:42.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f685c00bb00 con 0x7f685c004d40 2024-06-10T00:15:42.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f685c00bd00 con 0x7f6874156830 2024-06-10T00:15:42.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6879324640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c004120 0x7f685c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f6879b25640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6874156830 0x7f685c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.923+0000 7f687a326640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004d40 0x7f685c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6879324640 1 -- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6874156830 msgr2=0x7f685c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:42.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6879324640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6874156830 0x7f685c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6879324640 1 -- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004d40 msgr2=0x7f685c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6879324640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004d40 0x7f685c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6879324640 1 -- 172.21.15.79:0/2399855239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685c003520 con 0x7f685c004120 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f687a326640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004d40 0x7f685c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6879324640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c004120 0x7f685c004800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f68680018f0 tx=0x7f685c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47240c0b02966bc0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868001510 con 0x7f685c004120 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68680052d0 con 0x7f685c004120 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.924+0000 7f6878b23640 1 -- 172.21.15.79:0/2399855239 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686802abf0 con 0x7f685c004120 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.925+0000 7f687bd89640 1 -- 172.21.15.79:0/2399855239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c004120 msgr2=0x7f685c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.925+0000 7f687bd89640 1 --2- 172.21.15.79:0/2399855239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c004120 0x7f685c004800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f68680018f0 tx=0x7f685c005830 comp rx=0 tx=0).stop 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.925+0000 7f687a326640 1 -- 172.21.15.79:0/2399855239 reap_dead start 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.925+0000 7f687bd89640 1 -- 172.21.15.79:0/2399855239 shutdown_connections 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.925+0000 7f687bd89640 1 -- 172.21.15.79:0/2399855239 >> 172.21.15.79:0/2399855239 conn(0x7f68740b19f0 msgr2=0x7f68740b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:42.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.925+0000 7f687bd89640 1 -- 172.21.15.79:0/2399855239 shutdown_connections 2024-06-10T00:15:42.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.925+0000 7f687bd89640 1 -- 172.21.15.79:0/2399855239 wait complete. 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.926+0000 7f687bd89640 1 Processor -- start 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.926+0000 7f687bd89640 1 -- start start 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f687bd89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004120 0x7f687409d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f687bd89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687413e480 0x7f687415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f687bd89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f687415b5f0 0x7f68741f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f687bd89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f68740ccf00 con 0x7f687413e480 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f687bd89640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f68740ccd80 con 0x7f685c004120 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f687bd89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f68740cd080 con 0x7f687415b5f0 2024-06-10T00:15:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687413e480 0x7f687415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687413e480 0x7f687415b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45112/0 (socket says 172.21.15.79:45112) 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 -- 172.21.15.79:0/3381906279 learned_addr learned my addr 172.21.15.79:0/3381906279 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f687a326640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f687415b5f0 0x7f68741f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879b25640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004120 0x7f687409d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 -- 172.21.15.79:0/3381906279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f687415b5f0 msgr2=0x7f68741f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f687415b5f0 0x7f68741f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 -- 172.21.15.79:0/3381906279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004120 msgr2=0x7f687409d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004120 0x7f687409d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 -- 172.21.15.79:0/3381906279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68741f5550 con 0x7f687413e480 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.927+0000 7f6879324640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687413e480 0x7f687415b0b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6868001950 tx=0x7f68680012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.928+0000 7f68727fc640 1 -- 172.21.15.79:0/3381906279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686803f020 con 0x7f687413e480 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.928+0000 7f68727fc640 1 -- 172.21.15.79:0/3381906279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6868005480 con 0x7f687413e480 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.928+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687409cd20 con 0x7f687413e480 2024-06-10T00:15:42.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.928+0000 7f68727fc640 1 -- 172.21.15.79:0/3381906279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868037040 con 0x7f687413e480 2024-06-10T00:15:42.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.928+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f687409d2e0 con 0x7f687413e480 2024-06-10T00:15:42.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.929+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6874068430 con 0x7f687413e480 2024-06-10T00:15:42.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.929+0000 7f68727fc640 1 -- 172.21.15.79:0/3381906279 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6868042020 con 0x7f687413e480 2024-06-10T00:15:42.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.930+0000 7f68727fc640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686006be60 0x7f686006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:42.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.930+0000 7f6879b25640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686006be60 0x7f686006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:42.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.930+0000 7f68727fc640 1 -- 172.21.15.79:0/3381906279 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f68680aaaf0 con 0x7f687413e480 2024-06-10T00:15:42.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.930+0000 7f6879b25640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686006be60 0x7f686006e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f686c009a20 tx=0x7f686c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:42.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:42.934+0000 7f68727fc640 1 -- 172.21.15.79:0/3381906279 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6868049030 con 0x7f687413e480 2024-06-10T00:15:43.091 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:15:43.092+0000 7f3d7d9c4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:15:43.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.104+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f687409dea0 con 0x7f686006be60 2024-06-10T00:15:43.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.109+0000 7f68727fc640 1 -- 172.21.15.79:0/3381906279 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240049 (secure 0 0 0) 0x7f687409dea0 con 0x7f686006be60 2024-06-10T00:15:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:43.112 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686006be60 msgr2=0x7f686006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686006be60 0x7f686006e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f686c009a20 tx=0x7f686c008040 comp rx=0 tx=0).stop 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687413e480 msgr2=0x7f687415b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687413e480 0x7f687415b0b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6868001950 tx=0x7f68680012d0 comp rx=0 tx=0).stop 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 shutdown_connections 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686006be60 0x7f686006e320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f687415b5f0 0x7f68741f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687413e480 0x7f687415b0b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 --2- 172.21.15.79:0/3381906279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685c004120 0x7f687409d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 >> 172.21.15.79:0/3381906279 conn(0x7f68740b19f0 msgr2=0x7f68740afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 shutdown_connections 2024-06-10T00:15:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:43.112+0000 7f687bd89640 1 -- 172.21.15.79:0/3381906279 wait complete. 2024-06-10T00:15:43.123 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-06-10T00:15:41.158082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220424,"kb_used_data":4212,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754296,"statfs":{"total":773094113280,"available":772868399104,"internally_reserved":0,"allocated":4313088,"data_stored":2493289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.050645"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113274+0000","last_change":"2024-06-10T00:15:36.113274+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113274+0000","last_undegraded":"2024-06-10T00:15:36.113274+0000","last_fullsized":"2024-06-10T00:15:36.113274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113805+0000","last_change":"2024-06-10T00:15:36.113805+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113805+0000","last_undegraded":"2024-06-10T00:15:36.113805+0000","last_fullsized":"2024-06-10T00:15:36.113805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110469+0000","last_change":"2024-06-10T00:15:36.110469+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110469+0000","last_undegraded":"2024-06-10T00:15:36.110469+0000","last_fullsized":"2024-06-10T00:15:36.110469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110361+0000","last_change":"2024-06-10T00:15:36.110361+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110361+0000","last_undegraded":"2024-06-10T00:15:36.110361+0000","last_fullsized":"2024-06-10T00:15:36.110361+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111587+0000","last_change":"2024-06-10T00:15:36.111587+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111587+0000","last_undegraded":"2024-06-10T00:15:36.111587+0000","last_fullsized":"2024-06-10T00:15:36.111587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115247+0000","last_change":"2024-06-10T00:15:36.115247+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115247+0000","last_undegraded":"2024-06-10T00:15:36.115247+0000","last_fullsized":"2024-06-10T00:15:36.115247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110473+0000","last_change":"2024-06-10T00:15:36.110473+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110473+0000","last_undegraded":"2024-06-10T00:15:36.110473+0000","last_fullsized":"2024-06-10T00:15:36.110473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110397+0000","last_change":"2024-06-10T00:15:36.110397+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110397+0000","last_undegraded":"2024-06-10T00:15:36.110397+0000","last_fullsized":"2024-06-10T00:15:36.110397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112578+0000","last_change":"2024-06-10T00:15:36.112578+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112578+0000","last_undegraded":"2024-06-10T00:15:36.112578+0000","last_fullsized":"2024-06-10T00:15:36.112578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111074+0000","last_change":"2024-06-10T00:15:36.111074+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111074+0000","last_undegraded":"2024-06-10T00:15:36.111074+0000","last_fullsized":"2024-06-10T00:15:36.111074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110848+0000","last_change":"2024-06-10T00:15:36.110848+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110848+0000","last_undegraded":"2024-06-10T00:15:36.110848+0000","last_fullsized":"2024-06-10T00:15:36.110848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112427+0000","last_change":"2024-06-10T00:15:36.112427+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112427+0000","last_undegraded":"2024-06-10T00:15:36.112427+0000","last_fullsized":"2024-06-10T00:15:36.112427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112424+0000","last_change":"2024-06-10T00:15:36.112424+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112424+0000","last_undegraded":"2024-06-10T00:15:36.112424+0000","last_fullsized":"2024-06-10T00:15:36.112424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110443+0000","last_change":"2024-06-10T00:15:36.110443+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110443+0000","last_undegraded":"2024-06-10T00:15:36.110443+0000","last_fullsized":"2024-06-10T00:15:36.110443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113604+0000","last_change":"2024-06-10T00:15:36.113604+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113604+0000","last_undegraded":"2024-06-10T00:15:36.113604+0000","last_fullsized":"2024-06-10T00:15:36.113604+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115240+0000","last_change":"2024-06-10T00:15:36.115240+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115240+0000","last_undegraded":"2024-06-10T00:15:36.115240+0000","last_fullsized":"2024-06-10T00:15:36.115240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.111438+0000","last_change":"2024-06-10T00:15:36.111438+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.111438+0000","last_undegraded":"2024-06-10T00:15:36.111438+0000","last_fullsized":"2024-06-10T00:15:36.111438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110371+0000","last_change":"2024-06-10T00:15:36.110371+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110371+0000","last_undegraded":"2024-06-10T00:15:36.110371+0000","last_fullsized":"2024-06-10T00:15:36.110371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117964+0000","last_change":"2024-06-10T00:15:36.117964+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117964+0000","last_undegraded":"2024-06-10T00:15:36.117964+0000","last_fullsized":"2024-06-10T00:15:36.117964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110445+0000","last_change":"2024-06-10T00:15:36.110445+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110445+0000","last_undegraded":"2024-06-10T00:15:36.110445+0000","last_fullsized":"2024-06-10T00:15:36.110445+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117886+0000","last_change":"2024-06-10T00:15:36.117886+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117886+0000","last_undegraded":"2024-06-10T00:15:36.117886+0000","last_fullsized":"2024-06-10T00:15:36.117886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117933+0000","last_change":"2024-06-10T00:15:36.117933+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117933+0000","last_undegraded":"2024-06-10T00:15:36.117933+0000","last_fullsized":"2024-06-10T00:15:36.117933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115209+0000","last_change":"2024-06-10T00:15:36.115209+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115209+0000","last_undegraded":"2024-06-10T00:15:36.115209+0000","last_fullsized":"2024-06-10T00:15:36.115209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.117869+0000","last_change":"2024-06-10T00:15:36.117869+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.117869+0000","last_undegraded":"2024-06-10T00:15:36.117869+0000","last_fullsized":"2024-06-10T00:15:36.117869+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110963+0000","last_change":"2024-06-10T00:15:36.110963+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110963+0000","last_undegraded":"2024-06-10T00:15:36.110963+0000","last_fullsized":"2024-06-10T00:15:36.110963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.118015+0000","last_change":"2024-06-10T00:15:36.118015+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.118015+0000","last_undegraded":"2024-06-10T00:15:36.118015+0000","last_fullsized":"2024-06-10T00:15:36.118015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113786+0000","last_change":"2024-06-10T00:15:36.113786+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113786+0000","last_undegraded":"2024-06-10T00:15:36.113786+0000","last_fullsized":"2024-06-10T00:15:36.113786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113745+0000","last_change":"2024-06-10T00:15:36.113745+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113745+0000","last_undegraded":"2024-06-10T00:15:36.113745+0000","last_fullsized":"2024-06-10T00:15:36.113745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.113289+0000","last_change":"2024-06-10T00:15:36.113289+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.113289+0000","last_undegraded":"2024-06-10T00:15:36.113289+0000","last_fullsized":"2024-06-10T00:15:36.113289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.110396+0000","last_change":"2024-06-10T00:15:36.110396+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.110396+0000","last_undegraded":"2024-06-10T00:15:36.110396+0000","last_fullsized":"2024-06-10T00:15:36.110396+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.112402+0000","last_change":"2024-06-10T00:15:36.112402+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.112402+0000","last_undegraded":"2024-06-10T00:15:36.112402+0000","last_fullsized":"2024-06-10T00:15:36.112402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:15:37.106977+0000","last_change":"2024-06-10T00:15:37.106977+0000","last_active":"2024-06-10T00:15:37.106977+0000","last_peered":"2024-06-10T00:15:37.106977+0000","last_clean":"2024-06-10T00:15:37.106977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:37.106977+0000","last_undegraded":"2024-06-10T00:15:37.106977+0000","last_fullsized":"2024-06-10T00:15:37.106977+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-10T00:15:36.115332+0000","last_change":"2024-06-10T00:15:36.115332+0000","last_active":"2024-06-10T00:15:36.102063+0000","last_peered":"2024-06-10T00:15:36.102063+0000","last_clean":"2024-06-10T00:15:36.102063+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:15:36.115332+0000","last_undegraded":"2024-06-10T00:15:36.115332+0000","last_fullsized":"2024-06-10T00:15:36.115332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-10T00:15:36.115737+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:15:36.115737+0000","last_peered":"2024-06-10T00:15:36.115737+0000","last_clean":"2024-06-10T00:15:36.115737+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:15:36.115737+0000","last_undegraded":"2024-06-10T00:15:36.115737+0000","last_fullsized":"2024-06-10T00:15:36.115737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:43.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:15:43.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:15:46.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:15:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.242+0000 7fd6fdb90640 1 Processor -- start 2024-06-10T00:15:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.242+0000 7fd6fdb90640 1 -- start start 2024-06-10T00:15:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.242+0000 7fd6fdb90640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd6f80ae910 0x7fd6f806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6fdb90640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f806d130 con 0x7fd6f806ea20 2024-06-10T00:15:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6fdb90640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f806d410 con 0x7fd6f80cf360 2024-06-10T00:15:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6fdb90640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f806ee90 con 0x7fd6f80ae910 2024-06-10T00:15:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6f77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd6f80ae910 0x7fd6f806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6eeffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd6f806ea20 0x7fd6f80cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44946/0 (socket says 172.21.15.79:44946) 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6eeffd640 1 -- 172.21.15.79:0/2492370459 learned_addr learned my addr 172.21.15.79:0/2492370459 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6f77fe640 1 -- 172.21.15.79:0/2492370459 >> v1:172.21.15.117:6789/0 conn(0x7fd6f80cf360 legacy=0x7fd6f80acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6f77fe640 1 -- 172.21.15.79:0/2492370459 >> v1:172.21.15.79:6789/0 conn(0x7fd6f806ea20 legacy=0x7fd6f80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6f6ffd640 1 -- 172.21.15.79:0/2492370459 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278343496 0 0) 0x7fd6f806d130 con 0x7fd6f806ea20 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.243+0000 7fd6f77fe640 1 -- 172.21.15.79:0/2492370459 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f806d6f0 con 0x7fd6f80ae910 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6f77fe640 1 --2- 172.21.15.79:0/2492370459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f806e4e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80097a0 tx=0x7fd6e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4eab087c468c6f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6f6ffd640 1 -- 172.21.15.79:0/2492370459 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8037070 con 0x7fd6f80ae910 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6f6ffd640 1 -- 172.21.15.79:0/2492370459 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e802ae50 con 0x7fd6f80ae910 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6f6ffd640 1 -- 172.21.15.79:0/2492370459 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8032660 con 0x7fd6f80ae910 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6fdb90640 1 -- 172.21.15.79:0/2492370459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 msgr2=0x7fd6f806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6fdb90640 1 --2- 172.21.15.79:0/2492370459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f806e4e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80097a0 tx=0x7fd6e802a140 comp rx=0 tx=0).stop 2024-06-10T00:15:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6fdb90640 1 -- 172.21.15.79:0/2492370459 shutdown_connections 2024-06-10T00:15:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6fdb90640 1 --2- 172.21.15.79:0/2492370459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f806e4e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.244+0000 7fd6fdb90640 1 -- 172.21.15.79:0/2492370459 >> 172.21.15.79:0/2492370459 conn(0x7fd6f80b19f0 msgr2=0x7fd6f80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.245+0000 7fd6fdb90640 1 -- 172.21.15.79:0/2492370459 shutdown_connections 2024-06-10T00:15:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.245+0000 7fd6fdb90640 1 -- 172.21.15.79:0/2492370459 wait complete. 2024-06-10T00:15:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.246+0000 7fd6fdb90640 1 Processor -- start 2024-06-10T00:15:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.246+0000 7fd6fdb90640 1 -- start start 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6fdb90640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f806ea20 0x7fd6f80c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6fdb90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6fdb90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cf360 0x7fd6f8159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6fdb90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f80ad450 con 0x7fd6f80ae910 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6fdb90640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f80aecf0 con 0x7fd6f806ea20 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6fdb90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f80ad5d0 con 0x7fd6f80cf360 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f80c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45142/0 (socket says 172.21.15.79:45142) 2024-06-10T00:15:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 -- 172.21.15.79:0/3082201438 learned_addr learned my addr 172.21.15.79:0/3082201438 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 -- 172.21.15.79:0/3082201438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cf360 msgr2=0x7fd6f8159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cf360 0x7fd6f8159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 -- 172.21.15.79:0/3082201438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f806ea20 msgr2=0x7fd6f80c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6f77fe640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f806ea20 0x7fd6f80c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f806ea20 0x7fd6f80c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 -- 172.21.15.79:0/3082201438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f809af50 con 0x7fd6f80ae910 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6eeffd640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f80c5c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000c460 tx=0x7fd6e000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6f4ff9640 1 -- 172.21.15.79:0/3082201438 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00074e0 con 0x7fd6f80ae910 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6f4ff9640 1 -- 172.21.15.79:0/3082201438 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e00047e0 con 0x7fd6f80ae910 2024-06-10T00:15:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6f4ff9640 1 -- 172.21.15.79:0/3082201438 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0004bd0 con 0x7fd6f80ae910 2024-06-10T00:15:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.247+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f809b230 con 0x7fd6f80ae910 2024-06-10T00:15:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.248+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f809ac40 con 0x7fd6f80ae910 2024-06-10T00:15:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.249+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f8068430 con 0x7fd6f80ae910 2024-06-10T00:15:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.249+0000 7fd6f4ff9640 1 -- 172.21.15.79:0/3082201438 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6e0011070 con 0x7fd6f80ae910 2024-06-10T00:15:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.249+0000 7fd6f4ff9640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd6d806be30 0x7fd6d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.250+0000 7fd6f4ff9640 1 -- 172.21.15.79:0/3082201438 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fd6e008ac30 con 0x7fd6f80ae910 2024-06-10T00:15:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.250+0000 7fd6f77fe640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd6d806be30 0x7fd6d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.250+0000 7fd6f77fe640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd6d806be30 0x7fd6d806e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8034000 tx=0x7fd6e802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.254+0000 7fd6f4ff9640 1 -- 172.21.15.79:0/3082201438 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd6e0059450 con 0x7fd6f80ae910 2024-06-10T00:15:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.422+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6f80cd780 con 0x7fd6d806be30 2024-06-10T00:15:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.428+0000 7fd6f4ff9640 1 -- 172.21.15.79:0/3082201438 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fd6f80cd780 con 0x7fd6d806be30 2024-06-10T00:15:46.431 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:46.433 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:15:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd6d806be30 msgr2=0x7fd6d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd6d806be30 0x7fd6d806e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8034000 tx=0x7fd6e802e000 comp rx=0 tx=0).stop 2024-06-10T00:15:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 msgr2=0x7fd6f80c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f80c5c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000c460 tx=0x7fd6e000c920 comp rx=0 tx=0).stop 2024-06-10T00:15:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 shutdown_connections 2024-06-10T00:15:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd6d806be30 0x7fd6d806e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cf360 0x7fd6f8159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f80ae910 0x7fd6f80c5c80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 --2- 172.21.15.79:0/3082201438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f806ea20 0x7fd6f80c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 >> 172.21.15.79:0/3082201438 conn(0x7fd6f80b19f0 msgr2=0x7fd6f80b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 shutdown_connections 2024-06-10T00:15:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.431+0000 7fd6fdb90640 1 -- 172.21.15.79:0/3082201438 wait complete. 2024-06-10T00:15:46.443 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-06-10T00:15:45.158829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220832,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753888,"statfs":{"total":773094113280,"available":772867981312,"internally_reserved":0,"allocated":4759552,"data_stored":2705780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001308"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092044+0000","last_change":"2024-06-10T00:15:38.136375+0000","last_active":"2024-06-10T00:15:40.092044+0000","last_peered":"2024-06-10T00:15:40.092044+0000","last_clean":"2024-06-10T00:15:40.092044+0000","last_became_active":"2024-06-10T00:15:38.136118+0000","last_became_peered":"2024-06-10T00:15:38.136118+0000","last_unstale":"2024-06-10T00:15:40.092044+0000","last_undegraded":"2024-06-10T00:15:40.092044+0000","last_fullsized":"2024-06-10T00:15:40.092044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:05.270164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092169+0000","last_change":"2024-06-10T00:15:38.133972+0000","last_active":"2024-06-10T00:15:40.092169+0000","last_peered":"2024-06-10T00:15:40.092169+0000","last_clean":"2024-06-10T00:15:40.092169+0000","last_became_active":"2024-06-10T00:15:38.133707+0000","last_became_peered":"2024-06-10T00:15:38.133707+0000","last_unstale":"2024-06-10T00:15:40.092169+0000","last_undegraded":"2024-06-10T00:15:40.092169+0000","last_fullsized":"2024-06-10T00:15:40.092169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:31:20.641047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092329+0000","last_change":"2024-06-10T00:15:38.142567+0000","last_active":"2024-06-10T00:15:40.092329+0000","last_peered":"2024-06-10T00:15:40.092329+0000","last_clean":"2024-06-10T00:15:40.092329+0000","last_became_active":"2024-06-10T00:15:38.142212+0000","last_became_peered":"2024-06-10T00:15:38.142212+0000","last_unstale":"2024-06-10T00:15:40.092329+0000","last_undegraded":"2024-06-10T00:15:40.092329+0000","last_fullsized":"2024-06-10T00:15:40.092329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:54:41.236240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142570+0000","last_change":"2024-06-10T00:15:38.130756+0000","last_active":"2024-06-10T00:15:39.142570+0000","last_peered":"2024-06-10T00:15:39.142570+0000","last_clean":"2024-06-10T00:15:39.142570+0000","last_became_active":"2024-06-10T00:15:38.130461+0000","last_became_peered":"2024-06-10T00:15:38.130461+0000","last_unstale":"2024-06-10T00:15:39.142570+0000","last_undegraded":"2024-06-10T00:15:39.142570+0000","last_fullsized":"2024-06-10T00:15:39.142570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:58:47.549757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142499+0000","last_change":"2024-06-10T00:15:38.131519+0000","last_active":"2024-06-10T00:15:39.142499+0000","last_peered":"2024-06-10T00:15:39.142499+0000","last_clean":"2024-06-10T00:15:39.142499+0000","last_became_active":"2024-06-10T00:15:38.131249+0000","last_became_peered":"2024-06-10T00:15:38.131249+0000","last_unstale":"2024-06-10T00:15:39.142499+0000","last_undegraded":"2024-06-10T00:15:39.142499+0000","last_fullsized":"2024-06-10T00:15:39.142499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:29:27.006925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284121+0000","last_change":"2024-06-10T00:15:38.133296+0000","last_active":"2024-06-10T00:15:39.284121+0000","last_peered":"2024-06-10T00:15:39.284121+0000","last_clean":"2024-06-10T00:15:39.284121+0000","last_became_active":"2024-06-10T00:15:38.133038+0000","last_became_peered":"2024-06-10T00:15:38.133038+0000","last_unstale":"2024-06-10T00:15:39.284121+0000","last_undegraded":"2024-06-10T00:15:39.284121+0000","last_fullsized":"2024-06-10T00:15:39.284121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:47:31.899953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542400+0000","last_change":"2024-06-10T00:15:38.136291+0000","last_active":"2024-06-10T00:15:39.542400+0000","last_peered":"2024-06-10T00:15:39.542400+0000","last_clean":"2024-06-10T00:15:39.542400+0000","last_became_active":"2024-06-10T00:15:38.134014+0000","last_became_peered":"2024-06-10T00:15:38.134014+0000","last_unstale":"2024-06-10T00:15:39.542400+0000","last_undegraded":"2024-06-10T00:15:39.542400+0000","last_fullsized":"2024-06-10T00:15:39.542400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:29:33.361377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091590+0000","last_change":"2024-06-10T00:15:38.143519+0000","last_active":"2024-06-10T00:15:40.091590+0000","last_peered":"2024-06-10T00:15:40.091590+0000","last_clean":"2024-06-10T00:15:40.091590+0000","last_became_active":"2024-06-10T00:15:38.143237+0000","last_became_peered":"2024-06-10T00:15:38.143237+0000","last_unstale":"2024-06-10T00:15:40.091590+0000","last_undegraded":"2024-06-10T00:15:40.091590+0000","last_fullsized":"2024-06-10T00:15:40.091590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:29:33.361377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092618+0000","last_change":"2024-06-10T00:15:38.142520+0000","last_active":"2024-06-10T00:15:40.092618+0000","last_peered":"2024-06-10T00:15:40.092618+0000","last_clean":"2024-06-10T00:15:40.092618+0000","last_became_active":"2024-06-10T00:15:38.142281+0000","last_became_peered":"2024-06-10T00:15:38.142281+0000","last_unstale":"2024-06-10T00:15:40.092618+0000","last_undegraded":"2024-06-10T00:15:40.092618+0000","last_fullsized":"2024-06-10T00:15:40.092618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:26:07.393455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542867+0000","last_change":"2024-06-10T00:15:38.144227+0000","last_active":"2024-06-10T00:15:39.542867+0000","last_peered":"2024-06-10T00:15:39.542867+0000","last_clean":"2024-06-10T00:15:39.542867+0000","last_became_active":"2024-06-10T00:15:38.143959+0000","last_became_peered":"2024-06-10T00:15:38.143959+0000","last_unstale":"2024-06-10T00:15:39.542867+0000","last_undegraded":"2024-06-10T00:15:39.542867+0000","last_fullsized":"2024-06-10T00:15:39.542867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:31:20.641047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542781+0000","last_change":"2024-06-10T00:15:38.133858+0000","last_active":"2024-06-10T00:15:39.542781+0000","last_peered":"2024-06-10T00:15:39.542781+0000","last_clean":"2024-06-10T00:15:39.542781+0000","last_became_active":"2024-06-10T00:15:38.133478+0000","last_became_peered":"2024-06-10T00:15:38.133478+0000","last_unstale":"2024-06-10T00:15:39.542781+0000","last_undegraded":"2024-06-10T00:15:39.542781+0000","last_fullsized":"2024-06-10T00:15:39.542781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:50:24.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092207+0000","last_change":"2024-06-10T00:15:38.134237+0000","last_active":"2024-06-10T00:15:40.092207+0000","last_peered":"2024-06-10T00:15:40.092207+0000","last_clean":"2024-06-10T00:15:40.092207+0000","last_became_active":"2024-06-10T00:15:38.133964+0000","last_became_peered":"2024-06-10T00:15:38.133964+0000","last_unstale":"2024-06-10T00:15:40.092207+0000","last_undegraded":"2024-06-10T00:15:40.092207+0000","last_fullsized":"2024-06-10T00:15:40.092207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:47:31.899953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542474+0000","last_change":"2024-06-10T00:15:38.144178+0000","last_active":"2024-06-10T00:15:39.542474+0000","last_peered":"2024-06-10T00:15:39.542474+0000","last_clean":"2024-06-10T00:15:39.542474+0000","last_became_active":"2024-06-10T00:15:38.143904+0000","last_became_peered":"2024-06-10T00:15:38.143904+0000","last_unstale":"2024-06-10T00:15:39.542474+0000","last_undegraded":"2024-06-10T00:15:39.542474+0000","last_fullsized":"2024-06-10T00:15:39.542474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:50:38.452311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141179+0000","last_change":"2024-06-10T00:15:38.145658+0000","last_active":"2024-06-10T00:15:39.141179+0000","last_peered":"2024-06-10T00:15:39.141179+0000","last_clean":"2024-06-10T00:15:39.141179+0000","last_became_active":"2024-06-10T00:15:38.145382+0000","last_became_peered":"2024-06-10T00:15:38.145382+0000","last_unstale":"2024-06-10T00:15:39.141179+0000","last_undegraded":"2024-06-10T00:15:39.141179+0000","last_fullsized":"2024-06-10T00:15:39.141179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:00:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542377+0000","last_change":"2024-06-10T00:15:38.129407+0000","last_active":"2024-06-10T00:15:39.542377+0000","last_peered":"2024-06-10T00:15:39.542377+0000","last_clean":"2024-06-10T00:15:39.542377+0000","last_became_active":"2024-06-10T00:15:38.128790+0000","last_became_peered":"2024-06-10T00:15:38.128790+0000","last_unstale":"2024-06-10T00:15:39.542377+0000","last_undegraded":"2024-06-10T00:15:39.542377+0000","last_fullsized":"2024-06-10T00:15:39.542377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:17:29.180626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092210+0000","last_change":"2024-06-10T00:15:38.151751+0000","last_active":"2024-06-10T00:15:40.092210+0000","last_peered":"2024-06-10T00:15:40.092210+0000","last_clean":"2024-06-10T00:15:40.092210+0000","last_became_active":"2024-06-10T00:15:38.151489+0000","last_became_peered":"2024-06-10T00:15:38.151489+0000","last_unstale":"2024-06-10T00:15:40.092210+0000","last_undegraded":"2024-06-10T00:15:40.092210+0000","last_fullsized":"2024-06-10T00:15:40.092210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:54:41.236240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092793+0000","last_change":"2024-06-10T00:15:38.150690+0000","last_active":"2024-06-10T00:15:40.092793+0000","last_peered":"2024-06-10T00:15:40.092793+0000","last_clean":"2024-06-10T00:15:40.092793+0000","last_became_active":"2024-06-10T00:15:38.150415+0000","last_became_peered":"2024-06-10T00:15:38.150415+0000","last_unstale":"2024-06-10T00:15:40.092793+0000","last_undegraded":"2024-06-10T00:15:40.092793+0000","last_fullsized":"2024-06-10T00:15:40.092793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:29:33.361377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141296+0000","last_change":"2024-06-10T00:15:38.144603+0000","last_active":"2024-06-10T00:15:39.141296+0000","last_peered":"2024-06-10T00:15:39.141296+0000","last_clean":"2024-06-10T00:15:39.141296+0000","last_became_active":"2024-06-10T00:15:38.144314+0000","last_became_peered":"2024-06-10T00:15:38.144314+0000","last_unstale":"2024-06-10T00:15:39.141296+0000","last_undegraded":"2024-06-10T00:15:39.141296+0000","last_fullsized":"2024-06-10T00:15:39.141296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:33:15.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142706+0000","last_change":"2024-06-10T00:15:38.128878+0000","last_active":"2024-06-10T00:15:39.142706+0000","last_peered":"2024-06-10T00:15:39.142706+0000","last_clean":"2024-06-10T00:15:39.142706+0000","last_became_active":"2024-06-10T00:15:38.128621+0000","last_became_peered":"2024-06-10T00:15:38.128621+0000","last_unstale":"2024-06-10T00:15:39.142706+0000","last_undegraded":"2024-06-10T00:15:39.142706+0000","last_fullsized":"2024-06-10T00:15:39.142706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:15:54.471023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141531+0000","last_change":"2024-06-10T00:15:38.144858+0000","last_active":"2024-06-10T00:15:39.141531+0000","last_peered":"2024-06-10T00:15:39.141531+0000","last_clean":"2024-06-10T00:15:39.141531+0000","last_became_active":"2024-06-10T00:15:38.144553+0000","last_became_peered":"2024-06-10T00:15:38.144553+0000","last_unstale":"2024-06-10T00:15:39.141531+0000","last_undegraded":"2024-06-10T00:15:39.141531+0000","last_fullsized":"2024-06-10T00:15:39.141531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:35.904902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542548+0000","last_change":"2024-06-10T00:15:38.133585+0000","last_active":"2024-06-10T00:15:39.542548+0000","last_peered":"2024-06-10T00:15:39.542548+0000","last_clean":"2024-06-10T00:15:39.542548+0000","last_became_active":"2024-06-10T00:15:38.133254+0000","last_became_peered":"2024-06-10T00:15:38.133254+0000","last_unstale":"2024-06-10T00:15:39.542548+0000","last_undegraded":"2024-06-10T00:15:39.542548+0000","last_fullsized":"2024-06-10T00:15:39.542548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:14.363732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141840+0000","last_change":"2024-06-10T00:15:38.132551+0000","last_active":"2024-06-10T00:15:39.141840+0000","last_peered":"2024-06-10T00:15:39.141840+0000","last_clean":"2024-06-10T00:15:39.141840+0000","last_became_active":"2024-06-10T00:15:38.132258+0000","last_became_peered":"2024-06-10T00:15:38.132258+0000","last_unstale":"2024-06-10T00:15:39.141840+0000","last_undegraded":"2024-06-10T00:15:39.141840+0000","last_fullsized":"2024-06-10T00:15:39.141840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:04:38.101713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092318+0000","last_change":"2024-06-10T00:15:38.139329+0000","last_active":"2024-06-10T00:15:40.092318+0000","last_peered":"2024-06-10T00:15:40.092318+0000","last_clean":"2024-06-10T00:15:40.092318+0000","last_became_active":"2024-06-10T00:15:38.139054+0000","last_became_peered":"2024-06-10T00:15:38.139054+0000","last_unstale":"2024-06-10T00:15:40.092318+0000","last_undegraded":"2024-06-10T00:15:40.092318+0000","last_fullsized":"2024-06-10T00:15:40.092318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:38:46.142225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142685+0000","last_change":"2024-06-10T00:15:38.138685+0000","last_active":"2024-06-10T00:15:39.142685+0000","last_peered":"2024-06-10T00:15:39.142685+0000","last_clean":"2024-06-10T00:15:39.142685+0000","last_became_active":"2024-06-10T00:15:38.138373+0000","last_became_peered":"2024-06-10T00:15:38.138373+0000","last_unstale":"2024-06-10T00:15:39.142685+0000","last_undegraded":"2024-06-10T00:15:39.142685+0000","last_fullsized":"2024-06-10T00:15:39.142685+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:59:50.997700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141320+0000","last_change":"2024-06-10T00:15:38.146308+0000","last_active":"2024-06-10T00:15:39.141320+0000","last_peered":"2024-06-10T00:15:39.141320+0000","last_clean":"2024-06-10T00:15:39.141320+0000","last_became_active":"2024-06-10T00:15:38.146028+0000","last_became_peered":"2024-06-10T00:15:38.146028+0000","last_unstale":"2024-06-10T00:15:39.141320+0000","last_undegraded":"2024-06-10T00:15:39.141320+0000","last_fullsized":"2024-06-10T00:15:39.141320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:06:04.319367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284322+0000","last_change":"2024-06-10T00:15:38.134586+0000","last_active":"2024-06-10T00:15:39.284322+0000","last_peered":"2024-06-10T00:15:39.284322+0000","last_clean":"2024-06-10T00:15:39.284322+0000","last_became_active":"2024-06-10T00:15:38.134309+0000","last_became_peered":"2024-06-10T00:15:38.134309+0000","last_unstale":"2024-06-10T00:15:39.284322+0000","last_undegraded":"2024-06-10T00:15:39.284322+0000","last_fullsized":"2024-06-10T00:15:39.284322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:49:56.367727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141000+0000","last_change":"2024-06-10T00:15:38.151807+0000","last_active":"2024-06-10T00:15:39.141000+0000","last_peered":"2024-06-10T00:15:39.141000+0000","last_clean":"2024-06-10T00:15:39.141000+0000","last_became_active":"2024-06-10T00:15:38.151510+0000","last_became_peered":"2024-06-10T00:15:38.151510+0000","last_unstale":"2024-06-10T00:15:39.141000+0000","last_undegraded":"2024-06-10T00:15:39.141000+0000","last_fullsized":"2024-06-10T00:15:39.141000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:52:33.289132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542656+0000","last_change":"2024-06-10T00:15:38.137649+0000","last_active":"2024-06-10T00:15:39.542656+0000","last_peered":"2024-06-10T00:15:39.542656+0000","last_clean":"2024-06-10T00:15:39.542656+0000","last_became_active":"2024-06-10T00:15:38.137381+0000","last_became_peered":"2024-06-10T00:15:38.137381+0000","last_unstale":"2024-06-10T00:15:39.542656+0000","last_undegraded":"2024-06-10T00:15:39.542656+0000","last_fullsized":"2024-06-10T00:15:39.542656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:03.277021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141159+0000","last_change":"2024-06-10T00:15:38.146332+0000","last_active":"2024-06-10T00:15:39.141159+0000","last_peered":"2024-06-10T00:15:39.141159+0000","last_clean":"2024-06-10T00:15:39.141159+0000","last_became_active":"2024-06-10T00:15:38.146044+0000","last_became_peered":"2024-06-10T00:15:38.146044+0000","last_unstale":"2024-06-10T00:15:39.141159+0000","last_undegraded":"2024-06-10T00:15:39.141159+0000","last_fullsized":"2024-06-10T00:15:39.141159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:41:37.410149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141035+0000","last_change":"2024-06-10T00:15:38.148857+0000","last_active":"2024-06-10T00:15:39.141035+0000","last_peered":"2024-06-10T00:15:39.141035+0000","last_clean":"2024-06-10T00:15:39.141035+0000","last_became_active":"2024-06-10T00:15:38.148580+0000","last_became_peered":"2024-06-10T00:15:38.148580+0000","last_unstale":"2024-06-10T00:15:39.141035+0000","last_undegraded":"2024-06-10T00:15:39.141035+0000","last_fullsized":"2024-06-10T00:15:39.141035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:54:13.607762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092608+0000","last_change":"2024-06-10T00:15:38.139967+0000","last_active":"2024-06-10T00:15:40.092608+0000","last_peered":"2024-06-10T00:15:40.092608+0000","last_clean":"2024-06-10T00:15:40.092608+0000","last_became_active":"2024-06-10T00:15:38.139701+0000","last_became_peered":"2024-06-10T00:15:38.139701+0000","last_unstale":"2024-06-10T00:15:40.092608+0000","last_undegraded":"2024-06-10T00:15:40.092608+0000","last_fullsized":"2024-06-10T00:15:40.092608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:14:27.802763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284091+0000","last_change":"2024-06-10T00:15:38.133416+0000","last_active":"2024-06-10T00:15:39.284091+0000","last_peered":"2024-06-10T00:15:39.284091+0000","last_clean":"2024-06-10T00:15:39.284091+0000","last_became_active":"2024-06-10T00:15:38.133146+0000","last_became_peered":"2024-06-10T00:15:38.133146+0000","last_unstale":"2024-06-10T00:15:39.284091+0000","last_undegraded":"2024-06-10T00:15:39.284091+0000","last_fullsized":"2024-06-10T00:15:39.284091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:08:38.144033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092439+0000","last_change":"2024-06-10T00:15:38.150770+0000","last_active":"2024-06-10T00:15:40.092439+0000","last_peered":"2024-06-10T00:15:40.092439+0000","last_clean":"2024-06-10T00:15:40.092439+0000","last_became_active":"2024-06-10T00:15:38.150490+0000","last_became_peered":"2024-06-10T00:15:38.150490+0000","last_unstale":"2024-06-10T00:15:40.092439+0000","last_undegraded":"2024-06-10T00:15:40.092439+0000","last_fullsized":"2024-06-10T00:15:40.092439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:26:07.393455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141385+0000","last_change":"2024-06-10T00:15:37.123317+0000","last_active":"2024-06-10T00:15:39.141385+0000","last_peered":"2024-06-10T00:15:39.141385+0000","last_clean":"2024-06-10T00:15:39.141385+0000","last_became_active":"2024-06-10T00:15:37.123069+0000","last_became_peered":"2024-06-10T00:15:37.123069+0000","last_unstale":"2024-06-10T00:15:39.141385+0000","last_undegraded":"2024-06-10T00:15:39.141385+0000","last_fullsized":"2024-06-10T00:15:39.141385+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:29:26.002011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284355+0000","last_change":"2024-06-10T00:15:38.135355+0000","last_active":"2024-06-10T00:15:39.284355+0000","last_peered":"2024-06-10T00:15:39.284355+0000","last_clean":"2024-06-10T00:15:39.284355+0000","last_became_active":"2024-06-10T00:15:38.135082+0000","last_became_peered":"2024-06-10T00:15:38.135082+0000","last_unstale":"2024-06-10T00:15:39.284355+0000","last_undegraded":"2024-06-10T00:15:39.284355+0000","last_fullsized":"2024-06-10T00:15:39.284355+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:54:41.236240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092516+0000","last_change":"2024-06-10T00:15:37.126777+0000","last_active":"2024-06-10T00:15:40.092516+0000","last_peered":"2024-06-10T00:15:40.092516+0000","last_clean":"2024-06-10T00:15:40.092516+0000","last_became_active":"2024-06-10T00:15:37.126502+0000","last_became_peered":"2024-06-10T00:15:37.126502+0000","last_unstale":"2024-06-10T00:15:40.092516+0000","last_undegraded":"2024-06-10T00:15:40.092516+0000","last_fullsized":"2024-06-10T00:15:40.092516+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:59:49.992785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141333+0000","last_change":"2024-06-10T00:15:38.146308+0000","last_active":"2024-06-10T00:15:39.141333+0000","last_peered":"2024-06-10T00:15:39.141333+0000","last_clean":"2024-06-10T00:15:39.141333+0000","last_became_active":"2024-06-10T00:15:38.146048+0000","last_became_peered":"2024-06-10T00:15:38.146048+0000","last_unstale":"2024-06-10T00:15:39.141333+0000","last_undegraded":"2024-06-10T00:15:39.141333+0000","last_fullsized":"2024-06-10T00:15:39.141333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:49:56.367727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284347+0000","last_change":"2024-06-10T00:15:37.127396+0000","last_active":"2024-06-10T00:15:39.284347+0000","last_peered":"2024-06-10T00:15:39.284347+0000","last_clean":"2024-06-10T00:15:39.284347+0000","last_became_active":"2024-06-10T00:15:37.127110+0000","last_became_peered":"2024-06-10T00:15:37.127110+0000","last_unstale":"2024-06-10T00:15:39.284347+0000","last_undegraded":"2024-06-10T00:15:39.284347+0000","last_fullsized":"2024-06-10T00:15:39.284347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:48:30.739194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092175+0000","last_change":"2024-06-10T00:15:38.146518+0000","last_active":"2024-06-10T00:15:40.092175+0000","last_peered":"2024-06-10T00:15:40.092175+0000","last_clean":"2024-06-10T00:15:40.092175+0000","last_became_active":"2024-06-10T00:15:38.146291+0000","last_became_peered":"2024-06-10T00:15:38.146291+0000","last_unstale":"2024-06-10T00:15:40.092175+0000","last_undegraded":"2024-06-10T00:15:40.092175+0000","last_fullsized":"2024-06-10T00:15:40.092175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:23:19.443643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141717+0000","last_change":"2024-06-10T00:15:37.132498+0000","last_active":"2024-06-10T00:15:39.141717+0000","last_peered":"2024-06-10T00:15:39.141717+0000","last_clean":"2024-06-10T00:15:39.141717+0000","last_became_active":"2024-06-10T00:15:37.132213+0000","last_became_peered":"2024-06-10T00:15:37.132213+0000","last_unstale":"2024-06-10T00:15:39.141717+0000","last_undegraded":"2024-06-10T00:15:39.141717+0000","last_fullsized":"2024-06-10T00:15:39.141717+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:59:49.992785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092126+0000","last_change":"2024-06-10T00:15:38.137088+0000","last_active":"2024-06-10T00:15:40.092126+0000","last_peered":"2024-06-10T00:15:40.092126+0000","last_clean":"2024-06-10T00:15:40.092126+0000","last_became_active":"2024-06-10T00:15:38.136734+0000","last_became_peered":"2024-06-10T00:15:38.136734+0000","last_unstale":"2024-06-10T00:15:40.092126+0000","last_undegraded":"2024-06-10T00:15:40.092126+0000","last_fullsized":"2024-06-10T00:15:40.092126+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:08:38.144033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542535+0000","last_change":"2024-06-10T00:15:37.129962+0000","last_active":"2024-06-10T00:15:39.542535+0000","last_peered":"2024-06-10T00:15:39.542535+0000","last_clean":"2024-06-10T00:15:39.542535+0000","last_became_active":"2024-06-10T00:15:37.129715+0000","last_became_peered":"2024-06-10T00:15:37.129715+0000","last_unstale":"2024-06-10T00:15:39.542535+0000","last_undegraded":"2024-06-10T00:15:39.542535+0000","last_fullsized":"2024-06-10T00:15:39.542535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:54:12.602848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542561+0000","last_change":"2024-06-10T00:15:38.129451+0000","last_active":"2024-06-10T00:15:39.542561+0000","last_peered":"2024-06-10T00:15:39.542561+0000","last_clean":"2024-06-10T00:15:39.542561+0000","last_became_active":"2024-06-10T00:15:38.129089+0000","last_became_peered":"2024-06-10T00:15:38.129089+0000","last_unstale":"2024-06-10T00:15:39.542561+0000","last_undegraded":"2024-06-10T00:15:39.542561+0000","last_fullsized":"2024-06-10T00:15:39.542561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:35:51.379461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092344+0000","last_change":"2024-06-10T00:15:37.132572+0000","last_active":"2024-06-10T00:15:40.092344+0000","last_peered":"2024-06-10T00:15:40.092344+0000","last_clean":"2024-06-10T00:15:40.092344+0000","last_became_active":"2024-06-10T00:15:37.132331+0000","last_became_peered":"2024-06-10T00:15:37.132331+0000","last_unstale":"2024-06-10T00:15:40.092344+0000","last_undegraded":"2024-06-10T00:15:40.092344+0000","last_fullsized":"2024-06-10T00:15:40.092344+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:48:30.739194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141761+0000","last_change":"2024-06-10T00:15:38.137669+0000","last_active":"2024-06-10T00:15:39.141761+0000","last_peered":"2024-06-10T00:15:39.141761+0000","last_clean":"2024-06-10T00:15:39.141761+0000","last_became_active":"2024-06-10T00:15:38.137374+0000","last_became_peered":"2024-06-10T00:15:38.137374+0000","last_unstale":"2024-06-10T00:15:39.141761+0000","last_undegraded":"2024-06-10T00:15:39.141761+0000","last_fullsized":"2024-06-10T00:15:39.141761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:38:46.142225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284010+0000","last_change":"2024-06-10T00:15:37.129603+0000","last_active":"2024-06-10T00:15:39.284010+0000","last_peered":"2024-06-10T00:15:39.284010+0000","last_clean":"2024-06-10T00:15:39.284010+0000","last_became_active":"2024-06-10T00:15:37.129230+0000","last_became_peered":"2024-06-10T00:15:37.129230+0000","last_unstale":"2024-06-10T00:15:39.284010+0000","last_undegraded":"2024-06-10T00:15:39.284010+0000","last_fullsized":"2024-06-10T00:15:39.284010+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:59:49.992785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091747+0000","last_change":"2024-06-10T00:15:38.138070+0000","last_active":"2024-06-10T00:15:40.091747+0000","last_peered":"2024-06-10T00:15:40.091747+0000","last_clean":"2024-06-10T00:15:40.091747+0000","last_became_active":"2024-06-10T00:15:38.137551+0000","last_became_peered":"2024-06-10T00:15:38.137551+0000","last_unstale":"2024-06-10T00:15:40.091747+0000","last_undegraded":"2024-06-10T00:15:40.091747+0000","last_fullsized":"2024-06-10T00:15:40.091747+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:13.377073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.140603+0000","last_change":"2024-06-10T00:15:37.120249+0000","last_active":"2024-06-10T00:15:39.140603+0000","last_peered":"2024-06-10T00:15:39.140603+0000","last_clean":"2024-06-10T00:15:39.140603+0000","last_became_active":"2024-06-10T00:15:37.119983+0000","last_became_peered":"2024-06-10T00:15:37.119983+0000","last_unstale":"2024-06-10T00:15:39.140603+0000","last_undegraded":"2024-06-10T00:15:39.140603+0000","last_fullsized":"2024-06-10T00:15:39.140603+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:58:46.544843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142713+0000","last_change":"2024-06-10T00:15:38.129743+0000","last_active":"2024-06-10T00:15:39.142713+0000","last_peered":"2024-06-10T00:15:39.142713+0000","last_clean":"2024-06-10T00:15:39.142713+0000","last_became_active":"2024-06-10T00:15:38.129487+0000","last_became_peered":"2024-06-10T00:15:38.129487+0000","last_unstale":"2024-06-10T00:15:39.142713+0000","last_undegraded":"2024-06-10T00:15:39.142713+0000","last_fullsized":"2024-06-10T00:15:39.142713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:48:31.744108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092117+0000","last_change":"2024-06-10T00:15:37.131733+0000","last_active":"2024-06-10T00:15:40.092117+0000","last_peered":"2024-06-10T00:15:40.092117+0000","last_clean":"2024-06-10T00:15:40.092117+0000","last_became_active":"2024-06-10T00:15:37.131465+0000","last_became_peered":"2024-06-10T00:15:37.131465+0000","last_unstale":"2024-06-10T00:15:40.092117+0000","last_undegraded":"2024-06-10T00:15:40.092117+0000","last_fullsized":"2024-06-10T00:15:40.092117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:47:30.895039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092651+0000","last_change":"2024-06-10T00:15:38.148060+0000","last_active":"2024-06-10T00:15:40.092651+0000","last_peered":"2024-06-10T00:15:40.092651+0000","last_clean":"2024-06-10T00:15:40.092651+0000","last_became_active":"2024-06-10T00:15:38.147786+0000","last_became_peered":"2024-06-10T00:15:38.147786+0000","last_unstale":"2024-06-10T00:15:40.092651+0000","last_undegraded":"2024-06-10T00:15:40.092651+0000","last_fullsized":"2024-06-10T00:15:40.092651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:00:34.424734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542955+0000","last_change":"2024-06-10T00:15:37.132272+0000","last_active":"2024-06-10T00:15:39.542955+0000","last_peered":"2024-06-10T00:15:39.542955+0000","last_clean":"2024-06-10T00:15:39.542955+0000","last_became_active":"2024-06-10T00:15:37.131942+0000","last_became_peered":"2024-06-10T00:15:37.131942+0000","last_unstale":"2024-06-10T00:15:39.542955+0000","last_undegraded":"2024-06-10T00:15:39.542955+0000","last_fullsized":"2024-06-10T00:15:39.542955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:41:36.405234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092469+0000","last_change":"2024-06-10T00:15:38.140155+0000","last_active":"2024-06-10T00:15:40.092469+0000","last_peered":"2024-06-10T00:15:40.092469+0000","last_clean":"2024-06-10T00:15:40.092469+0000","last_became_active":"2024-06-10T00:15:38.139900+0000","last_became_peered":"2024-06-10T00:15:38.139900+0000","last_unstale":"2024-06-10T00:15:40.092469+0000","last_undegraded":"2024-06-10T00:15:40.092469+0000","last_fullsized":"2024-06-10T00:15:40.092469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:04:38.101713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542838+0000","last_change":"2024-06-10T00:15:37.131617+0000","last_active":"2024-06-10T00:15:39.542838+0000","last_peered":"2024-06-10T00:15:39.542838+0000","last_clean":"2024-06-10T00:15:39.542838+0000","last_became_active":"2024-06-10T00:15:37.131344+0000","last_became_peered":"2024-06-10T00:15:37.131344+0000","last_unstale":"2024-06-10T00:15:39.542838+0000","last_undegraded":"2024-06-10T00:15:39.542838+0000","last_fullsized":"2024-06-10T00:15:39.542838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:52:32.284218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.140884+0000","last_change":"2024-06-10T00:15:38.132795+0000","last_active":"2024-06-10T00:15:39.140884+0000","last_peered":"2024-06-10T00:15:39.140884+0000","last_clean":"2024-06-10T00:15:39.140884+0000","last_became_active":"2024-06-10T00:15:38.132503+0000","last_became_peered":"2024-06-10T00:15:38.132503+0000","last_unstale":"2024-06-10T00:15:39.140884+0000","last_undegraded":"2024-06-10T00:15:39.140884+0000","last_fullsized":"2024-06-10T00:15:39.140884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:08:38.144033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091940+0000","last_change":"2024-06-10T00:15:37.131097+0000","last_active":"2024-06-10T00:15:40.091940+0000","last_peered":"2024-06-10T00:15:40.091940+0000","last_clean":"2024-06-10T00:15:40.091940+0000","last_became_active":"2024-06-10T00:15:37.130801+0000","last_became_peered":"2024-06-10T00:15:37.130801+0000","last_unstale":"2024-06-10T00:15:40.091940+0000","last_undegraded":"2024-06-10T00:15:40.091940+0000","last_fullsized":"2024-06-10T00:15:40.091940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:34.899988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092272+0000","last_change":"2024-06-10T00:15:38.142733+0000","last_active":"2024-06-10T00:15:40.092272+0000","last_peered":"2024-06-10T00:15:40.092272+0000","last_clean":"2024-06-10T00:15:40.092272+0000","last_became_active":"2024-06-10T00:15:38.142242+0000","last_became_peered":"2024-06-10T00:15:38.142242+0000","last_unstale":"2024-06-10T00:15:40.092272+0000","last_undegraded":"2024-06-10T00:15:40.092272+0000","last_fullsized":"2024-06-10T00:15:40.092272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:00:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091971+0000","last_change":"2024-06-10T00:15:37.129842+0000","last_active":"2024-06-10T00:15:40.091971+0000","last_peered":"2024-06-10T00:15:40.091971+0000","last_clean":"2024-06-10T00:15:40.091971+0000","last_became_active":"2024-06-10T00:15:37.127944+0000","last_became_peered":"2024-06-10T00:15:37.127944+0000","last_unstale":"2024-06-10T00:15:40.091971+0000","last_undegraded":"2024-06-10T00:15:40.091971+0000","last_fullsized":"2024-06-10T00:15:40.091971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:08:37.139118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091710+0000","last_change":"2024-06-10T00:15:38.135573+0000","last_active":"2024-06-10T00:15:40.091710+0000","last_peered":"2024-06-10T00:15:40.091710+0000","last_clean":"2024-06-10T00:15:40.091710+0000","last_became_active":"2024-06-10T00:15:38.135301+0000","last_became_peered":"2024-06-10T00:15:38.135301+0000","last_unstale":"2024-06-10T00:15:40.091710+0000","last_undegraded":"2024-06-10T00:15:40.091710+0000","last_fullsized":"2024-06-10T00:15:40.091710+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:50:38.452311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284022+0000","last_change":"2024-06-10T00:15:37.130539+0000","last_active":"2024-06-10T00:15:39.284022+0000","last_peered":"2024-06-10T00:15:39.284022+0000","last_clean":"2024-06-10T00:15:39.284022+0000","last_became_active":"2024-06-10T00:15:37.130188+0000","last_became_peered":"2024-06-10T00:15:37.130188+0000","last_unstale":"2024-06-10T00:15:39.284022+0000","last_undegraded":"2024-06-10T00:15:39.284022+0000","last_fullsized":"2024-06-10T00:15:39.284022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:15:53.466109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092472+0000","last_change":"2024-06-10T00:15:38.146812+0000","last_active":"2024-06-10T00:15:40.092472+0000","last_peered":"2024-06-10T00:15:40.092472+0000","last_clean":"2024-06-10T00:15:40.092472+0000","last_became_active":"2024-06-10T00:15:38.146569+0000","last_became_peered":"2024-06-10T00:15:38.146569+0000","last_unstale":"2024-06-10T00:15:40.092472+0000","last_undegraded":"2024-06-10T00:15:40.092472+0000","last_fullsized":"2024-06-10T00:15:40.092472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:37:35.040758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.140617+0000","last_change":"2024-06-10T00:15:37.120793+0000","last_active":"2024-06-10T00:15:39.140617+0000","last_peered":"2024-06-10T00:15:39.140617+0000","last_clean":"2024-06-10T00:15:39.140617+0000","last_became_active":"2024-06-10T00:15:37.120504+0000","last_became_peered":"2024-06-10T00:15:37.120504+0000","last_unstale":"2024-06-10T00:15:39.140617+0000","last_undegraded":"2024-06-10T00:15:39.140617+0000","last_fullsized":"2024-06-10T00:15:39.140617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:00:49.029193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091910+0000","last_change":"2024-06-10T00:15:38.135828+0000","last_active":"2024-06-10T00:15:40.091910+0000","last_peered":"2024-06-10T00:15:40.091910+0000","last_clean":"2024-06-10T00:15:40.091910+0000","last_became_active":"2024-06-10T00:15:38.135567+0000","last_became_peered":"2024-06-10T00:15:38.135567+0000","last_unstale":"2024-06-10T00:15:40.091910+0000","last_undegraded":"2024-06-10T00:15:40.091910+0000","last_fullsized":"2024-06-10T00:15:40.091910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:35:51.379461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092158+0000","last_change":"2024-06-10T00:15:37.134814+0000","last_active":"2024-06-10T00:15:40.092158+0000","last_peered":"2024-06-10T00:15:40.092158+0000","last_clean":"2024-06-10T00:15:40.092158+0000","last_became_active":"2024-06-10T00:15:37.134566+0000","last_became_peered":"2024-06-10T00:15:37.134566+0000","last_unstale":"2024-06-10T00:15:40.092158+0000","last_undegraded":"2024-06-10T00:15:40.092158+0000","last_fullsized":"2024-06-10T00:15:40.092158+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:51:41.705376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091952+0000","last_change":"2024-06-10T00:15:38.144401+0000","last_active":"2024-06-10T00:15:40.091952+0000","last_peered":"2024-06-10T00:15:40.091952+0000","last_clean":"2024-06-10T00:15:40.091952+0000","last_became_active":"2024-06-10T00:15:38.144155+0000","last_became_peered":"2024-06-10T00:15:38.144155+0000","last_unstale":"2024-06-10T00:15:40.091952+0000","last_undegraded":"2024-06-10T00:15:40.091952+0000","last_fullsized":"2024-06-10T00:15:40.091952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:03.277021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542957+0000","last_change":"2024-06-10T00:15:37.120841+0000","last_active":"2024-06-10T00:15:39.542957+0000","last_peered":"2024-06-10T00:15:39.542957+0000","last_clean":"2024-06-10T00:15:39.542957+0000","last_became_active":"2024-06-10T00:15:37.120553+0000","last_became_peered":"2024-06-10T00:15:37.120553+0000","last_unstale":"2024-06-10T00:15:39.542957+0000","last_undegraded":"2024-06-10T00:15:39.542957+0000","last_fullsized":"2024-06-10T00:15:39.542957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:06:03.314453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542836+0000","last_change":"2024-06-10T00:15:38.132973+0000","last_active":"2024-06-10T00:15:39.542836+0000","last_peered":"2024-06-10T00:15:39.542836+0000","last_clean":"2024-06-10T00:15:39.542836+0000","last_became_active":"2024-06-10T00:15:38.132650+0000","last_became_peered":"2024-06-10T00:15:38.132650+0000","last_unstale":"2024-06-10T00:15:39.542836+0000","last_undegraded":"2024-06-10T00:15:39.542836+0000","last_fullsized":"2024-06-10T00:15:39.542836+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:05.270164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141392+0000","last_change":"2024-06-10T00:15:37.127305+0000","last_active":"2024-06-10T00:15:39.141392+0000","last_peered":"2024-06-10T00:15:39.141392+0000","last_clean":"2024-06-10T00:15:39.141392+0000","last_became_active":"2024-06-10T00:15:37.127018+0000","last_became_peered":"2024-06-10T00:15:37.127018+0000","last_unstale":"2024-06-10T00:15:39.141392+0000","last_undegraded":"2024-06-10T00:15:39.141392+0000","last_fullsized":"2024-06-10T00:15:39.141392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:48:30.739194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141159+0000","last_change":"2024-06-10T00:15:38.130408+0000","last_active":"2024-06-10T00:15:39.141159+0000","last_peered":"2024-06-10T00:15:39.141159+0000","last_clean":"2024-06-10T00:15:39.141159+0000","last_became_active":"2024-06-10T00:15:38.130030+0000","last_became_peered":"2024-06-10T00:15:38.130030+0000","last_unstale":"2024-06-10T00:15:39.141159+0000","last_undegraded":"2024-06-10T00:15:39.141159+0000","last_fullsized":"2024-06-10T00:15:39.141159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:47:31.899953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142659+0000","last_change":"2024-06-10T00:15:37.132213+0000","last_active":"2024-06-10T00:15:39.142659+0000","last_peered":"2024-06-10T00:15:39.142659+0000","last_clean":"2024-06-10T00:15:39.142659+0000","last_became_active":"2024-06-10T00:15:37.131921+0000","last_became_peered":"2024-06-10T00:15:37.131921+0000","last_unstale":"2024-06-10T00:15:39.142659+0000","last_undegraded":"2024-06-10T00:15:39.142659+0000","last_fullsized":"2024-06-10T00:15:39.142659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:03:56.511391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142855+0000","last_change":"2024-06-10T00:15:38.128038+0000","last_active":"2024-06-10T00:15:39.142855+0000","last_peered":"2024-06-10T00:15:39.142855+0000","last_clean":"2024-06-10T00:15:39.142855+0000","last_became_active":"2024-06-10T00:15:38.127753+0000","last_became_peered":"2024-06-10T00:15:38.127753+0000","last_unstale":"2024-06-10T00:15:39.142855+0000","last_undegraded":"2024-06-10T00:15:39.142855+0000","last_fullsized":"2024-06-10T00:15:39.142855+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:51:42.710291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284060+0000","last_change":"2024-06-10T00:15:37.118774+0000","last_active":"2024-06-10T00:15:39.284060+0000","last_peered":"2024-06-10T00:15:39.284060+0000","last_clean":"2024-06-10T00:15:39.284060+0000","last_became_active":"2024-06-10T00:15:37.118508+0000","last_became_peered":"2024-06-10T00:15:37.118508+0000","last_unstale":"2024-06-10T00:15:39.284060+0000","last_undegraded":"2024-06-10T00:15:39.284060+0000","last_fullsized":"2024-06-10T00:15:39.284060+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:58:46.544843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092424+0000","last_change":"2024-06-10T00:15:38.146169+0000","last_active":"2024-06-10T00:15:40.092424+0000","last_peered":"2024-06-10T00:15:40.092424+0000","last_clean":"2024-06-10T00:15:40.092424+0000","last_became_active":"2024-06-10T00:15:38.145901+0000","last_became_peered":"2024-06-10T00:15:38.145901+0000","last_unstale":"2024-06-10T00:15:40.092424+0000","last_undegraded":"2024-06-10T00:15:40.092424+0000","last_fullsized":"2024-06-10T00:15:40.092424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:04:38.101713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142485+0000","last_change":"2024-06-10T00:15:37.126205+0000","last_active":"2024-06-10T00:15:39.142485+0000","last_peered":"2024-06-10T00:15:39.142485+0000","last_clean":"2024-06-10T00:15:39.142485+0000","last_became_active":"2024-06-10T00:15:37.125889+0000","last_became_peered":"2024-06-10T00:15:37.125889+0000","last_unstale":"2024-06-10T00:15:39.142485+0000","last_undegraded":"2024-06-10T00:15:39.142485+0000","last_fullsized":"2024-06-10T00:15:39.142485+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:14:25.000576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092330+0000","last_change":"2024-06-10T00:15:38.139641+0000","last_active":"2024-06-10T00:15:40.092330+0000","last_peered":"2024-06-10T00:15:40.092330+0000","last_clean":"2024-06-10T00:15:40.092330+0000","last_became_active":"2024-06-10T00:15:38.139387+0000","last_became_peered":"2024-06-10T00:15:38.139387+0000","last_unstale":"2024-06-10T00:15:40.092330+0000","last_undegraded":"2024-06-10T00:15:40.092330+0000","last_fullsized":"2024-06-10T00:15:40.092330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:49:56.367727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142439+0000","last_change":"2024-06-10T00:15:37.117269+0000","last_active":"2024-06-10T00:15:39.142439+0000","last_peered":"2024-06-10T00:15:39.142439+0000","last_clean":"2024-06-10T00:15:39.142439+0000","last_became_active":"2024-06-10T00:15:37.116906+0000","last_became_peered":"2024-06-10T00:15:37.116906+0000","last_unstale":"2024-06-10T00:15:39.142439+0000","last_undegraded":"2024-06-10T00:15:39.142439+0000","last_fullsized":"2024-06-10T00:15:39.142439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:30:17.836069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542507+0000","last_change":"2024-06-10T00:15:38.145722+0000","last_active":"2024-06-10T00:15:39.542507+0000","last_peered":"2024-06-10T00:15:39.542507+0000","last_clean":"2024-06-10T00:15:39.542507+0000","last_became_active":"2024-06-10T00:15:38.145417+0000","last_became_peered":"2024-06-10T00:15:38.145417+0000","last_unstale":"2024-06-10T00:15:39.542507+0000","last_undegraded":"2024-06-10T00:15:39.542507+0000","last_fullsized":"2024-06-10T00:15:39.542507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:13.377073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092376+0000","last_change":"2024-06-10T00:15:37.132124+0000","last_active":"2024-06-10T00:15:40.092376+0000","last_peered":"2024-06-10T00:15:40.092376+0000","last_clean":"2024-06-10T00:15:40.092376+0000","last_became_active":"2024-06-10T00:15:37.131848+0000","last_became_peered":"2024-06-10T00:15:37.131848+0000","last_unstale":"2024-06-10T00:15:40.092376+0000","last_undegraded":"2024-06-10T00:15:40.092376+0000","last_fullsized":"2024-06-10T00:15:40.092376+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:15:53.466109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091904+0000","last_change":"2024-06-10T00:15:38.137503+0000","last_active":"2024-06-10T00:15:40.091904+0000","last_peered":"2024-06-10T00:15:40.091904+0000","last_clean":"2024-06-10T00:15:40.091904+0000","last_became_active":"2024-06-10T00:15:38.137254+0000","last_became_peered":"2024-06-10T00:15:38.137254+0000","last_unstale":"2024-06-10T00:15:40.091904+0000","last_undegraded":"2024-06-10T00:15:40.091904+0000","last_fullsized":"2024-06-10T00:15:40.091904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:14.363732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142395+0000","last_change":"2024-06-10T00:15:37.128938+0000","last_active":"2024-06-10T00:15:39.142395+0000","last_peered":"2024-06-10T00:15:39.142395+0000","last_clean":"2024-06-10T00:15:39.142395+0000","last_became_active":"2024-06-10T00:15:37.128654+0000","last_became_peered":"2024-06-10T00:15:37.128654+0000","last_unstale":"2024-06-10T00:15:39.142395+0000","last_undegraded":"2024-06-10T00:15:39.142395+0000","last_fullsized":"2024-06-10T00:15:39.142395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:47:02.259257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284222+0000","last_change":"2024-06-10T00:15:38.134292+0000","last_active":"2024-06-10T00:15:39.284222+0000","last_peered":"2024-06-10T00:15:39.284222+0000","last_clean":"2024-06-10T00:15:39.284222+0000","last_became_active":"2024-06-10T00:15:38.134039+0000","last_became_peered":"2024-06-10T00:15:38.134039+0000","last_unstale":"2024-06-10T00:15:39.284222+0000","last_undegraded":"2024-06-10T00:15:39.284222+0000","last_fullsized":"2024-06-10T00:15:39.284222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:00:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.543071+0000","last_change":"2024-06-10T00:15:37.127979+0000","last_active":"2024-06-10T00:15:39.543071+0000","last_peered":"2024-06-10T00:15:39.543071+0000","last_clean":"2024-06-10T00:15:39.543071+0000","last_became_active":"2024-06-10T00:15:37.127728+0000","last_became_peered":"2024-06-10T00:15:37.127728+0000","last_unstale":"2024-06-10T00:15:39.543071+0000","last_undegraded":"2024-06-10T00:15:39.543071+0000","last_fullsized":"2024-06-10T00:15:39.543071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:33:14.345929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092693+0000","last_change":"2024-06-10T00:15:38.148447+0000","last_active":"2024-06-10T00:15:40.092693+0000","last_peered":"2024-06-10T00:15:40.092693+0000","last_clean":"2024-06-10T00:15:40.092693+0000","last_became_active":"2024-06-10T00:15:38.148176+0000","last_became_peered":"2024-06-10T00:15:38.148176+0000","last_unstale":"2024-06-10T00:15:40.092693+0000","last_undegraded":"2024-06-10T00:15:40.092693+0000","last_fullsized":"2024-06-10T00:15:40.092693+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:17:29.180626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.142730+0000","last_change":"2024-06-10T00:15:37.127551+0000","last_active":"2024-06-10T00:15:39.142730+0000","last_peered":"2024-06-10T00:15:39.142730+0000","last_clean":"2024-06-10T00:15:39.142730+0000","last_became_active":"2024-06-10T00:15:37.127294+0000","last_became_peered":"2024-06-10T00:15:37.127294+0000","last_unstale":"2024-06-10T00:15:39.142730+0000","last_undegraded":"2024-06-10T00:15:39.142730+0000","last_fullsized":"2024-06-10T00:15:39.142730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:28:24.027464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092032+0000","last_change":"2024-06-10T00:15:38.132635+0000","last_active":"2024-06-10T00:15:40.092032+0000","last_peered":"2024-06-10T00:15:40.092032+0000","last_clean":"2024-06-10T00:15:40.092032+0000","last_became_active":"2024-06-10T00:15:38.132363+0000","last_became_peered":"2024-06-10T00:15:38.132363+0000","last_unstale":"2024-06-10T00:15:40.092032+0000","last_undegraded":"2024-06-10T00:15:40.092032+0000","last_fullsized":"2024-06-10T00:15:40.092032+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:50:24.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092292+0000","last_change":"2024-06-10T00:15:37.128960+0000","last_active":"2024-06-10T00:15:40.092292+0000","last_peered":"2024-06-10T00:15:40.092292+0000","last_clean":"2024-06-10T00:15:40.092292+0000","last_became_active":"2024-06-10T00:15:37.128659+0000","last_became_peered":"2024-06-10T00:15:37.128659+0000","last_unstale":"2024-06-10T00:15:40.092292+0000","last_undegraded":"2024-06-10T00:15:40.092292+0000","last_fullsized":"2024-06-10T00:15:40.092292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:58:46.544843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092391+0000","last_change":"2024-06-10T00:15:38.137489+0000","last_active":"2024-06-10T00:15:40.092391+0000","last_peered":"2024-06-10T00:15:40.092391+0000","last_clean":"2024-06-10T00:15:40.092391+0000","last_became_active":"2024-06-10T00:15:38.137194+0000","last_became_peered":"2024-06-10T00:15:38.137194+0000","last_unstale":"2024-06-10T00:15:40.092391+0000","last_undegraded":"2024-06-10T00:15:40.092391+0000","last_fullsized":"2024-06-10T00:15:40.092391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:38:46.142225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092507+0000","last_change":"2024-06-10T00:15:37.130338+0000","last_active":"2024-06-10T00:15:40.092507+0000","last_peered":"2024-06-10T00:15:40.092507+0000","last_clean":"2024-06-10T00:15:40.092507+0000","last_became_active":"2024-06-10T00:15:37.129721+0000","last_became_peered":"2024-06-10T00:15:37.129721+0000","last_unstale":"2024-06-10T00:15:40.092507+0000","last_undegraded":"2024-06-10T00:15:40.092507+0000","last_fullsized":"2024-06-10T00:15:40.092507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:15:53.466109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.284077+0000","last_change":"2024-06-10T00:15:38.144364+0000","last_active":"2024-06-10T00:15:39.284077+0000","last_peered":"2024-06-10T00:15:39.284077+0000","last_clean":"2024-06-10T00:15:39.284077+0000","last_became_active":"2024-06-10T00:15:38.144124+0000","last_became_peered":"2024-06-10T00:15:38.144124+0000","last_unstale":"2024-06-10T00:15:39.284077+0000","last_undegraded":"2024-06-10T00:15:39.284077+0000","last_fullsized":"2024-06-10T00:15:39.284077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:21:35.904902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141343+0000","last_change":"2024-06-10T00:15:37.129357+0000","last_active":"2024-06-10T00:15:39.141343+0000","last_peered":"2024-06-10T00:15:39.141343+0000","last_clean":"2024-06-10T00:15:39.141343+0000","last_became_active":"2024-06-10T00:15:37.129046+0000","last_became_peered":"2024-06-10T00:15:37.129046+0000","last_unstale":"2024-06-10T00:15:39.141343+0000","last_undegraded":"2024-06-10T00:15:39.141343+0000","last_fullsized":"2024-06-10T00:15:39.141343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:53:17.104418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.141365+0000","last_change":"2024-06-10T00:15:38.130186+0000","last_active":"2024-06-10T00:15:39.141365+0000","last_peered":"2024-06-10T00:15:39.141365+0000","last_clean":"2024-06-10T00:15:39.141365+0000","last_became_active":"2024-06-10T00:15:38.129854+0000","last_became_peered":"2024-06-10T00:15:38.129854+0000","last_unstale":"2024-06-10T00:15:39.141365+0000","last_undegraded":"2024-06-10T00:15:39.141365+0000","last_fullsized":"2024-06-10T00:15:39.141365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:54:41.236240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.140820+0000","last_change":"2024-06-10T00:15:37.120615+0000","last_active":"2024-06-10T00:15:39.140820+0000","last_peered":"2024-06-10T00:15:39.140820+0000","last_clean":"2024-06-10T00:15:39.140820+0000","last_became_active":"2024-06-10T00:15:37.120361+0000","last_became_peered":"2024-06-10T00:15:37.120361+0000","last_unstale":"2024-06-10T00:15:39.140820+0000","last_undegraded":"2024-06-10T00:15:39.140820+0000","last_fullsized":"2024-06-10T00:15:39.140820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:15:53.466109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092605+0000","last_change":"2024-06-10T00:15:38.144917+0000","last_active":"2024-06-10T00:15:40.092605+0000","last_peered":"2024-06-10T00:15:40.092605+0000","last_clean":"2024-06-10T00:15:40.092605+0000","last_became_active":"2024-06-10T00:15:38.144653+0000","last_became_peered":"2024-06-10T00:15:38.144653+0000","last_unstale":"2024-06-10T00:15:40.092605+0000","last_undegraded":"2024-06-10T00:15:40.092605+0000","last_fullsized":"2024-06-10T00:15:40.092605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:26.027095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.091563+0000","last_change":"2024-06-10T00:15:37.126675+0000","last_active":"2024-06-10T00:15:40.091563+0000","last_peered":"2024-06-10T00:15:40.091563+0000","last_clean":"2024-06-10T00:15:40.091563+0000","last_became_active":"2024-06-10T00:15:37.125923+0000","last_became_peered":"2024-06-10T00:15:37.125923+0000","last_unstale":"2024-06-10T00:15:40.091563+0000","last_undegraded":"2024-06-10T00:15:40.091563+0000","last_fullsized":"2024-06-10T00:15:40.091563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:06:03.314453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:39.542957+0000","last_change":"2024-06-10T00:15:38.136089+0000","last_active":"2024-06-10T00:15:39.542957+0000","last_peered":"2024-06-10T00:15:39.542957+0000","last_clean":"2024-06-10T00:15:39.542957+0000","last_became_active":"2024-06-10T00:15:38.135082+0000","last_became_peered":"2024-06-10T00:15:38.135082+0000","last_unstale":"2024-06-10T00:15:39.542957+0000","last_undegraded":"2024-06-10T00:15:39.542957+0000","last_fullsized":"2024-06-10T00:15:39.542957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:37.106977+0000","last_clean_scrub_stamp":"2024-06-10T00:15:37.106977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:23:19.443643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092460+0000","last_change":"2024-06-10T00:15:37.133708+0000","last_active":"2024-06-10T00:15:40.092460+0000","last_peered":"2024-06-10T00:15:40.092460+0000","last_clean":"2024-06-10T00:15:40.092460+0000","last_became_active":"2024-06-10T00:15:37.133489+0000","last_became_peered":"2024-06-10T00:15:37.133489+0000","last_unstale":"2024-06-10T00:15:40.092460+0000","last_undegraded":"2024-06-10T00:15:40.092460+0000","last_fullsized":"2024-06-10T00:15:40.092460+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:15:36.102063+0000","last_clean_scrub_stamp":"2024-06-10T00:15:36.102063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:19:13.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-10T00:15:40.092498+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:15:40.092498+0000","last_peered":"2024-06-10T00:15:40.092498+0000","last_clean":"2024-06-10T00:15:40.092498+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:15:40.092498+0000","last_undegraded":"2024-06-10T00:15:40.092498+0000","last_fullsized":"2024-06-10T00:15:40.092498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":782078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":190610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":191674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":190098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":190118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":780430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:15:46.447 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:15:46.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-10T00:15:46.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.590+0000 7f9503831640 1 Processor -- start 2024-06-10T00:15:46.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.591+0000 7f9503831640 1 -- start start 2024-06-10T00:15:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.591+0000 7f9503831640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc15e1c0 0x7f94fc0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9503831640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f94fc0d11f0 0x7f94fc0d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9503831640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc0cf9a0 con 0x7f94fc0b2f60 2024-06-10T00:15:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9503831640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f94fc0cfc70 con 0x7f94fc0d11f0 2024-06-10T00:15:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9503831640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f94fc0cff50 con 0x7f94fc15e1c0 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9501dce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f94fc0d11f0 0x7f94fc0d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f95015cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc15e1c0 0x7f94fc0d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9500dcc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f94fc0b2f60 0x7f94fc0d0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52334/0 (socket says 172.21.15.79:52334) 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9501dce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f94fc0d11f0 0x7f94fc0d2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:46316/0 (socket says 172.21.15.79:46316) 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9500dcc640 1 -- 172.21.15.79:0/1380770452 learned_addr learned my addr 172.21.15.79:0/1380770452 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9501dce640 1 -- 172.21.15.79:0/1380770452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc15e1c0 msgr2=0x7f94fc0d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9501dce640 1 --2- 172.21.15.79:0/1380770452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc15e1c0 0x7f94fc0d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9501dce640 1 -- 172.21.15.79:0/1380770452 >> v1:172.21.15.117:6789/0 conn(0x7f94fc0b2f60 legacy=0x7f94fc0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.592+0000 7f9501dce640 1 -- 172.21.15.79:0/1380770452 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc0d0230 con 0x7f94fc0d11f0 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.593+0000 7f9501dce640 1 --2- 172.21.15.79:0/1380770452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc0d11f0 0x7f94fc0d2260 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009d90 tx=0x7f94f402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ce351e1ecd0e02 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.593+0000 7f94f3fff640 1 -- 172.21.15.79:0/1380770452 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4007740 con 0x7f94fc0d11f0 2024-06-10T00:15:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.593+0000 7f94f3fff640 1 -- 172.21.15.79:0/1380770452 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f40078e0 con 0x7f94fc0d11f0 2024-06-10T00:15:46.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.593+0000 7f94f3fff640 1 -- 172.21.15.79:0/1380770452 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4007cb0 con 0x7f94fc0d11f0 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.594+0000 7f9503831640 1 -- 172.21.15.79:0/1380770452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc0d11f0 msgr2=0x7f94fc0d2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.594+0000 7f9503831640 1 --2- 172.21.15.79:0/1380770452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc0d11f0 0x7f94fc0d2260 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009d90 tx=0x7f94f402a660 comp rx=0 tx=0).stop 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.594+0000 7f9503831640 1 -- 172.21.15.79:0/1380770452 shutdown_connections 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.594+0000 7f9503831640 1 --2- 172.21.15.79:0/1380770452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc0d11f0 0x7f94fc0d2260 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.594+0000 7f9503831640 1 --2- 172.21.15.79:0/1380770452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc15e1c0 0x7f94fc0d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.594+0000 7f9503831640 1 -- 172.21.15.79:0/1380770452 >> 172.21.15.79:0/1380770452 conn(0x7f94fc09d3e0 msgr2=0x7f94fc0d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.594+0000 7f9503831640 1 -- 172.21.15.79:0/1380770452 shutdown_connections 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.594+0000 7f9503831640 1 -- 172.21.15.79:0/1380770452 wait complete. 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.595+0000 7f9503831640 1 Processor -- start 2024-06-10T00:15:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.595+0000 7f9503831640 1 -- start start 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f9503831640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94fc0b2f60 0x7f94fc150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f9503831640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc0d11f0 0x7f94fc1f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f9503831640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc15e1c0 0x7f94fc14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f9503831640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc0b0cd0 con 0x7f94fc0b2f60 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f9503831640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc0d1d40 con 0x7f94fc15e1c0 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f9503831640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f94fc0b0e50 con 0x7f94fc0d11f0 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94fc0b2f60 0x7f94fc150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94fc0b2f60 0x7f94fc150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45152/0 (socket says 172.21.15.79:45152) 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 -- 172.21.15.79:0/3612855947 learned_addr learned my addr 172.21.15.79:0/3612855947 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f9501dce640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc15e1c0 0x7f94fc14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f9500dcc640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc0d11f0 0x7f94fc1f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 -- 172.21.15.79:0/3612855947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc0d11f0 msgr2=0x7f94fc1f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc0d11f0 0x7f94fc1f80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 -- 172.21.15.79:0/3612855947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc15e1c0 msgr2=0x7f94fc14d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc15e1c0 0x7f94fc14d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 -- 172.21.15.79:0/3612855947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc15fc60 con 0x7f94fc0b2f60 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.596+0000 7f95015cd640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94fc0b2f60 0x7f94fc150390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f94f800e870 tx=0x7f94f800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.597+0000 7f94f1ffb640 1 -- 172.21.15.79:0/3612855947 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8017070 con 0x7f94fc0b2f60 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.597+0000 7f94f1ffb640 1 -- 172.21.15.79:0/3612855947 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f800c940 con 0x7f94fc0b2f60 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.597+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94fc150970 con 0x7f94fc0b2f60 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.597+0000 7f94f1ffb640 1 -- 172.21.15.79:0/3612855947 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f800cd30 con 0x7f94fc0b2f60 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.597+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94fc150f30 con 0x7f94fc0b2f60 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.598+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94fc0683c0 con 0x7f94fc0b2f60 2024-06-10T00:15:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.598+0000 7f94f1ffb640 1 -- 172.21.15.79:0/3612855947 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94f801a070 con 0x7f94fc0b2f60 2024-06-10T00:15:46.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.599+0000 7f94f1ffb640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f94e006be60 0x7f94e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.599+0000 7f94f1ffb640 1 -- 172.21.15.79:0/3612855947 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f94f808adf0 con 0x7f94fc0b2f60 2024-06-10T00:15:46.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.599+0000 7f9500dcc640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f94e006be60 0x7f94e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.599+0000 7f9500dcc640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f94e006be60 0x7f94e006e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f94fc1f7610 tx=0x7f94ec007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.603+0000 7f94f1ffb640 1 -- 172.21.15.79:0/3612855947 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f94f8058fc0 con 0x7f94fc0b2f60 2024-06-10T00:15:46.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.841+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f94fc15dc70 con 0x7f94fc0b2f60 2024-06-10T00:15:46.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.844+0000 7f94f1ffb640 1 -- 172.21.15.79:0/3612855947 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f94f805d2c0 con 0x7f94fc0b2f60 2024-06-10T00:15:46.843 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-06-10T00:15:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:15:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-06-10T00:15:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-06-10T00:15:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-10T00:15:46.844 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-06-10T00:15:46.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f94e006be60 msgr2=0x7f94e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f94e006be60 0x7f94e006e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f94fc1f7610 tx=0x7f94ec007e80 comp rx=0 tx=0).stop 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94fc0b2f60 msgr2=0x7f94fc150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94fc0b2f60 0x7f94fc150390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f94f800e870 tx=0x7f94f800ed30 comp rx=0 tx=0).stop 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 shutdown_connections 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f94e006be60 0x7f94e006e320 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94fc15e1c0 0x7f94fc14d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94fc0d11f0 0x7f94fc1f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 --2- 172.21.15.79:0/3612855947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94fc0b2f60 0x7f94fc150390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 >> 172.21.15.79:0/3612855947 conn(0x7f94fc09d3e0 msgr2=0x7f94fc06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 shutdown_connections 2024-06-10T00:15:46.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.846+0000 7f9503831640 1 -- 172.21.15.79:0/3612855947 wait complete. 2024-06-10T00:15:46.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:46.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.956+0000 7f42ce86b640 1 Processor -- start 2024-06-10T00:15:46.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.956+0000 7f42ce86b640 1 -- start start 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42ce86b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c8071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42ce86b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42c80721a0 0x7f42c8165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42ce86b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c8072820 con 0x7f42c80cc6d0 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42ce86b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f42c8072b00 con 0x7f42c80721a0 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42ce86b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f42c8072de0 con 0x7f42c80b46d0 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42c7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42c80cc6d0 0x7f42c80ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44952/0 (socket says 172.21.15.79:44952) 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42c7fff640 1 -- 172.21.15.79:0/4146050 learned_addr learned my addr 172.21.15.79:0/4146050 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42cce08640 1 --2- 172.21.15.79:0/4146050 >> v2:172.21.15.117:3300/0 conn(0x7f42c80721a0 0x7f42c8165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42c77fe640 1 --2- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c8071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.957+0000 7f42c6ffd640 1 -- 172.21.15.79:0/4146050 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014452111 0 0) 0x7f42c8072820 con 0x7f42c80cc6d0 2024-06-10T00:15:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.958+0000 7f42c6ffd640 1 -- 172.21.15.79:0/4146050 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b0003520 con 0x7f42c80cc6d0 2024-06-10T00:15:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.958+0000 7f42cce08640 1 -- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 msgr2=0x7f42c8071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.958+0000 7f42cce08640 1 --2- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c8071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.958+0000 7f42c6ffd640 1 -- 172.21.15.79:0/4146050 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2857238462 0 0) 0x7f42b0003520 con 0x7f42c80cc6d0 2024-06-10T00:15:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.958+0000 7f42cce08640 1 -- 172.21.15.79:0/4146050 >> v1:172.21.15.79:6789/0 conn(0x7f42c80cc6d0 legacy=0x7f42c80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.958+0000 7f42cce08640 1 -- 172.21.15.79:0/4146050 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c80b31a0 con 0x7f42c80721a0 2024-06-10T00:15:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.958+0000 7f42c77fe640 1 --2- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c8071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:15:46.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42cce08640 1 --2- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 0x7f42c8165c30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009d90 tx=0x7f42c002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f88ea8a2dc39f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42c6ffd640 1 -- 172.21.15.79:0/4146050 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8001670 con 0x7f42c80721a0 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42c6ffd640 1 -- 172.21.15.79:0/4146050 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c0007540 con 0x7f42c80721a0 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42c6ffd640 1 -- 172.21.15.79:0/4146050 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00078f0 con 0x7f42c80721a0 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42ce86b640 1 -- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 msgr2=0x7f42c8165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 0x7f42c8165c30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009d90 tx=0x7f42c002a5f0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42ce86b640 1 -- 172.21.15.79:0/4146050 shutdown_connections 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 0x7f42c8165c30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4146050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c8071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42ce86b640 1 -- 172.21.15.79:0/4146050 >> 172.21.15.79:0/4146050 conn(0x7f42c80b19f0 msgr2=0x7f42c80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42ce86b640 1 -- 172.21.15.79:0/4146050 shutdown_connections 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.959+0000 7f42ce86b640 1 -- 172.21.15.79:0/4146050 wait complete. 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.961+0000 7f42ce86b640 1 Processor -- start 2024-06-10T00:15:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.961+0000 7f42ce86b640 1 -- start start 2024-06-10T00:15:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.961+0000 7f42ce86b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 0x7f42c814b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.961+0000 7f42ce86b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.961+0000 7f42ce86b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c80cc6d0 0x7f42c8155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.961+0000 7f42ce86b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42c8166170 con 0x7f42c80cc6d0 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.961+0000 7f42ce86b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f42c8159f60 con 0x7f42c80721a0 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.961+0000 7f42ce86b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f42c81662f0 con 0x7f42c80b46d0 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c80cc6d0 0x7f42c8155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c80cc6d0 0x7f42c8155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45158/0 (socket says 172.21.15.79:45158) 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 -- 172.21.15.79:0/4010666677 learned_addr learned my addr 172.21.15.79:0/4010666677 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42c7fff640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 0x7f42c814b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42c77fe640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 -- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 msgr2=0x7f42c814f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c814f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 -- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 msgr2=0x7f42c814b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 0x7f42c814b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 -- 172.21.15.79:0/4010666677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c8157af0 con 0x7f42c80cc6d0 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42c77fe640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c814f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42c7fff640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 0x7f42c814b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42cce08640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c80cc6d0 0x7f42c8155070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009eb0 tx=0x7f42c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42c4ff9640 1 -- 172.21.15.79:0/4010666677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0009450 con 0x7f42c80cc6d0 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42c4ff9640 1 -- 172.21.15.79:0/4010666677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c0004240 con 0x7f42c80cc6d0 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42c4ff9640 1 -- 172.21.15.79:0/4010666677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00045f0 con 0x7f42c80cc6d0 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c8157dd0 con 0x7f42c80cc6d0 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.962+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c8158390 con 0x7f42c80cc6d0 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.963+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c8068430 con 0x7f42c80cc6d0 2024-06-10T00:15:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.964+0000 7f42c4ff9640 1 -- 172.21.15.79:0/4010666677 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42c003b410 con 0x7f42c80cc6d0 2024-06-10T00:15:46.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.964+0000 7f42c4ff9640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42b406be60 0x7f42b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:46.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.964+0000 7f42c4ff9640 1 -- 172.21.15.79:0/4010666677 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f42c00ac240 con 0x7f42c80cc6d0 2024-06-10T00:15:46.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.964+0000 7f42c7fff640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42b406be60 0x7f42b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:46.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.965+0000 7f42c7fff640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42b406be60 0x7f42b406e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42b8005880 tx=0x7f42b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:46.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:46.969+0000 7f42c4ff9640 1 -- 172.21.15.79:0/4010666677 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f42c003f030 con 0x7f42c80cc6d0 2024-06-10T00:15:47.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.183+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42c8075430 con 0x7f42c80cc6d0 2024-06-10T00:15:47.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.183+0000 7f42c4ff9640 1 -- 172.21.15.79:0/4010666677 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7f42c007aa60 con 0x7f42c80cc6d0 2024-06-10T00:15:47.183 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:47.183 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:15:37.465229+0000","modified":"2024-06-10T00:15:40.130979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3860098569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3860098569},{"type":"v1","addr":"172.21.15.79:6837","nonce":3860098569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4968,"qdb_cluster":[4968]},"id":2}]} 2024-06-10T00:15:47.183 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.185+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42b406be60 msgr2=0x7f42b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.185+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42b406be60 0x7f42b406e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42b8005880 tx=0x7f42b8009040 comp rx=0 tx=0).stop 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c80cc6d0 msgr2=0x7f42c8155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c80cc6d0 0x7f42c8155070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009eb0 tx=0x7f42c0004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 shutdown_connections 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42b406be60 0x7f42b406e320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c80cc6d0 0x7f42c8155070 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42c80b46d0 0x7f42c814f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 --2- 172.21.15.79:0/4010666677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42c80721a0 0x7f42c814b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 >> 172.21.15.79:0/4010666677 conn(0x7f42c80b19f0 msgr2=0x7f42c815da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:47.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 shutdown_connections 2024-06-10T00:15:47.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.186+0000 7f42ce86b640 1 -- 172.21.15.79:0/4010666677 wait complete. 2024-06-10T00:15:47.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:15:37.465229+0000', 'modified': '2024-06-10T00:15:40.130979+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4968}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4968': {'gid': 4968, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/3860098569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 3860098569}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 3860098569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4968, 'qdb_cluster': [4968]} 2024-06-10T00:15:47.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:15:47.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:15:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.700+0000 7f61ccd22640 1 Processor -- start 2024-06-10T00:15:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.700+0000 7f61ccd22640 1 -- start start 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.701+0000 7f61ccd22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c806e050 0x7f61c80cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.701+0000 7f61ccd22640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61c809aa10 0x7f61c809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.701+0000 7f61ccd22640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61c80cd360 0x7f61c80cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.701+0000 7f61ccd22640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f61c80d1d30 con 0x7f61c80cd360 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.701+0000 7f61ccd22640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f61c809b390 con 0x7f61c809aa10 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.701+0000 7f61ccd22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f61c80d12d0 con 0x7f61c806e050 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61c80cd360 0x7f61c80cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61c80cd360 0x7f61c80cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45166/0 (socket says 172.21.15.79:45166) 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 -- 172.21.15.79:0/2965428590 learned_addr learned my addr 172.21.15.79:0/2965428590 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c659c640 1 --2- 172.21.15.79:0/2965428590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c806e050 0x7f61c80cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/2965428590 >> v2:172.21.15.117:3300/0 conn(0x7f61c809aa10 0x7f61c809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 -- 172.21.15.79:0/2965428590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c806e050 msgr2=0x7f61c80cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/2965428590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c806e050 0x7f61c80cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 -- 172.21.15.79:0/2965428590 >> v2:172.21.15.117:3300/0 conn(0x7f61c809aa10 msgr2=0x7f61c809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/2965428590 >> v2:172.21.15.117:3300/0 conn(0x7f61c809aa10 0x7f61c809ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 -- 172.21.15.79:0/2965428590 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c80cc5a0 con 0x7f61c80cd360 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/2965428590 >> v2:172.21.15.117:3300/0 conn(0x7f61c809aa10 0x7f61c809ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.702+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/2965428590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80cd7f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61c8072930 tx=0x7f61c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25de57da393a9d28 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61c559a640 1 -- 172.21.15.79:0/2965428590 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0037070 con 0x7f61c80cd360 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61c559a640 1 -- 172.21.15.79:0/2965428590 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c0032440 con 0x7f61c80cd360 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61c559a640 1 -- 172.21.15.79:0/2965428590 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0032810 con 0x7f61c80cd360 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 -- 172.21.15.79:0/2965428590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 msgr2=0x7f61c80cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 --2- 172.21.15.79:0/2965428590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80cd7f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61c8072930 tx=0x7f61c002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 -- 172.21.15.79:0/2965428590 shutdown_connections 2024-06-10T00:15:47.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 --2- 172.21.15.79:0/2965428590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80cd7f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 --2- 172.21.15.79:0/2965428590 >> v2:172.21.15.117:3300/0 conn(0x7f61c809aa10 0x7f61c809ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 --2- 172.21.15.79:0/2965428590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c806e050 0x7f61c80cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 -- 172.21.15.79:0/2965428590 >> 172.21.15.79:0/2965428590 conn(0x7f61c80d1eb0 msgr2=0x7f61c80d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:47.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 -- 172.21.15.79:0/2965428590 shutdown_connections 2024-06-10T00:15:47.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.703+0000 7f61ccd22640 1 -- 172.21.15.79:0/2965428590 wait complete. 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.705+0000 7f61ccd22640 1 Processor -- start 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.705+0000 7f61ccd22640 1 -- start start 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.705+0000 7f61ccd22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61c806e050 0x7f61c81d61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.705+0000 7f61ccd22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c809aa10 0x7f61c80cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.705+0000 7f61ccd22640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.705+0000 7f61ccd22640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80cce40 con 0x7f61c80cd360 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.705+0000 7f61ccd22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80ccb60 con 0x7f61c806e050 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.705+0000 7f61ccd22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f61c806e430 con 0x7f61c809aa10 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45182/0 (socket says 172.21.15.79:45182) 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 -- 172.21.15.79:0/1320355793 learned_addr learned my addr 172.21.15.79:0/1320355793 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c809aa10 0x7f61c80cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c659c640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61c806e050 0x7f61c81d61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 -- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c809aa10 msgr2=0x7f61c80cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c809aa10 0x7f61c80cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 -- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61c806e050 msgr2=0x7f61c81d61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61c806e050 0x7f61c81d61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 -- 172.21.15.79:0/1320355793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c80ca730 con 0x7f61c80cd360 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c659c640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61c806e050 0x7f61c81d61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80ca1f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f61c00090b0 tx=0x7f61c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61b6ffd640 1 -- 172.21.15.79:0/1320355793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0041020 con 0x7f61c80cd360 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61b6ffd640 1 -- 172.21.15.79:0/1320355793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c0030640 con 0x7f61c80cd360 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61ccd22640 1 -- 172.21.15.79:0/1320355793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c80ca9d0 con 0x7f61c80cd360 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61b6ffd640 1 -- 172.21.15.79:0/1320355793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0037040 con 0x7f61c80cd360 2024-06-10T00:15:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.706+0000 7f61ccd22640 1 -- 172.21.15.79:0/1320355793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c80caf90 con 0x7f61c80cd360 2024-06-10T00:15:47.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.708+0000 7f61b6ffd640 1 -- 172.21.15.79:0/1320355793 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61c0044020 con 0x7f61c80cd360 2024-06-10T00:15:47.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.708+0000 7f61b6ffd640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f61a806be30 0x7f61a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.708+0000 7f61b6ffd640 1 -- 172.21.15.79:0/1320355793 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f61c00ab740 con 0x7f61c80cd360 2024-06-10T00:15:47.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.708+0000 7f61c659c640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f61a806be30 0x7f61a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.709+0000 7f61c659c640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f61a806be30 0x7f61a806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f61b8007440 tx=0x7f61b800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.709+0000 7f61cfa34740 1 Processor -- start 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.709+0000 7f61cfa34740 1 -- start start 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b59d00 0x558837b5c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b5ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b2c960 0x558837b30170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61cfa34740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558837a95740 con 0x558837b5a0e0 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61cfa34740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558837a33a80 con 0x558837b59d00 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61cfa34740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558837a91700 con 0x558837b2c960 2024-06-10T00:15:47.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b5ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b5ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45186/0 (socket says 172.21.15.79:45186) 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c5d9b640 1 -- 172.21.15.79:0/2022389626 learned_addr learned my addr 172.21.15.79:0/2022389626 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c659c640 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b59d00 0x558837b5c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b2c960 0x558837b30170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c5d9b640 1 -- 172.21.15.79:0/2022389626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b2c960 msgr2=0x558837b30170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b2c960 0x558837b30170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c5d9b640 1 -- 172.21.15.79:0/2022389626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b59d00 msgr2=0x558837b5c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b59d00 0x558837b5c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.710+0000 7f61c5d9b640 1 -- 172.21.15.79:0/2022389626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558837a5efb0 con 0x558837b5a0e0 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b5ca50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009850 tx=0x7f61bc009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a6d980d9893fb8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61a7fff640 1 -- 172.21.15.79:0/2022389626 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc017020 con 0x558837b5a0e0 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61a7fff640 1 -- 172.21.15.79:0/2022389626 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc00e8f0 con 0x558837b5a0e0 2024-06-10T00:15:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61a7fff640 1 -- 172.21.15.79:0/2022389626 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00f040 con 0x558837b5a0e0 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61cfa34740 1 -- 172.21.15.79:0/2022389626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 msgr2=0x558837b5ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61cfa34740 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b5ca50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009850 tx=0x7f61bc009d10 comp rx=0 tx=0).stop 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61cfa34740 1 -- 172.21.15.79:0/2022389626 shutdown_connections 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61cfa34740 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b2c960 0x558837b30170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61cfa34740 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b5ca50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61cfa34740 1 --2- 172.21.15.79:0/2022389626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b59d00 0x558837b5c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.711+0000 7f61cfa34740 1 -- 172.21.15.79:0/2022389626 >> 172.21.15.79:0/2022389626 conn(0x558837b2ebd0 msgr2=0x558837b77510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.712+0000 7f61cfa34740 1 -- 172.21.15.79:0/2022389626 shutdown_connections 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.712+0000 7f61cfa34740 1 -- 172.21.15.79:0/2022389626 wait complete. 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.712+0000 7f61cfa34740 1 -- start start 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.712+0000 7f61cfa34740 1 Processor -- start 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837b50fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b71b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b72080 0x558837b72500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61cfa34740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558837b31d80 con 0x558837b5a0e0 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61cfa34740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558837a1ec30 con 0x558837b72080 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61cfa34740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558837b32060 con 0x558837b59d00 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61cfa34740 10 client.0 _ll_register_callbacks cb 0x558837a507f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b71b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b71b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45194/0 (socket says 172.21.15.79:45194) 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c5d9b640 1 -- 172.21.15.79:0/3534681212 learned_addr learned my addr 172.21.15.79:0/3534681212 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c659c640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837b50fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b72080 0x558837b72500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c5d9b640 1 -- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 msgr2=0x558837b50fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837b50fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c5d9b640 1 -- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b72080 msgr2=0x558837b72500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b72080 0x558837b72500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c5d9b640 1 -- 172.21.15.79:0/3534681212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588377a92d0 con 0x558837b5a0e0 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b72080 0x558837b72500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.713+0000 7f61c659c640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837b50fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b71b40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f61bc006d10 tx=0x7f61bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72e8469c1374dbb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61a57fa640 1 -- 172.21.15.79:0/3534681212 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc017070 con 0x558837b5a0e0 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61a57fa640 1 -- 172.21.15.79:0/3534681212 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f61bc006a20 con 0x558837b5a0e0 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 1 -- 172.21.15.79:0/3534681212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61bc00e8f0 con 0x558837b5a0e0 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61a57fa640 1 -- 172.21.15.79:0/3534681212 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f61bc009490 con 0x558837b5a0e0 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 10 client.5160 fetch_fsmap learned FSMap version 16 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 1 -- 172.21.15.79:0/3534681212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5588378736b0 con 0x558837b5a0e0 2024-06-10T00:15:47.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61a57fa640 1 -- 172.21.15.79:0/3534681212 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc00e8f0 con 0x558837b5a0e0 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61a57fa640 1 -- 172.21.15.79:0/3534681212 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f61bc02d050 con 0x558837b5a0e0 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 10 client.5160 fetch_fsmap finished waiting for FSMap version 16 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 10 client.5160 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 20 client.5160 populate_metadata read hostname 'smithi079' 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] conn(0x558837b5ed90 0x558837b5f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 4 client.5160 mds_command: new command op to 4968 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61cfa34740 1 -- 172.21.15.79:0/3534681212 --> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558837aa2e70 con 0x558837b5ed90 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.714+0000 7f61c659c640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] conn(0x558837b5ed90 0x558837b5f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61a57fa640 10 client.5160 ms_handle_connect on v2:172.21.15.79:6835/3860098569 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61c659c640 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] conn(0x558837b5ed90 0x558837b5f170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2a60fe49e2549fd server_cookie=b8620182f31d4330 in_seq=0 out_seq=0 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61a57fa640 1 -- 172.21.15.79:0/3534681212 <== mds.0 v2:172.21.15.79:6835/3860098569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558837aa2e70 con 0x558837b5ed90 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61a57fa640 10 client.5160 handle_command_reply: tid=0 2024-06-10T00:15:47.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61cfa34740 1 client.5160 shutdown 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61cfa34740 1 -- 172.21.15.79:0/3534681212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 msgr2=0x558837b71b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b71b40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f61bc006d10 tx=0x7f61bc004730 comp rx=0 tx=0).stop 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61cfa34740 1 -- 172.21.15.79:0/3534681212 shutdown_connections 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] conn(0x558837b5ed90 0x558837b5f170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b72080 0x558837b72500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b5a0e0 0x558837b71b40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61a57fa640 0 client.5160 ms_handle_reset on v2:172.21.15.79:6835/3860098569 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.715+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3534681212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837b50fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.716+0000 7f61cfa34740 1 -- 172.21.15.79:0/3534681212 >> 172.21.15.79:0/3534681212 conn(0x558837b2c960 msgr2=0x558837b59190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.716+0000 7f61cfa34740 1 -- 172.21.15.79:0/3534681212 shutdown_connections 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.716+0000 7f61cfa34740 1 -- 172.21.15.79:0/3534681212 wait complete. 2024-06-10T00:15:47.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.716+0000 7f61cfa34740 20 client.5160 trim_cache size 0 max 16384 2024-06-10T00:15:47.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.734+0000 7f61cfa34740 1 Processor -- start 2024-06-10T00:15:47.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.734+0000 7f61cfa34740 1 -- start start 2024-06-10T00:15:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837b73c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 0x558837b7ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b7b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61cfa34740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61c8200eb0 con 0x558837b72080 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61cfa34740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61c81ffef0 con 0x558837b5a0e0 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61cfa34740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f61c80c9be0 con 0x558837b59d00 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b7b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b7b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45200/0 (socket says 172.21.15.79:45200) 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 -- 172.21.15.79:0/3304504687 learned_addr learned my addr 172.21.15.79:0/3304504687 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 -- 172.21.15.79:0/3304504687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 msgr2=0x558837b73c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/3304504687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837b73c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 -- 172.21.15.79:0/3304504687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 msgr2=0x558837b7ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/3304504687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 0x558837b7ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 -- 172.21.15.79:0/3304504687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558837b2c510 con 0x558837b72080 2024-06-10T00:15:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/3304504687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b7b1b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f61c0035040 tx=0x7f61c00ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4685ff03743bd073 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61a77fe640 1 -- 172.21.15.79:0/3304504687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0079860 con 0x558837b72080 2024-06-10T00:15:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61a77fe640 1 -- 172.21.15.79:0/3304504687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c007dc10 con 0x558837b72080 2024-06-10T00:15:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.735+0000 7f61a77fe640 1 -- 172.21.15.79:0/3304504687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0082440 con 0x558837b72080 2024-06-10T00:15:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 -- 172.21.15.79:0/3304504687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 msgr2=0x558837b7b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3304504687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b7b1b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f61c0035040 tx=0x7f61c00ab040 comp rx=0 tx=0).stop 2024-06-10T00:15:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 -- 172.21.15.79:0/3304504687 shutdown_connections 2024-06-10T00:15:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3304504687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b7b1b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3304504687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 0x558837b7ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 --2- 172.21.15.79:0/3304504687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837b73c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 -- 172.21.15.79:0/3304504687 >> 172.21.15.79:0/3304504687 conn(0x558837b2c960 msgr2=0x558837b50dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 -- 172.21.15.79:0/3304504687 shutdown_connections 2024-06-10T00:15:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 -- 172.21.15.79:0/3304504687 wait complete. 2024-06-10T00:15:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 -- start start 2024-06-10T00:15:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.736+0000 7f61cfa34740 1 Processor -- start 2024-06-10T00:15:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837bf36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 0x558837bf6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61cfa34740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b73c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61cfa34740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558837b78b90 con 0x558837b72080 2024-06-10T00:15:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61cfa34740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61c81ff8a0 con 0x558837b5a0e0 2024-06-10T00:15:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61cfa34740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558837b514f0 con 0x558837b59d00 2024-06-10T00:15:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61cfa34740 10 client.0 _ll_register_callbacks cb 0x7f61bc00ee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:15:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61c6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b73c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61c6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b73c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45214/0 (socket says 172.21.15.79:45214) 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.737+0000 7f61c6d9d640 1 -- 172.21.15.79:0/1440510247 learned_addr learned my addr 172.21.15.79:0/1440510247 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c5d9b640 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 0x558837bf6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c659c640 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837bf36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c6d9d640 1 -- 172.21.15.79:0/1440510247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 msgr2=0x558837bf36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837bf36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c6d9d640 1 -- 172.21.15.79:0/1440510247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 msgr2=0x558837bf6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 0x558837bf6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c6d9d640 1 -- 172.21.15.79:0/1440510247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558837b77b10 con 0x558837b72080 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c6d9d640 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b73c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61c00a9b30 tx=0x7f61c0032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176c01e70a321b73 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61a57fa640 1 -- 172.21.15.79:0/1440510247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0096070 con 0x558837b72080 2024-06-10T00:15:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61a57fa640 1 -- 172.21.15.79:0/1440510247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f61c0075ed0 con 0x558837b72080 2024-06-10T00:15:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 1 -- 172.21.15.79:0/1440510247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c007dc10 con 0x558837b72080 2024-06-10T00:15:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61a57fa640 1 -- 172.21.15.79:0/1440510247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f61c00a0050 con 0x558837b72080 2024-06-10T00:15:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 10 client.5166 fetch_fsmap learned FSMap version 16 2024-06-10T00:15:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 1 -- 172.21.15.79:0/1440510247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x558837b77800 con 0x558837b72080 2024-06-10T00:15:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61a57fa640 1 -- 172.21.15.79:0/1440510247 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c007dc10 con 0x558837b72080 2024-06-10T00:15:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61a57fa640 1 -- 172.21.15.79:0/1440510247 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f61c00a3020 con 0x558837b72080 2024-06-10T00:15:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 10 client.5166 fetch_fsmap finished waiting for FSMap version 16 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 10 client.5166 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 20 client.5166 populate_metadata read hostname 'smithi079' 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] conn(0x558837bfa170 0x558837b89e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 4 client.5166 mds_command: new command op to 4968 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61cfa34740 1 -- 172.21.15.79:0/1440510247 --> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] -- command(tid 0: {"prefix": "status"}) -- 0x558837a9d1c0 con 0x558837bfa170 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.738+0000 7f61c659c640 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] conn(0x558837bfa170 0x558837b89e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61a57fa640 10 client.5166 ms_handle_connect on v2:172.21.15.79:6835/3860098569 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61c659c640 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] conn(0x558837bfa170 0x558837b89e80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a6163b3762d0fb1 server_cookie=66ed15ac92a13b2f in_seq=0 out_seq=0 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61a57fa640 1 -- 172.21.15.79:0/1440510247 <== mds.0 v2:172.21.15.79:6835/3860098569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558837a9d1c0 con 0x558837bfa170 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61a57fa640 10 client.5166 handle_command_reply: tid=0 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 client.5166 shutdown 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 -- 172.21.15.79:0/1440510247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 msgr2=0x558837b73c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b73c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61c00a9b30 tx=0x7f61c0032f90 comp rx=0 tx=0).stop 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 -- 172.21.15.79:0/1440510247 shutdown_connections 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.79:6835/3860098569,v1:172.21.15.79:6837/3860098569] conn(0x558837bfa170 0x558837b89e80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558837b72080 0x558837b73c40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558837b5a0e0 0x558837bf6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61a57fa640 0 client.5166 ms_handle_reset on v2:172.21.15.79:6835/3860098569 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 --2- 172.21.15.79:0/1440510247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558837b59d00 0x558837bf36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 -- 172.21.15.79:0/1440510247 >> 172.21.15.79:0/1440510247 conn(0x558837b2c960 msgr2=0x558837b7af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 -- 172.21.15.79:0/1440510247 shutdown_connections 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 1 -- 172.21.15.79:0/1440510247 wait complete. 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.739+0000 7f61cfa34740 20 client.5166 trim_cache size 0 max 16384 2024-06-10T00:15:47.747 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4968, 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 9.6109438790000006, 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 16, 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 38, 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 38, 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 16.511799379999999 2024-06-10T00:15:47.748 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:15:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 -- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f61a806be30 msgr2=0x7f61a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f61a806be30 0x7f61a806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f61b8007440 tx=0x7f61b800b040 comp rx=0 tx=0).stop 2024-06-10T00:15:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 -- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 msgr2=0x7f61c80ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80ca1f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f61c00090b0 tx=0x7f61c00046c0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 -- 172.21.15.79:0/1320355793 shutdown_connections 2024-06-10T00:15:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f61a806be30 0x7f61a806e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c80cd360 0x7f61c80ca1f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61c809aa10 0x7f61c80cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 --2- 172.21.15.79:0/1320355793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61c806e050 0x7f61c81d61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 -- 172.21.15.79:0/1320355793 >> 172.21.15.79:0/1320355793 conn(0x7f61c80d1eb0 msgr2=0x7f61c80b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 -- 172.21.15.79:0/1320355793 shutdown_connections 2024-06-10T00:15:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.740+0000 7f61ccd22640 1 -- 172.21.15.79:0/1320355793 wait complete. 2024-06-10T00:15:47.751 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:15:47.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.850+0000 7efd2c361640 1 Processor -- start 2024-06-10T00:15:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.850+0000 7efd2c361640 1 -- start start 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2c361640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd241553c0 0x7efd240cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2c361640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efd240cec50 0x7efd240cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2c361640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd240b31a0 con 0x7efd240b2cf0 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2c361640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efd240b3420 con 0x7efd241553c0 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2c361640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efd240cc750 con 0x7efd240cec50 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2a0fd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd241553c0 0x7efd240cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2a0fd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd241553c0 0x7efd240cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45228/0 (socket says 172.21.15.79:45228) 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2a0fd640 1 -- 172.21.15.79:0/2104731398 learned_addr learned my addr 172.21.15.79:0/2104731398 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2a8fe640 1 --2- 172.21.15.79:0/2104731398 >> v2:172.21.15.117:3300/0 conn(0x7efd240cec50 0x7efd240cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2a0fd640 1 -- 172.21.15.79:0/2104731398 >> v2:172.21.15.117:3300/0 conn(0x7efd240cec50 msgr2=0x7efd240cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2a0fd640 1 --2- 172.21.15.79:0/2104731398 >> v2:172.21.15.117:3300/0 conn(0x7efd240cec50 0x7efd240cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2a0fd640 1 -- 172.21.15.79:0/2104731398 >> v1:172.21.15.117:6789/0 conn(0x7efd240b2cf0 legacy=0x7efd2415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.851+0000 7efd2a0fd640 1 -- 172.21.15.79:0/2104731398 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd240cca30 con 0x7efd241553c0 2024-06-10T00:15:47.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.852+0000 7efd2a0fd640 1 --2- 172.21.15.79:0/2104731398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd240cd230 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efd14009870 tx=0x7efd1402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79729e4a4223a5db server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.852+0000 7efd290fb640 1 -- 172.21.15.79:0/2104731398 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14037070 con 0x7efd241553c0 2024-06-10T00:15:47.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.852+0000 7efd290fb640 1 -- 172.21.15.79:0/2104731398 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd14032440 con 0x7efd241553c0 2024-06-10T00:15:47.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.852+0000 7efd290fb640 1 -- 172.21.15.79:0/2104731398 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14032810 con 0x7efd241553c0 2024-06-10T00:15:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.853+0000 7efd2c361640 1 -- 172.21.15.79:0/2104731398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 msgr2=0x7efd240cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.853+0000 7efd2c361640 1 --2- 172.21.15.79:0/2104731398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd240cd230 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efd14009870 tx=0x7efd1402a2a0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.853+0000 7efd2c361640 1 -- 172.21.15.79:0/2104731398 shutdown_connections 2024-06-10T00:15:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.853+0000 7efd2c361640 1 --2- 172.21.15.79:0/2104731398 >> v2:172.21.15.117:3300/0 conn(0x7efd240cec50 0x7efd240cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.853+0000 7efd2c361640 1 --2- 172.21.15.79:0/2104731398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd240cd230 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.853+0000 7efd2c361640 1 -- 172.21.15.79:0/2104731398 >> 172.21.15.79:0/2104731398 conn(0x7efd240b19f0 msgr2=0x7efd240b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.853+0000 7efd2c361640 1 -- 172.21.15.79:0/2104731398 shutdown_connections 2024-06-10T00:15:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.853+0000 7efd2c361640 1 -- 172.21.15.79:0/2104731398 wait complete. 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.854+0000 7efd2c361640 1 Processor -- start 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.854+0000 7efd2c361640 1 -- start start 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2c361640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd240b2cf0 0x7efd240af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2c361640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd240cec50 0x7efd2415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2c361640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd241503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2c361640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd241557a0 con 0x7efd241553c0 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2c361640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efd240b3700 con 0x7efd240b2cf0 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2c361640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efd24155920 con 0x7efd240cec50 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd241503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd241503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45232/0 (socket says 172.21.15.79:45232) 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 -- 172.21.15.79:0/1306920055 learned_addr learned my addr 172.21.15.79:0/1306920055 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a0fd640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd240b2cf0 0x7efd240af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd298fc640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd240cec50 0x7efd2415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 -- 172.21.15.79:0/1306920055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd240cec50 msgr2=0x7efd2415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd240cec50 0x7efd2415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 -- 172.21.15.79:0/1306920055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd240b2cf0 msgr2=0x7efd240af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd240b2cf0 0x7efd240af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 -- 172.21.15.79:0/1306920055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd240affb0 con 0x7efd241553c0 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2a8fe640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd241503a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efd1c007e40 tx=0x7efd1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd1affd640 1 -- 172.21.15.79:0/1306920055 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c014620 con 0x7efd241553c0 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd1affd640 1 -- 172.21.15.79:0/1306920055 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c019070 con 0x7efd241553c0 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd240b0290 con 0x7efd241553c0 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd1affd640 1 -- 172.21.15.79:0/1306920055 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c014a20 con 0x7efd241553c0 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.855+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd240b0b30 con 0x7efd241553c0 2024-06-10T00:15:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.856+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd24068430 con 0x7efd241553c0 2024-06-10T00:15:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.857+0000 7efd1affd640 1 -- 172.21.15.79:0/1306920055 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd1c014bc0 con 0x7efd241553c0 2024-06-10T00:15:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.857+0000 7efd1affd640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efd0806be30 0x7efd0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.857+0000 7efd1affd640 1 -- 172.21.15.79:0/1306920055 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7efd1c08b890 con 0x7efd241553c0 2024-06-10T00:15:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.857+0000 7efd2a0fd640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efd0806be30 0x7efd0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.858+0000 7efd2a0fd640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efd0806be30 0x7efd0806e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd14034000 tx=0x7efd1402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:47.862+0000 7efd1affd640 1 -- 172.21.15.79:0/1306920055 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd1c05a0c0 con 0x7efd241553c0 2024-06-10T00:15:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.072+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efd24071560 con 0x7efd241553c0 2024-06-10T00:15:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.072+0000 7efd1affd640 1 -- 172.21.15.79:0/1306920055 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7efd1c0599c0 con 0x7efd241553c0 2024-06-10T00:15:48.072 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:15:48.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efd0806be30 msgr2=0x7efd0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:48.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efd0806be30 0x7efd0806e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd14034000 tx=0x7efd1402e000 comp rx=0 tx=0).stop 2024-06-10T00:15:48.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 msgr2=0x7efd241503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:48.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd241503a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efd1c007e40 tx=0x7efd1c00e4b0 comp rx=0 tx=0).stop 2024-06-10T00:15:48.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 shutdown_connections 2024-06-10T00:15:48.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efd0806be30 0x7efd0806e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:48.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd241553c0 0x7efd241503a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:48.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd240cec50 0x7efd2415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:48.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 --2- 172.21.15.79:0/1306920055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd240b2cf0 0x7efd240af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:48.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 >> 172.21.15.79:0/1306920055 conn(0x7efd240b19f0 msgr2=0x7efd241533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:48.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 shutdown_connections 2024-06-10T00:15:48.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48.074+0000 7efd2c361640 1 -- 172.21.15.79:0/1306920055 wait complete. 2024-06-10T00:15:48.085 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:15:48.085 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:15:48.085 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:15:48.085 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:15:48.085 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:48.085 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:15:48.085 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:15:48.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:15:48.086 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:15:48.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:48.086 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:15:48.102 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:15:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:15:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:15:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:15:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:48.104 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:15:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:15:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:48.105 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:15:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:15:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:15:48.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:48.106 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:15:48.165 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:15:48.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:48.167 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:15:48.225 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:15:48.225 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:15:48.225 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:15:48.225 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:15:48.225 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:15:48.225 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:15:48.226 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:15:48.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:15:48.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:15:48.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:15:48.226 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:15:48.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:15:48.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:48.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:48.352 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:15:48.367 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:15:48.367 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:15:48.367 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:15:48.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:48.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:15:48.433 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:15:48.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:48.433 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:48.488 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:15:48.488 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:15:48.488 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:48.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:15:48.608 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:48.664 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:15:48.665 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:15:48.666 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:15:48.667 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:15:48.667 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:15:48.667 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:15:48.667 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:15:48.667 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:48.667 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:48.667 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:48.667 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:48.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:48.668 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:15:48.720 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:15:48.720 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:15:48.763 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:15:48.788 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:15:48.844 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:15:48.844 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:15:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:15:48.846 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:15:48.847 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:48.847 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:15:48.847 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:48.847 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:15:48.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:48.847 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:15:48.848 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:15:48.846+0000 7f89840b2480 -1 init, newargv = 0x5583ba34dda0 newargc=15 2024-06-10T00:15:48.848 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[51062]: starting ceph client 2024-06-10T00:15:48.853 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[51062]: starting fuse 2024-06-10T00:15:48.863 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:15:48.863 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:15:48.864 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:15:48.865 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:48.981 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.51062.asok 2024-06-10T00:15:48.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:48.992 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51062.asok 2024-06-10T00:15:48.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:48.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51062.asok status 2024-06-10T00:15:49.125 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:15:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:15:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "51062", 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5178, 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:15:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 5178 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3407222567 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3407222567 2024-06-10T00:15:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.5178 192.168.0.1:0/3407222567", 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/3407222567", 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 16, 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 38, 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:15:49.128 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:15:49.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:49.134 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:15:49.134 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:49.150 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:15:49.150 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:49.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:49.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:49.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:49.216 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-06-10T00:15:49.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:49.276 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-06-10T00:15:49.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:49.334 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-06-10T00:15:49.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:49.392 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-06-10T00:15:49.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:49.453 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-06-10T00:15:49.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:49.510 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-06-10T00:15:49.574 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-06-10T00:15:49.574 INFO:teuthology.orchestra.run.smithi079.stdout:./rfile 2024-06-10T00:15:49.574 INFO:teuthology.orchestra.run.smithi079.stdout:./parentdir 2024-06-10T00:15:49.574 INFO:teuthology.orchestra.run.smithi079.stdout:./parentdir/pfile 2024-06-10T00:15:49.574 INFO:teuthology.orchestra.run.smithi079.stdout:./parentdir/childdir 2024-06-10T00:15:49.575 INFO:teuthology.orchestra.run.smithi079.stdout:./parentdir/childdir/cfile 2024-06-10T00:15:49.575 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:15:49.575 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:49.575 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:15:49.575 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:49.575 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-06-10T00:15:49.575 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:49.680 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:15:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:49.688 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:15:49.689 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:49.689 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:15:49.689 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:49.689 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-06-10T00:15:49.689 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:49.794 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-06-10T00:15:49.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:49.803 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:15:49.803 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:49.803 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:15:49.803 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:49.803 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-06-10T00:15:49.803 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:49.909 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-06-10T00:15:49.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:49.918 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:15:49.918 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:49.918 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:15:49.918 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:49.918 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-06-10T00:15:49.918 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:50.025 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628279 2024-06-10T00:15:50.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:50.033 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:15:50.033 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:50.033 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:15:50.033 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:50.033 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-06-10T00:15:50.033 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:50.139 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-06-10T00:15:50.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:50.149 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:15:50.149 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:15:50.149 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:15:50.149 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:15:50.149 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-06-10T00:15:50.149 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:15:50.254 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628280 2024-06-10T00:15:50.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:15:50.263 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:15:50.264 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:50.320 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:50.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.460+0000 7f56854e1640 1 Processor -- start 2024-06-10T00:15:50.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.460+0000 7f56854e1640 1 -- start start 2024-06-10T00:15:50.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.461+0000 7f56854e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f568015f1a0 0x7f56800d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.461+0000 7f56854e1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f568015f5e0 con 0x7f56800d2680 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.461+0000 7f56854e1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56800d0ad0 con 0x7f56800cef70 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.461+0000 7f56854e1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f56800d13e0 con 0x7f568015f1a0 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.461+0000 7f567effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f56800d2680 0x7f56800d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51962/0 (socket says 172.21.15.79:51962) 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.461+0000 7f567effd640 1 -- 172.21.15.79:0/3187390805 learned_addr learned my addr 172.21.15.79:0/3187390805 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493413762 0 0) 0x7f568015f5e0 con 0x7f56800d2680 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f566c003520 con 0x7f56800d2680 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567e7fc640 1 --2- 172.21.15.79:0/3187390805 >> v2:172.21.15.117:3300/0 conn(0x7f568015f1a0 0x7f56800d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2169212001 0 0) 0x7f566c003520 con 0x7f56800d2680 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 >> v2:172.21.15.117:3300/0 conn(0x7f568015f1a0 msgr2=0x7f56800d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 --2- 172.21.15.79:0/3187390805 >> v2:172.21.15.117:3300/0 conn(0x7f568015f1a0 0x7f56800d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 >> v1:172.21.15.117:6789/0 conn(0x7f56800cef70 legacy=0x7f56800cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568015f890 con 0x7f56800d2680 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f56700019f0 con 0x7f56800d2680 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 >> v1:172.21.15.79:6789/0 conn(0x7f56800d2680 legacy=0x7f56800d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c0039b0 0x7f566c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566c004800 0x7f566c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f566c0051c0 0x7f566c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56800d13e0 con 0x7f566c004800 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f566c00c110 con 0x7f566c0039b0 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f566c00c310 con 0x7f566c0051c0 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567e7fc640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566c004800 0x7f566c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567effd640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c0039b0 0x7f566c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567f7fe640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f566c0051c0 0x7f566c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567e7fc640 1 -- 172.21.15.79:0/3187390805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f566c0051c0 msgr2=0x7f566c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567e7fc640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f566c0051c0 0x7f566c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567e7fc640 1 -- 172.21.15.79:0/3187390805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c0039b0 msgr2=0x7f566c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567e7fc640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c0039b0 0x7f566c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567e7fc640 1 -- 172.21.15.79:0/3187390805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566c003520 con 0x7f566c004800 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.462+0000 7f567f7fe640 1 -- 172.21.15.79:0/3187390805 reap_dead start 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.463+0000 7f567e7fc640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566c004800 0x7f566c004c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f566800ba30 tx=0x7f566c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a073695f704ac43b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.463+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668030070 con 0x7f566c004800 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.463+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566802ae00 con 0x7f566c004800 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.463+0000 7f567dffb640 1 -- 172.21.15.79:0/3187390805 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566800b600 con 0x7f566c004800 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.464+0000 7f56854e1640 1 -- 172.21.15.79:0/3187390805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566c004800 msgr2=0x7f566c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.464+0000 7f56854e1640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566c004800 0x7f566c004c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f566800ba30 tx=0x7f566c005830 comp rx=0 tx=0).stop 2024-06-10T00:15:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.464+0000 7f56854e1640 1 -- 172.21.15.79:0/3187390805 shutdown_connections 2024-06-10T00:15:50.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.464+0000 7f56854e1640 1 --2- 172.21.15.79:0/3187390805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f566c004800 0x7f566c004c80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.464+0000 7f56854e1640 1 -- 172.21.15.79:0/3187390805 >> 172.21.15.79:0/3187390805 conn(0x7f568009d3f0 msgr2=0x7f56800d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:50.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.464+0000 7f56854e1640 1 -- 172.21.15.79:0/3187390805 shutdown_connections 2024-06-10T00:15:50.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.464+0000 7f56854e1640 1 -- 172.21.15.79:0/3187390805 wait complete. 2024-06-10T00:15:50.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.465+0000 7f56854e1640 1 Processor -- start 2024-06-10T00:15:50.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.465+0000 7f56854e1640 1 -- start start 2024-06-10T00:15:50.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f56854e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c004800 0x7f568015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f56854e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5680150b00 0x7f568015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f56854e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568015d680 0x7f56800ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f56854e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56800d4f00 con 0x7f568015d680 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f56854e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f56800d1070 con 0x7f566c004800 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f56854e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f56800d1870 con 0x7f5680150b00 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568015d680 0x7f56800ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568015d680 0x7f56800ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56310/0 (socket says 172.21.15.79:56310) 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 -- 172.21.15.79:0/1591911620 learned_addr learned my addr 172.21.15.79:0/1591911620 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567e7fc640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5680150b00 0x7f568015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567effd640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c004800 0x7f568015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 -- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5680150b00 msgr2=0x7f568015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5680150b00 0x7f568015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 -- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c004800 msgr2=0x7f568015dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c004800 0x7f568015dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 -- 172.21.15.79:0/1591911620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56800cc080 con 0x7f568015d680 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567e7fc640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5680150b00 0x7f568015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567effd640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c004800 0x7f568015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.466+0000 7f567f7fe640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568015d680 0x7f56800ccb20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f568008caa0 tx=0x7f567800e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.467+0000 7f56777fe640 1 -- 172.21.15.79:0/1591911620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678019070 con 0x7f568015d680 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.467+0000 7f56777fe640 1 -- 172.21.15.79:0/1591911620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56780052e0 con 0x7f568015d680 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.467+0000 7f56777fe640 1 -- 172.21.15.79:0/1591911620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678003810 con 0x7f568015d680 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.467+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56800ca2b0 con 0x7f568015d680 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.467+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56800cc320 con 0x7f568015d680 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.468+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5680068430 con 0x7f568015d680 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.468+0000 7f56777fe640 1 -- 172.21.15.79:0/1591911620 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f567801c070 con 0x7f568015d680 2024-06-10T00:15:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.468+0000 7f56777fe640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f566006be30 0x7f566006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.469+0000 7f56777fe640 1 -- 172.21.15.79:0/1591911620 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f567808a370 con 0x7f568015d680 2024-06-10T00:15:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.469+0000 7f567effd640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f566006be30 0x7f566006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.469+0000 7f567effd640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f566006be30 0x7f566006e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5680160d50 tx=0x7f5670006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.473+0000 7f56777fe640 1 -- 172.21.15.79:0/1591911620 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5678058b90 con 0x7f568015d680 2024-06-10T00:15:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.657+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f56800cbe60 con 0x7f568015d680 2024-06-10T00:15:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.657+0000 7f56777fe640 1 -- 172.21.15.79:0/1591911620 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) ==== 80+0+0 (secure 0 0 0) 0x7f5678058490 con 0x7f568015d680 2024-06-10T00:15:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f566006be30 msgr2=0x7f566006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f566006be30 0x7f566006e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5680160d50 tx=0x7f5670006040 comp rx=0 tx=0).stop 2024-06-10T00:15:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568015d680 msgr2=0x7f56800ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568015d680 0x7f56800ccb20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f568008caa0 tx=0x7f567800e820 comp rx=0 tx=0).stop 2024-06-10T00:15:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 shutdown_connections 2024-06-10T00:15:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f566006be30 0x7f566006e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568015d680 0x7f56800ccb20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5680150b00 0x7f568015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 --2- 172.21.15.79:0/1591911620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566c004800 0x7f568015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 >> 172.21.15.79:0/1591911620 conn(0x7f568009d3f0 msgr2=0x7f56800cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 shutdown_connections 2024-06-10T00:15:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.659+0000 7f56854e1640 1 -- 172.21.15.79:0/1591911620 wait complete. 2024-06-10T00:15:50.670 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:15:50.670 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:15:50.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:15:50.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.826+0000 7f995545d640 1 Processor -- start 2024-06-10T00:15:50.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.826+0000 7f995545d640 1 -- start start 2024-06-10T00:15:50.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.826+0000 7f995545d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 0x7f99500b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.826+0000 7f995545d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99500cebb0 con 0x7f99500d1110 2024-06-10T00:15:50.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.826+0000 7f995545d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99500d2fc0 con 0x7f9950161c10 2024-06-10T00:15:50.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.826+0000 7f995545d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f99500d4f20 con 0x7f9950161830 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f99500d1110 0x7f99500cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51970/0 (socket says 172.21.15.79:51970) 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994f7fe640 1 -- 172.21.15.79:0/2968347061 learned_addr learned my addr 172.21.15.79:0/2968347061 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994effd640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 0x7f99500b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041347519 0 0) 0x7f99500cebb0 con 0x7f99500d1110 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9938003520 con 0x7f99500d1110 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1549061506 0 0) 0x7f9938003520 con 0x7f99500d1110 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 msgr2=0x7f99500b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 0x7f99500b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 >> v1:172.21.15.117:6789/0 conn(0x7f9950161c10 legacy=0x7f99500d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99500d2720 con 0x7f99500d1110 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f99480019f0 con 0x7f99500d1110 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 >> v1:172.21.15.79:6789/0 conn(0x7f99500d1110 legacy=0x7f99500cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9938003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9938004800 0x7f9938004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 0x7f99380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99500d4f20 con 0x7f99380039e0 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f993800ba70 con 0x7f9938004800 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f993800bc70 con 0x7f9950161830 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994effd640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9938003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994e7fc640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9938004800 0x7f9938004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.827+0000 7f994f7fe640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 0x7f99380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994effd640 1 -- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 msgr2=0x7f99380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994effd640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 0x7f99380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994effd640 1 -- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9938004800 msgr2=0x7f9938004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994effd640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9938004800 0x7f9938004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994effd640 1 -- 172.21.15.79:0/2968347061 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9938003520 con 0x7f99380039e0 2024-06-10T00:15:50.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994f7fe640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9950161830 0x7f99380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:15:50.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994effd640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9938003e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9940009a90 tx=0x7f9938005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffca736089ba8e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:50.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940036070 con 0x7f99380039e0 2024-06-10T00:15:50.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9940031400 con 0x7f99380039e0 2024-06-10T00:15:50.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.828+0000 7f994dffb640 1 -- 172.21.15.79:0/2968347061 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940009690 con 0x7f99380039e0 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.829+0000 7f995545d640 1 -- 172.21.15.79:0/2968347061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 msgr2=0x7f9938003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.829+0000 7f995545d640 1 --2- 172.21.15.79:0/2968347061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9938003e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9940009a90 tx=0x7f9938005830 comp rx=0 tx=0).stop 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.829+0000 7f994f7fe640 1 -- 172.21.15.79:0/2968347061 reap_dead start 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.829+0000 7f995545d640 1 -- 172.21.15.79:0/2968347061 shutdown_connections 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.829+0000 7f995545d640 1 -- 172.21.15.79:0/2968347061 >> 172.21.15.79:0/2968347061 conn(0x7f995009d3e0 msgr2=0x7f99500d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.829+0000 7f995545d640 1 -- 172.21.15.79:0/2968347061 shutdown_connections 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.829+0000 7f995545d640 1 -- 172.21.15.79:0/2968347061 wait complete. 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.830+0000 7f995545d640 1 Processor -- start 2024-06-10T00:15:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f995545d640 1 -- start start 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f995545d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9950152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f995545d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99501f3fe0 0x7f995015e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f995545d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995015e990 0x7f99500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f995545d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99500c7bf0 con 0x7f99380039e0 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f995545d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99500d2ce0 con 0x7f995015e990 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f995545d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f99500b5270 con 0x7f99501f3fe0 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f994effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9950152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f994effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9950152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56320/0 (socket says 172.21.15.79:56320) 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f994effd640 1 -- 172.21.15.79:0/188902054 learned_addr learned my addr 172.21.15.79:0/188902054 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.831+0000 7f994f7fe640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995015e990 0x7f99500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f994e7fc640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99501f3fe0 0x7f995015e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f994effd640 1 -- 172.21.15.79:0/188902054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99501f3fe0 msgr2=0x7f995015e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f994effd640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99501f3fe0 0x7f995015e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f994effd640 1 -- 172.21.15.79:0/188902054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995015e990 msgr2=0x7f99500b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f994effd640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995015e990 0x7f99500b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f994effd640 1 -- 172.21.15.79:0/188902054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99500cb310 con 0x7f99380039e0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f994effd640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9950152470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9940009bb0 tx=0x7f9940004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f99377fe640 1 -- 172.21.15.79:0/188902054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940040020 con 0x7f99380039e0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f99377fe640 1 -- 172.21.15.79:0/188902054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9940003b40 con 0x7f99380039e0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99500cb5f0 con 0x7f99380039e0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f99377fe640 1 -- 172.21.15.79:0/188902054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940036040 con 0x7f99380039e0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.832+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99500cbbb0 con 0x7f99380039e0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.833+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9950068430 con 0x7f99380039e0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.834+0000 7f99377fe640 1 -- 172.21.15.79:0/188902054 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9940043020 con 0x7f99380039e0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.834+0000 7f99377fe640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f993c06be30 0x7f993c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.834+0000 7f994e7fc640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f993c06be30 0x7f993c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:50.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.834+0000 7f99377fe640 1 -- 172.21.15.79:0/188902054 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f99400aaf50 con 0x7f99380039e0 2024-06-10T00:15:50.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.835+0000 7f994e7fc640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f993c06be30 0x7f993c06e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99500ce4f0 tx=0x7f9944009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:50.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:50.839+0000 7f99377fe640 1 -- 172.21.15.79:0/188902054 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f994004a070 con 0x7f99380039e0 2024-06-10T00:15:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.025+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f995015ed70 con 0x7f99380039e0 2024-06-10T00:15:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.025+0000 7f99377fe640 1 -- 172.21.15.79:0/188902054 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) ==== 80+0+0 (secure 0 0 0) 0x7f99400044e0 con 0x7f99380039e0 2024-06-10T00:15:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:15:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f993c06be30 msgr2=0x7f993c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f993c06be30 0x7f993c06e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99500ce4f0 tx=0x7f9944009040 comp rx=0 tx=0).stop 2024-06-10T00:15:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 msgr2=0x7f9950152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9950152470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9940009bb0 tx=0x7f9940004730 comp rx=0 tx=0).stop 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 shutdown_connections 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f993c06be30 0x7f993c06e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995015e990 0x7f99500b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99501f3fe0 0x7f995015e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 --2- 172.21.15.79:0/188902054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99380039e0 0x7f9950152470 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 >> 172.21.15.79:0/188902054 conn(0x7f995009d3e0 msgr2=0x7f995006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 shutdown_connections 2024-06-10T00:15:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:51.027+0000 7f995545d640 1 -- 172.21.15.79:0/188902054 wait complete. 2024-06-10T00:15:51.039 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:15:51.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:51.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:15:51.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[51062]: fuse finished with error 0 and tester_r 0 2024-06-10T00:15:51.065 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:15:57.166 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:15:57.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:15:57.167 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:15:57.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.335+0000 7f915c24d640 1 Processor -- start 2024-06-10T00:15:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.335+0000 7f915c24d640 1 -- start start 2024-06-10T00:15:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.336+0000 7f915c24d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f91541553c0 0x7f91540cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.336+0000 7f915c24d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91540cec50 0x7f91540cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.336+0000 7f915c24d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91540b31a0 con 0x7f91540b2cf0 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.336+0000 7f915c24d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f91540b3420 con 0x7f91540cec50 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.336+0000 7f915c24d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f91540cc750 con 0x7f91541553c0 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.336+0000 7f915a7ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91540cec50 0x7f91540cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.336+0000 7f91597e8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f91540b2cf0 0x7f915415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51986/0 (socket says 172.21.15.79:51986) 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.336+0000 7f91597e8640 1 -- 172.21.15.79:0/2307936492 learned_addr learned my addr 172.21.15.79:0/2307936492 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f9159fe9640 1 --2- 172.21.15.79:0/2307936492 >> v2:172.21.15.117:3300/0 conn(0x7f91541553c0 0x7f91540cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f915a7ea640 1 -- 172.21.15.79:0/2307936492 >> v2:172.21.15.117:3300/0 conn(0x7f91541553c0 msgr2=0x7f91540cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f915a7ea640 1 --2- 172.21.15.79:0/2307936492 >> v2:172.21.15.117:3300/0 conn(0x7f91541553c0 0x7f91540cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f915a7ea640 1 -- 172.21.15.79:0/2307936492 >> v1:172.21.15.79:6789/0 conn(0x7f91540b2cf0 legacy=0x7f915415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f915a7ea640 1 -- 172.21.15.79:0/2307936492 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91540cca30 con 0x7f91540cec50 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f9158fe7640 1 -- 172.21.15.79:0/2307936492 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3449881051 0 0) 0x7f9144001110 con 0x7f91540b2cf0 2024-06-10T00:15:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f9159fe9640 1 --2- 172.21.15.79:0/2307936492 >> v2:172.21.15.117:3300/0 conn(0x7f91541553c0 0x7f91540cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f915a7ea640 1 --2- 172.21.15.79:0/2307936492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540cec50 0x7f91540cf0e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f914c009d90 tx=0x7f914c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3718842878b7a905 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.337+0000 7f9158fe7640 1 -- 172.21.15.79:0/2307936492 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c007740 con 0x7f91540cec50 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f9158fe7640 1 -- 172.21.15.79:0/2307936492 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914c0078e0 con 0x7f91540cec50 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f9158fe7640 1 -- 172.21.15.79:0/2307936492 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c007cb0 con 0x7f91540cec50 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f915c24d640 1 -- 172.21.15.79:0/2307936492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540cec50 msgr2=0x7f91540cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f915c24d640 1 --2- 172.21.15.79:0/2307936492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540cec50 0x7f91540cf0e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f914c009d90 tx=0x7f914c02a6a0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f915c24d640 1 -- 172.21.15.79:0/2307936492 shutdown_connections 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f915c24d640 1 --2- 172.21.15.79:0/2307936492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540cec50 0x7f91540cf0e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f915c24d640 1 --2- 172.21.15.79:0/2307936492 >> v2:172.21.15.117:3300/0 conn(0x7f91541553c0 0x7f91540cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f915c24d640 1 -- 172.21.15.79:0/2307936492 >> 172.21.15.79:0/2307936492 conn(0x7f91540b19f0 msgr2=0x7f91540b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f915c24d640 1 -- 172.21.15.79:0/2307936492 shutdown_connections 2024-06-10T00:15:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.338+0000 7f915c24d640 1 -- 172.21.15.79:0/2307936492 wait complete. 2024-06-10T00:15:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.339+0000 7f915c24d640 1 Processor -- start 2024-06-10T00:15:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915c24d640 1 -- start start 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915c24d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91540b2cf0 0x7f91541455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915c24d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91540cec50 0x7f915409aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915c24d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91541553c0 0x7f915415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915c24d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91541557a0 con 0x7f91541553c0 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915c24d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f91540b3700 con 0x7f91540cec50 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915c24d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9154155920 con 0x7f91540b2cf0 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915a7ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91541553c0 0x7f915415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915a7ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91541553c0 0x7f915415a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56342/0 (socket says 172.21.15.79:56342) 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.340+0000 7f915a7ea640 1 -- 172.21.15.79:0/808567885 learned_addr learned my addr 172.21.15.79:0/808567885 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f9159fe9640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91540b2cf0 0x7f91541455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f91597e8640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91540cec50 0x7f915409aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f915a7ea640 1 -- 172.21.15.79:0/808567885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91540b2cf0 msgr2=0x7f91541455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f915a7ea640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91540b2cf0 0x7f91541455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f915a7ea640 1 -- 172.21.15.79:0/808567885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91540cec50 msgr2=0x7f915409aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f915a7ea640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91540cec50 0x7f915409aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f915a7ea640 1 -- 172.21.15.79:0/808567885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915409af50 con 0x7f91541553c0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f915a7ea640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91541553c0 0x7f915415a1b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f914c02ac90 tx=0x7f914c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f914a7fc640 1 -- 172.21.15.79:0/808567885 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c040070 con 0x7f91541553c0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f914a7fc640 1 -- 172.21.15.79:0/808567885 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914c031c90 con 0x7f91541553c0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f914a7fc640 1 -- 172.21.15.79:0/808567885 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c045680 con 0x7f91541553c0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915409c6a0 con 0x7f91541553c0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.341+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915409cc60 con 0x7f91541553c0 2024-06-10T00:15:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.342+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9154068430 con 0x7f91541553c0 2024-06-10T00:15:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.343+0000 7f914a7fc640 1 -- 172.21.15.79:0/808567885 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f914c039040 con 0x7f91541553c0 2024-06-10T00:15:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.343+0000 7f914a7fc640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f913806be30 0x7f913806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.343+0000 7f914a7fc640 1 -- 172.21.15.79:0/808567885 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f914c0ac9a0 con 0x7f91541553c0 2024-06-10T00:15:57.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.343+0000 7f9159fe9640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f913806be30 0x7f913806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.344+0000 7f9159fe9640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f913806be30 0x7f913806e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f915000b840 tx=0x7f9150008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.348+0000 7f914a7fc640 1 -- 172.21.15.79:0/808567885 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f914c07b3a0 con 0x7f91541553c0 2024-06-10T00:15:57.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.556+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f915409dad0 con 0x7f91541553c0 2024-06-10T00:15:57.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.556+0000 7f914a7fc640 1 -- 172.21.15.79:0/808567885 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7f914c07aca0 con 0x7f91541553c0 2024-06-10T00:15:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:57.556 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:15:37.465229+0000","modified":"2024-06-10T00:15:40.130979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3860098569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3860098569},{"type":"v1","addr":"172.21.15.79:6837","nonce":3860098569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4968,"qdb_cluster":[4968]},"id":2}]} 2024-06-10T00:15:57.556 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-06-10T00:15:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f913806be30 msgr2=0x7f913806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f913806be30 0x7f913806e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f915000b840 tx=0x7f9150008040 comp rx=0 tx=0).stop 2024-06-10T00:15:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91541553c0 msgr2=0x7f915415a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91541553c0 0x7f915415a1b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f914c02ac90 tx=0x7f914c004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 shutdown_connections 2024-06-10T00:15:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f913806be30 0x7f913806e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91541553c0 0x7f915415a1b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91540cec50 0x7f915409aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 --2- 172.21.15.79:0/808567885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91540b2cf0 0x7f91541455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 >> 172.21.15.79:0/808567885 conn(0x7f91540b19f0 msgr2=0x7f91540cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:57.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 shutdown_connections 2024-06-10T00:15:57.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.558+0000 7f915c24d640 1 -- 172.21.15.79:0/808567885 wait complete. 2024-06-10T00:15:57.569 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-06-10T00:15:57.698 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0} 2024-06-10T00:15:57.698 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:15:57.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:15:57.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.798+0000 7effdaccd640 1 Processor -- start 2024-06-10T00:15:57.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.798+0000 7effdaccd640 1 -- start start 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.799+0000 7effdaccd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effd40d2680 0x7effd415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.799+0000 7effdaccd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effd40d1fc0 0x7effd40d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.799+0000 7effdaccd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd40d2fa0 con 0x7effd4161fa0 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.799+0000 7effdaccd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7effd40cff80 con 0x7effd40d1fc0 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.799+0000 7effdaccd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7effd40d13e0 con 0x7effd40d2680 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.799+0000 7effd3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effd40d1fc0 0x7effd40d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.799+0000 7effd3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effd40d1fc0 0x7effd40d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56346/0 (socket says 172.21.15.79:56346) 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.799+0000 7effd3fff640 1 -- 172.21.15.79:0/1329553447 learned_addr learned my addr 172.21.15.79:0/1329553447 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.800+0000 7effd8a69640 1 --2- 172.21.15.79:0/1329553447 >> v2:172.21.15.117:3300/0 conn(0x7effd40d2680 0x7effd415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.800+0000 7effd3fff640 1 -- 172.21.15.79:0/1329553447 >> v2:172.21.15.117:3300/0 conn(0x7effd40d2680 msgr2=0x7effd415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.800+0000 7effd3fff640 1 --2- 172.21.15.79:0/1329553447 >> v2:172.21.15.117:3300/0 conn(0x7effd40d2680 0x7effd415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.800+0000 7effd3fff640 1 -- 172.21.15.79:0/1329553447 >> v1:172.21.15.117:6789/0 conn(0x7effd4161fa0 legacy=0x7effd41623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.800+0000 7effd3fff640 1 -- 172.21.15.79:0/1329553447 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd40d0ad0 con 0x7effd40d1fc0 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.800+0000 7effd8a69640 1 --2- 172.21.15.79:0/1329553447 >> v2:172.21.15.117:3300/0 conn(0x7effd40d2680 0x7effd415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.800+0000 7effd3fff640 1 --2- 172.21.15.79:0/1329553447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d1fc0 0x7effd40d2a60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7effd408ca40 tx=0x7effc802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb611ca3dbbe0765 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effd37fe640 1 -- 172.21.15.79:0/1329553447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8036070 con 0x7effd40d1fc0 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effd37fe640 1 -- 172.21.15.79:0/1329553447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc8031600 con 0x7effd40d1fc0 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effd37fe640 1 -- 172.21.15.79:0/1329553447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc80319d0 con 0x7effd40d1fc0 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effdaccd640 1 -- 172.21.15.79:0/1329553447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d1fc0 msgr2=0x7effd40d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effdaccd640 1 --2- 172.21.15.79:0/1329553447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d1fc0 0x7effd40d2a60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7effd408ca40 tx=0x7effc802a730 comp rx=0 tx=0).stop 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effdaccd640 1 -- 172.21.15.79:0/1329553447 shutdown_connections 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effdaccd640 1 --2- 172.21.15.79:0/1329553447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d1fc0 0x7effd40d2a60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effdaccd640 1 --2- 172.21.15.79:0/1329553447 >> v2:172.21.15.117:3300/0 conn(0x7effd40d2680 0x7effd415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effdaccd640 1 -- 172.21.15.79:0/1329553447 >> 172.21.15.79:0/1329553447 conn(0x7effd409d3f0 msgr2=0x7effd40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effdaccd640 1 -- 172.21.15.79:0/1329553447 shutdown_connections 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.801+0000 7effdaccd640 1 -- 172.21.15.79:0/1329553447 wait complete. 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.802+0000 7effdaccd640 1 Processor -- start 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.802+0000 7effdaccd640 1 -- start start 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effdaccd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd40d1fc0 0x7effd40c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effdaccd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d2680 0x7effd40cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effdaccd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd4161fa0 0x7effd415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effdaccd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effd40d1070 con 0x7effd40d2680 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effdaccd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effd40d0d90 con 0x7effd4161fa0 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effdaccd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effd40d2400 con 0x7effd40d1fc0 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effd3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d2680 0x7effd40cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effd3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d2680 0x7effd40cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56354/0 (socket says 172.21.15.79:56354) 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.803+0000 7effd3fff640 1 -- 172.21.15.79:0/2399764717 learned_addr learned my addr 172.21.15.79:0/2399764717 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:15:57.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd926a640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd4161fa0 0x7effd415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd3fff640 1 -- 172.21.15.79:0/2399764717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd40d1fc0 msgr2=0x7effd40c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd3fff640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd40d1fc0 0x7effd40c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd3fff640 1 -- 172.21.15.79:0/2399764717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd4161fa0 msgr2=0x7effd415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd3fff640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd4161fa0 0x7effd415dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd3fff640 1 -- 172.21.15.79:0/2399764717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd40cc730 con 0x7effd40d2680 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd3fff640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d2680 0x7effd40cc1f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7effc8009f40 tx=0x7effc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd17fa640 1 -- 172.21.15.79:0/2399764717 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc803f020 con 0x7effd40d2680 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd17fa640 1 -- 172.21.15.79:0/2399764717 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc8037040 con 0x7effd40d2680 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd40cca00 con 0x7effd40d2680 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effd17fa640 1 -- 172.21.15.79:0/2399764717 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8036070 con 0x7effd40d2680 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.804+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd40ccfc0 con 0x7effd40d2680 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.805+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd4068430 con 0x7effd40d2680 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.805+0000 7effd17fa640 1 -- 172.21.15.79:0/2399764717 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effc8042020 con 0x7effd40d2680 2024-06-10T00:15:57.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.806+0000 7effd17fa640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effc006be30 0x7effc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:15:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.806+0000 7effd8a69640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effc006be30 0x7effc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:15:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.806+0000 7effd17fa640 1 -- 172.21.15.79:0/2399764717 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7effc80ab4d0 con 0x7effd40d2680 2024-06-10T00:15:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.806+0000 7effd8a69640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effc006be30 0x7effc006e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7effc4006fd0 tx=0x7effc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:15:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:57.810+0000 7effd17fa640 1 -- 172.21.15.79:0/2399764717 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7effc8049030 con 0x7effd40d2680 2024-06-10T00:15:58.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.021+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effd40ce580 con 0x7effd40d2680 2024-06-10T00:15:58.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.022+0000 7effd17fa640 1 -- 172.21.15.79:0/2399764717 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7effc8079d80 con 0x7effd40d2680 2024-06-10T00:15:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:15:58.022 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:15:37.465229+0000","modified":"2024-06-10T00:15:40.130979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3860098569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3860098569},{"type":"v1","addr":"172.21.15.79:6837","nonce":3860098569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4968,"qdb_cluster":[4968]},"id":2}]} 2024-06-10T00:15:58.022 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-06-10T00:15:58.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effc006be30 msgr2=0x7effc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effc006be30 0x7effc006e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7effc4006fd0 tx=0x7effc4008040 comp rx=0 tx=0).stop 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d2680 msgr2=0x7effd40cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d2680 0x7effd40cc1f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7effc8009f40 tx=0x7effc8004a40 comp rx=0 tx=0).stop 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 shutdown_connections 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effc006be30 0x7effc006e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd4161fa0 0x7effd415dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd40d2680 0x7effd40cc1f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 --2- 172.21.15.79:0/2399764717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd40d1fc0 0x7effd40c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 >> 172.21.15.79:0/2399764717 conn(0x7effd409d3f0 msgr2=0x7effd40b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 shutdown_connections 2024-06-10T00:15:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:15:58.024+0000 7effdaccd640 1 -- 172.21.15.79:0/2399764717 wait complete. 2024-06-10T00:15:58.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2024-06-10T00:15:58.154 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-06-10T00:15:58.154 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-06-10T00:16:08.155 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-06-10T00:16:08.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.205+0000 7f55d40edf40 1 Processor -- start 2024-06-10T00:16:08.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.205+0000 7f55d40edf40 1 -- start start 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55d40edf40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf203bd80 0x55ecf2065770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55d40edf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf210c2b0 0x55ecf2105110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55d40edf40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 0x55ecf2114270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55d40edf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1fe1e30 con 0x55ecf210c2b0 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55d40edf40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1fe5e70 con 0x55ecf203bd80 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55d40edf40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ecf2067a80 con 0x55ecf2112320 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55c93ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf210c2b0 0x55ecf2105110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55c93ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf210c2b0 0x55ecf2105110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58890/0 (socket says 172.21.15.79:58890) 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55c93ed640 1 -- 172.21.15.79:0/2059163668 learned_addr learned my addr 172.21.15.79:0/2059163668 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55d1bee640 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf203bd80 0x55ecf2065770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.206+0000 7f55d23ef640 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 0x55ecf2114270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55c93ed640 1 -- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 msgr2=0x55ecf2114270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55c93ed640 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 0x55ecf2114270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55c93ed640 1 -- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf203bd80 msgr2=0x55ecf2065770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55c93ed640 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf203bd80 0x55ecf2065770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55c93ed640 1 -- 172.21.15.79:0/2059163668 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf2065fd0 con 0x55ecf210c2b0 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55d1bee640 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf203bd80 0x55ecf2065770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55c93ed640 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf210c2b0 0x55ecf2105110 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00b2f0 tx=0x7f55bc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f35385021348ef8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55d0bec640 1 -- 172.21.15.79:0/2059163668 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc008070 con 0x55ecf210c2b0 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55d0bec640 1 -- 172.21.15.79:0/2059163668 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc00d500 con 0x55ecf210c2b0 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55d0bec640 1 -- 172.21.15.79:0/2059163668 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00d8d0 con 0x55ecf210c2b0 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55d40edf40 1 -- 172.21.15.79:0/2059163668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf210c2b0 msgr2=0x55ecf2105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55d40edf40 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf210c2b0 0x55ecf2105110 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00b2f0 tx=0x7f55bc00b7b0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.207+0000 7f55d40edf40 1 -- 172.21.15.79:0/2059163668 shutdown_connections 2024-06-10T00:16:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.208+0000 7f55d40edf40 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 0x55ecf2114270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.208+0000 7f55d40edf40 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf210c2b0 0x55ecf2105110 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.208+0000 7f55d40edf40 1 --2- 172.21.15.79:0/2059163668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf203bd80 0x55ecf2065770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.208+0000 7f55d40edf40 1 -- 172.21.15.79:0/2059163668 >> 172.21.15.79:0/2059163668 conn(0x55ecf20391c0 msgr2=0x55ecf2114df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.208+0000 7f55d40edf40 1 -- 172.21.15.79:0/2059163668 shutdown_connections 2024-06-10T00:16:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.208+0000 7f55d40edf40 1 -- 172.21.15.79:0/2059163668 wait complete. 2024-06-10T00:16:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.208+0000 7f55d40edf40 1 Processor -- start 2024-06-10T00:16:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.208+0000 7f55d40edf40 1 -- start start 2024-06-10T00:16:08.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d40edf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf203bd80 0x55ecf2107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d40edf40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf210c2b0 0x55ecf2105080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d40edf40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 0x55ecf21036e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d40edf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ecf210b060 con 0x55ecf203bd80 2024-06-10T00:16:08.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d40edf40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecf210b340 con 0x55ecf210c2b0 2024-06-10T00:16:08.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d40edf40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ecf2111c40 con 0x55ecf2112320 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d1bee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf203bd80 0x55ecf2107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d1bee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf203bd80 0x55ecf2107ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58902/0 (socket says 172.21.15.79:58902) 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d1bee640 1 -- 172.21.15.79:0/1252553729 learned_addr learned my addr 172.21.15.79:0/1252553729 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55c93ed640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf210c2b0 0x55ecf2105080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d23ef640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 0x55ecf21036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d1bee640 1 -- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 msgr2=0x55ecf21036e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d1bee640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecf2112320 0x55ecf21036e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d1bee640 1 -- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf210c2b0 msgr2=0x55ecf2105080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d1bee640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecf210c2b0 0x55ecf2105080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.209+0000 7f55d1bee640 1 -- 172.21.15.79:0/1252553729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf210a1b0 con 0x55ecf203bd80 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.210+0000 7f55d1bee640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf203bd80 0x55ecf2107ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f55c4025d60 tx=0x7f55c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.210+0000 7f55cb7fe640 1 -- 172.21.15.79:0/1252553729 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4056040 con 0x55ecf203bd80 2024-06-10T00:16:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.210+0000 7f55cb7fe640 1 -- 172.21.15.79:0/1252553729 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c400a2d0 con 0x55ecf203bd80 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.210+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecf21141c0 con 0x55ecf203bd80 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.210+0000 7f55cb7fe640 1 -- 172.21.15.79:0/1252553729 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4052a20 con 0x55ecf203bd80 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.210+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf210a710 con 0x55ecf203bd80 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.211+0000 7f55cb7fe640 1 -- 172.21.15.79:0/1252553729 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55c4059020 con 0x55ecf203bd80 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.212+0000 7f55cb7fe640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f55b406a810 0x7f55b406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.212+0000 7f55cb7fe640 1 -- 172.21.15.79:0/1252553729 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f55c40cdcd0 con 0x55ecf203bd80 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.212+0000 7f55c93ed640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f55b406a810 0x7f55b406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.212+0000 7f55d40edf40 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ecf2104130 0x55ecf2038250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.212+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x55ecf2103c20 con 0x55ecf2104130 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.212+0000 7f55c93ed640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f55b406a810 0x7f55b406ccd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00b2f0 tx=0x7f55bc009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.212+0000 7f55d23ef640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ecf2104130 0x55ecf2038250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.213+0000 7f55d23ef640 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ecf2104130 0x55ecf2038250 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.213+0000 7f55d23ef640 1 -- 172.21.15.79:0/1252553729 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f55cc010580 con 0x55ecf2104130 2024-06-10T00:16:08.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ecf2104130 msgr2=0x55ecf2038250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ecf2104130 0x55ecf2038250 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f55b406a810 msgr2=0x7f55b406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f55b406a810 0x7f55b406ccd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00b2f0 tx=0x7f55bc009000 comp rx=0 tx=0).stop 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf203bd80 msgr2=0x55ecf2107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 --2- 172.21.15.79:0/1252553729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecf203bd80 0x55ecf2107ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f55c4025d60 tx=0x7f55c4002fb0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d23ef640 1 -- 172.21.15.79:0/1252553729 reap_dead start 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 shutdown_connections 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 >> 172.21.15.79:0/1252553729 conn(0x55ecf20391c0 msgr2=0x55ecf2081f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 shutdown_connections 2024-06-10T00:16:08.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.214+0000 7f55d40edf40 1 -- 172.21.15.79:0/1252553729 wait complete. 2024-06-10T00:16:08.219 INFO:teuthology.orchestra.run.smithi079.stdout:mytag 2024-06-10T00:16:08.219 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-06-10T00:16:08.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.265+0000 7f7b1e1b7f40 1 Processor -- start 2024-06-10T00:16:08.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.265+0000 7f7b1e1b7f40 1 -- start start 2024-06-10T00:16:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b1e1b7f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b08003ab0 0x5622fcb83af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b1e1b7f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622fcc2bf10 0x5622fcb5a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b1e1b7f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 0x5622fcc1de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b1e1b7f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5622fcaffe30 con 0x5622fcc2bf10 2024-06-10T00:16:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b1e1b7f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5622fcb03e70 con 0x7f7b08003ab0 2024-06-10T00:16:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b1e1b7f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5622fcb5af50 con 0x5622fcc1d990 2024-06-10T00:16:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b13fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622fcc2bf10 0x5622fcb5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b13fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622fcc2bf10 0x5622fcb5a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58920/0 (socket says 172.21.15.79:58920) 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b13fff640 1 -- 172.21.15.79:0/3502780352 learned_addr learned my addr 172.21.15.79:0/3502780352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b1bcb8640 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b08003ab0 0x5622fcb83af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.266+0000 7f7b1c4b9640 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 0x5622fcc1de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b13fff640 1 -- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 msgr2=0x5622fcc1de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b13fff640 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 0x5622fcc1de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b13fff640 1 -- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b08003ab0 msgr2=0x5622fcb83af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b13fff640 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b08003ab0 0x5622fcb83af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b13fff640 1 -- 172.21.15.79:0/3502780352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622fcb87ee0 con 0x5622fcc2bf10 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1c4b9640 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 0x5622fcc1de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b13fff640 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622fcc2bf10 0x5622fcb5a100 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7b040097b0 tx=0x7f7b04005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ded5d043d36a190 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1acb6640 1 -- 172.21.15.79:0/3502780352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04007830 con 0x5622fcc2bf10 2024-06-10T00:16:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1acb6640 1 -- 172.21.15.79:0/3502780352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b040079d0 con 0x5622fcc2bf10 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1acb6640 1 -- 172.21.15.79:0/3502780352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04007d80 con 0x5622fcc2bf10 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3502780352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622fcc2bf10 msgr2=0x5622fcb5a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622fcc2bf10 0x5622fcb5a100 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7b040097b0 tx=0x7f7b04005a00 comp rx=0 tx=0).stop 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3502780352 shutdown_connections 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 0x5622fcc1de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622fcc2bf10 0x5622fcb5a100 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 --2- 172.21.15.79:0/3502780352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b08003ab0 0x5622fcb83af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3502780352 >> 172.21.15.79:0/3502780352 conn(0x5622fcb57a40 msgr2=0x5622fcc2c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3502780352 shutdown_connections 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.267+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3502780352 wait complete. 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.268+0000 7f7b1e1b7f40 1 Processor -- start 2024-06-10T00:16:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.268+0000 7f7b1e1b7f40 1 -- start start 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1e1b7f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 0x5622fcb9c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1e1b7f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5622fcc2bf10 0x5622fcc1a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1e1b7f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b08003ab0 0x5622fcc1c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1e1b7f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5622fcc26620 con 0x7f7b08003ab0 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1e1b7f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5622fcb84030 con 0x5622fcc2bf10 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1e1b7f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5622fcb834b0 con 0x5622fcc1d990 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b08003ab0 0x5622fcc1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b08003ab0 0x5622fcc1c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58936/0 (socket says 172.21.15.79:58936) 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 -- 172.21.15.79:0/3068691023 learned_addr learned my addr 172.21.15.79:0/3068691023 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1bcb8640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 0x5622fcb9c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b13fff640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5622fcc2bf10 0x5622fcc1a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 -- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 msgr2=0x5622fcb9c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5622fcc1d990 0x5622fcb9c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 -- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5622fcc2bf10 msgr2=0x5622fcc1a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5622fcc2bf10 0x5622fcc1a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 -- 172.21.15.79:0/3068691023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622fcc275f0 con 0x7f7b08003ab0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b1c4b9640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b08003ab0 0x5622fcc1c100 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7b14006fd0 tx=0x7f7b140014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.269+0000 7f7b19cb4640 1 -- 172.21.15.79:0/3068691023 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14063020 con 0x7f7b08003ab0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.270+0000 7f7b19cb4640 1 -- 172.21.15.79:0/3068691023 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14059040 con 0x7f7b08003ab0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.270+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622fcc278d0 con 0x7f7b08003ab0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.270+0000 7f7b19cb4640 1 -- 172.21.15.79:0/3068691023 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14058070 con 0x7f7b08003ab0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.270+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622fcc27e90 con 0x7f7b08003ab0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.271+0000 7f7b19cb4640 1 -- 172.21.15.79:0/3068691023 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b14066020 con 0x7f7b08003ab0 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.271+0000 7f7b19cb4640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7afc06a810 0x7f7afc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.272+0000 7f7b1bcb8640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7afc06a810 0x7f7afc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.272+0000 7f7b19cb4640 1 -- 172.21.15.79:0/3068691023 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f7b140cd0e0 con 0x7f7b08003ab0 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.272+0000 7f7b1e1b7f40 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5622fcc28690 0x5622fcc28aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.272+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x5622fcc28fe0 con 0x5622fcc28690 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.272+0000 7f7b1bcb8640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7afc06a810 0x7f7afc06ccd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0017e0 tx=0x7f7b0c001e10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.272+0000 7f7b13fff640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5622fcc28690 0x5622fcc28aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.272+0000 7f7b13fff640 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5622fcc28690 0x5622fcc28aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b13fff640 1 -- 172.21.15.79:0/3068691023 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f7b04007c80 con 0x5622fcc28690 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5622fcc28690 msgr2=0x5622fcc28aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5622fcc28690 0x5622fcc28aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7afc06a810 msgr2=0x7f7afc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7afc06a810 0x7f7afc06ccd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0017e0 tx=0x7f7b0c001e10 comp rx=0 tx=0).stop 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b08003ab0 msgr2=0x5622fcc1c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 --2- 172.21.15.79:0/3068691023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b08003ab0 0x5622fcc1c100 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7b14006fd0 tx=0x7f7b140014a0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1c4b9640 1 -- 172.21.15.79:0/3068691023 reap_dead start 2024-06-10T00:16:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 shutdown_connections 2024-06-10T00:16:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 >> 172.21.15.79:0/3068691023 conn(0x5622fcb57a40 msgr2=0x5622fcc2c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 shutdown_connections 2024-06-10T00:16:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.273+0000 7f7b1e1b7f40 1 -- 172.21.15.79:0/3068691023 wait complete. 2024-06-10T00:16:08.279 INFO:teuthology.orchestra.run.smithi079.stdout:mytag 2024-06-10T00:16:08.279 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-06-10T00:16:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.322+0000 7f2963ce4f40 1 Processor -- start 2024-06-10T00:16:08.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.322+0000 7f2963ce4f40 1 -- start start 2024-06-10T00:16:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2963ce4f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeafea0d90 0x55eeafeeb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2963ce4f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 0x55eeaff77240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2963ce4f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeaff77fd0 0x55eeaff767c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2963ce4f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55eeafea1300 con 0x55eeaff77fd0 2024-06-10T00:16:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2963ce4f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55eeafe47e30 con 0x55eeafea0d90 2024-06-10T00:16:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2963ce4f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55eeafea15a0 con 0x55eeafea3680 2024-06-10T00:16:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeaff77fd0 0x55eeaff767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeaff77fd0 0x55eeaff767c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58942/0 (socket says 172.21.15.79:58942) 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 -- 172.21.15.79:0/1883370620 learned_addr learned my addr 172.21.15.79:0/1883370620 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f295bfff640 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 0x55eeaff77240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f29617e5640 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeafea0d90 0x55eeafeeb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 -- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 msgr2=0x55eeaff77240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 0x55eeaff77240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 -- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeafea0d90 msgr2=0x55eeafeeb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeafea0d90 0x55eeafeeb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 -- 172.21.15.79:0/1883370620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeafdcccb0 con 0x55eeaff77fd0 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f295bfff640 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 0x55eeaff77240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f29617e5640 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeafea0d90 0x55eeafeeb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f2961fe6640 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeaff77fd0 0x55eeaff767c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f295c005fd0 tx=0x7f295c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a1fb7b46854627 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f295b7fe640 1 -- 172.21.15.79:0/1883370620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c055030 con 0x55eeaff77fd0 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f295b7fe640 1 -- 172.21.15.79:0/1883370620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295c051c30 con 0x55eeaff77fd0 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.323+0000 7f295b7fe640 1 -- 172.21.15.79:0/1883370620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c05b430 con 0x55eeaff77fd0 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1883370620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeaff77fd0 msgr2=0x55eeaff767c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeaff77fd0 0x55eeaff767c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f295c005fd0 tx=0x7f295c050000 comp rx=0 tx=0).stop 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1883370620 shutdown_connections 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeaff77fd0 0x55eeaff767c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 0x55eeaff77240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 --2- 172.21.15.79:0/1883370620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeafea0d90 0x55eeafeeb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1883370620 >> 172.21.15.79:0/1883370620 conn(0x55eeafecbeb0 msgr2=0x55eeafed0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1883370620 shutdown_connections 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1883370620 wait complete. 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 Processor -- start 2024-06-10T00:16:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.324+0000 7f2963ce4f40 1 -- start start 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f2963ce4f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafea0d90 0x55eeaff69a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f2963ce4f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 0x55eeaff755b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f2963ce4f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeaff77fd0 0x55eeaff6b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f2963ce4f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55eeafee8830 con 0x55eeafea0d90 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f2963ce4f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55eeaff77780 con 0x55eeaff77fd0 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f2963ce4f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55eeafecf380 con 0x55eeafea3680 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f29617e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafea0d90 0x55eeaff69a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f29617e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafea0d90 0x55eeaff69a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58952/0 (socket says 172.21.15.79:58952) 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f29617e5640 1 -- 172.21.15.79:0/1201055353 learned_addr learned my addr 172.21.15.79:0/1201055353 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f295bfff640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 0x55eeaff755b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f2961fe6640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeaff77fd0 0x55eeaff6b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f29617e5640 1 -- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 msgr2=0x55eeaff755b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f29617e5640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eeafea3680 0x55eeaff755b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f29617e5640 1 -- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeaff77fd0 msgr2=0x55eeaff6b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f29617e5640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeaff77fd0 0x55eeaff6b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f29617e5640 1 -- 172.21.15.79:0/1201055353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeafee56f0 con 0x55eeafea0d90 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.325+0000 7f2961fe6640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eeaff77fd0 0x55eeaff6b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.326+0000 7f29617e5640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafea0d90 0x55eeaff69a00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f295400cec0 tx=0x7f295400a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.326+0000 7f295a7fc640 1 -- 172.21.15.79:0/1201055353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954010470 con 0x55eeafea0d90 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.326+0000 7f295a7fc640 1 -- 172.21.15.79:0/1201055353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2954010610 con 0x55eeafea0d90 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.326+0000 7f295a7fc640 1 -- 172.21.15.79:0/1201055353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29540109e0 con 0x55eeafea0d90 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.326+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeafee59d0 con 0x55eeafea0d90 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.326+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeafee5f90 con 0x55eeafea0d90 2024-06-10T00:16:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.327+0000 7f295a7fc640 1 -- 172.21.15.79:0/1201055353 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f295400e040 con 0x55eeafea0d90 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.327+0000 7f295a7fc640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294406a840 0x7f294406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.328+0000 7f295a7fc640 1 -- 172.21.15.79:0/1201055353 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f2954089ae0 con 0x55eeafea0d90 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.328+0000 7f295bfff640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294406a840 0x7f294406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.328+0000 7f2963ce4f40 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55eeaff75af0 0x55eeaff72ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.328+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x55eeaff73220 con 0x55eeaff75af0 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.328+0000 7f295bfff640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294406a840 0x7f294406cd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55eeafecf760 tx=0x7f294c00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.328+0000 7f2961fe6640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55eeaff75af0 0x55eeaff72ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.328+0000 7f2961fe6640 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55eeaff75af0 0x55eeaff72ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2961fe6640 1 -- 172.21.15.79:0/1201055353 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f295c065430 con 0x55eeaff75af0 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55eeaff75af0 msgr2=0x55eeaff72ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55eeaff75af0 0x55eeaff72ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294406a840 msgr2=0x7f294406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294406a840 0x7f294406cd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55eeafecf760 tx=0x7f294c00d040 comp rx=0 tx=0).stop 2024-06-10T00:16:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafea0d90 msgr2=0x55eeaff69a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 --2- 172.21.15.79:0/1201055353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55eeafea0d90 0x55eeaff69a00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f295400cec0 tx=0x7f295400a5a0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2961fe6640 1 -- 172.21.15.79:0/1201055353 reap_dead start 2024-06-10T00:16:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 shutdown_connections 2024-06-10T00:16:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 >> 172.21.15.79:0/1201055353 conn(0x55eeafecbeb0 msgr2=0x55eeafed0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 shutdown_connections 2024-06-10T00:16:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.329+0000 7f2963ce4f40 1 -- 172.21.15.79:0/1201055353 wait complete. 2024-06-10T00:16:08.335 INFO:teuthology.orchestra.run.smithi079.stdout:mytag 2024-06-10T00:16:08.335 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-06-10T00:16:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.377+0000 7ff9c3fd4f40 1 Processor -- start 2024-06-10T00:16:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.377+0000 7ff9c3fd4f40 1 -- start start 2024-06-10T00:16:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c3fd4f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ade3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c3fd4f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 0x56316ade3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c3fd4f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 0x56316ad0f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c3fd4f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56316ad37d30 con 0x56316ad55850 2024-06-10T00:16:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c3fd4f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56316acb3e30 con 0x56316ad56170 2024-06-10T00:16:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c3fd4f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56316ade1140 con 0x56316ade1c90 2024-06-10T00:16:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ade3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ade3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58964/0 (socket says 172.21.15.79:58964) 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 -- 172.21.15.79:0/2484893616 learned_addr learned my addr 172.21.15.79:0/2484893616 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9bbfff640 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 0x56316ade3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c22d6640 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 0x56316ad0f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 -- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 msgr2=0x56316ad0f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 0x56316ad0f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 -- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 msgr2=0x56316ade3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 0x56316ade3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 -- 172.21.15.79:0/2484893616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316ac38cb0 con 0x56316ad55850 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c22d6640 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 0x56316ad0f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9bbfff640 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 0x56316ade3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.378+0000 7ff9c1ad5640 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ade3730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009540 tx=0x7ff9b4009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c56e708a958c253 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c0ad3640 1 -- 172.21.15.79:0/2484893616 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4017070 con 0x56316ad55850 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c0ad3640 1 -- 172.21.15.79:0/2484893616 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b40065a0 con 0x56316ad55850 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c0ad3640 1 -- 172.21.15.79:0/2484893616 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4006970 con 0x56316ad55850 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/2484893616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 msgr2=0x56316ade3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ade3730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009540 tx=0x7ff9b4009a00 comp rx=0 tx=0).stop 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/2484893616 shutdown_connections 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 0x56316ad0f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 0x56316ade3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 --2- 172.21.15.79:0/2484893616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ade3730 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/2484893616 >> 172.21.15.79:0/2484893616 conn(0x56316ad37eb0 msgr2=0x56316ade45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/2484893616 shutdown_connections 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.379+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/2484893616 wait complete. 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c3fd4f40 1 Processor -- start 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c3fd4f40 1 -- start start 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c3fd4f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ad3cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c3fd4f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 0x56316ad0f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c3fd4f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 0x56316adc1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c3fd4f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56316ade4e60 con 0x56316ad55850 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c3fd4f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56316ad535d0 con 0x56316ad56170 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c3fd4f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56316ade1390 con 0x56316ade1c90 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c1ad5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ad3cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c1ad5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ad3cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58976/0 (socket says 172.21.15.79:58976) 2024-06-10T00:16:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.380+0000 7ff9c1ad5640 1 -- 172.21.15.79:0/152997918 learned_addr learned my addr 172.21.15.79:0/152997918 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9bbfff640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 0x56316ad0f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c22d6640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 0x56316adc1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c1ad5640 1 -- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 msgr2=0x56316adc1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c1ad5640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56316ade1c90 0x56316adc1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c1ad5640 1 -- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 msgr2=0x56316ad0f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c1ad5640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56316ad56170 0x56316ad0f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c1ad5640 1 -- 172.21.15.79:0/152997918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316ad3d120 con 0x56316ad55850 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c1ad5640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ad3cbe0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4000c00 tx=0x7ff9b4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9baffd640 1 -- 172.21.15.79:0/152997918 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b401f020 con 0x56316ad55850 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9baffd640 1 -- 172.21.15.79:0/152997918 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4006d80 con 0x56316ad55850 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56316adc5df0 con 0x56316ad55850 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9baffd640 1 -- 172.21.15.79:0/152997918 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4017040 con 0x56316ad55850 2024-06-10T00:16:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.381+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316ad3c6c0 con 0x56316ad55850 2024-06-10T00:16:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.382+0000 7ff9baffd640 1 -- 172.21.15.79:0/152997918 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9b4022020 con 0x56316ad55850 2024-06-10T00:16:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.383+0000 7ff9baffd640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9a406a810 0x7ff9a406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.383+0000 7ff9baffd640 1 -- 172.21.15.79:0/152997918 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7ff9b408a610 con 0x56316ad55850 2024-06-10T00:16:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.383+0000 7ff9bbfff640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9a406a810 0x7ff9a406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.383+0000 7ff9c3fd4f40 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x56316ad0fb10 0x56316adc73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.383+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x56316ad10440 con 0x56316ad0fb10 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.383+0000 7ff9bbfff640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9a406a810 0x7ff9a406ccd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac057000 tx=0x7ff9ac052000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.383+0000 7ff9c22d6640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x56316ad0fb10 0x56316adc73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c22d6640 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x56316ad0fb10 0x56316adc73b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c22d6640 1 -- 172.21.15.79:0/152997918 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7ff9bc003450 con 0x56316ad0fb10 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x56316ad0fb10 msgr2=0x56316adc73b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x56316ad0fb10 0x56316adc73b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9a406a810 msgr2=0x7ff9a406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff9a406a810 0x7ff9a406ccd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac057000 tx=0x7ff9ac052000 comp rx=0 tx=0).stop 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 msgr2=0x56316ad3cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 --2- 172.21.15.79:0/152997918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56316ad55850 0x56316ad3cbe0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4000c00 tx=0x7ff9b4003020 comp rx=0 tx=0).stop 2024-06-10T00:16:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c22d6640 1 -- 172.21.15.79:0/152997918 reap_dead start 2024-06-10T00:16:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 shutdown_connections 2024-06-10T00:16:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 >> 172.21.15.79:0/152997918 conn(0x56316ad37eb0 msgr2=0x56316ad53810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 shutdown_connections 2024-06-10T00:16:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.384+0000 7ff9c3fd4f40 1 -- 172.21.15.79:0/152997918 wait complete. 2024-06-10T00:16:08.391 INFO:teuthology.orchestra.run.smithi079.stdout:mytag 2024-06-10T00:16:08.391 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-06-10T00:16:08.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.474+0000 7fc6a5d1cf40 1 Processor -- start 2024-06-10T00:16:08.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.474+0000 7fc6a5d1cf40 1 -- start start 2024-06-10T00:16:08.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:16:08.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a5d1cf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6bb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a5d1cf40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c07f0 0x561a8a6ba630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a5d1cf40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c0bd0 0x561a8a6195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a5d1cf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561a8a593e30 con 0x561a8a6beb80 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a5d1cf40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561a8a6c2640 con 0x561a8a6c07f0 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a5d1cf40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561a8a6be470 con 0x561a8a6c0bd0 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6bb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6bb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58980/0 (socket says 172.21.15.79:58980) 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 -- 172.21.15.79:0/3445651270 learned_addr learned my addr 172.21.15.79:0/3445651270 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a25b8640 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c07f0 0x561a8a6ba630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a35ba640 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c0bd0 0x561a8a6195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 -- 172.21.15.79:0/3445651270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c0bd0 msgr2=0x561a8a6195e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c0bd0 0x561a8a6195e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 -- 172.21.15.79:0/3445651270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c07f0 msgr2=0x561a8a6ba630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c07f0 0x561a8a6ba630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 -- 172.21.15.79:0/3445651270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8a518cb0 con 0x561a8a6beb80 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.475+0000 7fc6a2db9640 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6bb8a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc69400a7b0 tx=0x7fc694005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ab059b6f509a9e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a15b6640 1 -- 172.21.15.79:0/3445651270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694017020 con 0x561a8a6beb80 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a15b6640 1 -- 172.21.15.79:0/3445651270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69400ae50 con 0x561a8a6beb80 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a15b6640 1 -- 172.21.15.79:0/3445651270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69400db80 con 0x561a8a6beb80 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3445651270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 msgr2=0x561a8a6bb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6bb8a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc69400a7b0 tx=0x7fc694005d80 comp rx=0 tx=0).stop 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3445651270 shutdown_connections 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c0bd0 0x561a8a6195e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c07f0 0x561a8a6ba630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 --2- 172.21.15.79:0/3445651270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6bb8a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3445651270 >> 172.21.15.79:0/3445651270 conn(0x561a8a5eb1c0 msgr2=0x561a8a6bf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3445651270 shutdown_connections 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.476+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3445651270 wait complete. 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a5d1cf40 1 Processor -- start 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a5d1cf40 1 -- start start 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a5d1cf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a5d1cf40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c07f0 0x561a8a6c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a5d1cf40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c0bd0 0x561a8a6c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a5d1cf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561a8a6bade0 con 0x561a8a6beb80 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a5d1cf40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561a8a6bab70 con 0x561a8a6c0bd0 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a5d1cf40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561a8a61a2b0 con 0x561a8a6c07f0 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.477+0000 7fc6a2db9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a2db9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6a5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58992/0 (socket says 172.21.15.79:58992) 2024-06-10T00:16:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a2db9640 1 -- 172.21.15.79:0/3808045696 learned_addr learned my addr 172.21.15.79:0/3808045696 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a35ba640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c0bd0 0x561a8a6c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a25b8640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c07f0 0x561a8a6c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a2db9640 1 -- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c07f0 msgr2=0x561a8a6c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a2db9640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561a8a6c07f0 0x561a8a6c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a2db9640 1 -- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c0bd0 msgr2=0x561a8a6c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a2db9640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c0bd0 0x561a8a6c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a2db9640 1 -- 172.21.15.79:0/3808045696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8a75d970 con 0x561a8a6beb80 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a35ba640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561a8a6c0bd0 0x561a8a6c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a2db9640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6a5000 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc694005f70 tx=0x7fc6940033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc68bfff640 1 -- 172.21.15.79:0/3808045696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694017040 con 0x561a8a6beb80 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc68bfff640 1 -- 172.21.15.79:0/3808045696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc694012980 con 0x561a8a6beb80 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a8a75dc50 con 0x561a8a6beb80 2024-06-10T00:16:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc68bfff640 1 -- 172.21.15.79:0/3808045696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694012d70 con 0x561a8a6beb80 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.478+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a8a6a5540 con 0x561a8a6beb80 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.479+0000 7fc68bfff640 1 -- 172.21.15.79:0/3808045696 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc694024020 con 0x561a8a6beb80 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.480+0000 7fc68bfff640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc69006a810 0x7fc69006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.480+0000 7fc68bfff640 1 -- 172.21.15.79:0/3808045696 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fc69408ba60 con 0x561a8a6beb80 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.480+0000 7fc6a25b8640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc69006a810 0x7fc69006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.480+0000 7fc6a5d1cf40 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561a8a6b6710 0x561a8a6b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.480+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x561a8a6b7030 con 0x561a8a6b6710 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.480+0000 7fc6a35ba640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561a8a6b6710 0x561a8a6b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.480+0000 7fc6a25b8640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc69006a810 0x7fc69006ccd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc698057000 tx=0x7fc698052000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a35ba640 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561a8a6b6710 0x561a8a6b6af0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a35ba640 1 -- 172.21.15.79:0/3808045696 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7fc69c010580 con 0x561a8a6b6710 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561a8a6b6710 msgr2=0x561a8a6b6af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561a8a6b6710 0x561a8a6b6af0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc69006a810 msgr2=0x7fc69006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc69006a810 0x7fc69006ccd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc698057000 tx=0x7fc698052000 comp rx=0 tx=0).stop 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 msgr2=0x561a8a6a5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 --2- 172.21.15.79:0/3808045696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a8a6beb80 0x561a8a6a5000 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc694005f70 tx=0x7fc6940033a0 comp rx=0 tx=0).stop 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a35ba640 1 -- 172.21.15.79:0/3808045696 reap_dead start 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 shutdown_connections 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 >> 172.21.15.79:0/3808045696 conn(0x561a8a5eb1c0 msgr2=0x561a8a6bb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 shutdown_connections 2024-06-10T00:16:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:08.481+0000 7fc6a5d1cf40 1 -- 172.21.15.79:0/3808045696 wait complete. 2024-06-10T00:16:08.491 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:16:08.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:16:08.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:16:08.622 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:16:08.622 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:16:08.622 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:16:08.622 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:16:08.638 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:16:08.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:16:08.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:08.638 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:16:08.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:16:08.694 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-10T00:16:08.694 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:16:08.694 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:16:08.694 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:16:08.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:16:08.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:16:08.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:08.714 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-10T00:16:08.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:16:08.772 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-10T00:16:08.772 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:16:08.773 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:16:08.773 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:16:08.788 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:16:08.788 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:16:08.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:08.788 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-10T00:16:08.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:16:08.844 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-10T00:16:08.844 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:16:08.844 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:16:08.845 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:16:08.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:16:08.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:16:08.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:08.863 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-10T00:16:08.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:16:08.922 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-10T00:16:08.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:16:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.021+0000 7fadbeeb3640 1 Processor -- start 2024-06-10T00:16:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.021+0000 7fadbeeb3640 1 -- start start 2024-06-10T00:16:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadbeeb3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fadb80cc6d0 0x7fadb80ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadbeeb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb8071c60 0x7fadb80720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadbeeb3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb80ccff0 con 0x7fadb80b36c0 2024-06-10T00:16:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadbeeb3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fadb8072820 con 0x7fadb80cc6d0 2024-06-10T00:16:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadbeeb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fadb8072b00 con 0x7fadb8071c60 2024-06-10T00:16:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadb7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb8071c60 0x7fadb80720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadbcc4f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fadb80cc6d0 0x7fadb80ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadb7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb8071c60 0x7fadb80720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:48570/0 (socket says 172.21.15.79:48570) 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.022+0000 7fadb7fff640 1 -- 172.21.15.79:0/1160244675 learned_addr learned my addr 172.21.15.79:0/1160244675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.023+0000 7fadb7fff640 1 -- 172.21.15.79:0/1160244675 >> v2:172.21.15.117:3300/0 conn(0x7fadb80cc6d0 msgr2=0x7fadb80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.023+0000 7fadb7fff640 1 --2- 172.21.15.79:0/1160244675 >> v2:172.21.15.117:3300/0 conn(0x7fadb80cc6d0 0x7fadb80ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.023+0000 7fadb7fff640 1 -- 172.21.15.79:0/1160244675 >> v1:172.21.15.117:6789/0 conn(0x7fadb80b36c0 legacy=0x7fadb80b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.023+0000 7fadb7fff640 1 -- 172.21.15.79:0/1160244675 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb8072de0 con 0x7fadb8071c60 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.023+0000 7fadbcc4f640 1 --2- 172.21.15.79:0/1160244675 >> v2:172.21.15.117:3300/0 conn(0x7fadb80cc6d0 0x7fadb80ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.023+0000 7fadb7fff640 1 --2- 172.21.15.79:0/1160244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb8071c60 0x7fadb80720e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fadac009870 tx=0x7fadac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b01f2f46de37c15f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadb77fe640 1 -- 172.21.15.79:0/1160244675 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac037070 con 0x7fadb8071c60 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadb77fe640 1 -- 172.21.15.79:0/1160244675 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac032440 con 0x7fadb8071c60 2024-06-10T00:16:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadb77fe640 1 -- 172.21.15.79:0/1160244675 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac032810 con 0x7fadb8071c60 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadbeeb3640 1 -- 172.21.15.79:0/1160244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb8071c60 msgr2=0x7fadb80720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/1160244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb8071c60 0x7fadb80720e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fadac009870 tx=0x7fadac02a270 comp rx=0 tx=0).stop 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadbeeb3640 1 -- 172.21.15.79:0/1160244675 shutdown_connections 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/1160244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb8071c60 0x7fadb80720e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/1160244675 >> v2:172.21.15.117:3300/0 conn(0x7fadb80cc6d0 0x7fadb80ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadbeeb3640 1 -- 172.21.15.79:0/1160244675 >> 172.21.15.79:0/1160244675 conn(0x7fadb80b19f0 msgr2=0x7fadb80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadbeeb3640 1 -- 172.21.15.79:0/1160244675 shutdown_connections 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.024+0000 7fadbeeb3640 1 -- 172.21.15.79:0/1160244675 wait complete. 2024-06-10T00:16:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.025+0000 7fadbeeb3640 1 Processor -- start 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.025+0000 7fadbeeb3640 1 -- start start 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadbeeb3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb8071c60 0x7fadb8151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadbeeb3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadb80b36c0 0x7fadb814fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadbeeb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb80cc6d0 0x7fadb815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadbeeb3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8159f60 con 0x7fadb80b36c0 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadbeeb3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fadb815c890 con 0x7fadb8071c60 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadbeeb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fadb80b4240 con 0x7fadb80cc6d0 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadb7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadb80b36c0 0x7fadb814fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadb7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadb80b36c0 0x7fadb814fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59008/0 (socket says 172.21.15.79:59008) 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.026+0000 7fadb7fff640 1 -- 172.21.15.79:0/3555325453 learned_addr learned my addr 172.21.15.79:0/3555325453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadbd450640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb80cc6d0 0x7fadb815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadbcc4f640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb8071c60 0x7fadb8151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb7fff640 1 -- 172.21.15.79:0/3555325453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb80cc6d0 msgr2=0x7fadb815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb7fff640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb80cc6d0 0x7fadb815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb7fff640 1 -- 172.21.15.79:0/3555325453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb8071c60 msgr2=0x7fadb8151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb7fff640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb8071c60 0x7fadb8151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb7fff640 1 -- 172.21.15.79:0/3555325453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb8153370 con 0x7fadb80b36c0 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb7fff640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadb80b36c0 0x7fadb814fd10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fadac000c00 tx=0x7fadac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb57fa640 1 -- 172.21.15.79:0/3555325453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac037040 con 0x7fadb80b36c0 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb57fa640 1 -- 172.21.15.79:0/3555325453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac042070 con 0x7fadb80b36c0 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadb57fa640 1 -- 172.21.15.79:0/3555325453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac030860 con 0x7fadb80b36c0 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb8158090 con 0x7fadb80b36c0 2024-06-10T00:16:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.027+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb8158330 con 0x7fadb80b36c0 2024-06-10T00:16:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.028+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb8068430 con 0x7fadb80b36c0 2024-06-10T00:16:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.029+0000 7fadb57fa640 1 -- 172.21.15.79:0/3555325453 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadac030a00 con 0x7fadb80b36c0 2024-06-10T00:16:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.029+0000 7fadb57fa640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.029+0000 7fadb57fa640 1 -- 172.21.15.79:0/3555325453 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fadac0ab860 con 0x7fadb80b36c0 2024-06-10T00:16:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.029+0000 7fadbcc4f640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.029+0000 7fadbcc4f640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fada406be30 0x7fada406e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fada8009a30 tx=0x7fada8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.034+0000 7fadb57fa640 1 -- 172.21.15.79:0/3555325453 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fadac07a080 con 0x7fadb80b36c0 2024-06-10T00:16:09.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.245+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadb8156200 con 0x7fadb80b36c0 2024-06-10T00:16:09.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.246+0000 7fadb57fa640 1 -- 172.21.15.79:0/3555325453 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7fadac079980 con 0x7fadb80b36c0 2024-06-10T00:16:09.247 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:09.247 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:15:37.465229+0000","modified":"2024-06-10T00:15:40.130979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3860098569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3860098569},{"type":"v1","addr":"172.21.15.79:6837","nonce":3860098569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4968,"qdb_cluster":[4968]},"id":2}]} 2024-06-10T00:16:09.247 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fada406be30 msgr2=0x7fada406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fada406be30 0x7fada406e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fada8009a30 tx=0x7fada8008040 comp rx=0 tx=0).stop 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadb80b36c0 msgr2=0x7fadb814fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadb80b36c0 0x7fadb814fd10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fadac000c00 tx=0x7fadac0046c0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 shutdown_connections 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb80cc6d0 0x7fadb815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadb80b36c0 0x7fadb814fd10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 --2- 172.21.15.79:0/3555325453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb8071c60 0x7fadb8151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 >> 172.21.15.79:0/3555325453 conn(0x7fadb80b19f0 msgr2=0x7fadb80b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 shutdown_connections 2024-06-10T00:16:09.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.248+0000 7fadbeeb3640 1 -- 172.21.15.79:0/3555325453 wait complete. 2024-06-10T00:16:09.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:16:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.358+0000 7f3efeed4640 1 Processor -- start 2024-06-10T00:16:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.358+0000 7f3efeed4640 1 -- start start 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efeed4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3ef80ae910 0x7f3ef806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efeed4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 0x7f3ef80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efeed4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3ef80cf190 0x7f3ef815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efeed4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef806ee60 con 0x7f3ef80cf190 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efeed4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef80cf620 con 0x7f3ef80ae910 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efeed4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef806d130 con 0x7f3ef806ea20 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3ef80cf190 0x7f3ef815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3ef80cf190 0x7f3ef815ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59020/0 (socket says 172.21.15.79:59020) 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 -- 172.21.15.79:0/4253433320 learned_addr learned my addr 172.21.15.79:0/4253433320 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efcc70640 1 --2- 172.21.15.79:0/4253433320 >> v2:172.21.15.117:3300/0 conn(0x7f3ef80ae910 0x7f3ef806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3eeffff640 1 --2- 172.21.15.79:0/4253433320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 0x7f3ef80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 -- 172.21.15.79:0/4253433320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 msgr2=0x7f3ef80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 --2- 172.21.15.79:0/4253433320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 0x7f3ef80cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 -- 172.21.15.79:0/4253433320 >> v2:172.21.15.117:3300/0 conn(0x7f3ef80ae910 msgr2=0x7f3ef806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 --2- 172.21.15.79:0/4253433320 >> v2:172.21.15.117:3300/0 conn(0x7f3ef80ae910 0x7f3ef806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 -- 172.21.15.79:0/4253433320 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef806d410 con 0x7f3ef80cf190 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efcc70640 1 --2- 172.21.15.79:0/4253433320 >> v2:172.21.15.117:3300/0 conn(0x7f3ef80ae910 0x7f3ef806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3efd471640 1 --2- 172.21.15.79:0/4253433320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef815ead0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000d150 tx=0x7f3ef002c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5576e09089483988 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3eef7fe640 1 -- 172.21.15.79:0/4253433320 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0039070 con 0x7f3ef80cf190 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3eef7fe640 1 -- 172.21.15.79:0/4253433320 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0009600 con 0x7f3ef80cf190 2024-06-10T00:16:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.360+0000 7f3eef7fe640 1 -- 172.21.15.79:0/4253433320 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00099d0 con 0x7f3ef80cf190 2024-06-10T00:16:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 -- 172.21.15.79:0/4253433320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 msgr2=0x7f3ef815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 --2- 172.21.15.79:0/4253433320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef815ead0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000d150 tx=0x7f3ef002c840 comp rx=0 tx=0).stop 2024-06-10T00:16:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 -- 172.21.15.79:0/4253433320 shutdown_connections 2024-06-10T00:16:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 --2- 172.21.15.79:0/4253433320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef815ead0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 --2- 172.21.15.79:0/4253433320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 0x7f3ef80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 --2- 172.21.15.79:0/4253433320 >> v2:172.21.15.117:3300/0 conn(0x7f3ef80ae910 0x7f3ef806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 -- 172.21.15.79:0/4253433320 >> 172.21.15.79:0/4253433320 conn(0x7f3ef80b19f0 msgr2=0x7f3ef80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 -- 172.21.15.79:0/4253433320 shutdown_connections 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.361+0000 7f3efeed4640 1 -- 172.21.15.79:0/4253433320 wait complete. 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.362+0000 7f3efeed4640 1 Processor -- start 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.362+0000 7f3efeed4640 1 -- start start 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efeed4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 0x7f3ef815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efeed4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ef80ae910 0x7f3ef815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efeed4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef8157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efeed4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef80aecf0 con 0x7f3ef80cf190 2024-06-10T00:16:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efeed4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef806d9d0 con 0x7f3ef80ae910 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efeed4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef815f010 con 0x7f3ef806ea20 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef8157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef8157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59034/0 (socket says 172.21.15.79:59034) 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 -- 172.21.15.79:0/2049837174 learned_addr learned my addr 172.21.15.79:0/2049837174 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 -- 172.21.15.79:0/2049837174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 msgr2=0x7f3ef815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 0x7f3ef815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 -- 172.21.15.79:0/2049837174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ef80ae910 msgr2=0x7f3ef815b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ef80ae910 0x7f3ef815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 -- 172.21.15.79:0/2049837174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef8144260 con 0x7f3ef80cf190 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efd471640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef8157240 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0037040 tx=0x7f3ef0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3eed7fa640 1 -- 172.21.15.79:0/2049837174 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0039050 con 0x7f3ef80cf190 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3eed7fa640 1 -- 172.21.15.79:0/2049837174 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0045070 con 0x7f3ef80cf190 2024-06-10T00:16:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef815d5d0 con 0x7f3ef80cf190 2024-06-10T00:16:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3eed7fa640 1 -- 172.21.15.79:0/2049837174 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef000b720 con 0x7f3ef80cf190 2024-06-10T00:16:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.363+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef815db90 con 0x7f3ef80cf190 2024-06-10T00:16:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.364+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef8068430 con 0x7f3ef80cf190 2024-06-10T00:16:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.365+0000 7f3eed7fa640 1 -- 172.21.15.79:0/2049837174 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ef003ea70 con 0x7f3ef80cf190 2024-06-10T00:16:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.365+0000 7f3eed7fa640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ee406be30 0x7f3ee406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.365+0000 7f3eed7fa640 1 -- 172.21.15.79:0/2049837174 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3ef00add30 con 0x7f3ef80cf190 2024-06-10T00:16:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.365+0000 7f3efcc70640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ee406be30 0x7f3ee406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.366+0000 7f3efcc70640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ee406be30 0x7f3ee406e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4006fd0 tx=0x7f3ef4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.370+0000 7f3eed7fa640 1 -- 172.21.15.79:0/2049837174 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3ef0031070 con 0x7f3ef80cf190 2024-06-10T00:16:09.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.581+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ef8075430 con 0x7f3ef80cf190 2024-06-10T00:16:09.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.581+0000 7f3eed7fa640 1 -- 172.21.15.79:0/2049837174 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7f3ef007c550 con 0x7f3ef80cf190 2024-06-10T00:16:09.581 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:09.581 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:15:37.465229+0000","modified":"2024-06-10T00:15:40.130979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3860098569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3860098569},{"type":"v1","addr":"172.21.15.79:6837","nonce":3860098569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4968,"qdb_cluster":[4968]},"id":2}]} 2024-06-10T00:16:09.581 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-06-10T00:16:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ee406be30 msgr2=0x7f3ee406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ee406be30 0x7f3ee406e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4006fd0 tx=0x7f3ef4008040 comp rx=0 tx=0).stop 2024-06-10T00:16:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 msgr2=0x7f3ef8157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef8157240 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0037040 tx=0x7f3ef0004a40 comp rx=0 tx=0).stop 2024-06-10T00:16:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 shutdown_connections 2024-06-10T00:16:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ee406be30 0x7f3ee406e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ef80cf190 0x7f3ef8157240 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ef80ae910 0x7f3ef815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 --2- 172.21.15.79:0/2049837174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef806ea20 0x7f3ef815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 >> 172.21.15.79:0/2049837174 conn(0x7f3ef80b19f0 msgr2=0x7f3ef80acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 shutdown_connections 2024-06-10T00:16:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.583+0000 7f3efeed4640 1 -- 172.21.15.79:0/2049837174 wait complete. 2024-06-10T00:16:09.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:16:09.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.692+0000 7fa3638da640 1 Processor -- start 2024-06-10T00:16:09.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.692+0000 7fa3638da640 1 -- start start 2024-06-10T00:16:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.693+0000 7fa3638da640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c1553c0 0x7fa35c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.693+0000 7fa3638da640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa35c0b2cf0 0x7fa35c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.693+0000 7fa3638da640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35c15c3f0 con 0x7fa35c0cec50 2024-06-10T00:16:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.693+0000 7fa3638da640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa35c0b3170 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.693+0000 7fa3638da640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa35c0b3420 con 0x7fa35c1553c0 2024-06-10T00:16:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.694+0000 7fa361676640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c1553c0 0x7fa35c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.694+0000 7fa360e75640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa35c0b2cf0 0x7fa35c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.694+0000 7fa361676640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c1553c0 0x7fa35c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:48622/0 (socket says 172.21.15.79:48622) 2024-06-10T00:16:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.694+0000 7fa361676640 1 -- 172.21.15.79:0/1944197631 learned_addr learned my addr 172.21.15.79:0/1944197631 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.694+0000 7fa361676640 1 -- 172.21.15.79:0/1944197631 >> v2:172.21.15.117:3300/0 conn(0x7fa35c0b2cf0 msgr2=0x7fa35c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.694+0000 7fa361676640 1 --2- 172.21.15.79:0/1944197631 >> v2:172.21.15.117:3300/0 conn(0x7fa35c0b2cf0 0x7fa35c15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.694+0000 7fa361676640 1 -- 172.21.15.79:0/1944197631 >> v1:172.21.15.117:6789/0 conn(0x7fa35c0cec50 legacy=0x7fa35c071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.694+0000 7fa361676640 1 -- 172.21.15.79:0/1944197631 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c0cc750 con 0x7fa35c1553c0 2024-06-10T00:16:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa361676640 1 --2- 172.21.15.79:0/1944197631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c1553c0 0x7fa35c0cd230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e50 tx=0x7fa34c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9546b89356e739cd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa35bfff640 1 -- 172.21.15.79:0/1944197631 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c036070 con 0x7fa35c1553c0 2024-06-10T00:16:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa35bfff640 1 -- 172.21.15.79:0/1944197631 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34c031600 con 0x7fa35c1553c0 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa35bfff640 1 -- 172.21.15.79:0/1944197631 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0319d0 con 0x7fa35c1553c0 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa3638da640 1 -- 172.21.15.79:0/1944197631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c1553c0 msgr2=0x7fa35c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa3638da640 1 --2- 172.21.15.79:0/1944197631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c1553c0 0x7fa35c0cd230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e50 tx=0x7fa34c02a710 comp rx=0 tx=0).stop 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa3638da640 1 -- 172.21.15.79:0/1944197631 shutdown_connections 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa3638da640 1 --2- 172.21.15.79:0/1944197631 >> v2:172.21.15.117:3300/0 conn(0x7fa35c0b2cf0 0x7fa35c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa3638da640 1 --2- 172.21.15.79:0/1944197631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c1553c0 0x7fa35c0cd230 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.695+0000 7fa3638da640 1 -- 172.21.15.79:0/1944197631 >> 172.21.15.79:0/1944197631 conn(0x7fa35c0b19f0 msgr2=0x7fa35c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.696+0000 7fa3638da640 1 -- 172.21.15.79:0/1944197631 shutdown_connections 2024-06-10T00:16:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.696+0000 7fa3638da640 1 -- 172.21.15.79:0/1944197631 wait complete. 2024-06-10T00:16:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa3638da640 1 Processor -- start 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa3638da640 1 -- start start 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa3638da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c0b2cf0 0x7fa35c1f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa3638da640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c0cec50 0x7fa35c147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa3638da640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa35c1553c0 0x7fa35c15e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa3638da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c0b3700 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa3638da640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c0ccd10 con 0x7fa35c1553c0 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa3638da640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa35c1557a0 con 0x7fa35c0cec50 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.697+0000 7fa361676640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c0b2cf0 0x7fa35c1f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361676640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c0b2cf0 0x7fa35c1f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59050/0 (socket says 172.21.15.79:59050) 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361676640 1 -- 172.21.15.79:0/1871241403 learned_addr learned my addr 172.21.15.79:0/1871241403 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa360e75640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c0cec50 0x7fa35c147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361e77640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa35c1553c0 0x7fa35c15e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361676640 1 -- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c0cec50 msgr2=0x7fa35c147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361676640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c0cec50 0x7fa35c147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361676640 1 -- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa35c1553c0 msgr2=0x7fa35c15e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361676640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa35c1553c0 0x7fa35c15e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361676640 1 -- 172.21.15.79:0/1871241403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c15ecf0 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361e77640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa35c1553c0 0x7fa35c15e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa360e75640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c0cec50 0x7fa35c147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:09.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa361676640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c0b2cf0 0x7fa35c1f2660 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009f70 tx=0x7fa34c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa359ffb640 1 -- 172.21.15.79:0/1871241403 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c041020 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa359ffb640 1 -- 172.21.15.79:0/1871241403 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34c007820 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35c15ef80 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa359ffb640 1 -- 172.21.15.79:0/1871241403 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c036040 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.698+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35c155e00 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.699+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35c068430 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.700+0000 7fa359ffb640 1 -- 172.21.15.79:0/1871241403 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa34c044020 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.700+0000 7fa359ffb640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa34806be30 0x7fa34806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.700+0000 7fa359ffb640 1 -- 172.21.15.79:0/1871241403 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa34c0abc90 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.700+0000 7fa360e75640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa34806be30 0x7fa34806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.701+0000 7fa360e75640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa34806be30 0x7fa34806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa35c06d750 tx=0x7fa350008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.704+0000 7fa359ffb640 1 -- 172.21.15.79:0/1871241403 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa34c04b030 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.877+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa35c0addf0 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.878+0000 7fa359ffb640 1 -- 172.21.15.79:0/1871241403 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16894 (secure 0 0 0) 0x7fa34c07a4b0 con 0x7fa35c0b2cf0 2024-06-10T00:16:09.878 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:09.879 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:15:39.128132+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:15:35.302215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-10T00:15:36.439347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:16:09.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa34806be30 msgr2=0x7fa34806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa34806be30 0x7fa34806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa35c06d750 tx=0x7fa350008040 comp rx=0 tx=0).stop 2024-06-10T00:16:09.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c0b2cf0 msgr2=0x7fa35c1f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c0b2cf0 0x7fa35c1f2660 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009f70 tx=0x7fa34c004a40 comp rx=0 tx=0).stop 2024-06-10T00:16:09.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 shutdown_connections 2024-06-10T00:16:09.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa34806be30 0x7fa34806e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa35c1553c0 0x7fa35c15e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35c0cec50 0x7fa35c147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 --2- 172.21.15.79:0/1871241403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c0b2cf0 0x7fa35c1f2660 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 >> 172.21.15.79:0/1871241403 conn(0x7fa35c0b19f0 msgr2=0x7fa35c072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:09.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 shutdown_connections 2024-06-10T00:16:09.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.881+0000 7fa3638da640 1 -- 172.21.15.79:0/1871241403 wait complete. 2024-06-10T00:16:09.892 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:16:09.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:16:09.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.991+0000 7fad4344d640 1 Processor -- start 2024-06-10T00:16:09.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.991+0000 7fad4344d640 1 -- start start 2024-06-10T00:16:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad4344d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c1553c0 0x7fad3c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad4344d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad3c0cec50 0x7fad3c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad4344d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3c0b3170 con 0x7fad3c0b2cf0 2024-06-10T00:16:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad4344d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fad3c0b3420 con 0x7fad3c0cec50 2024-06-10T00:16:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad4344d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fad3c0cc750 con 0x7fad3c1553c0 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad419ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad3c0cec50 0x7fad3c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad409e8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fad3c0b2cf0 0x7fad3c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47526/0 (socket says 172.21.15.79:47526) 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad409e8640 1 -- 172.21.15.79:0/1856016711 learned_addr learned my addr 172.21.15.79:0/1856016711 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad411e9640 1 --2- 172.21.15.79:0/1856016711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c1553c0 0x7fad3c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad419ea640 1 -- 172.21.15.79:0/1856016711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c1553c0 msgr2=0x7fad3c0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad419ea640 1 --2- 172.21.15.79:0/1856016711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c1553c0 0x7fad3c0cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad419ea640 1 -- 172.21.15.79:0/1856016711 >> v1:172.21.15.79:6789/0 conn(0x7fad3c0b2cf0 legacy=0x7fad3c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad33fff640 1 -- 172.21.15.79:0/1856016711 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567746635 0 0) 0x7fad3c0b3170 con 0x7fad3c0b2cf0 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.992+0000 7fad419ea640 1 -- 172.21.15.79:0/1856016711 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c0cca30 con 0x7fad3c0cec50 2024-06-10T00:16:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.993+0000 7fad411e9640 1 --2- 172.21.15.79:0/1856016711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c1553c0 0x7fad3c0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.993+0000 7fad419ea640 1 --2- 172.21.15.79:0/1856016711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0cec50 0x7fad3c0cf0e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fad34009d90 tx=0x7fad3402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bbe481cc420262 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.993+0000 7fad33fff640 1 -- 172.21.15.79:0/1856016711 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34007740 con 0x7fad3c0cec50 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.993+0000 7fad33fff640 1 -- 172.21.15.79:0/1856016711 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad340078e0 con 0x7fad3c0cec50 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.993+0000 7fad33fff640 1 -- 172.21.15.79:0/1856016711 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34007cb0 con 0x7fad3c0cec50 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.994+0000 7fad4344d640 1 -- 172.21.15.79:0/1856016711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0cec50 msgr2=0x7fad3c0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.994+0000 7fad4344d640 1 --2- 172.21.15.79:0/1856016711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0cec50 0x7fad3c0cf0e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fad34009d90 tx=0x7fad3402a660 comp rx=0 tx=0).stop 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.994+0000 7fad4344d640 1 -- 172.21.15.79:0/1856016711 shutdown_connections 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.994+0000 7fad4344d640 1 --2- 172.21.15.79:0/1856016711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0cec50 0x7fad3c0cf0e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.994+0000 7fad4344d640 1 --2- 172.21.15.79:0/1856016711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c1553c0 0x7fad3c0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.994+0000 7fad4344d640 1 -- 172.21.15.79:0/1856016711 >> 172.21.15.79:0/1856016711 conn(0x7fad3c0b19f0 msgr2=0x7fad3c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:09.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.994+0000 7fad4344d640 1 -- 172.21.15.79:0/1856016711 shutdown_connections 2024-06-10T00:16:09.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.994+0000 7fad4344d640 1 -- 172.21.15.79:0/1856016711 wait complete. 2024-06-10T00:16:09.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.995+0000 7fad4344d640 1 Processor -- start 2024-06-10T00:16:09.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.995+0000 7fad4344d640 1 -- start start 2024-06-10T00:16:09.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad4344d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0b2cf0 0x7fad3c15e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad4344d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c0cec50 0x7fad3c09be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad4344d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad3c1553c0 0x7fad3c1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:09.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad4344d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c1557a0 con 0x7fad3c0b2cf0 2024-06-10T00:16:09.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad4344d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c0b3700 con 0x7fad3c1553c0 2024-06-10T00:16:09.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad4344d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fad3c155920 con 0x7fad3c0cec50 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0b2cf0 0x7fad3c15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0b2cf0 0x7fad3c15e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59062/0 (socket says 172.21.15.79:59062) 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 -- 172.21.15.79:0/1294636991 learned_addr learned my addr 172.21.15.79:0/1294636991 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad409e8640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c0cec50 0x7fad3c09be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad419ea640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad3c1553c0 0x7fad3c1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 -- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c0cec50 msgr2=0x7fad3c09be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c0cec50 0x7fad3c09be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 -- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad3c1553c0 msgr2=0x7fad3c1496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad3c1553c0 0x7fad3c1496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 -- 172.21.15.79:0/1294636991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c09c3b0 con 0x7fad3c0b2cf0 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad409e8640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c0cec50 0x7fad3c09be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad419ea640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad3c1553c0 0x7fad3c1496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:09.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.996+0000 7fad411e9640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0b2cf0 0x7fad3c15e860 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fad3800e7e0 tx=0x7fad3800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.997+0000 7fad31ffb640 1 -- 172.21.15.79:0/1294636991 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3800f040 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.997+0000 7fad31ffb640 1 -- 172.21.15.79:0/1294636991 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad38004030 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.997+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3c09add0 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.997+0000 7fad31ffb640 1 -- 172.21.15.79:0/1294636991 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38004400 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.997+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3c09b390 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.998+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3c0b4540 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.998+0000 7fad31ffb640 1 -- 172.21.15.79:0/1294636991 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad3800c6d0 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.999+0000 7fad31ffb640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2006be30 0x7fad2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.999+0000 7fad409e8640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2006be30 0x7fad2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.999+0000 7fad31ffb640 1 -- 172.21.15.79:0/1294636991 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fad3808add0 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:09.999+0000 7fad409e8640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2006be30 0x7fad2006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad3c153330 tx=0x7fad2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.003+0000 7fad31ffb640 1 -- 172.21.15.79:0/1294636991 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fad3c0b4540 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.217+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad3c09ba50 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.217+0000 7fad31ffb640 1 -- 172.21.15.79:0/1294636991 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7fad38017020 con 0x7fad3c0b2cf0 2024-06-10T00:16:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:10.217 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:15:37.465229+0000","modified":"2024-06-10T00:15:40.130979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3860098569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3860098569},{"type":"v1","addr":"172.21.15.79:6837","nonce":3860098569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4968,"qdb_cluster":[4968]},"id":2}]} 2024-06-10T00:16:10.217 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-06-10T00:16:10.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2006be30 msgr2=0x7fad2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2006be30 0x7fad2006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad3c153330 tx=0x7fad2c009040 comp rx=0 tx=0).stop 2024-06-10T00:16:10.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0b2cf0 msgr2=0x7fad3c15e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0b2cf0 0x7fad3c15e860 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fad3800e7e0 tx=0x7fad3800eca0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 shutdown_connections 2024-06-10T00:16:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad2006be30 0x7fad2006e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad3c1553c0 0x7fad3c1496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3c0cec50 0x7fad3c09be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 --2- 172.21.15.79:0/1294636991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad3c0b2cf0 0x7fad3c15e860 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 >> 172.21.15.79:0/1294636991 conn(0x7fad3c0b19f0 msgr2=0x7fad3c0ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 shutdown_connections 2024-06-10T00:16:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.219+0000 7fad4344d640 1 -- 172.21.15.79:0/1294636991 wait complete. 2024-06-10T00:16:10.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:16:10.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.330+0000 7fdeed777640 1 Processor -- start 2024-06-10T00:16:10.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.330+0000 7fdeed777640 1 -- start start 2024-06-10T00:16:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdeed777640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdee815a870 0x7fdee806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdeed777640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee80aef70 0x7fdee80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdeed777640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee806e390 con 0x7fdee80af3d0 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdeed777640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdee815ac50 con 0x7fdee815a870 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdeed777640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdee806cdb0 con 0x7fdee80aef70 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdee77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdee80af3d0 0x7fdee80cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47542/0 (socket says 172.21.15.79:47542) 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdee77fe640 1 -- 172.21.15.79:0/2058883333 learned_addr learned my addr 172.21.15.79:0/2058883333 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdee67fc640 1 --2- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee80aef70 0x7fdee80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdee6ffd640 1 --2- 172.21.15.79:0/2058883333 >> v2:172.21.15.117:3300/0 conn(0x7fdee815a870 0x7fdee806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.331+0000 7fdee5ffb640 1 -- 172.21.15.79:0/2058883333 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161056863 0 0) 0x7fdee806e390 con 0x7fdee80af3d0 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.332+0000 7fdee5ffb640 1 -- 172.21.15.79:0/2058883333 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fded0003520 con 0x7fdee80af3d0 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.332+0000 7fdee5ffb640 1 -- 172.21.15.79:0/2058883333 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 501426274 0 0) 0x7fded0003520 con 0x7fdee80af3d0 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.332+0000 7fdee6ffd640 1 -- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee80aef70 msgr2=0x7fdee80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.332+0000 7fdee6ffd640 1 --2- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee80aef70 0x7fdee80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.332+0000 7fdee6ffd640 1 -- 172.21.15.79:0/2058883333 >> v1:172.21.15.79:6789/0 conn(0x7fdee80af3d0 legacy=0x7fdee80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.332+0000 7fdee6ffd640 1 -- 172.21.15.79:0/2058883333 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee806d090 con 0x7fdee815a870 2024-06-10T00:16:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.332+0000 7fdee67fc640 1 --2- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee80aef70 0x7fdee80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.332+0000 7fdee6ffd640 1 --2- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee815a870 0x7fdee806de50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fded800a940 tx=0x7fded802b440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75d2aafa5c655d03 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdee5ffb640 1 -- 172.21.15.79:0/2058883333 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8038070 con 0x7fdee815a870 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdee5ffb640 1 -- 172.21.15.79:0/2058883333 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded8033440 con 0x7fdee815a870 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdee5ffb640 1 -- 172.21.15.79:0/2058883333 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00019f0 con 0x7fdee815a870 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdeed777640 1 -- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee815a870 msgr2=0x7fdee806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdeed777640 1 --2- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee815a870 0x7fdee806de50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fded800a940 tx=0x7fded802b440 comp rx=0 tx=0).stop 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdeed777640 1 -- 172.21.15.79:0/2058883333 shutdown_connections 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdeed777640 1 --2- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee80aef70 0x7fdee80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdeed777640 1 --2- 172.21.15.79:0/2058883333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee815a870 0x7fdee806de50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdeed777640 1 -- 172.21.15.79:0/2058883333 >> 172.21.15.79:0/2058883333 conn(0x7fdee80b19f0 msgr2=0x7fdee80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdeed777640 1 -- 172.21.15.79:0/2058883333 shutdown_connections 2024-06-10T00:16:10.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.333+0000 7fdeed777640 1 -- 172.21.15.79:0/2058883333 wait complete. 2024-06-10T00:16:10.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdeed777640 1 Processor -- start 2024-06-10T00:16:10.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdeed777640 1 -- start start 2024-06-10T00:16:10.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdeed777640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee80aef70 0x7fdee81e3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdeed777640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee80af3d0 0x7fdee81e4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdeed777640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee815a870 0x7fdee814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdeed777640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdee806d930 con 0x7fdee80af3d0 2024-06-10T00:16:10.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdeed777640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdee806d650 con 0x7fdee80aef70 2024-06-10T00:16:10.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdeed777640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdee80b2e40 con 0x7fdee815a870 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdee67fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee80af3d0 0x7fdee81e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdee67fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee80af3d0 0x7fdee81e4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59074/0 (socket says 172.21.15.79:59074) 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.335+0000 7fdee67fc640 1 -- 172.21.15.79:0/1416946124 learned_addr learned my addr 172.21.15.79:0/1416946124 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdee6ffd640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee80aef70 0x7fdee81e3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdee77fe640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee815a870 0x7fdee814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdee67fc640 1 -- 172.21.15.79:0/1416946124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee815a870 msgr2=0x7fdee814d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdee67fc640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee815a870 0x7fdee814d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdee67fc640 1 -- 172.21.15.79:0/1416946124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee80aef70 msgr2=0x7fdee81e3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdee67fc640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee80aef70 0x7fdee81e3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdee67fc640 1 -- 172.21.15.79:0/1416946124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee81e3770 con 0x7fdee80af3d0 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdee67fc640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee80af3d0 0x7fdee81e4810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00ebe0 tx=0x7fdedc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdecf7fe640 1 -- 172.21.15.79:0/1416946124 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc017070 con 0x7fdee80af3d0 2024-06-10T00:16:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdecf7fe640 1 -- 172.21.15.79:0/1416946124 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc00cc30 con 0x7fdee80af3d0 2024-06-10T00:16:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee81e3a50 con 0x7fdee80af3d0 2024-06-10T00:16:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdecf7fe640 1 -- 172.21.15.79:0/1416946124 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc013470 con 0x7fdee80af3d0 2024-06-10T00:16:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.336+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee81e4010 con 0x7fdee80af3d0 2024-06-10T00:16:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.337+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee8067d20 con 0x7fdee80af3d0 2024-06-10T00:16:10.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.338+0000 7fdecf7fe640 1 -- 172.21.15.79:0/1416946124 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdedc01a070 con 0x7fdee80af3d0 2024-06-10T00:16:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.338+0000 7fdecf7fe640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fded406be30 0x7fded406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.338+0000 7fdecf7fe640 1 -- 172.21.15.79:0/1416946124 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fdedc08b2c0 con 0x7fdee80af3d0 2024-06-10T00:16:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.338+0000 7fdee6ffd640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fded406be30 0x7fded406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.338+0000 7fdee6ffd640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fded406be30 0x7fded406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fded8035000 tx=0x7fded802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.342+0000 7fdecf7fe640 1 -- 172.21.15.79:0/1416946124 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdee8067d20 con 0x7fdee80af3d0 2024-06-10T00:16:10.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.549+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdee8068430 con 0x7fdee80af3d0 2024-06-10T00:16:10.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.550+0000 7fdecf7fe640 1 -- 172.21.15.79:0/1416946124 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7fdedc059410 con 0x7fdee80af3d0 2024-06-10T00:16:10.550 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:10.550 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:15:37.465229+0000","modified":"2024-06-10T00:15:40.130979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3860098569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3860098569},{"type":"v1","addr":"172.21.15.79:6837","nonce":3860098569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4968,"qdb_cluster":[4968]},"id":2}]} 2024-06-10T00:16:10.550 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fded406be30 msgr2=0x7fded406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fded406be30 0x7fded406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fded8035000 tx=0x7fded802f000 comp rx=0 tx=0).stop 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee80af3d0 msgr2=0x7fdee81e4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee80af3d0 0x7fdee81e4810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00ebe0 tx=0x7fdedc00c520 comp rx=0 tx=0).stop 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 shutdown_connections 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fded406be30 0x7fded406e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee815a870 0x7fdee814d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee80af3d0 0x7fdee81e4810 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 --2- 172.21.15.79:0/1416946124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee80aef70 0x7fdee81e3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 >> 172.21.15.79:0/1416946124 conn(0x7fdee80b19f0 msgr2=0x7fdee814f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 shutdown_connections 2024-06-10T00:16:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.552+0000 7fdeed777640 1 -- 172.21.15.79:0/1416946124 wait complete. 2024-06-10T00:16:10.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:16:10.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.662+0000 7fb516763640 1 Processor -- start 2024-06-10T00:16:10.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.662+0000 7fb516763640 1 -- start start 2024-06-10T00:16:10.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb516763640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb510165bf0 0x7fb5100b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb516763640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5100b4b20 0x7fb51006e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb516763640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51006d160 con 0x7fb51006e740 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb516763640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb51006dd70 con 0x7fb510165bf0 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb516763640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb51006d440 con 0x7fb5100b4b20 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb50f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5100b4b20 0x7fb51006e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb50ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb510165bf0 0x7fb5100b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb50f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5100b4b20 0x7fb51006e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:48672/0 (socket says 172.21.15.79:48672) 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb50f7fe640 1 -- 172.21.15.79:0/427866723 learned_addr learned my addr 172.21.15.79:0/427866723 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb514d00640 1 --1- 172.21.15.79:0/427866723 >> v1:172.21.15.117:6789/0 conn(0x7fb51006e740 0x7fb5100cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:48998/0 (socket says 172.21.15.79:48998) 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb50f7fe640 1 -- 172.21.15.79:0/427866723 >> v2:172.21.15.117:3300/0 conn(0x7fb510165bf0 msgr2=0x7fb5100b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb50f7fe640 1 --2- 172.21.15.79:0/427866723 >> v2:172.21.15.117:3300/0 conn(0x7fb510165bf0 0x7fb5100b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.663+0000 7fb50f7fe640 1 -- 172.21.15.79:0/427866723 >> v1:172.21.15.117:6789/0 conn(0x7fb51006e740 legacy=0x7fb5100cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.664+0000 7fb50f7fe640 1 -- 172.21.15.79:0/427866723 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51006d720 con 0x7fb5100b4b20 2024-06-10T00:16:10.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.664+0000 7fb50ffff640 1 --2- 172.21.15.79:0/427866723 >> v2:172.21.15.117:3300/0 conn(0x7fb510165bf0 0x7fb5100b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.664+0000 7fb50f7fe640 1 --2- 172.21.15.79:0/427866723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5100b4b20 0x7fb51006e200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb504009870 tx=0x7fb50402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8262cdbc40055ad server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.664+0000 7fb50effd640 1 -- 172.21.15.79:0/427866723 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504037070 con 0x7fb5100b4b20 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.664+0000 7fb50effd640 1 -- 172.21.15.79:0/427866723 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb504032440 con 0x7fb5100b4b20 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.664+0000 7fb50effd640 1 -- 172.21.15.79:0/427866723 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504032810 con 0x7fb5100b4b20 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.665+0000 7fb516763640 1 -- 172.21.15.79:0/427866723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5100b4b20 msgr2=0x7fb51006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.665+0000 7fb516763640 1 --2- 172.21.15.79:0/427866723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5100b4b20 0x7fb51006e200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb504009870 tx=0x7fb50402a270 comp rx=0 tx=0).stop 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.665+0000 7fb516763640 1 -- 172.21.15.79:0/427866723 shutdown_connections 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.665+0000 7fb516763640 1 --2- 172.21.15.79:0/427866723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5100b4b20 0x7fb51006e200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.665+0000 7fb516763640 1 --2- 172.21.15.79:0/427866723 >> v2:172.21.15.117:3300/0 conn(0x7fb510165bf0 0x7fb5100b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.665+0000 7fb516763640 1 -- 172.21.15.79:0/427866723 >> 172.21.15.79:0/427866723 conn(0x7fb5100b19f0 msgr2=0x7fb5100b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.665+0000 7fb516763640 1 -- 172.21.15.79:0/427866723 shutdown_connections 2024-06-10T00:16:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.665+0000 7fb516763640 1 -- 172.21.15.79:0/427866723 wait complete. 2024-06-10T00:16:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.666+0000 7fb516763640 1 Processor -- start 2024-06-10T00:16:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.666+0000 7fb516763640 1 -- start start 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb516763640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb51006e740 0x7fb510160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb516763640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5100b4b20 0x7fb5101fb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb516763640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb510165bf0 0x7fb5100cee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb516763640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5100ccd90 con 0x7fb51006e740 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb516763640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb5100b4f80 con 0x7fb5100b4b20 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb516763640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb5100ccf10 con 0x7fb510165bf0 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb51006e740 0x7fb510160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb51006e740 0x7fb510160c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59078/0 (socket says 172.21.15.79:59078) 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50ffff640 1 -- 172.21.15.79:0/3388165246 learned_addr learned my addr 172.21.15.79:0/3388165246 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb514d00640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb510165bf0 0x7fb5100cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50f7fe640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5100b4b20 0x7fb5101fb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50ffff640 1 -- 172.21.15.79:0/3388165246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb510165bf0 msgr2=0x7fb5100cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50ffff640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb510165bf0 0x7fb5100cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50ffff640 1 -- 172.21.15.79:0/3388165246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5100b4b20 msgr2=0x7fb5101fb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50ffff640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5100b4b20 0x7fb5101fb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.667+0000 7fb50ffff640 1 -- 172.21.15.79:0/3388165246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5101fbda0 con 0x7fb51006e740 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.668+0000 7fb50ffff640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb51006e740 0x7fb510160c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb50000e990 tx=0x7fb50000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.668+0000 7fb50cff9640 1 -- 172.21.15.79:0/3388165246 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500017070 con 0x7fb51006e740 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.668+0000 7fb50cff9640 1 -- 172.21.15.79:0/3388165246 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50000c9e0 con 0x7fb51006e740 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.668+0000 7fb50cff9640 1 -- 172.21.15.79:0/3388165246 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50000cdb0 con 0x7fb51006e740 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.668+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5101eace0 con 0x7fb51006e740 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.668+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5101fc5e0 con 0x7fb51006e740 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.669+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb510068430 con 0x7fb51006e740 2024-06-10T00:16:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.669+0000 7fb50cff9640 1 -- 172.21.15.79:0/3388165246 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb50001a070 con 0x7fb51006e740 2024-06-10T00:16:10.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.670+0000 7fb50cff9640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.670+0000 7fb50cff9640 1 -- 172.21.15.79:0/3388165246 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fb50008ae30 con 0x7fb51006e740 2024-06-10T00:16:10.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.670+0000 7fb50f7fe640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.670+0000 7fb50f7fe640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb504034000 tx=0x7fb50402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.674+0000 7fb50cff9640 1 -- 172.21.15.79:0/3388165246 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb5101fbda0 con 0x7fb51006e740 2024-06-10T00:16:10.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.848+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5100732f0 con 0x7fb51006e740 2024-06-10T00:16:10.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.849+0000 7fb50cff9640 1 -- 172.21.15.79:0/3388165246 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16894 (secure 0 0 0) 0x7fb500059030 con 0x7fb51006e740 2024-06-10T00:16:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:10.849 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:15:39.128132+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:15:35.302215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-10T00:15:36.439347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb4fc06be30 msgr2=0x7fb4fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb504034000 tx=0x7fb50402e000 comp rx=0 tx=0).stop 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb51006e740 msgr2=0x7fb510160c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb51006e740 0x7fb510160c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb50000e990 tx=0x7fb50000ee50 comp rx=0 tx=0).stop 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 shutdown_connections 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb510165bf0 0x7fb5100cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5100b4b20 0x7fb5101fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 --2- 172.21.15.79:0/3388165246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb51006e740 0x7fb510160c10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 >> 172.21.15.79:0/3388165246 conn(0x7fb5100b19f0 msgr2=0x7fb5100b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 shutdown_connections 2024-06-10T00:16:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.851+0000 7fb516763640 1 -- 172.21.15.79:0/3388165246 wait complete. 2024-06-10T00:16:10.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:16:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.963+0000 7fb3b385d640 1 Processor -- start 2024-06-10T00:16:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.963+0000 7fb3b385d640 1 -- start start 2024-06-10T00:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b385d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3ac158770 0x7fb3ac06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b385d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3ac158b50 0x7fb3ac06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b385d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3ac06e670 con 0x7fb3ac06d9b0 2024-06-10T00:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b385d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb3ac06e950 con 0x7fb3ac158b50 2024-06-10T00:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b385d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb3ac06ec30 con 0x7fb3ac158770 2024-06-10T00:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b0df8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3ac158b50 0x7fb3ac06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b1dfa640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb3ac06d9b0 0x7fb3ac06de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47544/0 (socket says 172.21.15.79:47544) 2024-06-10T00:16:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b1dfa640 1 -- 172.21.15.79:0/3777554232 learned_addr learned my addr 172.21.15.79:0/3777554232 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b15f9640 1 --2- 172.21.15.79:0/3777554232 >> v2:172.21.15.117:3300/0 conn(0x7fb3ac158770 0x7fb3ac06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b0df8640 1 -- 172.21.15.79:0/3777554232 >> v2:172.21.15.117:3300/0 conn(0x7fb3ac158770 msgr2=0x7fb3ac06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b0df8640 1 --2- 172.21.15.79:0/3777554232 >> v2:172.21.15.117:3300/0 conn(0x7fb3ac158770 0x7fb3ac06c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b0df8640 1 -- 172.21.15.79:0/3777554232 >> v1:172.21.15.79:6789/0 conn(0x7fb3ac06d9b0 legacy=0x7fb3ac06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb3b0df8640 1 -- 172.21.15.79:0/3777554232 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac0ae890 con 0x7fb3ac158b50 2024-06-10T00:16:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.964+0000 7fb39ffff640 1 -- 172.21.15.79:0/3777554232 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3166446685 0 0) 0x7fb3ac06e670 con 0x7fb3ac06d9b0 2024-06-10T00:16:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb3b0df8640 1 --2- 172.21.15.79:0/3777554232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158b50 0x7fb3ac06c910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac06d880 tx=0x7fb3a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b02791412ad9fbb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb39ffff640 1 -- 172.21.15.79:0/3777554232 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8037070 con 0x7fb3ac158b50 2024-06-10T00:16:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb39ffff640 1 -- 172.21.15.79:0/3777554232 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a8032440 con 0x7fb3ac158b50 2024-06-10T00:16:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb39ffff640 1 -- 172.21.15.79:0/3777554232 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a802ae60 con 0x7fb3ac158b50 2024-06-10T00:16:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb3b385d640 1 -- 172.21.15.79:0/3777554232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158b50 msgr2=0x7fb3ac06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb3b385d640 1 --2- 172.21.15.79:0/3777554232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158b50 0x7fb3ac06c910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac06d880 tx=0x7fb3a802a110 comp rx=0 tx=0).stop 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb3b385d640 1 -- 172.21.15.79:0/3777554232 shutdown_connections 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb3b385d640 1 --2- 172.21.15.79:0/3777554232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158b50 0x7fb3ac06c910 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb3b385d640 1 --2- 172.21.15.79:0/3777554232 >> v2:172.21.15.117:3300/0 conn(0x7fb3ac158770 0x7fb3ac06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.965+0000 7fb3b385d640 1 -- 172.21.15.79:0/3777554232 >> 172.21.15.79:0/3777554232 conn(0x7fb3ac071950 msgr2=0x7fb3ac071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.966+0000 7fb3b385d640 1 -- 172.21.15.79:0/3777554232 shutdown_connections 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.966+0000 7fb3b385d640 1 -- 172.21.15.79:0/3777554232 wait complete. 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.967+0000 7fb3b385d640 1 Processor -- start 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.967+0000 7fb3b385d640 1 -- start start 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.967+0000 7fb3b385d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3ac06d9b0 0x7fb3ac1f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.967+0000 7fb3b385d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158770 0x7fb3ac0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.967+0000 7fb3b385d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3ac158b50 0x7fb3ac0b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.967+0000 7fb3b385d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac0aef30 con 0x7fb3ac158770 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.967+0000 7fb3b385d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac0aedb0 con 0x7fb3ac06d9b0 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.967+0000 7fb3b385d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3ac0af0b0 con 0x7fb3ac158b50 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158770 0x7fb3ac0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158770 0x7fb3ac0b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59096/0 (socket says 172.21.15.79:59096) 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 -- 172.21.15.79:0/2722821904 learned_addr learned my addr 172.21.15.79:0/2722821904 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 -- 172.21.15.79:0/2722821904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3ac158b50 msgr2=0x7fb3ac0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3ac158b50 0x7fb3ac0b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 -- 172.21.15.79:0/2722821904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3ac06d9b0 msgr2=0x7fb3ac1f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3ac06d9b0 0x7fb3ac1f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 -- 172.21.15.79:0/2722821904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac157270 con 0x7fb3ac158770 2024-06-10T00:16:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b0df8640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158770 0x7fb3ac0b4890 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009890 tx=0x7fb3a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb39dffb640 1 -- 172.21.15.79:0/2722821904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8037040 con 0x7fb3ac158770 2024-06-10T00:16:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb39dffb640 1 -- 172.21.15.79:0/2722821904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a8042070 con 0x7fb3ac158770 2024-06-10T00:16:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac157550 con 0x7fb3ac158770 2024-06-10T00:16:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb39dffb640 1 -- 172.21.15.79:0/2722821904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8030960 con 0x7fb3ac158770 2024-06-10T00:16:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.968+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac157b10 con 0x7fb3ac158770 2024-06-10T00:16:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.969+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ac068430 con 0x7fb3ac158770 2024-06-10T00:16:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.970+0000 7fb39dffb640 1 -- 172.21.15.79:0/2722821904 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3a8030b00 con 0x7fb3ac158770 2024-06-10T00:16:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.970+0000 7fb39dffb640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb39006be30 0x7fb39006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.970+0000 7fb39dffb640 1 -- 172.21.15.79:0/2722821904 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fb3a80ab940 con 0x7fb3ac158770 2024-06-10T00:16:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.970+0000 7fb3b15f9640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb39006be30 0x7fb39006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.971+0000 7fb3b15f9640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb39006be30 0x7fb39006e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0006a90 tx=0x7fb3a0006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:10.974+0000 7fb39dffb640 1 -- 172.21.15.79:0/2722821904 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb3a8045360 con 0x7fb3ac158770 2024-06-10T00:16:11.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.188+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb3ac072850 con 0x7fb3ac158770 2024-06-10T00:16:11.188 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:16:11.188+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:16:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.192+0000 7fb39dffb640 1 -- 172.21.15.79:0/2722821904 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7fb3a807a160 con 0x7fb3ac158770 2024-06-10T00:16:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:16:11.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb39006be30 msgr2=0x7fb39006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:11.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb39006be30 0x7fb39006e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0006a90 tx=0x7fb3a0006a20 comp rx=0 tx=0).stop 2024-06-10T00:16:11.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158770 msgr2=0x7fb3ac0b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:11.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158770 0x7fb3ac0b4890 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009890 tx=0x7fb3a80046c0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 shutdown_connections 2024-06-10T00:16:11.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb39006be30 0x7fb39006e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3ac158b50 0x7fb3ac0b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3ac158770 0x7fb3ac0b4890 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 --2- 172.21.15.79:0/2722821904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3ac06d9b0 0x7fb3ac1f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.194+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 >> 172.21.15.79:0/2722821904 conn(0x7fb3ac071950 msgr2=0x7fb3ac1606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:11.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.195+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 shutdown_connections 2024-06-10T00:16:11.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.195+0000 7fb3b385d640 1 -- 172.21.15.79:0/2722821904 wait complete. 2024-06-10T00:16:11.197 INFO:tasks.ceph.mds.a.smithi079.stderr: -5870> 2024-06-10T00:15:43.092+0000 7f3d7d9c4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:16:11.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-10T00:16:11.228 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:16:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.308+0000 7f624b84d640 1 Processor -- start 2024-06-10T00:16:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.309+0000 7f624b84d640 1 -- start start 2024-06-10T00:16:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.309+0000 7f624b84d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62440d0020 0x7f62440d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.309+0000 7f624b84d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f624406e1f0 0x7f624406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.309+0000 7f624b84d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6244155700 con 0x7f6244155320 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.309+0000 7f624b84d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f62440d09c0 con 0x7f624406e1f0 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.309+0000 7f624b84d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f624415b6b0 con 0x7f62440d0020 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f6249dea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f624406e1f0 0x7f624406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f62495e9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6244155320 0x7f62440b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47550/0 (socket says 172.21.15.79:47550) 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f62495e9640 1 -- 172.21.15.79:0/759790524 learned_addr learned my addr 172.21.15.79:0/759790524 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f6248de8640 1 --2- 172.21.15.79:0/759790524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62440d0020 0x7f62440d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f6249dea640 1 -- 172.21.15.79:0/759790524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62440d0020 msgr2=0x7f62440d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f6249dea640 1 --2- 172.21.15.79:0/759790524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62440d0020 0x7f62440d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f6249dea640 1 -- 172.21.15.79:0/759790524 >> v1:172.21.15.79:6789/0 conn(0x7f6244155320 legacy=0x7f62440b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f6237fff640 1 -- 172.21.15.79:0/759790524 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3121441276 0 0) 0x7f6244155700 con 0x7f6244155320 2024-06-10T00:16:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.310+0000 7f6249dea640 1 -- 172.21.15.79:0/759790524 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624415b990 con 0x7f624406e1f0 2024-06-10T00:16:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f6249dea640 1 --2- 172.21.15.79:0/759790524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406e680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f623c009d90 tx=0x7f623c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5618bd5a8c0d6a92 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f6237fff640 1 -- 172.21.15.79:0/759790524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c007740 con 0x7f624406e1f0 2024-06-10T00:16:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f6237fff640 1 -- 172.21.15.79:0/759790524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623c0078e0 con 0x7f624406e1f0 2024-06-10T00:16:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f6237fff640 1 -- 172.21.15.79:0/759790524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c007cb0 con 0x7f624406e1f0 2024-06-10T00:16:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f624b84d640 1 -- 172.21.15.79:0/759790524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 msgr2=0x7f624406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f624b84d640 1 --2- 172.21.15.79:0/759790524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406e680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f623c009d90 tx=0x7f623c02a660 comp rx=0 tx=0).stop 2024-06-10T00:16:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f624b84d640 1 -- 172.21.15.79:0/759790524 shutdown_connections 2024-06-10T00:16:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f624b84d640 1 --2- 172.21.15.79:0/759790524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406e680 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f624b84d640 1 --2- 172.21.15.79:0/759790524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62440d0020 0x7f62440d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f624b84d640 1 -- 172.21.15.79:0/759790524 >> 172.21.15.79:0/759790524 conn(0x7f62440b1d10 msgr2=0x7f62440b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f624b84d640 1 -- 172.21.15.79:0/759790524 shutdown_connections 2024-06-10T00:16:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.311+0000 7f624b84d640 1 -- 172.21.15.79:0/759790524 wait complete. 2024-06-10T00:16:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f624b84d640 1 Processor -- start 2024-06-10T00:16:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f624b84d640 1 -- start start 2024-06-10T00:16:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f624b84d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f624b84d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62440d0020 0x7f6244155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f624b84d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6244155320 0x7f6244155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f624b84d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f624406ebc0 con 0x7f624406e1f0 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f624b84d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f624415bf50 con 0x7f62440d0020 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f624b84d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f624415c7e0 con 0x7f6244155320 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f62495e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f62495e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59146/0 (socket says 172.21.15.79:59146) 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.313+0000 7f62495e9640 1 -- 172.21.15.79:0/4004807767 learned_addr learned my addr 172.21.15.79:0/4004807767 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f6248de8640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62440d0020 0x7f6244155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f6249dea640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6244155320 0x7f6244155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f62495e9640 1 -- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6244155320 msgr2=0x7f6244155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f62495e9640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6244155320 0x7f6244155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f62495e9640 1 -- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62440d0020 msgr2=0x7f6244155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f62495e9640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62440d0020 0x7f6244155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f62495e9640 1 -- 172.21.15.79:0/4004807767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624406dc80 con 0x7f624406e1f0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f6249dea640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6244155320 0x7f6244155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f62495e9640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406d740 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f623800c4d0 tx=0x7f623800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f6235ffb640 1 -- 172.21.15.79:0/4004807767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238018070 con 0x7f624406e1f0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f6235ffb640 1 -- 172.21.15.79:0/4004807767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6238007500 con 0x7f624406e1f0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624415ca30 con 0x7f624406e1f0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f6235ffb640 1 -- 172.21.15.79:0/4004807767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238004a20 con 0x7f624406e1f0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.314+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624415cff0 con 0x7f624406e1f0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.315+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624415b2f0 con 0x7f624406e1f0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.315+0000 7f6235ffb640 1 -- 172.21.15.79:0/4004807767 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f623801b070 con 0x7f624406e1f0 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.316+0000 7f6235ffb640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f622806be30 0x7f622806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.316+0000 7f6235ffb640 1 -- 172.21.15.79:0/4004807767 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6187+0+0 (secure 0 0 0) 0x7f623808a250 con 0x7f624406e1f0 2024-06-10T00:16:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.316+0000 7f6248de8640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f622806be30 0x7f622806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.316+0000 7f6248de8640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f622806be30 0x7f622806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6244068ee0 tx=0x7f6240008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.320+0000 7f6235ffb640 1 -- 172.21.15.79:0/4004807767 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f624415b2f0 con 0x7f624406e1f0 2024-06-10T00:16:11.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:11.528+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f62440acee0 con 0x7f624406e1f0 2024-06-10T00:16:12.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.193+0000 7f6235ffb640 1 -- 172.21.15.79:0/4004807767 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f62440acee0 con 0x7f624406e1f0 2024-06-10T00:16:12.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f622806be30 msgr2=0x7f622806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:12.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f622806be30 0x7f622806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6244068ee0 tx=0x7f6240008040 comp rx=0 tx=0).stop 2024-06-10T00:16:12.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 msgr2=0x7f624406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:12.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406d740 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f623800c4d0 tx=0x7f623800c990 comp rx=0 tx=0).stop 2024-06-10T00:16:12.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 shutdown_connections 2024-06-10T00:16:12.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f622806be30 0x7f622806e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6244155320 0x7f6244155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62440d0020 0x7f6244155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 --2- 172.21.15.79:0/4004807767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f624406e1f0 0x7f624406d740 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.195+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 >> 172.21.15.79:0/4004807767 conn(0x7f62440b1d10 msgr2=0x7f62440b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:12.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.196+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 shutdown_connections 2024-06-10T00:16:12.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.196+0000 7f624b84d640 1 -- 172.21.15.79:0/4004807767 wait complete. 2024-06-10T00:16:12.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-10T00:16:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.355+0000 7ff6e4d77640 1 Processor -- start 2024-06-10T00:16:12.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.355+0000 7ff6e4d77640 1 -- start start 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6e4d77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6e00cf0e0 0x7ff6e00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6e4d77640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e00acd40 con 0x7ff6e0155590 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6e4d77640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e00cf570 con 0x7ff6e00cec60 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6e4d77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e015bfe0 con 0x7ff6e00cf0e0 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6de59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff6e0155590 0x7ff6e015b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47564/0 (socket says 172.21.15.79:47564) 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6de59c640 1 -- 172.21.15.79:0/1072753477 learned_addr learned my addr 172.21.15.79:0/1072753477 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255576023 0 0) 0x7ff6e00acd40 con 0x7ff6e0155590 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6cc003520 con 0x7ff6e0155590 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6ded9d640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6e00cf0e0 0x7ff6e00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 46001649 0 0) 0x7ff6cc003520 con 0x7ff6e0155590 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6e00cf0e0 msgr2=0x7ff6e00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6e00cf0e0 0x7ff6e00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 >> v1:172.21.15.117:6789/0 conn(0x7ff6e00cec60 legacy=0x7ff6e00ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e015c2c0 con 0x7ff6e0155590 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7ff6d80019f0 con 0x7ff6e0155590 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 >> v1:172.21.15.79:6789/0 conn(0x7ff6e0155590 legacy=0x7ff6e015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0039e0 0x7ff6cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6e00cf0e0 0x7ff6cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc004d40 0x7ff6cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e015bfe0 con 0x7ff6cc004d40 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc00bb50 con 0x7ff6cc0039e0 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6cc00bd20 con 0x7ff6e00cf0e0 2024-06-10T00:16:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.356+0000 7ff6ded9d640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc004d40 0x7ff6cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.357+0000 7ff6de59c640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0039e0 0x7ff6cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.357+0000 7ff6ddd9b640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6e00cf0e0 0x7ff6cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.357+0000 7ff6ded9d640 1 -- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6e00cf0e0 msgr2=0x7ff6cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.357+0000 7ff6ded9d640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6e00cf0e0 0x7ff6cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.357+0000 7ff6ded9d640 1 -- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0039e0 msgr2=0x7ff6cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.357+0000 7ff6ded9d640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0039e0 0x7ff6cc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.357+0000 7ff6ded9d640 1 -- 172.21.15.79:0/1072753477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6cc003520 con 0x7ff6cc004d40 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.357+0000 7ff6ded9d640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc004d40 0x7ff6cc0051c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000ba60 tx=0x7ff6cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827964e1d5b8df0f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0030070 con 0x7ff6cc004d40 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d002ae10 con 0x7ff6cc004d40 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6dd59a640 1 -- 172.21.15.79:0/1072753477 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000b600 con 0x7ff6cc004d40 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6e4d77640 1 -- 172.21.15.79:0/1072753477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc004d40 msgr2=0x7ff6cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6e4d77640 1 --2- 172.21.15.79:0/1072753477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc004d40 0x7ff6cc0051c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000ba60 tx=0x7ff6cc005830 comp rx=0 tx=0).stop 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6ded9d640 1 -- 172.21.15.79:0/1072753477 reap_dead start 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6e4d77640 1 -- 172.21.15.79:0/1072753477 shutdown_connections 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6e4d77640 1 -- 172.21.15.79:0/1072753477 >> 172.21.15.79:0/1072753477 conn(0x7ff6e00b1980 msgr2=0x7ff6e00b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6e4d77640 1 -- 172.21.15.79:0/1072753477 shutdown_connections 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.358+0000 7ff6e4d77640 1 -- 172.21.15.79:0/1072753477 wait complete. 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.359+0000 7ff6e4d77640 1 Processor -- start 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6e4d77640 1 -- start start 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6e4d77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc004d40 0x7ff6e0148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6e4d77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e015c500 0x7ff6e006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6e4d77640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6e015c980 0x7ff6e0159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6e4d77640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e00b26d0 con 0x7ff6e015c500 2024-06-10T00:16:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6e4d77640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e00ad2e0 con 0x7ff6e015c980 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6e4d77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e015bb70 con 0x7ff6cc004d40 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6ddd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e015c500 0x7ff6e006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6ddd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e015c500 0x7ff6e006d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59166/0 (socket says 172.21.15.79:59166) 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.360+0000 7ff6ddd9b640 1 -- 172.21.15.79:0/2950815305 learned_addr learned my addr 172.21.15.79:0/2950815305 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6de59c640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc004d40 0x7ff6e0148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6ded9d640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6e015c980 0x7ff6e0159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6ddd9b640 1 -- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc004d40 msgr2=0x7ff6e0148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6ddd9b640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc004d40 0x7ff6e0148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6ddd9b640 1 -- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6e015c980 msgr2=0x7ff6e0159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6ddd9b640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6e015c980 0x7ff6e0159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6ddd9b640 1 -- 172.21.15.79:0/2950815305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e0149640 con 0x7ff6e015c500 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6de59c640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc004d40 0x7ff6e0148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6ded9d640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6e015c980 0x7ff6e0159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6ddd9b640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e015c500 0x7ff6e006d7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800f880 tx=0x7ff6c800fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/2950815305 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8001d20 con 0x7ff6e015c500 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/2950815305 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c8018070 con 0x7ff6e015c500 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e0149920 con 0x7ff6e015c500 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/2950815305 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800d730 con 0x7ff6e015c500 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.361+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e0149ee0 con 0x7ff6e015c500 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.362+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e0068540 con 0x7ff6e015c500 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.362+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/2950815305 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6c800d8d0 con 0x7ff6e015c500 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.363+0000 7ff6d6ffd640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff6c006be30 0x7ff6c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.363+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/2950815305 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6187+0+0 (secure 0 0 0) 0x7ff6c808adf0 con 0x7ff6e015c500 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.363+0000 7ff6de59c640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff6c006be30 0x7ff6c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.363+0000 7ff6de59c640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff6c006be30 0x7ff6c006e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8004d00 tx=0x7ff6d8006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:12.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.367+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/2950815305 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff6c8059650 con 0x7ff6e015c500 2024-06-10T00:16:12.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:12.543+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff6e0154c20 con 0x7ff6e015c500 2024-06-10T00:16:13.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.194+0000 7ff6d6ffd640 1 -- 172.21.15.79:0/2950815305 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) ==== 181+0+0 (secure 0 0 0) 0x7ff6c8058f50 con 0x7ff6e015c500 2024-06-10T00:16:13.194 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-06-10T00:16:13.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff6c006be30 msgr2=0x7ff6c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:13.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff6c006be30 0x7ff6c006e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8004d00 tx=0x7ff6d8006040 comp rx=0 tx=0).stop 2024-06-10T00:16:13.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e015c500 msgr2=0x7ff6e006d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:13.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e015c500 0x7ff6e006d7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800f880 tx=0x7ff6c800fd40 comp rx=0 tx=0).stop 2024-06-10T00:16:13.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 shutdown_connections 2024-06-10T00:16:13.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff6c006be30 0x7ff6c006e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6e015c980 0x7ff6e0159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e015c500 0x7ff6e006d7a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 --2- 172.21.15.79:0/2950815305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc004d40 0x7ff6e0148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.197+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 >> 172.21.15.79:0/2950815305 conn(0x7ff6e00b1980 msgr2=0x7ff6e00ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:13.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.198+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 shutdown_connections 2024-06-10T00:16:13.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.198+0000 7ff6e4d77640 1 -- 172.21.15.79:0/2950815305 wait complete. 2024-06-10T00:16:13.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-10T00:16:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.314+0000 7fd51e59e640 1 Processor -- start 2024-06-10T00:16:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.314+0000 7fd51e59e640 1 -- start start 2024-06-10T00:16:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.315+0000 7fd51e59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5180d2a80 0x7fd5180d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.315+0000 7fd51e59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5180d0b80 0x7fd51806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.315+0000 7fd51e59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51806d310 con 0x7fd518161710 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.315+0000 7fd51e59e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd5180cf8c0 con 0x7fd5180d0b80 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.315+0000 7fd51e59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd51806d8d0 con 0x7fd5180d2a80 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.315+0000 7fd51dd9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5180d0b80 0x7fd51806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.315+0000 7fd51dd9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5180d0b80 0x7fd51806bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59168/0 (socket says 172.21.15.79:59168) 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.315+0000 7fd51dd9d640 1 -- 172.21.15.79:0/3158777490 learned_addr learned my addr 172.21.15.79:0/3158777490 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.316+0000 7fd51dd9d640 1 -- 172.21.15.79:0/3158777490 >> v2:172.21.15.117:3300/0 conn(0x7fd5180d2a80 msgr2=0x7fd5180d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.316+0000 7fd51dd9d640 1 --2- 172.21.15.79:0/3158777490 >> v2:172.21.15.117:3300/0 conn(0x7fd5180d2a80 0x7fd5180d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.316+0000 7fd51dd9d640 1 -- 172.21.15.79:0/3158777490 >> v1:172.21.15.117:6789/0 conn(0x7fd518161710 legacy=0x7fd5180d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.316+0000 7fd51dd9d640 1 -- 172.21.15.79:0/3158777490 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51806d5f0 con 0x7fd5180d0b80 2024-06-10T00:16:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.316+0000 7fd51dd9d640 1 --2- 172.21.15.79:0/3158777490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d0b80 0x7fd51806bdd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd5180b38b0 tx=0x7fd51002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a885e5da3b55b911 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd50ffff640 1 -- 172.21.15.79:0/3158777490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510037070 con 0x7fd5180d0b80 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd50ffff640 1 -- 172.21.15.79:0/3158777490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd510032440 con 0x7fd5180d0b80 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd50ffff640 1 -- 172.21.15.79:0/3158777490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510032810 con 0x7fd5180d0b80 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd51e59e640 1 -- 172.21.15.79:0/3158777490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d0b80 msgr2=0x7fd51806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd51e59e640 1 --2- 172.21.15.79:0/3158777490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d0b80 0x7fd51806bdd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd5180b38b0 tx=0x7fd51002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd51e59e640 1 -- 172.21.15.79:0/3158777490 shutdown_connections 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd51e59e640 1 --2- 172.21.15.79:0/3158777490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d0b80 0x7fd51806bdd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd51e59e640 1 --2- 172.21.15.79:0/3158777490 >> v2:172.21.15.117:3300/0 conn(0x7fd5180d2a80 0x7fd5180d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd51e59e640 1 -- 172.21.15.79:0/3158777490 >> 172.21.15.79:0/3158777490 conn(0x7fd51809d1f0 msgr2=0x7fd5180d3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd51e59e640 1 -- 172.21.15.79:0/3158777490 shutdown_connections 2024-06-10T00:16:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.317+0000 7fd51e59e640 1 -- 172.21.15.79:0/3158777490 wait complete. 2024-06-10T00:16:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.318+0000 7fd51e59e640 1 Processor -- start 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51e59e640 1 -- start start 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51e59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5180d0b80 0x7fd5180c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51e59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d2a80 0x7fd51814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51e59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd518161710 0x7fd5180b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51e59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd518161c70 con 0x7fd5180d2a80 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51e59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd518161af0 con 0x7fd518161710 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51e59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5180d0ff0 con 0x7fd5180d0b80 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51cd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d2a80 0x7fd51814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51cd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d2a80 0x7fd51814f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59172/0 (socket says 172.21.15.79:59172) 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.319+0000 7fd51cd9b640 1 -- 172.21.15.79:0/1588683752 learned_addr learned my addr 172.21.15.79:0/1588683752 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51dd9d640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd518161710 0x7fd5180b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51d59c640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5180d0b80 0x7fd5180c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51cd9b640 1 -- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5180d0b80 msgr2=0x7fd5180c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51cd9b640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5180d0b80 0x7fd5180c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51cd9b640 1 -- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd518161710 msgr2=0x7fd5180b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51cd9b640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd518161710 0x7fd5180b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51cd9b640 1 -- 172.21.15.79:0/1588683752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51814f810 con 0x7fd5180d2a80 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51dd9d640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd518161710 0x7fd5180b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51cd9b640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d2a80 0x7fd51814f2d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd50800b450 tx=0x7fd50800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd50dffb640 1 -- 172.21.15.79:0/1588683752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508015020 con 0x7fd5180d2a80 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd50dffb640 1 -- 172.21.15.79:0/1588683752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd508011890 con 0x7fd5180d2a80 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5180b4bd0 con 0x7fd5180d2a80 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd50dffb640 1 -- 172.21.15.79:0/1588683752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508011c80 con 0x7fd5180d2a80 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.320+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5180b5190 con 0x7fd5180d2a80 2024-06-10T00:16:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.321+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5180683c0 con 0x7fd5180d2a80 2024-06-10T00:16:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.322+0000 7fd50dffb640 1 -- 172.21.15.79:0/1588683752 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd508018020 con 0x7fd5180d2a80 2024-06-10T00:16:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.322+0000 7fd50dffb640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be30 0x7fd4fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.322+0000 7fd50dffb640 1 -- 172.21.15.79:0/1588683752 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5749+0+0 (secure 0 0 0) 0x7fd50808afd0 con 0x7fd5180d2a80 2024-06-10T00:16:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.322+0000 7fd51d59c640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be30 0x7fd4fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.323+0000 7fd51d59c640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be30 0x7fd4fc06e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd514009f60 tx=0x7fd5140094f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.326+0000 7fd50dffb640 1 -- 172.21.15.79:0/1588683752 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd50801f020 con 0x7fd5180d2a80 2024-06-10T00:16:13.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:16:13.439 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:16:13.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:13.503+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd5180b1fc0 con 0x7fd5180d2a80 2024-06-10T00:16:14.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.203+0000 7fd50dffb640 1 -- 172.21.15.79:0/1588683752 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) ==== 169+0+0 (secure 0 0 0) 0x7fd50800d040 con 0x7fd5180d2a80 2024-06-10T00:16:14.203 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be30 msgr2=0x7fd4fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be30 0x7fd4fc06e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd514009f60 tx=0x7fd5140094f0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d2a80 msgr2=0x7fd51814f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d2a80 0x7fd51814f2d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd50800b450 tx=0x7fd50800b910 comp rx=0 tx=0).stop 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 shutdown_connections 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be30 0x7fd4fc06e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd518161710 0x7fd5180b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5180d2a80 0x7fd51814f2d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 --2- 172.21.15.79:0/1588683752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5180d0b80 0x7fd5180c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 >> 172.21.15.79:0/1588683752 conn(0x7fd51809d1f0 msgr2=0x7fd51806bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 shutdown_connections 2024-06-10T00:16:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.207+0000 7fd51e59e640 1 -- 172.21.15.79:0/1588683752 wait complete. 2024-06-10T00:16:14.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-10T00:16:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.321+0000 7fc75c33b640 1 Processor -- start 2024-06-10T00:16:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.321+0000 7fc75c33b640 1 -- start start 2024-06-10T00:16:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc75c33b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540b2bf0 0x7fc7540d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc75c33b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7540d0560 0x7fc75406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc75c33b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7540b3080 con 0x7fc7540b3b40 2024-06-10T00:16:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc75c33b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc7540d09b0 con 0x7fc7540d0560 2024-06-10T00:16:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc75c33b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc75415c870 con 0x7fc7540b2bf0 2024-06-10T00:16:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc75a0d7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc7540b3b40 0x7fc7540b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47578/0 (socket says 172.21.15.79:47578) 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc75a0d7640 1 -- 172.21.15.79:0/3777097945 learned_addr learned my addr 172.21.15.79:0/3777097945 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc7598d6640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540b2bf0 0x7fc7540d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc75a8d8640 1 --2- 172.21.15.79:0/3777097945 >> v2:172.21.15.117:3300/0 conn(0x7fc7540d0560 0x7fc75406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.322+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819571615 0 0) 0x7fc7540b3080 con 0x7fc7540b3b40 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc740003520 con 0x7fc7540b3b40 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 952917653 0 0) 0x7fc740003520 con 0x7fc7540b3b40 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540b2bf0 msgr2=0x7fc7540d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540b2bf0 0x7fc7540d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 >> v2:172.21.15.117:3300/0 conn(0x7fc7540d0560 msgr2=0x7fc75406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 --2- 172.21.15.79:0/3777097945 >> v2:172.21.15.117:3300/0 conn(0x7fc7540d0560 0x7fc75406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75415cb50 con 0x7fc7540b3b40 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fc750001670 con 0x7fc7540b3b40 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 >> v1:172.21.15.79:6789/0 conn(0x7fc7540b3b40 legacy=0x7fc7540b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7400039b0 0x7fc740003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc740004800 0x7fc740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540b2bf0 0x7fc7400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7540d09b0 con 0x7fc7400039b0 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc75415c870 con 0x7fc740004800 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc74000b9c0 con 0x7fc7540b2bf0 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc75a8d8640 1 --2- 172.21.15.79:0/3777097945 >> v2:172.21.15.117:3300/0 conn(0x7fc7540d0560 0x7fc75406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc75a0d7640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7400039b0 0x7fc740003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc7598d6640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc740004800 0x7fc740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc75a8d8640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540b2bf0 0x7fc7400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc75a0d7640 1 -- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540b2bf0 msgr2=0x7fc7400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc75a0d7640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540b2bf0 0x7fc7400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc75a0d7640 1 -- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc740004800 msgr2=0x7fc740004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc75a0d7640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc740004800 0x7fc740004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.323+0000 7fc75a0d7640 1 -- 172.21.15.79:0/3777097945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc740003520 con 0x7fc7400039b0 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.324+0000 7fc75a0d7640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7400039b0 0x7fc740003dd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc75000c210 tx=0x7fc740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b979d1e6f50a35 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.324+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750007d50 con 0x7fc7400039b0 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.324+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc750005af0 con 0x7fc7400039b0 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.324+0000 7fc7590d5640 1 -- 172.21.15.79:0/3777097945 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750007070 con 0x7fc7400039b0 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.324+0000 7fc75c33b640 1 -- 172.21.15.79:0/3777097945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7400039b0 msgr2=0x7fc740003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.324+0000 7fc75c33b640 1 --2- 172.21.15.79:0/3777097945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7400039b0 0x7fc740003dd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc75000c210 tx=0x7fc740005830 comp rx=0 tx=0).stop 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.324+0000 7fc75a8d8640 1 -- 172.21.15.79:0/3777097945 reap_dead start 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.325+0000 7fc75c33b640 1 -- 172.21.15.79:0/3777097945 shutdown_connections 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.325+0000 7fc75c33b640 1 -- 172.21.15.79:0/3777097945 >> 172.21.15.79:0/3777097945 conn(0x7fc7540b1d10 msgr2=0x7fc7540b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.325+0000 7fc75c33b640 1 -- 172.21.15.79:0/3777097945 shutdown_connections 2024-06-10T00:16:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.325+0000 7fc75c33b640 1 -- 172.21.15.79:0/3777097945 wait complete. 2024-06-10T00:16:14.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.326+0000 7fc75c33b640 1 Processor -- start 2024-06-10T00:16:14.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.326+0000 7fc75c33b640 1 -- start start 2024-06-10T00:16:14.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.326+0000 7fc75c33b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7400039b0 0x7fc75414b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.326+0000 7fc75c33b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7541f1880 0x7fc7540af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc75c33b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540ae780 0x7fc7541e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc75c33b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc75415d3f0 con 0x7fc7541f1880 2024-06-10T00:16:14.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc75c33b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc75415d110 con 0x7fc7400039b0 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc75c33b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc7540b3f20 con 0x7fc7540ae780 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7541f1880 0x7fc7540af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7541f1880 0x7fc7540af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59192/0 (socket says 172.21.15.79:59192) 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 -- 172.21.15.79:0/3016539441 learned_addr learned my addr 172.21.15.79:0/3016539441 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 -- 172.21.15.79:0/3016539441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540ae780 msgr2=0x7fc7541e47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540ae780 0x7fc7541e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 -- 172.21.15.79:0/3016539441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7400039b0 msgr2=0x7fc75414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc75a0d7640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7400039b0 0x7fc75414b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7400039b0 0x7fc75414b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 -- 172.21.15.79:0/3016539441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7541e2310 con 0x7fc7541f1880 2024-06-10T00:16:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc7598d6640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7541f1880 0x7fc7540af600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc7440114c0 tx=0x7fc744011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc74affd640 1 -- 172.21.15.79:0/3016539441 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744015930 con 0x7fc7541f1880 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc74affd640 1 -- 172.21.15.79:0/3016539441 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc744015ad0 con 0x7fc7541f1880 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc74affd640 1 -- 172.21.15.79:0/3016539441 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74401d400 con 0x7fc7541f1880 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7540aff30 con 0x7fc7541f1880 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.327+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7541e2890 con 0x7fc7541f1880 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.328+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75415c490 con 0x7fc7541f1880 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.329+0000 7fc74affd640 1 -- 172.21.15.79:0/3016539441 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc74401d5a0 con 0x7fc7541f1880 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.329+0000 7fc74affd640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc73806be30 0x7fc73806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.329+0000 7fc74affd640 1 -- 172.21.15.79:0/3016539441 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fc74408b550 con 0x7fc7541f1880 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.329+0000 7fc75a0d7640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc73806be30 0x7fc73806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.330+0000 7fc75a0d7640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc73806be30 0x7fc73806e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc750033000 tx=0x7fc75002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:14.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.334+0000 7fc74affd640 1 -- 172.21.15.79:0/3016539441 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc75415c490 con 0x7fc7541f1880 2024-06-10T00:16:14.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.507+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc7540008d0 con 0x7fc7541f1880 2024-06-10T00:16:14.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.510+0000 7fc74affd640 1 -- 172.21.15.79:0/3016539441 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fc744019030 con 0x7fc7541f1880 2024-06-10T00:16:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc73806be30 msgr2=0x7fc73806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc73806be30 0x7fc73806e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc750033000 tx=0x7fc75002e000 comp rx=0 tx=0).stop 2024-06-10T00:16:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7541f1880 msgr2=0x7fc7540af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7541f1880 0x7fc7540af600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc7440114c0 tx=0x7fc744011980 comp rx=0 tx=0).stop 2024-06-10T00:16:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 shutdown_connections 2024-06-10T00:16:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc73806be30 0x7fc73806e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7540ae780 0x7fc7541e47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7541f1880 0x7fc7540af600 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 --2- 172.21.15.79:0/3016539441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7400039b0 0x7fc75414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 >> 172.21.15.79:0/3016539441 conn(0x7fc7540b1d10 msgr2=0x7fc7540b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 shutdown_connections 2024-06-10T00:16:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.512+0000 7fc75c33b640 1 -- 172.21.15.79:0/3016539441 wait complete. 2024-06-10T00:16:14.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-06-10T00:16:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.622+0000 7fc6d6541640 1 Processor -- start 2024-06-10T00:16:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.622+0000 7fc6d6541640 1 -- start start 2024-06-10T00:16:14.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6d6541640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6d0156830 0x7fc6d0071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6d6541640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6d015c7f0 0x7fc6d0165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6d6541640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d00725f0 con 0x7fc6d0072130 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6d6541640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc6d00b3090 con 0x7fc6d0156830 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6d6541640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc6d00728d0 con 0x7fc6d015c7f0 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6cffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6d0156830 0x7fc6d0071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6cf7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc6d0072130 0x7fc6d00cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47594/0 (socket says 172.21.15.79:47594) 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6cf7fe640 1 -- 172.21.15.79:0/763000494 learned_addr learned my addr 172.21.15.79:0/763000494 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6cffff640 1 -- 172.21.15.79:0/763000494 >> v2:172.21.15.117:3300/0 conn(0x7fc6d015c7f0 msgr2=0x7fc6d0165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6d4ade640 1 --2- 172.21.15.79:0/763000494 >> v2:172.21.15.117:3300/0 conn(0x7fc6d015c7f0 0x7fc6d0165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6ceffd640 1 -- 172.21.15.79:0/763000494 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847172231 0 0) 0x7fc6d00725f0 con 0x7fc6d0072130 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6cffff640 1 --2- 172.21.15.79:0/763000494 >> v2:172.21.15.117:3300/0 conn(0x7fc6d015c7f0 0x7fc6d0165cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6cffff640 1 -- 172.21.15.79:0/763000494 >> v1:172.21.15.79:6789/0 conn(0x7fc6d0072130 legacy=0x7fc6d00cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6cffff640 1 -- 172.21.15.79:0/763000494 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d0072bb0 con 0x7fc6d0156830 2024-06-10T00:16:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.623+0000 7fc6d4ade640 1 --2- 172.21.15.79:0/763000494 >> v2:172.21.15.117:3300/0 conn(0x7fc6d015c7f0 0x7fc6d0165cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.624+0000 7fc6cffff640 1 --2- 172.21.15.79:0/763000494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0156830 0x7fc6d0071bf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00aef60 tx=0x7fc6c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ea8d959c433581 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.624+0000 7fc6ceffd640 1 -- 172.21.15.79:0/763000494 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0037070 con 0x7fc6d0156830 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.624+0000 7fc6ceffd640 1 -- 172.21.15.79:0/763000494 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c0032440 con 0x7fc6d0156830 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.624+0000 7fc6ceffd640 1 -- 172.21.15.79:0/763000494 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0032810 con 0x7fc6d0156830 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.625+0000 7fc6d6541640 1 -- 172.21.15.79:0/763000494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0156830 msgr2=0x7fc6d0071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.625+0000 7fc6d6541640 1 --2- 172.21.15.79:0/763000494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0156830 0x7fc6d0071bf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00aef60 tx=0x7fc6c002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.625+0000 7fc6d6541640 1 -- 172.21.15.79:0/763000494 shutdown_connections 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.625+0000 7fc6d6541640 1 --2- 172.21.15.79:0/763000494 >> v2:172.21.15.117:3300/0 conn(0x7fc6d015c7f0 0x7fc6d0165cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.625+0000 7fc6d6541640 1 --2- 172.21.15.79:0/763000494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0156830 0x7fc6d0071bf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.625+0000 7fc6d6541640 1 -- 172.21.15.79:0/763000494 >> 172.21.15.79:0/763000494 conn(0x7fc6d00b19f0 msgr2=0x7fc6d00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.625+0000 7fc6d6541640 1 -- 172.21.15.79:0/763000494 shutdown_connections 2024-06-10T00:16:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.625+0000 7fc6d6541640 1 -- 172.21.15.79:0/763000494 wait complete. 2024-06-10T00:16:14.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.626+0000 7fc6d6541640 1 Processor -- start 2024-06-10T00:16:14.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.626+0000 7fc6d6541640 1 -- start start 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d6541640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0072130 0x7fc6d01f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d6541640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6d0156830 0x7fc6d01f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d6541640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6d015c7f0 0x7fc6d00aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d6541640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d00ccf00 con 0x7fc6d0072130 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d6541640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d00ccd80 con 0x7fc6d015c7f0 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d6541640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d00cd080 con 0x7fc6d0156830 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0072130 0x7fc6d01f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0072130 0x7fc6d01f4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59212/0 (socket says 172.21.15.79:59212) 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 -- 172.21.15.79:0/3301960680 learned_addr learned my addr 172.21.15.79:0/3301960680 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 -- 172.21.15.79:0/3301960680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6d0156830 msgr2=0x7fc6d01f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d4ade640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6d015c7f0 0x7fc6d00aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6d0156830 0x7fc6d01f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 -- 172.21.15.79:0/3301960680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6d015c7f0 msgr2=0x7fc6d00aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6d015c7f0 0x7fc6d00aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 -- 172.21.15.79:0/3301960680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d014e640 con 0x7fc6d0072130 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d4ade640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6d015c7f0 0x7fc6d00aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6cffff640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0072130 0x7fc6d01f4ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000c00 tx=0x7fc6c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6ccff9640 1 -- 172.21.15.79:0/3301960680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0037040 con 0x7fc6d0072130 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6ccff9640 1 -- 172.21.15.79:0/3301960680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c0042070 con 0x7fc6d0072130 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d01f5530 con 0x7fc6d0072130 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6ccff9640 1 -- 172.21.15.79:0/3301960680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0030a50 con 0x7fc6d0072130 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.627+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d014e8b0 con 0x7fc6d0072130 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.628+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d0068430 con 0x7fc6d0072130 2024-06-10T00:16:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.629+0000 7fc6ccff9640 1 -- 172.21.15.79:0/3301960680 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6c0030bf0 con 0x7fc6d0072130 2024-06-10T00:16:14.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.629+0000 7fc6ccff9640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc6bc06be30 0x7fc6bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:14.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.629+0000 7fc6ccff9640 1 -- 172.21.15.79:0/3301960680 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fc6c00ab6c0 con 0x7fc6d0072130 2024-06-10T00:16:14.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.629+0000 7fc6cf7fe640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc6bc06be30 0x7fc6bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:14.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.630+0000 7fc6cf7fe640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc6bc06be30 0x7fc6bc06e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4007fd0 tx=0x7fc6c4007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:14.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.634+0000 7fc6ccff9640 1 -- 172.21.15.79:0/3301960680 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc6c0045360 con 0x7fc6d0072130 2024-06-10T00:16:14.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:14.874+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7fc6d015ba70 con 0x7fc6d0072130 2024-06-10T00:16:15.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.204+0000 7fc6ccff9640 1 -- 172.21.15.79:0/3301960680 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v99) ==== 142+0+0 (secure 0 0 0) 0x7fc6c007a270 con 0x7fc6d0072130 2024-06-10T00:16:15.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc6bc06be30 msgr2=0x7fc6bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc6bc06be30 0x7fc6bc06e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4007fd0 tx=0x7fc6c4007920 comp rx=0 tx=0).stop 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0072130 msgr2=0x7fc6d01f4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0072130 0x7fc6d01f4ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000c00 tx=0x7fc6c00046c0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 shutdown_connections 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc6bc06be30 0x7fc6bc06e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6d015c7f0 0x7fc6d00aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6d0156830 0x7fc6d01f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 --2- 172.21.15.79:0/3301960680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0072130 0x7fc6d01f4ff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.206+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 >> 172.21.15.79:0/3301960680 conn(0x7fc6d00b19f0 msgr2=0x7fc6d0155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.207+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 shutdown_connections 2024-06-10T00:16:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.207+0000 7fc6d6541640 1 -- 172.21.15.79:0/3301960680 wait complete. 2024-06-10T00:16:15.218 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-06-10T00:16:15.218 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-06-10T00:16:15.218 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-06-10T00:16:15.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:16:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.318+0000 7f2771012640 1 Processor -- start 2024-06-10T00:16:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.318+0000 7f2771012640 1 -- start start 2024-06-10T00:16:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.319+0000 7f2771012640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f276c0cf360 0x7f276c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.319+0000 7f2771012640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c0b3420 con 0x7f276c1553c0 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.319+0000 7f2771012640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c0cc750 con 0x7f276c0cd230 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.319+0000 7f2771012640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f276c0cca30 con 0x7f276c0cf360 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.319+0000 7f276b59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f276c0cf360 0x7f276c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.319+0000 7f276ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f276c1553c0 0x7f276c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47608/0 (socket says 172.21.15.79:47608) 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.319+0000 7f276ad9d640 1 -- 172.21.15.79:0/1462001583 learned_addr learned my addr 172.21.15.79:0/1462001583 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.320+0000 7f276b59e640 1 -- 172.21.15.79:0/1462001583 >> v1:172.21.15.117:6789/0 conn(0x7f276c0cd230 legacy=0x7f276c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.320+0000 7f276b59e640 1 -- 172.21.15.79:0/1462001583 >> v1:172.21.15.79:6789/0 conn(0x7f276c1553c0 legacy=0x7f276c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.320+0000 7f2769d9b640 1 -- 172.21.15.79:0/1462001583 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362034713 0 0) 0x7f276c0b3420 con 0x7f276c1553c0 2024-06-10T00:16:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.320+0000 7f276b59e640 1 -- 172.21.15.79:0/1462001583 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0ccd10 con 0x7f276c0cf360 2024-06-10T00:16:15.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.320+0000 7f276b59e640 1 --2- 172.21.15.79:0/1462001583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c0cf360 0x7f276c0b2cf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f275c0097a0 tx=0x7f275c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be578ed2d368126d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2769d9b640 1 -- 172.21.15.79:0/1462001583 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c037070 con 0x7f276c0cf360 2024-06-10T00:16:15.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2769d9b640 1 -- 172.21.15.79:0/1462001583 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c032440 con 0x7f276c0cf360 2024-06-10T00:16:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2769d9b640 1 -- 172.21.15.79:0/1462001583 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c032810 con 0x7f276c0cf360 2024-06-10T00:16:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2771012640 1 -- 172.21.15.79:0/1462001583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c0cf360 msgr2=0x7f276c0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2771012640 1 --2- 172.21.15.79:0/1462001583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c0cf360 0x7f276c0b2cf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f275c0097a0 tx=0x7f275c02a230 comp rx=0 tx=0).stop 2024-06-10T00:16:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2771012640 1 -- 172.21.15.79:0/1462001583 shutdown_connections 2024-06-10T00:16:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2771012640 1 --2- 172.21.15.79:0/1462001583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c0cf360 0x7f276c0b2cf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2771012640 1 -- 172.21.15.79:0/1462001583 >> 172.21.15.79:0/1462001583 conn(0x7f276c0b19f0 msgr2=0x7f276c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2771012640 1 -- 172.21.15.79:0/1462001583 shutdown_connections 2024-06-10T00:16:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.321+0000 7f2771012640 1 -- 172.21.15.79:0/1462001583 wait complete. 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f2771012640 1 Processor -- start 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f2771012640 1 -- start start 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f2771012640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cd230 0x7f276c09ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f2771012640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cf360 0x7f276c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f2771012640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c1553c0 0x7f276c151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f2771012640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f276c155920 con 0x7f276c1553c0 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f2771012640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f276c1557a0 con 0x7f276c0cf360 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f2771012640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f276c071030 con 0x7f276c0cd230 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.323+0000 7f276b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c1553c0 0x7f276c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c1553c0 0x7f276c151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59228/0 (socket says 172.21.15.79:59228) 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276b59e640 1 -- 172.21.15.79:0/1323516488 learned_addr learned my addr 172.21.15.79:0/1323516488 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276ad9d640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cd230 0x7f276c09ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276a59c640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cf360 0x7f276c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276b59e640 1 -- 172.21.15.79:0/1323516488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cd230 msgr2=0x7f276c09ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276b59e640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cd230 0x7f276c09ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276b59e640 1 -- 172.21.15.79:0/1323516488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cf360 msgr2=0x7f276c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276b59e640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cf360 0x7f276c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276b59e640 1 -- 172.21.15.79:0/1323516488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c15d380 con 0x7f276c1553c0 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f276b59e640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c1553c0 0x7f276c151570 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f275c0097a0 tx=0x7f275c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f27637fe640 1 -- 172.21.15.79:0/1323516488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c037040 con 0x7f276c1553c0 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f27637fe640 1 -- 172.21.15.79:0/1323516488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c042070 con 0x7f276c1553c0 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f27637fe640 1 -- 172.21.15.79:0/1323516488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c030b30 con 0x7f276c1553c0 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c15d940 con 0x7f276c1553c0 2024-06-10T00:16:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.324+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c15df00 con 0x7f276c1553c0 2024-06-10T00:16:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.325+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276c068430 con 0x7f276c1553c0 2024-06-10T00:16:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.326+0000 7f27637fe640 1 -- 172.21.15.79:0/1323516488 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f275c030cd0 con 0x7f276c1553c0 2024-06-10T00:16:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.326+0000 7f27637fe640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f274c06be30 0x7f274c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.326+0000 7f27637fe640 1 -- 172.21.15.79:0/1323516488 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f275c0ab930 con 0x7f276c1553c0 2024-06-10T00:16:15.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.326+0000 7f276ad9d640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f274c06be30 0x7f274c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.327+0000 7f276ad9d640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f274c06be30 0x7f274c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f27640012e0 tx=0x7f2764005bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.330+0000 7f27637fe640 1 -- 172.21.15.79:0/1323516488 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f275c07a450 con 0x7f276c1553c0 2024-06-10T00:16:15.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.504+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f276c153440 con 0x7f276c1553c0 2024-06-10T00:16:15.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.505+0000 7f27637fe640 1 -- 172.21.15.79:0/1323516488 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+13245 (secure 0 0 0) 0x7f275c079d50 con 0x7f276c1553c0 2024-06-10T00:16:15.505 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:15.505 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:16:14.195603+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/3860098569":"2024-06-11T00:16:11.189225+0000","172.21.15.79:6835/3860098569":"2024-06-11T00:16:11.189225+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:16:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f274c06be30 msgr2=0x7f274c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f274c06be30 0x7f274c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f27640012e0 tx=0x7f2764005bf0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c1553c0 msgr2=0x7f276c151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c1553c0 0x7f276c151570 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f275c0097a0 tx=0x7f275c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 shutdown_connections 2024-06-10T00:16:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f274c06be30 0x7f274c06e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f276c1553c0 0x7f276c151570 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cf360 0x7f276c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 --2- 172.21.15.79:0/1323516488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cd230 0x7f276c09ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 >> 172.21.15.79:0/1323516488 conn(0x7f276c0b19f0 msgr2=0x7f276c0ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 shutdown_connections 2024-06-10T00:16:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.507+0000 7f2771012640 1 -- 172.21.15.79:0/1323516488 wait complete. 2024-06-10T00:16:15.519 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-10T00:14:31.177808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-10T00:16:15.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-10T00:16:15.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.621+0000 7f18d9f90640 1 Processor -- start 2024-06-10T00:16:15.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.621+0000 7f18d9f90640 1 -- start start 2024-06-10T00:16:15.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d9f90640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f18d4155320 0x7f18d40b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d9f90640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f18d40b34e0 0x7f18d40d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d9f90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 0x7f18d406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d9f90640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f18d4155700 con 0x7f18d40b34e0 2024-06-10T00:16:15.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d9f90640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f18d415b6b0 con 0x7f18d4155320 2024-06-10T00:16:15.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d9f90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18d415b990 con 0x7f18d40d0560 2024-06-10T00:16:15.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f18d40b34e0 0x7f18d40d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f18d40b34e0 0x7f18d40d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59238/0 (socket says 172.21.15.79:59238) 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.622+0000 7f18d2ffd640 1 -- 172.21.15.79:0/3265754820 learned_addr learned my addr 172.21.15.79:0/3265754820 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d37fe640 1 --2- 172.21.15.79:0/3265754820 >> v2:172.21.15.117:3300/0 conn(0x7f18d4155320 0x7f18d40b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d3fff640 1 --2- 172.21.15.79:0/3265754820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 0x7f18d406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d2ffd640 1 -- 172.21.15.79:0/3265754820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 msgr2=0x7f18d406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d2ffd640 1 --2- 172.21.15.79:0/3265754820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 0x7f18d406e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d2ffd640 1 -- 172.21.15.79:0/3265754820 >> v2:172.21.15.117:3300/0 conn(0x7f18d4155320 msgr2=0x7f18d40b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d2ffd640 1 --2- 172.21.15.79:0/3265754820 >> v2:172.21.15.117:3300/0 conn(0x7f18d4155320 0x7f18d40b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d2ffd640 1 -- 172.21.15.79:0/3265754820 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d415bc70 con 0x7f18d40b34e0 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d2ffd640 1 --2- 172.21.15.79:0/3265754820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d40d0020 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f18d40d0c60 tx=0x7f18c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5a50d5b57bfe44 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d27fc640 1 -- 172.21.15.79:0/3265754820 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8037070 con 0x7f18d40b34e0 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.623+0000 7f18d27fc640 1 -- 172.21.15.79:0/3265754820 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c8032440 con 0x7f18d40b34e0 2024-06-10T00:16:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d27fc640 1 -- 172.21.15.79:0/3265754820 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8032810 con 0x7f18d40b34e0 2024-06-10T00:16:15.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 -- 172.21.15.79:0/3265754820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 msgr2=0x7f18d40d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 --2- 172.21.15.79:0/3265754820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d40d0020 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f18d40d0c60 tx=0x7f18c802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 -- 172.21.15.79:0/3265754820 shutdown_connections 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 --2- 172.21.15.79:0/3265754820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 0x7f18d406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 --2- 172.21.15.79:0/3265754820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d40d0020 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 --2- 172.21.15.79:0/3265754820 >> v2:172.21.15.117:3300/0 conn(0x7f18d4155320 0x7f18d40b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 -- 172.21.15.79:0/3265754820 >> 172.21.15.79:0/3265754820 conn(0x7f18d40b1d10 msgr2=0x7f18d40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 -- 172.21.15.79:0/3265754820 shutdown_connections 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.624+0000 7f18d9f90640 1 -- 172.21.15.79:0/3265754820 wait complete. 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.625+0000 7f18d9f90640 1 Processor -- start 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.625+0000 7f18d9f90640 1 -- start start 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d9f90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d409d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d9f90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 0x7f18d41527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d9f90640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d4155320 0x7f18d40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d9f90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18d415b470 con 0x7f18d40b34e0 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d9f90640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18d415b2f0 con 0x7f18d4155320 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d9f90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18d406e730 con 0x7f18d40d0560 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d409d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d409d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59252/0 (socket says 172.21.15.79:59252) 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d37fe640 1 -- 172.21.15.79:0/1523138803 learned_addr learned my addr 172.21.15.79:0/1523138803 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d2ffd640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 0x7f18d41527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.626+0000 7f18d3fff640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d4155320 0x7f18d40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18d37fe640 1 -- 172.21.15.79:0/1523138803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 msgr2=0x7f18d41527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18d37fe640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 0x7f18d41527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18d37fe640 1 -- 172.21.15.79:0/1523138803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d4155320 msgr2=0x7f18d40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18d37fe640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d4155320 0x7f18d40cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18d37fe640 1 -- 172.21.15.79:0/1523138803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d40ce420 con 0x7f18d40b34e0 2024-06-10T00:16:15.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18d37fe640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d409d4a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f18c4007e40 tx=0x7f18c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18bbfff640 1 -- 172.21.15.79:0/1523138803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4014620 con 0x7f18d40b34e0 2024-06-10T00:16:15.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18bbfff640 1 -- 172.21.15.79:0/1523138803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c4019070 con 0x7f18d40b34e0 2024-06-10T00:16:15.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d40ce700 con 0x7f18d40b34e0 2024-06-10T00:16:15.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18bbfff640 1 -- 172.21.15.79:0/1523138803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4014a00 con 0x7f18d40b34e0 2024-06-10T00:16:15.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.627+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d409b950 con 0x7f18d40b34e0 2024-06-10T00:16:15.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.628+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d40683c0 con 0x7f18d40b34e0 2024-06-10T00:16:15.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.628+0000 7f18bbfff640 1 -- 172.21.15.79:0/1523138803 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18c4014ba0 con 0x7f18d40b34e0 2024-06-10T00:16:15.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.629+0000 7f18bbfff640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18c006be30 0x7f18c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.629+0000 7f18bbfff640 1 -- 172.21.15.79:0/1523138803 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f18c408b3f0 con 0x7f18d40b34e0 2024-06-10T00:16:15.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.629+0000 7f18d2ffd640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18c006be30 0x7f18c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.629+0000 7f18d2ffd640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18c006be30 0x7f18c006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f18c8034000 tx=0x7f18c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.633+0000 7f18bbfff640 1 -- 172.21.15.79:0/1523138803 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f18c40598c0 con 0x7f18d40b34e0 2024-06-10T00:16:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.807+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f18d40cf640 con 0x7f18d40b34e0 2024-06-10T00:16:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.808+0000 7f18bbfff640 1 -- 172.21.15.79:0/1523138803 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7f18c405dbc0 con 0x7f18d40b34e0 2024-06-10T00:16:15.808 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18c006be30 msgr2=0x7f18c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18c006be30 0x7f18c006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f18c8034000 tx=0x7f18c802e000 comp rx=0 tx=0).stop 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 msgr2=0x7f18d409d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d409d4a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f18c4007e40 tx=0x7f18c400e4b0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 shutdown_connections 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18c006be30 0x7f18c006e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d4155320 0x7f18d40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d40d0560 0x7f18d41527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 --2- 172.21.15.79:0/1523138803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d40b34e0 0x7f18d409d4a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 >> 172.21.15.79:0/1523138803 conn(0x7f18d40b1d10 msgr2=0x7f18d40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:15.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 shutdown_connections 2024-06-10T00:16:15.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.810+0000 7f18d9f90640 1 -- 172.21.15.79:0/1523138803 wait complete. 2024-06-10T00:16:15.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-06-10T00:16:15.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.920+0000 7f5039d7e640 1 Processor -- start 2024-06-10T00:16:15.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.920+0000 7f5039d7e640 1 -- start start 2024-06-10T00:16:15.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.921+0000 7f5039d7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50341618e0 0x7f50340cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.921+0000 7f5039d7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5034161cc0 0x7f50340d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.921+0000 7f5039d7e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50340d03e0 con 0x7f50340d4cd0 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.921+0000 7f5039d7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f50340b4130 con 0x7f5034161cc0 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.921+0000 7f5039d7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50340d0100 con 0x7f50341618e0 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.921+0000 7f5032ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5034161cc0 0x7f50340d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.921+0000 7f5033fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f50340d4cd0 0x7f50340d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47618/0 (socket says 172.21.15.79:47618) 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.921+0000 7f5033fff640 1 -- 172.21.15.79:0/2539732601 learned_addr learned my addr 172.21.15.79:0/2539732601 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.922+0000 7f50337fe640 1 --2- 172.21.15.79:0/2539732601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50341618e0 0x7f50340cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.922+0000 7f5032ffd640 1 -- 172.21.15.79:0/2539732601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50341618e0 msgr2=0x7f50340cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.922+0000 7f5032ffd640 1 --2- 172.21.15.79:0/2539732601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50341618e0 0x7f50340cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.922+0000 7f5032ffd640 1 -- 172.21.15.79:0/2539732601 >> v1:172.21.15.79:6789/0 conn(0x7f50340d4cd0 legacy=0x7f50340d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.922+0000 7f50327fc640 1 -- 172.21.15.79:0/2539732601 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371897940 0 0) 0x7f50340d03e0 con 0x7f50340d4cd0 2024-06-10T00:16:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.922+0000 7f5032ffd640 1 -- 172.21.15.79:0/2539732601 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50340b3ae0 con 0x7f5034161cc0 2024-06-10T00:16:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.922+0000 7f5032ffd640 1 --2- 172.21.15.79:0/2539732601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f50340d2510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f501c0097a0 tx=0x7f501c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4351957237e611 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f50327fc640 1 -- 172.21.15.79:0/2539732601 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c037070 con 0x7f5034161cc0 2024-06-10T00:16:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f50327fc640 1 -- 172.21.15.79:0/2539732601 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c032440 con 0x7f5034161cc0 2024-06-10T00:16:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f50327fc640 1 -- 172.21.15.79:0/2539732601 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c032810 con 0x7f5034161cc0 2024-06-10T00:16:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f5039d7e640 1 -- 172.21.15.79:0/2539732601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 msgr2=0x7f50340d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f5039d7e640 1 --2- 172.21.15.79:0/2539732601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f50340d2510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f501c0097a0 tx=0x7f501c02a180 comp rx=0 tx=0).stop 2024-06-10T00:16:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f5039d7e640 1 -- 172.21.15.79:0/2539732601 shutdown_connections 2024-06-10T00:16:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f5039d7e640 1 --2- 172.21.15.79:0/2539732601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f50340d2510 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f5039d7e640 1 --2- 172.21.15.79:0/2539732601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50341618e0 0x7f50340cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f5039d7e640 1 -- 172.21.15.79:0/2539732601 >> 172.21.15.79:0/2539732601 conn(0x7f503409d410 msgr2=0x7f50340d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f5039d7e640 1 -- 172.21.15.79:0/2539732601 shutdown_connections 2024-06-10T00:16:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.923+0000 7f5039d7e640 1 -- 172.21.15.79:0/2539732601 wait complete. 2024-06-10T00:16:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.924+0000 7f5039d7e640 1 Processor -- start 2024-06-10T00:16:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5039d7e640 1 -- start start 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5039d7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50340d4cd0 0x7f50341f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5039d7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50341618e0 0x7f50341f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5039d7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f5034154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5039d7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f50340cfec0 con 0x7f5034161cc0 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5039d7e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50340cfd40 con 0x7f50341618e0 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5039d7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50340b55d0 con 0x7f50340d4cd0 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5033fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f5034154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5033fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f5034154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59272/0 (socket says 172.21.15.79:59272) 2024-06-10T00:16:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.925+0000 7f5033fff640 1 -- 172.21.15.79:0/4249005816 learned_addr learned my addr 172.21.15.79:0/4249005816 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f50337fe640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50340d4cd0 0x7f50341f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5032ffd640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50341618e0 0x7f50341f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5033fff640 1 -- 172.21.15.79:0/4249005816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50340d4cd0 msgr2=0x7f50341f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5033fff640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50340d4cd0 0x7f50341f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5033fff640 1 -- 172.21.15.79:0/4249005816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50341618e0 msgr2=0x7f50341f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5033fff640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50341618e0 0x7f50341f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5033fff640 1 -- 172.21.15.79:0/4249005816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503415f550 con 0x7f5034161cc0 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5033fff640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f5034154da0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f502c00c7d0 tx=0x7f502c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f502bfff640 1 -- 172.21.15.79:0/4249005816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c018070 con 0x7f5034161cc0 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f502bfff640 1 -- 172.21.15.79:0/4249005816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f502c00a640 con 0x7f5034161cc0 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503415f830 con 0x7f5034161cc0 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f502bfff640 1 -- 172.21.15.79:0/4249005816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00aa70 con 0x7f5034161cc0 2024-06-10T00:16:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.926+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503415fdf0 con 0x7f5034161cc0 2024-06-10T00:16:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.927+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5034068430 con 0x7f5034161cc0 2024-06-10T00:16:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.928+0000 7f502bfff640 1 -- 172.21.15.79:0/4249005816 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f502c01b070 con 0x7f5034161cc0 2024-06-10T00:16:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.928+0000 7f502bfff640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501406be30 0x7f501406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.928+0000 7f502bfff640 1 -- 172.21.15.79:0/4249005816 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f502c08a290 con 0x7f5034161cc0 2024-06-10T00:16:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.928+0000 7f50337fe640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501406be30 0x7f501406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.928+0000 7f50337fe640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501406be30 0x7f501406e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5024006fd0 tx=0x7f5024008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:15.932+0000 7f502bfff640 1 -- 172.21.15.79:0/4249005816 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f502c058760 con 0x7f5034161cc0 2024-06-10T00:16:16.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.171+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f50340d41b0 con 0x7f5034161cc0 2024-06-10T00:16:16.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.206+0000 7f502bfff640 1 -- 172.21.15.79:0/4249005816 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v100) ==== 152+0+0 (secure 0 0 0) 0x7f502c05ca60 con 0x7f5034161cc0 2024-06-10T00:16:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501406be30 msgr2=0x7f501406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501406be30 0x7f501406e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5024006fd0 tx=0x7f5024008040 comp rx=0 tx=0).stop 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 msgr2=0x7f5034154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f5034154da0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f502c00c7d0 tx=0x7f502c00cc90 comp rx=0 tx=0).stop 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 shutdown_connections 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501406be30 0x7f501406e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5034161cc0 0x7f5034154da0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50341618e0 0x7f50341f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 --2- 172.21.15.79:0/4249005816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50340d4cd0 0x7f50341f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 >> 172.21.15.79:0/4249005816 conn(0x7f503409d410 msgr2=0x7f50340cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 shutdown_connections 2024-06-10T00:16:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.208+0000 7f5039d7e640 1 -- 172.21.15.79:0/4249005816 wait complete. 2024-06-10T00:16:16.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-10T00:16:16.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.321+0000 7f786a990640 1 Processor -- start 2024-06-10T00:16:16.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f786a990640 1 -- start start 2024-06-10T00:16:16.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f786a990640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78640d08f0 0x7f78640b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f786a990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640d0cd0 0x7f78640cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f786a990640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78640cf620 con 0x7f78640cf190 2024-06-10T00:16:16.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f786a990640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f78640d1c80 con 0x7f78640d08f0 2024-06-10T00:16:16.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f786a990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f78640cf8a0 con 0x7f78640d0cd0 2024-06-10T00:16:16.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f7863fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78640d08f0 0x7f78640b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f7863fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78640d08f0 0x7f78640b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59282/0 (socket says 172.21.15.79:59282) 2024-06-10T00:16:16.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.322+0000 7f7863fff640 1 -- 172.21.15.79:0/3066005294 learned_addr learned my addr 172.21.15.79:0/3066005294 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:16.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.323+0000 7f78637fe640 1 --2- 172.21.15.79:0/3066005294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640d0cd0 0x7f78640cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.323+0000 7f7863fff640 1 -- 172.21.15.79:0/3066005294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640d0cd0 msgr2=0x7f78640cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:16.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.323+0000 7f7863fff640 1 --2- 172.21.15.79:0/3066005294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640d0cd0 0x7f78640cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.323+0000 7f7863fff640 1 -- 172.21.15.79:0/3066005294 >> v1:172.21.15.117:6789/0 conn(0x7f78640cf190 legacy=0x7f78640d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.323+0000 7f7863fff640 1 -- 172.21.15.79:0/3066005294 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78640cfb80 con 0x7f78640d08f0 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.323+0000 7f78637fe640 1 --2- 172.21.15.79:0/3066005294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640d0cd0 0x7f78640cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.323+0000 7f7863fff640 1 --2- 172.21.15.79:0/3066005294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640b3800 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7854009870 tx=0x7f785402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f602c090871070 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f7862ffd640 1 -- 172.21.15.79:0/3066005294 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854037070 con 0x7f78640d08f0 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f7862ffd640 1 -- 172.21.15.79:0/3066005294 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7854032440 con 0x7f78640d08f0 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f7862ffd640 1 -- 172.21.15.79:0/3066005294 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854032810 con 0x7f78640d08f0 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f786a990640 1 -- 172.21.15.79:0/3066005294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 msgr2=0x7f78640b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f786a990640 1 --2- 172.21.15.79:0/3066005294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640b3800 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7854009870 tx=0x7f785402a210 comp rx=0 tx=0).stop 2024-06-10T00:16:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f786a990640 1 -- 172.21.15.79:0/3066005294 shutdown_connections 2024-06-10T00:16:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f786a990640 1 --2- 172.21.15.79:0/3066005294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640d0cd0 0x7f78640cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f786a990640 1 --2- 172.21.15.79:0/3066005294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640b3800 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f786a990640 1 -- 172.21.15.79:0/3066005294 >> 172.21.15.79:0/3066005294 conn(0x7f786409d3c0 msgr2=0x7f78640d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f786a990640 1 -- 172.21.15.79:0/3066005294 shutdown_connections 2024-06-10T00:16:16.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.324+0000 7f786a990640 1 -- 172.21.15.79:0/3066005294 wait complete. 2024-06-10T00:16:16.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.325+0000 7f786a990640 1 Processor -- start 2024-06-10T00:16:16.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.325+0000 7f786a990640 1 -- start start 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f786a990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640cf190 0x7f78640c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f786a990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f786a990640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78640d0cd0 0x7f78640ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f786a990640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78640b50c0 con 0x7f78640d08f0 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f786a990640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f78640d1ed0 con 0x7f78640d0cd0 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f786a990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f78640d1150 con 0x7f78640cf190 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f78637fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f78637fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59292/0 (socket says 172.21.15.79:59292) 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f78637fe640 1 -- 172.21.15.79:0/1482768191 learned_addr learned my addr 172.21.15.79:0/1482768191 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f7863fff640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640cf190 0x7f78640c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.326+0000 7f7868f2d640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78640d0cd0 0x7f78640ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f78637fe640 1 -- 172.21.15.79:0/1482768191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640cf190 msgr2=0x7f78640c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f78637fe640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640cf190 0x7f78640c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f78637fe640 1 -- 172.21.15.79:0/1482768191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78640d0cd0 msgr2=0x7f78640ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f78637fe640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78640d0cd0 0x7f78640ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f78637fe640 1 -- 172.21.15.79:0/1482768191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78640b99f0 con 0x7f78640d08f0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f78637fe640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640cc840 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f785800c7f0 tx=0x7f785800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f7860ff9640 1 -- 172.21.15.79:0/1482768191 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858015070 con 0x7f78640d08f0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f7860ff9640 1 -- 172.21.15.79:0/1482768191 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78580077c0 con 0x7f78640d08f0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78640cd610 con 0x7f78640d08f0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f7860ff9640 1 -- 172.21.15.79:0/1482768191 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858007b70 con 0x7f78640d08f0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.327+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78640cdbd0 con 0x7f78640d08f0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.328+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78640683c0 con 0x7f78640d08f0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.328+0000 7f7860ff9640 1 -- 172.21.15.79:0/1482768191 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7858018070 con 0x7f78640d08f0 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.329+0000 7f7860ff9640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f785006be30 0x7f785006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.329+0000 7f7860ff9640 1 -- 172.21.15.79:0/1482768191 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f785808ab30 con 0x7f78640d08f0 2024-06-10T00:16:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.329+0000 7f7863fff640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f785006be30 0x7f785006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.329+0000 7f7863fff640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f785006be30 0x7f785006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7854034000 tx=0x7f785402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.333+0000 7f7860ff9640 1 -- 172.21.15.79:0/1482768191 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f78580596e0 con 0x7f78640d08f0 2024-06-10T00:16:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.506+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f78640d1730 con 0x7f78640d08f0 2024-06-10T00:16:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.510+0000 7f7860ff9640 1 -- 172.21.15.79:0/1482768191 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f7858058fe0 con 0x7f78640d08f0 2024-06-10T00:16:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.511+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f785006be30 msgr2=0x7f785006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.511+0000 7f786a990640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f785006be30 0x7f785006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7854034000 tx=0x7f785402e000 comp rx=0 tx=0).stop 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.511+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 msgr2=0x7f78640cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.511+0000 7f786a990640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640cc840 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f785800c7f0 tx=0x7f785800ccb0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.512+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 shutdown_connections 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.512+0000 7f786a990640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f785006be30 0x7f785006e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.512+0000 7f786a990640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78640d0cd0 0x7f78640ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.512+0000 7f786a990640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78640d08f0 0x7f78640cc840 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.512+0000 7f786a990640 1 --2- 172.21.15.79:0/1482768191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78640cf190 0x7f78640c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.512+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 >> 172.21.15.79:0/1482768191 conn(0x7f786409d3c0 msgr2=0x7f78640b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.512+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 shutdown_connections 2024-06-10T00:16:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.512+0000 7f786a990640 1 -- 172.21.15.79:0/1482768191 wait complete. 2024-06-10T00:16:16.522 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:16:16.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:16:16.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:16:16.614 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:16:16.614 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:16:16.614 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:16:16.630 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:16:16.630 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:16:16.630 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:16:16.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:16:16.649 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:16:16.649 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:16:16.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:16:16.686 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:16:16.686 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:16:16.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:16:16.708 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-10T00:16:16.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:16:16.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.826+0000 7f54eb1e9640 1 Processor -- start 2024-06-10T00:16:16.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.826+0000 7f54eb1e9640 1 -- start start 2024-06-10T00:16:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54eb1e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cd230 0x7f54e40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54eb1e9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54e40cec50 0x7f54e40cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54eb1e9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e40b3420 con 0x7f54e41553c0 2024-06-10T00:16:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54eb1e9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f54e40cc750 con 0x7f54e40cec50 2024-06-10T00:16:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54eb1e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f54e40cca30 con 0x7f54e40cd230 2024-06-10T00:16:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e9786640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54e40cec50 0x7f54e40cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e8f85640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f54e41553c0 0x7f54e415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47624/0 (socket says 172.21.15.79:47624) 2024-06-10T00:16:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e8f85640 1 -- 172.21.15.79:0/1285321029 learned_addr learned my addr 172.21.15.79:0/1285321029 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e9786640 1 -- 172.21.15.79:0/1285321029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cd230 msgr2=0x7f54e40b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e3fff640 1 --2- 172.21.15.79:0/1285321029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cd230 0x7f54e40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e9786640 1 --2- 172.21.15.79:0/1285321029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cd230 0x7f54e40b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e9786640 1 -- 172.21.15.79:0/1285321029 >> v1:172.21.15.79:6789/0 conn(0x7f54e41553c0 legacy=0x7f54e415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e9786640 1 -- 172.21.15.79:0/1285321029 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e40ccd10 con 0x7f54e40cec50 2024-06-10T00:16:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.827+0000 7f54e37fe640 1 -- 172.21.15.79:0/1285321029 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147766578 0 0) 0x7f54e40b3420 con 0x7f54e41553c0 2024-06-10T00:16:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54e9786640 1 --2- 172.21.15.79:0/1285321029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40cec50 0x7f54e40cf0e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009d90 tx=0x7f54dc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666b47168064c14e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54e37fe640 1 -- 172.21.15.79:0/1285321029 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc007740 con 0x7f54e40cec50 2024-06-10T00:16:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54e37fe640 1 -- 172.21.15.79:0/1285321029 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54dc0078e0 con 0x7f54e40cec50 2024-06-10T00:16:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54e37fe640 1 -- 172.21.15.79:0/1285321029 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc007cb0 con 0x7f54e40cec50 2024-06-10T00:16:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54eb1e9640 1 -- 172.21.15.79:0/1285321029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40cec50 msgr2=0x7f54e40cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/1285321029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40cec50 0x7f54e40cf0e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009d90 tx=0x7f54dc02a660 comp rx=0 tx=0).stop 2024-06-10T00:16:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54eb1e9640 1 -- 172.21.15.79:0/1285321029 shutdown_connections 2024-06-10T00:16:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/1285321029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40cec50 0x7f54e40cf0e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/1285321029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cd230 0x7f54e40b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54eb1e9640 1 -- 172.21.15.79:0/1285321029 >> 172.21.15.79:0/1285321029 conn(0x7f54e40b19f0 msgr2=0x7f54e40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54eb1e9640 1 -- 172.21.15.79:0/1285321029 shutdown_connections 2024-06-10T00:16:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.828+0000 7f54eb1e9640 1 -- 172.21.15.79:0/1285321029 wait complete. 2024-06-10T00:16:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.830+0000 7f54eb1e9640 1 Processor -- start 2024-06-10T00:16:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.830+0000 7f54eb1e9640 1 -- start start 2024-06-10T00:16:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.830+0000 7f54eb1e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54e40cd230 0x7f54e415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.830+0000 7f54eb1e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cec50 0x7f54e40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.830+0000 7f54eb1e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e41553c0 0x7f54e415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.830+0000 7f54eb1e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f54e4155920 con 0x7f54e41553c0 2024-06-10T00:16:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.830+0000 7f54eb1e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41557a0 con 0x7f54e40cd230 2024-06-10T00:16:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54eb1e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f54e4071030 con 0x7f54e40cec50 2024-06-10T00:16:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e41553c0 0x7f54e415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e41553c0 0x7f54e415e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59312/0 (socket says 172.21.15.79:59312) 2024-06-10T00:16:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 -- 172.21.15.79:0/947359721 learned_addr learned my addr 172.21.15.79:0/947359721 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 -- 172.21.15.79:0/947359721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cec50 msgr2=0x7f54e40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cec50 0x7f54e40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 -- 172.21.15.79:0/947359721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54e40cd230 msgr2=0x7f54e415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e8f85640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54e40cd230 0x7f54e415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54e40cd230 0x7f54e415a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 -- 172.21.15.79:0/947359721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e409b800 con 0x7f54e41553c0 2024-06-10T00:16:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e9786640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e41553c0 0x7f54e415e0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009eb0 tx=0x7f54dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e17fa640 1 -- 172.21.15.79:0/947359721 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc040070 con 0x7f54e41553c0 2024-06-10T00:16:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e17fa640 1 -- 172.21.15.79:0/947359721 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54dc031c90 con 0x7f54e41553c0 2024-06-10T00:16:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e409bae0 con 0x7f54e41553c0 2024-06-10T00:16:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54e17fa640 1 -- 172.21.15.79:0/947359721 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc045680 con 0x7f54e41553c0 2024-06-10T00:16:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.831+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e409c0a0 con 0x7f54e41553c0 2024-06-10T00:16:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.832+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e4068430 con 0x7f54e41553c0 2024-06-10T00:16:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.833+0000 7f54e17fa640 1 -- 172.21.15.79:0/947359721 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54dc039040 con 0x7f54e41553c0 2024-06-10T00:16:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.833+0000 7f54e17fa640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f54c806be30 0x7f54c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.833+0000 7f54e8f85640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f54c806be30 0x7f54c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.833+0000 7f54e17fa640 1 -- 172.21.15.79:0/947359721 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f54dc0ac720 con 0x7f54e41553c0 2024-06-10T00:16:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.834+0000 7f54e8f85640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f54c806be30 0x7f54c806e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f54d8000f60 tx=0x7f54d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:16.838+0000 7f54e17fa640 1 -- 172.21.15.79:0/947359721 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f54dc043360 con 0x7f54e41553c0 2024-06-10T00:16:17.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.045+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54e40b2e70 con 0x7f54e41553c0 2024-06-10T00:16:17.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.046+0000 7f54e17fa640 1 -- 172.21.15.79:0/947359721 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3872 (secure 0 0 0) 0x7f54dc07b300 con 0x7f54e41553c0 2024-06-10T00:16:17.046 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:17.046 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4744,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/465777512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":465777512},{"type":"v1","addr":"172.21.15.117:6834","nonce":465777512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2394993448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2394993448},{"type":"v1","addr":"172.21.15.117:6835","nonce":2394993448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1324712618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1324712618},{"type":"v1","addr":"172.21.15.79:6836","nonce":1324712618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3667753006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3667753006},{"type":"v1","addr":"172.21.15.79:6837","nonce":3667753006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-06-10T00:16:17.046 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f54c806be30 msgr2=0x7f54c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f54c806be30 0x7f54c806e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f54d8000f60 tx=0x7f54d8009040 comp rx=0 tx=0).stop 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e41553c0 msgr2=0x7f54e415e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e41553c0 0x7f54e415e0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009eb0 tx=0x7f54dc004a40 comp rx=0 tx=0).stop 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 shutdown_connections 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f54c806be30 0x7f54c806e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e41553c0 0x7f54e415e0c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54e40cec50 0x7f54e40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 --2- 172.21.15.79:0/947359721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54e40cd230 0x7f54e415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 >> 172.21.15.79:0/947359721 conn(0x7f54e40b19f0 msgr2=0x7f54e406e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 shutdown_connections 2024-06-10T00:16:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.048+0000 7f54eb1e9640 1 -- 172.21.15.79:0/947359721 wait complete. 2024-06-10T00:16:17.059 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-10T00:16:17.059 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-10T00:16:17.059 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-10T00:16:17.059 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:16:17.060 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-10T00:16:17.060 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-10T00:16:17.060 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-10T00:16:17.060 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:16:17.060 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-10T00:16:17.060 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-10T00:16:17.060 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-10T00:16:17.060 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:16:17.061 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-10T00:16:17.061 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-10T00:16:17.061 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-10T00:16:17.061 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:16:17.071 INFO:tasks.ceph.mds.a:Stopped 2024-06-10T00:16:17.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-10T00:16:17.072 INFO:tasks.ceph.mds.c:Stopped 2024-06-10T00:16:17.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-10T00:16:17.073 INFO:tasks.ceph.mds.b:Stopped 2024-06-10T00:16:17.074 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-10T00:16:17.074 INFO:tasks.ceph.mds.d:Stopped 2024-06-10T00:16:17.075 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-10T00:16:17.114 INFO:tasks.ceph.mds.a:Started 2024-06-10T00:16:17.114 DEBUG:teuthology.parallel:result is None 2024-06-10T00:16:17.115 INFO:tasks.ceph.mds.c:Started 2024-06-10T00:16:17.115 DEBUG:teuthology.parallel:result is None 2024-06-10T00:16:17.116 INFO:tasks.ceph.mds.b:Started 2024-06-10T00:16:17.117 DEBUG:teuthology.parallel:result is None 2024-06-10T00:16:17.117 INFO:tasks.ceph.mds.d:Started 2024-06-10T00:16:17.117 DEBUG:teuthology.parallel:result is None 2024-06-10T00:16:17.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-10T00:16:17.191 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:16:17.191 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:16:17.192 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:16:17.192+0000 7f1d191b9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-06-10T00:16:17.203 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:16:17.203 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:16:17.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.225+0000 7fe62969a640 1 Processor -- start 2024-06-10T00:16:17.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.225+0000 7fe62969a640 1 -- start start 2024-06-10T00:16:17.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe62969a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe62406fb30 0x7fe6240b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe62969a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe62406b3c0 0x7fe62406b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe622ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe62415c100 0x7fe6240add50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47638/0 (socket says 172.21.15.79:47638) 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe62969a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe624072df0 con 0x7fe62415c100 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe62969a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe62415c4e0 con 0x7fe62406b3c0 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe62969a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe6240afd50 con 0x7fe62406fb30 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe6237fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe62406b3c0 0x7fe62406b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe622ffd640 1 -- 172.21.15.79:0/1852001997 learned_addr learned my addr 172.21.15.79:0/1852001997 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.226+0000 7fe6227fc640 1 --2- 172.21.15.79:0/1852001997 >> v2:172.21.15.117:3300/0 conn(0x7fe62406fb30 0x7fe6240b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.227+0000 7fe6237fe640 1 -- 172.21.15.79:0/1852001997 >> v2:172.21.15.117:3300/0 conn(0x7fe62406fb30 msgr2=0x7fe6240b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.227+0000 7fe6237fe640 1 --2- 172.21.15.79:0/1852001997 >> v2:172.21.15.117:3300/0 conn(0x7fe62406fb30 0x7fe6240b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.227+0000 7fe6237fe640 1 -- 172.21.15.79:0/1852001997 >> v1:172.21.15.79:6789/0 conn(0x7fe62415c100 legacy=0x7fe6240add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:17.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.227+0000 7fe6237fe640 1 -- 172.21.15.79:0/1852001997 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6240730d0 con 0x7fe62406b3c0 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.227+0000 7fe6237fe640 1 --2- 172.21.15.79:0/1852001997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62406b3c0 0x7fe62406b850 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe62415fac0 tx=0x7fe61c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1485c2346149665 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.228+0000 7fe621ffb640 1 -- 172.21.15.79:0/1852001997 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c007740 con 0x7fe62406b3c0 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.228+0000 7fe621ffb640 1 -- 172.21.15.79:0/1852001997 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe61c0078e0 con 0x7fe62406b3c0 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.228+0000 7fe621ffb640 1 -- 172.21.15.79:0/1852001997 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c007cb0 con 0x7fe62406b3c0 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.228+0000 7fe62969a640 1 -- 172.21.15.79:0/1852001997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62406b3c0 msgr2=0x7fe62406b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.228+0000 7fe62969a640 1 --2- 172.21.15.79:0/1852001997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62406b3c0 0x7fe62406b850 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe62415fac0 tx=0x7fe61c02a5f0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.228+0000 7fe62969a640 1 -- 172.21.15.79:0/1852001997 shutdown_connections 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.228+0000 7fe62969a640 1 --2- 172.21.15.79:0/1852001997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62406b3c0 0x7fe62406b850 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.229+0000 7fe62969a640 1 --2- 172.21.15.79:0/1852001997 >> v2:172.21.15.117:3300/0 conn(0x7fe62406fb30 0x7fe6240b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.229+0000 7fe62969a640 1 -- 172.21.15.79:0/1852001997 >> 172.21.15.79:0/1852001997 conn(0x7fe62406c4d0 msgr2=0x7fe62406c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:17.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.229+0000 7fe62969a640 1 -- 172.21.15.79:0/1852001997 shutdown_connections 2024-06-10T00:16:17.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.229+0000 7fe62969a640 1 -- 172.21.15.79:0/1852001997 wait complete. 2024-06-10T00:16:17.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.230+0000 7fe62969a640 1 Processor -- start 2024-06-10T00:16:17.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.230+0000 7fe62969a640 1 -- start start 2024-06-10T00:16:17.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe62969a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe62406b3c0 0x7fe6240cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:17.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe62969a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe62406fb30 0x7fe6241f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe62969a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62415c100 0x7fe6241519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe62969a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe62415fb60 con 0x7fe62415c100 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe62969a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6240af9e0 con 0x7fe62406fb30 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe62969a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe62415fce0 con 0x7fe62406b3c0 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62415c100 0x7fe6241519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62415c100 0x7fe6241519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59336/0 (socket says 172.21.15.79:59336) 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe6237fe640 1 -- 172.21.15.79:0/2871983260 learned_addr learned my addr 172.21.15.79:0/2871983260 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe622ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe62406b3c0 0x7fe6240cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.231+0000 7fe6227fc640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe62406fb30 0x7fe6241f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe6237fe640 1 -- 172.21.15.79:0/2871983260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe62406b3c0 msgr2=0x7fe6240cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe6237fe640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe62406b3c0 0x7fe6240cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe6237fe640 1 -- 172.21.15.79:0/2871983260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe62406fb30 msgr2=0x7fe6241f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:17.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe6237fe640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe62406fb30 0x7fe6241f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:17.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe6237fe640 1 -- 172.21.15.79:0/2871983260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6240cdd50 con 0x7fe62415c100 2024-06-10T00:16:17.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe6237fe640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62415c100 0x7fe6241519a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009e50 tx=0x7fe61c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:17.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe60b7fe640 1 -- 172.21.15.79:0/2871983260 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c040070 con 0x7fe62415c100 2024-06-10T00:16:17.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe60b7fe640 1 -- 172.21.15.79:0/2871983260 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe61c031bf0 con 0x7fe62415c100 2024-06-10T00:16:17.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe60b7fe640 1 -- 172.21.15.79:0/2871983260 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c009450 con 0x7fe62415c100 2024-06-10T00:16:17.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6240ce030 con 0x7fe62415c100 2024-06-10T00:16:17.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.232+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6240ce5f0 con 0x7fe62415c100 2024-06-10T00:16:17.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.233+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe624068ad0 con 0x7fe62415c100 2024-06-10T00:16:17.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.233+0000 7fe60b7fe640 1 -- 172.21.15.79:0/2871983260 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe61c039040 con 0x7fe62415c100 2024-06-10T00:16:17.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.234+0000 7fe60b7fe640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe61006be30 0x7fe61006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:17.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.234+0000 7fe60b7fe640 1 -- 172.21.15.79:0/2871983260 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fe61c0ac510 con 0x7fe62415c100 2024-06-10T00:16:17.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.234+0000 7fe622ffd640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe61006be30 0x7fe61006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:17.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.234+0000 7fe622ffd640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe61006be30 0x7fe61006e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe614007fd0 tx=0x7fe614007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:17.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.238+0000 7fe60b7fe640 1 -- 172.21.15.79:0/2871983260 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe61c07aa60 con 0x7fe62415c100 2024-06-10T00:16:17.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:17.423+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe6240727e0 con 0x7fe62415c100 2024-06-10T00:16:18.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.227+0000 7fe60b7fe640 1 -- 172.21.15.79:0/2871983260 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) ==== 97+0+0 (secure 0 0 0) 0x7fe61c07ed60 con 0x7fe62415c100 2024-06-10T00:16:18.227 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe61006be30 msgr2=0x7fe61006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe61006be30 0x7fe61006e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe614007fd0 tx=0x7fe614007e80 comp rx=0 tx=0).stop 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62415c100 msgr2=0x7fe6241519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62415c100 0x7fe6241519a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009e50 tx=0x7fe61c004a40 comp rx=0 tx=0).stop 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 shutdown_connections 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe61006be30 0x7fe61006e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe62415c100 0x7fe6241519a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe62406fb30 0x7fe6241f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 --2- 172.21.15.79:0/2871983260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe62406b3c0 0x7fe6240cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 >> 172.21.15.79:0/2871983260 conn(0x7fe62406c4d0 msgr2=0x7fe62406c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:18.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 shutdown_connections 2024-06-10T00:16:18.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.230+0000 7fe62969a640 1 -- 172.21.15.79:0/2871983260 wait complete. 2024-06-10T00:16:18.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-10T00:16:18.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.349+0000 7f6895cae640 1 Processor -- start 2024-06-10T00:16:18.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.349+0000 7f6895cae640 1 -- start start 2024-06-10T00:16:18.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.350+0000 7f6895cae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 0x7f68900b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.350+0000 7f6895cae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f689006fea0 0x7f6890072370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.350+0000 7f6895cae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68900afbd0 con 0x7f689006c3d0 2024-06-10T00:16:18.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.350+0000 7f6895cae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f689015d390 con 0x7f689006fea0 2024-06-10T00:16:18.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.350+0000 7f6895cae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f68900afe70 con 0x7f689015bfa0 2024-06-10T00:16:18.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.350+0000 7f688effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f689006fea0 0x7f6890072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.350+0000 7f688effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f689006fea0 0x7f6890072370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49002/0 (socket says 172.21.15.79:49002) 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.350+0000 7f688effd640 1 -- 172.21.15.79:0/1091835044 learned_addr learned my addr 172.21.15.79:0/1091835044 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.351+0000 7f688effd640 1 -- 172.21.15.79:0/1091835044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 msgr2=0x7f68900b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.351+0000 7f688effd640 1 --2- 172.21.15.79:0/1091835044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 0x7f68900b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.351+0000 7f688effd640 1 -- 172.21.15.79:0/1091835044 >> v1:172.21.15.79:6789/0 conn(0x7f689006c3d0 legacy=0x7f689015fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.351+0000 7f688effd640 1 -- 172.21.15.79:0/1091835044 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68900b41d0 con 0x7f689006fea0 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.351+0000 7f688effd640 1 --2- 172.21.15.79:0/1091835044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006fea0 0x7f6890072370 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6884009870 tx=0x7f688402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5281677c13cc5c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f688e7fc640 1 -- 172.21.15.79:0/1091835044 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884037070 con 0x7f689006fea0 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f688e7fc640 1 -- 172.21.15.79:0/1091835044 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6884032440 con 0x7f689006fea0 2024-06-10T00:16:18.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f688e7fc640 1 -- 172.21.15.79:0/1091835044 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884032810 con 0x7f689006fea0 2024-06-10T00:16:18.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f6895cae640 1 -- 172.21.15.79:0/1091835044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006fea0 msgr2=0x7f6890072370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f6895cae640 1 --2- 172.21.15.79:0/1091835044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006fea0 0x7f6890072370 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6884009870 tx=0x7f688402a1c0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f6895cae640 1 -- 172.21.15.79:0/1091835044 shutdown_connections 2024-06-10T00:16:18.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f6895cae640 1 --2- 172.21.15.79:0/1091835044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006fea0 0x7f6890072370 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f6895cae640 1 --2- 172.21.15.79:0/1091835044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 0x7f68900b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f6895cae640 1 -- 172.21.15.79:0/1091835044 >> 172.21.15.79:0/1091835044 conn(0x7f6890071850 msgr2=0x7f6890071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:18.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f6895cae640 1 -- 172.21.15.79:0/1091835044 shutdown_connections 2024-06-10T00:16:18.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.352+0000 7f6895cae640 1 -- 172.21.15.79:0/1091835044 wait complete. 2024-06-10T00:16:18.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.353+0000 7f6895cae640 1 Processor -- start 2024-06-10T00:16:18.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f6895cae640 1 -- start start 2024-06-10T00:16:18.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f6895cae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006c3d0 0x7f6890142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f6895cae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f689006fea0 0x7f6890153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f6895cae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 0x7f68901542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f6895cae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f689006c9e0 con 0x7f689006c3d0 2024-06-10T00:16:18.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f6895cae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f689006c860 con 0x7f689006fea0 2024-06-10T00:16:18.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f6895cae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f689006cb60 con 0x7f689015bfa0 2024-06-10T00:16:18.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006c3d0 0x7f6890142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006c3d0 0x7f6890142a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49010/0 (socket says 172.21.15.79:49010) 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.354+0000 7f688f7fe640 1 -- 172.21.15.79:0/1662156327 learned_addr learned my addr 172.21.15.79:0/1662156327 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688f7fe640 1 -- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 msgr2=0x7f68901542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688effd640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f689006fea0 0x7f6890153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688ffff640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 0x7f68901542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688f7fe640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 0x7f68901542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688f7fe640 1 -- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f689006fea0 msgr2=0x7f6890153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688f7fe640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f689006fea0 0x7f6890153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688f7fe640 1 -- 172.21.15.79:0/1662156327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6890152ce0 con 0x7f689006c3d0 2024-06-10T00:16:18.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688effd640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f689006fea0 0x7f6890153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f688f7fe640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006c3d0 0x7f6890142a50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f688000b410 tx=0x7f688000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f6877fff640 1 -- 172.21.15.79:0/1662156327 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880015020 con 0x7f689006c3d0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f6877fff640 1 -- 172.21.15.79:0/1662156327 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6880011850 con 0x7f689006c3d0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6890152fc0 con 0x7f689006c3d0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f6877fff640 1 -- 172.21.15.79:0/1662156327 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880011c40 con 0x7f689006c3d0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.355+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6890153580 con 0x7f689006c3d0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.356+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6890152a70 con 0x7f689006c3d0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.356+0000 7f6877fff640 1 -- 172.21.15.79:0/1662156327 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6880018020 con 0x7f689006c3d0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.357+0000 7f6877fff640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f687c06be30 0x7f687c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.357+0000 7f6877fff640 1 -- 172.21.15.79:0/1662156327 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5249+0+0 (secure 0 0 0) 0x7f688008ab60 con 0x7f689006c3d0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.357+0000 7f688effd640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f687c06be30 0x7f687c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.357+0000 7f688effd640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f687c06be30 0x7f687c06e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6884034000 tx=0x7f688402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:18.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.361+0000 7f6877fff640 1 -- 172.21.15.79:0/1662156327 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f688001f020 con 0x7f689006c3d0 2024-06-10T00:16:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.601+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f68900b4950 con 0x7f689006c3d0 2024-06-10T00:16:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.602+0000 7f6877fff640 1 -- 172.21.15.79:0/1662156327 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f68800172c0 con 0x7f689006c3d0 2024-06-10T00:16:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA==", 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow==", 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ==", 2024-06-10T00:16:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw==", 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:16:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw==", 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-06-10T00:16:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg==", 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg==", 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:16:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g==", 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-06-10T00:16:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw==", 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw==", 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:16:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ==", 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA==", 2024-06-10T00:16:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw==", 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-06-10T00:16:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA==", 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-06-10T00:16:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A==", 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw==", 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:16:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmQYVlARAAk+Jo8bykvpKKZY5XAPe2ZA==", 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA==", 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw==", 2024-06-10T00:16:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:16:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:16:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:16:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:16:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-10T00:16:18.615 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:16:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f687c06be30 msgr2=0x7f687c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f687c06be30 0x7f687c06e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6884034000 tx=0x7f688402e000 comp rx=0 tx=0).stop 2024-06-10T00:16:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006c3d0 msgr2=0x7f6890142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006c3d0 0x7f6890142a50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f688000b410 tx=0x7f688000b8d0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 shutdown_connections 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f687c06be30 0x7f687c06e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f689015bfa0 0x7f68901542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f689006fea0 0x7f6890153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.603+0000 7f6895cae640 1 --2- 172.21.15.79:0/1662156327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689006c3d0 0x7f6890142a50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.604+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 >> 172.21.15.79:0/1662156327 conn(0x7f6890071850 msgr2=0x7f68900b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.604+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 shutdown_connections 2024-06-10T00:16:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.604+0000 7f6895cae640 1 -- 172.21.15.79:0/1662156327 wait complete. 2024-06-10T00:16:18.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-10T00:16:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.717+0000 7f896014f640 1 Processor -- start 2024-06-10T00:16:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.718+0000 7f896014f640 1 -- start start 2024-06-10T00:16:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.718+0000 7f896014f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580b46d0 0x7f8958071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f896014f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89580721a0 0x7f8958165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f896014f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8958072820 con 0x7f89580cc6d0 2024-06-10T00:16:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f896014f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8958072b00 con 0x7f89580721a0 2024-06-10T00:16:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f896014f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8958072de0 con 0x7f89580b46d0 2024-06-10T00:16:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895e6ec640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89580721a0 0x7f8958165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895e6ec640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89580721a0 0x7f8958165c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49022/0 (socket says 172.21.15.79:49022) 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895e6ec640 1 -- 172.21.15.79:0/489843638 learned_addr learned my addr 172.21.15.79:0/489843638 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895d6ea640 1 --2- 172.21.15.79:0/489843638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580b46d0 0x7f8958071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895e6ec640 1 -- 172.21.15.79:0/489843638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580b46d0 msgr2=0x7f8958071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895e6ec640 1 --2- 172.21.15.79:0/489843638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580b46d0 0x7f8958071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895e6ec640 1 -- 172.21.15.79:0/489843638 >> v1:172.21.15.79:6789/0 conn(0x7f89580cc6d0 legacy=0x7f89580ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895e6ec640 1 -- 172.21.15.79:0/489843638 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89580b31a0 con 0x7f89580721a0 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.719+0000 7f895d6ea640 1 --2- 172.21.15.79:0/489843638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580b46d0 0x7f8958071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f895e6ec640 1 --2- 172.21.15.79:0/489843638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580721a0 0x7f8958165c30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8950009e50 tx=0x7f895002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43567e69b9b1d2aa server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f895cee9640 1 -- 172.21.15.79:0/489843638 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950036070 con 0x7f89580721a0 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f895cee9640 1 -- 172.21.15.79:0/489843638 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8950031600 con 0x7f89580721a0 2024-06-10T00:16:18.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f895cee9640 1 -- 172.21.15.79:0/489843638 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500319d0 con 0x7f89580721a0 2024-06-10T00:16:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f896014f640 1 -- 172.21.15.79:0/489843638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580721a0 msgr2=0x7f8958165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f896014f640 1 --2- 172.21.15.79:0/489843638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580721a0 0x7f8958165c30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8950009e50 tx=0x7f895002a710 comp rx=0 tx=0).stop 2024-06-10T00:16:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f896014f640 1 -- 172.21.15.79:0/489843638 shutdown_connections 2024-06-10T00:16:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f896014f640 1 --2- 172.21.15.79:0/489843638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580721a0 0x7f8958165c30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f896014f640 1 --2- 172.21.15.79:0/489843638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580b46d0 0x7f8958071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f896014f640 1 -- 172.21.15.79:0/489843638 >> 172.21.15.79:0/489843638 conn(0x7f89580b19f0 msgr2=0x7f89580b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f896014f640 1 -- 172.21.15.79:0/489843638 shutdown_connections 2024-06-10T00:16:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.720+0000 7f896014f640 1 -- 172.21.15.79:0/489843638 wait complete. 2024-06-10T00:16:18.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.721+0000 7f896014f640 1 Processor -- start 2024-06-10T00:16:18.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f896014f640 1 -- start start 2024-06-10T00:16:18.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f896014f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580721a0 0x7f895814b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f896014f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580b46d0 0x7f89580ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f896014f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89580cc6d0 0x7f895815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f896014f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8958166170 con 0x7f89580b46d0 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f896014f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8958159f60 con 0x7f89580cc6d0 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f896014f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f89581662f0 con 0x7f89580721a0 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f895d6ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580b46d0 0x7f89580ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f895d6ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580b46d0 0x7f89580ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49036/0 (socket says 172.21.15.79:49036) 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.722+0000 7f895d6ea640 1 -- 172.21.15.79:0/2968993410 learned_addr learned my addr 172.21.15.79:0/2968993410 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895deeb640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580721a0 0x7f895814b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895e6ec640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89580cc6d0 0x7f895815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895d6ea640 1 -- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580721a0 msgr2=0x7f895814b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895d6ea640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580721a0 0x7f895814b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895d6ea640 1 -- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89580cc6d0 msgr2=0x7f895815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895d6ea640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89580cc6d0 0x7f895815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895d6ea640 1 -- 172.21.15.79:0/2968993410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895814bf00 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895e6ec640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89580cc6d0 0x7f895815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f895d6ea640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580b46d0 0x7f89580ce7c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f895400c820 tx=0x7f895400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f894e7fc640 1 -- 172.21.15.79:0/2968993410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954015070 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f894e7fc640 1 -- 172.21.15.79:0/2968993410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8954007a30 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89580d04c0 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f894e7fc640 1 -- 172.21.15.79:0/2968993410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954007e00 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.723+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89580cdfc0 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.724+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8958068430 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.724+0000 7f894e7fc640 1 -- 172.21.15.79:0/2968993410 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8954018070 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.725+0000 7f894e7fc640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893c06be60 0x7f893c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.725+0000 7f894e7fc640 1 -- 172.21.15.79:0/2968993410 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5249+0+0 (secure 0 0 0) 0x7f895408abf0 con 0x7f89580b46d0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.725+0000 7f895deeb640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893c06be60 0x7f893c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.725+0000 7f895deeb640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893c06be60 0x7f893c06e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8948001640 tx=0x7f8948009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.729+0000 7f894e7fc640 1 -- 172.21.15.79:0/2968993410 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8954059760 con 0x7f89580b46d0 2024-06-10T00:16:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.905+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8958071cf0 con 0x7f89580b46d0 2024-06-10T00:16:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.906+0000 7f894e7fc640 1 -- 172.21.15.79:0/2968993410 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) ==== 84+0+65 (secure 0 0 0) 0x7f8954059060 con 0x7f89580b46d0 2024-06-10T00:16:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:18.906 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:16:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-06-10T00:16:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-06-10T00:16:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:18.906 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893c06be60 msgr2=0x7f893c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893c06be60 0x7f893c06e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8948001640 tx=0x7f8948009040 comp rx=0 tx=0).stop 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580b46d0 msgr2=0x7f89580ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580b46d0 0x7f89580ce7c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f895400c820 tx=0x7f895400cc20 comp rx=0 tx=0).stop 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 shutdown_connections 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893c06be60 0x7f893c06e320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89580cc6d0 0x7f895815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89580b46d0 0x7f89580ce7c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 --2- 172.21.15.79:0/2968993410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89580721a0 0x7f895814b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 >> 172.21.15.79:0/2968993410 conn(0x7f89580b19f0 msgr2=0x7f8958074830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 shutdown_connections 2024-06-10T00:16:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:18.908+0000 7f896014f640 1 -- 172.21.15.79:0/2968993410 wait complete. 2024-06-10T00:16:18.918 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-10T00:16:18.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-10T00:16:19.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.024+0000 7fdd5b0ca640 1 Processor -- start 2024-06-10T00:16:19.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.024+0000 7fdd5b0ca640 1 -- start start 2024-06-10T00:16:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd5b0ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd54155590 0x7fdd5415b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd5b0ca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd5415b9a0 0x7fdd540cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd5b0ca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd540acd40 con 0x7fdd540cf1a0 2024-06-10T00:16:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd5b0ca640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5415bfe0 con 0x7fdd5415b9a0 2024-06-10T00:16:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd5b0ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5415c2c0 con 0x7fdd54155590 2024-06-10T00:16:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd59667640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdd540cf1a0 0x7fdd5415eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50966/0 (socket says 172.21.15.79:50966) 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd59667640 1 -- 172.21.15.79:0/3672950143 learned_addr learned my addr 172.21.15.79:0/3672950143 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd58e66640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd54155590 0x7fdd5415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd53fff640 1 --2- 172.21.15.79:0/3672950143 >> v2:172.21.15.117:3300/0 conn(0x7fdd5415b9a0 0x7fdd540cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617604991 0 0) 0x7fdd540acd40 con 0x7fdd540cf1a0 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd44003520 con 0x7fdd540cf1a0 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4205847696 0 0) 0x7fdd44003520 con 0x7fdd540cf1a0 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd54155590 msgr2=0x7fdd5415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd54155590 0x7fdd5415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 >> v2:172.21.15.117:3300/0 conn(0x7fdd5415b9a0 msgr2=0x7fdd540cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 --2- 172.21.15.79:0/3672950143 >> v2:172.21.15.117:3300/0 conn(0x7fdd5415b9a0 0x7fdd540cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd540ad000 con 0x7fdd540cf1a0 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fdd4c0019f0 con 0x7fdd540cf1a0 2024-06-10T00:16:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.025+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 >> v1:172.21.15.79:6789/0 conn(0x7fdd540cf1a0 legacy=0x7fdd5415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd537fe640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd440039b0 0x7fdd44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd537fe640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd44004800 0x7fdd44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd537fe640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd54155590 0x7fdd440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5415bfe0 con 0x7fdd44004800 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5415c2c0 con 0x7fdd440039b0 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4400b9c0 con 0x7fdd54155590 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd53fff640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd44004800 0x7fdd44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd58e66640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd440039b0 0x7fdd44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd59667640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd54155590 0x7fdd440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd53fff640 1 -- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd54155590 msgr2=0x7fdd440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd53fff640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd54155590 0x7fdd440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd53fff640 1 -- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd440039b0 msgr2=0x7fdd44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:19.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd53fff640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd440039b0 0x7fdd44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd53fff640 1 -- 172.21.15.79:0/3672950143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd44003520 con 0x7fdd44004800 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.026+0000 7fdd58e66640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd440039b0 0x7fdd44003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd53fff640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd44004800 0x7fdd44004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009ac0 tx=0x7fdd44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df10db479b18b01d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40036070 con 0x7fdd44004800 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd40031400 con 0x7fdd44004800 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd537fe640 1 -- 172.21.15.79:0/3672950143 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40009690 con 0x7fdd44004800 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/3672950143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd44004800 msgr2=0x7fdd44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd5b0ca640 1 --2- 172.21.15.79:0/3672950143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd44004800 0x7fdd44004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009ac0 tx=0x7fdd44005830 comp rx=0 tx=0).stop 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd59667640 1 -- 172.21.15.79:0/3672950143 reap_dead start 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/3672950143 shutdown_connections 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/3672950143 >> 172.21.15.79:0/3672950143 conn(0x7fdd540b1980 msgr2=0x7fdd540b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:19.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/3672950143 shutdown_connections 2024-06-10T00:16:19.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.027+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/3672950143 wait complete. 2024-06-10T00:16:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.028+0000 7fdd5b0ca640 1 Processor -- start 2024-06-10T00:16:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.029+0000 7fdd5b0ca640 1 -- start start 2024-06-10T00:16:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.029+0000 7fdd5b0ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd44004800 0x7fdd54155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.029+0000 7fdd5b0ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd541f1e80 0x7fdd54153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.029+0000 7fdd5b0ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd541539a0 0x7fdd54153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.029+0000 7fdd5b0ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd540ae810 con 0x7fdd541539a0 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.029+0000 7fdd5b0ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd540b26d0 con 0x7fdd541f1e80 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.029+0000 7fdd5b0ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd540ae990 con 0x7fdd44004800 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.029+0000 7fdd59667640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd541539a0 0x7fdd54153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd59667640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd541539a0 0x7fdd54153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49048/0 (socket says 172.21.15.79:49048) 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd59667640 1 -- 172.21.15.79:0/956779218 learned_addr learned my addr 172.21.15.79:0/956779218 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd58e66640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd44004800 0x7fdd54155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd53fff640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd541f1e80 0x7fdd54153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd59667640 1 -- 172.21.15.79:0/956779218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd44004800 msgr2=0x7fdd54155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd59667640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd44004800 0x7fdd54155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd59667640 1 -- 172.21.15.79:0/956779218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd541f1e80 msgr2=0x7fdd54153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd59667640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd541f1e80 0x7fdd54153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd59667640 1 -- 172.21.15.79:0/956779218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5409ae70 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd59667640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd541539a0 0x7fdd54153e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c002070 tx=0x7fdd4c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd517fa640 1 -- 172.21.15.79:0/956779218 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00eda0 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd517fa640 1 -- 172.21.15.79:0/956779218 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4c018070 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5415ed90 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd517fa640 1 -- 172.21.15.79:0/956779218 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c013660 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.030+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5409b410 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.031+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd54068540 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.032+0000 7fdd517fa640 1 -- 172.21.15.79:0/956779218 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd4c013800 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.032+0000 7fdd517fa640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd3806be30 0x7fdd3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.032+0000 7fdd517fa640 1 -- 172.21.15.79:0/956779218 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5249+0+0 (secure 0 0 0) 0x7fdd4c08afe0 con 0x7fdd541539a0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.032+0000 7fdd58e66640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd3806be30 0x7fdd3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.032+0000 7fdd58e66640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd3806be30 0x7fdd3806e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdd480099b0 tx=0x7fdd48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:19.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.036+0000 7fdd517fa640 1 -- 172.21.15.79:0/956779218 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdd4c059b50 con 0x7fdd541539a0 2024-06-10T00:16:19.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.211+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdd541665e0 con 0x7fdd541539a0 2024-06-10T00:16:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.281+0000 7fdd517fa640 1 -- 172.21.15.79:0/956779218 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) ==== 138+0+0 (secure 0 0 0) 0x7fdd4c059450 con 0x7fdd541539a0 2024-06-10T00:16:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd3806be30 msgr2=0x7fdd3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd3806be30 0x7fdd3806e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdd480099b0 tx=0x7fdd48008040 comp rx=0 tx=0).stop 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd541539a0 msgr2=0x7fdd54153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd541539a0 0x7fdd54153e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c002070 tx=0x7fdd4c00e530 comp rx=0 tx=0).stop 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 shutdown_connections 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd3806be30 0x7fdd3806e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd541539a0 0x7fdd54153e20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd541f1e80 0x7fdd54153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 --2- 172.21.15.79:0/956779218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd44004800 0x7fdd54155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 >> 172.21.15.79:0/956779218 conn(0x7fdd540b1980 msgr2=0x7fdd540cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 shutdown_connections 2024-06-10T00:16:19.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.283+0000 7fdd5b0ca640 1 -- 172.21.15.79:0/956779218 wait complete. 2024-06-10T00:16:19.296 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-10T00:16:19.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.402+0000 7f1e53cb3640 1 Processor -- start 2024-06-10T00:16:19.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.403+0000 7f1e53cb3640 1 -- start start 2024-06-10T00:16:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.403+0000 7f1e53cb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4c15e1c0 0x7f1e4c0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.403+0000 7f1e53cb3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e4c0d11f0 0x7f1e4c0d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.403+0000 7f1e53cb3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4c0cf9a0 con 0x7f1e4c0b2f60 2024-06-10T00:16:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.403+0000 7f1e53cb3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4c0cfc70 con 0x7f1e4c0d11f0 2024-06-10T00:16:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.403+0000 7f1e53cb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cff50 con 0x7f1e4c15e1c0 2024-06-10T00:16:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e5124e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1e4c0b2f60 0x7f1e4c0d0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50976/0 (socket says 172.21.15.79:50976) 2024-06-10T00:16:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e5124e640 1 -- 172.21.15.79:0/733739685 learned_addr learned my addr 172.21.15.79:0/733739685 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e51a4f640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4c15e1c0 0x7f1e4c0d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e52250640 1 --2- 172.21.15.79:0/733739685 >> v2:172.21.15.117:3300/0 conn(0x7f1e4c0d11f0 0x7f1e4c0d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618533786 0 0) 0x7f1e4c0cf9a0 con 0x7f1e4c0b2f60 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e38003520 con 0x7f1e4c0b2f60 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2429499341 0 0) 0x7f1e38003520 con 0x7f1e4c0b2f60 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4c15e1c0 msgr2=0x7f1e4c0d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4c15e1c0 0x7f1e4c0d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 >> v2:172.21.15.117:3300/0 conn(0x7f1e4c0d11f0 msgr2=0x7f1e4c0d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 --2- 172.21.15.79:0/733739685 >> v2:172.21.15.117:3300/0 conn(0x7f1e4c0d11f0 0x7f1e4c0d2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c0d0230 con 0x7f1e4c0b2f60 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f1e3c001670 con 0x7f1e4c0b2f60 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 >> v1:172.21.15.79:6789/0 conn(0x7f1e4c0b2f60 legacy=0x7f1e4c0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4c15e1c0 0x7f1e380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e38003f30 0x7f1e38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e38004d40 0x7f1e380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cfc70 con 0x7f1e38004d40 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cff50 con 0x7f1e38003f30 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3800b9c0 con 0x7f1e4c15e1c0 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e52250640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e38004d40 0x7f1e380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e51a4f640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4c15e1c0 0x7f1e380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.404+0000 7f1e5124e640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e38003f30 0x7f1e38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e52250640 1 -- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4c15e1c0 msgr2=0x7f1e380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e52250640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4c15e1c0 0x7f1e380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e52250640 1 -- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e38003f30 msgr2=0x7f1e38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e52250640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e38003f30 0x7f1e38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e52250640 1 -- 172.21.15.79:0/733739685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e38003520 con 0x7f1e38004d40 2024-06-10T00:16:19.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e52250640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e38004d40 0x7f1e380051c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009f90 tx=0x7f1e38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84431cd6932a6cb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44009c10 con 0x7f1e38004d40 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e44036070 con 0x7f1e38004d40 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.405+0000 7f1e50a4d640 1 -- 172.21.15.79:0/733739685 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44031670 con 0x7f1e38004d40 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.406+0000 7f1e53cb3640 1 -- 172.21.15.79:0/733739685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e38004d40 msgr2=0x7f1e380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.406+0000 7f1e53cb3640 1 --2- 172.21.15.79:0/733739685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e38004d40 0x7f1e380051c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009f90 tx=0x7f1e38005830 comp rx=0 tx=0).stop 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.406+0000 7f1e52250640 1 -- 172.21.15.79:0/733739685 reap_dead start 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.406+0000 7f1e53cb3640 1 -- 172.21.15.79:0/733739685 shutdown_connections 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.406+0000 7f1e53cb3640 1 -- 172.21.15.79:0/733739685 >> 172.21.15.79:0/733739685 conn(0x7f1e4c09d3e0 msgr2=0x7f1e4c0d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.406+0000 7f1e53cb3640 1 -- 172.21.15.79:0/733739685 shutdown_connections 2024-06-10T00:16:19.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.406+0000 7f1e53cb3640 1 -- 172.21.15.79:0/733739685 wait complete. 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.407+0000 7f1e53cb3640 1 Processor -- start 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.407+0000 7f1e53cb3640 1 -- start start 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e53cb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e38004d40 0x7f1e4c0b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e53cb3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0b38b0 0x7f1e4c0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e53cb3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4c0c9fe0 0x7f1e4c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e53cb3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0b0cd0 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e53cb3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0d1d40 con 0x7f1e4c0c9fe0 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e53cb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c0b0e50 con 0x7f1e38004d40 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e5124e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0b38b0 0x7f1e4c0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e5124e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0b38b0 0x7f1e4c0b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49056/0 (socket says 172.21.15.79:49056) 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e5124e640 1 -- 172.21.15.79:0/721773263 learned_addr learned my addr 172.21.15.79:0/721773263 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e52250640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4c0c9fe0 0x7f1e4c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e51a4f640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e38004d40 0x7f1e4c0b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e5124e640 1 -- 172.21.15.79:0/721773263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e38004d40 msgr2=0x7f1e4c0b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e5124e640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e38004d40 0x7f1e4c0b7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e5124e640 1 -- 172.21.15.79:0/721773263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4c0c9fe0 msgr2=0x7f1e4c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e5124e640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4c0c9fe0 0x7f1e4c0ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.408+0000 7f1e5124e640 1 -- 172.21.15.79:0/721773263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c0ca9a0 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.409+0000 7f1e5124e640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0b38b0 0x7f1e4c0b3d10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0073a0 tx=0x7f1e3c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.409+0000 7f1e427fc640 1 -- 172.21.15.79:0/721773263 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c01a070 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.409+0000 7f1e427fc640 1 -- 172.21.15.79:0/721773263 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c00f940 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.409+0000 7f1e427fc640 1 -- 172.21.15.79:0/721773263 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00fcf0 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.409+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c1f7720 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.409+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1f7ce0 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.410+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c0683c0 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.410+0000 7f1e427fc640 1 -- 172.21.15.79:0/721773263 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e3c01d070 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.411+0000 7f1e427fc640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:19.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.411+0000 7f1e427fc640 1 -- 172.21.15.79:0/721773263 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5619+0+0 (secure 0 0 0) 0x7f1e3c08a8f0 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.411+0000 7f1e51a4f640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:19.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.411+0000 7f1e51a4f640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1e3006be30 0x7f1e3006e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e480099e0 tx=0x7f1e48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:19.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.415+0000 7f1e427fc640 1 -- 172.21.15.79:0/721773263 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1e3c0592f0 con 0x7f1e4c0b38b0 2024-06-10T00:16:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:19.588+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1e4c0ce1d0 con 0x7f1e4c0b38b0 2024-06-10T00:16:20.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.283+0000 7f1e427fc640 1 -- 172.21.15.79:0/721773263 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) ==== 170+0+0 (secure 0 0 0) 0x7f1e3c058bf0 con 0x7f1e4c0b38b0 2024-06-10T00:16:20.284 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-06-10T00:16:20.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1e3006be30 msgr2=0x7f1e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:20.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1e3006be30 0x7f1e3006e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e480099e0 tx=0x7f1e48008040 comp rx=0 tx=0).stop 2024-06-10T00:16:20.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0b38b0 msgr2=0x7f1e4c0b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:20.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0b38b0 0x7f1e4c0b3d10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0073a0 tx=0x7f1e3c007860 comp rx=0 tx=0).stop 2024-06-10T00:16:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 shutdown_connections 2024-06-10T00:16:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4c0c9fe0 0x7f1e4c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e4c0b38b0 0x7f1e4c0b3d10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 --2- 172.21.15.79:0/721773263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e38004d40 0x7f1e4c0b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 >> 172.21.15.79:0/721773263 conn(0x7f1e4c09d3e0 msgr2=0x7f1e4c06d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 shutdown_connections 2024-06-10T00:16:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.285+0000 7f1e53cb3640 1 -- 172.21.15.79:0/721773263 wait complete. 2024-06-10T00:16:20.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-10T00:16:20.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.409+0000 7fcd41941640 1 Processor -- start 2024-06-10T00:16:20.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.409+0000 7fcd41941640 1 -- start start 2024-06-10T00:16:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd41941640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd3c15e650 0x7fcd3c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd41941640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c0703e0 0x7fcd3c0d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd41941640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd3c070890 con 0x7fcd3c06cee0 2024-06-10T00:16:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd41941640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcd3c0cfd40 con 0x7fcd3c15e650 2024-06-10T00:16:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd41941640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3c070b50 con 0x7fcd3c0703e0 2024-06-10T00:16:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd327fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd3c15e650 0x7fcd3c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd327fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd3c15e650 0x7fcd3c06c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49064/0 (socket says 172.21.15.79:49064) 2024-06-10T00:16:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd327fc640 1 -- 172.21.15.79:0/4025885361 learned_addr learned my addr 172.21.15.79:0/4025885361 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:20.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd327fc640 1 -- 172.21.15.79:0/4025885361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c0703e0 msgr2=0x7fcd3c0d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:20.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd327fc640 1 --2- 172.21.15.79:0/4025885361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c0703e0 0x7fcd3c0d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd327fc640 1 -- 172.21.15.79:0/4025885361 >> v1:172.21.15.79:6789/0 conn(0x7fcd3c06cee0 legacy=0x7fcd3c06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:20.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.410+0000 7fcd327fc640 1 -- 172.21.15.79:0/4025885361 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3c0cff90 con 0x7fcd3c15e650 2024-06-10T00:16:20.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd327fc640 1 --2- 172.21.15.79:0/4025885361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c06c6e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009870 tx=0x7fcd2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7c602117285fd0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:20.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd3a7fc640 1 -- 172.21.15.79:0/4025885361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24037070 con 0x7fcd3c15e650 2024-06-10T00:16:20.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd3a7fc640 1 -- 172.21.15.79:0/4025885361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd24032440 con 0x7fcd3c15e650 2024-06-10T00:16:20.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd3a7fc640 1 -- 172.21.15.79:0/4025885361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24032810 con 0x7fcd3c15e650 2024-06-10T00:16:20.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd41941640 1 -- 172.21.15.79:0/4025885361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 msgr2=0x7fcd3c06c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd41941640 1 --2- 172.21.15.79:0/4025885361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c06c6e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009870 tx=0x7fcd2402a270 comp rx=0 tx=0).stop 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd41941640 1 -- 172.21.15.79:0/4025885361 shutdown_connections 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd41941640 1 --2- 172.21.15.79:0/4025885361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c0703e0 0x7fcd3c0d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd41941640 1 --2- 172.21.15.79:0/4025885361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c06c6e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd41941640 1 -- 172.21.15.79:0/4025885361 >> 172.21.15.79:0/4025885361 conn(0x7fcd3c0b3970 msgr2=0x7fcd3c0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd41941640 1 -- 172.21.15.79:0/4025885361 shutdown_connections 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.411+0000 7fcd41941640 1 -- 172.21.15.79:0/4025885361 wait complete. 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.413+0000 7fcd41941640 1 Processor -- start 2024-06-10T00:16:20.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.413+0000 7fcd41941640 1 -- start start 2024-06-10T00:16:20.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.413+0000 7fcd41941640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c06cee0 0x7fcd3c0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:20.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.413+0000 7fcd41941640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3c0703e0 0x7fcd3c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:20.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.413+0000 7fcd41941640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:20.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.413+0000 7fcd41941640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c0d0fb0 con 0x7fcd3c15e650 2024-06-10T00:16:20.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.413+0000 7fcd41941640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c0d0550 con 0x7fcd3c0703e0 2024-06-10T00:16:20.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.413+0000 7fcd41941640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3c0d1130 con 0x7fcd3c06cee0 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49066/0 (socket says 172.21.15.79:49066) 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 -- 172.21.15.79:0/2258845050 learned_addr learned my addr 172.21.15.79:0/2258845050 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd327fc640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3c0703e0 0x7fcd3c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3affd640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c06cee0 0x7fcd3c0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 -- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c06cee0 msgr2=0x7fcd3c0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c06cee0 0x7fcd3c0c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 -- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3c0703e0 msgr2=0x7fcd3c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3c0703e0 0x7fcd3c0c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 -- 172.21.15.79:0/2258845050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3c160cb0 con 0x7fcd3c15e650 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd327fc640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3c0703e0 0x7fcd3c0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3affd640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c06cee0 0x7fcd3c0c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd3b7fe640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c0c6170 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b9a0 tx=0x7fcd3400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd38ff9640 1 -- 172.21.15.79:0/2258845050 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34019070 con 0x7fcd3c15e650 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd38ff9640 1 -- 172.21.15.79:0/2258845050 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3400cbc0 con 0x7fcd3c15e650 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3c161810 con 0x7fcd3c15e650 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd38ff9640 1 -- 172.21.15.79:0/2258845050 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34014440 con 0x7fcd3c15e650 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.414+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3c161250 con 0x7fcd3c15e650 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.415+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3c0683c0 con 0x7fcd3c15e650 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.416+0000 7fcd38ff9640 1 -- 172.21.15.79:0/2258845050 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd3401c070 con 0x7fcd3c15e650 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.416+0000 7fcd38ff9640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be60 0x7fcd1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.416+0000 7fcd38ff9640 1 -- 172.21.15.79:0/2258845050 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6001+0+0 (secure 0 0 0) 0x7fcd3408acc0 con 0x7fcd3c15e650 2024-06-10T00:16:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.416+0000 7fcd3affd640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be60 0x7fcd1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:20.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.417+0000 7fcd3affd640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be60 0x7fcd1c06e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c001680 tx=0x7fcd2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.420+0000 7fcd38ff9640 1 -- 172.21.15.79:0/2258845050 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcd34059540 con 0x7fcd3c15e650 2024-06-10T00:16:20.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:20.629+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcd3c06ccc0 con 0x7fcd3c15e650 2024-06-10T00:16:21.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.297+0000 7fcd38ff9640 1 -- 172.21.15.79:0/2258845050 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) ==== 172+0+0 (secure 0 0 0) 0x7fcd34058e40 con 0x7fcd3c15e650 2024-06-10T00:16:21.297 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 7 and data pool 8 2024-06-10T00:16:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.304+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be60 msgr2=0x7fcd1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.304+0000 7fcd41941640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be60 0x7fcd1c06e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c001680 tx=0x7fcd2c009040 comp rx=0 tx=0).stop 2024-06-10T00:16:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.304+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 msgr2=0x7fcd3c0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.304+0000 7fcd41941640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c0c6170 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b9a0 tx=0x7fcd3400be60 comp rx=0 tx=0).stop 2024-06-10T00:16:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.305+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 shutdown_connections 2024-06-10T00:16:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.305+0000 7fcd41941640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be60 0x7fcd1c06e320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.305+0000 7fcd41941640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c15e650 0x7fcd3c0c6170 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.305+0000 7fcd41941640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3c0703e0 0x7fcd3c0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.305+0000 7fcd41941640 1 --2- 172.21.15.79:0/2258845050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd3c06cee0 0x7fcd3c0c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.305+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 >> 172.21.15.79:0/2258845050 conn(0x7fcd3c0b3970 msgr2=0x7fcd3c15bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:21.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.306+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 shutdown_connections 2024-06-10T00:16:21.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.307+0000 7fcd41941640 1 -- 172.21.15.79:0/2258845050 wait complete. 2024-06-10T00:16:21.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:16:21.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.423+0000 7f9995009640 1 Processor -- start 2024-06-10T00:16:21.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.423+0000 7f9995009640 1 -- start start 2024-06-10T00:16:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f9995009640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99900cc6d0 0x7f99900ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f9995009640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990072110 0x7f99900b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f9995009640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9990072580 con 0x7f9990071c60 2024-06-10T00:16:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f9995009640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f99900ccff0 con 0x7f99900cc6d0 2024-06-10T00:16:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f9995009640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9990072820 con 0x7f9990072110 2024-06-10T00:16:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f998ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99900cc6d0 0x7f99900ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f998ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99900cc6d0 0x7f99900ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49070/0 (socket says 172.21.15.79:49070) 2024-06-10T00:16:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f998ed9d640 1 -- 172.21.15.79:0/1823345352 learned_addr learned my addr 172.21.15.79:0/1823345352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f998f59e640 1 --2- 172.21.15.79:0/1823345352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990072110 0x7f99900b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f998ed9d640 1 -- 172.21.15.79:0/1823345352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990072110 msgr2=0x7f99900b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f998ed9d640 1 --2- 172.21.15.79:0/1823345352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990072110 0x7f99900b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f998ed9d640 1 -- 172.21.15.79:0/1823345352 >> v1:172.21.15.117:6789/0 conn(0x7f9990071c60 legacy=0x7f99900b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.424+0000 7f998ed9d640 1 -- 172.21.15.79:0/1823345352 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9990072b00 con 0x7f99900cc6d0 2024-06-10T00:16:21.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.425+0000 7f998ed9d640 1 --2- 172.21.15.79:0/1823345352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99900cc6d0 0x7f99900ccab0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9980009870 tx=0x7f998002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a1bf861dc6b8b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:21.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.425+0000 7f998dd9b640 1 -- 172.21.15.79:0/1823345352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980037070 con 0x7f99900cc6d0 2024-06-10T00:16:21.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.425+0000 7f998dd9b640 1 -- 172.21.15.79:0/1823345352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9980032440 con 0x7f99900cc6d0 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.425+0000 7f998dd9b640 1 -- 172.21.15.79:0/1823345352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980032810 con 0x7f99900cc6d0 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.426+0000 7f9995009640 1 -- 172.21.15.79:0/1823345352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99900cc6d0 msgr2=0x7f99900ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.426+0000 7f9995009640 1 --2- 172.21.15.79:0/1823345352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99900cc6d0 0x7f99900ccab0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9980009870 tx=0x7f998002a210 comp rx=0 tx=0).stop 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.426+0000 7f9995009640 1 -- 172.21.15.79:0/1823345352 shutdown_connections 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.426+0000 7f9995009640 1 --2- 172.21.15.79:0/1823345352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990072110 0x7f99900b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.426+0000 7f9995009640 1 --2- 172.21.15.79:0/1823345352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99900cc6d0 0x7f99900ccab0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.426+0000 7f9995009640 1 -- 172.21.15.79:0/1823345352 >> 172.21.15.79:0/1823345352 conn(0x7f99900b19f0 msgr2=0x7f99900b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.426+0000 7f9995009640 1 -- 172.21.15.79:0/1823345352 shutdown_connections 2024-06-10T00:16:21.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.426+0000 7f9995009640 1 -- 172.21.15.79:0/1823345352 wait complete. 2024-06-10T00:16:21.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.427+0000 7f9995009640 1 Processor -- start 2024-06-10T00:16:21.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.427+0000 7f9995009640 1 -- start start 2024-06-10T00:16:21.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f9995009640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990071c60 0x7f999009cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f9995009640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9990072110 0x7f999015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f9995009640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99900cc6d0 0x7f999015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f9995009640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f999015c890 con 0x7f9990072110 2024-06-10T00:16:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f9995009640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99900b31a0 con 0x7f99900cc6d0 2024-06-10T00:16:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f9995009640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9990159f60 con 0x7f9990071c60 2024-06-10T00:16:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9990072110 0x7f999015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9990072110 0x7f999015b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49080/0 (socket says 172.21.15.79:49080) 2024-06-10T00:16:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998e59c640 1 -- 172.21.15.79:0/843423476 learned_addr learned my addr 172.21.15.79:0/843423476 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998ed9d640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990071c60 0x7f999009cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998f59e640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99900cc6d0 0x7f999015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998e59c640 1 -- 172.21.15.79:0/843423476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990071c60 msgr2=0x7f999009cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998e59c640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990071c60 0x7f999009cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998e59c640 1 -- 172.21.15.79:0/843423476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99900cc6d0 msgr2=0x7f999015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998e59c640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99900cc6d0 0x7f999015b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.428+0000 7f998e59c640 1 -- 172.21.15.79:0/843423476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999009d5c0 con 0x7f9990072110 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.429+0000 7f998e59c640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9990072110 0x7f999015b420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f998400b420 tx=0x7f998400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.429+0000 7f99777fe640 1 -- 172.21.15.79:0/843423476 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984011830 con 0x7f9990072110 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.429+0000 7f99777fe640 1 -- 172.21.15.79:0/843423476 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9984016070 con 0x7f9990072110 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.429+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9990146230 con 0x7f9990072110 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.429+0000 7f99777fe640 1 -- 172.21.15.79:0/843423476 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984011c10 con 0x7f9990072110 2024-06-10T00:16:21.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.429+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f999009d8a0 con 0x7f9990072110 2024-06-10T00:16:21.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.430+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9990146400 con 0x7f9990072110 2024-06-10T00:16:21.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.430+0000 7f99777fe640 1 -- 172.21.15.79:0/843423476 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f998401b460 con 0x7f9990072110 2024-06-10T00:16:21.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.431+0000 7f99777fe640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f997c06be30 0x7f997c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.431+0000 7f99777fe640 1 -- 172.21.15.79:0/843423476 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f998408a940 con 0x7f9990072110 2024-06-10T00:16:21.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.431+0000 7f998ed9d640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f997c06be30 0x7f997c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.431+0000 7f998ed9d640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f997c06be30 0x7f997c06e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9980034000 tx=0x7f998002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:21.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.435+0000 7f99777fe640 1 -- 172.21.15.79:0/843423476 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9984020020 con 0x7f9990072110 2024-06-10T00:16:21.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.611+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9990068430 con 0x7f9990072110 2024-06-10T00:16:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.612+0000 7f99777fe640 1 -- 172.21.15.79:0/843423476 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16907 (secure 0 0 0) 0x7f9984058b10 con 0x7f9990072110 2024-06-10T00:16:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:21.612 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":49,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:16:20.630672+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:16:19.229807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-10T00:16:19.607050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f997c06be30 msgr2=0x7f997c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f997c06be30 0x7f997c06e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9980034000 tx=0x7f998002e000 comp rx=0 tx=0).stop 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9990072110 msgr2=0x7f999015b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9990072110 0x7f999015b420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f998400b420 tx=0x7f998400b8e0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 shutdown_connections 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f997c06be30 0x7f997c06e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99900cc6d0 0x7f999015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9990072110 0x7f999015b420 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 --2- 172.21.15.79:0/843423476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990071c60 0x7f999009cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 >> 172.21.15.79:0/843423476 conn(0x7f99900b19f0 msgr2=0x7f99900b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 shutdown_connections 2024-06-10T00:16:21.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.614+0000 7f9995009640 1 -- 172.21.15.79:0/843423476 wait complete. 2024-06-10T00:16:21.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:16:21.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.724+0000 7f346f89e640 1 Processor -- start 2024-06-10T00:16:21.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.724+0000 7f346f89e640 1 -- start start 2024-06-10T00:16:21.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.725+0000 7f346f89e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f346815f1a0 0x7f34680d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.725+0000 7f346f89e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34680cef70 0x7f34680cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.725+0000 7f346f89e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f346815f5e0 con 0x7f34680d2680 2024-06-10T00:16:21.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.725+0000 7f346f89e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f34680d13e0 con 0x7f346815f1a0 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.725+0000 7f346f89e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f34680d0ad0 con 0x7f34680cef70 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.725+0000 7f346ce39640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f346815f1a0 0x7f34680d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.725+0000 7f346ce39640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f346815f1a0 0x7f34680d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49082/0 (socket says 172.21.15.79:49082) 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.725+0000 7f346ce39640 1 -- 172.21.15.79:0/2703530578 learned_addr learned my addr 172.21.15.79:0/2703530578 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.726+0000 7f346de3b640 1 --2- 172.21.15.79:0/2703530578 >> v2:172.21.15.117:3300/0 conn(0x7f34680cef70 0x7f34680cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.726+0000 7f346ce39640 1 -- 172.21.15.79:0/2703530578 >> v2:172.21.15.117:3300/0 conn(0x7f34680cef70 msgr2=0x7f34680cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.726+0000 7f346ce39640 1 --2- 172.21.15.79:0/2703530578 >> v2:172.21.15.117:3300/0 conn(0x7f34680cef70 0x7f34680cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.726+0000 7f346ce39640 1 -- 172.21.15.79:0/2703530578 >> v1:172.21.15.117:6789/0 conn(0x7f34680d2680 legacy=0x7f34680d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.726+0000 7f346ce39640 1 -- 172.21.15.79:0/2703530578 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346815f890 con 0x7f346815f1a0 2024-06-10T00:16:21.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.726+0000 7f346ce39640 1 --2- 172.21.15.79:0/2703530578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680d1fc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34680d1560 tx=0x7f345c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c076a4e45c8bfd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:21.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f3467fff640 1 -- 172.21.15.79:0/2703530578 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c037070 con 0x7f346815f1a0 2024-06-10T00:16:21.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f3467fff640 1 -- 172.21.15.79:0/2703530578 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345c032440 con 0x7f346815f1a0 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f3467fff640 1 -- 172.21.15.79:0/2703530578 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c032810 con 0x7f346815f1a0 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f346f89e640 1 -- 172.21.15.79:0/2703530578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 msgr2=0x7f34680d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f346f89e640 1 --2- 172.21.15.79:0/2703530578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680d1fc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34680d1560 tx=0x7f345c02a270 comp rx=0 tx=0).stop 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f346f89e640 1 -- 172.21.15.79:0/2703530578 shutdown_connections 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f346f89e640 1 --2- 172.21.15.79:0/2703530578 >> v2:172.21.15.117:3300/0 conn(0x7f34680cef70 0x7f34680cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f346f89e640 1 --2- 172.21.15.79:0/2703530578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680d1fc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f346f89e640 1 -- 172.21.15.79:0/2703530578 >> 172.21.15.79:0/2703530578 conn(0x7f346809d3f0 msgr2=0x7f34680d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f346f89e640 1 -- 172.21.15.79:0/2703530578 shutdown_connections 2024-06-10T00:16:21.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.727+0000 7f346f89e640 1 -- 172.21.15.79:0/2703530578 wait complete. 2024-06-10T00:16:21.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.728+0000 7f346f89e640 1 Processor -- start 2024-06-10T00:16:21.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.728+0000 7f346f89e640 1 -- start start 2024-06-10T00:16:21.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346f89e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34680cef70 0x7f34680b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346f89e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34680d2680 0x7f34680b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346f89e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346f89e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f34680d4f00 con 0x7f346815f1a0 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346f89e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f34680d1070 con 0x7f34680d2680 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346f89e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f34680d1870 con 0x7f34680cef70 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346de3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346de3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49098/0 (socket says 172.21.15.79:49098) 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346de3b640 1 -- 172.21.15.79:0/1927927483 learned_addr learned my addr 172.21.15.79:0/1927927483 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346ce39640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34680d2680 0x7f34680b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346d63a640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34680cef70 0x7f34680b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346de3b640 1 -- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34680cef70 msgr2=0x7f34680b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346de3b640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34680cef70 0x7f34680b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346de3b640 1 -- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34680d2680 msgr2=0x7f34680b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346de3b640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34680d2680 0x7f34680b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346de3b640 1 -- 172.21.15.79:0/1927927483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34680b9060 con 0x7f346815f1a0 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.729+0000 7f346d63a640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34680cef70 0x7f34680b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.730+0000 7f346de3b640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680b5360 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f346000e7f0 tx=0x7f346000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.730+0000 7f3465ffb640 1 -- 172.21.15.79:0/1927927483 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460017070 con 0x7f346815f1a0 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.730+0000 7f3465ffb640 1 -- 172.21.15.79:0/1927927483 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346000ee40 con 0x7f346815f1a0 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.730+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34680b9340 con 0x7f346815f1a0 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.730+0000 7f3465ffb640 1 -- 172.21.15.79:0/1927927483 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346000cb80 con 0x7f346815f1a0 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.730+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34680b9900 con 0x7f346815f1a0 2024-06-10T00:16:21.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.731+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34680b9b40 con 0x7f346815f1a0 2024-06-10T00:16:21.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.731+0000 7f3465ffb640 1 -- 172.21.15.79:0/1927927483 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f346001a070 con 0x7f346815f1a0 2024-06-10T00:16:21.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.732+0000 7f3465ffb640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f345406be30 0x7f345406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:21.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.732+0000 7f3465ffb640 1 -- 172.21.15.79:0/1927927483 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f346008b190 con 0x7f346815f1a0 2024-06-10T00:16:21.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.732+0000 7f346d63a640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f345406be30 0x7f345406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:21.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.732+0000 7f346d63a640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f345406be30 0x7f345406e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f34680cdf30 tx=0x7f3458009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:21.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.736+0000 7f3465ffb640 1 -- 172.21.15.79:0/1927927483 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3460059360 con 0x7f346815f1a0 2024-06-10T00:16:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.910+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3468068430 con 0x7f346815f1a0 2024-06-10T00:16:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.911+0000 7f3465ffb640 1 -- 172.21.15.79:0/1927927483 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16907 (secure 0 0 0) 0x7f346005d660 con 0x7f346815f1a0 2024-06-10T00:16:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:21.911 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":49,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:16:20.630672+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:16:19.229807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-10T00:16:19.607050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f345406be30 msgr2=0x7f345406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f345406be30 0x7f345406e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f34680cdf30 tx=0x7f3458009040 comp rx=0 tx=0).stop 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 msgr2=0x7f34680b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680b5360 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f346000e7f0 tx=0x7f346000ebf0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 shutdown_connections 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f345406be30 0x7f345406e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f346815f1a0 0x7f34680b5360 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34680d2680 0x7f34680b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 --2- 172.21.15.79:0/1927927483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34680cef70 0x7f34680b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 >> 172.21.15.79:0/1927927483 conn(0x7f346809d3f0 msgr2=0x7f346815a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 shutdown_connections 2024-06-10T00:16:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:21.913+0000 7f346f89e640 1 -- 172.21.15.79:0/1927927483 wait complete. 2024-06-10T00:16:21.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-10T00:16:22.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.027+0000 7f71c6253640 1 Processor -- start 2024-06-10T00:16:22.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.027+0000 7f71c6253640 1 -- start start 2024-06-10T00:16:22.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71c6253640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c00b3b40 0x7f71c00b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71c6253640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71c00b48e0 0x7f71c00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71c6253640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c015c870 con 0x7f71c00d0020 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71c6253640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f71c015cb50 con 0x7f71c00b48e0 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71c6253640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f71c015ce30 con 0x7f71c00b3b40 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71bffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f71c00d0020 0x7f71c006d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50994/0 (socket says 172.21.15.79:50994) 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71bffff640 1 -- 172.21.15.79:0/2955171814 learned_addr learned my addr 172.21.15.79:0/2955171814 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2955171814 >> v2:172.21.15.117:3300/0 conn(0x7f71c00b48e0 0x7f71c00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320263050 0 0) 0x7f71c015c870 con 0x7f71c00d0020 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71ac003520 con 0x7f71c00d0020 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.028+0000 7f71bf7fe640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c00b3b40 0x7f71c00b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2584001735 0 0) 0x7f71ac003520 con 0x7f71c00d0020 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c00b3b40 msgr2=0x7f71c00b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c00b3b40 0x7f71c00b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 >> v2:172.21.15.117:3300/0 conn(0x7f71c00b48e0 msgr2=0x7f71c00b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 --2- 172.21.15.79:0/2955171814 >> v2:172.21.15.117:3300/0 conn(0x7f71c00b48e0 0x7f71c00b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c015d110 con 0x7f71c00d0020 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f71b80019f0 con 0x7f71c00d0020 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 >> v1:172.21.15.79:6789/0 conn(0x7f71c00d0020 legacy=0x7f71c006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c00b3b40 0x7f71ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac003f30 0x7f71ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac004d40 0x7f71ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71c015cb50 con 0x7f71ac003f30 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f71c015ce30 con 0x7f71ac004d40 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac00ba10 con 0x7f71c00b3b40 2024-06-10T00:16:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac003f30 0x7f71ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71bf7fe640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c00b3b40 0x7f71ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71bffff640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac004d40 0x7f71ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71b7fff640 1 -- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c00b3b40 msgr2=0x7f71ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c00b3b40 0x7f71ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71b7fff640 1 -- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac004d40 msgr2=0x7f71ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac004d40 0x7f71ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71b7fff640 1 -- 172.21.15.79:0/2955171814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac003520 con 0x7f71ac003f30 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.029+0000 7f71bffff640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac004d40 0x7f71ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.030+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac003f30 0x7f71ac004800 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009af0 tx=0x7f71ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450670eebfa7fdd7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.030+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8036070 con 0x7f71ac003f30 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.030+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a8031400 con 0x7f71ac003f30 2024-06-10T00:16:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.030+0000 7f71beffd640 1 -- 172.21.15.79:0/2955171814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8009690 con 0x7f71ac003f30 2024-06-10T00:16:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.031+0000 7f71c6253640 1 -- 172.21.15.79:0/2955171814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac003f30 msgr2=0x7f71ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.031+0000 7f71c6253640 1 --2- 172.21.15.79:0/2955171814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac003f30 0x7f71ac004800 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009af0 tx=0x7f71ac005830 comp rx=0 tx=0).stop 2024-06-10T00:16:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.031+0000 7f71bffff640 1 -- 172.21.15.79:0/2955171814 reap_dead start 2024-06-10T00:16:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.031+0000 7f71c6253640 1 -- 172.21.15.79:0/2955171814 shutdown_connections 2024-06-10T00:16:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.031+0000 7f71c6253640 1 -- 172.21.15.79:0/2955171814 >> 172.21.15.79:0/2955171814 conn(0x7f71c00b1d10 msgr2=0x7f71c00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.031+0000 7f71c6253640 1 -- 172.21.15.79:0/2955171814 shutdown_connections 2024-06-10T00:16:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.031+0000 7f71c6253640 1 -- 172.21.15.79:0/2955171814 wait complete. 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.032+0000 7f71c6253640 1 Processor -- start 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.032+0000 7f71c6253640 1 -- start start 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71c6253640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac003f30 0x7f71c0152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71c6253640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c01554e0 0x7f71c01f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71c6253640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71c01f1c00 0x7f71c01f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71c6253640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71c015c490 con 0x7f71c01f1c00 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71c6253640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00b3f20 con 0x7f71ac003f30 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71c6253640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f71c015c610 con 0x7f71c01554e0 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71c01f1c00 0x7f71c01f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71c01f1c00 0x7f71c01f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49114/0 (socket says 172.21.15.79:49114) 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 -- 172.21.15.79:0/746233948 learned_addr learned my addr 172.21.15.79:0/746233948 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bf7fe640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac003f30 0x7f71c0152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71b7fff640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c01554e0 0x7f71c01f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 -- 172.21.15.79:0/746233948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c01554e0 msgr2=0x7f71c01f16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c01554e0 0x7f71c01f16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 -- 172.21.15.79:0/746233948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac003f30 msgr2=0x7f71c0152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac003f30 0x7f71c0152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 -- 172.21.15.79:0/746233948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c0153020 con 0x7f71c01f1c00 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bffff640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71c01f1c00 0x7f71c01f2060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f71c00ad460 tx=0x7f71b800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bcff9640 1 -- 172.21.15.79:0/746233948 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b800eda0 con 0x7f71c01f1c00 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bcff9640 1 -- 172.21.15.79:0/746233948 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8014430 con 0x7f71c01f1c00 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71bcff9640 1 -- 172.21.15.79:0/746233948 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8014820 con 0x7f71c01f1c00 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c0153300 con 0x7f71c01f1c00 2024-06-10T00:16:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.033+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c01538c0 con 0x7f71c01f1c00 2024-06-10T00:16:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.034+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c00683c0 con 0x7f71c01f1c00 2024-06-10T00:16:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.035+0000 7f71bcff9640 1 -- 172.21.15.79:0/746233948 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71b80149c0 con 0x7f71c01f1c00 2024-06-10T00:16:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.035+0000 7f71bcff9640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a006be30 0x7f71a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.035+0000 7f71bcff9640 1 -- 172.21.15.79:0/746233948 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f71b808ae80 con 0x7f71c01f1c00 2024-06-10T00:16:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.035+0000 7f71bf7fe640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a006be30 0x7f71a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.036+0000 7f71bf7fe640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a006be30 0x7f71a006e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009a20 tx=0x7f71b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.039+0000 7f71bcff9640 1 -- 172.21.15.79:0/746233948 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f71b80596a0 con 0x7f71c01f1c00 2024-06-10T00:16:22.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.249+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f71c0075430 con 0x7f71c01f1c00 2024-06-10T00:16:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.298+0000 7f71bcff9640 1 -- 172.21.15.79:0/746233948 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f71b8058fa0 con 0x7f71c01f1c00 2024-06-10T00:16:22.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.300+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a006be30 msgr2=0x7f71a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.300+0000 7f71c6253640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a006be30 0x7f71a006e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009a20 tx=0x7f71b0008040 comp rx=0 tx=0).stop 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.300+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71c01f1c00 msgr2=0x7f71c01f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.300+0000 7f71c6253640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71c01f1c00 0x7f71c01f2060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f71c00ad460 tx=0x7f71b800e530 comp rx=0 tx=0).stop 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.301+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 shutdown_connections 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.301+0000 7f71c6253640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a006be30 0x7f71a006e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.301+0000 7f71c6253640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71c01f1c00 0x7f71c01f2060 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.301+0000 7f71c6253640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71c01554e0 0x7f71c01f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.301+0000 7f71c6253640 1 --2- 172.21.15.79:0/746233948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71ac003f30 0x7f71c0152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.301+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 >> 172.21.15.79:0/746233948 conn(0x7f71c00b1d10 msgr2=0x7f71c00aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.301+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 shutdown_connections 2024-06-10T00:16:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.301+0000 7f71c6253640 1 -- 172.21.15.79:0/746233948 wait complete. 2024-06-10T00:16:22.312 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-10T00:16:22.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-10T00:16:22.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.414+0000 7fc194768640 1 Processor -- start 2024-06-10T00:16:22.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.414+0000 7fc194768640 1 -- start start 2024-06-10T00:16:22.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.415+0000 7fc194768640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc18c06cee0 0x7fc18c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.415+0000 7fc194768640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 0x7fc18c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.415+0000 7fc194768640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc18c070b50 con 0x7fc18c06d2c0 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.415+0000 7fc194768640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc18c070920 con 0x7fc18c06cee0 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.415+0000 7fc194768640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c0cfd40 con 0x7fc18c15e650 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.415+0000 7fc192504640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc18c06cee0 0x7fc18c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.415+0000 7fc192504640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc18c06cee0 0x7fc18c06c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49118/0 (socket says 172.21.15.79:49118) 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.415+0000 7fc192504640 1 -- 172.21.15.79:0/997164366 learned_addr learned my addr 172.21.15.79:0/997164366 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.416+0000 7fc192504640 1 -- 172.21.15.79:0/997164366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 msgr2=0x7fc18c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.416+0000 7fc192504640 1 --2- 172.21.15.79:0/997164366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 0x7fc18c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.416+0000 7fc192504640 1 -- 172.21.15.79:0/997164366 >> v1:172.21.15.79:6789/0 conn(0x7fc18c06d2c0 legacy=0x7fc18c161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.416+0000 7fc192504640 1 -- 172.21.15.79:0/997164366 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c0cff90 con 0x7fc18c06cee0 2024-06-10T00:16:22.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.416+0000 7fc192504640 1 --2- 172.21.15.79:0/997164366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c06c6e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc188009e50 tx=0x7fc18802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838856cdc9d6925d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:22.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.416+0000 7fc191502640 1 -- 172.21.15.79:0/997164366 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188036070 con 0x7fc18c06cee0 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc191502640 1 -- 172.21.15.79:0/997164366 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188031600 con 0x7fc18c06cee0 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc191502640 1 -- 172.21.15.79:0/997164366 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880319d0 con 0x7fc18c06cee0 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc194768640 1 -- 172.21.15.79:0/997164366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 msgr2=0x7fc18c06c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc194768640 1 --2- 172.21.15.79:0/997164366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c06c6e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc188009e50 tx=0x7fc18802a710 comp rx=0 tx=0).stop 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc194768640 1 -- 172.21.15.79:0/997164366 shutdown_connections 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc194768640 1 --2- 172.21.15.79:0/997164366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 0x7fc18c0703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc194768640 1 --2- 172.21.15.79:0/997164366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c06c6e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc194768640 1 -- 172.21.15.79:0/997164366 >> 172.21.15.79:0/997164366 conn(0x7fc18c0b3970 msgr2=0x7fc18c0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc194768640 1 -- 172.21.15.79:0/997164366 shutdown_connections 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.417+0000 7fc194768640 1 -- 172.21.15.79:0/997164366 wait complete. 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.418+0000 7fc194768640 1 Processor -- start 2024-06-10T00:16:22.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.418+0000 7fc194768640 1 -- start start 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc194768640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c1f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc194768640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c06d2c0 0x7fc18c153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc194768640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 0x7fc18c15be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc194768640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c06d770 con 0x7fc18c06cee0 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc194768640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c0d0550 con 0x7fc18c06d2c0 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc194768640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c0d1a80 con 0x7fc18c15e650 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192504640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c1f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192504640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c1f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49132/0 (socket says 172.21.15.79:49132) 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192504640 1 -- 172.21.15.79:0/541999410 learned_addr learned my addr 172.21.15.79:0/541999410 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192d05640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 0x7fc18c15be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc191d03640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c06d2c0 0x7fc18c153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192504640 1 -- 172.21.15.79:0/541999410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 msgr2=0x7fc18c15be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192504640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 0x7fc18c15be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192504640 1 -- 172.21.15.79:0/541999410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c06d2c0 msgr2=0x7fc18c153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192504640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c06d2c0 0x7fc18c153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.419+0000 7fc192504640 1 -- 172.21.15.79:0/541999410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c1f5750 con 0x7fc18c06cee0 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.420+0000 7fc192504640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c1f5210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc188000f80 tx=0x7fc188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.420+0000 7fc182ffd640 1 -- 172.21.15.79:0/541999410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188036050 con 0x7fc18c06cee0 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.420+0000 7fc182ffd640 1 -- 172.21.15.79:0/541999410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188042070 con 0x7fc18c06cee0 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.420+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c15acf0 con 0x7fc18c06cee0 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.420+0000 7fc182ffd640 1 -- 172.21.15.79:0/541999410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188009510 con 0x7fc18c06cee0 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.420+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c15b2b0 con 0x7fc18c06cee0 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.421+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18c0683c0 con 0x7fc18c06cee0 2024-06-10T00:16:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.421+0000 7fc182ffd640 1 -- 172.21.15.79:0/541999410 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc188007c70 con 0x7fc18c06cee0 2024-06-10T00:16:22.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.422+0000 7fc182ffd640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc17006be30 0x7fc17006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:22.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.422+0000 7fc191d03640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc17006be30 0x7fc17006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:22.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.422+0000 7fc182ffd640 1 -- 172.21.15.79:0/541999410 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fc1880abf70 con 0x7fc18c06cee0 2024-06-10T00:16:22.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.422+0000 7fc191d03640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc17006be30 0x7fc17006e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc18c157080 tx=0x7fc17c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:22.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.426+0000 7fc182ffd640 1 -- 172.21.15.79:0/541999410 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc18807a790 con 0x7fc18c06cee0 2024-06-10T00:16:22.522 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-06-10T00:16:22.522+0000 7f477ca6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:16:22.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:22.636+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc18c06ccc0 con 0x7fc18c06cee0 2024-06-10T00:16:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.306+0000 7fc182ffd640 1 -- 172.21.15.79:0/541999410 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fc18807a090 con 0x7fc18c06cee0 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc17006be30 msgr2=0x7fc17006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc17006be30 0x7fc17006e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc18c157080 tx=0x7fc17c008040 comp rx=0 tx=0).stop 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 msgr2=0x7fc18c1f5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c1f5210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc188000f80 tx=0x7fc188004a40 comp rx=0 tx=0).stop 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 shutdown_connections 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc17006be30 0x7fc17006e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc18c15e650 0x7fc18c15be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c06d2c0 0x7fc18c153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 --2- 172.21.15.79:0/541999410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc18c06cee0 0x7fc18c1f5210 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 >> 172.21.15.79:0/541999410 conn(0x7fc18c0b3970 msgr2=0x7fc18c153dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 shutdown_connections 2024-06-10T00:16:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.308+0000 7fc194768640 1 -- 172.21.15.79:0/541999410 wait complete. 2024-06-10T00:16:23.319 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-10T00:16:23.319 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:16:23.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.420+0000 7f728085d640 1 Processor -- start 2024-06-10T00:16:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.420+0000 7f728085d640 1 -- start start 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f728085d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f727c0b46d0 0x7f727c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f728085d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f727c072820 con 0x7f727c0cc6d0 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f728085d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f727c072b00 con 0x7f727c0721a0 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f728085d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f727c0725d0 con 0x7f727c0b46d0 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f7279d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f727c0b46d0 0x7f727c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f7279d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f727c0b46d0 0x7f727c071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49136/0 (socket says 172.21.15.79:49136) 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f7279d9b640 1 -- 172.21.15.79:0/4252614888 learned_addr learned my addr 172.21.15.79:0/4252614888 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f7279d9b640 1 -- 172.21.15.79:0/4252614888 >> v1:172.21.15.117:6789/0 conn(0x7f727c0721a0 legacy=0x7f727c165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f7279d9b640 1 -- 172.21.15.79:0/4252614888 >> v1:172.21.15.79:6789/0 conn(0x7f727c0cc6d0 legacy=0x7f727c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.421+0000 7f7279d9b640 1 -- 172.21.15.79:0/4252614888 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c072de0 con 0x7f727c0b46d0 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.422+0000 7f7279d9b640 1 --2- 172.21.15.79:0/4252614888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0b46d0 0x7f727c071c60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7270009870 tx=0x7f727002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e34d23582d6e712 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.422+0000 7f727959a640 1 -- 172.21.15.79:0/4252614888 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270037070 con 0x7f727c0b46d0 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.422+0000 7f727959a640 1 -- 172.21.15.79:0/4252614888 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270032440 con 0x7f727c0b46d0 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.422+0000 7f727959a640 1 -- 172.21.15.79:0/4252614888 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270032810 con 0x7f727c0b46d0 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.423+0000 7f728085d640 1 -- 172.21.15.79:0/4252614888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0b46d0 msgr2=0x7f727c071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.423+0000 7f728085d640 1 --2- 172.21.15.79:0/4252614888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0b46d0 0x7f727c071c60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7270009870 tx=0x7f727002a2a0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.423+0000 7f728085d640 1 -- 172.21.15.79:0/4252614888 shutdown_connections 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.423+0000 7f728085d640 1 --2- 172.21.15.79:0/4252614888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0b46d0 0x7f727c071c60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.423+0000 7f728085d640 1 -- 172.21.15.79:0/4252614888 >> 172.21.15.79:0/4252614888 conn(0x7f727c0b19f0 msgr2=0x7f727c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.423+0000 7f728085d640 1 -- 172.21.15.79:0/4252614888 shutdown_connections 2024-06-10T00:16:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.423+0000 7f728085d640 1 -- 172.21.15.79:0/4252614888 wait complete. 2024-06-10T00:16:23.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.424+0000 7f728085d640 1 Processor -- start 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.424+0000 7f728085d640 1 -- start start 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f728085d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f727c0721a0 0x7f727c0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f728085d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f727c0b46d0 0x7f727c158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f728085d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0cc6d0 0x7f727c159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f728085d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f727c159f60 con 0x7f727c0cc6d0 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f728085d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f727c15c890 con 0x7f727c0b46d0 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f728085d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f727c167350 con 0x7f727c0721a0 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0cc6d0 0x7f727c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0cc6d0 0x7f727c159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49150/0 (socket says 172.21.15.79:49150) 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 -- 172.21.15.79:0/2854860236 learned_addr learned my addr 172.21.15.79:0/2854860236 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f7279d9b640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f727c0b46d0 0x7f727c158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727a59c640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f727c0721a0 0x7f727c0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 -- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f727c0721a0 msgr2=0x7f727c0add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f727c0721a0 0x7f727c0add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 -- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f727c0b46d0 msgr2=0x7f727c158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f727c0b46d0 0x7f727c158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 -- 172.21.15.79:0/2854860236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c0c9f80 con 0x7f727c0cc6d0 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f7279d9b640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f727c0b46d0 0x7f727c158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727a59c640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f727c0721a0 0x7f727c0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.425+0000 7f727ad9d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0cc6d0 0x7f727c159080 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f727400b990 tx=0x7f727400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.426+0000 7f726affd640 1 -- 172.21.15.79:0/2854860236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274019070 con 0x7f727c0cc6d0 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.426+0000 7f726affd640 1 -- 172.21.15.79:0/2854860236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727400cba0 con 0x7f727c0cc6d0 2024-06-10T00:16:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.426+0000 7f726affd640 1 -- 172.21.15.79:0/2854860236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274014440 con 0x7f727c0cc6d0 2024-06-10T00:16:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.426+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c0ca260 con 0x7f727c0cc6d0 2024-06-10T00:16:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.426+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c0ca820 con 0x7f727c0cc6d0 2024-06-10T00:16:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.427+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727c068430 con 0x7f727c0cc6d0 2024-06-10T00:16:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.427+0000 7f726affd640 1 -- 172.21.15.79:0/2854860236 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f727401c070 con 0x7f727c0cc6d0 2024-06-10T00:16:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.428+0000 7f726affd640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f725c06be30 0x7f725c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.428+0000 7f727a59c640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f725c06be30 0x7f725c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.428+0000 7f726affd640 1 -- 172.21.15.79:0/2854860236 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f727408acf0 con 0x7f727c0cc6d0 2024-06-10T00:16:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.429+0000 7f727a59c640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f725c06be30 0x7f725c06e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f726c001680 tx=0x7f726c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:23.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.432+0000 7f726affd640 1 -- 172.21.15.79:0/2854860236 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f727408f070 con 0x7f727c0cc6d0 2024-06-10T00:16:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.641+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f727c0b04c0 con 0x7f727c0cc6d0 2024-06-10T00:16:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.642+0000 7f726affd640 1 -- 172.21.15.79:0/2854860236 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5184 (secure 0 0 0) 0x7f72740595a0 con 0x7f727c0cc6d0 2024-06-10T00:16:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:23.642 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:16:20.631079+0000","modified":"2024-06-10T00:16:22.637364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1724490819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1724490819},{"type":"v1","addr":"172.21.15.117:6835","nonce":1724490819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":3}]} 2024-06-10T00:16:23.642 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f725c06be30 msgr2=0x7f725c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f725c06be30 0x7f725c06e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f726c001680 tx=0x7f726c009040 comp rx=0 tx=0).stop 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0cc6d0 msgr2=0x7f727c159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0cc6d0 0x7f727c159080 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f727400b990 tx=0x7f727400be50 comp rx=0 tx=0).stop 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 shutdown_connections 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f725c06be30 0x7f725c06e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c0cc6d0 0x7f727c159080 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f727c0b46d0 0x7f727c158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 --2- 172.21.15.79:0/2854860236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f727c0721a0 0x7f727c0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 >> 172.21.15.79:0/2854860236 conn(0x7f727c0b19f0 msgr2=0x7f727c0af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 shutdown_connections 2024-06-10T00:16:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.644+0000 7f728085d640 1 -- 172.21.15.79:0/2854860236 wait complete. 2024-06-10T00:16:23.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:16:23.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.753+0000 7fcb75e12640 1 Processor -- start 2024-06-10T00:16:23.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.753+0000 7fcb75e12640 1 -- start start 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb75e12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb700cc6d0 0x7fcb700ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb75e12640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb70071c60 0x7fcb70072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb75e12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb700b36c0 0x7fcb700b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb75e12640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcb700ccff0 con 0x7fcb70071c60 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb75e12640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcb70072820 con 0x7fcb700cc6d0 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb75e12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb70072b00 con 0x7fcb700b36c0 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb6effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb70071c60 0x7fcb70072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb6effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb70071c60 0x7fcb70072110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49164/0 (socket says 172.21.15.79:49164) 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb6effd640 1 -- 172.21.15.79:0/721840644 learned_addr learned my addr 172.21.15.79:0/721840644 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb6effd640 1 -- 172.21.15.79:0/721840644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb700b36c0 msgr2=0x7fcb700b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:23.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb6effd640 1 --2- 172.21.15.79:0/721840644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb700b36c0 0x7fcb700b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb6effd640 1 -- 172.21.15.79:0/721840644 >> v2:172.21.15.117:3300/0 conn(0x7fcb700cc6d0 msgr2=0x7fcb700ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:23.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb6effd640 1 --2- 172.21.15.79:0/721840644 >> v2:172.21.15.117:3300/0 conn(0x7fcb700cc6d0 0x7fcb700ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.754+0000 7fcb6effd640 1 -- 172.21.15.79:0/721840644 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb70072de0 con 0x7fcb70071c60 2024-06-10T00:16:23.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.755+0000 7fcb6effd640 1 --2- 172.21.15.79:0/721840644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb70071c60 0x7fcb70072110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb7009e090 tx=0x7fcb6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcae6cb24c35930 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:23.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.755+0000 7fcb6e7fc640 1 -- 172.21.15.79:0/721840644 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64037070 con 0x7fcb70071c60 2024-06-10T00:16:23.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.755+0000 7fcb6e7fc640 1 -- 172.21.15.79:0/721840644 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb64032440 con 0x7fcb70071c60 2024-06-10T00:16:23.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.755+0000 7fcb6e7fc640 1 -- 172.21.15.79:0/721840644 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64032810 con 0x7fcb70071c60 2024-06-10T00:16:23.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 -- 172.21.15.79:0/721840644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb70071c60 msgr2=0x7fcb70072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 --2- 172.21.15.79:0/721840644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb70071c60 0x7fcb70072110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb7009e090 tx=0x7fcb6402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 -- 172.21.15.79:0/721840644 shutdown_connections 2024-06-10T00:16:23.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 --2- 172.21.15.79:0/721840644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb700b36c0 0x7fcb700b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 --2- 172.21.15.79:0/721840644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb70071c60 0x7fcb70072110 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 --2- 172.21.15.79:0/721840644 >> v2:172.21.15.117:3300/0 conn(0x7fcb700cc6d0 0x7fcb700ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 -- 172.21.15.79:0/721840644 >> 172.21.15.79:0/721840644 conn(0x7fcb700b19f0 msgr2=0x7fcb700b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:23.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 -- 172.21.15.79:0/721840644 shutdown_connections 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.756+0000 7fcb75e12640 1 -- 172.21.15.79:0/721840644 wait complete. 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.757+0000 7fcb75e12640 1 Processor -- start 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.757+0000 7fcb75e12640 1 -- start start 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb75e12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb70071c60 0x7fcb701456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb75e12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb700b36c0 0x7fcb700afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb75e12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb700cc6d0 0x7fcb700aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb75e12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70159f60 con 0x7fcb700b36c0 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb75e12640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7015c890 con 0x7fcb70071c60 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb75e12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb700b4070 con 0x7fcb700cc6d0 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb700b36c0 0x7fcb700afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb700b36c0 0x7fcb700afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49180/0 (socket says 172.21.15.79:49180) 2024-06-10T00:16:23.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 -- 172.21.15.79:0/1251214990 learned_addr learned my addr 172.21.15.79:0/1251214990 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 -- 172.21.15.79:0/1251214990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb700cc6d0 msgr2=0x7fcb700aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb700cc6d0 0x7fcb700aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 -- 172.21.15.79:0/1251214990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb70071c60 msgr2=0x7fcb701456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb70071c60 0x7fcb701456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 -- 172.21.15.79:0/1251214990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb70155f80 con 0x7fcb700b36c0 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb6effd640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb700b36c0 0x7fcb700afa40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcb64000c00 tx=0x7fcb640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb57fff640 1 -- 172.21.15.79:0/1251214990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64041070 con 0x7fcb700b36c0 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb57fff640 1 -- 172.21.15.79:0/1251214990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6403c870 con 0x7fcb700b36c0 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.758+0000 7fcb57fff640 1 -- 172.21.15.79:0/1251214990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64037040 con 0x7fcb700b36c0 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.759+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb70157680 con 0x7fcb700b36c0 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.759+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb70145bf0 con 0x7fcb700b36c0 2024-06-10T00:16:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.760+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb70068430 con 0x7fcb700b36c0 2024-06-10T00:16:23.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.760+0000 7fcb57fff640 1 -- 172.21.15.79:0/1251214990 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb64044070 con 0x7fcb700b36c0 2024-06-10T00:16:23.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.760+0000 7fcb57fff640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5c06be30 0x7fcb5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:23.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.761+0000 7fcb57fff640 1 -- 172.21.15.79:0/1251214990 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fcb640abb50 con 0x7fcb700b36c0 2024-06-10T00:16:23.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.761+0000 7fcb6f7fe640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5c06be30 0x7fcb5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:23.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.761+0000 7fcb6f7fe640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5c06be30 0x7fcb5c06e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009670 tx=0x7fcb60006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:23.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.765+0000 7fcb57fff640 1 -- 172.21.15.79:0/1251214990 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcb6407a400 con 0x7fcb700b36c0 2024-06-10T00:16:23.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.941+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb700cc1b0 con 0x7fcb700b36c0 2024-06-10T00:16:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.942+0000 7fcb57fff640 1 -- 172.21.15.79:0/1251214990 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16894 (secure 0 0 0) 0x7fcb64079d00 con 0x7fcb700b36c0 2024-06-10T00:16:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:23.942 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:16:22.285313+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:16:19.229807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-10T00:16:19.607050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:16:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5c06be30 msgr2=0x7fcb5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5c06be30 0x7fcb5c06e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009670 tx=0x7fcb60006bf0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb700b36c0 msgr2=0x7fcb700afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb700b36c0 0x7fcb700afa40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcb64000c00 tx=0x7fcb640046c0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 shutdown_connections 2024-06-10T00:16:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5c06be30 0x7fcb5c06e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb700cc6d0 0x7fcb700aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb700b36c0 0x7fcb700afa40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 --2- 172.21.15.79:0/1251214990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb70071c60 0x7fcb701456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:23.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 >> 172.21.15.79:0/1251214990 conn(0x7fcb700b19f0 msgr2=0x7fcb700b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:23.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 shutdown_connections 2024-06-10T00:16:23.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:23.945+0000 7fcb75e12640 1 -- 172.21.15.79:0/1251214990 wait complete. 2024-06-10T00:16:23.955 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:16:23.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:16:24.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.056+0000 7f6cb2283640 1 Processor -- start 2024-06-10T00:16:24.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.056+0000 7f6cb2283640 1 -- start start 2024-06-10T00:16:24.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.056+0000 7f6cb2283640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 0x7f6cac15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.056+0000 7f6cb2283640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6cac0d1fc0 0x7f6cac0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.056+0000 7f6cb2283640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6cac161fa0 0x7f6cac162430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.056+0000 7f6cb2283640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6cac0d13e0 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.056+0000 7f6cb2283640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6cac0d2fa0 con 0x7f6cac161fa0 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.056+0000 7f6cb2283640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac0d0ad0 con 0x7f6cac0d2680 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cab7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6cac0d1fc0 0x7f6cac0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cab7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6cac0d1fc0 0x7f6cac0d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49196/0 (socket says 172.21.15.79:49196) 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cab7fe640 1 -- 172.21.15.79:0/623211142 learned_addr learned my addr 172.21.15.79:0/623211142 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cb0820640 1 --2- 172.21.15.79:0/623211142 >> v2:172.21.15.117:3300/0 conn(0x7f6cac161fa0 0x7f6cac162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cab7fe640 1 -- 172.21.15.79:0/623211142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 msgr2=0x7f6cac15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cabfff640 1 --2- 172.21.15.79:0/623211142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 0x7f6cac15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cab7fe640 1 --2- 172.21.15.79:0/623211142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 0x7f6cac15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cab7fe640 1 -- 172.21.15.79:0/623211142 >> v2:172.21.15.117:3300/0 conn(0x7f6cac161fa0 msgr2=0x7f6cac162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cab7fe640 1 --2- 172.21.15.79:0/623211142 >> v2:172.21.15.117:3300/0 conn(0x7f6cac161fa0 0x7f6cac162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cab7fe640 1 -- 172.21.15.79:0/623211142 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac15f890 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.057+0000 7f6cb0820640 1 --2- 172.21.15.79:0/623211142 >> v2:172.21.15.117:3300/0 conn(0x7f6cac161fa0 0x7f6cac162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cab7fe640 1 --2- 172.21.15.79:0/623211142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac0d2a60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6cac161ee0 tx=0x7f6ca002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df250532f2600f1f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6caaffd640 1 -- 172.21.15.79:0/623211142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0037070 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6caaffd640 1 -- 172.21.15.79:0/623211142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca0032440 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6caaffd640 1 -- 172.21.15.79:0/623211142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0032810 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 -- 172.21.15.79:0/623211142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 msgr2=0x7f6cac0d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 --2- 172.21.15.79:0/623211142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac0d2a60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6cac161ee0 tx=0x7f6ca002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 -- 172.21.15.79:0/623211142 shutdown_connections 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 --2- 172.21.15.79:0/623211142 >> v2:172.21.15.117:3300/0 conn(0x7f6cac161fa0 0x7f6cac162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 --2- 172.21.15.79:0/623211142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac0d2a60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 --2- 172.21.15.79:0/623211142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 0x7f6cac15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 -- 172.21.15.79:0/623211142 >> 172.21.15.79:0/623211142 conn(0x7f6cac09d3f0 msgr2=0x7f6cac0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 -- 172.21.15.79:0/623211142 shutdown_connections 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.058+0000 7f6cb2283640 1 -- 172.21.15.79:0/623211142 wait complete. 2024-06-10T00:16:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.060+0000 7f6cb2283640 1 Processor -- start 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.060+0000 7f6cb2283640 1 -- start start 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.060+0000 7f6cb2283640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.060+0000 7f6cb2283640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 0x7f6cac15ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.060+0000 7f6cb2283640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cac161fa0 0x7f6cac15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.060+0000 7f6cb2283640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0d2400 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.060+0000 7f6cb2283640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0d1070 con 0x7f6cac161fa0 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.060+0000 7f6cb2283640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac0d4f00 con 0x7f6cac0d2680 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac15a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49204/0 (socket says 172.21.15.79:49204) 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 -- 172.21.15.79:0/4130846753 learned_addr learned my addr 172.21.15.79:0/4130846753 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cab7fe640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 0x7f6cac15ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cb0820640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cac161fa0 0x7f6cac15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 -- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 msgr2=0x7f6cac15ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 0x7f6cac15ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 -- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cac161fa0 msgr2=0x7f6cac15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cac161fa0 0x7f6cac15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 -- 172.21.15.79:0/4130846753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac0cbf00 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cb0820640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cac161fa0 0x7f6cac15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cabfff640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac15a650 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c7f0 tx=0x7f6c9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6ca8ff9640 1 -- 172.21.15.79:0/4130846753 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c015070 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6ca8ff9640 1 -- 172.21.15.79:0/4130846753 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c004220 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6ca8ff9640 1 -- 172.21.15.79:0/4130846753 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c007620 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac0cc1e0 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.061+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac0cc7a0 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.062+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac073620 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.063+0000 7f6ca8ff9640 1 -- 172.21.15.79:0/4130846753 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c9c0079d0 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.063+0000 7f6ca8ff9640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c9806be60 0x7f6c9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.063+0000 7f6ca8ff9640 1 -- 172.21.15.79:0/4130846753 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f6c9c08b0e0 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.063+0000 7f6cab7fe640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c9806be60 0x7f6c9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.064+0000 7f6cab7fe640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c9806be60 0x7f6c9806e320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0034000 tx=0x7f6ca002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.067+0000 7f6ca8ff9640 1 -- 172.21.15.79:0/4130846753 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6cac073620 con 0x7f6cac0d1fc0 2024-06-10T00:16:24.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.240+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6cac15ab90 con 0x7f6c9806be60 2024-06-10T00:16:24.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.245+0000 7f6ca8ff9640 1 -- 172.21.15.79:0/4130846753 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7f6ca00327b0 con 0x7f6c9806be60 2024-06-10T00:16:24.248 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:24.249 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c9806be60 msgr2=0x7f6c9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c9806be60 0x7f6c9806e320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0034000 tx=0x7f6ca002e000 comp rx=0 tx=0).stop 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 msgr2=0x7f6cac15a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac15a650 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c7f0 tx=0x7f6c9c00ccb0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 shutdown_connections 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c9806be60 0x7f6c9806e320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cac161fa0 0x7f6cac15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cac0d2680 0x7f6cac15ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 --2- 172.21.15.79:0/4130846753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cac0d1fc0 0x7f6cac15a650 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 >> 172.21.15.79:0/4130846753 conn(0x7f6cac09d3f0 msgr2=0x7f6cac161530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:24.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 shutdown_connections 2024-06-10T00:16:24.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.248+0000 7f6cb2283640 1 -- 172.21.15.79:0/4130846753 wait complete. 2024-06-10T00:16:24.259 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-06-10T00:16:23.167419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221788,"kb_used_data":5572,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752932,"statfs":{"total":773094113280,"available":772867002368,"internally_reserved":0,"allocated":5705728,"data_stored":3155839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000778"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292207+0000","last_change":"2024-06-10T00:16:20.292207+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292207+0000","last_undegraded":"2024-06-10T00:16:20.292207+0000","last_fullsized":"2024-06-10T00:16:20.292207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292285+0000","last_change":"2024-06-10T00:16:20.292285+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292285+0000","last_undegraded":"2024-06-10T00:16:20.292285+0000","last_fullsized":"2024-06-10T00:16:20.292285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297906+0000","last_change":"2024-06-10T00:16:20.297906+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297906+0000","last_undegraded":"2024-06-10T00:16:20.297906+0000","last_fullsized":"2024-06-10T00:16:20.297906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290662+0000","last_change":"2024-06-10T00:16:20.290662+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290662+0000","last_undegraded":"2024-06-10T00:16:20.290662+0000","last_fullsized":"2024-06-10T00:16:20.290662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289043+0000","last_change":"2024-06-10T00:16:20.289043+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289043+0000","last_undegraded":"2024-06-10T00:16:20.289043+0000","last_fullsized":"2024-06-10T00:16:20.289043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292419+0000","last_change":"2024-06-10T00:16:20.292419+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292419+0000","last_undegraded":"2024-06-10T00:16:20.292419+0000","last_fullsized":"2024-06-10T00:16:20.292419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296405+0000","last_change":"2024-06-10T00:16:20.296405+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296405+0000","last_undegraded":"2024-06-10T00:16:20.296405+0000","last_fullsized":"2024-06-10T00:16:20.296405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295580+0000","last_change":"2024-06-10T00:16:20.295580+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295580+0000","last_undegraded":"2024-06-10T00:16:20.295580+0000","last_fullsized":"2024-06-10T00:16:20.295580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294002+0000","last_change":"2024-06-10T00:16:20.294002+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294002+0000","last_undegraded":"2024-06-10T00:16:20.294002+0000","last_fullsized":"2024-06-10T00:16:20.294002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291900+0000","last_change":"2024-06-10T00:16:20.291900+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291900+0000","last_undegraded":"2024-06-10T00:16:20.291900+0000","last_fullsized":"2024-06-10T00:16:20.291900+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297704+0000","last_change":"2024-06-10T00:16:20.297704+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297704+0000","last_undegraded":"2024-06-10T00:16:20.297704+0000","last_fullsized":"2024-06-10T00:16:20.297704+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292777+0000","last_change":"2024-06-10T00:16:20.292777+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292777+0000","last_undegraded":"2024-06-10T00:16:20.292777+0000","last_fullsized":"2024-06-10T00:16:20.292777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291477+0000","last_change":"2024-06-10T00:16:20.291477+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291477+0000","last_undegraded":"2024-06-10T00:16:20.291477+0000","last_fullsized":"2024-06-10T00:16:20.291477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295384+0000","last_change":"2024-06-10T00:16:20.295384+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295384+0000","last_undegraded":"2024-06-10T00:16:20.295384+0000","last_fullsized":"2024-06-10T00:16:20.295384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290636+0000","last_change":"2024-06-10T00:16:20.290636+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290636+0000","last_undegraded":"2024-06-10T00:16:20.290636+0000","last_fullsized":"2024-06-10T00:16:20.290636+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291199+0000","last_change":"2024-06-10T00:16:20.291199+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291199+0000","last_undegraded":"2024-06-10T00:16:20.291199+0000","last_fullsized":"2024-06-10T00:16:20.291199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.301114+0000","last_change":"2024-06-10T00:16:20.301114+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.301114+0000","last_undegraded":"2024-06-10T00:16:20.301114+0000","last_fullsized":"2024-06-10T00:16:20.301114+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291494+0000","last_change":"2024-06-10T00:16:20.291494+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291494+0000","last_undegraded":"2024-06-10T00:16:20.291494+0000","last_fullsized":"2024-06-10T00:16:20.291494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297279+0000","last_change":"2024-06-10T00:16:20.297279+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297279+0000","last_undegraded":"2024-06-10T00:16:20.297279+0000","last_fullsized":"2024-06-10T00:16:20.297279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294476+0000","last_change":"2024-06-10T00:16:20.294476+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294476+0000","last_undegraded":"2024-06-10T00:16:20.294476+0000","last_fullsized":"2024-06-10T00:16:20.294476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296057+0000","last_change":"2024-06-10T00:16:20.296057+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296057+0000","last_undegraded":"2024-06-10T00:16:20.296057+0000","last_fullsized":"2024-06-10T00:16:20.296057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293602+0000","last_change":"2024-06-10T00:16:20.293602+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293602+0000","last_undegraded":"2024-06-10T00:16:20.293602+0000","last_fullsized":"2024-06-10T00:16:20.293602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296488+0000","last_change":"2024-06-10T00:16:20.296488+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296488+0000","last_undegraded":"2024-06-10T00:16:20.296488+0000","last_fullsized":"2024-06-10T00:16:20.296488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294763+0000","last_change":"2024-06-10T00:16:20.294763+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294763+0000","last_undegraded":"2024-06-10T00:16:20.294763+0000","last_fullsized":"2024-06-10T00:16:20.294763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.300280+0000","last_change":"2024-06-10T00:16:20.300280+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.300280+0000","last_undegraded":"2024-06-10T00:16:20.300280+0000","last_fullsized":"2024-06-10T00:16:20.300280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295052+0000","last_change":"2024-06-10T00:16:20.295052+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295052+0000","last_undegraded":"2024-06-10T00:16:20.295052+0000","last_fullsized":"2024-06-10T00:16:20.295052+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291206+0000","last_change":"2024-06-10T00:16:20.291206+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291206+0000","last_undegraded":"2024-06-10T00:16:20.291206+0000","last_fullsized":"2024-06-10T00:16:20.291206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294087+0000","last_change":"2024-06-10T00:16:20.294087+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294087+0000","last_undegraded":"2024-06-10T00:16:20.294087+0000","last_fullsized":"2024-06-10T00:16:20.294087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296088+0000","last_change":"2024-06-10T00:16:20.296088+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296088+0000","last_undegraded":"2024-06-10T00:16:20.296088+0000","last_fullsized":"2024-06-10T00:16:20.296088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290938+0000","last_change":"2024-06-10T00:16:20.290938+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290938+0000","last_undegraded":"2024-06-10T00:16:20.290938+0000","last_fullsized":"2024-06-10T00:16:20.290938+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296046+0000","last_change":"2024-06-10T00:16:20.296046+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296046+0000","last_undegraded":"2024-06-10T00:16:20.296046+0000","last_fullsized":"2024-06-10T00:16:20.296046+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288285+0000","last_change":"2024-06-10T00:16:20.288285+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288285+0000","last_undegraded":"2024-06-10T00:16:20.288285+0000","last_fullsized":"2024-06-10T00:16:20.288285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290545+0000","last_change":"2024-06-10T00:16:20.290545+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290545+0000","last_undegraded":"2024-06-10T00:16:20.290545+0000","last_fullsized":"2024-06-10T00:16:20.290545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304382+0000","last_change":"2024-06-10T00:16:20.297870+0000","last_active":"2024-06-10T00:16:20.304382+0000","last_peered":"2024-06-10T00:16:20.304382+0000","last_clean":"2024-06-10T00:16:20.304382+0000","last_became_active":"2024-06-10T00:16:20.297484+0000","last_became_peered":"2024-06-10T00:16:20.297484+0000","last_unstale":"2024-06-10T00:16:20.304382+0000","last_undegraded":"2024-06-10T00:16:20.304382+0000","last_fullsized":"2024-06-10T00:16:20.304382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:20.625301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287546+0000","last_change":"2024-06-10T00:16:20.287546+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287546+0000","last_undegraded":"2024-06-10T00:16:20.287546+0000","last_fullsized":"2024-06-10T00:16:20.287546+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.305239+0000","last_change":"2024-06-10T00:16:20.303002+0000","last_active":"2024-06-10T00:16:20.305239+0000","last_peered":"2024-06-10T00:16:20.305239+0000","last_clean":"2024-06-10T00:16:20.305239+0000","last_became_active":"2024-06-10T00:16:20.302738+0000","last_became_peered":"2024-06-10T00:16:20.302738+0000","last_unstale":"2024-06-10T00:16:20.305239+0000","last_undegraded":"2024-06-10T00:16:20.305239+0000","last_fullsized":"2024-06-10T00:16:20.305239+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296035+0000","last_change":"2024-06-10T00:16:20.296035+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296035+0000","last_undegraded":"2024-06-10T00:16:20.296035+0000","last_fullsized":"2024-06-10T00:16:20.296035+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.303123+0000","last_change":"2024-06-10T00:16:20.299695+0000","last_active":"2024-06-10T00:16:20.303123+0000","last_peered":"2024-06-10T00:16:20.303123+0000","last_clean":"2024-06-10T00:16:20.303123+0000","last_became_active":"2024-06-10T00:16:20.299435+0000","last_became_peered":"2024-06-10T00:16:20.299435+0000","last_unstale":"2024-06-10T00:16:20.303123+0000","last_undegraded":"2024-06-10T00:16:20.303123+0000","last_fullsized":"2024-06-10T00:16:20.303123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:33.552452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294200+0000","last_change":"2024-06-10T00:16:20.294200+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294200+0000","last_undegraded":"2024-06-10T00:16:20.294200+0000","last_fullsized":"2024-06-10T00:16:20.294200+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304851+0000","last_change":"2024-06-10T00:16:20.300555+0000","last_active":"2024-06-10T00:16:20.304851+0000","last_peered":"2024-06-10T00:16:20.304851+0000","last_clean":"2024-06-10T00:16:20.304851+0000","last_became_active":"2024-06-10T00:16:20.300241+0000","last_became_peered":"2024-06-10T00:16:20.300241+0000","last_unstale":"2024-06-10T00:16:20.304851+0000","last_undegraded":"2024-06-10T00:16:20.304851+0000","last_fullsized":"2024-06-10T00:16:20.304851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:55.681863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289108+0000","last_change":"2024-06-10T00:16:20.289108+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289108+0000","last_undegraded":"2024-06-10T00:16:20.289108+0000","last_fullsized":"2024-06-10T00:16:20.289108+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308906+0000","last_change":"2024-06-10T00:16:20.305776+0000","last_active":"2024-06-10T00:16:20.308906+0000","last_peered":"2024-06-10T00:16:20.308906+0000","last_clean":"2024-06-10T00:16:20.308906+0000","last_became_active":"2024-06-10T00:16:20.305527+0000","last_became_peered":"2024-06-10T00:16:20.305527+0000","last_unstale":"2024-06-10T00:16:20.308906+0000","last_undegraded":"2024-06-10T00:16:20.308906+0000","last_fullsized":"2024-06-10T00:16:20.308906+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:24:01.616634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291706+0000","last_change":"2024-06-10T00:16:20.291706+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291706+0000","last_undegraded":"2024-06-10T00:16:20.291706+0000","last_fullsized":"2024-06-10T00:16:20.291706+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.301501+0000","last_change":"2024-06-10T00:16:20.298240+0000","last_active":"2024-06-10T00:16:20.301501+0000","last_peered":"2024-06-10T00:16:20.301501+0000","last_clean":"2024-06-10T00:16:20.301501+0000","last_became_active":"2024-06-10T00:16:20.297962+0000","last_became_peered":"2024-06-10T00:16:20.297962+0000","last_unstale":"2024-06-10T00:16:20.301501+0000","last_undegraded":"2024-06-10T00:16:20.301501+0000","last_fullsized":"2024-06-10T00:16:20.301501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292961+0000","last_change":"2024-06-10T00:16:20.292961+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292961+0000","last_undegraded":"2024-06-10T00:16:20.292961+0000","last_fullsized":"2024-06-10T00:16:20.292961+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304440+0000","last_change":"2024-06-10T00:16:20.298791+0000","last_active":"2024-06-10T00:16:20.304440+0000","last_peered":"2024-06-10T00:16:20.304440+0000","last_clean":"2024-06-10T00:16:20.304440+0000","last_became_active":"2024-06-10T00:16:20.297457+0000","last_became_peered":"2024-06-10T00:16:20.297457+0000","last_unstale":"2024-06-10T00:16:20.304440+0000","last_undegraded":"2024-06-10T00:16:20.304440+0000","last_fullsized":"2024-06-10T00:16:20.304440+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:55.550063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291642+0000","last_change":"2024-06-10T00:16:20.291642+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291642+0000","last_undegraded":"2024-06-10T00:16:20.291642+0000","last_fullsized":"2024-06-10T00:16:20.291642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.309257+0000","last_change":"2024-06-10T00:16:20.307746+0000","last_active":"2024-06-10T00:16:20.309257+0000","last_peered":"2024-06-10T00:16:20.309257+0000","last_clean":"2024-06-10T00:16:20.309257+0000","last_became_active":"2024-06-10T00:16:20.306090+0000","last_became_peered":"2024-06-10T00:16:20.306090+0000","last_unstale":"2024-06-10T00:16:20.309257+0000","last_undegraded":"2024-06-10T00:16:20.309257+0000","last_fullsized":"2024-06-10T00:16:20.309257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:53.046468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288041+0000","last_change":"2024-06-10T00:16:20.288041+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288041+0000","last_undegraded":"2024-06-10T00:16:20.288041+0000","last_fullsized":"2024-06-10T00:16:20.288041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.299771+0000","last_change":"2024-06-10T00:16:20.297128+0000","last_active":"2024-06-10T00:16:20.299771+0000","last_peered":"2024-06-10T00:16:20.299771+0000","last_clean":"2024-06-10T00:16:20.299771+0000","last_became_active":"2024-06-10T00:16:20.296839+0000","last_became_peered":"2024-06-10T00:16:20.296839+0000","last_unstale":"2024-06-10T00:16:20.299771+0000","last_undegraded":"2024-06-10T00:16:20.299771+0000","last_fullsized":"2024-06-10T00:16:20.299771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288797+0000","last_change":"2024-06-10T00:16:20.288797+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288797+0000","last_undegraded":"2024-06-10T00:16:20.288797+0000","last_fullsized":"2024-06-10T00:16:20.288797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312825+0000","last_change":"2024-06-10T00:16:20.309837+0000","last_active":"2024-06-10T00:16:20.312825+0000","last_peered":"2024-06-10T00:16:20.312825+0000","last_clean":"2024-06-10T00:16:20.312825+0000","last_became_active":"2024-06-10T00:16:20.309531+0000","last_became_peered":"2024-06-10T00:16:20.309531+0000","last_unstale":"2024-06-10T00:16:20.312825+0000","last_undegraded":"2024-06-10T00:16:20.312825+0000","last_fullsized":"2024-06-10T00:16:20.312825+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295043+0000","last_change":"2024-06-10T00:16:20.295043+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295043+0000","last_undegraded":"2024-06-10T00:16:20.295043+0000","last_fullsized":"2024-06-10T00:16:20.295043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304676+0000","last_change":"2024-06-10T00:16:20.300508+0000","last_active":"2024-06-10T00:16:20.304676+0000","last_peered":"2024-06-10T00:16:20.304676+0000","last_clean":"2024-06-10T00:16:20.304676+0000","last_became_active":"2024-06-10T00:16:20.300209+0000","last_became_peered":"2024-06-10T00:16:20.300209+0000","last_unstale":"2024-06-10T00:16:20.304676+0000","last_undegraded":"2024-06-10T00:16:20.304676+0000","last_fullsized":"2024-06-10T00:16:20.304676+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:01:40.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288604+0000","last_change":"2024-06-10T00:16:20.288604+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288604+0000","last_undegraded":"2024-06-10T00:16:20.288604+0000","last_fullsized":"2024-06-10T00:16:20.288604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306552+0000","last_change":"2024-06-10T00:16:20.304014+0000","last_active":"2024-06-10T00:16:20.306552+0000","last_peered":"2024-06-10T00:16:20.306552+0000","last_clean":"2024-06-10T00:16:20.306552+0000","last_became_active":"2024-06-10T00:16:20.303743+0000","last_became_peered":"2024-06-10T00:16:20.303743+0000","last_unstale":"2024-06-10T00:16:20.306552+0000","last_undegraded":"2024-06-10T00:16:20.306552+0000","last_fullsized":"2024-06-10T00:16:20.306552+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:15:50.724605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288417+0000","last_change":"2024-06-10T00:16:20.288417+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288417+0000","last_undegraded":"2024-06-10T00:16:20.288417+0000","last_fullsized":"2024-06-10T00:16:20.288417+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308734+0000","last_change":"2024-06-10T00:16:20.304457+0000","last_active":"2024-06-10T00:16:20.308734+0000","last_peered":"2024-06-10T00:16:20.308734+0000","last_clean":"2024-06-10T00:16:20.308734+0000","last_became_active":"2024-06-10T00:16:20.302179+0000","last_became_peered":"2024-06-10T00:16:20.302179+0000","last_unstale":"2024-06-10T00:16:20.308734+0000","last_undegraded":"2024-06-10T00:16:20.308734+0000","last_fullsized":"2024-06-10T00:16:20.308734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296898+0000","last_change":"2024-06-10T00:16:20.296898+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296898+0000","last_undegraded":"2024-06-10T00:16:20.296898+0000","last_fullsized":"2024-06-10T00:16:20.296898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312781+0000","last_change":"2024-06-10T00:16:20.309057+0000","last_active":"2024-06-10T00:16:20.312781+0000","last_peered":"2024-06-10T00:16:20.312781+0000","last_clean":"2024-06-10T00:16:20.312781+0000","last_became_active":"2024-06-10T00:16:20.308794+0000","last_became_peered":"2024-06-10T00:16:20.308794+0000","last_unstale":"2024-06-10T00:16:20.312781+0000","last_undegraded":"2024-06-10T00:16:20.312781+0000","last_fullsized":"2024-06-10T00:16:20.312781+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293832+0000","last_change":"2024-06-10T00:16:20.293832+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293832+0000","last_undegraded":"2024-06-10T00:16:20.293832+0000","last_fullsized":"2024-06-10T00:16:20.293832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.301803+0000","last_change":"2024-06-10T00:16:20.299284+0000","last_active":"2024-06-10T00:16:20.301803+0000","last_peered":"2024-06-10T00:16:20.301803+0000","last_clean":"2024-06-10T00:16:20.301803+0000","last_became_active":"2024-06-10T00:16:20.298987+0000","last_became_peered":"2024-06-10T00:16:20.298987+0000","last_unstale":"2024-06-10T00:16:20.301803+0000","last_undegraded":"2024-06-10T00:16:20.301803+0000","last_fullsized":"2024-06-10T00:16:20.301803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:35:29.547234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.301475+0000","last_change":"2024-06-10T00:16:20.301475+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.301475+0000","last_undegraded":"2024-06-10T00:16:20.301475+0000","last_fullsized":"2024-06-10T00:16:20.301475+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306014+0000","last_change":"2024-06-10T00:16:20.303655+0000","last_active":"2024-06-10T00:16:20.306014+0000","last_peered":"2024-06-10T00:16:20.306014+0000","last_clean":"2024-06-10T00:16:20.306014+0000","last_became_active":"2024-06-10T00:16:20.303386+0000","last_became_peered":"2024-06-10T00:16:20.303386+0000","last_unstale":"2024-06-10T00:16:20.306014+0000","last_undegraded":"2024-06-10T00:16:20.306014+0000","last_fullsized":"2024-06-10T00:16:20.306014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:55.681863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292316+0000","last_change":"2024-06-10T00:16:20.292316+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292316+0000","last_undegraded":"2024-06-10T00:16:20.292316+0000","last_fullsized":"2024-06-10T00:16:20.292316+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.310617+0000","last_change":"2024-06-10T00:16:20.309531+0000","last_active":"2024-06-10T00:16:20.310617+0000","last_peered":"2024-06-10T00:16:20.310617+0000","last_clean":"2024-06-10T00:16:20.310617+0000","last_became_active":"2024-06-10T00:16:20.309223+0000","last_became_peered":"2024-06-10T00:16:20.309223+0000","last_unstale":"2024-06-10T00:16:20.310617+0000","last_undegraded":"2024-06-10T00:16:20.310617+0000","last_fullsized":"2024-06-10T00:16:20.310617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290965+0000","last_change":"2024-06-10T00:16:20.290965+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290965+0000","last_undegraded":"2024-06-10T00:16:20.290965+0000","last_fullsized":"2024-06-10T00:16:20.290965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.307178+0000","last_change":"2024-06-10T00:16:20.305785+0000","last_active":"2024-06-10T00:16:20.307178+0000","last_peered":"2024-06-10T00:16:20.307178+0000","last_clean":"2024-06-10T00:16:20.307178+0000","last_became_active":"2024-06-10T00:16:20.305483+0000","last_became_peered":"2024-06-10T00:16:20.305483+0000","last_unstale":"2024-06-10T00:16:20.307178+0000","last_undegraded":"2024-06-10T00:16:20.307178+0000","last_fullsized":"2024-06-10T00:16:20.307178+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:17.213749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289029+0000","last_change":"2024-06-10T00:16:20.289029+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289029+0000","last_undegraded":"2024-06-10T00:16:20.289029+0000","last_fullsized":"2024-06-10T00:16:20.289029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304736+0000","last_change":"2024-06-10T00:16:20.300901+0000","last_active":"2024-06-10T00:16:20.304736+0000","last_peered":"2024-06-10T00:16:20.304736+0000","last_clean":"2024-06-10T00:16:20.304736+0000","last_became_active":"2024-06-10T00:16:20.300594+0000","last_became_peered":"2024-06-10T00:16:20.300594+0000","last_unstale":"2024-06-10T00:16:20.304736+0000","last_undegraded":"2024-06-10T00:16:20.304736+0000","last_fullsized":"2024-06-10T00:16:20.304736+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:56.536723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290675+0000","last_change":"2024-06-10T00:16:20.290675+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290675+0000","last_undegraded":"2024-06-10T00:16:20.290675+0000","last_fullsized":"2024-06-10T00:16:20.290675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.309934+0000","last_change":"2024-06-10T00:16:20.305387+0000","last_active":"2024-06-10T00:16:20.309934+0000","last_peered":"2024-06-10T00:16:20.309934+0000","last_clean":"2024-06-10T00:16:20.309934+0000","last_became_active":"2024-06-10T00:16:20.305118+0000","last_became_peered":"2024-06-10T00:16:20.305118+0000","last_unstale":"2024-06-10T00:16:20.309934+0000","last_undegraded":"2024-06-10T00:16:20.309934+0000","last_fullsized":"2024-06-10T00:16:20.309934+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:33.552452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287883+0000","last_change":"2024-06-10T00:16:20.287883+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287883+0000","last_undegraded":"2024-06-10T00:16:20.287883+0000","last_fullsized":"2024-06-10T00:16:20.287883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.296484+0000","last_change":"2024-06-10T00:16:20.293250+0000","last_active":"2024-06-10T00:16:20.296484+0000","last_peered":"2024-06-10T00:16:20.296484+0000","last_clean":"2024-06-10T00:16:20.296484+0000","last_became_active":"2024-06-10T00:16:20.292968+0000","last_became_peered":"2024-06-10T00:16:20.292968+0000","last_unstale":"2024-06-10T00:16:20.296484+0000","last_undegraded":"2024-06-10T00:16:20.296484+0000","last_fullsized":"2024-06-10T00:16:20.296484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:56.536723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295762+0000","last_change":"2024-06-10T00:16:20.295762+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295762+0000","last_undegraded":"2024-06-10T00:16:20.295762+0000","last_fullsized":"2024-06-10T00:16:20.295762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308681+0000","last_change":"2024-06-10T00:16:20.304632+0000","last_active":"2024-06-10T00:16:20.308681+0000","last_peered":"2024-06-10T00:16:20.308681+0000","last_clean":"2024-06-10T00:16:20.308681+0000","last_became_active":"2024-06-10T00:16:20.304382+0000","last_became_peered":"2024-06-10T00:16:20.304382+0000","last_unstale":"2024-06-10T00:16:20.308681+0000","last_undegraded":"2024-06-10T00:16:20.308681+0000","last_fullsized":"2024-06-10T00:16:20.308681+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:47:25.968321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.298291+0000","last_change":"2024-06-10T00:16:20.298291+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.298291+0000","last_undegraded":"2024-06-10T00:16:20.298291+0000","last_fullsized":"2024-06-10T00:16:20.298291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308731+0000","last_change":"2024-06-10T00:16:20.305088+0000","last_active":"2024-06-10T00:16:20.308731+0000","last_peered":"2024-06-10T00:16:20.308731+0000","last_clean":"2024-06-10T00:16:20.308731+0000","last_became_active":"2024-06-10T00:16:20.304825+0000","last_became_peered":"2024-06-10T00:16:20.304825+0000","last_unstale":"2024-06-10T00:16:20.308731+0000","last_undegraded":"2024-06-10T00:16:20.308731+0000","last_fullsized":"2024-06-10T00:16:20.308731+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290661+0000","last_change":"2024-06-10T00:16:20.290661+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290661+0000","last_undegraded":"2024-06-10T00:16:20.290661+0000","last_fullsized":"2024-06-10T00:16:20.290661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306291+0000","last_change":"2024-06-10T00:16:20.302648+0000","last_active":"2024-06-10T00:16:20.306291+0000","last_peered":"2024-06-10T00:16:20.306291+0000","last_clean":"2024-06-10T00:16:20.306291+0000","last_became_active":"2024-06-10T00:16:20.302385+0000","last_became_peered":"2024-06-10T00:16:20.302385+0000","last_unstale":"2024-06-10T00:16:20.306291+0000","last_undegraded":"2024-06-10T00:16:20.306291+0000","last_fullsized":"2024-06-10T00:16:20.306291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:26:49.566446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287760+0000","last_change":"2024-06-10T00:16:20.287760+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287760+0000","last_undegraded":"2024-06-10T00:16:20.287760+0000","last_fullsized":"2024-06-10T00:16:20.287760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312804+0000","last_change":"2024-06-10T00:16:20.309578+0000","last_active":"2024-06-10T00:16:20.312804+0000","last_peered":"2024-06-10T00:16:20.312804+0000","last_clean":"2024-06-10T00:16:20.312804+0000","last_became_active":"2024-06-10T00:16:20.309249+0000","last_became_peered":"2024-06-10T00:16:20.309249+0000","last_unstale":"2024-06-10T00:16:20.312804+0000","last_undegraded":"2024-06-10T00:16:20.312804+0000","last_fullsized":"2024-06-10T00:16:20.312804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291176+0000","last_change":"2024-06-10T00:16:20.291176+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291176+0000","last_undegraded":"2024-06-10T00:16:20.291176+0000","last_fullsized":"2024-06-10T00:16:20.291176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.307316+0000","last_change":"2024-06-10T00:16:20.302054+0000","last_active":"2024-06-10T00:16:20.307316+0000","last_peered":"2024-06-10T00:16:20.307316+0000","last_clean":"2024-06-10T00:16:20.307316+0000","last_became_active":"2024-06-10T00:16:20.301779+0000","last_became_peered":"2024-06-10T00:16:20.301779+0000","last_unstale":"2024-06-10T00:16:20.307316+0000","last_undegraded":"2024-06-10T00:16:20.307316+0000","last_fullsized":"2024-06-10T00:16:20.307316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:36.042655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293824+0000","last_change":"2024-06-10T00:16:20.293824+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293824+0000","last_undegraded":"2024-06-10T00:16:20.293824+0000","last_fullsized":"2024-06-10T00:16:20.293824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308890+0000","last_change":"2024-06-10T00:16:20.305512+0000","last_active":"2024-06-10T00:16:20.308890+0000","last_peered":"2024-06-10T00:16:20.308890+0000","last_clean":"2024-06-10T00:16:20.308890+0000","last_became_active":"2024-06-10T00:16:20.305274+0000","last_became_peered":"2024-06-10T00:16:20.305274+0000","last_unstale":"2024-06-10T00:16:20.308890+0000","last_undegraded":"2024-06-10T00:16:20.308890+0000","last_fullsized":"2024-06-10T00:16:20.308890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:32:02.814038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294993+0000","last_change":"2024-06-10T00:16:20.294993+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294993+0000","last_undegraded":"2024-06-10T00:16:20.294993+0000","last_fullsized":"2024-06-10T00:16:20.294993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306539+0000","last_change":"2024-06-10T00:16:20.304106+0000","last_active":"2024-06-10T00:16:20.306539+0000","last_peered":"2024-06-10T00:16:20.306539+0000","last_clean":"2024-06-10T00:16:20.306539+0000","last_became_active":"2024-06-10T00:16:20.303755+0000","last_became_peered":"2024-06-10T00:16:20.303755+0000","last_unstale":"2024-06-10T00:16:20.306539+0000","last_undegraded":"2024-06-10T00:16:20.306539+0000","last_fullsized":"2024-06-10T00:16:20.306539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:34:57.335177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288151+0000","last_change":"2024-06-10T00:16:20.288151+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288151+0000","last_undegraded":"2024-06-10T00:16:20.288151+0000","last_fullsized":"2024-06-10T00:16:20.288151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.305299+0000","last_change":"2024-06-10T00:16:20.302947+0000","last_active":"2024-06-10T00:16:20.305299+0000","last_peered":"2024-06-10T00:16:20.305299+0000","last_clean":"2024-06-10T00:16:20.305299+0000","last_became_active":"2024-06-10T00:16:20.302664+0000","last_became_peered":"2024-06-10T00:16:20.302664+0000","last_unstale":"2024-06-10T00:16:20.305299+0000","last_undegraded":"2024-06-10T00:16:20.305299+0000","last_fullsized":"2024-06-10T00:16:20.305299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.299579+0000","last_change":"2024-06-10T00:16:20.299579+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.299579+0000","last_undegraded":"2024-06-10T00:16:20.299579+0000","last_fullsized":"2024-06-10T00:16:20.299579+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304539+0000","last_change":"2024-06-10T00:16:20.301224+0000","last_active":"2024-06-10T00:16:20.304539+0000","last_peered":"2024-06-10T00:16:20.304539+0000","last_clean":"2024-06-10T00:16:20.304539+0000","last_became_active":"2024-06-10T00:16:20.300924+0000","last_became_peered":"2024-06-10T00:16:20.300924+0000","last_unstale":"2024-06-10T00:16:20.304539+0000","last_undegraded":"2024-06-10T00:16:20.304539+0000","last_fullsized":"2024-06-10T00:16:20.304539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292999+0000","last_change":"2024-06-10T00:16:20.292999+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292999+0000","last_undegraded":"2024-06-10T00:16:20.292999+0000","last_fullsized":"2024-06-10T00:16:20.292999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.295014+0000","last_change":"2024-06-10T00:16:20.294051+0000","last_active":"2024-06-10T00:16:20.295014+0000","last_peered":"2024-06-10T00:16:20.295014+0000","last_clean":"2024-06-10T00:16:20.295014+0000","last_became_active":"2024-06-10T00:16:20.293751+0000","last_became_peered":"2024-06-10T00:16:20.293751+0000","last_unstale":"2024-06-10T00:16:20.295014+0000","last_undegraded":"2024-06-10T00:16:20.295014+0000","last_fullsized":"2024-06-10T00:16:20.295014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293270+0000","last_change":"2024-06-10T00:16:20.293270+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293270+0000","last_undegraded":"2024-06-10T00:16:20.293270+0000","last_fullsized":"2024-06-10T00:16:20.293270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.310282+0000","last_change":"2024-06-10T00:16:20.308999+0000","last_active":"2024-06-10T00:16:20.310282+0000","last_peered":"2024-06-10T00:16:20.310282+0000","last_clean":"2024-06-10T00:16:20.310282+0000","last_became_active":"2024-06-10T00:16:20.308679+0000","last_became_peered":"2024-06-10T00:16:20.308679+0000","last_unstale":"2024-06-10T00:16:20.310282+0000","last_undegraded":"2024-06-10T00:16:20.310282+0000","last_fullsized":"2024-06-10T00:16:20.310282+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:40.052203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":219,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.292737+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:16:20.292737+0000","last_peered":"2024-06-10T00:16:20.292737+0000","last_clean":"2024-06-10T00:16:20.292737+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:16:20.292737+0000","last_undegraded":"2024-06-10T00:16:20.292737+0000","last_fullsized":"2024-06-10T00:16:20.292737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":839756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":839756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:16:24.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:16:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.398+0000 7f95f5116640 1 Processor -- start 2024-06-10T00:16:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.399+0000 7f95f5116640 1 -- start start 2024-06-10T00:16:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.399+0000 7f95f5116640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f95f015f1a0 0x7f95f00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.399+0000 7f95f5116640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95f00cef70 0x7f95f00cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.399+0000 7f95f5116640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95f015f5e0 con 0x7f95f00d2680 2024-06-10T00:16:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.399+0000 7f95f5116640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f95f00d13e0 con 0x7f95f00cef70 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.399+0000 7f95f5116640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f95f00d0ad0 con 0x7f95f015f1a0 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.400+0000 7f95ef59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95f00cef70 0x7f95f00cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.400+0000 7f95ef59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95f00cef70 0x7f95f00cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49208/0 (socket says 172.21.15.79:49208) 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.400+0000 7f95ef59e640 1 -- 172.21.15.79:0/790644200 learned_addr learned my addr 172.21.15.79:0/790644200 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.400+0000 7f95ee59c640 1 --2- 172.21.15.79:0/790644200 >> v2:172.21.15.117:3300/0 conn(0x7f95f015f1a0 0x7f95f00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.400+0000 7f95ef59e640 1 -- 172.21.15.79:0/790644200 >> v2:172.21.15.117:3300/0 conn(0x7f95f015f1a0 msgr2=0x7f95f00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.400+0000 7f95ef59e640 1 --2- 172.21.15.79:0/790644200 >> v2:172.21.15.117:3300/0 conn(0x7f95f015f1a0 0x7f95f00d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.400+0000 7f95ef59e640 1 -- 172.21.15.79:0/790644200 >> v1:172.21.15.117:6789/0 conn(0x7f95f00d2680 legacy=0x7f95f00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.400+0000 7f95ef59e640 1 -- 172.21.15.79:0/790644200 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f015f890 con 0x7f95f00cef70 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95ef59e640 1 --2- 172.21.15.79:0/790644200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f00cef70 0x7f95f00cf3c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f95f00d1560 tx=0x7f95e802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a5f072840372f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95edd9b640 1 -- 172.21.15.79:0/790644200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8036070 con 0x7f95f00cef70 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95edd9b640 1 -- 172.21.15.79:0/790644200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e8031600 con 0x7f95f00cef70 2024-06-10T00:16:24.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95edd9b640 1 -- 172.21.15.79:0/790644200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e80319d0 con 0x7f95f00cef70 2024-06-10T00:16:24.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95f5116640 1 -- 172.21.15.79:0/790644200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f00cef70 msgr2=0x7f95f00cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95f5116640 1 --2- 172.21.15.79:0/790644200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f00cef70 0x7f95f00cf3c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f95f00d1560 tx=0x7f95e802a730 comp rx=0 tx=0).stop 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95f5116640 1 -- 172.21.15.79:0/790644200 shutdown_connections 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95f5116640 1 --2- 172.21.15.79:0/790644200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f00cef70 0x7f95f00cf3c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95f5116640 1 --2- 172.21.15.79:0/790644200 >> v2:172.21.15.117:3300/0 conn(0x7f95f015f1a0 0x7f95f00d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95f5116640 1 -- 172.21.15.79:0/790644200 >> 172.21.15.79:0/790644200 conn(0x7f95f009d3f0 msgr2=0x7f95f00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95f5116640 1 -- 172.21.15.79:0/790644200 shutdown_connections 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.401+0000 7f95f5116640 1 -- 172.21.15.79:0/790644200 wait complete. 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.403+0000 7f95f5116640 1 Processor -- start 2024-06-10T00:16:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.403+0000 7f95f5116640 1 -- start start 2024-06-10T00:16:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.403+0000 7f95f5116640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95f00cef70 0x7f95f01f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.403+0000 7f95f5116640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95f00d2680 0x7f95f015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.403+0000 7f95f5116640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f015f1a0 0x7f95f01597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.403+0000 7f95f5116640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95f00d4f00 con 0x7f95f015f1a0 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.403+0000 7f95f5116640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f95f00d1070 con 0x7f95f00d2680 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.403+0000 7f95f5116640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95f00d1870 con 0x7f95f00cef70 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f015f1a0 0x7f95f01597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f015f1a0 0x7f95f01597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49222/0 (socket says 172.21.15.79:49222) 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 -- 172.21.15.79:0/1464984131 learned_addr learned my addr 172.21.15.79:0/1464984131 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 -- 172.21.15.79:0/1464984131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95f00cef70 msgr2=0x7f95f01f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95f00cef70 0x7f95f01f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ee59c640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95f00d2680 0x7f95f015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 -- 172.21.15.79:0/1464984131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95f00d2680 msgr2=0x7f95f015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95f00d2680 0x7f95f015c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 -- 172.21.15.79:0/1464984131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f01f8da0 con 0x7f95f015f1a0 2024-06-10T00:16:24.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ee59c640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95f00d2680 0x7f95f015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95ef59e640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f015f1a0 0x7f95f01597d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009f10 tx=0x7f95e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95e77fe640 1 -- 172.21.15.79:0/1464984131 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8036050 con 0x7f95f015f1a0 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95e77fe640 1 -- 172.21.15.79:0/1464984131 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e8042070 con 0x7f95f015f1a0 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95e77fe640 1 -- 172.21.15.79:0/1464984131 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8009510 con 0x7f95f015f1a0 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f015dc00 con 0x7f95f015f1a0 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.404+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f006c540 con 0x7f95f015f1a0 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.405+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f0068430 con 0x7f95f015f1a0 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.406+0000 7f95e77fe640 1 -- 172.21.15.79:0/1464984131 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95e8007bf0 con 0x7f95f015f1a0 2024-06-10T00:16:24.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.406+0000 7f95e77fe640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95d006be30 0x7f95d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.406+0000 7f95e77fe640 1 -- 172.21.15.79:0/1464984131 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f95e80abe30 con 0x7f95f015f1a0 2024-06-10T00:16:24.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.406+0000 7f95eed9d640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95d006be30 0x7f95d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.407+0000 7f95eed9d640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95d006be30 0x7f95d006e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e00079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.410+0000 7f95e77fe640 1 -- 172.21.15.79:0/1464984131 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f95f01f8da0 con 0x7f95f015f1a0 2024-06-10T00:16:24.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.581+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f95f00d04e0 con 0x7f95d006be30 2024-06-10T00:16:24.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.587+0000 7f95e77fe640 1 -- 172.21.15.79:0/1464984131 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7f95f00d04e0 con 0x7f95d006be30 2024-06-10T00:16:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:24.590 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:16:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95d006be30 msgr2=0x7f95d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95d006be30 0x7f95d006e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e00079d0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f015f1a0 msgr2=0x7f95f01597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f015f1a0 0x7f95f01597d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009f10 tx=0x7f95e8004a40 comp rx=0 tx=0).stop 2024-06-10T00:16:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 shutdown_connections 2024-06-10T00:16:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95d006be30 0x7f95d006e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95f015f1a0 0x7f95f01597d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95f00d2680 0x7f95f015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 --2- 172.21.15.79:0/1464984131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95f00cef70 0x7f95f01f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 >> 172.21.15.79:0/1464984131 conn(0x7f95f009d3f0 msgr2=0x7f95f00c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.590+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 shutdown_connections 2024-06-10T00:16:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.591+0000 7f95f5116640 1 -- 172.21.15.79:0/1464984131 wait complete. 2024-06-10T00:16:24.601 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-06-10T00:16:23.167419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221788,"kb_used_data":5572,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752932,"statfs":{"total":773094113280,"available":772867002368,"internally_reserved":0,"allocated":5705728,"data_stored":3155839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000778"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292207+0000","last_change":"2024-06-10T00:16:20.292207+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292207+0000","last_undegraded":"2024-06-10T00:16:20.292207+0000","last_fullsized":"2024-06-10T00:16:20.292207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292285+0000","last_change":"2024-06-10T00:16:20.292285+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292285+0000","last_undegraded":"2024-06-10T00:16:20.292285+0000","last_fullsized":"2024-06-10T00:16:20.292285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297906+0000","last_change":"2024-06-10T00:16:20.297906+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297906+0000","last_undegraded":"2024-06-10T00:16:20.297906+0000","last_fullsized":"2024-06-10T00:16:20.297906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290662+0000","last_change":"2024-06-10T00:16:20.290662+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290662+0000","last_undegraded":"2024-06-10T00:16:20.290662+0000","last_fullsized":"2024-06-10T00:16:20.290662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289043+0000","last_change":"2024-06-10T00:16:20.289043+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289043+0000","last_undegraded":"2024-06-10T00:16:20.289043+0000","last_fullsized":"2024-06-10T00:16:20.289043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292419+0000","last_change":"2024-06-10T00:16:20.292419+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292419+0000","last_undegraded":"2024-06-10T00:16:20.292419+0000","last_fullsized":"2024-06-10T00:16:20.292419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296405+0000","last_change":"2024-06-10T00:16:20.296405+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296405+0000","last_undegraded":"2024-06-10T00:16:20.296405+0000","last_fullsized":"2024-06-10T00:16:20.296405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295580+0000","last_change":"2024-06-10T00:16:20.295580+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295580+0000","last_undegraded":"2024-06-10T00:16:20.295580+0000","last_fullsized":"2024-06-10T00:16:20.295580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294002+0000","last_change":"2024-06-10T00:16:20.294002+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294002+0000","last_undegraded":"2024-06-10T00:16:20.294002+0000","last_fullsized":"2024-06-10T00:16:20.294002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291900+0000","last_change":"2024-06-10T00:16:20.291900+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291900+0000","last_undegraded":"2024-06-10T00:16:20.291900+0000","last_fullsized":"2024-06-10T00:16:20.291900+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297704+0000","last_change":"2024-06-10T00:16:20.297704+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297704+0000","last_undegraded":"2024-06-10T00:16:20.297704+0000","last_fullsized":"2024-06-10T00:16:20.297704+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292777+0000","last_change":"2024-06-10T00:16:20.292777+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292777+0000","last_undegraded":"2024-06-10T00:16:20.292777+0000","last_fullsized":"2024-06-10T00:16:20.292777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291477+0000","last_change":"2024-06-10T00:16:20.291477+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291477+0000","last_undegraded":"2024-06-10T00:16:20.291477+0000","last_fullsized":"2024-06-10T00:16:20.291477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295384+0000","last_change":"2024-06-10T00:16:20.295384+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295384+0000","last_undegraded":"2024-06-10T00:16:20.295384+0000","last_fullsized":"2024-06-10T00:16:20.295384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290636+0000","last_change":"2024-06-10T00:16:20.290636+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290636+0000","last_undegraded":"2024-06-10T00:16:20.290636+0000","last_fullsized":"2024-06-10T00:16:20.290636+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291199+0000","last_change":"2024-06-10T00:16:20.291199+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291199+0000","last_undegraded":"2024-06-10T00:16:20.291199+0000","last_fullsized":"2024-06-10T00:16:20.291199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.301114+0000","last_change":"2024-06-10T00:16:20.301114+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.301114+0000","last_undegraded":"2024-06-10T00:16:20.301114+0000","last_fullsized":"2024-06-10T00:16:20.301114+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291494+0000","last_change":"2024-06-10T00:16:20.291494+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291494+0000","last_undegraded":"2024-06-10T00:16:20.291494+0000","last_fullsized":"2024-06-10T00:16:20.291494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297279+0000","last_change":"2024-06-10T00:16:20.297279+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297279+0000","last_undegraded":"2024-06-10T00:16:20.297279+0000","last_fullsized":"2024-06-10T00:16:20.297279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294476+0000","last_change":"2024-06-10T00:16:20.294476+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294476+0000","last_undegraded":"2024-06-10T00:16:20.294476+0000","last_fullsized":"2024-06-10T00:16:20.294476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296057+0000","last_change":"2024-06-10T00:16:20.296057+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296057+0000","last_undegraded":"2024-06-10T00:16:20.296057+0000","last_fullsized":"2024-06-10T00:16:20.296057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293602+0000","last_change":"2024-06-10T00:16:20.293602+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293602+0000","last_undegraded":"2024-06-10T00:16:20.293602+0000","last_fullsized":"2024-06-10T00:16:20.293602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296488+0000","last_change":"2024-06-10T00:16:20.296488+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296488+0000","last_undegraded":"2024-06-10T00:16:20.296488+0000","last_fullsized":"2024-06-10T00:16:20.296488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294763+0000","last_change":"2024-06-10T00:16:20.294763+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294763+0000","last_undegraded":"2024-06-10T00:16:20.294763+0000","last_fullsized":"2024-06-10T00:16:20.294763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.300280+0000","last_change":"2024-06-10T00:16:20.300280+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.300280+0000","last_undegraded":"2024-06-10T00:16:20.300280+0000","last_fullsized":"2024-06-10T00:16:20.300280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295052+0000","last_change":"2024-06-10T00:16:20.295052+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295052+0000","last_undegraded":"2024-06-10T00:16:20.295052+0000","last_fullsized":"2024-06-10T00:16:20.295052+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291206+0000","last_change":"2024-06-10T00:16:20.291206+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291206+0000","last_undegraded":"2024-06-10T00:16:20.291206+0000","last_fullsized":"2024-06-10T00:16:20.291206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294087+0000","last_change":"2024-06-10T00:16:20.294087+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294087+0000","last_undegraded":"2024-06-10T00:16:20.294087+0000","last_fullsized":"2024-06-10T00:16:20.294087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296088+0000","last_change":"2024-06-10T00:16:20.296088+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296088+0000","last_undegraded":"2024-06-10T00:16:20.296088+0000","last_fullsized":"2024-06-10T00:16:20.296088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290938+0000","last_change":"2024-06-10T00:16:20.290938+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290938+0000","last_undegraded":"2024-06-10T00:16:20.290938+0000","last_fullsized":"2024-06-10T00:16:20.290938+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296046+0000","last_change":"2024-06-10T00:16:20.296046+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296046+0000","last_undegraded":"2024-06-10T00:16:20.296046+0000","last_fullsized":"2024-06-10T00:16:20.296046+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288285+0000","last_change":"2024-06-10T00:16:20.288285+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288285+0000","last_undegraded":"2024-06-10T00:16:20.288285+0000","last_fullsized":"2024-06-10T00:16:20.288285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290545+0000","last_change":"2024-06-10T00:16:20.290545+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290545+0000","last_undegraded":"2024-06-10T00:16:20.290545+0000","last_fullsized":"2024-06-10T00:16:20.290545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304382+0000","last_change":"2024-06-10T00:16:20.297870+0000","last_active":"2024-06-10T00:16:20.304382+0000","last_peered":"2024-06-10T00:16:20.304382+0000","last_clean":"2024-06-10T00:16:20.304382+0000","last_became_active":"2024-06-10T00:16:20.297484+0000","last_became_peered":"2024-06-10T00:16:20.297484+0000","last_unstale":"2024-06-10T00:16:20.304382+0000","last_undegraded":"2024-06-10T00:16:20.304382+0000","last_fullsized":"2024-06-10T00:16:20.304382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:20.625301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287546+0000","last_change":"2024-06-10T00:16:20.287546+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287546+0000","last_undegraded":"2024-06-10T00:16:20.287546+0000","last_fullsized":"2024-06-10T00:16:20.287546+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.305239+0000","last_change":"2024-06-10T00:16:20.303002+0000","last_active":"2024-06-10T00:16:20.305239+0000","last_peered":"2024-06-10T00:16:20.305239+0000","last_clean":"2024-06-10T00:16:20.305239+0000","last_became_active":"2024-06-10T00:16:20.302738+0000","last_became_peered":"2024-06-10T00:16:20.302738+0000","last_unstale":"2024-06-10T00:16:20.305239+0000","last_undegraded":"2024-06-10T00:16:20.305239+0000","last_fullsized":"2024-06-10T00:16:20.305239+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296035+0000","last_change":"2024-06-10T00:16:20.296035+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296035+0000","last_undegraded":"2024-06-10T00:16:20.296035+0000","last_fullsized":"2024-06-10T00:16:20.296035+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.303123+0000","last_change":"2024-06-10T00:16:20.299695+0000","last_active":"2024-06-10T00:16:20.303123+0000","last_peered":"2024-06-10T00:16:20.303123+0000","last_clean":"2024-06-10T00:16:20.303123+0000","last_became_active":"2024-06-10T00:16:20.299435+0000","last_became_peered":"2024-06-10T00:16:20.299435+0000","last_unstale":"2024-06-10T00:16:20.303123+0000","last_undegraded":"2024-06-10T00:16:20.303123+0000","last_fullsized":"2024-06-10T00:16:20.303123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:33.552452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294200+0000","last_change":"2024-06-10T00:16:20.294200+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294200+0000","last_undegraded":"2024-06-10T00:16:20.294200+0000","last_fullsized":"2024-06-10T00:16:20.294200+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304851+0000","last_change":"2024-06-10T00:16:20.300555+0000","last_active":"2024-06-10T00:16:20.304851+0000","last_peered":"2024-06-10T00:16:20.304851+0000","last_clean":"2024-06-10T00:16:20.304851+0000","last_became_active":"2024-06-10T00:16:20.300241+0000","last_became_peered":"2024-06-10T00:16:20.300241+0000","last_unstale":"2024-06-10T00:16:20.304851+0000","last_undegraded":"2024-06-10T00:16:20.304851+0000","last_fullsized":"2024-06-10T00:16:20.304851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:55.681863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289108+0000","last_change":"2024-06-10T00:16:20.289108+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289108+0000","last_undegraded":"2024-06-10T00:16:20.289108+0000","last_fullsized":"2024-06-10T00:16:20.289108+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308906+0000","last_change":"2024-06-10T00:16:20.305776+0000","last_active":"2024-06-10T00:16:20.308906+0000","last_peered":"2024-06-10T00:16:20.308906+0000","last_clean":"2024-06-10T00:16:20.308906+0000","last_became_active":"2024-06-10T00:16:20.305527+0000","last_became_peered":"2024-06-10T00:16:20.305527+0000","last_unstale":"2024-06-10T00:16:20.308906+0000","last_undegraded":"2024-06-10T00:16:20.308906+0000","last_fullsized":"2024-06-10T00:16:20.308906+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:24:01.616634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291706+0000","last_change":"2024-06-10T00:16:20.291706+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291706+0000","last_undegraded":"2024-06-10T00:16:20.291706+0000","last_fullsized":"2024-06-10T00:16:20.291706+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.301501+0000","last_change":"2024-06-10T00:16:20.298240+0000","last_active":"2024-06-10T00:16:20.301501+0000","last_peered":"2024-06-10T00:16:20.301501+0000","last_clean":"2024-06-10T00:16:20.301501+0000","last_became_active":"2024-06-10T00:16:20.297962+0000","last_became_peered":"2024-06-10T00:16:20.297962+0000","last_unstale":"2024-06-10T00:16:20.301501+0000","last_undegraded":"2024-06-10T00:16:20.301501+0000","last_fullsized":"2024-06-10T00:16:20.301501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292961+0000","last_change":"2024-06-10T00:16:20.292961+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292961+0000","last_undegraded":"2024-06-10T00:16:20.292961+0000","last_fullsized":"2024-06-10T00:16:20.292961+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304440+0000","last_change":"2024-06-10T00:16:20.298791+0000","last_active":"2024-06-10T00:16:20.304440+0000","last_peered":"2024-06-10T00:16:20.304440+0000","last_clean":"2024-06-10T00:16:20.304440+0000","last_became_active":"2024-06-10T00:16:20.297457+0000","last_became_peered":"2024-06-10T00:16:20.297457+0000","last_unstale":"2024-06-10T00:16:20.304440+0000","last_undegraded":"2024-06-10T00:16:20.304440+0000","last_fullsized":"2024-06-10T00:16:20.304440+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:55.550063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291642+0000","last_change":"2024-06-10T00:16:20.291642+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291642+0000","last_undegraded":"2024-06-10T00:16:20.291642+0000","last_fullsized":"2024-06-10T00:16:20.291642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.309257+0000","last_change":"2024-06-10T00:16:20.307746+0000","last_active":"2024-06-10T00:16:20.309257+0000","last_peered":"2024-06-10T00:16:20.309257+0000","last_clean":"2024-06-10T00:16:20.309257+0000","last_became_active":"2024-06-10T00:16:20.306090+0000","last_became_peered":"2024-06-10T00:16:20.306090+0000","last_unstale":"2024-06-10T00:16:20.309257+0000","last_undegraded":"2024-06-10T00:16:20.309257+0000","last_fullsized":"2024-06-10T00:16:20.309257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:53.046468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288041+0000","last_change":"2024-06-10T00:16:20.288041+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288041+0000","last_undegraded":"2024-06-10T00:16:20.288041+0000","last_fullsized":"2024-06-10T00:16:20.288041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.299771+0000","last_change":"2024-06-10T00:16:20.297128+0000","last_active":"2024-06-10T00:16:20.299771+0000","last_peered":"2024-06-10T00:16:20.299771+0000","last_clean":"2024-06-10T00:16:20.299771+0000","last_became_active":"2024-06-10T00:16:20.296839+0000","last_became_peered":"2024-06-10T00:16:20.296839+0000","last_unstale":"2024-06-10T00:16:20.299771+0000","last_undegraded":"2024-06-10T00:16:20.299771+0000","last_fullsized":"2024-06-10T00:16:20.299771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288797+0000","last_change":"2024-06-10T00:16:20.288797+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288797+0000","last_undegraded":"2024-06-10T00:16:20.288797+0000","last_fullsized":"2024-06-10T00:16:20.288797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312825+0000","last_change":"2024-06-10T00:16:20.309837+0000","last_active":"2024-06-10T00:16:20.312825+0000","last_peered":"2024-06-10T00:16:20.312825+0000","last_clean":"2024-06-10T00:16:20.312825+0000","last_became_active":"2024-06-10T00:16:20.309531+0000","last_became_peered":"2024-06-10T00:16:20.309531+0000","last_unstale":"2024-06-10T00:16:20.312825+0000","last_undegraded":"2024-06-10T00:16:20.312825+0000","last_fullsized":"2024-06-10T00:16:20.312825+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295043+0000","last_change":"2024-06-10T00:16:20.295043+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295043+0000","last_undegraded":"2024-06-10T00:16:20.295043+0000","last_fullsized":"2024-06-10T00:16:20.295043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304676+0000","last_change":"2024-06-10T00:16:20.300508+0000","last_active":"2024-06-10T00:16:20.304676+0000","last_peered":"2024-06-10T00:16:20.304676+0000","last_clean":"2024-06-10T00:16:20.304676+0000","last_became_active":"2024-06-10T00:16:20.300209+0000","last_became_peered":"2024-06-10T00:16:20.300209+0000","last_unstale":"2024-06-10T00:16:20.304676+0000","last_undegraded":"2024-06-10T00:16:20.304676+0000","last_fullsized":"2024-06-10T00:16:20.304676+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:01:40.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288604+0000","last_change":"2024-06-10T00:16:20.288604+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288604+0000","last_undegraded":"2024-06-10T00:16:20.288604+0000","last_fullsized":"2024-06-10T00:16:20.288604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306552+0000","last_change":"2024-06-10T00:16:20.304014+0000","last_active":"2024-06-10T00:16:20.306552+0000","last_peered":"2024-06-10T00:16:20.306552+0000","last_clean":"2024-06-10T00:16:20.306552+0000","last_became_active":"2024-06-10T00:16:20.303743+0000","last_became_peered":"2024-06-10T00:16:20.303743+0000","last_unstale":"2024-06-10T00:16:20.306552+0000","last_undegraded":"2024-06-10T00:16:20.306552+0000","last_fullsized":"2024-06-10T00:16:20.306552+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:15:50.724605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288417+0000","last_change":"2024-06-10T00:16:20.288417+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288417+0000","last_undegraded":"2024-06-10T00:16:20.288417+0000","last_fullsized":"2024-06-10T00:16:20.288417+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308734+0000","last_change":"2024-06-10T00:16:20.304457+0000","last_active":"2024-06-10T00:16:20.308734+0000","last_peered":"2024-06-10T00:16:20.308734+0000","last_clean":"2024-06-10T00:16:20.308734+0000","last_became_active":"2024-06-10T00:16:20.302179+0000","last_became_peered":"2024-06-10T00:16:20.302179+0000","last_unstale":"2024-06-10T00:16:20.308734+0000","last_undegraded":"2024-06-10T00:16:20.308734+0000","last_fullsized":"2024-06-10T00:16:20.308734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296898+0000","last_change":"2024-06-10T00:16:20.296898+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296898+0000","last_undegraded":"2024-06-10T00:16:20.296898+0000","last_fullsized":"2024-06-10T00:16:20.296898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312781+0000","last_change":"2024-06-10T00:16:20.309057+0000","last_active":"2024-06-10T00:16:20.312781+0000","last_peered":"2024-06-10T00:16:20.312781+0000","last_clean":"2024-06-10T00:16:20.312781+0000","last_became_active":"2024-06-10T00:16:20.308794+0000","last_became_peered":"2024-06-10T00:16:20.308794+0000","last_unstale":"2024-06-10T00:16:20.312781+0000","last_undegraded":"2024-06-10T00:16:20.312781+0000","last_fullsized":"2024-06-10T00:16:20.312781+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293832+0000","last_change":"2024-06-10T00:16:20.293832+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293832+0000","last_undegraded":"2024-06-10T00:16:20.293832+0000","last_fullsized":"2024-06-10T00:16:20.293832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.301803+0000","last_change":"2024-06-10T00:16:20.299284+0000","last_active":"2024-06-10T00:16:20.301803+0000","last_peered":"2024-06-10T00:16:20.301803+0000","last_clean":"2024-06-10T00:16:20.301803+0000","last_became_active":"2024-06-10T00:16:20.298987+0000","last_became_peered":"2024-06-10T00:16:20.298987+0000","last_unstale":"2024-06-10T00:16:20.301803+0000","last_undegraded":"2024-06-10T00:16:20.301803+0000","last_fullsized":"2024-06-10T00:16:20.301803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:35:29.547234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.301475+0000","last_change":"2024-06-10T00:16:20.301475+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.301475+0000","last_undegraded":"2024-06-10T00:16:20.301475+0000","last_fullsized":"2024-06-10T00:16:20.301475+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306014+0000","last_change":"2024-06-10T00:16:20.303655+0000","last_active":"2024-06-10T00:16:20.306014+0000","last_peered":"2024-06-10T00:16:20.306014+0000","last_clean":"2024-06-10T00:16:20.306014+0000","last_became_active":"2024-06-10T00:16:20.303386+0000","last_became_peered":"2024-06-10T00:16:20.303386+0000","last_unstale":"2024-06-10T00:16:20.306014+0000","last_undegraded":"2024-06-10T00:16:20.306014+0000","last_fullsized":"2024-06-10T00:16:20.306014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:55.681863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292316+0000","last_change":"2024-06-10T00:16:20.292316+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292316+0000","last_undegraded":"2024-06-10T00:16:20.292316+0000","last_fullsized":"2024-06-10T00:16:20.292316+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.310617+0000","last_change":"2024-06-10T00:16:20.309531+0000","last_active":"2024-06-10T00:16:20.310617+0000","last_peered":"2024-06-10T00:16:20.310617+0000","last_clean":"2024-06-10T00:16:20.310617+0000","last_became_active":"2024-06-10T00:16:20.309223+0000","last_became_peered":"2024-06-10T00:16:20.309223+0000","last_unstale":"2024-06-10T00:16:20.310617+0000","last_undegraded":"2024-06-10T00:16:20.310617+0000","last_fullsized":"2024-06-10T00:16:20.310617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290965+0000","last_change":"2024-06-10T00:16:20.290965+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290965+0000","last_undegraded":"2024-06-10T00:16:20.290965+0000","last_fullsized":"2024-06-10T00:16:20.290965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.307178+0000","last_change":"2024-06-10T00:16:20.305785+0000","last_active":"2024-06-10T00:16:20.307178+0000","last_peered":"2024-06-10T00:16:20.307178+0000","last_clean":"2024-06-10T00:16:20.307178+0000","last_became_active":"2024-06-10T00:16:20.305483+0000","last_became_peered":"2024-06-10T00:16:20.305483+0000","last_unstale":"2024-06-10T00:16:20.307178+0000","last_undegraded":"2024-06-10T00:16:20.307178+0000","last_fullsized":"2024-06-10T00:16:20.307178+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:17.213749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289029+0000","last_change":"2024-06-10T00:16:20.289029+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289029+0000","last_undegraded":"2024-06-10T00:16:20.289029+0000","last_fullsized":"2024-06-10T00:16:20.289029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304736+0000","last_change":"2024-06-10T00:16:20.300901+0000","last_active":"2024-06-10T00:16:20.304736+0000","last_peered":"2024-06-10T00:16:20.304736+0000","last_clean":"2024-06-10T00:16:20.304736+0000","last_became_active":"2024-06-10T00:16:20.300594+0000","last_became_peered":"2024-06-10T00:16:20.300594+0000","last_unstale":"2024-06-10T00:16:20.304736+0000","last_undegraded":"2024-06-10T00:16:20.304736+0000","last_fullsized":"2024-06-10T00:16:20.304736+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:56.536723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290675+0000","last_change":"2024-06-10T00:16:20.290675+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290675+0000","last_undegraded":"2024-06-10T00:16:20.290675+0000","last_fullsized":"2024-06-10T00:16:20.290675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.309934+0000","last_change":"2024-06-10T00:16:20.305387+0000","last_active":"2024-06-10T00:16:20.309934+0000","last_peered":"2024-06-10T00:16:20.309934+0000","last_clean":"2024-06-10T00:16:20.309934+0000","last_became_active":"2024-06-10T00:16:20.305118+0000","last_became_peered":"2024-06-10T00:16:20.305118+0000","last_unstale":"2024-06-10T00:16:20.309934+0000","last_undegraded":"2024-06-10T00:16:20.309934+0000","last_fullsized":"2024-06-10T00:16:20.309934+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:33.552452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287883+0000","last_change":"2024-06-10T00:16:20.287883+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287883+0000","last_undegraded":"2024-06-10T00:16:20.287883+0000","last_fullsized":"2024-06-10T00:16:20.287883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.296484+0000","last_change":"2024-06-10T00:16:20.293250+0000","last_active":"2024-06-10T00:16:20.296484+0000","last_peered":"2024-06-10T00:16:20.296484+0000","last_clean":"2024-06-10T00:16:20.296484+0000","last_became_active":"2024-06-10T00:16:20.292968+0000","last_became_peered":"2024-06-10T00:16:20.292968+0000","last_unstale":"2024-06-10T00:16:20.296484+0000","last_undegraded":"2024-06-10T00:16:20.296484+0000","last_fullsized":"2024-06-10T00:16:20.296484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:56.536723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295762+0000","last_change":"2024-06-10T00:16:20.295762+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295762+0000","last_undegraded":"2024-06-10T00:16:20.295762+0000","last_fullsized":"2024-06-10T00:16:20.295762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308681+0000","last_change":"2024-06-10T00:16:20.304632+0000","last_active":"2024-06-10T00:16:20.308681+0000","last_peered":"2024-06-10T00:16:20.308681+0000","last_clean":"2024-06-10T00:16:20.308681+0000","last_became_active":"2024-06-10T00:16:20.304382+0000","last_became_peered":"2024-06-10T00:16:20.304382+0000","last_unstale":"2024-06-10T00:16:20.308681+0000","last_undegraded":"2024-06-10T00:16:20.308681+0000","last_fullsized":"2024-06-10T00:16:20.308681+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:47:25.968321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.298291+0000","last_change":"2024-06-10T00:16:20.298291+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.298291+0000","last_undegraded":"2024-06-10T00:16:20.298291+0000","last_fullsized":"2024-06-10T00:16:20.298291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308731+0000","last_change":"2024-06-10T00:16:20.305088+0000","last_active":"2024-06-10T00:16:20.308731+0000","last_peered":"2024-06-10T00:16:20.308731+0000","last_clean":"2024-06-10T00:16:20.308731+0000","last_became_active":"2024-06-10T00:16:20.304825+0000","last_became_peered":"2024-06-10T00:16:20.304825+0000","last_unstale":"2024-06-10T00:16:20.308731+0000","last_undegraded":"2024-06-10T00:16:20.308731+0000","last_fullsized":"2024-06-10T00:16:20.308731+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290661+0000","last_change":"2024-06-10T00:16:20.290661+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290661+0000","last_undegraded":"2024-06-10T00:16:20.290661+0000","last_fullsized":"2024-06-10T00:16:20.290661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306291+0000","last_change":"2024-06-10T00:16:20.302648+0000","last_active":"2024-06-10T00:16:20.306291+0000","last_peered":"2024-06-10T00:16:20.306291+0000","last_clean":"2024-06-10T00:16:20.306291+0000","last_became_active":"2024-06-10T00:16:20.302385+0000","last_became_peered":"2024-06-10T00:16:20.302385+0000","last_unstale":"2024-06-10T00:16:20.306291+0000","last_undegraded":"2024-06-10T00:16:20.306291+0000","last_fullsized":"2024-06-10T00:16:20.306291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:26:49.566446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287760+0000","last_change":"2024-06-10T00:16:20.287760+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287760+0000","last_undegraded":"2024-06-10T00:16:20.287760+0000","last_fullsized":"2024-06-10T00:16:20.287760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312804+0000","last_change":"2024-06-10T00:16:20.309578+0000","last_active":"2024-06-10T00:16:20.312804+0000","last_peered":"2024-06-10T00:16:20.312804+0000","last_clean":"2024-06-10T00:16:20.312804+0000","last_became_active":"2024-06-10T00:16:20.309249+0000","last_became_peered":"2024-06-10T00:16:20.309249+0000","last_unstale":"2024-06-10T00:16:20.312804+0000","last_undegraded":"2024-06-10T00:16:20.312804+0000","last_fullsized":"2024-06-10T00:16:20.312804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291176+0000","last_change":"2024-06-10T00:16:20.291176+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291176+0000","last_undegraded":"2024-06-10T00:16:20.291176+0000","last_fullsized":"2024-06-10T00:16:20.291176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.307316+0000","last_change":"2024-06-10T00:16:20.302054+0000","last_active":"2024-06-10T00:16:20.307316+0000","last_peered":"2024-06-10T00:16:20.307316+0000","last_clean":"2024-06-10T00:16:20.307316+0000","last_became_active":"2024-06-10T00:16:20.301779+0000","last_became_peered":"2024-06-10T00:16:20.301779+0000","last_unstale":"2024-06-10T00:16:20.307316+0000","last_undegraded":"2024-06-10T00:16:20.307316+0000","last_fullsized":"2024-06-10T00:16:20.307316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:36.042655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293824+0000","last_change":"2024-06-10T00:16:20.293824+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293824+0000","last_undegraded":"2024-06-10T00:16:20.293824+0000","last_fullsized":"2024-06-10T00:16:20.293824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308890+0000","last_change":"2024-06-10T00:16:20.305512+0000","last_active":"2024-06-10T00:16:20.308890+0000","last_peered":"2024-06-10T00:16:20.308890+0000","last_clean":"2024-06-10T00:16:20.308890+0000","last_became_active":"2024-06-10T00:16:20.305274+0000","last_became_peered":"2024-06-10T00:16:20.305274+0000","last_unstale":"2024-06-10T00:16:20.308890+0000","last_undegraded":"2024-06-10T00:16:20.308890+0000","last_fullsized":"2024-06-10T00:16:20.308890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:32:02.814038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294993+0000","last_change":"2024-06-10T00:16:20.294993+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294993+0000","last_undegraded":"2024-06-10T00:16:20.294993+0000","last_fullsized":"2024-06-10T00:16:20.294993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306539+0000","last_change":"2024-06-10T00:16:20.304106+0000","last_active":"2024-06-10T00:16:20.306539+0000","last_peered":"2024-06-10T00:16:20.306539+0000","last_clean":"2024-06-10T00:16:20.306539+0000","last_became_active":"2024-06-10T00:16:20.303755+0000","last_became_peered":"2024-06-10T00:16:20.303755+0000","last_unstale":"2024-06-10T00:16:20.306539+0000","last_undegraded":"2024-06-10T00:16:20.306539+0000","last_fullsized":"2024-06-10T00:16:20.306539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:34:57.335177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288151+0000","last_change":"2024-06-10T00:16:20.288151+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288151+0000","last_undegraded":"2024-06-10T00:16:20.288151+0000","last_fullsized":"2024-06-10T00:16:20.288151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.305299+0000","last_change":"2024-06-10T00:16:20.302947+0000","last_active":"2024-06-10T00:16:20.305299+0000","last_peered":"2024-06-10T00:16:20.305299+0000","last_clean":"2024-06-10T00:16:20.305299+0000","last_became_active":"2024-06-10T00:16:20.302664+0000","last_became_peered":"2024-06-10T00:16:20.302664+0000","last_unstale":"2024-06-10T00:16:20.305299+0000","last_undegraded":"2024-06-10T00:16:20.305299+0000","last_fullsized":"2024-06-10T00:16:20.305299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.299579+0000","last_change":"2024-06-10T00:16:20.299579+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.299579+0000","last_undegraded":"2024-06-10T00:16:20.299579+0000","last_fullsized":"2024-06-10T00:16:20.299579+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304539+0000","last_change":"2024-06-10T00:16:20.301224+0000","last_active":"2024-06-10T00:16:20.304539+0000","last_peered":"2024-06-10T00:16:20.304539+0000","last_clean":"2024-06-10T00:16:20.304539+0000","last_became_active":"2024-06-10T00:16:20.300924+0000","last_became_peered":"2024-06-10T00:16:20.300924+0000","last_unstale":"2024-06-10T00:16:20.304539+0000","last_undegraded":"2024-06-10T00:16:20.304539+0000","last_fullsized":"2024-06-10T00:16:20.304539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292999+0000","last_change":"2024-06-10T00:16:20.292999+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292999+0000","last_undegraded":"2024-06-10T00:16:20.292999+0000","last_fullsized":"2024-06-10T00:16:20.292999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.295014+0000","last_change":"2024-06-10T00:16:20.294051+0000","last_active":"2024-06-10T00:16:20.295014+0000","last_peered":"2024-06-10T00:16:20.295014+0000","last_clean":"2024-06-10T00:16:20.295014+0000","last_became_active":"2024-06-10T00:16:20.293751+0000","last_became_peered":"2024-06-10T00:16:20.293751+0000","last_unstale":"2024-06-10T00:16:20.295014+0000","last_undegraded":"2024-06-10T00:16:20.295014+0000","last_fullsized":"2024-06-10T00:16:20.295014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293270+0000","last_change":"2024-06-10T00:16:20.293270+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293270+0000","last_undegraded":"2024-06-10T00:16:20.293270+0000","last_fullsized":"2024-06-10T00:16:20.293270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.310282+0000","last_change":"2024-06-10T00:16:20.308999+0000","last_active":"2024-06-10T00:16:20.310282+0000","last_peered":"2024-06-10T00:16:20.310282+0000","last_clean":"2024-06-10T00:16:20.310282+0000","last_became_active":"2024-06-10T00:16:20.308679+0000","last_became_peered":"2024-06-10T00:16:20.308679+0000","last_unstale":"2024-06-10T00:16:20.310282+0000","last_undegraded":"2024-06-10T00:16:20.310282+0000","last_fullsized":"2024-06-10T00:16:20.310282+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:40.052203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":219,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.292737+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:16:20.292737+0000","last_peered":"2024-06-10T00:16:20.292737+0000","last_clean":"2024-06-10T00:16:20.292737+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:16:20.292737+0000","last_undegraded":"2024-06-10T00:16:20.292737+0000","last_fullsized":"2024-06-10T00:16:20.292737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":839756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":839756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:16:24.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:16:24.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.741+0000 7f466f27d640 1 Processor -- start 2024-06-10T00:16:24.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.742+0000 7f466f27d640 1 -- start start 2024-06-10T00:16:24.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.742+0000 7f466f27d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46681553c0 0x7f46680cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.742+0000 7f466f27d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46680b2cf0 0x7f466815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.742+0000 7f466f27d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680cec50 0x7f46680cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.742+0000 7f466f27d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f46680b31a0 con 0x7f46680b2cf0 2024-06-10T00:16:24.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.742+0000 7f466f27d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f466815c3f0 con 0x7f46681553c0 2024-06-10T00:16:24.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.742+0000 7f466f27d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f46680b3420 con 0x7f46680cec50 2024-06-10T00:16:24.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46680b2cf0 0x7f466815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46680b2cf0 0x7f466815beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49232/0 (socket says 172.21.15.79:49232) 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 -- 172.21.15.79:0/3482541054 learned_addr learned my addr 172.21.15.79:0/3482541054 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466d019640 1 --2- 172.21.15.79:0/3482541054 >> v2:172.21.15.117:3300/0 conn(0x7f46681553c0 0x7f46680cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466d81a640 1 --2- 172.21.15.79:0/3482541054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680cec50 0x7f46680cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 -- 172.21.15.79:0/3482541054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680cec50 msgr2=0x7f46680cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 --2- 172.21.15.79:0/3482541054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680cec50 0x7f46680cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 -- 172.21.15.79:0/3482541054 >> v2:172.21.15.117:3300/0 conn(0x7f46681553c0 msgr2=0x7f46680cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 --2- 172.21.15.79:0/3482541054 >> v2:172.21.15.117:3300/0 conn(0x7f46681553c0 0x7f46680cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 -- 172.21.15.79:0/3482541054 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46680cc750 con 0x7f46680b2cf0 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466d019640 1 --2- 172.21.15.79:0/3482541054 >> v2:172.21.15.117:3300/0 conn(0x7f46681553c0 0x7f46680cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.743+0000 7f466c818640 1 --2- 172.21.15.79:0/3482541054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680b2cf0 0x7f466815beb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f46680cd990 tx=0x7f465c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2ba32dd9211737 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f4667fff640 1 -- 172.21.15.79:0/3482541054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c037070 con 0x7f46680b2cf0 2024-06-10T00:16:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f4667fff640 1 -- 172.21.15.79:0/3482541054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465c032440 con 0x7f46680b2cf0 2024-06-10T00:16:24.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f4667fff640 1 -- 172.21.15.79:0/3482541054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c032810 con 0x7f46680b2cf0 2024-06-10T00:16:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 -- 172.21.15.79:0/3482541054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680b2cf0 msgr2=0x7f466815beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 --2- 172.21.15.79:0/3482541054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680b2cf0 0x7f466815beb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f46680cd990 tx=0x7f465c02a1e0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 -- 172.21.15.79:0/3482541054 shutdown_connections 2024-06-10T00:16:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 --2- 172.21.15.79:0/3482541054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680cec50 0x7f46680cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 --2- 172.21.15.79:0/3482541054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680b2cf0 0x7f466815beb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 --2- 172.21.15.79:0/3482541054 >> v2:172.21.15.117:3300/0 conn(0x7f46681553c0 0x7f46680cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 -- 172.21.15.79:0/3482541054 >> 172.21.15.79:0/3482541054 conn(0x7f46680b19f0 msgr2=0x7f46680b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 -- 172.21.15.79:0/3482541054 shutdown_connections 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.744+0000 7f466f27d640 1 -- 172.21.15.79:0/3482541054 wait complete. 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.745+0000 7f466f27d640 1 Processor -- start 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466f27d640 1 -- start start 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466f27d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680b2cf0 0x7f466814f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466f27d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680cec50 0x7f466815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466f27d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46681553c0 0x7f466814d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466f27d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46680b3700 con 0x7f46680cec50 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466f27d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46680ccd10 con 0x7f46681553c0 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466f27d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f46681557a0 con 0x7f46680b2cf0 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466c818640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680cec50 0x7f466815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466c818640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680cec50 0x7f466815e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49248/0 (socket says 172.21.15.79:49248) 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.746+0000 7f466c818640 1 -- 172.21.15.79:0/3551088454 learned_addr learned my addr 172.21.15.79:0/3551088454 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466d81a640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46681553c0 0x7f466814d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466d019640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680b2cf0 0x7f466814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466c818640 1 -- 172.21.15.79:0/3551088454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680b2cf0 msgr2=0x7f466814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466c818640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680b2cf0 0x7f466814f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466c818640 1 -- 172.21.15.79:0/3551088454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46681553c0 msgr2=0x7f466814d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466c818640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46681553c0 0x7f466814d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466c818640 1 -- 172.21.15.79:0/3551088454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46681f1fe0 con 0x7f46680cec50 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466c818640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680cec50 0x7f466815e9f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f465c02a220 tx=0x7f465c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f4665ffb640 1 -- 172.21.15.79:0/3551088454 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c041020 con 0x7f46680cec50 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f4665ffb640 1 -- 172.21.15.79:0/3551088454 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465c0306c0 con 0x7f46680cec50 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46681f22c0 con 0x7f46680cec50 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f4665ffb640 1 -- 172.21.15.79:0/3551088454 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c037040 con 0x7f46680cec50 2024-06-10T00:16:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.747+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46681f2b60 con 0x7f46680cec50 2024-06-10T00:16:24.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.748+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46681f26b0 con 0x7f46680cec50 2024-06-10T00:16:24.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.748+0000 7f4665ffb640 1 -- 172.21.15.79:0/3551088454 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f465c044020 con 0x7f46680cec50 2024-06-10T00:16:24.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.749+0000 7f4665ffb640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f465406be30 0x7f465406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:24.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.749+0000 7f4665ffb640 1 -- 172.21.15.79:0/3551088454 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f465c0ab7a0 con 0x7f46680cec50 2024-06-10T00:16:24.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.749+0000 7f466d019640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f465406be30 0x7f465406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:24.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.749+0000 7f466d019640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f465406be30 0x7f465406e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f46680ae390 tx=0x7f4660008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:24.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.753+0000 7f4665ffb640 1 -- 172.21.15.79:0/3551088454 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f465c04b030 con 0x7f46680cec50 2024-06-10T00:16:24.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.922+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f466814f550 con 0x7f465406be30 2024-06-10T00:16:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.928+0000 7f4665ffb640 1 -- 172.21.15.79:0/3551088454 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7f466814f550 con 0x7f465406be30 2024-06-10T00:16:24.930 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:24.931 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f465406be30 msgr2=0x7f465406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f465406be30 0x7f465406e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f46680ae390 tx=0x7f4660008040 comp rx=0 tx=0).stop 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680cec50 msgr2=0x7f466815e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680cec50 0x7f466815e9f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f465c02a220 tx=0x7f465c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 shutdown_connections 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f465406be30 0x7f465406e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46681553c0 0x7f466814d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680cec50 0x7f466815e9f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 --2- 172.21.15.79:0/3551088454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46680b2cf0 0x7f466814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 >> 172.21.15.79:0/3551088454 conn(0x7f46680b19f0 msgr2=0x7f46680ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 shutdown_connections 2024-06-10T00:16:24.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:24.931+0000 7f466f27d640 1 -- 172.21.15.79:0/3551088454 wait complete. 2024-06-10T00:16:24.942 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-06-10T00:16:23.167419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221788,"kb_used_data":5572,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752932,"statfs":{"total":773094113280,"available":772867002368,"internally_reserved":0,"allocated":5705728,"data_stored":3155839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000778"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292207+0000","last_change":"2024-06-10T00:16:20.292207+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292207+0000","last_undegraded":"2024-06-10T00:16:20.292207+0000","last_fullsized":"2024-06-10T00:16:20.292207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292285+0000","last_change":"2024-06-10T00:16:20.292285+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292285+0000","last_undegraded":"2024-06-10T00:16:20.292285+0000","last_fullsized":"2024-06-10T00:16:20.292285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297906+0000","last_change":"2024-06-10T00:16:20.297906+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297906+0000","last_undegraded":"2024-06-10T00:16:20.297906+0000","last_fullsized":"2024-06-10T00:16:20.297906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290662+0000","last_change":"2024-06-10T00:16:20.290662+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290662+0000","last_undegraded":"2024-06-10T00:16:20.290662+0000","last_fullsized":"2024-06-10T00:16:20.290662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289043+0000","last_change":"2024-06-10T00:16:20.289043+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289043+0000","last_undegraded":"2024-06-10T00:16:20.289043+0000","last_fullsized":"2024-06-10T00:16:20.289043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292419+0000","last_change":"2024-06-10T00:16:20.292419+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292419+0000","last_undegraded":"2024-06-10T00:16:20.292419+0000","last_fullsized":"2024-06-10T00:16:20.292419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296405+0000","last_change":"2024-06-10T00:16:20.296405+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296405+0000","last_undegraded":"2024-06-10T00:16:20.296405+0000","last_fullsized":"2024-06-10T00:16:20.296405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295580+0000","last_change":"2024-06-10T00:16:20.295580+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295580+0000","last_undegraded":"2024-06-10T00:16:20.295580+0000","last_fullsized":"2024-06-10T00:16:20.295580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294002+0000","last_change":"2024-06-10T00:16:20.294002+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294002+0000","last_undegraded":"2024-06-10T00:16:20.294002+0000","last_fullsized":"2024-06-10T00:16:20.294002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291900+0000","last_change":"2024-06-10T00:16:20.291900+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291900+0000","last_undegraded":"2024-06-10T00:16:20.291900+0000","last_fullsized":"2024-06-10T00:16:20.291900+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297704+0000","last_change":"2024-06-10T00:16:20.297704+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297704+0000","last_undegraded":"2024-06-10T00:16:20.297704+0000","last_fullsized":"2024-06-10T00:16:20.297704+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292777+0000","last_change":"2024-06-10T00:16:20.292777+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292777+0000","last_undegraded":"2024-06-10T00:16:20.292777+0000","last_fullsized":"2024-06-10T00:16:20.292777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291477+0000","last_change":"2024-06-10T00:16:20.291477+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291477+0000","last_undegraded":"2024-06-10T00:16:20.291477+0000","last_fullsized":"2024-06-10T00:16:20.291477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295384+0000","last_change":"2024-06-10T00:16:20.295384+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295384+0000","last_undegraded":"2024-06-10T00:16:20.295384+0000","last_fullsized":"2024-06-10T00:16:20.295384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290636+0000","last_change":"2024-06-10T00:16:20.290636+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290636+0000","last_undegraded":"2024-06-10T00:16:20.290636+0000","last_fullsized":"2024-06-10T00:16:20.290636+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291199+0000","last_change":"2024-06-10T00:16:20.291199+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291199+0000","last_undegraded":"2024-06-10T00:16:20.291199+0000","last_fullsized":"2024-06-10T00:16:20.291199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.301114+0000","last_change":"2024-06-10T00:16:20.301114+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.301114+0000","last_undegraded":"2024-06-10T00:16:20.301114+0000","last_fullsized":"2024-06-10T00:16:20.301114+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291494+0000","last_change":"2024-06-10T00:16:20.291494+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291494+0000","last_undegraded":"2024-06-10T00:16:20.291494+0000","last_fullsized":"2024-06-10T00:16:20.291494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297279+0000","last_change":"2024-06-10T00:16:20.297279+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297279+0000","last_undegraded":"2024-06-10T00:16:20.297279+0000","last_fullsized":"2024-06-10T00:16:20.297279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294476+0000","last_change":"2024-06-10T00:16:20.294476+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294476+0000","last_undegraded":"2024-06-10T00:16:20.294476+0000","last_fullsized":"2024-06-10T00:16:20.294476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296057+0000","last_change":"2024-06-10T00:16:20.296057+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296057+0000","last_undegraded":"2024-06-10T00:16:20.296057+0000","last_fullsized":"2024-06-10T00:16:20.296057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293602+0000","last_change":"2024-06-10T00:16:20.293602+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293602+0000","last_undegraded":"2024-06-10T00:16:20.293602+0000","last_fullsized":"2024-06-10T00:16:20.293602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296488+0000","last_change":"2024-06-10T00:16:20.296488+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296488+0000","last_undegraded":"2024-06-10T00:16:20.296488+0000","last_fullsized":"2024-06-10T00:16:20.296488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294763+0000","last_change":"2024-06-10T00:16:20.294763+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294763+0000","last_undegraded":"2024-06-10T00:16:20.294763+0000","last_fullsized":"2024-06-10T00:16:20.294763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.300280+0000","last_change":"2024-06-10T00:16:20.300280+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.300280+0000","last_undegraded":"2024-06-10T00:16:20.300280+0000","last_fullsized":"2024-06-10T00:16:20.300280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295052+0000","last_change":"2024-06-10T00:16:20.295052+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295052+0000","last_undegraded":"2024-06-10T00:16:20.295052+0000","last_fullsized":"2024-06-10T00:16:20.295052+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291206+0000","last_change":"2024-06-10T00:16:20.291206+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291206+0000","last_undegraded":"2024-06-10T00:16:20.291206+0000","last_fullsized":"2024-06-10T00:16:20.291206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294087+0000","last_change":"2024-06-10T00:16:20.294087+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294087+0000","last_undegraded":"2024-06-10T00:16:20.294087+0000","last_fullsized":"2024-06-10T00:16:20.294087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296088+0000","last_change":"2024-06-10T00:16:20.296088+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296088+0000","last_undegraded":"2024-06-10T00:16:20.296088+0000","last_fullsized":"2024-06-10T00:16:20.296088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290938+0000","last_change":"2024-06-10T00:16:20.290938+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290938+0000","last_undegraded":"2024-06-10T00:16:20.290938+0000","last_fullsized":"2024-06-10T00:16:20.290938+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296046+0000","last_change":"2024-06-10T00:16:20.296046+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296046+0000","last_undegraded":"2024-06-10T00:16:20.296046+0000","last_fullsized":"2024-06-10T00:16:20.296046+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288285+0000","last_change":"2024-06-10T00:16:20.288285+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288285+0000","last_undegraded":"2024-06-10T00:16:20.288285+0000","last_fullsized":"2024-06-10T00:16:20.288285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290545+0000","last_change":"2024-06-10T00:16:20.290545+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290545+0000","last_undegraded":"2024-06-10T00:16:20.290545+0000","last_fullsized":"2024-06-10T00:16:20.290545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304382+0000","last_change":"2024-06-10T00:16:20.297870+0000","last_active":"2024-06-10T00:16:20.304382+0000","last_peered":"2024-06-10T00:16:20.304382+0000","last_clean":"2024-06-10T00:16:20.304382+0000","last_became_active":"2024-06-10T00:16:20.297484+0000","last_became_peered":"2024-06-10T00:16:20.297484+0000","last_unstale":"2024-06-10T00:16:20.304382+0000","last_undegraded":"2024-06-10T00:16:20.304382+0000","last_fullsized":"2024-06-10T00:16:20.304382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:20.625301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287546+0000","last_change":"2024-06-10T00:16:20.287546+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287546+0000","last_undegraded":"2024-06-10T00:16:20.287546+0000","last_fullsized":"2024-06-10T00:16:20.287546+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.305239+0000","last_change":"2024-06-10T00:16:20.303002+0000","last_active":"2024-06-10T00:16:20.305239+0000","last_peered":"2024-06-10T00:16:20.305239+0000","last_clean":"2024-06-10T00:16:20.305239+0000","last_became_active":"2024-06-10T00:16:20.302738+0000","last_became_peered":"2024-06-10T00:16:20.302738+0000","last_unstale":"2024-06-10T00:16:20.305239+0000","last_undegraded":"2024-06-10T00:16:20.305239+0000","last_fullsized":"2024-06-10T00:16:20.305239+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296035+0000","last_change":"2024-06-10T00:16:20.296035+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296035+0000","last_undegraded":"2024-06-10T00:16:20.296035+0000","last_fullsized":"2024-06-10T00:16:20.296035+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.303123+0000","last_change":"2024-06-10T00:16:20.299695+0000","last_active":"2024-06-10T00:16:20.303123+0000","last_peered":"2024-06-10T00:16:20.303123+0000","last_clean":"2024-06-10T00:16:20.303123+0000","last_became_active":"2024-06-10T00:16:20.299435+0000","last_became_peered":"2024-06-10T00:16:20.299435+0000","last_unstale":"2024-06-10T00:16:20.303123+0000","last_undegraded":"2024-06-10T00:16:20.303123+0000","last_fullsized":"2024-06-10T00:16:20.303123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:33.552452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294200+0000","last_change":"2024-06-10T00:16:20.294200+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294200+0000","last_undegraded":"2024-06-10T00:16:20.294200+0000","last_fullsized":"2024-06-10T00:16:20.294200+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304851+0000","last_change":"2024-06-10T00:16:20.300555+0000","last_active":"2024-06-10T00:16:20.304851+0000","last_peered":"2024-06-10T00:16:20.304851+0000","last_clean":"2024-06-10T00:16:20.304851+0000","last_became_active":"2024-06-10T00:16:20.300241+0000","last_became_peered":"2024-06-10T00:16:20.300241+0000","last_unstale":"2024-06-10T00:16:20.304851+0000","last_undegraded":"2024-06-10T00:16:20.304851+0000","last_fullsized":"2024-06-10T00:16:20.304851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:55.681863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289108+0000","last_change":"2024-06-10T00:16:20.289108+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289108+0000","last_undegraded":"2024-06-10T00:16:20.289108+0000","last_fullsized":"2024-06-10T00:16:20.289108+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308906+0000","last_change":"2024-06-10T00:16:20.305776+0000","last_active":"2024-06-10T00:16:20.308906+0000","last_peered":"2024-06-10T00:16:20.308906+0000","last_clean":"2024-06-10T00:16:20.308906+0000","last_became_active":"2024-06-10T00:16:20.305527+0000","last_became_peered":"2024-06-10T00:16:20.305527+0000","last_unstale":"2024-06-10T00:16:20.308906+0000","last_undegraded":"2024-06-10T00:16:20.308906+0000","last_fullsized":"2024-06-10T00:16:20.308906+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:24:01.616634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291706+0000","last_change":"2024-06-10T00:16:20.291706+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291706+0000","last_undegraded":"2024-06-10T00:16:20.291706+0000","last_fullsized":"2024-06-10T00:16:20.291706+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.301501+0000","last_change":"2024-06-10T00:16:20.298240+0000","last_active":"2024-06-10T00:16:20.301501+0000","last_peered":"2024-06-10T00:16:20.301501+0000","last_clean":"2024-06-10T00:16:20.301501+0000","last_became_active":"2024-06-10T00:16:20.297962+0000","last_became_peered":"2024-06-10T00:16:20.297962+0000","last_unstale":"2024-06-10T00:16:20.301501+0000","last_undegraded":"2024-06-10T00:16:20.301501+0000","last_fullsized":"2024-06-10T00:16:20.301501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292961+0000","last_change":"2024-06-10T00:16:20.292961+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292961+0000","last_undegraded":"2024-06-10T00:16:20.292961+0000","last_fullsized":"2024-06-10T00:16:20.292961+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304440+0000","last_change":"2024-06-10T00:16:20.298791+0000","last_active":"2024-06-10T00:16:20.304440+0000","last_peered":"2024-06-10T00:16:20.304440+0000","last_clean":"2024-06-10T00:16:20.304440+0000","last_became_active":"2024-06-10T00:16:20.297457+0000","last_became_peered":"2024-06-10T00:16:20.297457+0000","last_unstale":"2024-06-10T00:16:20.304440+0000","last_undegraded":"2024-06-10T00:16:20.304440+0000","last_fullsized":"2024-06-10T00:16:20.304440+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:55.550063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291642+0000","last_change":"2024-06-10T00:16:20.291642+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291642+0000","last_undegraded":"2024-06-10T00:16:20.291642+0000","last_fullsized":"2024-06-10T00:16:20.291642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.309257+0000","last_change":"2024-06-10T00:16:20.307746+0000","last_active":"2024-06-10T00:16:20.309257+0000","last_peered":"2024-06-10T00:16:20.309257+0000","last_clean":"2024-06-10T00:16:20.309257+0000","last_became_active":"2024-06-10T00:16:20.306090+0000","last_became_peered":"2024-06-10T00:16:20.306090+0000","last_unstale":"2024-06-10T00:16:20.309257+0000","last_undegraded":"2024-06-10T00:16:20.309257+0000","last_fullsized":"2024-06-10T00:16:20.309257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:53.046468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288041+0000","last_change":"2024-06-10T00:16:20.288041+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288041+0000","last_undegraded":"2024-06-10T00:16:20.288041+0000","last_fullsized":"2024-06-10T00:16:20.288041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.299771+0000","last_change":"2024-06-10T00:16:20.297128+0000","last_active":"2024-06-10T00:16:20.299771+0000","last_peered":"2024-06-10T00:16:20.299771+0000","last_clean":"2024-06-10T00:16:20.299771+0000","last_became_active":"2024-06-10T00:16:20.296839+0000","last_became_peered":"2024-06-10T00:16:20.296839+0000","last_unstale":"2024-06-10T00:16:20.299771+0000","last_undegraded":"2024-06-10T00:16:20.299771+0000","last_fullsized":"2024-06-10T00:16:20.299771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288797+0000","last_change":"2024-06-10T00:16:20.288797+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288797+0000","last_undegraded":"2024-06-10T00:16:20.288797+0000","last_fullsized":"2024-06-10T00:16:20.288797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312825+0000","last_change":"2024-06-10T00:16:20.309837+0000","last_active":"2024-06-10T00:16:20.312825+0000","last_peered":"2024-06-10T00:16:20.312825+0000","last_clean":"2024-06-10T00:16:20.312825+0000","last_became_active":"2024-06-10T00:16:20.309531+0000","last_became_peered":"2024-06-10T00:16:20.309531+0000","last_unstale":"2024-06-10T00:16:20.312825+0000","last_undegraded":"2024-06-10T00:16:20.312825+0000","last_fullsized":"2024-06-10T00:16:20.312825+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295043+0000","last_change":"2024-06-10T00:16:20.295043+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295043+0000","last_undegraded":"2024-06-10T00:16:20.295043+0000","last_fullsized":"2024-06-10T00:16:20.295043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304676+0000","last_change":"2024-06-10T00:16:20.300508+0000","last_active":"2024-06-10T00:16:20.304676+0000","last_peered":"2024-06-10T00:16:20.304676+0000","last_clean":"2024-06-10T00:16:20.304676+0000","last_became_active":"2024-06-10T00:16:20.300209+0000","last_became_peered":"2024-06-10T00:16:20.300209+0000","last_unstale":"2024-06-10T00:16:20.304676+0000","last_undegraded":"2024-06-10T00:16:20.304676+0000","last_fullsized":"2024-06-10T00:16:20.304676+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:01:40.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288604+0000","last_change":"2024-06-10T00:16:20.288604+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288604+0000","last_undegraded":"2024-06-10T00:16:20.288604+0000","last_fullsized":"2024-06-10T00:16:20.288604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306552+0000","last_change":"2024-06-10T00:16:20.304014+0000","last_active":"2024-06-10T00:16:20.306552+0000","last_peered":"2024-06-10T00:16:20.306552+0000","last_clean":"2024-06-10T00:16:20.306552+0000","last_became_active":"2024-06-10T00:16:20.303743+0000","last_became_peered":"2024-06-10T00:16:20.303743+0000","last_unstale":"2024-06-10T00:16:20.306552+0000","last_undegraded":"2024-06-10T00:16:20.306552+0000","last_fullsized":"2024-06-10T00:16:20.306552+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:15:50.724605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288417+0000","last_change":"2024-06-10T00:16:20.288417+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288417+0000","last_undegraded":"2024-06-10T00:16:20.288417+0000","last_fullsized":"2024-06-10T00:16:20.288417+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308734+0000","last_change":"2024-06-10T00:16:20.304457+0000","last_active":"2024-06-10T00:16:20.308734+0000","last_peered":"2024-06-10T00:16:20.308734+0000","last_clean":"2024-06-10T00:16:20.308734+0000","last_became_active":"2024-06-10T00:16:20.302179+0000","last_became_peered":"2024-06-10T00:16:20.302179+0000","last_unstale":"2024-06-10T00:16:20.308734+0000","last_undegraded":"2024-06-10T00:16:20.308734+0000","last_fullsized":"2024-06-10T00:16:20.308734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296898+0000","last_change":"2024-06-10T00:16:20.296898+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296898+0000","last_undegraded":"2024-06-10T00:16:20.296898+0000","last_fullsized":"2024-06-10T00:16:20.296898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312781+0000","last_change":"2024-06-10T00:16:20.309057+0000","last_active":"2024-06-10T00:16:20.312781+0000","last_peered":"2024-06-10T00:16:20.312781+0000","last_clean":"2024-06-10T00:16:20.312781+0000","last_became_active":"2024-06-10T00:16:20.308794+0000","last_became_peered":"2024-06-10T00:16:20.308794+0000","last_unstale":"2024-06-10T00:16:20.312781+0000","last_undegraded":"2024-06-10T00:16:20.312781+0000","last_fullsized":"2024-06-10T00:16:20.312781+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293832+0000","last_change":"2024-06-10T00:16:20.293832+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293832+0000","last_undegraded":"2024-06-10T00:16:20.293832+0000","last_fullsized":"2024-06-10T00:16:20.293832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.301803+0000","last_change":"2024-06-10T00:16:20.299284+0000","last_active":"2024-06-10T00:16:20.301803+0000","last_peered":"2024-06-10T00:16:20.301803+0000","last_clean":"2024-06-10T00:16:20.301803+0000","last_became_active":"2024-06-10T00:16:20.298987+0000","last_became_peered":"2024-06-10T00:16:20.298987+0000","last_unstale":"2024-06-10T00:16:20.301803+0000","last_undegraded":"2024-06-10T00:16:20.301803+0000","last_fullsized":"2024-06-10T00:16:20.301803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:35:29.547234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.301475+0000","last_change":"2024-06-10T00:16:20.301475+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.301475+0000","last_undegraded":"2024-06-10T00:16:20.301475+0000","last_fullsized":"2024-06-10T00:16:20.301475+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306014+0000","last_change":"2024-06-10T00:16:20.303655+0000","last_active":"2024-06-10T00:16:20.306014+0000","last_peered":"2024-06-10T00:16:20.306014+0000","last_clean":"2024-06-10T00:16:20.306014+0000","last_became_active":"2024-06-10T00:16:20.303386+0000","last_became_peered":"2024-06-10T00:16:20.303386+0000","last_unstale":"2024-06-10T00:16:20.306014+0000","last_undegraded":"2024-06-10T00:16:20.306014+0000","last_fullsized":"2024-06-10T00:16:20.306014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:55.681863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292316+0000","last_change":"2024-06-10T00:16:20.292316+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292316+0000","last_undegraded":"2024-06-10T00:16:20.292316+0000","last_fullsized":"2024-06-10T00:16:20.292316+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.310617+0000","last_change":"2024-06-10T00:16:20.309531+0000","last_active":"2024-06-10T00:16:20.310617+0000","last_peered":"2024-06-10T00:16:20.310617+0000","last_clean":"2024-06-10T00:16:20.310617+0000","last_became_active":"2024-06-10T00:16:20.309223+0000","last_became_peered":"2024-06-10T00:16:20.309223+0000","last_unstale":"2024-06-10T00:16:20.310617+0000","last_undegraded":"2024-06-10T00:16:20.310617+0000","last_fullsized":"2024-06-10T00:16:20.310617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290965+0000","last_change":"2024-06-10T00:16:20.290965+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290965+0000","last_undegraded":"2024-06-10T00:16:20.290965+0000","last_fullsized":"2024-06-10T00:16:20.290965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.307178+0000","last_change":"2024-06-10T00:16:20.305785+0000","last_active":"2024-06-10T00:16:20.307178+0000","last_peered":"2024-06-10T00:16:20.307178+0000","last_clean":"2024-06-10T00:16:20.307178+0000","last_became_active":"2024-06-10T00:16:20.305483+0000","last_became_peered":"2024-06-10T00:16:20.305483+0000","last_unstale":"2024-06-10T00:16:20.307178+0000","last_undegraded":"2024-06-10T00:16:20.307178+0000","last_fullsized":"2024-06-10T00:16:20.307178+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:17.213749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289029+0000","last_change":"2024-06-10T00:16:20.289029+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289029+0000","last_undegraded":"2024-06-10T00:16:20.289029+0000","last_fullsized":"2024-06-10T00:16:20.289029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304736+0000","last_change":"2024-06-10T00:16:20.300901+0000","last_active":"2024-06-10T00:16:20.304736+0000","last_peered":"2024-06-10T00:16:20.304736+0000","last_clean":"2024-06-10T00:16:20.304736+0000","last_became_active":"2024-06-10T00:16:20.300594+0000","last_became_peered":"2024-06-10T00:16:20.300594+0000","last_unstale":"2024-06-10T00:16:20.304736+0000","last_undegraded":"2024-06-10T00:16:20.304736+0000","last_fullsized":"2024-06-10T00:16:20.304736+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:56.536723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290675+0000","last_change":"2024-06-10T00:16:20.290675+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290675+0000","last_undegraded":"2024-06-10T00:16:20.290675+0000","last_fullsized":"2024-06-10T00:16:20.290675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.309934+0000","last_change":"2024-06-10T00:16:20.305387+0000","last_active":"2024-06-10T00:16:20.309934+0000","last_peered":"2024-06-10T00:16:20.309934+0000","last_clean":"2024-06-10T00:16:20.309934+0000","last_became_active":"2024-06-10T00:16:20.305118+0000","last_became_peered":"2024-06-10T00:16:20.305118+0000","last_unstale":"2024-06-10T00:16:20.309934+0000","last_undegraded":"2024-06-10T00:16:20.309934+0000","last_fullsized":"2024-06-10T00:16:20.309934+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:33.552452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287883+0000","last_change":"2024-06-10T00:16:20.287883+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287883+0000","last_undegraded":"2024-06-10T00:16:20.287883+0000","last_fullsized":"2024-06-10T00:16:20.287883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.296484+0000","last_change":"2024-06-10T00:16:20.293250+0000","last_active":"2024-06-10T00:16:20.296484+0000","last_peered":"2024-06-10T00:16:20.296484+0000","last_clean":"2024-06-10T00:16:20.296484+0000","last_became_active":"2024-06-10T00:16:20.292968+0000","last_became_peered":"2024-06-10T00:16:20.292968+0000","last_unstale":"2024-06-10T00:16:20.296484+0000","last_undegraded":"2024-06-10T00:16:20.296484+0000","last_fullsized":"2024-06-10T00:16:20.296484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:56.536723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295762+0000","last_change":"2024-06-10T00:16:20.295762+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295762+0000","last_undegraded":"2024-06-10T00:16:20.295762+0000","last_fullsized":"2024-06-10T00:16:20.295762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308681+0000","last_change":"2024-06-10T00:16:20.304632+0000","last_active":"2024-06-10T00:16:20.308681+0000","last_peered":"2024-06-10T00:16:20.308681+0000","last_clean":"2024-06-10T00:16:20.308681+0000","last_became_active":"2024-06-10T00:16:20.304382+0000","last_became_peered":"2024-06-10T00:16:20.304382+0000","last_unstale":"2024-06-10T00:16:20.308681+0000","last_undegraded":"2024-06-10T00:16:20.308681+0000","last_fullsized":"2024-06-10T00:16:20.308681+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:47:25.968321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.298291+0000","last_change":"2024-06-10T00:16:20.298291+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.298291+0000","last_undegraded":"2024-06-10T00:16:20.298291+0000","last_fullsized":"2024-06-10T00:16:20.298291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308731+0000","last_change":"2024-06-10T00:16:20.305088+0000","last_active":"2024-06-10T00:16:20.308731+0000","last_peered":"2024-06-10T00:16:20.308731+0000","last_clean":"2024-06-10T00:16:20.308731+0000","last_became_active":"2024-06-10T00:16:20.304825+0000","last_became_peered":"2024-06-10T00:16:20.304825+0000","last_unstale":"2024-06-10T00:16:20.308731+0000","last_undegraded":"2024-06-10T00:16:20.308731+0000","last_fullsized":"2024-06-10T00:16:20.308731+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290661+0000","last_change":"2024-06-10T00:16:20.290661+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290661+0000","last_undegraded":"2024-06-10T00:16:20.290661+0000","last_fullsized":"2024-06-10T00:16:20.290661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306291+0000","last_change":"2024-06-10T00:16:20.302648+0000","last_active":"2024-06-10T00:16:20.306291+0000","last_peered":"2024-06-10T00:16:20.306291+0000","last_clean":"2024-06-10T00:16:20.306291+0000","last_became_active":"2024-06-10T00:16:20.302385+0000","last_became_peered":"2024-06-10T00:16:20.302385+0000","last_unstale":"2024-06-10T00:16:20.306291+0000","last_undegraded":"2024-06-10T00:16:20.306291+0000","last_fullsized":"2024-06-10T00:16:20.306291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:26:49.566446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287760+0000","last_change":"2024-06-10T00:16:20.287760+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287760+0000","last_undegraded":"2024-06-10T00:16:20.287760+0000","last_fullsized":"2024-06-10T00:16:20.287760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312804+0000","last_change":"2024-06-10T00:16:20.309578+0000","last_active":"2024-06-10T00:16:20.312804+0000","last_peered":"2024-06-10T00:16:20.312804+0000","last_clean":"2024-06-10T00:16:20.312804+0000","last_became_active":"2024-06-10T00:16:20.309249+0000","last_became_peered":"2024-06-10T00:16:20.309249+0000","last_unstale":"2024-06-10T00:16:20.312804+0000","last_undegraded":"2024-06-10T00:16:20.312804+0000","last_fullsized":"2024-06-10T00:16:20.312804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291176+0000","last_change":"2024-06-10T00:16:20.291176+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291176+0000","last_undegraded":"2024-06-10T00:16:20.291176+0000","last_fullsized":"2024-06-10T00:16:20.291176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.307316+0000","last_change":"2024-06-10T00:16:20.302054+0000","last_active":"2024-06-10T00:16:20.307316+0000","last_peered":"2024-06-10T00:16:20.307316+0000","last_clean":"2024-06-10T00:16:20.307316+0000","last_became_active":"2024-06-10T00:16:20.301779+0000","last_became_peered":"2024-06-10T00:16:20.301779+0000","last_unstale":"2024-06-10T00:16:20.307316+0000","last_undegraded":"2024-06-10T00:16:20.307316+0000","last_fullsized":"2024-06-10T00:16:20.307316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:36.042655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293824+0000","last_change":"2024-06-10T00:16:20.293824+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293824+0000","last_undegraded":"2024-06-10T00:16:20.293824+0000","last_fullsized":"2024-06-10T00:16:20.293824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308890+0000","last_change":"2024-06-10T00:16:20.305512+0000","last_active":"2024-06-10T00:16:20.308890+0000","last_peered":"2024-06-10T00:16:20.308890+0000","last_clean":"2024-06-10T00:16:20.308890+0000","last_became_active":"2024-06-10T00:16:20.305274+0000","last_became_peered":"2024-06-10T00:16:20.305274+0000","last_unstale":"2024-06-10T00:16:20.308890+0000","last_undegraded":"2024-06-10T00:16:20.308890+0000","last_fullsized":"2024-06-10T00:16:20.308890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:32:02.814038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294993+0000","last_change":"2024-06-10T00:16:20.294993+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294993+0000","last_undegraded":"2024-06-10T00:16:20.294993+0000","last_fullsized":"2024-06-10T00:16:20.294993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306539+0000","last_change":"2024-06-10T00:16:20.304106+0000","last_active":"2024-06-10T00:16:20.306539+0000","last_peered":"2024-06-10T00:16:20.306539+0000","last_clean":"2024-06-10T00:16:20.306539+0000","last_became_active":"2024-06-10T00:16:20.303755+0000","last_became_peered":"2024-06-10T00:16:20.303755+0000","last_unstale":"2024-06-10T00:16:20.306539+0000","last_undegraded":"2024-06-10T00:16:20.306539+0000","last_fullsized":"2024-06-10T00:16:20.306539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:34:57.335177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288151+0000","last_change":"2024-06-10T00:16:20.288151+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288151+0000","last_undegraded":"2024-06-10T00:16:20.288151+0000","last_fullsized":"2024-06-10T00:16:20.288151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.305299+0000","last_change":"2024-06-10T00:16:20.302947+0000","last_active":"2024-06-10T00:16:20.305299+0000","last_peered":"2024-06-10T00:16:20.305299+0000","last_clean":"2024-06-10T00:16:20.305299+0000","last_became_active":"2024-06-10T00:16:20.302664+0000","last_became_peered":"2024-06-10T00:16:20.302664+0000","last_unstale":"2024-06-10T00:16:20.305299+0000","last_undegraded":"2024-06-10T00:16:20.305299+0000","last_fullsized":"2024-06-10T00:16:20.305299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.299579+0000","last_change":"2024-06-10T00:16:20.299579+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.299579+0000","last_undegraded":"2024-06-10T00:16:20.299579+0000","last_fullsized":"2024-06-10T00:16:20.299579+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304539+0000","last_change":"2024-06-10T00:16:20.301224+0000","last_active":"2024-06-10T00:16:20.304539+0000","last_peered":"2024-06-10T00:16:20.304539+0000","last_clean":"2024-06-10T00:16:20.304539+0000","last_became_active":"2024-06-10T00:16:20.300924+0000","last_became_peered":"2024-06-10T00:16:20.300924+0000","last_unstale":"2024-06-10T00:16:20.304539+0000","last_undegraded":"2024-06-10T00:16:20.304539+0000","last_fullsized":"2024-06-10T00:16:20.304539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292999+0000","last_change":"2024-06-10T00:16:20.292999+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292999+0000","last_undegraded":"2024-06-10T00:16:20.292999+0000","last_fullsized":"2024-06-10T00:16:20.292999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.295014+0000","last_change":"2024-06-10T00:16:20.294051+0000","last_active":"2024-06-10T00:16:20.295014+0000","last_peered":"2024-06-10T00:16:20.295014+0000","last_clean":"2024-06-10T00:16:20.295014+0000","last_became_active":"2024-06-10T00:16:20.293751+0000","last_became_peered":"2024-06-10T00:16:20.293751+0000","last_unstale":"2024-06-10T00:16:20.295014+0000","last_undegraded":"2024-06-10T00:16:20.295014+0000","last_fullsized":"2024-06-10T00:16:20.295014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293270+0000","last_change":"2024-06-10T00:16:20.293270+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293270+0000","last_undegraded":"2024-06-10T00:16:20.293270+0000","last_fullsized":"2024-06-10T00:16:20.293270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.310282+0000","last_change":"2024-06-10T00:16:20.308999+0000","last_active":"2024-06-10T00:16:20.310282+0000","last_peered":"2024-06-10T00:16:20.310282+0000","last_clean":"2024-06-10T00:16:20.310282+0000","last_became_active":"2024-06-10T00:16:20.308679+0000","last_became_peered":"2024-06-10T00:16:20.308679+0000","last_unstale":"2024-06-10T00:16:20.310282+0000","last_undegraded":"2024-06-10T00:16:20.310282+0000","last_fullsized":"2024-06-10T00:16:20.310282+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:40.052203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":219,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.292737+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:16:20.292737+0000","last_peered":"2024-06-10T00:16:20.292737+0000","last_clean":"2024-06-10T00:16:20.292737+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:16:20.292737+0000","last_undegraded":"2024-06-10T00:16:20.292737+0000","last_fullsized":"2024-06-10T00:16:20.292737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":839756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":839756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:16:24.945 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-06-10T00:16:24.945 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.292207+0000', 'last_change': '2024-06-10T00:16:20.292207+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.292207+0000', 'last_undegraded': '2024-06-10T00:16:20.292207+0000', 'last_fullsized': '2024-06-10T00:16:20.292207+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.945 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.292285+0000', 'last_change': '2024-06-10T00:16:20.292285+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.292285+0000', 'last_undegraded': '2024-06-10T00:16:20.292285+0000', 'last_fullsized': '2024-06-10T00:16:20.292285+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.297906+0000', 'last_change': '2024-06-10T00:16:20.297906+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.297906+0000', 'last_undegraded': '2024-06-10T00:16:20.297906+0000', 'last_fullsized': '2024-06-10T00:16:20.297906+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.290662+0000', 'last_change': '2024-06-10T00:16:20.290662+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.290662+0000', 'last_undegraded': '2024-06-10T00:16:20.290662+0000', 'last_fullsized': '2024-06-10T00:16:20.290662+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.289043+0000', 'last_change': '2024-06-10T00:16:20.289043+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.289043+0000', 'last_undegraded': '2024-06-10T00:16:20.289043+0000', 'last_fullsized': '2024-06-10T00:16:20.289043+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.292419+0000', 'last_change': '2024-06-10T00:16:20.292419+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.292419+0000', 'last_undegraded': '2024-06-10T00:16:20.292419+0000', 'last_fullsized': '2024-06-10T00:16:20.292419+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-06-10T00:16:24.946 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.296405+0000', 'last_change': '2024-06-10T00:16:20.296405+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.296405+0000', 'last_undegraded': '2024-06-10T00:16:20.296405+0000', 'last_fullsized': '2024-06-10T00:16:20.296405+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.295580+0000', 'last_change': '2024-06-10T00:16:20.295580+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.295580+0000', 'last_undegraded': '2024-06-10T00:16:20.295580+0000', 'last_fullsized': '2024-06-10T00:16:20.295580+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.294002+0000', 'last_change': '2024-06-10T00:16:20.294002+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.294002+0000', 'last_undegraded': '2024-06-10T00:16:20.294002+0000', 'last_fullsized': '2024-06-10T00:16:20.294002+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.291900+0000', 'last_change': '2024-06-10T00:16:20.291900+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.291900+0000', 'last_undegraded': '2024-06-10T00:16:20.291900+0000', 'last_fullsized': '2024-06-10T00:16:20.291900+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.297704+0000', 'last_change': '2024-06-10T00:16:20.297704+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.297704+0000', 'last_undegraded': '2024-06-10T00:16:20.297704+0000', 'last_fullsized': '2024-06-10T00:16:20.297704+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.292777+0000', 'last_change': '2024-06-10T00:16:20.292777+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.292777+0000', 'last_undegraded': '2024-06-10T00:16:20.292777+0000', 'last_fullsized': '2024-06-10T00:16:20.292777+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-06-10T00:16:24.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.291477+0000', 'last_change': '2024-06-10T00:16:20.291477+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.291477+0000', 'last_undegraded': '2024-06-10T00:16:20.291477+0000', 'last_fullsized': '2024-06-10T00:16:20.291477+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.295384+0000', 'last_change': '2024-06-10T00:16:20.295384+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.295384+0000', 'last_undegraded': '2024-06-10T00:16:20.295384+0000', 'last_fullsized': '2024-06-10T00:16:20.295384+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.290636+0000', 'last_change': '2024-06-10T00:16:20.290636+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.290636+0000', 'last_undegraded': '2024-06-10T00:16:20.290636+0000', 'last_fullsized': '2024-06-10T00:16:20.290636+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.291199+0000', 'last_change': '2024-06-10T00:16:20.291199+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.291199+0000', 'last_undegraded': '2024-06-10T00:16:20.291199+0000', 'last_fullsized': '2024-06-10T00:16:20.291199+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.301114+0000', 'last_change': '2024-06-10T00:16:20.301114+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.301114+0000', 'last_undegraded': '2024-06-10T00:16:20.301114+0000', 'last_fullsized': '2024-06-10T00:16:20.301114+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.291494+0000', 'last_change': '2024-06-10T00:16:20.291494+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.291494+0000', 'last_undegraded': '2024-06-10T00:16:20.291494+0000', 'last_fullsized': '2024-06-10T00:16:20.291494+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-06-10T00:16:24.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.297279+0000', 'last_change': '2024-06-10T00:16:20.297279+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.297279+0000', 'last_undegraded': '2024-06-10T00:16:20.297279+0000', 'last_fullsized': '2024-06-10T00:16:20.297279+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.294476+0000', 'last_change': '2024-06-10T00:16:20.294476+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.294476+0000', 'last_undegraded': '2024-06-10T00:16:20.294476+0000', 'last_fullsized': '2024-06-10T00:16:20.294476+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.296057+0000', 'last_change': '2024-06-10T00:16:20.296057+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.296057+0000', 'last_undegraded': '2024-06-10T00:16:20.296057+0000', 'last_fullsized': '2024-06-10T00:16:20.296057+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.293602+0000', 'last_change': '2024-06-10T00:16:20.293602+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.293602+0000', 'last_undegraded': '2024-06-10T00:16:20.293602+0000', 'last_fullsized': '2024-06-10T00:16:20.293602+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.296488+0000', 'last_change': '2024-06-10T00:16:20.296488+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.296488+0000', 'last_undegraded': '2024-06-10T00:16:20.296488+0000', 'last_fullsized': '2024-06-10T00:16:20.296488+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.294763+0000', 'last_change': '2024-06-10T00:16:20.294763+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.294763+0000', 'last_undegraded': '2024-06-10T00:16:20.294763+0000', 'last_fullsized': '2024-06-10T00:16:20.294763+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-06-10T00:16:24.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.300280+0000', 'last_change': '2024-06-10T00:16:20.300280+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.300280+0000', 'last_undegraded': '2024-06-10T00:16:20.300280+0000', 'last_fullsized': '2024-06-10T00:16:20.300280+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.295052+0000', 'last_change': '2024-06-10T00:16:20.295052+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.295052+0000', 'last_undegraded': '2024-06-10T00:16:20.295052+0000', 'last_fullsized': '2024-06-10T00:16:20.295052+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.291206+0000', 'last_change': '2024-06-10T00:16:20.291206+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.291206+0000', 'last_undegraded': '2024-06-10T00:16:20.291206+0000', 'last_fullsized': '2024-06-10T00:16:20.291206+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.294087+0000', 'last_change': '2024-06-10T00:16:20.294087+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.294087+0000', 'last_undegraded': '2024-06-10T00:16:20.294087+0000', 'last_fullsized': '2024-06-10T00:16:20.294087+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.296088+0000', 'last_change': '2024-06-10T00:16:20.296088+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.296088+0000', 'last_undegraded': '2024-06-10T00:16:20.296088+0000', 'last_fullsized': '2024-06-10T00:16:20.296088+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-06-10T00:16:24.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.290938+0000', 'last_change': '2024-06-10T00:16:20.290938+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.290938+0000', 'last_undegraded': '2024-06-10T00:16:20.290938+0000', 'last_fullsized': '2024-06-10T00:16:20.290938+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.296046+0000', 'last_change': '2024-06-10T00:16:20.296046+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.296046+0000', 'last_undegraded': '2024-06-10T00:16:20.296046+0000', 'last_fullsized': '2024-06-10T00:16:20.296046+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.288285+0000', 'last_change': '2024-06-10T00:16:20.288285+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.288285+0000', 'last_undegraded': '2024-06-10T00:16:20.288285+0000', 'last_fullsized': '2024-06-10T00:16:20.288285+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.290545+0000', 'last_change': '2024-06-10T00:16:20.290545+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.290545+0000', 'last_undegraded': '2024-06-10T00:16:20.290545+0000', 'last_fullsized': '2024-06-10T00:16:20.290545+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.287546+0000', 'last_change': '2024-06-10T00:16:20.287546+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.287546+0000', 'last_undegraded': '2024-06-10T00:16:20.287546+0000', 'last_fullsized': '2024-06-10T00:16:20.287546+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.296035+0000', 'last_change': '2024-06-10T00:16:20.296035+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.296035+0000', 'last_undegraded': '2024-06-10T00:16:20.296035+0000', 'last_fullsized': '2024-06-10T00:16:20.296035+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:16:24.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.294200+0000', 'last_change': '2024-06-10T00:16:20.294200+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.294200+0000', 'last_undegraded': '2024-06-10T00:16:20.294200+0000', 'last_fullsized': '2024-06-10T00:16:20.294200+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.289108+0000', 'last_change': '2024-06-10T00:16:20.289108+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.289108+0000', 'last_undegraded': '2024-06-10T00:16:20.289108+0000', 'last_fullsized': '2024-06-10T00:16:20.289108+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.291706+0000', 'last_change': '2024-06-10T00:16:20.291706+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.291706+0000', 'last_undegraded': '2024-06-10T00:16:20.291706+0000', 'last_fullsized': '2024-06-10T00:16:20.291706+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.292961+0000', 'last_change': '2024-06-10T00:16:20.292961+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.292961+0000', 'last_undegraded': '2024-06-10T00:16:20.292961+0000', 'last_fullsized': '2024-06-10T00:16:20.292961+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.291642+0000', 'last_change': '2024-06-10T00:16:20.291642+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.291642+0000', 'last_undegraded': '2024-06-10T00:16:20.291642+0000', 'last_fullsized': '2024-06-10T00:16:20.291642+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-06-10T00:16:24.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.288041+0000', 'last_change': '2024-06-10T00:16:20.288041+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.288041+0000', 'last_undegraded': '2024-06-10T00:16:20.288041+0000', 'last_fullsized': '2024-06-10T00:16:20.288041+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.288797+0000', 'last_change': '2024-06-10T00:16:20.288797+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.288797+0000', 'last_undegraded': '2024-06-10T00:16:20.288797+0000', 'last_fullsized': '2024-06-10T00:16:20.288797+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.295043+0000', 'last_change': '2024-06-10T00:16:20.295043+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.295043+0000', 'last_undegraded': '2024-06-10T00:16:20.295043+0000', 'last_fullsized': '2024-06-10T00:16:20.295043+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.288604+0000', 'last_change': '2024-06-10T00:16:20.288604+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.288604+0000', 'last_undegraded': '2024-06-10T00:16:20.288604+0000', 'last_fullsized': '2024-06-10T00:16:20.288604+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.288417+0000', 'last_change': '2024-06-10T00:16:20.288417+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.288417+0000', 'last_undegraded': '2024-06-10T00:16:20.288417+0000', 'last_fullsized': '2024-06-10T00:16:20.288417+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.296898+0000', 'last_change': '2024-06-10T00:16:20.296898+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.296898+0000', 'last_undegraded': '2024-06-10T00:16:20.296898+0000', 'last_fullsized': '2024-06-10T00:16:20.296898+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.293832+0000', 'last_change': '2024-06-10T00:16:20.293832+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.293832+0000', 'last_undegraded': '2024-06-10T00:16:20.293832+0000', 'last_fullsized': '2024-06-10T00:16:20.293832+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.301475+0000', 'last_change': '2024-06-10T00:16:20.301475+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.301475+0000', 'last_undegraded': '2024-06-10T00:16:20.301475+0000', 'last_fullsized': '2024-06-10T00:16:20.301475+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.292316+0000', 'last_change': '2024-06-10T00:16:20.292316+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.292316+0000', 'last_undegraded': '2024-06-10T00:16:20.292316+0000', 'last_fullsized': '2024-06-10T00:16:20.292316+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.290965+0000', 'last_change': '2024-06-10T00:16:20.290965+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.290965+0000', 'last_undegraded': '2024-06-10T00:16:20.290965+0000', 'last_fullsized': '2024-06-10T00:16:20.290965+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.289029+0000', 'last_change': '2024-06-10T00:16:20.289029+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.289029+0000', 'last_undegraded': '2024-06-10T00:16:20.289029+0000', 'last_fullsized': '2024-06-10T00:16:20.289029+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-06-10T00:16:24.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.290675+0000', 'last_change': '2024-06-10T00:16:20.290675+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.290675+0000', 'last_undegraded': '2024-06-10T00:16:20.290675+0000', 'last_fullsized': '2024-06-10T00:16:20.290675+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.287883+0000', 'last_change': '2024-06-10T00:16:20.287883+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.287883+0000', 'last_undegraded': '2024-06-10T00:16:20.287883+0000', 'last_fullsized': '2024-06-10T00:16:20.287883+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.295762+0000', 'last_change': '2024-06-10T00:16:20.295762+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.295762+0000', 'last_undegraded': '2024-06-10T00:16:20.295762+0000', 'last_fullsized': '2024-06-10T00:16:20.295762+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.298291+0000', 'last_change': '2024-06-10T00:16:20.298291+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.298291+0000', 'last_undegraded': '2024-06-10T00:16:20.298291+0000', 'last_fullsized': '2024-06-10T00:16:20.298291+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.290661+0000', 'last_change': '2024-06-10T00:16:20.290661+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.290661+0000', 'last_undegraded': '2024-06-10T00:16:20.290661+0000', 'last_fullsized': '2024-06-10T00:16:20.290661+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.287760+0000', 'last_change': '2024-06-10T00:16:20.287760+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.287760+0000', 'last_undegraded': '2024-06-10T00:16:20.287760+0000', 'last_fullsized': '2024-06-10T00:16:20.287760+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-06-10T00:16:24.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.291176+0000', 'last_change': '2024-06-10T00:16:20.291176+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.291176+0000', 'last_undegraded': '2024-06-10T00:16:20.291176+0000', 'last_fullsized': '2024-06-10T00:16:20.291176+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.293824+0000', 'last_change': '2024-06-10T00:16:20.293824+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.293824+0000', 'last_undegraded': '2024-06-10T00:16:20.293824+0000', 'last_fullsized': '2024-06-10T00:16:20.293824+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.294993+0000', 'last_change': '2024-06-10T00:16:20.294993+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.294993+0000', 'last_undegraded': '2024-06-10T00:16:20.294993+0000', 'last_fullsized': '2024-06-10T00:16:20.294993+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.288151+0000', 'last_change': '2024-06-10T00:16:20.288151+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.288151+0000', 'last_undegraded': '2024-06-10T00:16:20.288151+0000', 'last_fullsized': '2024-06-10T00:16:20.288151+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.299579+0000', 'last_change': '2024-06-10T00:16:20.299579+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.299579+0000', 'last_undegraded': '2024-06-10T00:16:20.299579+0000', 'last_fullsized': '2024-06-10T00:16:20.299579+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-06-10T00:16:24.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.292999+0000', 'last_change': '2024-06-10T00:16:20.292999+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.292999+0000', 'last_undegraded': '2024-06-10T00:16:20.292999+0000', 'last_fullsized': '2024-06-10T00:16:20.292999+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:16:24.957 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-06-10T00:16:24.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:16:20.293270+0000', 'last_change': '2024-06-10T00:16:20.293270+0000', 'last_active': '2024-06-10T00:16:20.281856+0000', 'last_peered': '2024-06-10T00:16:20.281856+0000', 'last_clean': '2024-06-10T00:16:20.281856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:16:20.293270+0000', 'last_undegraded': '2024-06-10T00:16:20.293270+0000', 'last_fullsized': '2024-06-10T00:16:20.293270+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'last_clean_scrub_stamp': '2024-06-10T00:16:20.281856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:16:24.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-10T00:16:25.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.081+0000 7efc66e6d640 1 Processor -- start 2024-06-10T00:16:25.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.081+0000 7efc66e6d640 1 -- start start 2024-06-10T00:16:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc66e6d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efc601553c0 0x7efc600cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc66e6d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc600b2cf0 0x7efc6015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc66e6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 0x7efc600cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc66e6d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efc600b31a0 con 0x7efc600b2cf0 2024-06-10T00:16:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc66e6d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efc6015c3f0 con 0x7efc601553c0 2024-06-10T00:16:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc66e6d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efc600b3420 con 0x7efc600cec50 2024-06-10T00:16:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc5ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc600b2cf0 0x7efc6015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc5ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc600b2cf0 0x7efc6015beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49254/0 (socket says 172.21.15.79:49254) 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc5ffff640 1 -- 172.21.15.79:0/1925021078 learned_addr learned my addr 172.21.15.79:0/1925021078 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc6540a640 1 --2- 172.21.15.79:0/1925021078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 0x7efc600cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.082+0000 7efc64c09640 1 --2- 172.21.15.79:0/1925021078 >> v2:172.21.15.117:3300/0 conn(0x7efc601553c0 0x7efc600cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5ffff640 1 -- 172.21.15.79:0/1925021078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 msgr2=0x7efc600cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5ffff640 1 --2- 172.21.15.79:0/1925021078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 0x7efc600cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5ffff640 1 -- 172.21.15.79:0/1925021078 >> v2:172.21.15.117:3300/0 conn(0x7efc601553c0 msgr2=0x7efc600cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5ffff640 1 --2- 172.21.15.79:0/1925021078 >> v2:172.21.15.117:3300/0 conn(0x7efc601553c0 0x7efc600cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5ffff640 1 -- 172.21.15.79:0/1925021078 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc600cc750 con 0x7efc600b2cf0 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5ffff640 1 --2- 172.21.15.79:0/1925021078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600b2cf0 0x7efc6015beb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efc600cd990 tx=0x7efc5402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ff05f063c31b85 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5f7fe640 1 -- 172.21.15.79:0/1925021078 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54032790 con 0x7efc600b2cf0 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5f7fe640 1 -- 172.21.15.79:0/1925021078 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc54038070 con 0x7efc600b2cf0 2024-06-10T00:16:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.083+0000 7efc5f7fe640 1 -- 172.21.15.79:0/1925021078 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54032b50 con 0x7efc600b2cf0 2024-06-10T00:16:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 -- 172.21.15.79:0/1925021078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600b2cf0 msgr2=0x7efc6015beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 --2- 172.21.15.79:0/1925021078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600b2cf0 0x7efc6015beb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efc600cd990 tx=0x7efc5402c890 comp rx=0 tx=0).stop 2024-06-10T00:16:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 -- 172.21.15.79:0/1925021078 shutdown_connections 2024-06-10T00:16:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 --2- 172.21.15.79:0/1925021078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 0x7efc600cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 --2- 172.21.15.79:0/1925021078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600b2cf0 0x7efc6015beb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 --2- 172.21.15.79:0/1925021078 >> v2:172.21.15.117:3300/0 conn(0x7efc601553c0 0x7efc600cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 -- 172.21.15.79:0/1925021078 >> 172.21.15.79:0/1925021078 conn(0x7efc600b19f0 msgr2=0x7efc600b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 -- 172.21.15.79:0/1925021078 shutdown_connections 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.084+0000 7efc66e6d640 1 -- 172.21.15.79:0/1925021078 wait complete. 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.085+0000 7efc66e6d640 1 Processor -- start 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.085+0000 7efc66e6d640 1 -- start start 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc66e6d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc600b2cf0 0x7efc6009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc66e6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 0x7efc600cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc66e6d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc601553c0 0x7efc60150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc66e6d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efc600b3700 con 0x7efc601553c0 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc66e6d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc600ccd10 con 0x7efc600b2cf0 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc66e6d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efc601557a0 con 0x7efc600cec50 2024-06-10T00:16:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc6540a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc601553c0 0x7efc60150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc6540a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc601553c0 0x7efc60150b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49260/0 (socket says 172.21.15.79:49260) 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc6540a640 1 -- 172.21.15.79:0/4202379109 learned_addr learned my addr 172.21.15.79:0/4202379109 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc64c09640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc600b2cf0 0x7efc6009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc5ffff640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 0x7efc600cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc6540a640 1 -- 172.21.15.79:0/4202379109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 msgr2=0x7efc600cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.086+0000 7efc6540a640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 0x7efc600cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc6540a640 1 -- 172.21.15.79:0/4202379109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc600b2cf0 msgr2=0x7efc6009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc6540a640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc600b2cf0 0x7efc6009aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc6540a640 1 -- 172.21.15.79:0/4202379109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6015c610 con 0x7efc601553c0 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc6540a640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc601553c0 0x7efc60150b20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efc58007e60 tx=0x7efc5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc5d7fa640 1 -- 172.21.15.79:0/4202379109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58014620 con 0x7efc601553c0 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc5d7fa640 1 -- 172.21.15.79:0/4202379109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc58019070 con 0x7efc601553c0 2024-06-10T00:16:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6015c8b0 con 0x7efc601553c0 2024-06-10T00:16:25.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc5d7fa640 1 -- 172.21.15.79:0/4202379109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58014a20 con 0x7efc601553c0 2024-06-10T00:16:25.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.087+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6015ce70 con 0x7efc601553c0 2024-06-10T00:16:25.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.088+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc60068430 con 0x7efc601553c0 2024-06-10T00:16:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.088+0000 7efc5d7fa640 1 -- 172.21.15.79:0/4202379109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc58014bc0 con 0x7efc601553c0 2024-06-10T00:16:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.089+0000 7efc5d7fa640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efc4c06be30 0x7efc4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.089+0000 7efc5d7fa640 1 -- 172.21.15.79:0/4202379109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7efc5808b640 con 0x7efc601553c0 2024-06-10T00:16:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.089+0000 7efc64c09640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efc4c06be30 0x7efc4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.089+0000 7efc64c09640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efc4c06be30 0x7efc4c06e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efc500079a0 tx=0x7efc50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:25.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.093+0000 7efc5d7fa640 1 -- 172.21.15.79:0/4202379109 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efc580598a0 con 0x7efc601553c0 2024-06-10T00:16:25.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.335+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7efc60075430 con 0x7efc601553c0 2024-06-10T00:16:25.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.336+0000 7efc5d7fa640 1 -- 172.21.15.79:0/4202379109 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1582 (secure 0 0 0) 0x7efc5805dba0 con 0x7efc601553c0 2024-06-10T00:16:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":126,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1717978470,"num_in_osds":8,"osd_in_since":1717978461,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":227110912,"bytes_avail":772867002368,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":22,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5394}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-06-10T00:15:33.157089+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efc4c06be30 msgr2=0x7efc4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efc4c06be30 0x7efc4c06e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efc500079a0 tx=0x7efc50008040 comp rx=0 tx=0).stop 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc601553c0 msgr2=0x7efc60150b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc601553c0 0x7efc60150b20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efc58007e60 tx=0x7efc5800e4b0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 shutdown_connections 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efc4c06be30 0x7efc4c06e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc601553c0 0x7efc60150b20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc600cec50 0x7efc600cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 --2- 172.21.15.79:0/4202379109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc600b2cf0 0x7efc6009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 >> 172.21.15.79:0/4202379109 conn(0x7efc600b19f0 msgr2=0x7efc60153510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 shutdown_connections 2024-06-10T00:16:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.338+0000 7efc66e6d640 1 -- 172.21.15.79:0/4202379109 wait complete. 2024-06-10T00:16:25.348 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-10T00:16:25.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:16:25.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.448+0000 7fc403d53640 1 Processor -- start 2024-06-10T00:16:25.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.448+0000 7fc403d53640 1 -- start start 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc403d53640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc3fc0ae910 0x7fc3fc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc403d53640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc06d130 con 0x7fc3fc0cf360 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc403d53640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc06d410 con 0x7fc3fc06ea20 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc403d53640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc3fc06ee90 con 0x7fc3fc0ae910 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc4022f0640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc3fc0cf360 0x7fc3fc0acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51020/0 (socket says 172.21.15.79:51020) 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc4022f0640 1 -- 172.21.15.79:0/831197409 learned_addr learned my addr 172.21.15.79:0/831197409 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc401aef640 1 --2- 172.21.15.79:0/831197409 >> v2:172.21.15.117:3300/0 conn(0x7fc3fc0ae910 0x7fc3fc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028916540 0 0) 0x7fc3fc06d130 con 0x7fc3fc0cf360 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e8003520 con 0x7fc3fc0cf360 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2677370684 0 0) 0x7fc3e8003520 con 0x7fc3fc0cf360 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 >> v2:172.21.15.117:3300/0 conn(0x7fc3fc0ae910 msgr2=0x7fc3fc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 --2- 172.21.15.79:0/831197409 >> v2:172.21.15.117:3300/0 conn(0x7fc3fc0ae910 0x7fc3fc06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 >> v1:172.21.15.117:6789/0 conn(0x7fc3fc06ea20 legacy=0x7fc3fc0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc06d6f0 con 0x7fc3fc0cf360 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fc3f40019f0 con 0x7fc3fc0cf360 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 >> v1:172.21.15.79:6789/0 conn(0x7fc3fc0cf360 legacy=0x7fc3fc0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e80039b0 0x7fc3e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3e8004800 0x7fc3e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80051c0 0x7fc3e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc06ee90 con 0x7fc3e80039b0 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e800c160 con 0x7fc3e8004800 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.449+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e800c360 con 0x7fc3e80051c0 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc401aef640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e80039b0 0x7fc3e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc4012ee640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3e8004800 0x7fc3e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc4022f0640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80051c0 0x7fc3e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc401aef640 1 -- 172.21.15.79:0/831197409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80051c0 msgr2=0x7fc3e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc401aef640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80051c0 0x7fc3e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc401aef640 1 -- 172.21.15.79:0/831197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3e8004800 msgr2=0x7fc3e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc401aef640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3e8004800 0x7fc3e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc401aef640 1 -- 172.21.15.79:0/831197409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e8003520 con 0x7fc3e80039b0 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc4022f0640 1 -- 172.21.15.79:0/831197409 reap_dead start 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.450+0000 7fc401aef640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e80039b0 0x7fc3e8003dd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009ac0 tx=0x7fc3e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34286c47c31c74c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8036070 con 0x7fc3e80039b0 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f8031400 con 0x7fc3e80039b0 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc400aed640 1 -- 172.21.15.79:0/831197409 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8009690 con 0x7fc3e80039b0 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc403d53640 1 -- 172.21.15.79:0/831197409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e80039b0 msgr2=0x7fc3e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc403d53640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e80039b0 0x7fc3e8003dd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009ac0 tx=0x7fc3e8005830 comp rx=0 tx=0).stop 2024-06-10T00:16:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc403d53640 1 -- 172.21.15.79:0/831197409 shutdown_connections 2024-06-10T00:16:25.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc403d53640 1 --2- 172.21.15.79:0/831197409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3e80039b0 0x7fc3e8003dd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc403d53640 1 -- 172.21.15.79:0/831197409 >> 172.21.15.79:0/831197409 conn(0x7fc3fc0b19f0 msgr2=0x7fc3fc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:25.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc403d53640 1 -- 172.21.15.79:0/831197409 shutdown_connections 2024-06-10T00:16:25.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.451+0000 7fc403d53640 1 -- 172.21.15.79:0/831197409 wait complete. 2024-06-10T00:16:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.452+0000 7fc403d53640 1 Processor -- start 2024-06-10T00:16:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.452+0000 7fc403d53640 1 -- start start 2024-06-10T00:16:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc403d53640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80039b0 0x7fc3fc151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc403d53640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3fc0c6810 0x7fc3fc0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc403d53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3fc0c8320 0x7fc3fc0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc403d53640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc06e4e0 con 0x7fc3fc0c8320 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc403d53640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc0aecf0 con 0x7fc3fc0c6810 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc403d53640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc06e660 con 0x7fc3e80039b0 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4022f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3fc0c8320 0x7fc3fc0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4022f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3fc0c8320 0x7fc3fc0c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49270/0 (socket says 172.21.15.79:49270) 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4022f0640 1 -- 172.21.15.79:0/2651442040 learned_addr learned my addr 172.21.15.79:0/2651442040 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc401aef640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80039b0 0x7fc3fc151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4012ee640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3fc0c6810 0x7fc3fc0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4022f0640 1 -- 172.21.15.79:0/2651442040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80039b0 msgr2=0x7fc3fc151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4022f0640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80039b0 0x7fc3fc151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4022f0640 1 -- 172.21.15.79:0/2651442040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3fc0c6810 msgr2=0x7fc3fc0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4022f0640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3fc0c6810 0x7fc3fc0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.453+0000 7fc4022f0640 1 -- 172.21.15.79:0/2651442040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc0c6d40 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.454+0000 7fc4022f0640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3fc0c8320 0x7fc3fc0c87d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc15ea10 tx=0x7fc3f400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.454+0000 7fc3f27fc640 1 -- 172.21.15.79:0/2651442040 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400eb30 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.454+0000 7fc3f27fc640 1 -- 172.21.15.79:0/2651442040 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f4018070 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.454+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc0c7020 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.454+0000 7fc3f27fc640 1 -- 172.21.15.79:0/2651442040 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4013420 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.454+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc0c75e0 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.455+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc068430 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.455+0000 7fc3f27fc640 1 -- 172.21.15.79:0/2651442040 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3f40135c0 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.456+0000 7fc3f27fc640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc3e006be30 0x7fc3e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.456+0000 7fc3f27fc640 1 -- 172.21.15.79:0/2651442040 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fc3f408b240 con 0x7fc3fc0c8320 2024-06-10T00:16:25.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.456+0000 7fc401aef640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc3e006be30 0x7fc3e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:25.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.456+0000 7fc401aef640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc3e006be30 0x7fc3e006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8033000 tx=0x7fc3f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:25.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.460+0000 7fc3f27fc640 1 -- 172.21.15.79:0/2651442040 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc3f4059bb0 con 0x7fc3fc0c8320 2024-06-10T00:16:25.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.632+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3fc0ca430 con 0x7fc3e006be30 2024-06-10T00:16:25.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.637+0000 7fc3f27fc640 1 -- 172.21.15.79:0/2651442040 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246639 (secure 0 0 0) 0x7fc3fc0ca430 con 0x7fc3e006be30 2024-06-10T00:16:25.639 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:25.642 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:16:25.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc3e006be30 msgr2=0x7fc3e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc3e006be30 0x7fc3e006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8033000 tx=0x7fc3f8008030 comp rx=0 tx=0).stop 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3fc0c8320 msgr2=0x7fc3fc0c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3fc0c8320 0x7fc3fc0c87d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc15ea10 tx=0x7fc3f400e530 comp rx=0 tx=0).stop 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 shutdown_connections 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc3e006be30 0x7fc3e006e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3fc0c8320 0x7fc3fc0c87d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3fc0c6810 0x7fc3fc0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 --2- 172.21.15.79:0/2651442040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3e80039b0 0x7fc3fc151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 >> 172.21.15.79:0/2651442040 conn(0x7fc3fc0b19f0 msgr2=0x7fc3fc072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 shutdown_connections 2024-06-10T00:16:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:25.640+0000 7fc403d53640 1 -- 172.21.15.79:0/2651442040 wait complete. 2024-06-10T00:16:25.651 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-06-10T00:16:25.167687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221788,"kb_used_data":5572,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752932,"statfs":{"total":773094113280,"available":772867002368,"internally_reserved":0,"allocated":5705728,"data_stored":3155839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.885449"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292207+0000","last_change":"2024-06-10T00:16:20.292207+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292207+0000","last_undegraded":"2024-06-10T00:16:20.292207+0000","last_fullsized":"2024-06-10T00:16:20.292207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292285+0000","last_change":"2024-06-10T00:16:20.292285+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292285+0000","last_undegraded":"2024-06-10T00:16:20.292285+0000","last_fullsized":"2024-06-10T00:16:20.292285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297906+0000","last_change":"2024-06-10T00:16:20.297906+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297906+0000","last_undegraded":"2024-06-10T00:16:20.297906+0000","last_fullsized":"2024-06-10T00:16:20.297906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290662+0000","last_change":"2024-06-10T00:16:20.290662+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290662+0000","last_undegraded":"2024-06-10T00:16:20.290662+0000","last_fullsized":"2024-06-10T00:16:20.290662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289043+0000","last_change":"2024-06-10T00:16:20.289043+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289043+0000","last_undegraded":"2024-06-10T00:16:20.289043+0000","last_fullsized":"2024-06-10T00:16:20.289043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292419+0000","last_change":"2024-06-10T00:16:20.292419+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292419+0000","last_undegraded":"2024-06-10T00:16:20.292419+0000","last_fullsized":"2024-06-10T00:16:20.292419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296405+0000","last_change":"2024-06-10T00:16:20.296405+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296405+0000","last_undegraded":"2024-06-10T00:16:20.296405+0000","last_fullsized":"2024-06-10T00:16:20.296405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295580+0000","last_change":"2024-06-10T00:16:20.295580+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295580+0000","last_undegraded":"2024-06-10T00:16:20.295580+0000","last_fullsized":"2024-06-10T00:16:20.295580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294002+0000","last_change":"2024-06-10T00:16:20.294002+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294002+0000","last_undegraded":"2024-06-10T00:16:20.294002+0000","last_fullsized":"2024-06-10T00:16:20.294002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291900+0000","last_change":"2024-06-10T00:16:20.291900+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291900+0000","last_undegraded":"2024-06-10T00:16:20.291900+0000","last_fullsized":"2024-06-10T00:16:20.291900+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297704+0000","last_change":"2024-06-10T00:16:20.297704+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297704+0000","last_undegraded":"2024-06-10T00:16:20.297704+0000","last_fullsized":"2024-06-10T00:16:20.297704+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292777+0000","last_change":"2024-06-10T00:16:20.292777+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292777+0000","last_undegraded":"2024-06-10T00:16:20.292777+0000","last_fullsized":"2024-06-10T00:16:20.292777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291477+0000","last_change":"2024-06-10T00:16:20.291477+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291477+0000","last_undegraded":"2024-06-10T00:16:20.291477+0000","last_fullsized":"2024-06-10T00:16:20.291477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295384+0000","last_change":"2024-06-10T00:16:20.295384+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295384+0000","last_undegraded":"2024-06-10T00:16:20.295384+0000","last_fullsized":"2024-06-10T00:16:20.295384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290636+0000","last_change":"2024-06-10T00:16:20.290636+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290636+0000","last_undegraded":"2024-06-10T00:16:20.290636+0000","last_fullsized":"2024-06-10T00:16:20.290636+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291199+0000","last_change":"2024-06-10T00:16:20.291199+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291199+0000","last_undegraded":"2024-06-10T00:16:20.291199+0000","last_fullsized":"2024-06-10T00:16:20.291199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.301114+0000","last_change":"2024-06-10T00:16:20.301114+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.301114+0000","last_undegraded":"2024-06-10T00:16:20.301114+0000","last_fullsized":"2024-06-10T00:16:20.301114+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291494+0000","last_change":"2024-06-10T00:16:20.291494+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291494+0000","last_undegraded":"2024-06-10T00:16:20.291494+0000","last_fullsized":"2024-06-10T00:16:20.291494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.297279+0000","last_change":"2024-06-10T00:16:20.297279+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.297279+0000","last_undegraded":"2024-06-10T00:16:20.297279+0000","last_fullsized":"2024-06-10T00:16:20.297279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294476+0000","last_change":"2024-06-10T00:16:20.294476+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294476+0000","last_undegraded":"2024-06-10T00:16:20.294476+0000","last_fullsized":"2024-06-10T00:16:20.294476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296057+0000","last_change":"2024-06-10T00:16:20.296057+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296057+0000","last_undegraded":"2024-06-10T00:16:20.296057+0000","last_fullsized":"2024-06-10T00:16:20.296057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293602+0000","last_change":"2024-06-10T00:16:20.293602+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293602+0000","last_undegraded":"2024-06-10T00:16:20.293602+0000","last_fullsized":"2024-06-10T00:16:20.293602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296488+0000","last_change":"2024-06-10T00:16:20.296488+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296488+0000","last_undegraded":"2024-06-10T00:16:20.296488+0000","last_fullsized":"2024-06-10T00:16:20.296488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294763+0000","last_change":"2024-06-10T00:16:20.294763+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294763+0000","last_undegraded":"2024-06-10T00:16:20.294763+0000","last_fullsized":"2024-06-10T00:16:20.294763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.300280+0000","last_change":"2024-06-10T00:16:20.300280+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.300280+0000","last_undegraded":"2024-06-10T00:16:20.300280+0000","last_fullsized":"2024-06-10T00:16:20.300280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295052+0000","last_change":"2024-06-10T00:16:20.295052+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295052+0000","last_undegraded":"2024-06-10T00:16:20.295052+0000","last_fullsized":"2024-06-10T00:16:20.295052+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291206+0000","last_change":"2024-06-10T00:16:20.291206+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291206+0000","last_undegraded":"2024-06-10T00:16:20.291206+0000","last_fullsized":"2024-06-10T00:16:20.291206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294087+0000","last_change":"2024-06-10T00:16:20.294087+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294087+0000","last_undegraded":"2024-06-10T00:16:20.294087+0000","last_fullsized":"2024-06-10T00:16:20.294087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296088+0000","last_change":"2024-06-10T00:16:20.296088+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296088+0000","last_undegraded":"2024-06-10T00:16:20.296088+0000","last_fullsized":"2024-06-10T00:16:20.296088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290938+0000","last_change":"2024-06-10T00:16:20.290938+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290938+0000","last_undegraded":"2024-06-10T00:16:20.290938+0000","last_fullsized":"2024-06-10T00:16:20.290938+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296046+0000","last_change":"2024-06-10T00:16:20.296046+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296046+0000","last_undegraded":"2024-06-10T00:16:20.296046+0000","last_fullsized":"2024-06-10T00:16:20.296046+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288285+0000","last_change":"2024-06-10T00:16:20.288285+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288285+0000","last_undegraded":"2024-06-10T00:16:20.288285+0000","last_fullsized":"2024-06-10T00:16:20.288285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290545+0000","last_change":"2024-06-10T00:16:20.290545+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290545+0000","last_undegraded":"2024-06-10T00:16:20.290545+0000","last_fullsized":"2024-06-10T00:16:20.290545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304382+0000","last_change":"2024-06-10T00:16:20.297870+0000","last_active":"2024-06-10T00:16:20.304382+0000","last_peered":"2024-06-10T00:16:20.304382+0000","last_clean":"2024-06-10T00:16:20.304382+0000","last_became_active":"2024-06-10T00:16:20.297484+0000","last_became_peered":"2024-06-10T00:16:20.297484+0000","last_unstale":"2024-06-10T00:16:20.304382+0000","last_undegraded":"2024-06-10T00:16:20.304382+0000","last_fullsized":"2024-06-10T00:16:20.304382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:20.625301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287546+0000","last_change":"2024-06-10T00:16:20.287546+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287546+0000","last_undegraded":"2024-06-10T00:16:20.287546+0000","last_fullsized":"2024-06-10T00:16:20.287546+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.305239+0000","last_change":"2024-06-10T00:16:20.303002+0000","last_active":"2024-06-10T00:16:20.305239+0000","last_peered":"2024-06-10T00:16:20.305239+0000","last_clean":"2024-06-10T00:16:20.305239+0000","last_became_active":"2024-06-10T00:16:20.302738+0000","last_became_peered":"2024-06-10T00:16:20.302738+0000","last_unstale":"2024-06-10T00:16:20.305239+0000","last_undegraded":"2024-06-10T00:16:20.305239+0000","last_fullsized":"2024-06-10T00:16:20.305239+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296035+0000","last_change":"2024-06-10T00:16:20.296035+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296035+0000","last_undegraded":"2024-06-10T00:16:20.296035+0000","last_fullsized":"2024-06-10T00:16:20.296035+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.303123+0000","last_change":"2024-06-10T00:16:20.299695+0000","last_active":"2024-06-10T00:16:20.303123+0000","last_peered":"2024-06-10T00:16:20.303123+0000","last_clean":"2024-06-10T00:16:20.303123+0000","last_became_active":"2024-06-10T00:16:20.299435+0000","last_became_peered":"2024-06-10T00:16:20.299435+0000","last_unstale":"2024-06-10T00:16:20.303123+0000","last_undegraded":"2024-06-10T00:16:20.303123+0000","last_fullsized":"2024-06-10T00:16:20.303123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:33.552452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294200+0000","last_change":"2024-06-10T00:16:20.294200+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294200+0000","last_undegraded":"2024-06-10T00:16:20.294200+0000","last_fullsized":"2024-06-10T00:16:20.294200+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304851+0000","last_change":"2024-06-10T00:16:20.300555+0000","last_active":"2024-06-10T00:16:20.304851+0000","last_peered":"2024-06-10T00:16:20.304851+0000","last_clean":"2024-06-10T00:16:20.304851+0000","last_became_active":"2024-06-10T00:16:20.300241+0000","last_became_peered":"2024-06-10T00:16:20.300241+0000","last_unstale":"2024-06-10T00:16:20.304851+0000","last_undegraded":"2024-06-10T00:16:20.304851+0000","last_fullsized":"2024-06-10T00:16:20.304851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:55.681863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289108+0000","last_change":"2024-06-10T00:16:20.289108+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289108+0000","last_undegraded":"2024-06-10T00:16:20.289108+0000","last_fullsized":"2024-06-10T00:16:20.289108+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308906+0000","last_change":"2024-06-10T00:16:20.305776+0000","last_active":"2024-06-10T00:16:20.308906+0000","last_peered":"2024-06-10T00:16:20.308906+0000","last_clean":"2024-06-10T00:16:20.308906+0000","last_became_active":"2024-06-10T00:16:20.305527+0000","last_became_peered":"2024-06-10T00:16:20.305527+0000","last_unstale":"2024-06-10T00:16:20.308906+0000","last_undegraded":"2024-06-10T00:16:20.308906+0000","last_fullsized":"2024-06-10T00:16:20.308906+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:24:01.616634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291706+0000","last_change":"2024-06-10T00:16:20.291706+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291706+0000","last_undegraded":"2024-06-10T00:16:20.291706+0000","last_fullsized":"2024-06-10T00:16:20.291706+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.301501+0000","last_change":"2024-06-10T00:16:20.298240+0000","last_active":"2024-06-10T00:16:20.301501+0000","last_peered":"2024-06-10T00:16:20.301501+0000","last_clean":"2024-06-10T00:16:20.301501+0000","last_became_active":"2024-06-10T00:16:20.297962+0000","last_became_peered":"2024-06-10T00:16:20.297962+0000","last_unstale":"2024-06-10T00:16:20.301501+0000","last_undegraded":"2024-06-10T00:16:20.301501+0000","last_fullsized":"2024-06-10T00:16:20.301501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292961+0000","last_change":"2024-06-10T00:16:20.292961+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292961+0000","last_undegraded":"2024-06-10T00:16:20.292961+0000","last_fullsized":"2024-06-10T00:16:20.292961+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304440+0000","last_change":"2024-06-10T00:16:20.298791+0000","last_active":"2024-06-10T00:16:20.304440+0000","last_peered":"2024-06-10T00:16:20.304440+0000","last_clean":"2024-06-10T00:16:20.304440+0000","last_became_active":"2024-06-10T00:16:20.297457+0000","last_became_peered":"2024-06-10T00:16:20.297457+0000","last_unstale":"2024-06-10T00:16:20.304440+0000","last_undegraded":"2024-06-10T00:16:20.304440+0000","last_fullsized":"2024-06-10T00:16:20.304440+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:55.550063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291642+0000","last_change":"2024-06-10T00:16:20.291642+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291642+0000","last_undegraded":"2024-06-10T00:16:20.291642+0000","last_fullsized":"2024-06-10T00:16:20.291642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.309257+0000","last_change":"2024-06-10T00:16:20.307746+0000","last_active":"2024-06-10T00:16:20.309257+0000","last_peered":"2024-06-10T00:16:20.309257+0000","last_clean":"2024-06-10T00:16:20.309257+0000","last_became_active":"2024-06-10T00:16:20.306090+0000","last_became_peered":"2024-06-10T00:16:20.306090+0000","last_unstale":"2024-06-10T00:16:20.309257+0000","last_undegraded":"2024-06-10T00:16:20.309257+0000","last_fullsized":"2024-06-10T00:16:20.309257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:53.046468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288041+0000","last_change":"2024-06-10T00:16:20.288041+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288041+0000","last_undegraded":"2024-06-10T00:16:20.288041+0000","last_fullsized":"2024-06-10T00:16:20.288041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.299771+0000","last_change":"2024-06-10T00:16:20.297128+0000","last_active":"2024-06-10T00:16:20.299771+0000","last_peered":"2024-06-10T00:16:20.299771+0000","last_clean":"2024-06-10T00:16:20.299771+0000","last_became_active":"2024-06-10T00:16:20.296839+0000","last_became_peered":"2024-06-10T00:16:20.296839+0000","last_unstale":"2024-06-10T00:16:20.299771+0000","last_undegraded":"2024-06-10T00:16:20.299771+0000","last_fullsized":"2024-06-10T00:16:20.299771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288797+0000","last_change":"2024-06-10T00:16:20.288797+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288797+0000","last_undegraded":"2024-06-10T00:16:20.288797+0000","last_fullsized":"2024-06-10T00:16:20.288797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312825+0000","last_change":"2024-06-10T00:16:20.309837+0000","last_active":"2024-06-10T00:16:20.312825+0000","last_peered":"2024-06-10T00:16:20.312825+0000","last_clean":"2024-06-10T00:16:20.312825+0000","last_became_active":"2024-06-10T00:16:20.309531+0000","last_became_peered":"2024-06-10T00:16:20.309531+0000","last_unstale":"2024-06-10T00:16:20.312825+0000","last_undegraded":"2024-06-10T00:16:20.312825+0000","last_fullsized":"2024-06-10T00:16:20.312825+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295043+0000","last_change":"2024-06-10T00:16:20.295043+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295043+0000","last_undegraded":"2024-06-10T00:16:20.295043+0000","last_fullsized":"2024-06-10T00:16:20.295043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304676+0000","last_change":"2024-06-10T00:16:20.300508+0000","last_active":"2024-06-10T00:16:20.304676+0000","last_peered":"2024-06-10T00:16:20.304676+0000","last_clean":"2024-06-10T00:16:20.304676+0000","last_became_active":"2024-06-10T00:16:20.300209+0000","last_became_peered":"2024-06-10T00:16:20.300209+0000","last_unstale":"2024-06-10T00:16:20.304676+0000","last_undegraded":"2024-06-10T00:16:20.304676+0000","last_fullsized":"2024-06-10T00:16:20.304676+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:01:40.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288604+0000","last_change":"2024-06-10T00:16:20.288604+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288604+0000","last_undegraded":"2024-06-10T00:16:20.288604+0000","last_fullsized":"2024-06-10T00:16:20.288604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306552+0000","last_change":"2024-06-10T00:16:20.304014+0000","last_active":"2024-06-10T00:16:20.306552+0000","last_peered":"2024-06-10T00:16:20.306552+0000","last_clean":"2024-06-10T00:16:20.306552+0000","last_became_active":"2024-06-10T00:16:20.303743+0000","last_became_peered":"2024-06-10T00:16:20.303743+0000","last_unstale":"2024-06-10T00:16:20.306552+0000","last_undegraded":"2024-06-10T00:16:20.306552+0000","last_fullsized":"2024-06-10T00:16:20.306552+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:15:50.724605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288417+0000","last_change":"2024-06-10T00:16:20.288417+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288417+0000","last_undegraded":"2024-06-10T00:16:20.288417+0000","last_fullsized":"2024-06-10T00:16:20.288417+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308734+0000","last_change":"2024-06-10T00:16:20.304457+0000","last_active":"2024-06-10T00:16:20.308734+0000","last_peered":"2024-06-10T00:16:20.308734+0000","last_clean":"2024-06-10T00:16:20.308734+0000","last_became_active":"2024-06-10T00:16:20.302179+0000","last_became_peered":"2024-06-10T00:16:20.302179+0000","last_unstale":"2024-06-10T00:16:20.308734+0000","last_undegraded":"2024-06-10T00:16:20.308734+0000","last_fullsized":"2024-06-10T00:16:20.308734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.296898+0000","last_change":"2024-06-10T00:16:20.296898+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.296898+0000","last_undegraded":"2024-06-10T00:16:20.296898+0000","last_fullsized":"2024-06-10T00:16:20.296898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312781+0000","last_change":"2024-06-10T00:16:20.309057+0000","last_active":"2024-06-10T00:16:20.312781+0000","last_peered":"2024-06-10T00:16:20.312781+0000","last_clean":"2024-06-10T00:16:20.312781+0000","last_became_active":"2024-06-10T00:16:20.308794+0000","last_became_peered":"2024-06-10T00:16:20.308794+0000","last_unstale":"2024-06-10T00:16:20.312781+0000","last_undegraded":"2024-06-10T00:16:20.312781+0000","last_fullsized":"2024-06-10T00:16:20.312781+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:31:45.450011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293832+0000","last_change":"2024-06-10T00:16:20.293832+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293832+0000","last_undegraded":"2024-06-10T00:16:20.293832+0000","last_fullsized":"2024-06-10T00:16:20.293832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.301803+0000","last_change":"2024-06-10T00:16:20.299284+0000","last_active":"2024-06-10T00:16:20.301803+0000","last_peered":"2024-06-10T00:16:20.301803+0000","last_clean":"2024-06-10T00:16:20.301803+0000","last_became_active":"2024-06-10T00:16:20.298987+0000","last_became_peered":"2024-06-10T00:16:20.298987+0000","last_unstale":"2024-06-10T00:16:20.301803+0000","last_undegraded":"2024-06-10T00:16:20.301803+0000","last_fullsized":"2024-06-10T00:16:20.301803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:35:29.547234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.301475+0000","last_change":"2024-06-10T00:16:20.301475+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.301475+0000","last_undegraded":"2024-06-10T00:16:20.301475+0000","last_fullsized":"2024-06-10T00:16:20.301475+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306014+0000","last_change":"2024-06-10T00:16:20.303655+0000","last_active":"2024-06-10T00:16:20.306014+0000","last_peered":"2024-06-10T00:16:20.306014+0000","last_clean":"2024-06-10T00:16:20.306014+0000","last_became_active":"2024-06-10T00:16:20.303386+0000","last_became_peered":"2024-06-10T00:16:20.303386+0000","last_unstale":"2024-06-10T00:16:20.306014+0000","last_undegraded":"2024-06-10T00:16:20.306014+0000","last_fullsized":"2024-06-10T00:16:20.306014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:55.681863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292316+0000","last_change":"2024-06-10T00:16:20.292316+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292316+0000","last_undegraded":"2024-06-10T00:16:20.292316+0000","last_fullsized":"2024-06-10T00:16:20.292316+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.310617+0000","last_change":"2024-06-10T00:16:20.309531+0000","last_active":"2024-06-10T00:16:20.310617+0000","last_peered":"2024-06-10T00:16:20.310617+0000","last_clean":"2024-06-10T00:16:20.310617+0000","last_became_active":"2024-06-10T00:16:20.309223+0000","last_became_peered":"2024-06-10T00:16:20.309223+0000","last_unstale":"2024-06-10T00:16:20.310617+0000","last_undegraded":"2024-06-10T00:16:20.310617+0000","last_fullsized":"2024-06-10T00:16:20.310617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290965+0000","last_change":"2024-06-10T00:16:20.290965+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290965+0000","last_undegraded":"2024-06-10T00:16:20.290965+0000","last_fullsized":"2024-06-10T00:16:20.290965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.307178+0000","last_change":"2024-06-10T00:16:20.305785+0000","last_active":"2024-06-10T00:16:20.307178+0000","last_peered":"2024-06-10T00:16:20.307178+0000","last_clean":"2024-06-10T00:16:20.307178+0000","last_became_active":"2024-06-10T00:16:20.305483+0000","last_became_peered":"2024-06-10T00:16:20.305483+0000","last_unstale":"2024-06-10T00:16:20.307178+0000","last_undegraded":"2024-06-10T00:16:20.307178+0000","last_fullsized":"2024-06-10T00:16:20.307178+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:17.213749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.289029+0000","last_change":"2024-06-10T00:16:20.289029+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.289029+0000","last_undegraded":"2024-06-10T00:16:20.289029+0000","last_fullsized":"2024-06-10T00:16:20.289029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304736+0000","last_change":"2024-06-10T00:16:20.300901+0000","last_active":"2024-06-10T00:16:20.304736+0000","last_peered":"2024-06-10T00:16:20.304736+0000","last_clean":"2024-06-10T00:16:20.304736+0000","last_became_active":"2024-06-10T00:16:20.300594+0000","last_became_peered":"2024-06-10T00:16:20.300594+0000","last_unstale":"2024-06-10T00:16:20.304736+0000","last_undegraded":"2024-06-10T00:16:20.304736+0000","last_fullsized":"2024-06-10T00:16:20.304736+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:56.536723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290675+0000","last_change":"2024-06-10T00:16:20.290675+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290675+0000","last_undegraded":"2024-06-10T00:16:20.290675+0000","last_fullsized":"2024-06-10T00:16:20.290675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.309934+0000","last_change":"2024-06-10T00:16:20.305387+0000","last_active":"2024-06-10T00:16:20.309934+0000","last_peered":"2024-06-10T00:16:20.309934+0000","last_clean":"2024-06-10T00:16:20.309934+0000","last_became_active":"2024-06-10T00:16:20.305118+0000","last_became_peered":"2024-06-10T00:16:20.305118+0000","last_unstale":"2024-06-10T00:16:20.309934+0000","last_undegraded":"2024-06-10T00:16:20.309934+0000","last_fullsized":"2024-06-10T00:16:20.309934+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:33.552452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287883+0000","last_change":"2024-06-10T00:16:20.287883+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287883+0000","last_undegraded":"2024-06-10T00:16:20.287883+0000","last_fullsized":"2024-06-10T00:16:20.287883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.296484+0000","last_change":"2024-06-10T00:16:20.293250+0000","last_active":"2024-06-10T00:16:20.296484+0000","last_peered":"2024-06-10T00:16:20.296484+0000","last_clean":"2024-06-10T00:16:20.296484+0000","last_became_active":"2024-06-10T00:16:20.292968+0000","last_became_peered":"2024-06-10T00:16:20.292968+0000","last_unstale":"2024-06-10T00:16:20.296484+0000","last_undegraded":"2024-06-10T00:16:20.296484+0000","last_fullsized":"2024-06-10T00:16:20.296484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:07:56.536723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.295762+0000","last_change":"2024-06-10T00:16:20.295762+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.295762+0000","last_undegraded":"2024-06-10T00:16:20.295762+0000","last_fullsized":"2024-06-10T00:16:20.295762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308681+0000","last_change":"2024-06-10T00:16:20.304632+0000","last_active":"2024-06-10T00:16:20.308681+0000","last_peered":"2024-06-10T00:16:20.308681+0000","last_clean":"2024-06-10T00:16:20.308681+0000","last_became_active":"2024-06-10T00:16:20.304382+0000","last_became_peered":"2024-06-10T00:16:20.304382+0000","last_unstale":"2024-06-10T00:16:20.308681+0000","last_undegraded":"2024-06-10T00:16:20.308681+0000","last_fullsized":"2024-06-10T00:16:20.308681+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:47:25.968321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.298291+0000","last_change":"2024-06-10T00:16:20.298291+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.298291+0000","last_undegraded":"2024-06-10T00:16:20.298291+0000","last_fullsized":"2024-06-10T00:16:20.298291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308731+0000","last_change":"2024-06-10T00:16:20.305088+0000","last_active":"2024-06-10T00:16:20.308731+0000","last_peered":"2024-06-10T00:16:20.308731+0000","last_clean":"2024-06-10T00:16:20.308731+0000","last_became_active":"2024-06-10T00:16:20.304825+0000","last_became_peered":"2024-06-10T00:16:20.304825+0000","last_unstale":"2024-06-10T00:16:20.308731+0000","last_undegraded":"2024-06-10T00:16:20.308731+0000","last_fullsized":"2024-06-10T00:16:20.308731+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.290661+0000","last_change":"2024-06-10T00:16:20.290661+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.290661+0000","last_undegraded":"2024-06-10T00:16:20.290661+0000","last_fullsized":"2024-06-10T00:16:20.290661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306291+0000","last_change":"2024-06-10T00:16:20.302648+0000","last_active":"2024-06-10T00:16:20.306291+0000","last_peered":"2024-06-10T00:16:20.306291+0000","last_clean":"2024-06-10T00:16:20.306291+0000","last_became_active":"2024-06-10T00:16:20.302385+0000","last_became_peered":"2024-06-10T00:16:20.302385+0000","last_unstale":"2024-06-10T00:16:20.306291+0000","last_undegraded":"2024-06-10T00:16:20.306291+0000","last_fullsized":"2024-06-10T00:16:20.306291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:26:49.566446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.287760+0000","last_change":"2024-06-10T00:16:20.287760+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.287760+0000","last_undegraded":"2024-06-10T00:16:20.287760+0000","last_fullsized":"2024-06-10T00:16:20.287760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.312804+0000","last_change":"2024-06-10T00:16:20.309578+0000","last_active":"2024-06-10T00:16:20.312804+0000","last_peered":"2024-06-10T00:16:20.312804+0000","last_clean":"2024-06-10T00:16:20.312804+0000","last_became_active":"2024-06-10T00:16:20.309249+0000","last_became_peered":"2024-06-10T00:16:20.309249+0000","last_unstale":"2024-06-10T00:16:20.312804+0000","last_undegraded":"2024-06-10T00:16:20.312804+0000","last_fullsized":"2024-06-10T00:16:20.312804+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.291176+0000","last_change":"2024-06-10T00:16:20.291176+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.291176+0000","last_undegraded":"2024-06-10T00:16:20.291176+0000","last_fullsized":"2024-06-10T00:16:20.291176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.307316+0000","last_change":"2024-06-10T00:16:20.302054+0000","last_active":"2024-06-10T00:16:20.307316+0000","last_peered":"2024-06-10T00:16:20.307316+0000","last_clean":"2024-06-10T00:16:20.307316+0000","last_became_active":"2024-06-10T00:16:20.301779+0000","last_became_peered":"2024-06-10T00:16:20.301779+0000","last_unstale":"2024-06-10T00:16:20.307316+0000","last_undegraded":"2024-06-10T00:16:20.307316+0000","last_fullsized":"2024-06-10T00:16:20.307316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:36.042655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293824+0000","last_change":"2024-06-10T00:16:20.293824+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293824+0000","last_undegraded":"2024-06-10T00:16:20.293824+0000","last_fullsized":"2024-06-10T00:16:20.293824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.308890+0000","last_change":"2024-06-10T00:16:20.305512+0000","last_active":"2024-06-10T00:16:20.308890+0000","last_peered":"2024-06-10T00:16:20.308890+0000","last_clean":"2024-06-10T00:16:20.308890+0000","last_became_active":"2024-06-10T00:16:20.305274+0000","last_became_peered":"2024-06-10T00:16:20.305274+0000","last_unstale":"2024-06-10T00:16:20.308890+0000","last_undegraded":"2024-06-10T00:16:20.308890+0000","last_fullsized":"2024-06-10T00:16:20.308890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:32:02.814038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.294993+0000","last_change":"2024-06-10T00:16:20.294993+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.294993+0000","last_undegraded":"2024-06-10T00:16:20.294993+0000","last_fullsized":"2024-06-10T00:16:20.294993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.306539+0000","last_change":"2024-06-10T00:16:20.304106+0000","last_active":"2024-06-10T00:16:20.306539+0000","last_peered":"2024-06-10T00:16:20.306539+0000","last_clean":"2024-06-10T00:16:20.306539+0000","last_became_active":"2024-06-10T00:16:20.303755+0000","last_became_peered":"2024-06-10T00:16:20.303755+0000","last_unstale":"2024-06-10T00:16:20.306539+0000","last_undegraded":"2024-06-10T00:16:20.306539+0000","last_fullsized":"2024-06-10T00:16:20.306539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:34:57.335177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.288151+0000","last_change":"2024-06-10T00:16:20.288151+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.288151+0000","last_undegraded":"2024-06-10T00:16:20.288151+0000","last_fullsized":"2024-06-10T00:16:20.288151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.305299+0000","last_change":"2024-06-10T00:16:20.302947+0000","last_active":"2024-06-10T00:16:20.305299+0000","last_peered":"2024-06-10T00:16:20.305299+0000","last_clean":"2024-06-10T00:16:20.305299+0000","last_became_active":"2024-06-10T00:16:20.302664+0000","last_became_peered":"2024-06-10T00:16:20.302664+0000","last_unstale":"2024-06-10T00:16:20.305299+0000","last_undegraded":"2024-06-10T00:16:20.305299+0000","last_fullsized":"2024-06-10T00:16:20.305299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.299579+0000","last_change":"2024-06-10T00:16:20.299579+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.299579+0000","last_undegraded":"2024-06-10T00:16:20.299579+0000","last_fullsized":"2024-06-10T00:16:20.299579+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.304539+0000","last_change":"2024-06-10T00:16:20.301224+0000","last_active":"2024-06-10T00:16:20.304539+0000","last_peered":"2024-06-10T00:16:20.304539+0000","last_clean":"2024-06-10T00:16:20.304539+0000","last_became_active":"2024-06-10T00:16:20.300924+0000","last_became_peered":"2024-06-10T00:16:20.300924+0000","last_unstale":"2024-06-10T00:16:20.304539+0000","last_undegraded":"2024-06-10T00:16:20.304539+0000","last_fullsized":"2024-06-10T00:16:20.304539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.292999+0000","last_change":"2024-06-10T00:16:20.292999+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.292999+0000","last_undegraded":"2024-06-10T00:16:20.292999+0000","last_fullsized":"2024-06-10T00:16:20.292999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.295014+0000","last_change":"2024-06-10T00:16:20.294051+0000","last_active":"2024-06-10T00:16:20.295014+0000","last_peered":"2024-06-10T00:16:20.295014+0000","last_clean":"2024-06-10T00:16:20.295014+0000","last_became_active":"2024-06-10T00:16:20.293751+0000","last_became_peered":"2024-06-10T00:16:20.293751+0000","last_unstale":"2024-06-10T00:16:20.295014+0000","last_undegraded":"2024-06-10T00:16:20.295014+0000","last_fullsized":"2024-06-10T00:16:20.295014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-06-10T00:16:20.293270+0000","last_change":"2024-06-10T00:16:20.293270+0000","last_active":"2024-06-10T00:16:20.281856+0000","last_peered":"2024-06-10T00:16:20.281856+0000","last_clean":"2024-06-10T00:16:20.281856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:16:20.293270+0000","last_undegraded":"2024-06-10T00:16:20.293270+0000","last_fullsized":"2024-06-10T00:16:20.293270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.310282+0000","last_change":"2024-06-10T00:16:20.308999+0000","last_active":"2024-06-10T00:16:20.310282+0000","last_peered":"2024-06-10T00:16:20.310282+0000","last_clean":"2024-06-10T00:16:20.310282+0000","last_became_active":"2024-06-10T00:16:20.308679+0000","last_became_peered":"2024-06-10T00:16:20.308679+0000","last_unstale":"2024-06-10T00:16:20.310282+0000","last_undegraded":"2024-06-10T00:16:20.310282+0000","last_fullsized":"2024-06-10T00:16:20.310282+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:40.052203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":219,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-10T00:16:20.292737+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:16:20.292737+0000","last_peered":"2024-06-10T00:16:20.292737+0000","last_clean":"2024-06-10T00:16:20.292737+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:16:20.292737+0000","last_undegraded":"2024-06-10T00:16:20.292737+0000","last_fullsized":"2024-06-10T00:16:20.292737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":839756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":557056,"data_stored":242721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":249388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":839756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:16:28.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:16:28.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.768+0000 7f04ef079640 1 Processor -- start 2024-06-10T00:16:28.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.768+0000 7f04ef079640 1 -- start start 2024-06-10T00:16:28.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.769+0000 7f04ef079640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e815a870 0x7f04e806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:28.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.769+0000 7f04ef079640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04e80af3d0 0x7f04e80cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:28.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.769+0000 7f04ef079640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e806e390 con 0x7f04e80aef70 2024-06-10T00:16:28.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.769+0000 7f04ef079640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f04e815ac50 con 0x7f04e80af3d0 2024-06-10T00:16:28.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.769+0000 7f04ef079640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04e806cdb0 con 0x7f04e815a870 2024-06-10T00:16:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.769+0000 7f04ed616640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04e80af3d0 0x7f04e80cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.769+0000 7f04ed616640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04e80af3d0 0x7f04e80cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34322/0 (socket says 172.21.15.79:34322) 2024-06-10T00:16:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.769+0000 7f04ed616640 1 -- 172.21.15.79:0/3196423385 learned_addr learned my addr 172.21.15.79:0/3196423385 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.770+0000 7f04ed616640 1 -- 172.21.15.79:0/3196423385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e815a870 msgr2=0x7f04e806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.770+0000 7f04ed616640 1 --2- 172.21.15.79:0/3196423385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e815a870 0x7f04e806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.770+0000 7f04ed616640 1 -- 172.21.15.79:0/3196423385 >> v1:172.21.15.117:6789/0 conn(0x7f04e80aef70 legacy=0x7f04e80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.770+0000 7f04ed616640 1 -- 172.21.15.79:0/3196423385 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e806d090 con 0x7f04e80af3d0 2024-06-10T00:16:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.770+0000 7f04ed616640 1 --2- 172.21.15.79:0/3196423385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e80cdb40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f04e000af60 tx=0x7f04e002b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efad02ec5085a5d9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04e77fe640 1 -- 172.21.15.79:0/3196423385 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0037070 con 0x7f04e80af3d0 2024-06-10T00:16:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04e77fe640 1 -- 172.21.15.79:0/3196423385 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0008500 con 0x7f04e80af3d0 2024-06-10T00:16:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04e77fe640 1 -- 172.21.15.79:0/3196423385 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e00088d0 con 0x7f04e80af3d0 2024-06-10T00:16:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04ef079640 1 -- 172.21.15.79:0/3196423385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 msgr2=0x7f04e80cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04ef079640 1 --2- 172.21.15.79:0/3196423385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e80cdb40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f04e000af60 tx=0x7f04e002b750 comp rx=0 tx=0).stop 2024-06-10T00:16:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04ef079640 1 -- 172.21.15.79:0/3196423385 shutdown_connections 2024-06-10T00:16:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04ef079640 1 --2- 172.21.15.79:0/3196423385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e80cdb40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04ef079640 1 --2- 172.21.15.79:0/3196423385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e815a870 0x7f04e806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04ef079640 1 -- 172.21.15.79:0/3196423385 >> 172.21.15.79:0/3196423385 conn(0x7f04e80b19f0 msgr2=0x7f04e80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04ef079640 1 -- 172.21.15.79:0/3196423385 shutdown_connections 2024-06-10T00:16:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.771+0000 7f04ef079640 1 -- 172.21.15.79:0/3196423385 wait complete. 2024-06-10T00:16:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.772+0000 7f04ef079640 1 Processor -- start 2024-06-10T00:16:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.773+0000 7f04ef079640 1 -- start start 2024-06-10T00:16:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.773+0000 7f04ef079640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e80aef70 0x7f04e814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.773+0000 7f04ef079640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e81f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.773+0000 7f04ef079640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04e815a870 0x7f04e809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.773+0000 7f04ef079640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04e806d930 con 0x7f04e80af3d0 2024-06-10T00:16:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.773+0000 7f04ef079640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04e806d650 con 0x7f04e815a870 2024-06-10T00:16:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.773+0000 7f04ef079640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04e80b2e40 con 0x7f04e80aef70 2024-06-10T00:16:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.773+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e81f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e81f1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34326/0 (socket says 172.21.15.79:34326) 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e7fff640 1 -- 172.21.15.79:0/2921831699 learned_addr learned my addr 172.21.15.79:0/2921831699 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04ece15640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e80aef70 0x7f04e814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04ed616640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04e815a870 0x7f04e809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e7fff640 1 -- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e80aef70 msgr2=0x7f04e814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e7fff640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e80aef70 0x7f04e814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e7fff640 1 -- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04e815a870 msgr2=0x7f04e809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e7fff640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04e815a870 0x7f04e809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e7fff640 1 -- 172.21.15.79:0/2921831699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e814a1d0 con 0x7f04e80af3d0 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04ece15640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e80aef70 0x7f04e814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04ed616640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04e815a870 0x7f04e809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e7fff640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e81f1770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00b3f0 tx=0x7f04dc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e57fa640 1 -- 172.21.15.79:0/2921831699 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc015020 con 0x7f04e80af3d0 2024-06-10T00:16:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e57fa640 1 -- 172.21.15.79:0/2921831699 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04dc011830 con 0x7f04e80af3d0 2024-06-10T00:16:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e809b180 con 0x7f04e80af3d0 2024-06-10T00:16:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04e57fa640 1 -- 172.21.15.79:0/2921831699 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc011c20 con 0x7f04e80af3d0 2024-06-10T00:16:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.774+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e809b740 con 0x7f04e80af3d0 2024-06-10T00:16:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.775+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e815c090 con 0x7f04e80af3d0 2024-06-10T00:16:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.776+0000 7f04e57fa640 1 -- 172.21.15.79:0/2921831699 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04dc018020 con 0x7f04e80af3d0 2024-06-10T00:16:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.776+0000 7f04e57fa640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04d406be30 0x7f04d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.776+0000 7f04e57fa640 1 -- 172.21.15.79:0/2921831699 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f04dc08ae30 con 0x7f04e80af3d0 2024-06-10T00:16:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.776+0000 7f04ece15640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04d406be30 0x7f04d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.776+0000 7f04ece15640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04d406be30 0x7f04d406e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f04d8006fd0 tx=0x7f04d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:28.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.780+0000 7f04e57fa640 1 -- 172.21.15.79:0/2921831699 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f04dc01f020 con 0x7f04e80af3d0 2024-06-10T00:16:28.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.951+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04e8068430 con 0x7f04d406be30 2024-06-10T00:16:28.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.956+0000 7f04e57fa640 1 -- 172.21.15.79:0/2921831699 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7f04e8068430 con 0x7f04d406be30 2024-06-10T00:16:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:16:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04d406be30 msgr2=0x7f04d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04d406be30 0x7f04d406e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f04d8006fd0 tx=0x7f04d8008040 comp rx=0 tx=0).stop 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 msgr2=0x7f04e81f1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e81f1770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00b3f0 tx=0x7f04dc00b8b0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 shutdown_connections 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04d406be30 0x7f04d406e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04e815a870 0x7f04e809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04e80af3d0 0x7f04e81f1770 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 --2- 172.21.15.79:0/2921831699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04e80aef70 0x7f04e814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 >> 172.21.15.79:0/2921831699 conn(0x7f04e80b19f0 msgr2=0x7f04e8159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 shutdown_connections 2024-06-10T00:16:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:28.959+0000 7f04ef079640 1 -- 172.21.15.79:0/2921831699 wait complete. 2024-06-10T00:16:28.970 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-06-10T00:16:27.168119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222048,"kb_used_data":5864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752672,"statfs":{"total":773094113280,"available":772866736128,"internally_reserved":0,"allocated":6004736,"data_stored":3291532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.881171"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928596+0000","last_change":"2024-06-10T00:16:21.301874+0000","last_active":"2024-06-10T00:16:22.928596+0000","last_peered":"2024-06-10T00:16:22.928596+0000","last_clean":"2024-06-10T00:16:22.928596+0000","last_became_active":"2024-06-10T00:16:21.301619+0000","last_became_peered":"2024-06-10T00:16:21.301619+0000","last_unstale":"2024-06-10T00:16:22.928596+0000","last_undegraded":"2024-06-10T00:16:22.928596+0000","last_fullsized":"2024-06-10T00:16:22.928596+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:36:47.257184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313736+0000","last_change":"2024-06-10T00:16:21.309186+0000","last_active":"2024-06-10T00:16:22.313736+0000","last_peered":"2024-06-10T00:16:22.313736+0000","last_clean":"2024-06-10T00:16:22.313736+0000","last_became_active":"2024-06-10T00:16:21.308573+0000","last_became_peered":"2024-06-10T00:16:21.308573+0000","last_unstale":"2024-06-10T00:16:22.313736+0000","last_undegraded":"2024-06-10T00:16:22.313736+0000","last_fullsized":"2024-06-10T00:16:22.313736+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:02.595811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310796+0000","last_change":"2024-06-10T00:16:21.308684+0000","last_active":"2024-06-10T00:16:22.310796+0000","last_peered":"2024-06-10T00:16:22.310796+0000","last_clean":"2024-06-10T00:16:22.310796+0000","last_became_active":"2024-06-10T00:16:21.308430+0000","last_became_peered":"2024-06-10T00:16:21.308430+0000","last_unstale":"2024-06-10T00:16:22.310796+0000","last_undegraded":"2024-06-10T00:16:22.310796+0000","last_fullsized":"2024-06-10T00:16:22.310796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:22:14.792725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313491+0000","last_change":"2024-06-10T00:16:21.303586+0000","last_active":"2024-06-10T00:16:22.313491+0000","last_peered":"2024-06-10T00:16:22.313491+0000","last_clean":"2024-06-10T00:16:22.313491+0000","last_became_active":"2024-06-10T00:16:21.303316+0000","last_became_peered":"2024-06-10T00:16:21.303316+0000","last_unstale":"2024-06-10T00:16:22.313491+0000","last_undegraded":"2024-06-10T00:16:22.313491+0000","last_fullsized":"2024-06-10T00:16:22.313491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:38:39.330813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289530+0000","last_change":"2024-06-10T00:16:21.310121+0000","last_active":"2024-06-10T00:16:22.289530+0000","last_peered":"2024-06-10T00:16:22.289530+0000","last_clean":"2024-06-10T00:16:22.289530+0000","last_became_active":"2024-06-10T00:16:21.309831+0000","last_became_peered":"2024-06-10T00:16:21.309831+0000","last_unstale":"2024-06-10T00:16:22.289530+0000","last_undegraded":"2024-06-10T00:16:22.289530+0000","last_fullsized":"2024-06-10T00:16:22.289530+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:57:52.554489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928399+0000","last_change":"2024-06-10T00:16:21.304638+0000","last_active":"2024-06-10T00:16:22.928399+0000","last_peered":"2024-06-10T00:16:22.928399+0000","last_clean":"2024-06-10T00:16:22.928399+0000","last_became_active":"2024-06-10T00:16:21.304386+0000","last_became_peered":"2024-06-10T00:16:21.304386+0000","last_unstale":"2024-06-10T00:16:22.928399+0000","last_undegraded":"2024-06-10T00:16:22.928399+0000","last_fullsized":"2024-06-10T00:16:22.928399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:47:26.970210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310477+0000","last_change":"2024-06-10T00:16:21.300169+0000","last_active":"2024-06-10T00:16:22.310477+0000","last_peered":"2024-06-10T00:16:22.310477+0000","last_clean":"2024-06-10T00:16:22.310477+0000","last_became_active":"2024-06-10T00:16:21.299819+0000","last_became_peered":"2024-06-10T00:16:21.299819+0000","last_unstale":"2024-06-10T00:16:22.310477+0000","last_undegraded":"2024-06-10T00:16:22.310477+0000","last_fullsized":"2024-06-10T00:16:22.310477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:26:38.876686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.288998+0000","last_change":"2024-06-10T00:16:21.294303+0000","last_active":"2024-06-10T00:16:22.288998+0000","last_peered":"2024-06-10T00:16:22.288998+0000","last_clean":"2024-06-10T00:16:22.288998+0000","last_became_active":"2024-06-10T00:16:21.294039+0000","last_became_peered":"2024-06-10T00:16:21.294039+0000","last_unstale":"2024-06-10T00:16:22.288998+0000","last_undegraded":"2024-06-10T00:16:22.288998+0000","last_fullsized":"2024-06-10T00:16:22.288998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:59.732133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289240+0000","last_change":"2024-06-10T00:16:21.299844+0000","last_active":"2024-06-10T00:16:22.289240+0000","last_peered":"2024-06-10T00:16:22.289240+0000","last_clean":"2024-06-10T00:16:22.289240+0000","last_became_active":"2024-06-10T00:16:21.299585+0000","last_became_peered":"2024-06-10T00:16:21.299585+0000","last_unstale":"2024-06-10T00:16:22.289240+0000","last_undegraded":"2024-06-10T00:16:22.289240+0000","last_fullsized":"2024-06-10T00:16:22.289240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:07:27.025916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928447+0000","last_change":"2024-06-10T00:16:21.301075+0000","last_active":"2024-06-10T00:16:22.928447+0000","last_peered":"2024-06-10T00:16:22.928447+0000","last_clean":"2024-06-10T00:16:22.928447+0000","last_became_active":"2024-06-10T00:16:21.300835+0000","last_became_peered":"2024-06-10T00:16:21.300835+0000","last_unstale":"2024-06-10T00:16:22.928447+0000","last_undegraded":"2024-06-10T00:16:22.928447+0000","last_fullsized":"2024-06-10T00:16:22.928447+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:49.660255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928230+0000","last_change":"2024-06-10T00:16:21.304274+0000","last_active":"2024-06-10T00:16:22.928230+0000","last_peered":"2024-06-10T00:16:22.928230+0000","last_clean":"2024-06-10T00:16:22.928230+0000","last_became_active":"2024-06-10T00:16:21.303987+0000","last_became_peered":"2024-06-10T00:16:21.303987+0000","last_unstale":"2024-06-10T00:16:22.928230+0000","last_undegraded":"2024-06-10T00:16:22.928230+0000","last_fullsized":"2024-06-10T00:16:22.928230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:21.627190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289415+0000","last_change":"2024-06-10T00:16:21.306013+0000","last_active":"2024-06-10T00:16:22.289415+0000","last_peered":"2024-06-10T00:16:22.289415+0000","last_clean":"2024-06-10T00:16:22.289415+0000","last_became_active":"2024-06-10T00:16:21.305752+0000","last_became_peered":"2024-06-10T00:16:21.305752+0000","last_unstale":"2024-06-10T00:16:22.289415+0000","last_undegraded":"2024-06-10T00:16:22.289415+0000","last_fullsized":"2024-06-10T00:16:22.289415+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:43:49.435326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928383+0000","last_change":"2024-06-10T00:16:21.301802+0000","last_active":"2024-06-10T00:16:22.928383+0000","last_peered":"2024-06-10T00:16:22.928383+0000","last_clean":"2024-06-10T00:16:22.928383+0000","last_became_active":"2024-06-10T00:16:21.301506+0000","last_became_peered":"2024-06-10T00:16:21.301506+0000","last_unstale":"2024-06-10T00:16:22.928383+0000","last_undegraded":"2024-06-10T00:16:22.928383+0000","last_fullsized":"2024-06-10T00:16:22.928383+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:56.683752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310668+0000","last_change":"2024-06-10T00:16:21.303609+0000","last_active":"2024-06-10T00:16:22.310668+0000","last_peered":"2024-06-10T00:16:22.310668+0000","last_clean":"2024-06-10T00:16:22.310668+0000","last_became_active":"2024-06-10T00:16:21.300707+0000","last_became_peered":"2024-06-10T00:16:21.300707+0000","last_unstale":"2024-06-10T00:16:22.310668+0000","last_undegraded":"2024-06-10T00:16:22.310668+0000","last_fullsized":"2024-06-10T00:16:22.310668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:04.525479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313561+0000","last_change":"2024-06-10T00:16:21.313172+0000","last_active":"2024-06-10T00:16:22.313561+0000","last_peered":"2024-06-10T00:16:22.313561+0000","last_clean":"2024-06-10T00:16:22.313561+0000","last_became_active":"2024-06-10T00:16:21.312852+0000","last_became_peered":"2024-06-10T00:16:21.312852+0000","last_unstale":"2024-06-10T00:16:22.313561+0000","last_undegraded":"2024-06-10T00:16:22.313561+0000","last_fullsized":"2024-06-10T00:16:22.313561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:57:48.323346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928069+0000","last_change":"2024-06-10T00:16:21.300414+0000","last_active":"2024-06-10T00:16:22.928069+0000","last_peered":"2024-06-10T00:16:22.928069+0000","last_clean":"2024-06-10T00:16:22.928069+0000","last_became_active":"2024-06-10T00:16:21.300151+0000","last_became_peered":"2024-06-10T00:16:21.300151+0000","last_unstale":"2024-06-10T00:16:22.928069+0000","last_undegraded":"2024-06-10T00:16:22.928069+0000","last_fullsized":"2024-06-10T00:16:22.928069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:42.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310868+0000","last_change":"2024-06-10T00:16:21.310545+0000","last_active":"2024-06-10T00:16:22.310868+0000","last_peered":"2024-06-10T00:16:22.310868+0000","last_clean":"2024-06-10T00:16:22.310868+0000","last_became_active":"2024-06-10T00:16:21.310119+0000","last_became_peered":"2024-06-10T00:16:21.310119+0000","last_unstale":"2024-06-10T00:16:22.310868+0000","last_undegraded":"2024-06-10T00:16:22.310868+0000","last_fullsized":"2024-06-10T00:16:22.310868+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:16:07.152624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313806+0000","last_change":"2024-06-10T00:16:21.302736+0000","last_active":"2024-06-10T00:16:22.313806+0000","last_peered":"2024-06-10T00:16:22.313806+0000","last_clean":"2024-06-10T00:16:22.313806+0000","last_became_active":"2024-06-10T00:16:21.302458+0000","last_became_peered":"2024-06-10T00:16:21.302458+0000","last_unstale":"2024-06-10T00:16:22.313806+0000","last_undegraded":"2024-06-10T00:16:22.313806+0000","last_fullsized":"2024-06-10T00:16:22.313806+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:55:41.770933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310737+0000","last_change":"2024-06-10T00:16:21.312680+0000","last_active":"2024-06-10T00:16:22.310737+0000","last_peered":"2024-06-10T00:16:22.310737+0000","last_clean":"2024-06-10T00:16:22.310737+0000","last_became_active":"2024-06-10T00:16:21.312424+0000","last_became_peered":"2024-06-10T00:16:21.312424+0000","last_unstale":"2024-06-10T00:16:22.310737+0000","last_undegraded":"2024-06-10T00:16:22.310737+0000","last_fullsized":"2024-06-10T00:16:22.310737+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:59.732133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928656+0000","last_change":"2024-06-10T00:16:21.310788+0000","last_active":"2024-06-10T00:16:22.928656+0000","last_peered":"2024-06-10T00:16:22.928656+0000","last_clean":"2024-06-10T00:16:22.928656+0000","last_became_active":"2024-06-10T00:16:21.310514+0000","last_became_peered":"2024-06-10T00:16:21.310514+0000","last_unstale":"2024-06-10T00:16:22.928656+0000","last_undegraded":"2024-06-10T00:16:22.928656+0000","last_fullsized":"2024-06-10T00:16:22.928656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:56.683752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928647+0000","last_change":"2024-06-10T00:16:21.306075+0000","last_active":"2024-06-10T00:16:22.928647+0000","last_peered":"2024-06-10T00:16:22.928647+0000","last_clean":"2024-06-10T00:16:22.928647+0000","last_became_active":"2024-06-10T00:16:21.305817+0000","last_became_peered":"2024-06-10T00:16:21.305817+0000","last_unstale":"2024-06-10T00:16:22.928647+0000","last_undegraded":"2024-06-10T00:16:22.928647+0000","last_fullsized":"2024-06-10T00:16:22.928647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:15:51.726494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.288971+0000","last_change":"2024-06-10T00:16:21.299852+0000","last_active":"2024-06-10T00:16:22.288971+0000","last_peered":"2024-06-10T00:16:22.288971+0000","last_clean":"2024-06-10T00:16:22.288971+0000","last_became_active":"2024-06-10T00:16:21.299607+0000","last_became_peered":"2024-06-10T00:16:21.299607+0000","last_unstale":"2024-06-10T00:16:22.288971+0000","last_undegraded":"2024-06-10T00:16:22.288971+0000","last_fullsized":"2024-06-10T00:16:22.288971+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:30:46.077238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928404+0000","last_change":"2024-06-10T00:16:21.305028+0000","last_active":"2024-06-10T00:16:22.928404+0000","last_peered":"2024-06-10T00:16:22.928404+0000","last_clean":"2024-06-10T00:16:22.928404+0000","last_became_active":"2024-06-10T00:16:21.304773+0000","last_became_peered":"2024-06-10T00:16:21.304773+0000","last_unstale":"2024-06-10T00:16:22.928404+0000","last_undegraded":"2024-06-10T00:16:22.928404+0000","last_fullsized":"2024-06-10T00:16:22.928404+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:56.551952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310289+0000","last_change":"2024-06-10T00:16:21.296766+0000","last_active":"2024-06-10T00:16:22.310289+0000","last_peered":"2024-06-10T00:16:22.310289+0000","last_clean":"2024-06-10T00:16:22.310289+0000","last_became_active":"2024-06-10T00:16:21.296487+0000","last_became_peered":"2024-06-10T00:16:21.296487+0000","last_unstale":"2024-06-10T00:16:22.310289+0000","last_undegraded":"2024-06-10T00:16:22.310289+0000","last_fullsized":"2024-06-10T00:16:22.310289+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:02.595811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.311000+0000","last_change":"2024-06-10T00:16:21.308518+0000","last_active":"2024-06-10T00:16:22.311000+0000","last_peered":"2024-06-10T00:16:22.311000+0000","last_clean":"2024-06-10T00:16:22.311000+0000","last_became_active":"2024-06-10T00:16:21.308254+0000","last_became_peered":"2024-06-10T00:16:21.308254+0000","last_unstale":"2024-06-10T00:16:22.311000+0000","last_undegraded":"2024-06-10T00:16:22.311000+0000","last_fullsized":"2024-06-10T00:16:22.311000+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:16:34.294544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289059+0000","last_change":"2024-06-10T00:16:21.300222+0000","last_active":"2024-06-10T00:16:22.289059+0000","last_peered":"2024-06-10T00:16:22.289059+0000","last_clean":"2024-06-10T00:16:22.289059+0000","last_became_active":"2024-06-10T00:16:21.299976+0000","last_became_peered":"2024-06-10T00:16:21.299976+0000","last_unstale":"2024-06-10T00:16:22.289059+0000","last_undegraded":"2024-06-10T00:16:22.289059+0000","last_fullsized":"2024-06-10T00:16:22.289059+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:16:07.152624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928663+0000","last_change":"2024-06-10T00:16:21.307019+0000","last_active":"2024-06-10T00:16:22.928663+0000","last_peered":"2024-06-10T00:16:22.928663+0000","last_clean":"2024-06-10T00:16:22.928663+0000","last_became_active":"2024-06-10T00:16:21.306752+0000","last_became_peered":"2024-06-10T00:16:21.306752+0000","last_unstale":"2024-06-10T00:16:22.928663+0000","last_undegraded":"2024-06-10T00:16:22.928663+0000","last_fullsized":"2024-06-10T00:16:22.928663+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:22:46.978012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928771+0000","last_change":"2024-06-10T00:16:21.307040+0000","last_active":"2024-06-10T00:16:22.928771+0000","last_peered":"2024-06-10T00:16:22.928771+0000","last_clean":"2024-06-10T00:16:22.928771+0000","last_became_active":"2024-06-10T00:16:21.306751+0000","last_became_peered":"2024-06-10T00:16:21.306751+0000","last_unstale":"2024-06-10T00:16:22.928771+0000","last_undegraded":"2024-06-10T00:16:22.928771+0000","last_fullsized":"2024-06-10T00:16:22.928771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:34:58.337066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310542+0000","last_change":"2024-06-10T00:16:21.306784+0000","last_active":"2024-06-10T00:16:22.310542+0000","last_peered":"2024-06-10T00:16:22.310542+0000","last_clean":"2024-06-10T00:16:22.310542+0000","last_became_active":"2024-06-10T00:16:21.306049+0000","last_became_peered":"2024-06-10T00:16:21.306049+0000","last_unstale":"2024-06-10T00:16:22.310542+0000","last_undegraded":"2024-06-10T00:16:22.310542+0000","last_fullsized":"2024-06-10T00:16:22.310542+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:11:25.305003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313500+0000","last_change":"2024-06-10T00:16:21.303799+0000","last_active":"2024-06-10T00:16:22.313500+0000","last_peered":"2024-06-10T00:16:22.313500+0000","last_clean":"2024-06-10T00:16:22.313500+0000","last_became_active":"2024-06-10T00:16:21.303078+0000","last_became_peered":"2024-06-10T00:16:21.303078+0000","last_unstale":"2024-06-10T00:16:22.313500+0000","last_undegraded":"2024-06-10T00:16:22.313500+0000","last_fullsized":"2024-06-10T00:16:22.313500+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:00:13.920376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310375+0000","last_change":"2024-06-10T00:16:21.300487+0000","last_active":"2024-06-10T00:16:22.310375+0000","last_peered":"2024-06-10T00:16:22.310375+0000","last_clean":"2024-06-10T00:16:22.310375+0000","last_became_active":"2024-06-10T00:16:21.300229+0000","last_became_peered":"2024-06-10T00:16:21.300229+0000","last_unstale":"2024-06-10T00:16:22.310375+0000","last_undegraded":"2024-06-10T00:16:22.310375+0000","last_fullsized":"2024-06-10T00:16:22.310375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:55:41.770933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.290768+0000","last_change":"2024-06-10T00:16:21.301709+0000","last_active":"2024-06-10T00:16:22.290768+0000","last_peered":"2024-06-10T00:16:22.290768+0000","last_clean":"2024-06-10T00:16:22.290768+0000","last_became_active":"2024-06-10T00:16:21.301209+0000","last_became_peered":"2024-06-10T00:16:21.301209+0000","last_unstale":"2024-06-10T00:16:22.290768+0000","last_undegraded":"2024-06-10T00:16:22.290768+0000","last_fullsized":"2024-06-10T00:16:22.290768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:51:51.177151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313237+0000","last_change":"2024-06-10T00:16:21.303505+0000","last_active":"2024-06-10T00:16:22.313237+0000","last_peered":"2024-06-10T00:16:22.313237+0000","last_clean":"2024-06-10T00:16:22.313237+0000","last_became_active":"2024-06-10T00:16:21.302994+0000","last_became_peered":"2024-06-10T00:16:21.302994+0000","last_unstale":"2024-06-10T00:16:22.313237+0000","last_undegraded":"2024-06-10T00:16:22.313237+0000","last_fullsized":"2024-06-10T00:16:22.313237+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:22:46.978012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"49'4","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928877+0000","last_change":"2024-06-10T00:16:20.297870+0000","last_active":"2024-06-10T00:16:22.928877+0000","last_peered":"2024-06-10T00:16:22.928877+0000","last_clean":"2024-06-10T00:16:22.928877+0000","last_became_active":"2024-06-10T00:16:20.297484+0000","last_became_peered":"2024-06-10T00:16:20.297484+0000","last_unstale":"2024-06-10T00:16:22.928877+0000","last_undegraded":"2024-06-10T00:16:22.928877+0000","last_fullsized":"2024-06-10T00:16:22.928877+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:24:01.616634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.290884+0000","last_change":"2024-06-10T00:16:21.306742+0000","last_active":"2024-06-10T00:16:22.290884+0000","last_peered":"2024-06-10T00:16:22.290884+0000","last_clean":"2024-06-10T00:16:22.290884+0000","last_became_active":"2024-06-10T00:16:21.306488+0000","last_became_peered":"2024-06-10T00:16:21.306488+0000","last_unstale":"2024-06-10T00:16:22.290884+0000","last_undegraded":"2024-06-10T00:16:22.290884+0000","last_fullsized":"2024-06-10T00:16:22.290884+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:26:38.876686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928456+0000","last_change":"2024-06-10T00:16:20.303002+0000","last_active":"2024-06-10T00:16:22.928456+0000","last_peered":"2024-06-10T00:16:22.928456+0000","last_clean":"2024-06-10T00:16:22.928456+0000","last_became_active":"2024-06-10T00:16:20.302738+0000","last_became_peered":"2024-06-10T00:16:20.302738+0000","last_unstale":"2024-06-10T00:16:22.928456+0000","last_undegraded":"2024-06-10T00:16:22.928456+0000","last_fullsized":"2024-06-10T00:16:22.928456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:20:47.443155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928533+0000","last_change":"2024-06-10T00:16:21.308215+0000","last_active":"2024-06-10T00:16:22.928533+0000","last_peered":"2024-06-10T00:16:22.928533+0000","last_clean":"2024-06-10T00:16:22.928533+0000","last_became_active":"2024-06-10T00:16:21.307094+0000","last_became_peered":"2024-06-10T00:16:21.307094+0000","last_unstale":"2024-06-10T00:16:22.928533+0000","last_undegraded":"2024-06-10T00:16:22.928533+0000","last_fullsized":"2024-06-10T00:16:22.928533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:42.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928650+0000","last_change":"2024-06-10T00:16:20.299695+0000","last_active":"2024-06-10T00:16:22.928650+0000","last_peered":"2024-06-10T00:16:22.928650+0000","last_clean":"2024-06-10T00:16:22.928650+0000","last_became_active":"2024-06-10T00:16:20.299435+0000","last_became_peered":"2024-06-10T00:16:20.299435+0000","last_unstale":"2024-06-10T00:16:22.928650+0000","last_undegraded":"2024-06-10T00:16:22.928650+0000","last_fullsized":"2024-06-10T00:16:22.928650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:06.979523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289002+0000","last_change":"2024-06-10T00:16:21.299091+0000","last_active":"2024-06-10T00:16:22.289002+0000","last_peered":"2024-06-10T00:16:22.289002+0000","last_clean":"2024-06-10T00:16:22.289002+0000","last_became_active":"2024-06-10T00:16:21.298811+0000","last_became_peered":"2024-06-10T00:16:21.298811+0000","last_unstale":"2024-06-10T00:16:22.289002+0000","last_undegraded":"2024-06-10T00:16:22.289002+0000","last_fullsized":"2024-06-10T00:16:22.289002+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:21:16.494821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.291037+0000","last_change":"2024-06-10T00:16:20.300555+0000","last_active":"2024-06-10T00:16:22.291037+0000","last_peered":"2024-06-10T00:16:22.291037+0000","last_clean":"2024-06-10T00:16:22.291037+0000","last_became_active":"2024-06-10T00:16:20.300241+0000","last_became_peered":"2024-06-10T00:16:20.300241+0000","last_unstale":"2024-06-10T00:16:22.291037+0000","last_undegraded":"2024-06-10T00:16:22.291037+0000","last_fullsized":"2024-06-10T00:16:22.291037+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:15:50.724605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289800+0000","last_change":"2024-06-10T00:16:21.310304+0000","last_active":"2024-06-10T00:16:22.289800+0000","last_peered":"2024-06-10T00:16:22.289800+0000","last_clean":"2024-06-10T00:16:22.289800+0000","last_became_active":"2024-06-10T00:16:21.309872+0000","last_became_peered":"2024-06-10T00:16:21.309872+0000","last_unstale":"2024-06-10T00:16:22.289800+0000","last_undegraded":"2024-06-10T00:16:22.289800+0000","last_fullsized":"2024-06-10T00:16:22.289800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:57.342330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310429+0000","last_change":"2024-06-10T00:16:20.305776+0000","last_active":"2024-06-10T00:16:22.310429+0000","last_peered":"2024-06-10T00:16:22.310429+0000","last_clean":"2024-06-10T00:16:22.310429+0000","last_became_active":"2024-06-10T00:16:20.305527+0000","last_became_peered":"2024-06-10T00:16:20.305527+0000","last_unstale":"2024-06-10T00:16:22.310429+0000","last_undegraded":"2024-06-10T00:16:22.310429+0000","last_fullsized":"2024-06-10T00:16:22.310429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:25:56.759604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313653+0000","last_change":"2024-06-10T00:16:21.302602+0000","last_active":"2024-06-10T00:16:22.313653+0000","last_peered":"2024-06-10T00:16:22.313653+0000","last_clean":"2024-06-10T00:16:22.313653+0000","last_became_active":"2024-06-10T00:16:21.302329+0000","last_became_peered":"2024-06-10T00:16:21.302329+0000","last_unstale":"2024-06-10T00:16:22.313653+0000","last_undegraded":"2024-06-10T00:16:22.313653+0000","last_fullsized":"2024-06-10T00:16:22.313653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:51:51.177151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289367+0000","last_change":"2024-06-10T00:16:20.298240+0000","last_active":"2024-06-10T00:16:22.289367+0000","last_peered":"2024-06-10T00:16:22.289367+0000","last_clean":"2024-06-10T00:16:22.289367+0000","last_became_active":"2024-06-10T00:16:20.297962+0000","last_became_peered":"2024-06-10T00:16:20.297962+0000","last_unstale":"2024-06-10T00:16:22.289367+0000","last_undegraded":"2024-06-10T00:16:22.289367+0000","last_fullsized":"2024-06-10T00:16:22.289367+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:53.046468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289213+0000","last_change":"2024-06-10T00:16:21.298751+0000","last_active":"2024-06-10T00:16:22.289213+0000","last_peered":"2024-06-10T00:16:22.289213+0000","last_clean":"2024-06-10T00:16:22.289213+0000","last_became_active":"2024-06-10T00:16:21.297036+0000","last_became_peered":"2024-06-10T00:16:21.297036+0000","last_unstale":"2024-06-10T00:16:22.289213+0000","last_undegraded":"2024-06-10T00:16:22.289213+0000","last_fullsized":"2024-06-10T00:16:22.289213+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:46:11.355018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928471+0000","last_change":"2024-06-10T00:16:20.298791+0000","last_active":"2024-06-10T00:16:22.928471+0000","last_peered":"2024-06-10T00:16:22.928471+0000","last_clean":"2024-06-10T00:16:22.928471+0000","last_became_active":"2024-06-10T00:16:20.297457+0000","last_became_peered":"2024-06-10T00:16:20.297457+0000","last_unstale":"2024-06-10T00:16:22.928471+0000","last_undegraded":"2024-06-10T00:16:22.928471+0000","last_fullsized":"2024-06-10T00:16:22.928471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:32:02.814038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313649+0000","last_change":"2024-06-10T00:16:21.313730+0000","last_active":"2024-06-10T00:16:22.313649+0000","last_peered":"2024-06-10T00:16:22.313649+0000","last_clean":"2024-06-10T00:16:22.313649+0000","last_became_active":"2024-06-10T00:16:21.313442+0000","last_became_peered":"2024-06-10T00:16:21.313442+0000","last_unstale":"2024-06-10T00:16:22.313649+0000","last_undegraded":"2024-06-10T00:16:22.313649+0000","last_fullsized":"2024-06-10T00:16:22.313649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:40:15.600909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310300+0000","last_change":"2024-06-10T00:16:20.307746+0000","last_active":"2024-06-10T00:16:22.310300+0000","last_peered":"2024-06-10T00:16:22.310300+0000","last_clean":"2024-06-10T00:16:22.310300+0000","last_became_active":"2024-06-10T00:16:20.306090+0000","last_became_peered":"2024-06-10T00:16:20.306090+0000","last_unstale":"2024-06-10T00:16:22.310300+0000","last_undegraded":"2024-06-10T00:16:22.310300+0000","last_fullsized":"2024-06-10T00:16:22.310300+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:35:29.547234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289358+0000","last_change":"2024-06-10T00:16:21.301482+0000","last_active":"2024-06-10T00:16:22.289358+0000","last_peered":"2024-06-10T00:16:22.289358+0000","last_clean":"2024-06-10T00:16:22.289358+0000","last_became_active":"2024-06-10T00:16:21.301205+0000","last_became_peered":"2024-06-10T00:16:21.301205+0000","last_unstale":"2024-06-10T00:16:22.289358+0000","last_undegraded":"2024-06-10T00:16:22.289358+0000","last_fullsized":"2024-06-10T00:16:22.289358+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:11:38.081600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313636+0000","last_change":"2024-06-10T00:16:20.297128+0000","last_active":"2024-06-10T00:16:22.313636+0000","last_peered":"2024-06-10T00:16:22.313636+0000","last_clean":"2024-06-10T00:16:22.313636+0000","last_became_active":"2024-06-10T00:16:20.296839+0000","last_became_peered":"2024-06-10T00:16:20.296839+0000","last_unstale":"2024-06-10T00:16:22.313636+0000","last_undegraded":"2024-06-10T00:16:22.313636+0000","last_fullsized":"2024-06-10T00:16:22.313636+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:57:51.552600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.290711+0000","last_change":"2024-06-10T00:16:21.308590+0000","last_active":"2024-06-10T00:16:22.290711+0000","last_peered":"2024-06-10T00:16:22.290711+0000","last_clean":"2024-06-10T00:16:22.290711+0000","last_became_active":"2024-06-10T00:16:21.308317+0000","last_became_peered":"2024-06-10T00:16:21.308317+0000","last_unstale":"2024-06-10T00:16:22.290711+0000","last_undegraded":"2024-06-10T00:16:22.290711+0000","last_fullsized":"2024-06-10T00:16:22.290711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:57:48.323346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289475+0000","last_change":"2024-06-10T00:16:20.309837+0000","last_active":"2024-06-10T00:16:22.289475+0000","last_peered":"2024-06-10T00:16:22.289475+0000","last_clean":"2024-06-10T00:16:22.289475+0000","last_became_active":"2024-06-10T00:16:20.309531+0000","last_became_peered":"2024-06-10T00:16:20.309531+0000","last_unstale":"2024-06-10T00:16:22.289475+0000","last_undegraded":"2024-06-10T00:16:22.289475+0000","last_fullsized":"2024-06-10T00:16:22.289475+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:24:01.616634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310534+0000","last_change":"2024-06-10T00:16:21.309203+0000","last_active":"2024-06-10T00:16:22.310534+0000","last_peered":"2024-06-10T00:16:22.310534+0000","last_clean":"2024-06-10T00:16:22.310534+0000","last_became_active":"2024-06-10T00:16:21.308950+0000","last_became_peered":"2024-06-10T00:16:21.308950+0000","last_unstale":"2024-06-10T00:16:22.310534+0000","last_undegraded":"2024-06-10T00:16:22.310534+0000","last_fullsized":"2024-06-10T00:16:22.310534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:22:30.758998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313748+0000","last_change":"2024-06-10T00:16:20.300508+0000","last_active":"2024-06-10T00:16:22.313748+0000","last_peered":"2024-06-10T00:16:22.313748+0000","last_clean":"2024-06-10T00:16:22.313748+0000","last_became_active":"2024-06-10T00:16:20.300209+0000","last_became_peered":"2024-06-10T00:16:20.300209+0000","last_unstale":"2024-06-10T00:16:22.313748+0000","last_undegraded":"2024-06-10T00:16:22.313748+0000","last_fullsized":"2024-06-10T00:16:22.313748+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:25:56.759604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289619+0000","last_change":"2024-06-10T00:16:21.300596+0000","last_active":"2024-06-10T00:16:22.289619+0000","last_peered":"2024-06-10T00:16:22.289619+0000","last_clean":"2024-06-10T00:16:22.289619+0000","last_became_active":"2024-06-10T00:16:21.299523+0000","last_became_peered":"2024-06-10T00:16:21.299523+0000","last_unstale":"2024-06-10T00:16:22.289619+0000","last_undegraded":"2024-06-10T00:16:22.289619+0000","last_fullsized":"2024-06-10T00:16:22.289619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:52:42.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"49'6","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289467+0000","last_change":"2024-06-10T00:16:20.304014+0000","last_active":"2024-06-10T00:16:22.289467+0000","last_peered":"2024-06-10T00:16:22.289467+0000","last_clean":"2024-06-10T00:16:22.289467+0000","last_became_active":"2024-06-10T00:16:20.303743+0000","last_became_peered":"2024-06-10T00:16:20.303743+0000","last_unstale":"2024-06-10T00:16:22.289467+0000","last_undegraded":"2024-06-10T00:16:22.289467+0000","last_fullsized":"2024-06-10T00:16:22.289467+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:46:16.664107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.290884+0000","last_change":"2024-06-10T00:16:21.310943+0000","last_active":"2024-06-10T00:16:22.290884+0000","last_peered":"2024-06-10T00:16:22.290884+0000","last_clean":"2024-06-10T00:16:22.290884+0000","last_became_active":"2024-06-10T00:16:21.310650+0000","last_became_peered":"2024-06-10T00:16:21.310650+0000","last_unstale":"2024-06-10T00:16:22.290884+0000","last_undegraded":"2024-06-10T00:16:22.290884+0000","last_fullsized":"2024-06-10T00:16:22.290884+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:55:41.770933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310541+0000","last_change":"2024-06-10T00:16:20.304457+0000","last_active":"2024-06-10T00:16:22.310541+0000","last_peered":"2024-06-10T00:16:22.310541+0000","last_clean":"2024-06-10T00:16:22.310541+0000","last_became_active":"2024-06-10T00:16:20.302179+0000","last_became_peered":"2024-06-10T00:16:20.302179+0000","last_unstale":"2024-06-10T00:16:22.310541+0000","last_undegraded":"2024-06-10T00:16:22.310541+0000","last_fullsized":"2024-06-10T00:16:22.310541+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:39.153279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310902+0000","last_change":"2024-06-10T00:16:21.310056+0000","last_active":"2024-06-10T00:16:22.310902+0000","last_peered":"2024-06-10T00:16:22.310902+0000","last_clean":"2024-06-10T00:16:22.310902+0000","last_became_active":"2024-06-10T00:16:21.309608+0000","last_became_peered":"2024-06-10T00:16:21.309608+0000","last_unstale":"2024-06-10T00:16:22.310902+0000","last_undegraded":"2024-06-10T00:16:22.310902+0000","last_fullsized":"2024-06-10T00:16:22.310902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:07:27.025916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928618+0000","last_change":"2024-06-10T00:16:20.309057+0000","last_active":"2024-06-10T00:16:22.928618+0000","last_peered":"2024-06-10T00:16:22.928618+0000","last_clean":"2024-06-10T00:16:22.928618+0000","last_became_active":"2024-06-10T00:16:20.308794+0000","last_became_peered":"2024-06-10T00:16:20.308794+0000","last_unstale":"2024-06-10T00:16:22.928618+0000","last_undegraded":"2024-06-10T00:16:22.928618+0000","last_fullsized":"2024-06-10T00:16:22.928618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:35:29.547234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289220+0000","last_change":"2024-06-10T00:16:21.304814+0000","last_active":"2024-06-10T00:16:22.289220+0000","last_peered":"2024-06-10T00:16:22.289220+0000","last_clean":"2024-06-10T00:16:22.289220+0000","last_became_active":"2024-06-10T00:16:21.304534+0000","last_became_peered":"2024-06-10T00:16:21.304534+0000","last_unstale":"2024-06-10T00:16:22.289220+0000","last_undegraded":"2024-06-10T00:16:22.289220+0000","last_fullsized":"2024-06-10T00:16:22.289220+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:31:52.272381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313406+0000","last_change":"2024-06-10T00:16:20.299284+0000","last_active":"2024-06-10T00:16:22.313406+0000","last_peered":"2024-06-10T00:16:22.313406+0000","last_clean":"2024-06-10T00:16:22.313406+0000","last_became_active":"2024-06-10T00:16:20.298987+0000","last_became_peered":"2024-06-10T00:16:20.298987+0000","last_unstale":"2024-06-10T00:16:22.313406+0000","last_undegraded":"2024-06-10T00:16:22.313406+0000","last_fullsized":"2024-06-10T00:16:22.313406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:11:37.079711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310886+0000","last_change":"2024-06-10T00:16:21.310358+0000","last_active":"2024-06-10T00:16:22.310886+0000","last_peered":"2024-06-10T00:16:22.310886+0000","last_clean":"2024-06-10T00:16:22.310886+0000","last_became_active":"2024-06-10T00:16:21.309817+0000","last_became_peered":"2024-06-10T00:16:21.309817+0000","last_unstale":"2024-06-10T00:16:22.310886+0000","last_undegraded":"2024-06-10T00:16:22.310886+0000","last_fullsized":"2024-06-10T00:16:22.310886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:21:16.494821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"49'8","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289383+0000","last_change":"2024-06-10T00:16:20.303655+0000","last_active":"2024-06-10T00:16:22.289383+0000","last_peered":"2024-06-10T00:16:22.289383+0000","last_clean":"2024-06-10T00:16:22.289383+0000","last_became_active":"2024-06-10T00:16:20.303386+0000","last_became_peered":"2024-06-10T00:16:20.303386+0000","last_unstale":"2024-06-10T00:16:22.289383+0000","last_undegraded":"2024-06-10T00:16:22.289383+0000","last_fullsized":"2024-06-10T00:16:22.289383+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:36:46.255295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289299+0000","last_change":"2024-06-10T00:16:21.302315+0000","last_active":"2024-06-10T00:16:22.289299+0000","last_peered":"2024-06-10T00:16:22.289299+0000","last_clean":"2024-06-10T00:16:22.289299+0000","last_became_active":"2024-06-10T00:16:21.302059+0000","last_became_peered":"2024-06-10T00:16:21.302059+0000","last_unstale":"2024-06-10T00:16:22.289299+0000","last_undegraded":"2024-06-10T00:16:22.289299+0000","last_fullsized":"2024-06-10T00:16:22.289299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:24.545014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310974+0000","last_change":"2024-06-10T00:16:20.309531+0000","last_active":"2024-06-10T00:16:22.310974+0000","last_peered":"2024-06-10T00:16:22.310974+0000","last_clean":"2024-06-10T00:16:22.310974+0000","last_became_active":"2024-06-10T00:16:20.309223+0000","last_became_peered":"2024-06-10T00:16:20.309223+0000","last_unstale":"2024-06-10T00:16:22.310974+0000","last_undegraded":"2024-06-10T00:16:22.310974+0000","last_fullsized":"2024-06-10T00:16:22.310974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:56.340441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928160+0000","last_change":"2024-06-10T00:16:21.306238+0000","last_active":"2024-06-10T00:16:22.928160+0000","last_peered":"2024-06-10T00:16:22.928160+0000","last_clean":"2024-06-10T00:16:22.928160+0000","last_became_active":"2024-06-10T00:16:21.305957+0000","last_became_peered":"2024-06-10T00:16:21.305957+0000","last_unstale":"2024-06-10T00:16:22.928160+0000","last_undegraded":"2024-06-10T00:16:22.928160+0000","last_fullsized":"2024-06-10T00:16:22.928160+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:57.342330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928321+0000","last_change":"2024-06-10T00:16:20.305785+0000","last_active":"2024-06-10T00:16:22.928321+0000","last_peered":"2024-06-10T00:16:22.928321+0000","last_clean":"2024-06-10T00:16:22.928321+0000","last_became_active":"2024-06-10T00:16:20.305483+0000","last_became_peered":"2024-06-10T00:16:20.305483+0000","last_unstale":"2024-06-10T00:16:22.928321+0000","last_undegraded":"2024-06-10T00:16:22.928321+0000","last_fullsized":"2024-06-10T00:16:22.928321+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:15:09.975754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289241+0000","last_change":"2024-06-10T00:16:21.311376+0000","last_active":"2024-06-10T00:16:22.289241+0000","last_peered":"2024-06-10T00:16:22.289241+0000","last_clean":"2024-06-10T00:16:22.289241+0000","last_became_active":"2024-06-10T00:16:21.310708+0000","last_became_peered":"2024-06-10T00:16:21.310708+0000","last_unstale":"2024-06-10T00:16:22.289241+0000","last_undegraded":"2024-06-10T00:16:22.289241+0000","last_fullsized":"2024-06-10T00:16:22.289241+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:40.155168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928845+0000","last_change":"2024-06-10T00:16:20.300901+0000","last_active":"2024-06-10T00:16:22.928845+0000","last_peered":"2024-06-10T00:16:22.928845+0000","last_clean":"2024-06-10T00:16:22.928845+0000","last_became_active":"2024-06-10T00:16:20.300594+0000","last_became_peered":"2024-06-10T00:16:20.300594+0000","last_unstale":"2024-06-10T00:16:22.928845+0000","last_undegraded":"2024-06-10T00:16:22.928845+0000","last_fullsized":"2024-06-10T00:16:22.928845+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:00:57.798789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928407+0000","last_change":"2024-06-10T00:16:21.299288+0000","last_active":"2024-06-10T00:16:22.928407+0000","last_peered":"2024-06-10T00:16:22.928407+0000","last_clean":"2024-06-10T00:16:22.928407+0000","last_became_active":"2024-06-10T00:16:21.299029+0000","last_became_peered":"2024-06-10T00:16:21.299029+0000","last_unstale":"2024-06-10T00:16:22.928407+0000","last_undegraded":"2024-06-10T00:16:22.928407+0000","last_fullsized":"2024-06-10T00:16:22.928407+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:15:51.726494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928753+0000","last_change":"2024-06-10T00:16:20.305387+0000","last_active":"2024-06-10T00:16:22.928753+0000","last_peered":"2024-06-10T00:16:22.928753+0000","last_clean":"2024-06-10T00:16:22.928753+0000","last_became_active":"2024-06-10T00:16:20.305118+0000","last_became_peered":"2024-06-10T00:16:20.305118+0000","last_unstale":"2024-06-10T00:16:22.928753+0000","last_undegraded":"2024-06-10T00:16:22.928753+0000","last_fullsized":"2024-06-10T00:16:22.928753+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:40.052203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.290849+0000","last_change":"2024-06-10T00:16:21.301762+0000","last_active":"2024-06-10T00:16:22.290849+0000","last_peered":"2024-06-10T00:16:22.290849+0000","last_clean":"2024-06-10T00:16:22.290849+0000","last_became_active":"2024-06-10T00:16:21.301495+0000","last_became_peered":"2024-06-10T00:16:21.301495+0000","last_unstale":"2024-06-10T00:16:22.290849+0000","last_undegraded":"2024-06-10T00:16:22.290849+0000","last_fullsized":"2024-06-10T00:16:22.290849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:18:02.595811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928496+0000","last_change":"2024-06-10T00:16:20.293250+0000","last_active":"2024-06-10T00:16:22.928496+0000","last_peered":"2024-06-10T00:16:22.928496+0000","last_clean":"2024-06-10T00:16:22.928496+0000","last_became_active":"2024-06-10T00:16:20.292968+0000","last_became_peered":"2024-06-10T00:16:20.292968+0000","last_unstale":"2024-06-10T00:16:22.928496+0000","last_undegraded":"2024-06-10T00:16:22.928496+0000","last_fullsized":"2024-06-10T00:16:22.928496+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:32:02.814038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928760+0000","last_change":"2024-06-10T00:16:21.310512+0000","last_active":"2024-06-10T00:16:22.928760+0000","last_peered":"2024-06-10T00:16:22.928760+0000","last_clean":"2024-06-10T00:16:22.928760+0000","last_became_active":"2024-06-10T00:16:21.310222+0000","last_became_peered":"2024-06-10T00:16:21.310222+0000","last_unstale":"2024-06-10T00:16:22.928760+0000","last_undegraded":"2024-06-10T00:16:22.928760+0000","last_fullsized":"2024-06-10T00:16:22.928760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:47:26.970210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289069+0000","last_change":"2024-06-10T00:16:20.304632+0000","last_active":"2024-06-10T00:16:22.289069+0000","last_peered":"2024-06-10T00:16:22.289069+0000","last_clean":"2024-06-10T00:16:22.289069+0000","last_became_active":"2024-06-10T00:16:20.304382+0000","last_became_peered":"2024-06-10T00:16:20.304382+0000","last_unstale":"2024-06-10T00:16:22.289069+0000","last_undegraded":"2024-06-10T00:16:22.289069+0000","last_fullsized":"2024-06-10T00:16:22.289069+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:22:45.976124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310894+0000","last_change":"2024-06-10T00:16:21.299529+0000","last_active":"2024-06-10T00:16:22.310894+0000","last_peered":"2024-06-10T00:16:22.310894+0000","last_clean":"2024-06-10T00:16:22.310894+0000","last_became_active":"2024-06-10T00:16:21.299076+0000","last_became_peered":"2024-06-10T00:16:21.299076+0000","last_unstale":"2024-06-10T00:16:22.310894+0000","last_undegraded":"2024-06-10T00:16:22.310894+0000","last_fullsized":"2024-06-10T00:16:22.310894+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:31:52.272381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310464+0000","last_change":"2024-06-10T00:16:20.305088+0000","last_active":"2024-06-10T00:16:22.310464+0000","last_peered":"2024-06-10T00:16:22.310464+0000","last_clean":"2024-06-10T00:16:22.310464+0000","last_became_active":"2024-06-10T00:16:20.304825+0000","last_became_peered":"2024-06-10T00:16:20.304825+0000","last_unstale":"2024-06-10T00:16:22.310464+0000","last_undegraded":"2024-06-10T00:16:22.310464+0000","last_fullsized":"2024-06-10T00:16:22.310464+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:01:40.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928620+0000","last_change":"2024-06-10T00:16:21.294553+0000","last_active":"2024-06-10T00:16:22.928620+0000","last_peered":"2024-06-10T00:16:22.928620+0000","last_clean":"2024-06-10T00:16:22.928620+0000","last_became_active":"2024-06-10T00:16:21.294293+0000","last_became_peered":"2024-06-10T00:16:21.294293+0000","last_unstale":"2024-06-10T00:16:22.928620+0000","last_undegraded":"2024-06-10T00:16:22.928620+0000","last_fullsized":"2024-06-10T00:16:22.928620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:46:17.665996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.927992+0000","last_change":"2024-06-10T00:16:20.302648+0000","last_active":"2024-06-10T00:16:22.927992+0000","last_peered":"2024-06-10T00:16:22.927992+0000","last_clean":"2024-06-10T00:16:22.927992+0000","last_became_active":"2024-06-10T00:16:20.302385+0000","last_became_peered":"2024-06-10T00:16:20.302385+0000","last_unstale":"2024-06-10T00:16:22.927992+0000","last_undegraded":"2024-06-10T00:16:22.927992+0000","last_fullsized":"2024-06-10T00:16:22.927992+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:18:08.200085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.290762+0000","last_change":"2024-06-10T00:16:21.301484+0000","last_active":"2024-06-10T00:16:22.290762+0000","last_peered":"2024-06-10T00:16:22.290762+0000","last_clean":"2024-06-10T00:16:22.290762+0000","last_became_active":"2024-06-10T00:16:21.300876+0000","last_became_peered":"2024-06-10T00:16:21.300876+0000","last_unstale":"2024-06-10T00:16:22.290762+0000","last_undegraded":"2024-06-10T00:16:22.290762+0000","last_fullsized":"2024-06-10T00:16:22.290762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:40:15.600909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928894+0000","last_change":"2024-06-10T00:16:20.309578+0000","last_active":"2024-06-10T00:16:22.928894+0000","last_peered":"2024-06-10T00:16:22.928894+0000","last_clean":"2024-06-10T00:16:22.928894+0000","last_became_active":"2024-06-10T00:16:20.309249+0000","last_became_peered":"2024-06-10T00:16:20.309249+0000","last_unstale":"2024-06-10T00:16:22.928894+0000","last_undegraded":"2024-06-10T00:16:22.928894+0000","last_fullsized":"2024-06-10T00:16:22.928894+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:53.046468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928408+0000","last_change":"2024-06-10T00:16:21.296050+0000","last_active":"2024-06-10T00:16:22.928408+0000","last_peered":"2024-06-10T00:16:22.928408+0000","last_clean":"2024-06-10T00:16:22.928408+0000","last_became_active":"2024-06-10T00:16:21.295505+0000","last_became_peered":"2024-06-10T00:16:21.295505+0000","last_unstale":"2024-06-10T00:16:22.928408+0000","last_undegraded":"2024-06-10T00:16:22.928408+0000","last_fullsized":"2024-06-10T00:16:22.928408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:34:58.337066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313779+0000","last_change":"2024-06-10T00:16:20.302054+0000","last_active":"2024-06-10T00:16:22.313779+0000","last_peered":"2024-06-10T00:16:22.313779+0000","last_clean":"2024-06-10T00:16:22.313779+0000","last_became_active":"2024-06-10T00:16:20.301779+0000","last_became_peered":"2024-06-10T00:16:20.301779+0000","last_unstale":"2024-06-10T00:16:22.313779+0000","last_undegraded":"2024-06-10T00:16:22.313779+0000","last_fullsized":"2024-06-10T00:16:22.313779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:39.153279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289036+0000","last_change":"2024-06-10T00:16:21.302617+0000","last_active":"2024-06-10T00:16:22.289036+0000","last_peered":"2024-06-10T00:16:22.289036+0000","last_clean":"2024-06-10T00:16:22.289036+0000","last_became_active":"2024-06-10T00:16:21.302351+0000","last_became_peered":"2024-06-10T00:16:21.302351+0000","last_unstale":"2024-06-10T00:16:22.289036+0000","last_undegraded":"2024-06-10T00:16:22.289036+0000","last_fullsized":"2024-06-10T00:16:22.289036+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:22:14.792725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310621+0000","last_change":"2024-06-10T00:16:20.305512+0000","last_active":"2024-06-10T00:16:22.310621+0000","last_peered":"2024-06-10T00:16:22.310621+0000","last_clean":"2024-06-10T00:16:22.310621+0000","last_became_active":"2024-06-10T00:16:20.305274+0000","last_became_peered":"2024-06-10T00:16:20.305274+0000","last_unstale":"2024-06-10T00:16:22.310621+0000","last_undegraded":"2024-06-10T00:16:22.310621+0000","last_fullsized":"2024-06-10T00:16:22.310621+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:36.042655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310606+0000","last_change":"2024-06-10T00:16:21.297936+0000","last_active":"2024-06-10T00:16:22.310606+0000","last_peered":"2024-06-10T00:16:22.310606+0000","last_clean":"2024-06-10T00:16:22.310606+0000","last_became_active":"2024-06-10T00:16:21.297651+0000","last_became_peered":"2024-06-10T00:16:21.297651+0000","last_unstale":"2024-06-10T00:16:22.310606+0000","last_undegraded":"2024-06-10T00:16:22.310606+0000","last_fullsized":"2024-06-10T00:16:22.310606+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:34:21.213332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289129+0000","last_change":"2024-06-10T00:16:20.304106+0000","last_active":"2024-06-10T00:16:22.289129+0000","last_peered":"2024-06-10T00:16:22.289129+0000","last_clean":"2024-06-10T00:16:22.289129+0000","last_became_active":"2024-06-10T00:16:20.303755+0000","last_became_peered":"2024-06-10T00:16:20.303755+0000","last_unstale":"2024-06-10T00:16:22.289129+0000","last_undegraded":"2024-06-10T00:16:22.289129+0000","last_fullsized":"2024-06-10T00:16:22.289129+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:38:38.328925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.290962+0000","last_change":"2024-06-10T00:16:21.305796+0000","last_active":"2024-06-10T00:16:22.290962+0000","last_peered":"2024-06-10T00:16:22.290962+0000","last_clean":"2024-06-10T00:16:22.290962+0000","last_became_active":"2024-06-10T00:16:21.305523+0000","last_became_peered":"2024-06-10T00:16:21.305523+0000","last_unstale":"2024-06-10T00:16:22.290962+0000","last_undegraded":"2024-06-10T00:16:22.290962+0000","last_fullsized":"2024-06-10T00:16:22.290962+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:22:30.758998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289159+0000","last_change":"2024-06-10T00:16:20.302947+0000","last_active":"2024-06-10T00:16:22.289159+0000","last_peered":"2024-06-10T00:16:22.289159+0000","last_clean":"2024-06-10T00:16:22.289159+0000","last_became_active":"2024-06-10T00:16:20.302664+0000","last_became_peered":"2024-06-10T00:16:20.302664+0000","last_unstale":"2024-06-10T00:16:22.289159+0000","last_undegraded":"2024-06-10T00:16:22.289159+0000","last_fullsized":"2024-06-10T00:16:22.289159+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:37:48.658366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310732+0000","last_change":"2024-06-10T00:16:21.299334+0000","last_active":"2024-06-10T00:16:22.310732+0000","last_peered":"2024-06-10T00:16:22.310732+0000","last_clean":"2024-06-10T00:16:22.310732+0000","last_became_active":"2024-06-10T00:16:21.298743+0000","last_became_peered":"2024-06-10T00:16:21.298743+0000","last_unstale":"2024-06-10T00:16:22.310732+0000","last_undegraded":"2024-06-10T00:16:22.310732+0000","last_fullsized":"2024-06-10T00:16:22.310732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:30:46.077238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289200+0000","last_change":"2024-06-10T00:16:20.301224+0000","last_active":"2024-06-10T00:16:22.289200+0000","last_peered":"2024-06-10T00:16:22.289200+0000","last_clean":"2024-06-10T00:16:22.289200+0000","last_became_active":"2024-06-10T00:16:20.300924+0000","last_became_peered":"2024-06-10T00:16:20.300924+0000","last_unstale":"2024-06-10T00:16:22.289200+0000","last_undegraded":"2024-06-10T00:16:22.289200+0000","last_fullsized":"2024-06-10T00:16:22.289200+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:40.052203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.289282+0000","last_change":"2024-06-10T00:16:21.299522+0000","last_active":"2024-06-10T00:16:22.289282+0000","last_peered":"2024-06-10T00:16:22.289282+0000","last_clean":"2024-06-10T00:16:22.289282+0000","last_became_active":"2024-06-10T00:16:21.299229+0000","last_became_peered":"2024-06-10T00:16:21.299229+0000","last_unstale":"2024-06-10T00:16:22.289282+0000","last_undegraded":"2024-06-10T00:16:22.289282+0000","last_fullsized":"2024-06-10T00:16:22.289282+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:16:34.294544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.290872+0000","last_change":"2024-06-10T00:16:20.294051+0000","last_active":"2024-06-10T00:16:22.290872+0000","last_peered":"2024-06-10T00:16:22.290872+0000","last_clean":"2024-06-10T00:16:22.290872+0000","last_became_active":"2024-06-10T00:16:20.293751+0000","last_became_peered":"2024-06-10T00:16:20.293751+0000","last_unstale":"2024-06-10T00:16:22.290872+0000","last_undegraded":"2024-06-10T00:16:22.290872+0000","last_fullsized":"2024-06-10T00:16:22.290872+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:34:57.335177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.928596+0000","last_change":"2024-06-10T00:16:21.312131+0000","last_active":"2024-06-10T00:16:22.928596+0000","last_peered":"2024-06-10T00:16:22.928596+0000","last_clean":"2024-06-10T00:16:22.928596+0000","last_became_active":"2024-06-10T00:16:21.311368+0000","last_became_peered":"2024-06-10T00:16:21.311368+0000","last_unstale":"2024-06-10T00:16:22.928596+0000","last_undegraded":"2024-06-10T00:16:22.928596+0000","last_fullsized":"2024-06-10T00:16:22.928596+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:20.281856+0000","last_clean_scrub_stamp":"2024-06-10T00:16:20.281856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:57.342330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"50'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.310891+0000","last_change":"2024-06-10T00:16:20.308999+0000","last_active":"2024-06-10T00:16:22.310891+0000","last_peered":"2024-06-10T00:16:22.310891+0000","last_clean":"2024-06-10T00:16:22.310891+0000","last_became_active":"2024-06-10T00:16:20.308679+0000","last_became_peered":"2024-06-10T00:16:20.308679+0000","last_unstale":"2024-06-10T00:16:22.310891+0000","last_undegraded":"2024-06-10T00:16:22.310891+0000","last_fullsized":"2024-06-10T00:16:22.310891+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:16:19.279968+0000","last_clean_scrub_stamp":"2024-06-10T00:16:19.279968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:11:37.079711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-10T00:16:22.313232+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:16:22.313232+0000","last_peered":"2024-06-10T00:16:22.313232+0000","last_clean":"2024-06-10T00:16:22.313232+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:16:22.313232+0000","last_undegraded":"2024-06-10T00:16:22.313232+0000","last_fullsized":"2024-06-10T00:16:22.313232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28188,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343652,"statfs":{"total":96636764160,"available":96607899648,"internally_reserved":0,"allocated":1196032,"data_stored":853739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":263899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":263247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":263829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":610304,"data_stored":264881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":264859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":263407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28188,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343652,"statfs":{"total":96636764160,"available":96607899648,"internally_reserved":0,"allocated":1196032,"data_stored":853671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:16:28.973 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:16:28.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-10T00:16:29.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.116+0000 7f46f2edf640 1 Processor -- start 2024-06-10T00:16:29.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.116+0000 7f46f2edf640 1 -- start start 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f2edf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46ec1589e0 0x7f46ec15f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f2edf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ec158dc0 con 0x7f46ec0d06e0 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f2edf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ec0721b0 con 0x7f46ec15ea40 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f2edf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f46ec072490 con 0x7f46ec1589e0 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f0c7b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46ec1589e0 0x7f46ec15f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f0c7b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46ec1589e0 0x7f46ec15f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34338/0 (socket says 172.21.15.79:34338) 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f0c7b640 1 -- 172.21.15.79:0/4249909021 learned_addr learned my addr 172.21.15.79:0/4249909021 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f147c640 1 --1- 172.21.15.79:0/4249909021 >> v1:172.21.15.79:6789/0 conn(0x7f46ec0d06e0 0x7f46ec0ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35326/0 (socket says 172.21.15.79:35326) 2024-06-10T00:16:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f0c7b640 1 -- 172.21.15.79:0/4249909021 >> v1:172.21.15.117:6789/0 conn(0x7f46ec15ea40 legacy=0x7f46ec0cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:29.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f0c7b640 1 -- 172.21.15.79:0/4249909021 >> v1:172.21.15.79:6789/0 conn(0x7f46ec0d06e0 legacy=0x7f46ec0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.117+0000 7f46f0c7b640 1 -- 172.21.15.79:0/4249909021 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec072770 con 0x7f46ec1589e0 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46f0c7b640 1 --2- 172.21.15.79:0/4249909021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec15f270 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009870 tx=0x7f46e802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b4073491bdbeca server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46e37fe640 1 -- 172.21.15.79:0/4249909021 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8037070 con 0x7f46ec1589e0 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46e37fe640 1 -- 172.21.15.79:0/4249909021 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e8032440 con 0x7f46ec1589e0 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46e37fe640 1 -- 172.21.15.79:0/4249909021 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8032810 con 0x7f46ec1589e0 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46f2edf640 1 -- 172.21.15.79:0/4249909021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 msgr2=0x7f46ec15f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46f2edf640 1 --2- 172.21.15.79:0/4249909021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec15f270 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009870 tx=0x7f46e802a210 comp rx=0 tx=0).stop 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46f2edf640 1 -- 172.21.15.79:0/4249909021 shutdown_connections 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46f2edf640 1 --2- 172.21.15.79:0/4249909021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec15f270 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.118+0000 7f46f2edf640 1 -- 172.21.15.79:0/4249909021 >> 172.21.15.79:0/4249909021 conn(0x7f46ec06b7e0 msgr2=0x7f46ec06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.119+0000 7f46f2edf640 1 -- 172.21.15.79:0/4249909021 shutdown_connections 2024-06-10T00:16:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.119+0000 7f46f2edf640 1 -- 172.21.15.79:0/4249909021 wait complete. 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.120+0000 7f46f2edf640 1 Processor -- start 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.120+0000 7f46f2edf640 1 -- start start 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f2edf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ec0d06e0 0x7f46ec14a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f2edf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f2edf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ec15ea40 0x7f46ec1414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f2edf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec15f7b0 con 0x7f46ec1589e0 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f2edf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec072d30 con 0x7f46ec0d06e0 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f2edf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec073250 con 0x7f46ec15ea40 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec144c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34346/0 (socket says 172.21.15.79:34346) 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 -- 172.21.15.79:0/2340460711 learned_addr learned my addr 172.21.15.79:0/2340460711 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f0c7b640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ec0d06e0 0x7f46ec14a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f147c640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ec15ea40 0x7f46ec1414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 -- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ec15ea40 msgr2=0x7f46ec1414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ec15ea40 0x7f46ec1414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 -- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ec0d06e0 msgr2=0x7f46ec14a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ec0d06e0 0x7f46ec14a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 -- 172.21.15.79:0/2340460711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec142f40 con 0x7f46ec1589e0 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f0c7b640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ec0d06e0 0x7f46ec14a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e3fff640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec144c00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00b3e0 tx=0x7f46dc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e17fa640 1 -- 172.21.15.79:0/2340460711 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc015020 con 0x7f46ec1589e0 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e17fa640 1 -- 172.21.15.79:0/2340460711 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46dc011850 con 0x7f46ec1589e0 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec143220 con 0x7f46ec1589e0 2024-06-10T00:16:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46e17fa640 1 -- 172.21.15.79:0/2340460711 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc011c40 con 0x7f46ec1589e0 2024-06-10T00:16:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.121+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec1459f0 con 0x7f46ec1589e0 2024-06-10T00:16:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.122+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ec0acf90 con 0x7f46ec1589e0 2024-06-10T00:16:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.123+0000 7f46e17fa640 1 -- 172.21.15.79:0/2340460711 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46dc018020 con 0x7f46ec1589e0 2024-06-10T00:16:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.123+0000 7f46e17fa640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f46d806be30 0x7f46d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.123+0000 7f46e17fa640 1 -- 172.21.15.79:0/2340460711 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f46dc08aee0 con 0x7f46ec1589e0 2024-06-10T00:16:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.123+0000 7f46f0c7b640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f46d806be30 0x7f46d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.124+0000 7f46f0c7b640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f46d806be30 0x7f46d806e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46e8034000 tx=0x7f46e802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:29.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.127+0000 7f46e17fa640 1 -- 172.21.15.79:0/2340460711 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f46ec0acf90 con 0x7f46ec1589e0 2024-06-10T00:16:29.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.371+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f46ec0683c0 con 0x7f46ec1589e0 2024-06-10T00:16:29.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.374+0000 7f46e17fa640 1 -- 172.21.15.79:0/2340460711 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f46dc01f020 con 0x7f46ec1589e0 2024-06-10T00:16:29.373 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-06-10T00:16:29.373 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:16:29.373 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-06-10T00:16:29.373 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-06-10T00:16:29.374 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-10T00:16:29.374 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-06-10T00:16:29.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f46d806be30 msgr2=0x7f46d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f46d806be30 0x7f46d806e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46e8034000 tx=0x7f46e802e000 comp rx=0 tx=0).stop 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 msgr2=0x7f46ec144c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec144c00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00b3e0 tx=0x7f46dc00b8a0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 shutdown_connections 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f46d806be30 0x7f46d806e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ec15ea40 0x7f46ec1414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ec1589e0 0x7f46ec144c00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 --2- 172.21.15.79:0/2340460711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ec0d06e0 0x7f46ec14a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 >> 172.21.15.79:0/2340460711 conn(0x7f46ec06b7e0 msgr2=0x7f46ec06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 shutdown_connections 2024-06-10T00:16:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.376+0000 7f46f2edf640 1 -- 172.21.15.79:0/2340460711 wait complete. 2024-06-10T00:16:29.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:16:29.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.485+0000 7f6e01837640 1 Processor -- start 2024-06-10T00:16:29.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.485+0000 7f6e01837640 1 -- start start 2024-06-10T00:16:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6e01837640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6dfc161830 0x7f6dfc0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6e01837640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 0x7f6dfc0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6e01837640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6dfc0d0a00 0x7f6dfc0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6e01837640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6dfc0d4cf0 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6e01837640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6dfc0cebb0 con 0x7f6dfc161830 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6e01837640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6dfc0d2fc0 con 0x7f6dfc161c10 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6dfb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6dfc0d0a00 0x7f6dfc0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6dfb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6dfc0d0a00 0x7f6dfc0d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34360/0 (socket says 172.21.15.79:34360) 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6dfb7fe640 1 -- 172.21.15.79:0/2045699033 learned_addr learned my addr 172.21.15.79:0/2045699033 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6dfaffd640 1 --2- 172.21.15.79:0/2045699033 >> v2:172.21.15.117:3300/0 conn(0x7f6dfc161830 0x7f6dfc0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6df27fc640 1 --2- 172.21.15.79:0/2045699033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 0x7f6dfc0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6dfb7fe640 1 -- 172.21.15.79:0/2045699033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 msgr2=0x7f6dfc0d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6dfb7fe640 1 --2- 172.21.15.79:0/2045699033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 0x7f6dfc0d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.486+0000 7f6dfb7fe640 1 -- 172.21.15.79:0/2045699033 >> v2:172.21.15.117:3300/0 conn(0x7f6dfc161830 msgr2=0x7f6dfc0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.487+0000 7f6dfb7fe640 1 --2- 172.21.15.79:0/2045699033 >> v2:172.21.15.117:3300/0 conn(0x7f6dfc161830 0x7f6dfc0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.487+0000 7f6dfb7fe640 1 -- 172.21.15.79:0/2045699033 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc0d4f20 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.487+0000 7f6df27fc640 1 --2- 172.21.15.79:0/2045699033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 0x7f6dfc0d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.487+0000 7f6dfb7fe640 1 --2- 172.21.15.79:0/2045699033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0d0e90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc08e7a0 tx=0x7f6df402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbbff2ddfeebcb0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.487+0000 7f6dfa7fc640 1 -- 172.21.15.79:0/2045699033 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4036070 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6dfa7fc640 1 -- 172.21.15.79:0/2045699033 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df4031600 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6dfa7fc640 1 -- 172.21.15.79:0/2045699033 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df40319d0 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 -- 172.21.15.79:0/2045699033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 msgr2=0x7f6dfc0d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 --2- 172.21.15.79:0/2045699033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0d0e90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc08e7a0 tx=0x7f6df402a6a0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 -- 172.21.15.79:0/2045699033 shutdown_connections 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 --2- 172.21.15.79:0/2045699033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0d0e90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 --2- 172.21.15.79:0/2045699033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 0x7f6dfc0d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 --2- 172.21.15.79:0/2045699033 >> v2:172.21.15.117:3300/0 conn(0x7f6dfc161830 0x7f6dfc0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 -- 172.21.15.79:0/2045699033 >> 172.21.15.79:0/2045699033 conn(0x7f6dfc09d3e0 msgr2=0x7f6dfc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 -- 172.21.15.79:0/2045699033 shutdown_connections 2024-06-10T00:16:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.488+0000 7f6e01837640 1 -- 172.21.15.79:0/2045699033 wait complete. 2024-06-10T00:16:29.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.489+0000 7f6e01837640 1 Processor -- start 2024-06-10T00:16:29.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.489+0000 7f6e01837640 1 -- start start 2024-06-10T00:16:29.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6e01837640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6e01837640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc161830 0x7f6dfc0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6e01837640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 0x7f6dfc1f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6e01837640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc0d2ce0 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6e01837640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc0d2a00 con 0x7f6dfc161830 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6e01837640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6dfc0c7bf0 con 0x7f6dfc161c10 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6dfaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6dfaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34368/0 (socket says 172.21.15.79:34368) 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.490+0000 7f6dfaffd640 1 -- 172.21.15.79:0/833180046 learned_addr learned my addr 172.21.15.79:0/833180046 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6dfaffd640 1 -- 172.21.15.79:0/833180046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 msgr2=0x7f6dfc1f4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6dfaffd640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 0x7f6dfc1f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6dfaffd640 1 -- 172.21.15.79:0/833180046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc161830 msgr2=0x7f6dfc0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6df27fc640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc161830 0x7f6dfc0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6dfaffd640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc161830 0x7f6dfc0cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6dfaffd640 1 -- 172.21.15.79:0/833180046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc0b6cc0 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6df27fc640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc161830 0x7f6dfc0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6dfaffd640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0ccf30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00d800 tx=0x7f6dec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:29.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6df8ff9640 1 -- 172.21.15.79:0/833180046 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec018020 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6df8ff9640 1 -- 172.21.15.79:0/833180046 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dec0096a0 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc1f4940 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6df8ff9640 1 -- 172.21.15.79:0/833180046 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec009a70 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.491+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dfc1f4f00 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.492+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dfc068430 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.492+0000 7f6df8ff9640 1 -- 172.21.15.79:0/833180046 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dec01b020 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.493+0000 7f6df8ff9640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6ddc06be30 0x7f6ddc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.493+0000 7f6df8ff9640 1 -- 172.21.15.79:0/833180046 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f6dec08b270 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.493+0000 7f6df27fc640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6ddc06be30 0x7f6ddc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:29.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.493+0000 7f6df27fc640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6ddc06be30 0x7f6ddc06e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6de4006fd0 tx=0x7f6de4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:29.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.497+0000 7f6df8ff9640 1 -- 172.21.15.79:0/833180046 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6dec022030 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.707+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dfc0d1650 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.707+0000 7f6df8ff9640 1 -- 172.21.15.79:0/833180046 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5184 (secure 0 0 0) 0x7f6dec059a90 con 0x7f6dfc0d0a00 2024-06-10T00:16:29.707 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:29.707 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:16:20.631079+0000","modified":"2024-06-10T00:16:22.637364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1724490819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1724490819},{"type":"v1","addr":"172.21.15.117:6835","nonce":1724490819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":3}]} 2024-06-10T00:16:29.707 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-06-10T00:16:29.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6ddc06be30 msgr2=0x7f6ddc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6ddc06be30 0x7f6ddc06e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6de4006fd0 tx=0x7f6de4008040 comp rx=0 tx=0).stop 2024-06-10T00:16:29.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 msgr2=0x7f6dfc0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:29.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0ccf30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00d800 tx=0x7f6dec00dcc0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 shutdown_connections 2024-06-10T00:16:29.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6ddc06be30 0x7f6ddc06e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc161c10 0x7f6dfc1f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc161830 0x7f6dfc0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 --2- 172.21.15.79:0/833180046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dfc0d0a00 0x7f6dfc0ccf30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:29.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 >> 172.21.15.79:0/833180046 conn(0x7f6dfc09d3e0 msgr2=0x7f6dfc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:29.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 shutdown_connections 2024-06-10T00:16:29.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:29.709+0000 7f6e01837640 1 -- 172.21.15.79:0/833180046 wait complete. 2024-06-10T00:16:30.122 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:16:20.631079+0000', 'modified': '2024-06-10T00:16:22.637364+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5394}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5394': {'gid': 5394, 'name': 'd', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6835/1724490819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6833', 'nonce': 1724490819}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 1724490819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5394, 'qdb_cluster': [5394]} 2024-06-10T00:16:30.122 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:16:30.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-06-10T00:16:30.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.227+0000 7efdde2ee640 1 Processor -- start 2024-06-10T00:16:30.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.227+0000 7efdde2ee640 1 -- start start 2024-06-10T00:16:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.227+0000 7efdde2ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdd8161830 0x7efdd80b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.227+0000 7efdde2ee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efdd8161c10 0x7efdd80d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.227+0000 7efdde2ee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd80cebb0 con 0x7efdd80d0a00 2024-06-10T00:16:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.227+0000 7efdde2ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80d4cf0 con 0x7efdd8161830 2024-06-10T00:16:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.227+0000 7efdde2ee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80d2fc0 con 0x7efdd8161c10 2024-06-10T00:16:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdd8161830 0x7efdd80b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efdd8161830 0x7efdd80b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34382/0 (socket says 172.21.15.79:34382) 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd7fff640 1 -- 172.21.15.79:0/3562819014 learned_addr learned my addr 172.21.15.79:0/3562819014 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3562819014 >> v2:172.21.15.117:3300/0 conn(0x7efdd8161c10 0x7efdd80d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd7fff640 1 -- 172.21.15.79:0/3562819014 >> v2:172.21.15.117:3300/0 conn(0x7efdd8161c10 msgr2=0x7efdd80d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd7fff640 1 --2- 172.21.15.79:0/3562819014 >> v2:172.21.15.117:3300/0 conn(0x7efdd8161c10 0x7efdd80d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd7fff640 1 -- 172.21.15.79:0/3562819014 >> v1:172.21.15.117:6789/0 conn(0x7efdd80d0a00 legacy=0x7efdd81620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd7fff640 1 -- 172.21.15.79:0/3562819014 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd80d4f20 con 0x7efdd8161830 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.228+0000 7efdd77fe640 1 --2- 172.21.15.79:0/3562819014 >> v2:172.21.15.117:3300/0 conn(0x7efdd8161c10 0x7efdd80d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdd7fff640 1 --2- 172.21.15.79:0/3562819014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161830 0x7efdd80b5270 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efdd808e890 tx=0x7efdc802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c75f094746e0e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdd6ffd640 1 -- 172.21.15.79:0/3562819014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8037070 con 0x7efdd8161830 2024-06-10T00:16:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdd6ffd640 1 -- 172.21.15.79:0/3562819014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8032440 con 0x7efdd8161830 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdd6ffd640 1 -- 172.21.15.79:0/3562819014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8032810 con 0x7efdd8161830 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdde2ee640 1 -- 172.21.15.79:0/3562819014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161830 msgr2=0x7efdd80b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdde2ee640 1 --2- 172.21.15.79:0/3562819014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161830 0x7efdd80b5270 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efdd808e890 tx=0x7efdc802a230 comp rx=0 tx=0).stop 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdde2ee640 1 -- 172.21.15.79:0/3562819014 shutdown_connections 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdde2ee640 1 --2- 172.21.15.79:0/3562819014 >> v2:172.21.15.117:3300/0 conn(0x7efdd8161c10 0x7efdd80d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdde2ee640 1 --2- 172.21.15.79:0/3562819014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161830 0x7efdd80b5270 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdde2ee640 1 -- 172.21.15.79:0/3562819014 >> 172.21.15.79:0/3562819014 conn(0x7efdd809d3e0 msgr2=0x7efdd80d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdde2ee640 1 -- 172.21.15.79:0/3562819014 shutdown_connections 2024-06-10T00:16:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.229+0000 7efdde2ee640 1 -- 172.21.15.79:0/3562819014 wait complete. 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.230+0000 7efdde2ee640 1 Processor -- start 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.231+0000 7efdde2ee640 1 -- start start 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.231+0000 7efdde2ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd80d0a00 0x7efdd80cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.231+0000 7efdde2ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd8161830 0x7efdd80cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.231+0000 7efdde2ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161c10 0x7efdd8153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.231+0000 7efdde2ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80d2ce0 con 0x7efdd8161c10 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.231+0000 7efdde2ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80d2a00 con 0x7efdd8161830 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.231+0000 7efdde2ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efdd80d0060 con 0x7efdd80d0a00 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161c10 0x7efdd8153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161c10 0x7efdd8153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34386/0 (socket says 172.21.15.79:34386) 2024-06-10T00:16:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 -- 172.21.15.79:0/2090874510 learned_addr learned my addr 172.21.15.79:0/2090874510 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd80d0a00 0x7efdd80cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efdd77fe640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd8161830 0x7efdd80cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 -- 172.21.15.79:0/2090874510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd80d0a00 msgr2=0x7efdd80cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd80d0a00 0x7efdd80cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 -- 172.21.15.79:0/2090874510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd8161830 msgr2=0x7efdd80cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd8161830 0x7efdd80cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 -- 172.21.15.79:0/2090874510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd80ce080 con 0x7efdd8161c10 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efddc88b640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161c10 0x7efdd8153270 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b970 tx=0x7efdd000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efdd4ff9640 1 -- 172.21.15.79:0/2090874510 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0019070 con 0x7efdd8161c10 2024-06-10T00:16:30.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efdd4ff9640 1 -- 172.21.15.79:0/2090874510 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd000cb40 con 0x7efdd8161c10 2024-06-10T00:16:30.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efdde2ee640 1 -- 172.21.15.79:0/2090874510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd81537b0 con 0x7efdd8161c10 2024-06-10T00:16:30.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efdd4ff9640 1 -- 172.21.15.79:0/2090874510 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0014440 con 0x7efdd8161c10 2024-06-10T00:16:30.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.232+0000 7efdde2ee640 1 -- 172.21.15.79:0/2090874510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd80cdda0 con 0x7efdd8161c10 2024-06-10T00:16:30.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.234+0000 7efdd4ff9640 1 -- 172.21.15.79:0/2090874510 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdd001c070 con 0x7efdd8161c10 2024-06-10T00:16:30.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.234+0000 7efdd4ff9640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efdc406be30 0x7efdc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.234+0000 7efdd4ff9640 1 -- 172.21.15.79:0/2090874510 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7efdd008abb0 con 0x7efdd8161c10 2024-06-10T00:16:30.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.234+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efdc406be30 0x7efdc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.235+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efdc406be30 0x7efdc406e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efdc8034000 tx=0x7efdc802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.235+0000 7efde0ff6740 1 Processor -- start 2024-06-10T00:16:30.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.235+0000 7efde0ff6740 1 -- start start 2024-06-10T00:16:30.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc4f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4d0e0 0x5596bbc4fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc1f960 0x5596bbc23170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efde0ff6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5596bbb88740 con 0x5596bbc4cd00 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efde0ff6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5596bbb26a80 con 0x5596bbc4d0e0 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efde0ff6740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5596bbb84700 con 0x5596bbc1f960 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc4f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc4f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34388/0 (socket says 172.21.15.79:34388) 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 -- 172.21.15.79:0/2093714489 learned_addr learned my addr 172.21.15.79:0/2093714489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 -- 172.21.15.79:0/2093714489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc1f960 msgr2=0x5596bbc23170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2093714489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc1f960 0x5596bbc23170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 -- 172.21.15.79:0/2093714489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4d0e0 msgr2=0x5596bbc4fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2093714489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4d0e0 0x5596bbc4fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 -- 172.21.15.79:0/2093714489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596bbb51fb0 con 0x5596bbc4cd00 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2093714489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc4f510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efdc80090b0 tx=0x7efdc802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2aac0a9c5f617b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdbdffb640 1 -- 172.21.15.79:0/2093714489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc804e070 con 0x5596bbc4cd00 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdbdffb640 1 -- 172.21.15.79:0/2093714489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8032d60 con 0x5596bbc4cd00 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.236+0000 7efdbdffb640 1 -- 172.21.15.79:0/2093714489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8037040 con 0x5596bbc4cd00 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 -- 172.21.15.79:0/2093714489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 msgr2=0x5596bbc4f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2093714489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc4f510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efdc80090b0 tx=0x7efdc802c000 comp rx=0 tx=0).stop 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 -- 172.21.15.79:0/2093714489 shutdown_connections 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2093714489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc1f960 0x5596bbc23170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2093714489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4d0e0 0x5596bbc4fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2093714489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc4f510 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 -- 172.21.15.79:0/2093714489 >> 172.21.15.79:0/2093714489 conn(0x5596bbc21bd0 msgr2=0x5596bbc6a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 -- 172.21.15.79:0/2093714489 shutdown_connections 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.237+0000 7efde0ff6740 1 -- 172.21.15.79:0/2093714489 wait complete. 2024-06-10T00:16:30.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.238+0000 7efde0ff6740 1 -- start start 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.238+0000 7efde0ff6740 1 Processor -- start 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4cd00 0x5596bbc40980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 0x5596bbc66c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc24030 0x5596bbc244b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5596bbc24d80 con 0x5596bbc24030 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5596bbb11c30 con 0x5596bbc4cd00 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5596bbc25060 con 0x5596bbc4d0e0 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 10 client.0 _ll_register_callbacks cb 0x5596bbb437f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc24030 0x5596bbc244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc24030 0x5596bbc244b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34400/0 (socket says 172.21.15.79:34400) 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 -- 172.21.15.79:0/2669006501 learned_addr learned my addr 172.21.15.79:0/2669006501 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4cd00 0x5596bbc40980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efdd77fe640 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 0x5596bbc66c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 -- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 msgr2=0x5596bbc66c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 0x5596bbc66c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 -- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4cd00 msgr2=0x5596bbc40980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4cd00 0x5596bbc40980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 -- 172.21.15.79:0/2669006501 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596bb89c2d0 con 0x5596bbc24030 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4cd00 0x5596bbc40980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efddc88b640 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc24030 0x5596bbc244b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efdd0061410 tx=0x7efdd005d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9318844e90cccc9e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efdb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efdb6ffd640 1 -- 172.21.15.79:0/2669006501 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd00571d0 con 0x5596bbc24030 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efdb6ffd640 1 -- 172.21.15.79:0/2669006501 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7efdd0058260 con 0x5596bbc24030 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 1 -- 172.21.15.79:0/2669006501 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdc8032d60 con 0x5596bbc24030 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efdb6ffd640 1 -- 172.21.15.79:0/2669006501 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efdd0058460 con 0x5596bbc24030 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 10 client.5529 fetch_fsmap learned FSMap version 22 2024-06-10T00:16:30.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efde0ff6740 1 -- 172.21.15.79:0/2669006501 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x5596bb9666b0 con 0x5596bbc24030 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.239+0000 7efdb6ffd640 1 -- 172.21.15.79:0/2669006501 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8032d60 con 0x5596bbc24030 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efdb6ffd640 1 -- 172.21.15.79:0/2669006501 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7efdd0070020 con 0x5596bbc24030 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efde0ff6740 10 client.5529 fetch_fsmap finished waiting for FSMap version 22 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efde0ff6740 10 client.5529 resolve_mds: resolved name 'd' to daemon mds.d 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efde0ff6740 20 client.5529 populate_metadata read hostname 'smithi079' 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x5596bbc6bbe0 0x5596bbc6bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efde0ff6740 4 client.5529 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efde0ff6740 1 -- 172.21.15.79:0/2669006501 --> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596bbb95e70 con 0x5596bbc6bbe0 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x5596bbc6bbe0 0x5596bbc6bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efdd7fff640 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x5596bbc6bbe0 0x5596bbc6bfc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=887a457104e33d33 server_cookie=8ad3ba377980947d in_seq=0 out_seq=0 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.240+0000 7efdb6ffd640 10 client.5529 ms_handle_connect on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efdb6ffd640 1 -- 172.21.15.79:0/2669006501 <== mds.0 v2:172.21.15.117:6833/1724490819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5596bbb95e70 con 0x5596bbc6bbe0 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efdb6ffd640 10 client.5529 handle_command_reply: tid=0 2024-06-10T00:16:30.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 client.5529 shutdown 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 -- 172.21.15.79:0/2669006501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc24030 msgr2=0x5596bbc244b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc24030 0x5596bbc244b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efdd0061410 tx=0x7efdd005d110 comp rx=0 tx=0).stop 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 -- 172.21.15.79:0/2669006501 shutdown_connections 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x5596bbc6bbe0 0x5596bbc6bfc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc24030 0x5596bbc244b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 0x5596bbc66c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efdb6ffd640 0 client.5529 ms_handle_reset on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 --2- 172.21.15.79:0/2669006501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4cd00 0x5596bbc40980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 -- 172.21.15.79:0/2669006501 >> 172.21.15.79:0/2669006501 conn(0x5596bbc1f960 msgr2=0x5596bbc20910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 -- 172.21.15.79:0/2669006501 shutdown_connections 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 1 -- 172.21.15.79:0/2669006501 wait complete. 2024-06-10T00:16:30.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.241+0000 7efde0ff6740 20 client.5529 trim_cache size 0 max 16384 2024-06-10T00:16:30.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.260+0000 7efde0ff6740 1 Processor -- start 2024-06-10T00:16:30.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.260+0000 7efde0ff6740 1 -- start start 2024-06-10T00:16:30.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc24030 0x5596bbc7d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc52fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4d0e0 0x5596bbc53520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efde0ff6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8200cf0 con 0x5596bbc4cd00 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efde0ff6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efdd81ffe60 con 0x5596bbc4d0e0 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efde0ff6740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efdd81f4b40 con 0x5596bbc24030 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc52fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc52fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34402/0 (socket says 172.21.15.79:34402) 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 -- 172.21.15.79:0/1277991877 learned_addr learned my addr 172.21.15.79:0/1277991877 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 -- 172.21.15.79:0/1277991877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc24030 msgr2=0x5596bbc7d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 --2- 172.21.15.79:0/1277991877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc24030 0x5596bbc7d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 -- 172.21.15.79:0/1277991877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4d0e0 msgr2=0x5596bbc53520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 --2- 172.21.15.79:0/1277991877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4d0e0 0x5596bbc53520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 -- 172.21.15.79:0/1277991877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596bbc6a510 con 0x5596bbc4cd00 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdd77fe640 1 --2- 172.21.15.79:0/1277991877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc52fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efdd8156120 tx=0x7efdcc00ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4162132416263e12 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdbd7fa640 1 -- 172.21.15.79:0/1277991877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc012cd0 con 0x5596bbc4cd00 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdbd7fa640 1 -- 172.21.15.79:0/1277991877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc012e70 con 0x5596bbc4cd00 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.261+0000 7efdbd7fa640 1 -- 172.21.15.79:0/1277991877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc004250 con 0x5596bbc4cd00 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 -- 172.21.15.79:0/1277991877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 msgr2=0x5596bbc52fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1277991877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc52fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efdd8156120 tx=0x7efdcc00ae40 comp rx=0 tx=0).stop 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 -- 172.21.15.79:0/1277991877 shutdown_connections 2024-06-10T00:16:30.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1277991877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc4d0e0 0x5596bbc53520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1277991877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc52fe0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1277991877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc24030 0x5596bbc7d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 -- 172.21.15.79:0/1277991877 >> 172.21.15.79:0/1277991877 conn(0x5596bbc1f960 msgr2=0x5596bbc267f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:30.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 -- 172.21.15.79:0/1277991877 shutdown_connections 2024-06-10T00:16:30.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 -- 172.21.15.79:0/1277991877 wait complete. 2024-06-10T00:16:30.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.262+0000 7efde0ff6740 1 -- start start 2024-06-10T00:16:30.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.263+0000 7efde0ff6740 1 Processor -- start 2024-06-10T00:16:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.263+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc24030 0x5596bbce7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.263+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc20050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.263+0000 7efde0ff6740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 0x5596bbc682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.263+0000 7efde0ff6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5596bbc40ec0 con 0x5596bbc4cd00 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.263+0000 7efde0ff6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efdd81f5190 con 0x5596bbc24030 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.263+0000 7efde0ff6740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5596bbc6e360 con 0x5596bbc4d0e0 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.263+0000 7efde0ff6740 10 client.0 _ll_register_callbacks cb 0x7efdd00587e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc20050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc20050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34416/0 (socket says 172.21.15.79:34416) 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 -- 172.21.15.79:0/1176561939 learned_addr learned my addr 172.21.15.79:0/1176561939 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd7fff640 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc24030 0x5596bbce7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 -- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 msgr2=0x5596bbc682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 0x5596bbc682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 -- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc24030 msgr2=0x5596bbce7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc24030 0x5596bbce7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 -- 172.21.15.79:0/1176561939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596bbc7d6e0 con 0x5596bbc4cd00 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdd77fe640 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc20050 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efdcc008010 tx=0x7efdcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635c391fe9e54fc4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdb6ffd640 1 -- 172.21.15.79:0/1176561939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc02d060 con 0x5596bbc4cd00 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdb6ffd640 1 -- 172.21.15.79:0/1176561939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7efdcc003610 con 0x5596bbc4cd00 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efde0ff6740 1 -- 172.21.15.79:0/1176561939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdcc012e70 con 0x5596bbc4cd00 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdb6ffd640 1 -- 172.21.15.79:0/1176561939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efdcc003830 con 0x5596bbc4cd00 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efde0ff6740 10 client.5535 fetch_fsmap learned FSMap version 22 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efde0ff6740 1 -- 172.21.15.79:0/1176561939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x5596bbc20730 con 0x5596bbc4cd00 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.264+0000 7efdb6ffd640 1 -- 172.21.15.79:0/1176561939 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc012e70 con 0x5596bbc4cd00 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efdb6ffd640 1 -- 172.21.15.79:0/1176561939 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7efdcc0039d0 con 0x5596bbc4cd00 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efde0ff6740 10 client.5535 fetch_fsmap finished waiting for FSMap version 22 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efde0ff6740 10 client.5535 resolve_mds: resolved name 'd' to daemon mds.d 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efde0ff6740 20 client.5535 populate_metadata read hostname 'smithi079' 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x5596bbc6bbe0 0x5596bbc631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efde0ff6740 4 client.5535 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efde0ff6740 1 -- 172.21.15.79:0/1176561939 --> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] -- command(tid 0: {"prefix": "status"}) -- 0x5596bbc253d0 con 0x5596bbc6bbe0 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efdd7fff640 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x5596bbc6bbe0 0x5596bbc631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efdb6ffd640 10 client.5535 ms_handle_connect on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efdd7fff640 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x5596bbc6bbe0 0x5596bbc631d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53b630f0edb6d521 server_cookie=57ab81d99b0735e5 in_seq=0 out_seq=0 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efdb6ffd640 1 -- 172.21.15.79:0/1176561939 <== mds.0 v2:172.21.15.117:6833/1724490819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5596bbc253d0 con 0x5596bbc6bbe0 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efdb6ffd640 10 client.5535 handle_command_reply: tid=0 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.265+0000 7efde0ff6740 1 client.5535 shutdown 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 -- 172.21.15.79:0/1176561939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 msgr2=0x5596bbc20050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc20050 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efdcc008010 tx=0x7efdcc004730 comp rx=0 tx=0).stop 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 -- 172.21.15.79:0/1176561939 shutdown_connections 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x5596bbc6bbe0 0x5596bbc631d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5596bbc4d0e0 0x5596bbc682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596bbc4cd00 0x5596bbc20050 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 --2- 172.21.15.79:0/1176561939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5596bbc24030 0x5596bbce7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdb6ffd640 0 client.5535 ms_handle_reset on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 -- 172.21.15.79:0/1176561939 >> 172.21.15.79:0/1176561939 conn(0x5596bbc1f960 msgr2=0x5596bbc6a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 -- 172.21.15.79:0/1176561939 shutdown_connections 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 1 -- 172.21.15.79:0/1176561939 wait complete. 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efde0ff6740 20 client.5535 trim_cache size 0 max 16384 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:16:30.274 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5394, 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 8.9668503420000008, 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 22, 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 50, 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 50, 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.060549793 2024-06-10T00:16:30.275 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 -- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efdc406be30 msgr2=0x7efdc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efdc406be30 0x7efdc406e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efdc8034000 tx=0x7efdc802e000 comp rx=0 tx=0).stop 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 -- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161c10 msgr2=0x7efdd8153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161c10 0x7efdd8153270 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b970 tx=0x7efdd000be30 comp rx=0 tx=0).stop 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 -- 172.21.15.79:0/2090874510 shutdown_connections 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efdc406be30 0x7efdc406e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdd8161c10 0x7efdd8153270 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd8161830 0x7efdd80cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 --2- 172.21.15.79:0/2090874510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd80d0a00 0x7efdd80cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 -- 172.21.15.79:0/2090874510 >> 172.21.15.79:0/2090874510 conn(0x7efdd809d3e0 msgr2=0x7efdd806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:30.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 -- 172.21.15.79:0/2090874510 shutdown_connections 2024-06-10T00:16:30.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.266+0000 7efdde2ee640 1 -- 172.21.15.79:0/2090874510 wait complete. 2024-06-10T00:16:30.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:16:30.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.379+0000 7f1559f90640 1 Processor -- start 2024-06-10T00:16:30.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.379+0000 7f1559f90640 1 -- start start 2024-06-10T00:16:30.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.379+0000 7f1559f90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15540d2680 0x7f155415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.379+0000 7f1559f90640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15540d1fc0 0x7f15540d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.379+0000 7f1559f90640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15540d2fa0 con 0x7f1554161fa0 2024-06-10T00:16:30.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.379+0000 7f1559f90640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f15540cff80 con 0x7f15540d1fc0 2024-06-10T00:16:30.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.379+0000 7f1559f90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15540d13e0 con 0x7f15540d2680 2024-06-10T00:16:30.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f1552ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15540d1fc0 0x7f15540d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f1553fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1554161fa0 0x7f1554162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:57870/0 (socket says 172.21.15.79:57870) 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f1553fff640 1 -- 172.21.15.79:0/870584764 learned_addr learned my addr 172.21.15.79:0/870584764 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f1552ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15540d1fc0 0x7f15540d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:33006/0 (socket says 172.21.15.79:33006) 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f15537fe640 1 --2- 172.21.15.79:0/870584764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15540d2680 0x7f155415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f1552ffd640 1 -- 172.21.15.79:0/870584764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15540d2680 msgr2=0x7f155415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f1552ffd640 1 --2- 172.21.15.79:0/870584764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15540d2680 0x7f155415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f1552ffd640 1 -- 172.21.15.79:0/870584764 >> v1:172.21.15.117:6789/0 conn(0x7f1554161fa0 legacy=0x7f1554162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f1552ffd640 1 -- 172.21.15.79:0/870584764 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15540d0ad0 con 0x7f15540d1fc0 2024-06-10T00:16:30.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.380+0000 7f15527fc640 1 -- 172.21.15.79:0/870584764 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3867638447 0 0) 0x7f15540d2fa0 con 0x7f1554161fa0 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.381+0000 7f1552ffd640 1 --2- 172.21.15.79:0/870584764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d1fc0 0x7f15540d2a60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15480097a0 tx=0x7f154802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ee309affb983afc server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.381+0000 7f15527fc640 1 -- 172.21.15.79:0/870584764 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548037070 con 0x7f15540d1fc0 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.381+0000 7f15527fc640 1 -- 172.21.15.79:0/870584764 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1548032440 con 0x7f15540d1fc0 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.381+0000 7f15527fc640 1 -- 172.21.15.79:0/870584764 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548032810 con 0x7f15540d1fc0 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.382+0000 7f1559f90640 1 -- 172.21.15.79:0/870584764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d1fc0 msgr2=0x7f15540d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.382+0000 7f1559f90640 1 --2- 172.21.15.79:0/870584764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d1fc0 0x7f15540d2a60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15480097a0 tx=0x7f154802a180 comp rx=0 tx=0).stop 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.382+0000 7f1559f90640 1 -- 172.21.15.79:0/870584764 shutdown_connections 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.382+0000 7f1559f90640 1 --2- 172.21.15.79:0/870584764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d1fc0 0x7f15540d2a60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.382+0000 7f1559f90640 1 --2- 172.21.15.79:0/870584764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15540d2680 0x7f155415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.382+0000 7f1559f90640 1 -- 172.21.15.79:0/870584764 >> 172.21.15.79:0/870584764 conn(0x7f155409d3f0 msgr2=0x7f15540d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:30.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.382+0000 7f1559f90640 1 -- 172.21.15.79:0/870584764 shutdown_connections 2024-06-10T00:16:30.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.382+0000 7f1559f90640 1 -- 172.21.15.79:0/870584764 wait complete. 2024-06-10T00:16:30.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.383+0000 7f1559f90640 1 Processor -- start 2024-06-10T00:16:30.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.383+0000 7f1559f90640 1 -- start start 2024-06-10T00:16:30.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1559f90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540d1fc0 0x7f15540b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1559f90640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d2680 0x7f155415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1559f90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1554161fa0 0x7f15540cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1559f90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15540d1070 con 0x7f15540d1fc0 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1559f90640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15540d0d90 con 0x7f15540d2680 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1559f90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15540d2400 con 0x7f1554161fa0 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540d1fc0 0x7f15540b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540d1fc0 0x7f15540b9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34422/0 (socket says 172.21.15.79:34422) 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 -- 172.21.15.79:0/595793093 learned_addr learned my addr 172.21.15.79:0/595793093 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 -- 172.21.15.79:0/595793093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1554161fa0 msgr2=0x7f15540cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1552ffd640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d2680 0x7f155415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1553fff640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1554161fa0 0x7f15540cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1554161fa0 0x7f15540cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 -- 172.21.15.79:0/595793093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d2680 msgr2=0x7f155415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d2680 0x7f155415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 -- 172.21.15.79:0/595793093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15540b87a0 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f15537fe640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540d1fc0 0x7f15540b9840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f154400e9b0 tx=0x7f154400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f153bfff640 1 -- 172.21.15.79:0/595793093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544017070 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f153bfff640 1 -- 172.21.15.79:0/595793093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154400c9a0 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.384+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15540b8a80 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.385+0000 7f153bfff640 1 -- 172.21.15.79:0/595793093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154400cd90 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.385+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15540b9040 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.385+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1554068430 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.386+0000 7f153bfff640 1 -- 172.21.15.79:0/595793093 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f154401a070 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.386+0000 7f153bfff640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f154006be30 0x7f154006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.386+0000 7f153bfff640 1 -- 172.21.15.79:0/595793093 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f154408b400 con 0x7f15540d1fc0 2024-06-10T00:16:30.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.387+0000 7f1552ffd640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f154006be30 0x7f154006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:30.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.387+0000 7f1552ffd640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f154006be30 0x7f154006e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1548034000 tx=0x7f154802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:30.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.391+0000 7f153bfff640 1 -- 172.21.15.79:0/595793093 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1544059b90 con 0x7f15540d1fc0 2024-06-10T00:16:30.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.603+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f15540d04e0 con 0x7f15540d1fc0 2024-06-10T00:16:30.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.603+0000 7f153bfff640 1 -- 172.21.15.79:0/595793093 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f1544059490 con 0x7f15540d1fc0 2024-06-10T00:16:30.603 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:16:30.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f154006be30 msgr2=0x7f154006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f154006be30 0x7f154006e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1548034000 tx=0x7f154802e000 comp rx=0 tx=0).stop 2024-06-10T00:16:30.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540d1fc0 msgr2=0x7f15540b9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540d1fc0 0x7f15540b9840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f154400e9b0 tx=0x7f154400ee70 comp rx=0 tx=0).stop 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 shutdown_connections 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f154006be30 0x7f154006e2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1554161fa0 0x7f15540cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15540d2680 0x7f155415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 --2- 172.21.15.79:0/595793093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15540d1fc0 0x7f15540b9840 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.605+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 >> 172.21.15.79:0/595793093 conn(0x7f155409d3f0 msgr2=0x7f15541605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.606+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 shutdown_connections 2024-06-10T00:16:30.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30.606+0000 7f1559f90640 1 -- 172.21.15.79:0/595793093 wait complete. 2024-06-10T00:16:30.616 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:16:30.616 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:16:30.616 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:16:30.616 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:16:30.616 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:16:30.616 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:16:30.616 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:16:30.616 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:16:30.617 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:16:30.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:30.617 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:16:30.632 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:16:30.633 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42654sec preferred_lft 42654sec 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:16:30.634 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:16:30.635 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:16:30.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:30.636 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:16:30.696 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:16:30.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:30.698 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:16:30.754 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:16:30.754 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:16:30.754 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:16:30.754 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:16:30.754 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:16:30.754 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:16:30.755 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:16:30.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:16:30.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:16:30.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:16:30.755 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:16:30.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:16:30.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:16:30.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:30.879 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:16:30.894 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:16:30.894 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:16:30.894 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:16:30.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:30.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:16:30.960 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:16:30.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:16:30.960 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:16:31.016 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:16:31.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:16:31.016 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:16:31.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:16:31.136 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:16:31.193 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:16:31.193 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:16:31.193 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:16:31.193 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:16:31.193 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:16:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:16:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:16:31.196 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:16:31.196 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:16:31.196 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:16:31.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:31.197 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:16:31.252 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:16:31.252 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:16:31.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:16:31.323 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:16:31.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:16:31.376+0000 7fbce071f480 -1 init, newargv = 0x557def0aa500 newargc=15 2024-06-10T00:16:31.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[54024]: starting ceph client 2024-06-10T00:16:31.380 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:16:31.380 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:16:31.380 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:16:31.380 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:16:31.380 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:16:31.381 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:16:31.382 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:16:31.383 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:16:31.383 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:16:31.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:31.383 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:16:31.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[54024]: starting fuse 2024-06-10T00:16:31.397 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:16:31.398 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:16:31.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:16:31.398 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:16:31.398 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:16:31.398 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:16:31.398 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:16:31.398 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:16:31.398 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:16:31.398 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:16:31.399 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:16:31.400 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:16:31.400 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:16:31.400 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:16:31.400 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:16:31.400 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:16:31.400 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:16:31.517 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.54024.asok 2024-06-10T00:16:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:16:31.528 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54024.asok 2024-06-10T00:16:31.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:31.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54024.asok status 2024-06-10T00:16:31.661 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:16:31.661 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:16:31.661 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:16:31.661 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:16:31.661 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "54024", 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5547, 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:16:31.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 5547 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2058089885 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2058089885 2024-06-10T00:16:31.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.5547 192.168.0.1:0/2058089885", 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/2058089885", 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 22, 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 50, 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:16:31.664 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:16:31.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:31.669 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:16:31.670 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:16:31.685 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:16:31.685 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:16:31.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:31.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:16:31.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:31.751 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-06-10T00:16:31.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:31.814 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-06-10T00:16:31.872 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:16:31.872 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:16:31.872 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:16:31.872 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:16:31.872 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-06-10T00:16:31.872 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:16:31.978 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-06-10T00:16:31.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:16:31.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:16:32.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.127+0000 7f8360aa5640 1 Processor -- start 2024-06-10T00:16:32.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.127+0000 7f8360aa5640 1 -- start start 2024-06-10T00:16:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8360aa5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c0cc6d0 0x7f835c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8360aa5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f835c0720e0 0x7f835c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8360aa5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f835c0ccff0 con 0x7f835c071c60 2024-06-10T00:16:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8360aa5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f835c072550 con 0x7f835c0720e0 2024-06-10T00:16:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8360aa5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f835c072820 con 0x7f835c0cc6d0 2024-06-10T00:16:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8353fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f835c071c60 0x7f835c0b36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35330/0 (socket says 172.21.15.79:35330) 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8353fff640 1 -- 172.21.15.79:0/3050882825 learned_addr learned my addr 172.21.15.79:0/3050882825 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f835ad9d640 1 --2- 172.21.15.79:0/3050882825 >> v2:172.21.15.117:3300/0 conn(0x7f835c0720e0 0x7f835c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f835a59c640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c0cc6d0 0x7f835c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379521645 0 0) 0x7f835c0ccff0 con 0x7f835c071c60 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8348003520 con 0x7f835c071c60 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3319441530 0 0) 0x7f8348003520 con 0x7f835c071c60 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c0cc6d0 msgr2=0x7f835c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c0cc6d0 0x7f835c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 >> v2:172.21.15.117:3300/0 conn(0x7f835c0720e0 msgr2=0x7f835c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 --2- 172.21.15.79:0/3050882825 >> v2:172.21.15.117:3300/0 conn(0x7f835c0720e0 0x7f835c0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c072b00 con 0x7f835c071c60 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f8344001670 con 0x7f835c071c60 2024-06-10T00:16:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.128+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 >> v1:172.21.15.79:6789/0 conn(0x7f835c071c60 legacy=0x7f835c0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f8359d9b640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c0cc6d0 0x7f83480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f8359d9b640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8348003f30 0x7f8348004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f8359d9b640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f83480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f835c072550 con 0x7f8348004d40 2024-06-10T00:16:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f835c072820 con 0x7f8348003f30 2024-06-10T00:16:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f834800b9c0 con 0x7f835c0cc6d0 2024-06-10T00:16:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f835ad9d640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f83480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f8353fff640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8348003f30 0x7f8348004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f835a59c640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c0cc6d0 0x7f83480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f835ad9d640 1 -- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c0cc6d0 msgr2=0x7f83480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f835ad9d640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c0cc6d0 0x7f83480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f835ad9d640 1 -- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8348003f30 msgr2=0x7f8348004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f835ad9d640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8348003f30 0x7f8348004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.129+0000 7f835ad9d640 1 -- 172.21.15.79:0/3050882825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8348003520 con 0x7f8348004d40 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f835ad9d640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f83480051c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8354009fc0 tx=0x7f8348005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76583dd35d26db46 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354009c10 con 0x7f8348004d40 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8354036070 con 0x7f8348004d40 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8359d9b640 1 -- 172.21.15.79:0/3050882825 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835402d070 con 0x7f8348004d40 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8360aa5640 1 -- 172.21.15.79:0/3050882825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 msgr2=0x7f83480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8360aa5640 1 --2- 172.21.15.79:0/3050882825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f83480051c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8354009fc0 tx=0x7f8348005830 comp rx=0 tx=0).stop 2024-06-10T00:16:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f835ad9d640 1 -- 172.21.15.79:0/3050882825 reap_dead start 2024-06-10T00:16:32.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8360aa5640 1 -- 172.21.15.79:0/3050882825 shutdown_connections 2024-06-10T00:16:32.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8360aa5640 1 -- 172.21.15.79:0/3050882825 >> 172.21.15.79:0/3050882825 conn(0x7f835c0b19f0 msgr2=0x7f835c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8360aa5640 1 -- 172.21.15.79:0/3050882825 shutdown_connections 2024-06-10T00:16:32.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.130+0000 7f8360aa5640 1 -- 172.21.15.79:0/3050882825 wait complete. 2024-06-10T00:16:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f8360aa5640 1 Processor -- start 2024-06-10T00:16:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f8360aa5640 1 -- start start 2024-06-10T00:16:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f8360aa5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f835c146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f8360aa5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f835c15e4b0 0x7f835c15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f8360aa5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c09c4d0 0x7f835c09c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f8360aa5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f835c15c890 con 0x7f8348004d40 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f8360aa5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0b31a0 con 0x7f835c15e4b0 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f8360aa5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f835c159f60 con 0x7f835c09c4d0 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f835a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f835c146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f835a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f835c146040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34436/0 (socket says 172.21.15.79:34436) 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.132+0000 7f835a59c640 1 -- 172.21.15.79:0/3070442576 learned_addr learned my addr 172.21.15.79:0/3070442576 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f8353fff640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f835c15e4b0 0x7f835c15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f835a59c640 1 -- 172.21.15.79:0/3070442576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c09c4d0 msgr2=0x7f835c09c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f835a59c640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c09c4d0 0x7f835c09c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f835a59c640 1 -- 172.21.15.79:0/3070442576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f835c15e4b0 msgr2=0x7f835c15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f835a59c640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f835c15e4b0 0x7f835c15e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f835a59c640 1 -- 172.21.15.79:0/3070442576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c09d270 con 0x7f8348004d40 2024-06-10T00:16:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f835a59c640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f835c146040 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f834c011920 tx=0x7f834c011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f8352ffd640 1 -- 172.21.15.79:0/3070442576 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c00fa90 con 0x7f8348004d40 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f8352ffd640 1 -- 172.21.15.79:0/3070442576 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c00fc30 con 0x7f8348004d40 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f8352ffd640 1 -- 172.21.15.79:0/3070442576 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c014440 con 0x7f8348004d40 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c09d550 con 0x7f8348004d40 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.133+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c1466e0 con 0x7f8348004d40 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.134+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c15ee70 con 0x7f8348004d40 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.135+0000 7f8352ffd640 1 -- 172.21.15.79:0/3070442576 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f834c012040 con 0x7f8348004d40 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.135+0000 7f8352ffd640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f833c06be30 0x7f833c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.135+0000 7f8353fff640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f833c06be30 0x7f833c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.135+0000 7f8352ffd640 1 -- 172.21.15.79:0/3070442576 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f834c08b5b0 con 0x7f8348004d40 2024-06-10T00:16:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.136+0000 7f8353fff640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f833c06be30 0x7f833c06e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8344000fb0 tx=0x7f8344009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.140+0000 7f8352ffd640 1 -- 172.21.15.79:0/3070442576 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f834c019030 con 0x7f8348004d40 2024-06-10T00:16:32.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.351+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f835c068430 con 0x7f8348004d40 2024-06-10T00:16:32.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.351+0000 7f8352ffd640 1 -- 172.21.15.79:0/3070442576 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5184 (secure 0 0 0) 0x7f834c059dd0 con 0x7f8348004d40 2024-06-10T00:16:32.351 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:32.351 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:16:20.631079+0000","modified":"2024-06-10T00:16:22.637364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1724490819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1724490819},{"type":"v1","addr":"172.21.15.117:6835","nonce":1724490819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":3}]} 2024-06-10T00:16:32.352 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-06-10T00:16:32.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f833c06be30 msgr2=0x7f833c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f833c06be30 0x7f833c06e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8344000fb0 tx=0x7f8344009040 comp rx=0 tx=0).stop 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 msgr2=0x7f835c146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f835c146040 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f834c011920 tx=0x7f834c011de0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 shutdown_connections 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f833c06be30 0x7f833c06e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835c09c4d0 0x7f835c09c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f835c15e4b0 0x7f835c15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 --2- 172.21.15.79:0/3070442576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8348004d40 0x7f835c146040 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 >> 172.21.15.79:0/3070442576 conn(0x7f835c0b19f0 msgr2=0x7f835c15ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 shutdown_connections 2024-06-10T00:16:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.354+0000 7f8360aa5640 1 -- 172.21.15.79:0/3070442576 wait complete. 2024-06-10T00:16:32.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-06-10T00:16:32.503 INFO:teuthology.orchestra.run.smithi117.stdout:{"return_code":0} 2024-06-10T00:16:32.503 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:16:32.503 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-06-10T00:16:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.547+0000 7fc4cfd1af40 1 Processor -- start 2024-06-10T00:16:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.547+0000 7fc4cfd1af40 1 -- start start 2024-06-10T00:16:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4cfd1af40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010b3b4f0 0x55c010c0fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4cfd1af40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010c12930 0x55c010b3f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4cfd1af40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c010c16650 0x55c010b3f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4cfd1af40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c010b87240 con 0x55c010b3b4f0 2024-06-10T00:16:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4cfd1af40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c010ae4e30 con 0x55c010c12930 2024-06-10T00:16:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4cfd1af40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c010c13170 con 0x55c010c16650 2024-06-10T00:16:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010b3b4f0 0x55c010c0fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010b3b4f0 0x55c010c0fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34450/0 (socket says 172.21.15.79:34450) 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 -- 172.21.15.79:0/2177649843 learned_addr learned my addr 172.21.15.79:0/2177649843 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 -- 172.21.15.79:0/2177649843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c010c16650 msgr2=0x55c010b3f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 --2- 172.21.15.79:0/2177649843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c010c16650 0x55c010b3f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 -- 172.21.15.79:0/2177649843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010c12930 msgr2=0x55c010b3f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 --2- 172.21.15.79:0/2177649843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010c12930 0x55c010b3f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 -- 172.21.15.79:0/2177649843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c010a69cb0 con 0x55c010b3b4f0 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.548+0000 7fc4ccd4f640 1 --2- 172.21.15.79:0/2177649843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010b3b4f0 0x55c010c0fe00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000a770 tx=0x7fc4c000a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b07993093d2a9e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4c6ffd640 1 -- 172.21.15.79:0/2177649843 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0019070 con 0x55c010b3b4f0 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4c6ffd640 1 -- 172.21.15.79:0/2177649843 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c0007600 con 0x55c010b3b4f0 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4c6ffd640 1 -- 172.21.15.79:0/2177649843 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00079f0 con 0x55c010b3b4f0 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/2177649843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010b3b4f0 msgr2=0x55c010c0fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 --2- 172.21.15.79:0/2177649843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010b3b4f0 0x55c010c0fe00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000a770 tx=0x7fc4c000a860 comp rx=0 tx=0).stop 2024-06-10T00:16:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/2177649843 shutdown_connections 2024-06-10T00:16:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 --2- 172.21.15.79:0/2177649843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c010c16650 0x55c010b3f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 --2- 172.21.15.79:0/2177649843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010c12930 0x55c010b3f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 --2- 172.21.15.79:0/2177649843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010b3b4f0 0x55c010c0fe00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/2177649843 >> 172.21.15.79:0/2177649843 conn(0x55c010b3ca40 msgr2=0x55c010b3ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/2177649843 shutdown_connections 2024-06-10T00:16:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.549+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/2177649843 wait complete. 2024-06-10T00:16:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4cfd1af40 1 Processor -- start 2024-06-10T00:16:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4cfd1af40 1 -- start start 2024-06-10T00:16:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4cfd1af40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010b3b4f0 0x55c010ca0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4cfd1af40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010c12930 0x55c010c0e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4cfd1af40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c010c16650 0x55c010c0e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4cfd1af40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c010c10340 con 0x55c010c12930 2024-06-10T00:16:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4cfd1af40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c010b800a0 con 0x55c010b3b4f0 2024-06-10T00:16:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4cfd1af40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c010b3c0c0 con 0x55c010c16650 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.550+0000 7fc4c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010c12930 0x55c010c0e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010c12930 0x55c010c0e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34458/0 (socket says 172.21.15.79:34458) 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c7fff640 1 -- 172.21.15.79:0/1962582497 learned_addr learned my addr 172.21.15.79:0/1962582497 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4ccd4f640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010b3b4f0 0x55c010ca0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4cd550640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c010c16650 0x55c010c0e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c7fff640 1 -- 172.21.15.79:0/1962582497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c010c16650 msgr2=0x55c010c0e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c7fff640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c010c16650 0x55c010c0e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c7fff640 1 -- 172.21.15.79:0/1962582497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010b3b4f0 msgr2=0x55c010ca0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c7fff640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010b3b4f0 0x55c010ca0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c7fff640 1 -- 172.21.15.79:0/1962582497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c010b6c720 con 0x55c010c12930 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4ccd4f640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c010b3b4f0 0x55c010ca0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c7fff640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010c12930 0x55c010c0e390 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8025bc0 tx=0x7fc4b80458c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c5ffb640 1 -- 172.21.15.79:0/1962582497 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8059040 con 0x55c010c12930 2024-06-10T00:16:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c5ffb640 1 -- 172.21.15.79:0/1962582497 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b80549f0 con 0x55c010c12930 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c010c0ef50 con 0x55c010c12930 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4c5ffb640 1 -- 172.21.15.79:0/1962582497 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8054de0 con 0x55c010c12930 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.551+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c010c0f510 con 0x55c010c12930 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.552+0000 7fc4c5ffb640 1 -- 172.21.15.79:0/1962582497 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4b805f470 con 0x55c010c12930 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.553+0000 7fc4c5ffb640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc4b006a840 0x7fc4b006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.553+0000 7fc4c5ffb640 1 -- 172.21.15.79:0/1962582497 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fc4b80cdfa0 con 0x55c010c12930 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.553+0000 7fc4ccd4f640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc4b006a840 0x7fc4b006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.553+0000 7fc4cfd1af40 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c010ca27b0 0x55c010ca2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.553+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x55c010ca3100 con 0x55c010ca27b0 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.553+0000 7fc4cd550640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c010ca27b0 0x55c010ca2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.553+0000 7fc4ccd4f640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc4b006a840 0x7fc4b006cd00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000afd0 tx=0x7fc4c000c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.553+0000 7fc4cd550640 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c010ca27b0 0x55c010ca2bc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cd550640 1 -- 172.21.15.79:0/1962582497 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fc4c8003450 con 0x55c010ca27b0 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c010ca27b0 msgr2=0x55c010ca2bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c010ca27b0 0x55c010ca2bc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc4b006a840 msgr2=0x7fc4b006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc4b006a840 0x7fc4b006cd00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000afd0 tx=0x7fc4c000c000 comp rx=0 tx=0).stop 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010c12930 msgr2=0x55c010c0e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 --2- 172.21.15.79:0/1962582497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c010c12930 0x55c010c0e390 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8025bc0 tx=0x7fc4b80458c0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cd550640 1 -- 172.21.15.79:0/1962582497 reap_dead start 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 shutdown_connections 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 >> 172.21.15.79:0/1962582497 conn(0x55c010b3ca40 msgr2=0x55c010b3ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 shutdown_connections 2024-06-10T00:16:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.554+0000 7fc4cfd1af40 1 -- 172.21.15.79:0/1962582497 wait complete. 2024-06-10T00:16:32.558 INFO:teuthology.orchestra.run.smithi079.stdout:Yalphaparent_a 2024-06-10T00:16:32.558 DEBUG:teuthology.orchestra.run.smithi079:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-06-10T00:16:32.707 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:16:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-06-10T00:16:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "ancestors": [ 2024-06-10T00:16:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1099511627776, 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "alpha", 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 2 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1, 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "parent_a", 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 4 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 8, 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "old_pools": [] 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:16:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:32.712 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-06-10T00:16:32.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.756+0000 7fc7e9087f40 1 Processor -- start 2024-06-10T00:16:32.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.756+0000 7fc7e9087f40 1 -- start start 2024-06-10T00:16:32.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e9087f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83c2b10 0x5649f848fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e9087f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83ef080 0x5649f847e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e9087f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f847e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e9087f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649f83c2f20 con 0x5649f8494950 2024-06-10T00:16:32.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e9087f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5649f83f0220 con 0x5649f83c2b10 2024-06-10T00:16:32.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e9087f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5649f83ef7a0 con 0x5649f83ef080 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f847e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f847e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34484/0 (socket says 172.21.15.79:34484) 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 -- 172.21.15.79:0/1000280976 learned_addr learned my addr 172.21.15.79:0/1000280976 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e6b8a640 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83c2b10 0x5649f848fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7dffff640 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83ef080 0x5649f847e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 -- 172.21.15.79:0/1000280976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83ef080 msgr2=0x5649f847e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83ef080 0x5649f847e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 -- 172.21.15.79:0/1000280976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83c2b10 msgr2=0x5649f848fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83c2b10 0x5649f848fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 -- 172.21.15.79:0/1000280976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f8311e20 con 0x5649f8494950 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e738b640 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f847e770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000e830 tx=0x7fc7e000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daed3d212edf413d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.757+0000 7fc7e5b88640 1 -- 172.21.15.79:0/1000280976 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0014070 con 0x5649f8494950 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e5b88640 1 -- 172.21.15.79:0/1000280976 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e000cca0 con 0x5649f8494950 2024-06-10T00:16:32.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e5b88640 1 -- 172.21.15.79:0/1000280976 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00196a0 con 0x5649f8494950 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 -- 172.21.15.79:0/1000280976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 msgr2=0x5649f847e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f847e770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000e830 tx=0x7fc7e000ecf0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 -- 172.21.15.79:0/1000280976 shutdown_connections 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f847e770 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83ef080 0x5649f847e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 --2- 172.21.15.79:0/1000280976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83c2b10 0x5649f848fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 -- 172.21.15.79:0/1000280976 >> 172.21.15.79:0/1000280976 conn(0x5649f83c1280 msgr2=0x5649f8408b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 -- 172.21.15.79:0/1000280976 shutdown_connections 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.758+0000 7fc7e9087f40 1 -- 172.21.15.79:0/1000280976 wait complete. 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e9087f40 1 Processor -- start 2024-06-10T00:16:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e9087f40 1 -- start start 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e9087f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83c2b10 0x5649f83e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e9087f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83ef080 0x5649f847b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e9087f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f8408880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e9087f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649f83ec600 con 0x5649f8494950 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e9087f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5649f8497a10 con 0x5649f83ef080 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e9087f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5649f8497f40 con 0x5649f83c2b10 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e738b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f8408880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e738b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f8408880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34486/0 (socket says 172.21.15.79:34486) 2024-06-10T00:16:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e738b640 1 -- 172.21.15.79:0/2911116811 learned_addr learned my addr 172.21.15.79:0/2911116811 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7e6b8a640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83c2b10 0x5649f83e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.759+0000 7fc7dffff640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83ef080 0x5649f847b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e738b640 1 -- 172.21.15.79:0/2911116811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83c2b10 msgr2=0x5649f83e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e738b640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649f83c2b10 0x5649f83e6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e738b640 1 -- 172.21.15.79:0/2911116811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83ef080 msgr2=0x5649f847b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e738b640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5649f83ef080 0x5649f847b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e738b640 1 -- 172.21.15.79:0/2911116811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f82eccb0 con 0x5649f8494950 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e738b640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f8408880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0006fd0 tx=0x7fc7e00033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e4b86640 1 -- 172.21.15.79:0/2911116811 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0010650 con 0x5649f8494950 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e4b86640 1 -- 172.21.15.79:0/2911116811 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e0005690 con 0x5649f8494950 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649f848fa30 con 0x5649f8494950 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e4b86640 1 -- 172.21.15.79:0/2911116811 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0010a30 con 0x5649f8494950 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.760+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f847e3b0 con 0x5649f8494950 2024-06-10T00:16:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.761+0000 7fc7e4b86640 1 -- 172.21.15.79:0/2911116811 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7e0023400 con 0x5649f8494950 2024-06-10T00:16:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.762+0000 7fc7e4b86640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7c806a810 0x7fc7c806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.762+0000 7fc7e4b86640 1 -- 172.21.15.79:0/2911116811 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fc7e008bd10 con 0x5649f8494950 2024-06-10T00:16:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.762+0000 7fc7e6b8a640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7c806a810 0x7fc7c806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.762+0000 7fc7e9087f40 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5649f83e92a0 0x5649f83e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.762+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x5649f83eb350 con 0x5649f83e92a0 2024-06-10T00:16:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.762+0000 7fc7dffff640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5649f83e92a0 0x5649f83e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.762+0000 7fc7e6b8a640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7c806a810 0x7fc7c806ccd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8005fd0 tx=0x7fc7d800e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.763+0000 7fc7dffff640 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5649f83e92a0 0x5649f83e96a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7dffff640 1 -- 172.21.15.79:0/2911116811 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v50'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc7d0054970 con 0x5649f83e92a0 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5649f83e92a0 msgr2=0x5649f83e96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5649f83e92a0 0x5649f83e96a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7c806a810 msgr2=0x7fc7c806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7c806a810 0x7fc7c806ccd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8005fd0 tx=0x7fc7d800e040 comp rx=0 tx=0).stop 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 msgr2=0x5649f8408880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 --2- 172.21.15.79:0/2911116811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649f8494950 0x5649f8408880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0006fd0 tx=0x7fc7e00033a0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e738b640 1 -- 172.21.15.79:0/2911116811 reap_dead start 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 shutdown_connections 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 >> 172.21.15.79:0/2911116811 conn(0x5649f83c1280 msgr2=0x5649f83e20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 shutdown_connections 2024-06-10T00:16:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.764+0000 7fc7e9087f40 1 -- 172.21.15.79:0/2911116811 wait complete. 2024-06-10T00:16:32.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo daemon-helper kill ceph --cluster ceph -w 2024-06-10T00:16:32.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:32.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-06-10T00:16:32.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.874+0000 7fa0f9f90640 1 Processor -- start 2024-06-10T00:16:32.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.874+0000 7fa0f9f90640 1 -- start start 2024-06-10T00:16:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.874+0000 7fa0f9f90640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0f415e670 0x7fa0f40d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.874+0000 7fa0f9f90640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f415ec90 con 0x7fa0f40d1f30 2024-06-10T00:16:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.874+0000 7fa0f9f90640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f415ef70 con 0x7fa0f40d0e00 2024-06-10T00:16:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.874+0000 7fa0f9f90640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f415fa50 con 0x7fa0f415e670 2024-06-10T00:16:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.875+0000 7fa0f37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0f415e670 0x7fa0f40d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.875+0000 7fa0f37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0f415e670 0x7fa0f40d49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34496/0 (socket says 172.21.15.79:34496) 2024-06-10T00:16:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.875+0000 7fa0f2ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa0f40d1f30 0x7fa0f40d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35350/0 (socket says 172.21.15.79:35350) 2024-06-10T00:16:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.875+0000 7fa0f37fe640 1 -- 172.21.15.79:0/2915929754 learned_addr learned my addr 172.21.15.79:0/2915929754 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.875+0000 7fa0f37fe640 1 -- 172.21.15.79:0/2915929754 >> v1:172.21.15.117:6789/0 conn(0x7fa0f40d0e00 legacy=0x7fa0f40cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.875+0000 7fa0f37fe640 1 -- 172.21.15.79:0/2915929754 >> v1:172.21.15.79:6789/0 conn(0x7fa0f40d1f30 legacy=0x7fa0f40d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.875+0000 7fa0f37fe640 1 -- 172.21.15.79:0/2915929754 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f415f250 con 0x7fa0f415e670 2024-06-10T00:16:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.875+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2915929754 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050321396 0 0) 0x7fa0f415ec90 con 0x7fa0f40d1f30 2024-06-10T00:16:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/2915929754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f415e670 0x7fa0f40d49f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009870 tx=0x7fa0e402a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb61ae9f06be392 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2915929754 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4037070 con 0x7fa0f415e670 2024-06-10T00:16:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2915929754 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e4032640 con 0x7fa0f415e670 2024-06-10T00:16:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f27fc640 1 -- 172.21.15.79:0/2915929754 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4032a10 con 0x7fa0f415e670 2024-06-10T00:16:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2915929754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f415e670 msgr2=0x7fa0f40d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f9f90640 1 --2- 172.21.15.79:0/2915929754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f415e670 0x7fa0f40d49f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009870 tx=0x7fa0e402a3c0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2915929754 shutdown_connections 2024-06-10T00:16:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f9f90640 1 --2- 172.21.15.79:0/2915929754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f415e670 0x7fa0f40d49f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.876+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2915929754 >> 172.21.15.79:0/2915929754 conn(0x7fa0f409d400 msgr2=0x7fa0f40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.877+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2915929754 shutdown_connections 2024-06-10T00:16:32.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.877+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2915929754 wait complete. 2024-06-10T00:16:32.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.878+0000 7fa0f9f90640 1 Processor -- start 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.878+0000 7fa0f9f90640 1 -- start start 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f9f90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f40d0e00 0x7fa0f4156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f9f90640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0f40d1f30 0x7fa0f40c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f9f90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0f415e670 0x7fa0f40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f9f90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f40d2370 con 0x7fa0f40d0e00 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f9f90640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f415ea50 con 0x7fa0f40d1f30 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f9f90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f40cf2e0 con 0x7fa0f415e670 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f40d0e00 0x7fa0f4156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f40d0e00 0x7fa0f4156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34498/0 (socket says 172.21.15.79:34498) 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 -- 172.21.15.79:0/2152719244 learned_addr learned my addr 172.21.15.79:0/2152719244 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0f40d1f30 0x7fa0f40c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0f415e670 0x7fa0f40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 -- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0f415e670 msgr2=0x7fa0f40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0f415e670 0x7fa0f40b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 -- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0f40d1f30 msgr2=0x7fa0f40c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0f40d1f30 0x7fa0f40c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 -- 172.21.15.79:0/2152719244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f40b94e0 con 0x7fa0f40d0e00 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0f415e670 0x7fa0f40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f40d0e00 0x7fa0f4156e60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009870 tx=0x7fa0e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.879+0000 7fa0dbfff640 1 -- 172.21.15.79:0/2152719244 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4041070 con 0x7fa0f40d0e00 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.880+0000 7fa0dbfff640 1 -- 172.21.15.79:0/2152719244 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e403c870 con 0x7fa0f40d0e00 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.880+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2152719244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f40b97c0 con 0x7fa0f40d0e00 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.880+0000 7fa0dbfff640 1 -- 172.21.15.79:0/2152719244 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4037040 con 0x7fa0f40d0e00 2024-06-10T00:16:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.880+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2152719244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f40b7b70 con 0x7fa0f40d0e00 2024-06-10T00:16:32.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.882+0000 7fa0dbfff640 1 -- 172.21.15.79:0/2152719244 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0e4044070 con 0x7fa0f40d0e00 2024-06-10T00:16:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.882+0000 7fa0dbfff640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0e006be30 0x7fa0e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.882+0000 7fa0dbfff640 1 -- 172.21.15.79:0/2152719244 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fa0e40abd00 con 0x7fa0f40d0e00 2024-06-10T00:16:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.882+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0e006be30 0x7fa0e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.882+0000 7fa0fcd7a740 1 Processor -- start 2024-06-10T00:16:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.883+0000 7fa0fcd7a740 1 -- start start 2024-06-10T00:16:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.883+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0e006be30 0x7fa0e006e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8005fd0 tx=0x7fa0e8007f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.883+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 0x562d38e46ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.883+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e41f70 0x562d38e47430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.883+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e494a0 0x562d38e47970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.883+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d38daaa70 con 0x562d38e41f70 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.883+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562d38d48ca0 con 0x562d38e494a0 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.883+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562d38da6a30 con 0x562d38e6a8c0 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e41f70 0x562d38e47430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e41f70 0x562d38e47430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34510/0 (socket says 172.21.15.79:34510) 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/3047727036 learned_addr learned my addr 172.21.15.79:0/3047727036 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e494a0 0x562d38e47970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 0x562d38e46ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 msgr2=0x562d38e46ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 0x562d38e46ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e494a0 msgr2=0x562d38e47970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e494a0 0x562d38e47970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/3047727036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d38d73eb0 con 0x562d38e41f70 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e494a0 0x562d38e47970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e41f70 0x562d38e47430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8000f80 tx=0x7fa0e8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c55e1ab63767ed server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0d97fa640 1 -- 172.21.15.79:0/3047727036 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8004e30 con 0x562d38e41f70 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0d97fa640 1 -- 172.21.15.79:0/3047727036 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e80150d0 con 0x562d38e41f70 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.884+0000 7fa0d97fa640 1 -- 172.21.15.79:0/3047727036 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8015bc0 con 0x562d38e41f70 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/3047727036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e41f70 msgr2=0x562d38e47430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e41f70 0x562d38e47430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8000f80 tx=0x7fa0e8012000 comp rx=0 tx=0).stop 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/3047727036 shutdown_connections 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e494a0 0x562d38e47970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e41f70 0x562d38e47430 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/3047727036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 0x562d38e46ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/3047727036 >> 172.21.15.79:0/3047727036 conn(0x562d38e441e0 msgr2=0x562d38e8cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/3047727036 shutdown_connections 2024-06-10T00:16:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.885+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/3047727036 wait complete. 2024-06-10T00:16:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 1 -- start start 2024-06-10T00:16:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 1 Processor -- start 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6a8c0 0x562d38e6b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6dc90 0x562d38ea03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38ea0910 0x562d38e5fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d38e459b0 con 0x562d38e6dc90 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562d38d33e50 con 0x562d38e6a8c0 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562d38e6aca0 con 0x562d38ea0910 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0fcd7a740 10 client.0 _ll_register_callbacks cb 0x562d38abdc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.886+0000 7fa0f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6dc90 0x562d38ea03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6dc90 0x562d38ea03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34516/0 (socket says 172.21.15.79:34516) 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/1524834463 learned_addr learned my addr 172.21.15.79:0/1524834463 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6a8c0 0x562d38e6b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38ea0910 0x562d38e5fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38ea0910 msgr2=0x562d38e5fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38ea0910 0x562d38e5fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6a8c0 msgr2=0x562d38e6b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6a8c0 0x562d38e6b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/1524834463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d38b867e0 con 0x562d38e6dc90 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38ea0910 0x562d38e5fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6dc90 0x562d38ea03d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x562d38e43330 tx=0x7fa0e8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afea080f9bec268 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1524834463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8010040 con 0x562d38e6dc90 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1524834463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fa0e8021650 con 0x562d38e6dc90 2024-06-10T00:16:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1524834463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0e80150d0 con 0x562d38e6dc90 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1524834463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa0e8033050 con 0x562d38e6dc90 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0fcd7a740 10 client.5589 fetch_fsmap learned FSMap version 22 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1524834463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x562d38be6f70 con 0x562d38e6dc90 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.887+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1524834463 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e80150d0 con 0x562d38e6dc90 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1524834463 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7fa0e8036020 con 0x562d38e6dc90 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0fcd7a740 10 client.5589 fetch_fsmap finished waiting for FSMap version 22 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0fcd7a740 10 client.5589 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0fcd7a740 20 client.5589 populate_metadata read hostname 'smithi079' 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x562d38e657e0 0x562d38e65bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0fcd7a740 4 client.5589 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1524834463 --> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d38db81a0 con 0x562d38e657e0 2024-06-10T00:16:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x562d38e657e0 0x562d38e65bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0d27fc640 10 client.5589 ms_handle_connect on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.888+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x562d38e657e0 0x562d38e65bf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8c0e8badede65e1 server_cookie=5199f004dc534abf in_seq=0 out_seq=0 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1524834463 <== mds.0 v2:172.21.15.117:6833/1724490819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562d38db81a0 con 0x562d38e657e0 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0d27fc640 10 client.5589 handle_command_reply: tid=0 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 client.5589 shutdown 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1524834463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6dc90 msgr2=0x562d38ea03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6dc90 0x562d38ea03d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x562d38e43330 tx=0x7fa0e8007d90 comp rx=0 tx=0).stop 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1524834463 shutdown_connections 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x562d38e657e0 0x562d38e65bf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38ea0910 0x562d38e5fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6dc90 0x562d38ea03d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0d27fc640 0 client.5589 ms_handle_reset on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1524834463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6a8c0 0x562d38e6b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1524834463 >> 172.21.15.79:0/1524834463 conn(0x562d38e494a0 msgr2=0x562d38e90210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1524834463 shutdown_connections 2024-06-10T00:16:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1524834463 wait complete. 2024-06-10T00:16:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.889+0000 7fa0fcd7a740 20 client.5589 trim_cache size 0 max 16384 2024-06-10T00:16:32.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.894+0000 7f6b8de12640 1 Processor -- start 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.894+0000 7f6b8de12640 1 -- start start 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b8de12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b88161a20 0x7f6b880d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b8de12640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b880cf740 0x7f6b880d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b8de12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b880d0aa0 0x7f6b880d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b8de12640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6b880cfce0 con 0x7f6b880cf740 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b8de12640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6b880cffc0 con 0x7f6b880d0aa0 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b8de12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6b880b38c0 con 0x7f6b88161a20 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b86ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b880cf740 0x7f6b880d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b877fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b88161a20 0x7f6b880d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b86ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b880cf740 0x7f6b880d0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34522/0 (socket says 172.21.15.79:34522) 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b86ffd640 1 -- 172.21.15.79:0/3867357146 learned_addr learned my addr 172.21.15.79:0/3867357146 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.895+0000 7f6b87fff640 1 --2- 172.21.15.79:0/3867357146 >> v2:172.21.15.117:3300/0 conn(0x7f6b880d0aa0 0x7f6b880d1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.896+0000 7f6b86ffd640 1 -- 172.21.15.79:0/3867357146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b88161a20 msgr2=0x7f6b880d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.896+0000 7f6b86ffd640 1 --2- 172.21.15.79:0/3867357146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b88161a20 0x7f6b880d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.896+0000 7f6b86ffd640 1 -- 172.21.15.79:0/3867357146 >> v2:172.21.15.117:3300/0 conn(0x7f6b880d0aa0 msgr2=0x7f6b880d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.896+0000 7f6b86ffd640 1 --2- 172.21.15.79:0/3867357146 >> v2:172.21.15.117:3300/0 conn(0x7f6b880d0aa0 0x7f6b880d1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.896+0000 7f6b86ffd640 1 -- 172.21.15.79:0/3867357146 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b880b3ba0 con 0x7f6b880cf740 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.896+0000 7f6b877fe640 1 --2- 172.21.15.79:0/3867357146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b88161a20 0x7f6b880d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.896+0000 7f6b87fff640 1 --2- 172.21.15.79:0/3867357146 >> v2:172.21.15.117:3300/0 conn(0x7f6b880d0aa0 0x7f6b880d1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b86ffd640 1 --2- 172.21.15.79:0/3867357146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b880cf740 0x7f6b880d0560 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6b880ba110 tx=0x7f6b7002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a41d771485c3bd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b867fc640 1 -- 172.21.15.79:0/3867357146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70037070 con 0x7f6b880cf740 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b867fc640 1 -- 172.21.15.79:0/3867357146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b70032440 con 0x7f6b880cf740 2024-06-10T00:16:32.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b867fc640 1 -- 172.21.15.79:0/3867357146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70032810 con 0x7f6b880cf740 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 -- 172.21.15.79:0/3867357146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b880cf740 msgr2=0x7f6b880d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 --2- 172.21.15.79:0/3867357146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b880cf740 0x7f6b880d0560 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6b880ba110 tx=0x7f6b7002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 -- 172.21.15.79:0/3867357146 shutdown_connections 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 --2- 172.21.15.79:0/3867357146 >> v2:172.21.15.117:3300/0 conn(0x7f6b880d0aa0 0x7f6b880d1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 --2- 172.21.15.79:0/3867357146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b880cf740 0x7f6b880d0560 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 --2- 172.21.15.79:0/3867357146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b88161a20 0x7f6b880d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 -- 172.21.15.79:0/3867357146 >> 172.21.15.79:0/3867357146 conn(0x7f6b880d4090 msgr2=0x7f6b880d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 -- 172.21.15.79:0/3867357146 shutdown_connections 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.897+0000 7f6b8de12640 1 -- 172.21.15.79:0/3867357146 wait complete. 2024-06-10T00:16:32.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.899+0000 7f6b8de12640 1 Processor -- start 2024-06-10T00:16:32.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.900+0000 7f6b8de12640 1 -- start start 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b8de12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b880cf740 0x7f6b880ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b8de12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b880d0aa0 0x7f6b880cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b8de12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b88161a20 0x7f6b8815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b8de12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b880d1350 con 0x7f6b880d0aa0 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b8de12640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b880b3e80 con 0x7f6b88161a20 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b8de12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6b88161e00 con 0x7f6b880cf740 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b880d0aa0 0x7f6b880cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b880d0aa0 0x7f6b880cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34528/0 (socket says 172.21.15.79:34528) 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 -- 172.21.15.79:0/123173009 learned_addr learned my addr 172.21.15.79:0/123173009 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 -- 172.21.15.79:0/123173009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b880cf740 msgr2=0x7f6b880ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 --2- 172.21.15.79:0/123173009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b880cf740 0x7f6b880ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 -- 172.21.15.79:0/123173009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b88161a20 msgr2=0x7f6b8815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 --2- 172.21.15.79:0/123173009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b88161a20 0x7f6b8815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 -- 172.21.15.79:0/123173009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b880cc4a0 con 0x7f6b880d0aa0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b86ffd640 1 --2- 172.21.15.79:0/123173009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b880d0aa0 0x7f6b880cbf60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6b70000c00 tx=0x7f6b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.901+0000 7f6b7ffff640 1 -- 172.21.15.79:0/123173009 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70041020 con 0x7f6b880d0aa0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.902+0000 7f6b7ffff640 1 -- 172.21.15.79:0/123173009 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b7003d620 con 0x7f6b880d0aa0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.902+0000 7f6b8de12640 1 -- 172.21.15.79:0/123173009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b880cc740 con 0x7f6b880d0aa0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.902+0000 7f6b7ffff640 1 -- 172.21.15.79:0/123173009 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70037040 con 0x7f6b880d0aa0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.902+0000 7f6b8de12640 1 -- 172.21.15.79:0/123173009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b880ccfe0 con 0x7f6b880d0aa0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.902+0000 7f6b8de12640 1 -- 172.21.15.79:0/123173009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f6b880684a0 con 0x7f6b880d0aa0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.903+0000 7f6b7ffff640 1 -- 172.21.15.79:0/123173009 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b70044020 con 0x7f6b880d0aa0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.904+0000 7f6b7ffff640 1 --2- 172.21.15.79:0/123173009 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6b6806be30 0x7f6b6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.904+0000 7f6b877fe640 1 --2- 172.21.15.79:0/123173009 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6b6806be30 0x7f6b6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.904+0000 7f6b7ffff640 1 -- 172.21.15.79:0/123173009 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f6b700abda0 con 0x7f6b880d0aa0 2024-06-10T00:16:32.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.904+0000 7f6b7ffff640 1 -- 172.21.15.79:0/123173009 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+501 (secure 0 0 0) 0x7f6b7004b030 con 0x7f6b880d0aa0 2024-06-10T00:16:32.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.904+0000 7f6b877fe640 1 --2- 172.21.15.79:0/123173009 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6b6806be30 0x7f6b6806e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800e250 tx=0x7f6b7800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.904+0000 7f6b8de12640 1 -- 172.21.15.79:0/123173009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f6b880ccad0 con 0x7f6b880d0aa0 2024-06-10T00:16:32.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.911+0000 7fa0fcd7a740 1 Processor -- start 2024-06-10T00:16:32.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.911+0000 7fa0fcd7a740 1 -- start start 2024-06-10T00:16:32.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e657e0 0x562d38e67230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6a8c0 0x562d38e60390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e65dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f4200d10 con 0x562d38e6a8c0 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f41ffe70 con 0x562d38e6dc90 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f40b8370 con 0x562d38e657e0 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6a8c0 0x562d38e60390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6a8c0 0x562d38e60390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34538/0 (socket says 172.21.15.79:34538) 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/901874881 learned_addr learned my addr 172.21.15.79:0/901874881 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e657e0 0x562d38e67230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e65dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e657e0 msgr2=0x562d38e67230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e657e0 0x562d38e67230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 msgr2=0x562d38e65dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e65dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f2ffd640 1 -- 172.21.15.79:0/901874881 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d38a7e170 con 0x562d38e6a8c0 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e657e0 0x562d38e67230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.912+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e65dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.913+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6a8c0 0x562d38e60390 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001450 tx=0x7fa0e8024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b286120e3614a3b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.913+0000 7fa0d8ff9640 1 -- 172.21.15.79:0/901874881 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8021450 con 0x562d38e6a8c0 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.913+0000 7fa0d8ff9640 1 -- 172.21.15.79:0/901874881 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e8021630 con 0x562d38e6a8c0 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.913+0000 7fa0d8ff9640 1 -- 172.21.15.79:0/901874881 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e802b680 con 0x562d38e6a8c0 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.913+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/901874881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6a8c0 msgr2=0x562d38e60390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.913+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6a8c0 0x562d38e60390 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001450 tx=0x7fa0e8024040 comp rx=0 tx=0).stop 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/901874881 shutdown_connections 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e65dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e6a8c0 0x562d38e60390 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/901874881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e657e0 0x562d38e67230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/901874881 >> 172.21.15.79:0/901874881 conn(0x562d38e494a0 msgr2=0x562d38e47ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/901874881 shutdown_connections 2024-06-10T00:16:32.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/901874881 wait complete. 2024-06-10T00:16:32.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 -- start start 2024-06-10T00:16:32.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.914+0000 7fa0fcd7a740 1 Processor -- start 2024-06-10T00:16:32.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e657e0 0x562d38e633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 0x562d38e63920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0fcd7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e6aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f40b89c0 con 0x562d38e657e0 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562d38d61070 con 0x562d38e6dc90 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0fcd7a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562d38e642e0 con 0x562d38e6a8c0 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0fcd7a740 10 client.0 _ll_register_callbacks cb 0x7fa0e8007a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e657e0 0x562d38e633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e657e0 0x562d38e633e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34552/0 (socket says 172.21.15.79:34552) 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 -- 172.21.15.79:0/1655272420 learned_addr learned my addr 172.21.15.79:0/1655272420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f3fff640 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e6aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 0x562d38e63920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 -- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 msgr2=0x562d38e63920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 0x562d38e63920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 -- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 msgr2=0x562d38e6aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e6aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 -- 172.21.15.79:0/1655272420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d38e830e0 con 0x562d38e657e0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0f37fe640 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e657e0 0x562d38e633e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40aa0a0 tx=0x7fa0e407a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db42188fb3b03b05 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.915+0000 7fa0d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1655272420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40765b0 con 0x562d38e657e0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1655272420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fa0e407a1a0 con 0x562d38e657e0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1655272420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0e8021630 con 0x562d38e657e0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1655272420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa0e4076750 con 0x562d38e657e0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 10 client.5601 fetch_fsmap learned FSMap version 22 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1655272420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x562d38f0e600 con 0x562d38e657e0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1655272420 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e8021630 con 0x562d38e657e0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1655272420 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7fa0e4082690 con 0x562d38e657e0 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 10 client.5601 fetch_fsmap finished waiting for FSMap version 22 2024-06-10T00:16:32.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 10 client.5601 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 20 client.5601 populate_metadata read hostname 'smithi079' 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x562d38ea0910 0x562d38e6b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 4 client.5601 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1655272420 --> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x562d38e6e750 con 0x562d38ea0910 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.916+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x562d38ea0910 0x562d38e6b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.917+0000 7fa0d27fc640 10 client.5601 ms_handle_connect on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.917+0000 7fa0f2ffd640 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x562d38ea0910 0x562d38e6b1e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=458a8cf0002cdb4e server_cookie=4b6ab6386818e9ca in_seq=0 out_seq=0 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.917+0000 7fa0d27fc640 1 -- 172.21.15.79:0/1655272420 <== mds.0 v2:172.21.15.117:6833/1724490819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562d38e6e750 con 0x562d38ea0910 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.917+0000 7fa0d27fc640 10 client.5601 handle_command_reply: tid=0 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.917+0000 7fa0fcd7a740 1 client.5601 shutdown 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.917+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1655272420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e657e0 msgr2=0x562d38e633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.917+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e657e0 0x562d38e633e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40aa0a0 tx=0x7fa0e407a700 comp rx=0 tx=0).stop 2024-06-10T00:16:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1655272420 shutdown_connections 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x562d38ea0910 0x562d38e6b1e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0d27fc640 0 client.5601 ms_handle_reset on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d38e6dc90 0x562d38e6aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d38e6a8c0 0x562d38e63920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 1 --2- 172.21.15.79:0/1655272420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d38e657e0 0x562d38e633e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1655272420 >> 172.21.15.79:0/1655272420 conn(0x562d38e494a0 msgr2=0x562d38e8ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1655272420 shutdown_connections 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 1 -- 172.21.15.79:0/1655272420 wait complete. 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0fcd7a740 20 client.5601 trim_cache size 0 max 16384 2024-06-10T00:16:32.923 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:16:32.924 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:16:32.924 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "5c75bbb2-728c-4f56-9363-c9d7f72e6e58", 2024-06-10T00:16:32.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:16:32.924 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0e006be30 msgr2=0x7fa0e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0e006be30 0x7fa0e006e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8005fd0 tx=0x7fa0e8007f10 comp rx=0 tx=0).stop 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f40d0e00 msgr2=0x7fa0f4156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f40d0e00 0x7fa0f4156e60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009870 tx=0x7fa0e40046c0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2152719244 shutdown_connections 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa0e006be30 0x7fa0e006e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0f415e670 0x7fa0f40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0f40d1f30 0x7fa0f40c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 --2- 172.21.15.79:0/2152719244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f40d0e00 0x7fa0f4156e60 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2152719244 >> 172.21.15.79:0/2152719244 conn(0x7fa0f409d400 msgr2=0x7fa0f40d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2152719244 shutdown_connections 2024-06-10T00:16:32.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:32.918+0000 7fa0f9f90640 1 -- 172.21.15.79:0/2152719244 wait complete. 2024-06-10T00:16:32.926 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-06-10T00:16:32.917+0000 7f4778a65640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5547=0-4194304@1} caps={5547=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5547 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x56265624e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-10T00:16:32.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:16:32.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-06-10T00:16:33.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.029+0000 7f304769a640 1 Processor -- start 2024-06-10T00:16:33.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.030+0000 7f304769a640 1 -- start start 2024-06-10T00:16:33.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.030+0000 7f304769a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30400d08f0 0x7f30400b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.030+0000 7f304769a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30400d0cd0 0x7f30400cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.030+0000 7f304769a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30400cf5e0 con 0x7f30400cf190 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.030+0000 7f304769a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f30400d1c80 con 0x7f30400d0cd0 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.030+0000 7f304769a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f30400cf8a0 con 0x7f30400d08f0 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.030+0000 7f3044c35640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30400d0cd0 0x7f30400cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.030+0000 7f3044c35640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30400d0cd0 0x7f30400cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34562/0 (socket says 172.21.15.79:34562) 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.031+0000 7f3044c35640 1 -- 172.21.15.79:0/3942623740 learned_addr learned my addr 172.21.15.79:0/3942623740 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.031+0000 7f3044c35640 1 -- 172.21.15.79:0/3942623740 >> v2:172.21.15.117:3300/0 conn(0x7f30400d08f0 msgr2=0x7f30400b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.031+0000 7f3045436640 1 --2- 172.21.15.79:0/3942623740 >> v2:172.21.15.117:3300/0 conn(0x7f30400d08f0 0x7f30400b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.031+0000 7f3044c35640 1 --2- 172.21.15.79:0/3942623740 >> v2:172.21.15.117:3300/0 conn(0x7f30400d08f0 0x7f30400b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.031+0000 7f3044c35640 1 -- 172.21.15.79:0/3942623740 >> v1:172.21.15.117:6789/0 conn(0x7f30400cf190 legacy=0x7f30400d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.031+0000 7f3044c35640 1 -- 172.21.15.79:0/3942623740 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30400cfb80 con 0x7f30400d0cd0 2024-06-10T00:16:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.031+0000 7f3044c35640 1 --2- 172.21.15.79:0/3942623740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400d0cd0 0x7f30400cec50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3030009870 tx=0x7f303002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9c22c4a8f06237 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f3037fff640 1 -- 172.21.15.79:0/3942623740 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3030037070 con 0x7f30400d0cd0 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f3037fff640 1 -- 172.21.15.79:0/3942623740 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3030032440 con 0x7f30400d0cd0 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f3037fff640 1 -- 172.21.15.79:0/3942623740 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3030032810 con 0x7f30400d0cd0 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f304769a640 1 -- 172.21.15.79:0/3942623740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400d0cd0 msgr2=0x7f30400cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f304769a640 1 --2- 172.21.15.79:0/3942623740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400d0cd0 0x7f30400cec50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3030009870 tx=0x7f303002a270 comp rx=0 tx=0).stop 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f304769a640 1 -- 172.21.15.79:0/3942623740 shutdown_connections 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f304769a640 1 --2- 172.21.15.79:0/3942623740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400d0cd0 0x7f30400cec50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f304769a640 1 --2- 172.21.15.79:0/3942623740 >> v2:172.21.15.117:3300/0 conn(0x7f30400d08f0 0x7f30400b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f304769a640 1 -- 172.21.15.79:0/3942623740 >> 172.21.15.79:0/3942623740 conn(0x7f304009d3c0 msgr2=0x7f30400d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f304769a640 1 -- 172.21.15.79:0/3942623740 shutdown_connections 2024-06-10T00:16:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.032+0000 7f304769a640 1 -- 172.21.15.79:0/3942623740 wait complete. 2024-06-10T00:16:33.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.033+0000 7f304769a640 1 Processor -- start 2024-06-10T00:16:33.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.033+0000 7f304769a640 1 -- start start 2024-06-10T00:16:33.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f304769a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400cf190 0x7f30400c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f304769a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30400d08f0 0x7f30400cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f304769a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30400d0cd0 0x7f30400ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f304769a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30400b50c0 con 0x7f30400cf190 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f304769a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30400d1ed0 con 0x7f30400d0cd0 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f304769a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30400d1180 con 0x7f30400d08f0 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f3045436640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400cf190 0x7f30400c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f3045436640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400cf190 0x7f30400c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34566/0 (socket says 172.21.15.79:34566) 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f3045436640 1 -- 172.21.15.79:0/717400465 learned_addr learned my addr 172.21.15.79:0/717400465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f3044c35640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30400d08f0 0x7f30400cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f3045c37640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30400d0cd0 0x7f30400ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f3045436640 1 -- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30400d08f0 msgr2=0x7f30400cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.034+0000 7f3045436640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30400d08f0 0x7f30400cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f3045436640 1 -- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30400d0cd0 msgr2=0x7f30400ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f3045436640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30400d0cd0 0x7f30400ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f3045436640 1 -- 172.21.15.79:0/717400465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30400c95d0 con 0x7f30400cf190 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f3045c37640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30400d0cd0 0x7f30400ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f3045436640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400cf190 0x7f30400c9090 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c7f0 tx=0x7f303c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f3035ffb640 1 -- 172.21.15.79:0/717400465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c015070 con 0x7f30400cf190 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f3035ffb640 1 -- 172.21.15.79:0/717400465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c004240 con 0x7f30400cf190 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f304769a640 1 -- 172.21.15.79:0/717400465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30400c98a0 con 0x7f30400cf190 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f3035ffb640 1 -- 172.21.15.79:0/717400465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c003610 con 0x7f30400cf190 2024-06-10T00:16:33.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.035+0000 7f304769a640 1 -- 172.21.15.79:0/717400465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30400c9e60 con 0x7f30400cf190 2024-06-10T00:16:33.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.036+0000 7f3035ffb640 1 -- 172.21.15.79:0/717400465 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f303c0039c0 con 0x7f30400cf190 2024-06-10T00:16:33.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.037+0000 7f3035ffb640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f302406be30 0x7f302406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.037+0000 7f3044c35640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f302406be30 0x7f302406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.037+0000 7f3035ffb640 1 -- 172.21.15.79:0/717400465 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f303c08b3a0 con 0x7f30400cf190 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.037+0000 7f3044c35640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f302406be30 0x7f302406e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3030034000 tx=0x7f303002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.038+0000 7f304a3a7740 1 Processor -- start 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.038+0000 7f304a3a7740 1 -- start start 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c23120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c1e1a0 0x55a518c23660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c256d0 0x55a518c23ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f304a3a7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a518b487e0 con 0x55a518c46af0 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f304a3a7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a518b86e80 con 0x55a518c1e1a0 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f304a3a7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a518b24700 con 0x55a518c256d0 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c23120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c23120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34576/0 (socket says 172.21.15.79:34576) 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 -- 172.21.15.79:0/181682124 learned_addr learned my addr 172.21.15.79:0/181682124 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045c37640 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c256d0 0x55a518c23ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3044c35640 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c1e1a0 0x55a518c23660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 -- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c256d0 msgr2=0x55a518c23ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c256d0 0x55a518c23ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 -- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c1e1a0 msgr2=0x55a518c23660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c1e1a0 0x55a518c23660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 -- 172.21.15.79:0/181682124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a518b43dd0 con 0x55a518c46af0 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045c37640 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c256d0 0x55a518c23ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3044c35640 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c1e1a0 0x55a518c23660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f3045436640 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c23120 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f303c061b70 tx=0x7f303c058f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac0cef2c5a54a0f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f302affd640 1 -- 172.21.15.79:0/181682124 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c01e040 con 0x55a518c46af0 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f302affd640 1 -- 172.21.15.79:0/181682124 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c0577c0 con 0x55a518c46af0 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.039+0000 7f302affd640 1 -- 172.21.15.79:0/181682124 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c055b30 con 0x55a518c46af0 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 -- 172.21.15.79:0/181682124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 msgr2=0x55a518c23120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c23120 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f303c061b70 tx=0x7f303c058f50 comp rx=0 tx=0).stop 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 -- 172.21.15.79:0/181682124 shutdown_connections 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c256d0 0x55a518c23ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c1e1a0 0x55a518c23660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 --2- 172.21.15.79:0/181682124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c23120 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 -- 172.21.15.79:0/181682124 >> 172.21.15.79:0/181682124 conn(0x55a518c20410 msgr2=0x55a518c68f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 -- 172.21.15.79:0/181682124 shutdown_connections 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 -- 172.21.15.79:0/181682124 wait complete. 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.040+0000 7f304a3a7740 1 -- start start 2024-06-10T00:16:33.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.041+0000 7f304a3a7740 1 Processor -- start 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.041+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c46af0 0x55a518c48f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.041+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 0x55a518c49490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.041+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c4b290 0x55a518c6dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.041+0000 7f304a3a7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a518b0f640 con 0x55a518c4b290 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.041+0000 7f304a3a7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a518b82e40 con 0x55a518c41ea0 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.041+0000 7f304a3a7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a518c21be0 con 0x55a518c46af0 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f304a3a7740 10 client.0 _ll_register_callbacks cb 0x55a518b41430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c4b290 0x55a518c6dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c4b290 0x55a518c6dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34592/0 (socket says 172.21.15.79:34592) 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 -- 172.21.15.79:0/1786521381 learned_addr learned my addr 172.21.15.79:0/1786521381 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:33.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045436640 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c46af0 0x55a518c48f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3044c35640 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 0x55a518c49490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 -- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c46af0 msgr2=0x55a518c48f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c46af0 0x55a518c48f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 -- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 msgr2=0x55a518c49490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 0x55a518c49490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 -- 172.21.15.79:0/1786521381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5189647d0 con 0x55a518c4b290 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f3045c37640 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c4b290 0x55a518c6dff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f303800e4f0 tx=0x7f303800e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3605740a68305ec server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f301ffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f301ffff640 1 -- 172.21.15.79:0/1786521381 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3038006b50 con 0x55a518c4b290 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f301ffff640 1 -- 172.21.15.79:0/1786521381 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f3038006cf0 con 0x55a518c4b290 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f304a3a7740 1 -- 172.21.15.79:0/1786521381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f303c0577c0 con 0x55a518c4b290 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f301ffff640 1 -- 172.21.15.79:0/1786521381 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f303801f050 con 0x55a518c4b290 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f304a3a7740 10 client.5613 fetch_fsmap learned FSMap version 22 2024-06-10T00:16:33.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f304a3a7740 1 -- 172.21.15.79:0/1786521381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55a51889a3f0 con 0x55a518c4b290 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.042+0000 7f301ffff640 1 -- 172.21.15.79:0/1786521381 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c0577c0 con 0x55a518c4b290 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f301ffff640 1 -- 172.21.15.79:0/1786521381 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7f3038022020 con 0x55a518c4b290 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f304a3a7740 10 client.5613 fetch_fsmap finished waiting for FSMap version 22 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f304a3a7740 10 client.5613 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f304a3a7740 20 client.5613 populate_metadata read hostname 'smithi079' 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f304a3a7740 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x55a518c470e0 0x55a518c474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f304a3a7740 4 client.5613 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f304a3a7740 1 -- 172.21.15.79:0/1786521381 --> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a518b945b0 con 0x55a518c470e0 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f3045436640 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x55a518c470e0 0x55a518c474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f3045436640 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x55a518c470e0 0x55a518c474f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f127d36116c8dc9 server_cookie=a7d4d6f7ed89c508 in_seq=0 out_seq=0 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.043+0000 7f301ffff640 10 client.5613 ms_handle_connect on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f301ffff640 1 -- 172.21.15.79:0/1786521381 <== mds.0 v2:172.21.15.117:6833/1724490819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a518b945b0 con 0x55a518c470e0 2024-06-10T00:16:33.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f301ffff640 10 client.5613 handle_command_reply: tid=0 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 client.5613 shutdown 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 -- 172.21.15.79:0/1786521381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c4b290 msgr2=0x55a518c6dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c4b290 0x55a518c6dff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f303800e4f0 tx=0x7f303800e8f0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 -- 172.21.15.79:0/1786521381 shutdown_connections 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x55a518c470e0 0x55a518c474f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c4b290 0x55a518c6dff0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f301ffff640 0 client.5613 ms_handle_reset on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 0x55a518c49490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 --2- 172.21.15.79:0/1786521381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c46af0 0x55a518c48f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 -- 172.21.15.79:0/1786521381 >> 172.21.15.79:0/1786521381 conn(0x55a518c256d0 msgr2=0x55a518c6b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 -- 172.21.15.79:0/1786521381 shutdown_connections 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 1 -- 172.21.15.79:0/1786521381 wait complete. 2024-06-10T00:16:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.044+0000 7f304a3a7740 20 client.5613 trim_cache size 0 max 16384 2024-06-10T00:16:33.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.062+0000 7f304a3a7740 1 Processor -- start 2024-06-10T00:16:33.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.062+0000 7f304a3a7740 1 -- start start 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c41ea0 0x55a518c45170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c46af0 0x55a518c1f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 0x55a518c6d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f304a3a7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3040200e20 con 0x55a518c41ea0 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f304a3a7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30401ffe50 con 0x55a518c46af0 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f304a3a7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3040158fc0 con 0x55a518c4b290 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c41ea0 0x55a518c45170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c41ea0 0x55a518c45170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34602/0 (socket says 172.21.15.79:34602) 2024-06-10T00:16:33.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 -- 172.21.15.79:0/2502223859 learned_addr learned my addr 172.21.15.79:0/2502223859 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 -- 172.21.15.79:0/2502223859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 msgr2=0x55a518c6d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 --2- 172.21.15.79:0/2502223859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 0x55a518c6d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 -- 172.21.15.79:0/2502223859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c46af0 msgr2=0x55a518c1f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 --2- 172.21.15.79:0/2502223859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c46af0 0x55a518c1f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 -- 172.21.15.79:0/2502223859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51885a0f0 con 0x55a518c41ea0 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f3045436640 1 --2- 172.21.15.79:0/2502223859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c41ea0 0x55a518c45170 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f303c089790 tx=0x7f303c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab8ef3b9be2a179 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f302a7fc640 1 -- 172.21.15.79:0/2502223859 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c01e040 con 0x55a518c41ea0 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f302a7fc640 1 -- 172.21.15.79:0/2502223859 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c086040 con 0x55a518c41ea0 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.063+0000 7f302a7fc640 1 -- 172.21.15.79:0/2502223859 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c055b30 con 0x55a518c41ea0 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 -- 172.21.15.79:0/2502223859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c41ea0 msgr2=0x55a518c45170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 --2- 172.21.15.79:0/2502223859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c41ea0 0x55a518c45170 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f303c089790 tx=0x7f303c01b000 comp rx=0 tx=0).stop 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 -- 172.21.15.79:0/2502223859 shutdown_connections 2024-06-10T00:16:33.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 --2- 172.21.15.79:0/2502223859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 0x55a518c6d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 --2- 172.21.15.79:0/2502223859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c46af0 0x55a518c1f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 --2- 172.21.15.79:0/2502223859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c41ea0 0x55a518c45170 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 -- 172.21.15.79:0/2502223859 >> 172.21.15.79:0/2502223859 conn(0x55a518c256d0 msgr2=0x55a518c24070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:33.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 -- 172.21.15.79:0/2502223859 shutdown_connections 2024-06-10T00:16:33.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 -- 172.21.15.79:0/2502223859 wait complete. 2024-06-10T00:16:33.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.064+0000 7f304a3a7740 1 -- start start 2024-06-10T00:16:33.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.065+0000 7f304a3a7740 1 Processor -- start 2024-06-10T00:16:33.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.065+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 0x55a518c43fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.065+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c22910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.065+0000 7f304a3a7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 0x55a518c22e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.065+0000 7f304a3a7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a518c24780 con 0x55a518c46af0 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.065+0000 7f304a3a7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3040159610 con 0x55a518c41ea0 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.065+0000 7f304a3a7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a518c41cb0 con 0x55a518c4b290 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f304a3a7740 10 client.0 _ll_register_callbacks cb 0x7f3038004c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c22910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c22910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34608/0 (socket says 172.21.15.79:34608) 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 -- 172.21.15.79:0/3495547561 learned_addr learned my addr 172.21.15.79:0/3495547561 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3045436640 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 0x55a518c43fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3045c37640 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 0x55a518c22e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 -- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 msgr2=0x55a518c22e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 0x55a518c22e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 -- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 msgr2=0x55a518c43fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 0x55a518c43fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 -- 172.21.15.79:0/3495547561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a518b4d560 con 0x55a518c46af0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f3044c35640 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c22910 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f303002a860 tx=0x7f30300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c2531e90b651ea server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f301ffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f301ffff640 1 -- 172.21.15.79:0/3495547561 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303004e020 con 0x55a518c46af0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f301ffff640 1 -- 172.21.15.79:0/3495547561 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f303003dac0 con 0x55a518c46af0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f304a3a7740 1 -- 172.21.15.79:0/3495547561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f303c086040 con 0x55a518c46af0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f301ffff640 1 -- 172.21.15.79:0/3495547561 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3030058050 con 0x55a518c46af0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f304a3a7740 10 client.5619 fetch_fsmap learned FSMap version 22 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f304a3a7740 1 -- 172.21.15.79:0/3495547561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55a518c8b900 con 0x55a518c46af0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.066+0000 7f301ffff640 1 -- 172.21.15.79:0/3495547561 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c086040 con 0x55a518c46af0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f301ffff640 1 -- 172.21.15.79:0/3495547561 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7f303005b020 con 0x55a518c46af0 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 10 client.5619 fetch_fsmap finished waiting for FSMap version 22 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 10 client.5619 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-06-10T00:16:33.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 20 client.5619 populate_metadata read hostname 'smithi079' 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x55a518ccfdf0 0x55a518c7ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 4 client.5619 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 -- 172.21.15.79:0/3495547561 --> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a518b8e900 con 0x55a518ccfdf0 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f3045436640 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x55a518ccfdf0 0x55a518c7ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f301ffff640 10 client.5619 ms_handle_connect on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f3045436640 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x55a518ccfdf0 0x55a518c7ae10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e88c289071496bf1 server_cookie=30d001c68d09cc3f in_seq=0 out_seq=0 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f301ffff640 1 -- 172.21.15.79:0/3495547561 <== mds.0 v2:172.21.15.117:6833/1724490819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55a518b8e900 con 0x55a518ccfdf0 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f301ffff640 10 client.5619 handle_command_reply: tid=0 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 client.5619 shutdown 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 -- 172.21.15.79:0/3495547561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 msgr2=0x55a518c22910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c22910 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f303002a860 tx=0x7f30300046c0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 -- 172.21.15.79:0/3495547561 shutdown_connections 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x55a518ccfdf0 0x55a518c7ae10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a518c4b290 0x55a518c22e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a518c46af0 0x55a518c22910 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f301ffff640 0 client.5619 ms_handle_reset on v2:172.21.15.117:6833/1724490819 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 --2- 172.21.15.79:0/3495547561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a518c41ea0 0x55a518c43fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.067+0000 7f304a3a7740 1 -- 172.21.15.79:0/3495547561 >> 172.21.15.79:0/3495547561 conn(0x55a518c256d0 msgr2=0x55a518c42620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304a3a7740 1 -- 172.21.15.79:0/3495547561 shutdown_connections 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304a3a7740 1 -- 172.21.15.79:0/3495547561 wait complete. 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304a3a7740 20 client.5619 trim_cache size 0 max 16384 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:16:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "5c75bbb2-728c-4f56-9363-c9d7f72e6e58": { 2024-06-10T00:16:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-06-10T00:16:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "5c75bbb2-728c-4f56-9363-c9d7f72e6e58", 2024-06-10T00:16:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-06-10T00:16:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:16:33.074 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 -- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f302406be30 msgr2=0x7f302406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f302406be30 0x7f302406e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3030034000 tx=0x7f303002e000 comp rx=0 tx=0).stop 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 -- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400cf190 msgr2=0x7f30400c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400cf190 0x7f30400c9090 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c7f0 tx=0x7f303c00ccb0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 -- 172.21.15.79:0/717400465 shutdown_connections 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f302406be30 0x7f302406e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30400d0cd0 0x7f30400ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30400d08f0 0x7f30400cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 --2- 172.21.15.79:0/717400465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30400cf190 0x7f30400c9090 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 -- 172.21.15.79:0/717400465 >> 172.21.15.79:0/717400465 conn(0x7f304009d3c0 msgr2=0x7f30400b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:16:33.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 -- 172.21.15.79:0/717400465 shutdown_connections 2024-06-10T00:16:33.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.068+0000 7f304769a640 1 -- 172.21.15.79:0/717400465 wait complete. 2024-06-10T00:16:33.078 INFO:tasks.cephfs.filesystem:scrub status for tag:5c75bbb2-728c-4f56-9363-c9d7f72e6e58 - {'path': '/', 'tag': '5c75bbb2-728c-4f56-9363-c9d7f72e6e58', 'options': 'recursive,repair'} 2024-06-10T00:16:33.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:33.336+0000 7f6b7ffff640 1 -- 172.21.15.79:0/123173009 <== mon.0 v2:172.21.15.79:3300/0 7 ==== log(6 entries from seq 1 at 2024-06-10T00:16:32.917997+0000) ==== 1078+0+0 (secure 0 0 0) 0x7f6b70077ed0 con 0x7f6b880d0aa0 2024-06-10T00:16:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: cluster: 2024-06-10T00:16:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: id: 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:16:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: health: HEALTH_OK 2024-06-10T00:16:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: services: 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: mgr: y(active, since 2m), standbys: x 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: mds: 1/1 daemons up, 3 standby 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: data: 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: volumes: 1/1 healthy 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: pools: 3 pools, 97 pgs 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: objects: 24 objects, 579 KiB 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: usage: 217 MiB used, 720 GiB / 720 GiB avail 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: pgs: 97 active+clean 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: io: 2024-06-10T00:16:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: client: 1.4 KiB/s wr, 0 op/s rd, 4 op/s wr 2024-06-10T00:16:33.338 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:33.338 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:16:33.338 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:16:32.917997+0000 mds.d [INF] scrub queued for path: / 2024-06-10T00:16:33.338 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:16:32.918004+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-06-10T00:16:33.338 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:16:32.918010+0000 mds.d [INF] scrub summary: active paths [/] 2024-06-10T00:16:33.338 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:16:32.918917+0000 mds.d [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-06-10T00:16:33.338 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:16:32.918928+0000 mds.d [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-06-10T00:16:33.338 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:16:32.919403+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-06-10T00:16:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:16:37.346+0000 7f6b7ffff640 1 -- 172.21.15.79:0/123173009 <== mon.0 v2:172.21.15.79:3300/0 8 ==== log(1 entries from seq 7 at 2024-06-10T00:16:37.208626+0000) ==== 189+0+0 (secure 0 0 0) 0x7f6b70078130 con 0x7f6b880d0aa0 2024-06-10T00:16:37.346 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:16:37.208626+0000 mds.d [INF] scrub summary: idle 2024-06-10T00:16:43.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:16:43.579 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:17:03.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:03.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-06-10T00:17:03.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.194+0000 7f9d75872640 1 Processor -- start 2024-06-10T00:17:03.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.194+0000 7f9d75872640 1 -- start start 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d75872640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006cee0 0x7f9d7006c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d75872640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d7015e650 0x7f9d700703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d75872640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d70070b50 con 0x7f9d7006d2c0 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d75872640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9d70070920 con 0x7f9d7015e650 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d75872640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9d700cfd40 con 0x7f9d7006cee0 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d6e7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d7015e650 0x7f9d700703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d6effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006cee0 0x7f9d7006c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d6e7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d7015e650 0x7f9d700703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:44552/0 (socket says 172.21.15.79:44552) 2024-06-10T00:17:03.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d6effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006cee0 0x7f9d7006c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:43318/0 (socket says 172.21.15.79:43318) 2024-06-10T00:17:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d6f7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9d7006d2c0 0x7f9d70161f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:33250/0 (socket says 172.21.15.79:33250) 2024-06-10T00:17:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.195+0000 7f9d6e7fc640 1 -- 172.21.15.79:0/478739293 learned_addr learned my addr 172.21.15.79:0/478739293 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.196+0000 7f9d6effd640 1 -- 172.21.15.79:0/478739293 >> v2:172.21.15.117:3300/0 conn(0x7f9d7015e650 msgr2=0x7f9d700703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.196+0000 7f9d6effd640 1 --2- 172.21.15.79:0/478739293 >> v2:172.21.15.117:3300/0 conn(0x7f9d7015e650 0x7f9d700703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.196+0000 7f9d6effd640 1 -- 172.21.15.79:0/478739293 >> v1:172.21.15.117:6789/0 conn(0x7f9d7006d2c0 legacy=0x7f9d70161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.196+0000 7f9d6effd640 1 -- 172.21.15.79:0/478739293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d700cff90 con 0x7f9d7006cee0 2024-06-10T00:17:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.196+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/478739293 >> v2:172.21.15.117:3300/0 conn(0x7f9d7015e650 0x7f9d700703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:17:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d6effd640 1 --2- 172.21.15.79:0/478739293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006cee0 0x7f9d7006c6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097a0 tx=0x7f9d6002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78aa03dbe120759c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d6dffb640 1 -- 172.21.15.79:0/478739293 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60037070 con 0x7f9d7006cee0 2024-06-10T00:17:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d6dffb640 1 -- 172.21.15.79:0/478739293 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d60032440 con 0x7f9d7006cee0 2024-06-10T00:17:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d6dffb640 1 -- 172.21.15.79:0/478739293 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60032810 con 0x7f9d7006cee0 2024-06-10T00:17:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d75872640 1 -- 172.21.15.79:0/478739293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006cee0 msgr2=0x7f9d7006c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d75872640 1 --2- 172.21.15.79:0/478739293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006cee0 0x7f9d7006c6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097a0 tx=0x7f9d6002a180 comp rx=0 tx=0).stop 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d75872640 1 -- 172.21.15.79:0/478739293 shutdown_connections 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d75872640 1 --2- 172.21.15.79:0/478739293 >> v2:172.21.15.117:3300/0 conn(0x7f9d7015e650 0x7f9d700703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d75872640 1 --2- 172.21.15.79:0/478739293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006cee0 0x7f9d7006c6e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d75872640 1 -- 172.21.15.79:0/478739293 >> 172.21.15.79:0/478739293 conn(0x7f9d700b3970 msgr2=0x7f9d700b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d75872640 1 -- 172.21.15.79:0/478739293 shutdown_connections 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.197+0000 7f9d75872640 1 -- 172.21.15.79:0/478739293 wait complete. 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.198+0000 7f9d75872640 1 Processor -- start 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.199+0000 7f9d75872640 1 -- start start 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.199+0000 7f9d75872640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d7006cee0 0x7f9d701547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.199+0000 7f9d75872640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006d2c0 0x7f9d701f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.199+0000 7f9d75872640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d7015e650 0x7f9d701f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.199+0000 7f9d75872640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7006d770 con 0x7f9d7015e650 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.199+0000 7f9d75872640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9d700d0550 con 0x7f9d7006cee0 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.199+0000 7f9d75872640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9d700d1a80 con 0x7f9d7006d2c0 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d7015e650 0x7f9d701f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d7015e650 0x7f9d701f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48556/0 (socket says 172.21.15.79:48556) 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 -- 172.21.15.79:0/2006264096 learned_addr learned my addr 172.21.15.79:0/2006264096 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6effd640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d7006cee0 0x7f9d701547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006d2c0 0x7f9d701f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 -- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006d2c0 msgr2=0x7f9d701f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006d2c0 0x7f9d701f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 -- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d7006cee0 msgr2=0x7f9d701547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d7006cee0 0x7f9d701547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 -- 172.21.15.79:0/2006264096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d701562c0 con 0x7f9d7015e650 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006d2c0 0x7f9d701f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d7015e650 0x7f9d701f4c50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c760 tx=0x7f9d6800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d57fff640 1 -- 172.21.15.79:0/2006264096 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68017070 con 0x7f9d7015e650 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d57fff640 1 -- 172.21.15.79:0/2006264096 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6800a5e0 con 0x7f9d7015e650 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d75872640 1 -- 172.21.15.79:0/2006264096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d70155220 con 0x7f9d7015e650 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d57fff640 1 -- 172.21.15.79:0/2006264096 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6800a990 con 0x7f9d7015e650 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.200+0000 7f9d75872640 1 -- 172.21.15.79:0/2006264096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d70155ac0 con 0x7f9d7015e650 2024-06-10T00:17:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.202+0000 7f9d57fff640 1 -- 172.21.15.79:0/2006264096 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d6801a070 con 0x7f9d7015e650 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.202+0000 7f9d57fff640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d5c06be30 0x7f9d5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.203+0000 7f9d6effd640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d5c06be30 0x7f9d5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.203+0000 7f9d57fff640 1 -- 172.21.15.79:0/2006264096 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f9d6808a3e0 con 0x7f9d7015e650 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.203+0000 7f9d6effd640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d5c06be30 0x7f9d5c06e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d60034000 tx=0x7f9d6002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.203+0000 7f9d7857d740 1 Processor -- start 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.203+0000 7f9d7857d740 1 -- start start 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea65af0 0x561f0ea42120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea3d1a0 0x561f0ea42660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea446d0 0x561f0ea42ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d7857d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f0e9677e0 con 0x561f0ea446d0 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d7857d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561f0e9a5e80 con 0x561f0ea3d1a0 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d7857d740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561f0e943700 con 0x561f0ea65af0 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea446d0 0x561f0ea42ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea446d0 0x561f0ea42ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48562/0 (socket says 172.21.15.79:48562) 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.204+0000 7f9d6f7fe640 1 -- 172.21.15.79:0/2264909404 learned_addr learned my addr 172.21.15.79:0/2264909404 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea3d1a0 0x561f0ea42660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d6effd640 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea65af0 0x561f0ea42120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d6f7fe640 1 -- 172.21.15.79:0/2264909404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea65af0 msgr2=0x561f0ea42120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea65af0 0x561f0ea42120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d6f7fe640 1 -- 172.21.15.79:0/2264909404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea3d1a0 msgr2=0x561f0ea42660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea3d1a0 0x561f0ea42660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d6f7fe640 1 -- 172.21.15.79:0/2264909404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f0e962dd0 con 0x561f0ea446d0 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea446d0 0x561f0ea42ba0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9d68054a10 tx=0x7f9d68058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae228c3e03e6ea9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d557fa640 1 -- 172.21.15.79:0/2264909404 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d680568b0 con 0x561f0ea446d0 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d557fa640 1 -- 172.21.15.79:0/2264909404 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d68054c20 con 0x561f0ea446d0 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.205+0000 7f9d557fa640 1 -- 172.21.15.79:0/2264909404 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68060c50 con 0x561f0ea446d0 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 -- 172.21.15.79:0/2264909404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea446d0 msgr2=0x561f0ea42ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea446d0 0x561f0ea42ba0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9d68054a10 tx=0x7f9d68058040 comp rx=0 tx=0).stop 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 -- 172.21.15.79:0/2264909404 shutdown_connections 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea446d0 0x561f0ea42ba0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea3d1a0 0x561f0ea42660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 --2- 172.21.15.79:0/2264909404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea65af0 0x561f0ea42120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 -- 172.21.15.79:0/2264909404 >> 172.21.15.79:0/2264909404 conn(0x561f0ea3f410 msgr2=0x561f0ea87f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 -- 172.21.15.79:0/2264909404 shutdown_connections 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 -- 172.21.15.79:0/2264909404 wait complete. 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 -- start start 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.206+0000 7f9d7857d740 1 Processor -- start 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0ea7e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6ca20 0x561f0ea6af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6e440 0x561f0ea6e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d7857d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f0e92e640 con 0x561f0ea65af0 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d7857d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561f0e9a1e40 con 0x561f0ea6e440 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d7857d740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561f0ea40be0 con 0x561f0ea6ca20 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d7857d740 10 client.0 _ll_register_callbacks cb 0x561f0e960430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0ea7e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0ea7e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48564/0 (socket says 172.21.15.79:48564) 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d6effd640 1 -- 172.21.15.79:0/802098397 learned_addr learned my addr 172.21.15.79:0/802098397 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6e440 0x561f0ea6e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.207+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6ca20 0x561f0ea6af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d6effd640 1 -- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6ca20 msgr2=0x561f0ea6af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d6effd640 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6ca20 0x561f0ea6af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d6effd640 1 -- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6e440 msgr2=0x561f0ea6e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d6effd640 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6e440 0x561f0ea6e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d6effd640 1 -- 172.21.15.79:0/802098397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0e7837d0 con 0x561f0ea65af0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6e440 0x561f0ea6e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d6effd640 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0ea7e450 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9d600098c0 tx=0x7f9d6002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3123caa8050d4244 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/802098397 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60037040 con 0x561f0ea65af0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/802098397 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f9d6003c850 con 0x561f0ea65af0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 1 -- 172.21.15.79:0/802098397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d68054c20 con 0x561f0ea65af0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/802098397 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9d60056050 con 0x561f0ea65af0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 10 client.5628 fetch_fsmap learned FSMap version 22 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 1 -- 172.21.15.79:0/802098397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x561f0e6b93f0 con 0x561f0ea65af0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/802098397 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d68054c20 con 0x561f0ea65af0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/802098397 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7f9d60059020 con 0x561f0ea65af0 2024-06-10T00:17:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 10 client.5628 fetch_fsmap finished waiting for FSMap version 22 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 10 client.5628 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 20 client.5628 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x561f0ea66a80 0x561f0ea66eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 4 client.5628 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.208+0000 7f9d7857d740 1 -- 172.21.15.79:0/802098397 --> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f0e9b35b0 con 0x561f0ea66a80 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.209+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x561f0ea66a80 0x561f0ea66eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.209+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x561f0ea66a80 0x561f0ea66eb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d414d550773144cd server_cookie=5c0218bb2b447dad in_seq=0 out_seq=0 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.209+0000 7f9d4e7fc640 10 client.5628 ms_handle_connect on v2:172.21.15.117:6833/1724490819 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/802098397 <== mds.0 v2:172.21.15.117:6833/1724490819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561f0e9b35b0 con 0x561f0ea66a80 2024-06-10T00:17:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d4e7fc640 10 client.5628 handle_command_reply: tid=0 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 client.5628 shutdown 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 -- 172.21.15.79:0/802098397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 msgr2=0x561f0ea7e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0ea7e450 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9d600098c0 tx=0x7f9d6002c070 comp rx=0 tx=0).stop 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 -- 172.21.15.79:0/802098397 shutdown_connections 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x561f0ea66a80 0x561f0ea66eb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6e440 0x561f0ea6e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6ca20 0x561f0ea6af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d4e7fc640 0 client.5628 ms_handle_reset on v2:172.21.15.117:6833/1724490819 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 --2- 172.21.15.79:0/802098397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0ea7e450 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 -- 172.21.15.79:0/802098397 >> 172.21.15.79:0/802098397 conn(0x561f0ea446d0 msgr2=0x561f0ea41070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 -- 172.21.15.79:0/802098397 shutdown_connections 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 1 -- 172.21.15.79:0/802098397 wait complete. 2024-06-10T00:17:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.210+0000 7f9d7857d740 20 client.5628 trim_cache size 0 max 16384 2024-06-10T00:17:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.228+0000 7f9d7857d740 1 Processor -- start 2024-06-10T00:17:03.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.228+0000 7f9d7857d740 1 -- start start 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0eaabec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6ca20 0x561f0ea69d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 0x561f0ea6a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d7857d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d70200de0 con 0x561f0ea65af0 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d7857d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9d701ffe60 con 0x561f0ea6ca20 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d7857d740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9d701ff1c0 con 0x561f0ea6e440 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0eaabec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0eaabec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48578/0 (socket says 172.21.15.79:48578) 2024-06-10T00:17:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.229+0000 7f9d6effd640 1 -- 172.21.15.79:0/2450818842 learned_addr learned my addr 172.21.15.79:0/2450818842 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d6effd640 1 -- 172.21.15.79:0/2450818842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 msgr2=0x561f0ea6a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d6effd640 1 --2- 172.21.15.79:0/2450818842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 0x561f0ea6a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d6effd640 1 -- 172.21.15.79:0/2450818842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6ca20 msgr2=0x561f0ea69d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d6effd640 1 --2- 172.21.15.79:0/2450818842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6ca20 0x561f0ea69d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d6effd640 1 -- 172.21.15.79:0/2450818842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f0e6790f0 con 0x561f0ea65af0 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d6effd640 1 --2- 172.21.15.79:0/2450818842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0eaabec0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097a0 tx=0x7f9d6003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6542b4056768488e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d54ff9640 1 -- 172.21.15.79:0/2450818842 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6005f070 con 0x561f0ea65af0 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d54ff9640 1 -- 172.21.15.79:0/2450818842 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6004e070 con 0x561f0ea65af0 2024-06-10T00:17:03.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.230+0000 7f9d54ff9640 1 -- 172.21.15.79:0/2450818842 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60037040 con 0x561f0ea65af0 2024-06-10T00:17:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 -- 172.21.15.79:0/2450818842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 msgr2=0x561f0eaabec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 --2- 172.21.15.79:0/2450818842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0eaabec0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097a0 tx=0x7f9d6003c000 comp rx=0 tx=0).stop 2024-06-10T00:17:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 -- 172.21.15.79:0/2450818842 shutdown_connections 2024-06-10T00:17:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 --2- 172.21.15.79:0/2450818842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 0x561f0ea6a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 --2- 172.21.15.79:0/2450818842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea6ca20 0x561f0ea69d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 --2- 172.21.15.79:0/2450818842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea65af0 0x561f0eaabec0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 -- 172.21.15.79:0/2450818842 >> 172.21.15.79:0/2450818842 conn(0x561f0ea446d0 msgr2=0x561f0ea7d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 -- 172.21.15.79:0/2450818842 shutdown_connections 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 -- 172.21.15.79:0/2450818842 wait complete. 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 -- start start 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.231+0000 7f9d7857d740 1 Processor -- start 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea65af0 0x561f0eaab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea6ca20 0x561f0ea7d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d7857d740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 0x561f0eb04fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d7857d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f0ea43cd0 con 0x561f0ea6ca20 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d7857d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9d701ff810 con 0x561f0ea65af0 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d7857d740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561f0ea3f1c0 con 0x561f0ea6e440 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d7857d740 10 client.0 _ll_register_callbacks cb 0x7f9d60032ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d6e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea6ca20 0x561f0ea7d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d6e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea6ca20 0x561f0ea7d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48588/0 (socket says 172.21.15.79:48588) 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d6e7fc640 1 -- 172.21.15.79:0/370642207 learned_addr learned my addr 172.21.15.79:0/370642207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d6effd640 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea65af0 0x561f0eaab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.232+0000 7f9d6f7fe640 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 0x561f0eb04fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d6e7fc640 1 -- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 msgr2=0x561f0eb04fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 0x561f0eb04fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d6e7fc640 1 -- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea65af0 msgr2=0x561f0eaab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea65af0 0x561f0eaab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d6e7fc640 1 -- 172.21.15.79:0/370642207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0e96c560 con 0x561f0ea6ca20 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d6e7fc640 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea6ca20 0x561f0ea7d900 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x561f0ea6af20 tx=0x7f9d64017810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766263ec9194a98a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/370642207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64022020 con 0x561f0ea6ca20 2024-06-10T00:17:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/370642207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f9d64004230 con 0x561f0ea6ca20 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 1 -- 172.21.15.79:0/370642207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d6004e070 con 0x561f0ea6ca20 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/370642207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9d6402c050 con 0x561f0ea6ca20 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 10 client.5634 fetch_fsmap learned FSMap version 22 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 1 -- 172.21.15.79:0/370642207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x561f0eaaa880 con 0x561f0ea6ca20 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/370642207 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6004e070 con 0x561f0ea6ca20 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/370642207 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7f9d6402f020 con 0x561f0ea6ca20 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 10 client.5634 fetch_fsmap finished waiting for FSMap version 22 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 10 client.5634 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 20 client.5634 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x561f0ea9c260 0x561f0ea9c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 4 client.5634 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.233+0000 7f9d7857d740 1 -- 172.21.15.79:0/370642207 --> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561f0e9ad900 con 0x561f0ea9c260 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d6effd640 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x561f0ea9c260 0x561f0ea9c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d4e7fc640 10 client.5634 ms_handle_connect on v2:172.21.15.117:6833/1724490819 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d6effd640 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x561f0ea9c260 0x561f0ea9c640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f6651f44face5c server_cookie=eb626466e3d57e5b in_seq=0 out_seq=0 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d4e7fc640 1 -- 172.21.15.79:0/370642207 <== mds.0 v2:172.21.15.117:6833/1724490819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561f0e9ad900 con 0x561f0ea9c260 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d4e7fc640 10 client.5634 handle_command_reply: tid=0 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 client.5634 shutdown 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 -- 172.21.15.79:0/370642207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea6ca20 msgr2=0x561f0ea7d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea6ca20 0x561f0ea7d900 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x561f0ea6af20 tx=0x7f9d64017810 comp rx=0 tx=0).stop 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 -- 172.21.15.79:0/370642207 shutdown_connections 2024-06-10T00:17:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:6833/1724490819,v1:172.21.15.117:6835/1724490819] conn(0x561f0ea9c260 0x561f0ea9c640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f0ea6e440 0x561f0eb04fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d4e7fc640 0 client.5634 ms_handle_reset on v2:172.21.15.117:6833/1724490819 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f0ea6ca20 0x561f0ea7d900 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 --2- 172.21.15.79:0/370642207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f0ea65af0 0x561f0eaab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 -- 172.21.15.79:0/370642207 >> 172.21.15.79:0/370642207 conn(0x561f0ea446d0 msgr2=0x561f0ea6ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 -- 172.21.15.79:0/370642207 shutdown_connections 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 1 -- 172.21.15.79:0/370642207 wait complete. 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.234+0000 7f9d7857d740 20 client.5634 trim_cache size 0 max 16384 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:17:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:17:03.242 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 -- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d5c06be30 msgr2=0x7f9d5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d5c06be30 0x7f9d5c06e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d60034000 tx=0x7f9d6002e000 comp rx=0 tx=0).stop 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 -- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d7015e650 msgr2=0x7f9d701f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d7015e650 0x7f9d701f4c50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c760 tx=0x7f9d6800cc20 comp rx=0 tx=0).stop 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 -- 172.21.15.79:0/2006264096 shutdown_connections 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d5c06be30 0x7f9d5c06e2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d7015e650 0x7f9d701f4c50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d7006d2c0 0x7f9d701f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 --2- 172.21.15.79:0/2006264096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d7006cee0 0x7f9d701547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 -- 172.21.15.79:0/2006264096 >> 172.21.15.79:0/2006264096 conn(0x7f9d700b3970 msgr2=0x7f9d700b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 -- 172.21.15.79:0/2006264096 shutdown_connections 2024-06-10T00:17:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.235+0000 7f9d75872640 1 -- 172.21.15.79:0/2006264096 wait complete. 2024-06-10T00:17:03.245 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:17:03.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.445+0000 7fb0c48ba640 1 Processor -- start 2024-06-10T00:17:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.445+0000 7fb0c48ba640 1 -- start start 2024-06-10T00:17:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.446+0000 7fb0c48ba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0c00d2680 0x7fb0c015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.446+0000 7fb0c48ba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c00d0ad0 con 0x7fb0c00cef70 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.446+0000 7fb0c48ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c015f890 con 0x7fb0c00d1fc0 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.446+0000 7fb0c48ba640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c00d13e0 con 0x7fb0c00d2680 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.446+0000 7fb0be59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0c00d2680 0x7fb0c015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.447+0000 7fb0bed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb0c00cef70 0x7fb0c00cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42096/0 (socket says 172.21.15.79:42096) 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.447+0000 7fb0be59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0c00d2680 0x7fb0c015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48590/0 (socket says 172.21.15.79:48590) 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.447+0000 7fb0bed9d640 1 -- 172.21.15.79:0/1803039649 learned_addr learned my addr 172.21.15.79:0/1803039649 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.447+0000 7fb0be59c640 1 -- 172.21.15.79:0/1803039649 >> v1:172.21.15.117:6789/0 conn(0x7fb0c00d1fc0 legacy=0x7fb0c00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.447+0000 7fb0bd59a640 1 -- 172.21.15.79:0/1803039649 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839765683 0 0) 0x7fb0c00d0ad0 con 0x7fb0c00cef70 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.447+0000 7fb0be59c640 1 -- 172.21.15.79:0/1803039649 >> v1:172.21.15.79:6789/0 conn(0x7fb0c00cef70 legacy=0x7fb0c00cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.447+0000 7fb0be59c640 1 -- 172.21.15.79:0/1803039649 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c00d0d90 con 0x7fb0c00d2680 2024-06-10T00:17:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0be59c640 1 --2- 172.21.15.79:0/1803039649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c015f1a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00d1560 tx=0x7fb0b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f705fa41774218 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0bd59a640 1 -- 172.21.15.79:0/1803039649 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0007740 con 0x7fb0c00d2680 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0bd59a640 1 -- 172.21.15.79:0/1803039649 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b00078e0 con 0x7fb0c00d2680 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0bd59a640 1 -- 172.21.15.79:0/1803039649 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0007cb0 con 0x7fb0c00d2680 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0c48ba640 1 -- 172.21.15.79:0/1803039649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 msgr2=0x7fb0c015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0c48ba640 1 --2- 172.21.15.79:0/1803039649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c015f1a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00d1560 tx=0x7fb0b002a6a0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0c48ba640 1 -- 172.21.15.79:0/1803039649 shutdown_connections 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0c48ba640 1 --2- 172.21.15.79:0/1803039649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c015f1a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0c48ba640 1 -- 172.21.15.79:0/1803039649 >> 172.21.15.79:0/1803039649 conn(0x7fb0c009d3f0 msgr2=0x7fb0c00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0c48ba640 1 -- 172.21.15.79:0/1803039649 shutdown_connections 2024-06-10T00:17:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.448+0000 7fb0c48ba640 1 -- 172.21.15.79:0/1803039649 wait complete. 2024-06-10T00:17:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0c48ba640 1 Processor -- start 2024-06-10T00:17:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0c48ba640 1 -- start start 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0c48ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0c00cef70 0x7fb0c00c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0c48ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0c00d1fc0 0x7fb0c0158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0c48ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c00ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0c48ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00d4f00 con 0x7fb0c00d2680 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0c48ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00d2400 con 0x7fb0c00cef70 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0c48ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c00d1870 con 0x7fb0c00d1fc0 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.450+0000 7fb0bed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c00ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c00ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48600/0 (socket says 172.21.15.79:48600) 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bed9d640 1 -- 172.21.15.79:0/814825499 learned_addr learned my addr 172.21.15.79:0/814825499 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bdd9b640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0c00d1fc0 0x7fb0c0158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0be59c640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0c00cef70 0x7fb0c00c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bed9d640 1 -- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0c00d1fc0 msgr2=0x7fb0c0158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bed9d640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0c00d1fc0 0x7fb0c0158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bed9d640 1 -- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0c00cef70 msgr2=0x7fb0c00c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bed9d640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0c00cef70 0x7fb0c00c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bed9d640 1 -- 172.21.15.79:0/814825499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c00c8950 con 0x7fb0c00d2680 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bdd9b640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0c00d1fc0 0x7fb0c0158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0bed9d640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c00ca1f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800c480 tx=0x7fb0b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0aeffd640 1 -- 172.21.15.79:0/814825499 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8018070 con 0x7fb0c00d2680 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0aeffd640 1 -- 172.21.15.79:0/814825499 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b8007500 con 0x7fb0c00d2680 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c00c8c30 con 0x7fb0c00d2680 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0aeffd640 1 -- 172.21.15.79:0/814825499 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8004a20 con 0x7fb0c00d2680 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.451+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c00c91f0 con 0x7fb0c00d2680 2024-06-10T00:17:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.452+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c0068430 con 0x7fb0c00d2680 2024-06-10T00:17:03.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.453+0000 7fb0aeffd640 1 -- 172.21.15.79:0/814825499 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0b801b070 con 0x7fb0c00d2680 2024-06-10T00:17:03.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.453+0000 7fb0aeffd640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb0a006be30 0x7fb0a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.453+0000 7fb0aeffd640 1 -- 172.21.15.79:0/814825499 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fb0b808a240 con 0x7fb0c00d2680 2024-06-10T00:17:03.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.453+0000 7fb0be59c640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb0a006be30 0x7fb0a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.453+0000 7fb0be59c640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb0a006be30 0x7fb0a006e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0034000 tx=0x7fb0b002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.457+0000 7fb0aeffd640 1 -- 172.21.15.79:0/814825499 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb0b8058af0 con 0x7fb0c00d2680 2024-06-10T00:17:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.666+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0c00b9f80 con 0x7fb0c00d2680 2024-06-10T00:17:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.667+0000 7fb0aeffd640 1 -- 172.21.15.79:0/814825499 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5184 (secure 0 0 0) 0x7fb0b80583f0 con 0x7fb0c00d2680 2024-06-10T00:17:03.667 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:03.667 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:16:20.631079+0000","modified":"2024-06-10T00:16:22.637364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1724490819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1724490819},{"type":"v1","addr":"172.21.15.117:6835","nonce":1724490819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":3}]} 2024-06-10T00:17:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-06-10T00:17:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb0a006be30 msgr2=0x7fb0a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb0a006be30 0x7fb0a006e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0034000 tx=0x7fb0b002f000 comp rx=0 tx=0).stop 2024-06-10T00:17:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 msgr2=0x7fb0c00ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c00ca1f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800c480 tx=0x7fb0b800c940 comp rx=0 tx=0).stop 2024-06-10T00:17:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 shutdown_connections 2024-06-10T00:17:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb0a006be30 0x7fb0a006e2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c00d2680 0x7fb0c00ca1f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0c00d1fc0 0x7fb0c0158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 --2- 172.21.15.79:0/814825499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0c00cef70 0x7fb0c00c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 >> 172.21.15.79:0/814825499 conn(0x7fb0c009d3f0 msgr2=0x7fb0c0161290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 shutdown_connections 2024-06-10T00:17:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.669+0000 7fb0c48ba640 1 -- 172.21.15.79:0/814825499 wait complete. 2024-06-10T00:17:03.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-06-10T00:17:03.817 INFO:teuthology.orchestra.run.smithi117.stdout:{"return_code":0} 2024-06-10T00:17:03.818 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:17:03.818 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-06-10T00:17:03.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.862+0000 7fcd23a32f40 1 Processor -- start 2024-06-10T00:17:03.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.862+0000 7fcd23a32f40 1 -- start start 2024-06-10T00:17:03.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.862+0000 7fcd23a32f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f0bb2ecf60 0x55f0bb2cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.862+0000 7fcd23a32f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb362180 0x55f0bb377e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.862+0000 7fcd23a32f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb379b50 0x55f0bb378350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.862+0000 7fcd23a32f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb2a5450 con 0x55f0bb379b50 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.862+0000 7fcd23a32f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb24ae30 con 0x55f0bb362180 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.862+0000 7fcd23a32f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f0bb2a56f0 con 0x55f0bb2ecf60 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb379b50 0x55f0bb378350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb379b50 0x55f0bb378350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48624/0 (socket says 172.21.15.79:48624) 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 -- 172.21.15.79:0/1464629833 learned_addr learned my addr 172.21.15.79:0/1464629833 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd18d32640 1 --2- 172.21.15.79:0/1464629833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb362180 0x55f0bb377e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 -- 172.21.15.79:0/1464629833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f0bb2ecf60 msgr2=0x55f0bb2cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 --2- 172.21.15.79:0/1464629833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f0bb2ecf60 0x55f0bb2cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 -- 172.21.15.79:0/1464629833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb362180 msgr2=0x55f0bb377e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 --2- 172.21.15.79:0/1464629833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb362180 0x55f0bb377e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 -- 172.21.15.79:0/1464629833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bb1cfcb0 con 0x55f0bb379b50 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd21d34640 1 --2- 172.21.15.79:0/1464629833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb379b50 0x55f0bb378350 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c002880 tx=0x7fcd1c002d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6c530403cec278 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd1bfff640 1 -- 172.21.15.79:0/1464629833 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c016020 con 0x55f0bb379b50 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd1bfff640 1 -- 172.21.15.79:0/1464629833 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd1c00d9c0 con 0x55f0bb379b50 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.863+0000 7fcd1bfff640 1 -- 172.21.15.79:0/1464629833 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00ddb0 con 0x55f0bb379b50 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 -- 172.21.15.79:0/1464629833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb379b50 msgr2=0x55f0bb378350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 --2- 172.21.15.79:0/1464629833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb379b50 0x55f0bb378350 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c002880 tx=0x7fcd1c002d40 comp rx=0 tx=0).stop 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 -- 172.21.15.79:0/1464629833 shutdown_connections 2024-06-10T00:17:03.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 --2- 172.21.15.79:0/1464629833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb379b50 0x55f0bb378350 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 --2- 172.21.15.79:0/1464629833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb362180 0x55f0bb377e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 --2- 172.21.15.79:0/1464629833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f0bb2ecf60 0x55f0bb2cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 -- 172.21.15.79:0/1464629833 >> 172.21.15.79:0/1464629833 conn(0x55f0bb2a21c0 msgr2=0x55f0bb2a25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 -- 172.21.15.79:0/1464629833 shutdown_connections 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 -- 172.21.15.79:0/1464629833 wait complete. 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 Processor -- start 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.864+0000 7fcd23a32f40 1 -- start start 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd23a32f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2ecf60 0x55f0bb3581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd23a32f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f0bb362180 0x55f0bb2e4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd23a32f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb379b50 0x55f0bb377dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd23a32f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb360da0 con 0x55f0bb2ecf60 2024-06-10T00:17:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd23a32f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb2ea240 con 0x55f0bb379b50 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd23a32f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f0bb2ea490 con 0x55f0bb362180 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2ecf60 0x55f0bb3581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2ecf60 0x55f0bb3581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48632/0 (socket says 172.21.15.79:48632) 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 -- 172.21.15.79:0/701777852 learned_addr learned my addr 172.21.15.79:0/701777852 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd18d32640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f0bb362180 0x55f0bb2e4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21d34640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb379b50 0x55f0bb377dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 -- 172.21.15.79:0/701777852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f0bb362180 msgr2=0x55f0bb2e4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f0bb362180 0x55f0bb2e4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 -- 172.21.15.79:0/701777852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb379b50 msgr2=0x55f0bb377dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0bb379b50 0x55f0bb377dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 -- 172.21.15.79:0/701777852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bb373710 con 0x55f0bb2ecf60 2024-06-10T00:17:03.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.865+0000 7fcd21533640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2ecf60 0x55f0bb3581b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400a4f0 tx=0x7fcd140058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.866+0000 7fcd1affd640 1 -- 172.21.15.79:0/701777852 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140537a0 con 0x55f0bb2ecf60 2024-06-10T00:17:03.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.866+0000 7fcd1affd640 1 -- 172.21.15.79:0/701777852 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd14053940 con 0x55f0bb2ecf60 2024-06-10T00:17:03.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.866+0000 7fcd1affd640 1 -- 172.21.15.79:0/701777852 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14053d30 con 0x55f0bb2ecf60 2024-06-10T00:17:03.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.866+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0bb3739f0 con 0x55f0bb2ecf60 2024-06-10T00:17:03.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.866+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0bb3586f0 con 0x55f0bb2ecf60 2024-06-10T00:17:03.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.867+0000 7fcd1affd640 1 -- 172.21.15.79:0/701777852 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd14070440 con 0x55f0bb2ecf60 2024-06-10T00:17:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.867+0000 7fcd1affd640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd0406a810 0x7fcd0406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.867+0000 7fcd1affd640 1 -- 172.21.15.79:0/701777852 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fcd140ce170 con 0x55f0bb2ecf60 2024-06-10T00:17:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.867+0000 7fcd18d32640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd0406a810 0x7fcd0406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55f0bb378310 0x55f0bb3708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x55f0bb2e5390 con 0x55f0bb378310 2024-06-10T00:17:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd21d34640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55f0bb378310 0x55f0bb3708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd18d32640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd0406a810 0x7fcd0406ccd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55f0bb2eaa20 tx=0x7fcd0c003550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd21d34640 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55f0bb378310 0x55f0bb3708e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd21d34640 1 -- 172.21.15.79:0/701777852 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fcd1c012470 con 0x55f0bb378310 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55f0bb378310 msgr2=0x55f0bb3708e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55f0bb378310 0x55f0bb3708e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd0406a810 msgr2=0x7fcd0406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd0406a810 0x7fcd0406ccd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55f0bb2eaa20 tx=0x7fcd0c003550 comp rx=0 tx=0).stop 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2ecf60 msgr2=0x55f0bb3581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 --2- 172.21.15.79:0/701777852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2ecf60 0x55f0bb3581b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400a4f0 tx=0x7fcd140058b0 comp rx=0 tx=0).stop 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd21d34640 1 -- 172.21.15.79:0/701777852 reap_dead start 2024-06-10T00:17:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 shutdown_connections 2024-06-10T00:17:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.868+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 >> 172.21.15.79:0/701777852 conn(0x55f0bb2a21c0 msgr2=0x55f0bb2ec850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.869+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 shutdown_connections 2024-06-10T00:17:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:03.869+0000 7fcd23a32f40 1 -- 172.21.15.79:0/701777852 wait complete. 2024-06-10T00:17:03.876 INFO:teuthology.orchestra.run.smithi079.stdout:Yalphaparent_a 2024-06-10T00:17:03.876 DEBUG:teuthology.orchestra.run.smithi079:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-06-10T00:17:03.963 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-06-10T00:17:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: "ancestors": [ 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1099511627776, 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "alpha", 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 4 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1, 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "parent_a", 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 7 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 8, 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: "old_pools": [] 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:03.964 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:03.966 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:17:03.966 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:17:04.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:17:04.109 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:17:04.110 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:17:04.110 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:17:04.110 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:17:04.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:17:04.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.269+0000 7f4d8157e640 1 Processor -- start 2024-06-10T00:17:04.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.269+0000 7f4d8157e640 1 -- start start 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d8157e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d7c0d2680 0x7f4d7c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d8157e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d7c0d1fc0 0x7f4d7c0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d8157e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7c0d2fa0 con 0x7f4d7c161fa0 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d8157e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4d7c0cff80 con 0x7f4d7c0d2680 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d8157e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4d7c0d13e0 con 0x7f4d7c0d1fc0 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d7affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d7c0d2680 0x7f4d7c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d7affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d7c0d2680 0x7f4d7c15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48648/0 (socket says 172.21.15.79:48648) 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d7affd640 1 -- 172.21.15.79:0/4170263493 learned_addr learned my addr 172.21.15.79:0/4170263493 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d7a7fc640 1 --2- 172.21.15.79:0/4170263493 >> v2:172.21.15.117:3300/0 conn(0x7f4d7c0d1fc0 0x7f4d7c0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d7affd640 1 -- 172.21.15.79:0/4170263493 >> v2:172.21.15.117:3300/0 conn(0x7f4d7c0d1fc0 msgr2=0x7f4d7c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d7affd640 1 --2- 172.21.15.79:0/4170263493 >> v2:172.21.15.117:3300/0 conn(0x7f4d7c0d1fc0 0x7f4d7c0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d7affd640 1 -- 172.21.15.79:0/4170263493 >> v1:172.21.15.117:6789/0 conn(0x7f4d7c161fa0 legacy=0x7f4d7c1623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.270+0000 7f4d7affd640 1 -- 172.21.15.79:0/4170263493 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c0d0ad0 con 0x7f4d7c0d2680 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d7affd640 1 --2- 172.21.15.79:0/4170263493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c15f1a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0c7960 tx=0x7f4d6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f27c7237c8f6fa server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d79ffb640 1 -- 172.21.15.79:0/4170263493 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c037070 con 0x7f4d7c0d2680 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d79ffb640 1 -- 172.21.15.79:0/4170263493 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6c032440 con 0x7f4d7c0d2680 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d79ffb640 1 -- 172.21.15.79:0/4170263493 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c032810 con 0x7f4d7c0d2680 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d8157e640 1 -- 172.21.15.79:0/4170263493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 msgr2=0x7f4d7c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4170263493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c15f1a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0c7960 tx=0x7f4d6c02a270 comp rx=0 tx=0).stop 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d8157e640 1 -- 172.21.15.79:0/4170263493 shutdown_connections 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4170263493 >> v2:172.21.15.117:3300/0 conn(0x7f4d7c0d1fc0 0x7f4d7c0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4170263493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c15f1a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d8157e640 1 -- 172.21.15.79:0/4170263493 >> 172.21.15.79:0/4170263493 conn(0x7f4d7c09d3f0 msgr2=0x7f4d7c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:04.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d8157e640 1 -- 172.21.15.79:0/4170263493 shutdown_connections 2024-06-10T00:17:04.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.271+0000 7f4d8157e640 1 -- 172.21.15.79:0/4170263493 wait complete. 2024-06-10T00:17:04.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.273+0000 7f4d8157e640 1 Processor -- start 2024-06-10T00:17:04.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.273+0000 7f4d8157e640 1 -- start start 2024-06-10T00:17:04.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.273+0000 7f4d8157e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7c0d1fc0 0x7f4d7c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.273+0000 7f4d8157e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.273+0000 7f4d8157e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c161fa0 0x7f4d7c151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.273+0000 7f4d8157e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c0d1070 con 0x7f4d7c0d2680 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.273+0000 7f4d8157e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c0d0d90 con 0x7f4d7c161fa0 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.273+0000 7f4d8157e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7c0d2400 con 0x7f4d7c0d1fc0 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c0cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48654/0 (socket says 172.21.15.79:48654) 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 -- 172.21.15.79:0/4294180744 learned_addr learned my addr 172.21.15.79:0/4294180744 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7affd640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7c0d1fc0 0x7f4d7c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7b7fe640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c161fa0 0x7f4d7c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 -- 172.21.15.79:0/4294180744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7c0d1fc0 msgr2=0x7f4d7c1f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7c0d1fc0 0x7f4d7c1f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 -- 172.21.15.79:0/4294180744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c161fa0 msgr2=0x7f4d7c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c161fa0 0x7f4d7c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 -- 172.21.15.79:0/4294180744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c0b81d0 con 0x7f4d7c0d2680 2024-06-10T00:17:04.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d7a7fc640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c0cd5d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000e9b0 tx=0x7f4d7000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:04.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d637fe640 1 -- 172.21.15.79:0/4294180744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70017070 con 0x7f4d7c0d2680 2024-06-10T00:17:04.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d637fe640 1 -- 172.21.15.79:0/4294180744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7000c9a0 con 0x7f4d7c0d2680 2024-06-10T00:17:04.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d637fe640 1 -- 172.21.15.79:0/4294180744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000cd90 con 0x7f4d7c0d2680 2024-06-10T00:17:04.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c0b84b0 con 0x7f4d7c0d2680 2024-06-10T00:17:04.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.274+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c0b8a70 con 0x7f4d7c0d2680 2024-06-10T00:17:04.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.275+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c068430 con 0x7f4d7c0d2680 2024-06-10T00:17:04.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.276+0000 7f4d637fe640 1 -- 172.21.15.79:0/4294180744 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d7001a070 con 0x7f4d7c0d2680 2024-06-10T00:17:04.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.276+0000 7f4d637fe640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4d6806be30 0x7f4d6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.276+0000 7f4d637fe640 1 -- 172.21.15.79:0/4294180744 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f4d7008b2e0 con 0x7f4d7c0d2680 2024-06-10T00:17:04.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.276+0000 7f4d7affd640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4d6806be30 0x7f4d6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.277+0000 7f4d7affd640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4d6806be30 0x7f4d6806e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c034000 tx=0x7f4d6c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:04.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.281+0000 7f4d637fe640 1 -- 172.21.15.79:0/4294180744 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4d70059b90 con 0x7f4d7c0d2680 2024-06-10T00:17:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.469+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4d7c161d80 con 0x7f4d7c0d2680 2024-06-10T00:17:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.469+0000 7f4d637fe640 1 -- 172.21.15.79:0/4294180744 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) ==== 80+0+0 (secure 0 0 0) 0x7f4d70059490 con 0x7f4d7c0d2680 2024-06-10T00:17:04.469 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:17:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4d6806be30 msgr2=0x7f4d6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4d6806be30 0x7f4d6806e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c034000 tx=0x7f4d6c02e000 comp rx=0 tx=0).stop 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 msgr2=0x7f4d7c0cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c0cd5d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000e9b0 tx=0x7f4d7000ee70 comp rx=0 tx=0).stop 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 shutdown_connections 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4d6806be30 0x7f4d6806e2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c161fa0 0x7f4d7c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d7c0d2680 0x7f4d7c0cd5d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 --2- 172.21.15.79:0/4294180744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7c0d1fc0 0x7f4d7c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 >> 172.21.15.79:0/4294180744 conn(0x7f4d7c09d3f0 msgr2=0x7f4d7c15fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 shutdown_connections 2024-06-10T00:17:04.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.471+0000 7f4d8157e640 1 -- 172.21.15.79:0/4294180744 wait complete. 2024-06-10T00:17:04.481 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:17:04.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:04.482 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:17:04.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[54024]: fuse finished with error 0 and tester_r 0 2024-06-10T00:17:04.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:17:04.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:04.506 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:17:04.610 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:17:04.610 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:17:04.610 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:17:04.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:17:04.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:17:04.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:04.628 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-10T00:17:04.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:17:04.684 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-10T00:17:04.684 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:17:04.684 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:17:04.684 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:17:04.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:17:04.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:17:04.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:04.701 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-10T00:17:04.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:17:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-10T00:17:04.756 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:17:04.756 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:17:04.756 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:17:04.773 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:17:04.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:17:04.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:04.773 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-10T00:17:04.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:17:04.829 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-10T00:17:04.829 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.929+0000 7f41df370640 1 Processor -- start 2024-06-10T00:17:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.929+0000 7f41df370640 1 -- start start 2024-06-10T00:17:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41df370640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 0x7f41d806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41df370640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41d806ea20 0x7f41d80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41df370640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41d80cf190 0x7f41d815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41df370640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f41d806ee60 con 0x7f41d80cf190 2024-06-10T00:17:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41df370640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f41d80cf620 con 0x7f41d806ea20 2024-06-10T00:17:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41df370640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41d806d130 con 0x7f41d80ae910 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd90d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41d80cf190 0x7f41d815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd90d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41d80cf190 0x7f41d815ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48656/0 (socket says 172.21.15.79:48656) 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd90d640 1 -- 172.21.15.79:0/240547167 learned_addr learned my addr 172.21.15.79:0/240547167 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd90d640 1 -- 172.21.15.79:0/240547167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 msgr2=0x7f41d806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd10c640 1 --2- 172.21.15.79:0/240547167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 0x7f41d806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dc90b640 1 --2- 172.21.15.79:0/240547167 >> v2:172.21.15.117:3300/0 conn(0x7f41d806ea20 0x7f41d80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd90d640 1 --2- 172.21.15.79:0/240547167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 0x7f41d806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd90d640 1 -- 172.21.15.79:0/240547167 >> v2:172.21.15.117:3300/0 conn(0x7f41d806ea20 msgr2=0x7f41d80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd90d640 1 --2- 172.21.15.79:0/240547167 >> v2:172.21.15.117:3300/0 conn(0x7f41d806ea20 0x7f41d80cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.930+0000 7f41dd90d640 1 -- 172.21.15.79:0/240547167 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d806d410 con 0x7f41d80cf190 2024-06-10T00:17:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.931+0000 7f41dd90d640 1 --2- 172.21.15.79:0/240547167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d815ead0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009e50 tx=0x7f41d002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f83d3ac91ab699 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.931+0000 7f41cffff640 1 -- 172.21.15.79:0/240547167 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0036070 con 0x7f41d80cf190 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.931+0000 7f41cffff640 1 -- 172.21.15.79:0/240547167 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0031600 con 0x7f41d80cf190 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.931+0000 7f41cffff640 1 -- 172.21.15.79:0/240547167 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00319d0 con 0x7f41d80cf190 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 -- 172.21.15.79:0/240547167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 msgr2=0x7f41d815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 --2- 172.21.15.79:0/240547167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d815ead0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009e50 tx=0x7f41d002a630 comp rx=0 tx=0).stop 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 -- 172.21.15.79:0/240547167 shutdown_connections 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 --2- 172.21.15.79:0/240547167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d815ead0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 --2- 172.21.15.79:0/240547167 >> v2:172.21.15.117:3300/0 conn(0x7f41d806ea20 0x7f41d80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 --2- 172.21.15.79:0/240547167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 0x7f41d806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 -- 172.21.15.79:0/240547167 >> 172.21.15.79:0/240547167 conn(0x7f41d80b19f0 msgr2=0x7f41d80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 -- 172.21.15.79:0/240547167 shutdown_connections 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.932+0000 7f41df370640 1 -- 172.21.15.79:0/240547167 wait complete. 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.933+0000 7f41df370640 1 Processor -- start 2024-06-10T00:17:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.933+0000 7f41df370640 1 -- start start 2024-06-10T00:17:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41df370640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d806ea20 0x7f41d81efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41df370640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 0x7f41d814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41df370640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d80b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41df370640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80aecf0 con 0x7f41d80cf190 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41df370640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41d806d9d0 con 0x7f41d806ea20 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41df370640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41d815f010 con 0x7f41d80ae910 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d80b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d80b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48664/0 (socket says 172.21.15.79:48664) 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 -- 172.21.15.79:0/3868194177 learned_addr learned my addr 172.21.15.79:0/3868194177 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 -- 172.21.15.79:0/3868194177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 msgr2=0x7f41d814c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 0x7f41d814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 -- 172.21.15.79:0/3868194177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d806ea20 msgr2=0x7f41d81efaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d806ea20 0x7f41d81efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 -- 172.21.15.79:0/3868194177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d814c5e0 con 0x7f41d80cf190 2024-06-10T00:17:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41dd90d640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d80b00d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f41d0034040 tx=0x7f41d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41cdffb640 1 -- 172.21.15.79:0/3868194177 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0036050 con 0x7f41d80cf190 2024-06-10T00:17:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41cdffb640 1 -- 172.21.15.79:0/3868194177 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0042070 con 0x7f41d80cf190 2024-06-10T00:17:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41cdffb640 1 -- 172.21.15.79:0/3868194177 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0009510 con 0x7f41d80cf190 2024-06-10T00:17:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.934+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d815b5f0 con 0x7f41d80cf190 2024-06-10T00:17:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.935+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d815bbb0 con 0x7f41d80cf190 2024-06-10T00:17:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.936+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d8068430 con 0x7f41d80cf190 2024-06-10T00:17:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.936+0000 7f41cdffb640 1 -- 172.21.15.79:0/3868194177 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41d0007bd0 con 0x7f41d80cf190 2024-06-10T00:17:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.937+0000 7f41cdffb640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41bc06be30 0x7f41bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.937+0000 7f41cdffb640 1 -- 172.21.15.79:0/3868194177 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f41d00abfa0 con 0x7f41d80cf190 2024-06-10T00:17:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.937+0000 7f41dd10c640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41bc06be30 0x7f41bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.937+0000 7f41dd10c640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41bc06be30 0x7f41bc06e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f41c8006fd0 tx=0x7f41c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:04.941+0000 7f41cdffb640 1 -- 172.21.15.79:0/3868194177 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f41d007a7c0 con 0x7f41d80cf190 2024-06-10T00:17:05.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.148+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41d80cf8d0 con 0x7f41d80cf190 2024-06-10T00:17:05.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.149+0000 7f41cdffb640 1 -- 172.21.15.79:0/3868194177 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5184 (secure 0 0 0) 0x7f41d007a0c0 con 0x7f41d80cf190 2024-06-10T00:17:05.149 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:05.149 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:16:20.631079+0000","modified":"2024-06-10T00:16:22.637364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1724490819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1724490819},{"type":"v1","addr":"172.21.15.117:6835","nonce":1724490819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":3}]} 2024-06-10T00:17:05.149 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41bc06be30 msgr2=0x7f41bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41bc06be30 0x7f41bc06e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f41c8006fd0 tx=0x7f41c8008040 comp rx=0 tx=0).stop 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 msgr2=0x7f41d80b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d80b00d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f41d0034040 tx=0x7f41d0004a40 comp rx=0 tx=0).stop 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 shutdown_connections 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41bc06be30 0x7f41bc06e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41d80cf190 0x7f41d80b00d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d80ae910 0x7f41d814c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 --2- 172.21.15.79:0/3868194177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d806ea20 0x7f41d81efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 >> 172.21.15.79:0/3868194177 conn(0x7f41d80b19f0 msgr2=0x7f41d8071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 shutdown_connections 2024-06-10T00:17:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.151+0000 7f41df370640 1 -- 172.21.15.79:0/3868194177 wait complete. 2024-06-10T00:17:05.161 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:05.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.261+0000 7fcb70d7e640 1 Processor -- start 2024-06-10T00:17:05.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.261+0000 7fcb70d7e640 1 -- start start 2024-06-10T00:17:05.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb70d7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb70d7e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb6c071c60 0x7fcb6c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb70d7e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c0ccff0 con 0x7fcb6c0b36c0 2024-06-10T00:17:05.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb70d7e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c072820 con 0x7fcb6c071c60 2024-06-10T00:17:05.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb70d7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c072b00 con 0x7fcb6c0cc6d0 2024-06-10T00:17:05.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb63fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb6c071c60 0x7fcb6c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb6a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb6ad9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcb6c0b36c0 0x7fcb6c0b3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:33286/0 (socket says 172.21.15.79:33286) 2024-06-10T00:17:05.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb6ad9d640 1 -- 172.21.15.79:0/3591977577 learned_addr learned my addr 172.21.15.79:0/3591977577 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:05.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb63fff640 1 -- 172.21.15.79:0/3591977577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cc6d0 msgr2=0x7fcb6c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:05.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb63fff640 1 --2- 172.21.15.79:0/3591977577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb63fff640 1 -- 172.21.15.79:0/3591977577 >> v1:172.21.15.117:6789/0 conn(0x7fcb6c0b36c0 legacy=0x7fcb6c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb63fff640 1 -- 172.21.15.79:0/3591977577 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c072de0 con 0x7fcb6c071c60 2024-06-10T00:17:05.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb69d9b640 1 -- 172.21.15.79:0/3591977577 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829820805 0 0) 0x7fcb6c0ccff0 con 0x7fcb6c0b36c0 2024-06-10T00:17:05.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.262+0000 7fcb6a59c640 1 --2- 172.21.15.79:0/3591977577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:17:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.263+0000 7fcb63fff640 1 --2- 172.21.15.79:0/3591977577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c071c60 0x7fcb6c0720e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb540097a0 tx=0x7fcb5402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d05a6e20808a538 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.263+0000 7fcb69d9b640 1 -- 172.21.15.79:0/3591977577 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb54037070 con 0x7fcb6c071c60 2024-06-10T00:17:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.263+0000 7fcb69d9b640 1 -- 172.21.15.79:0/3591977577 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb54032440 con 0x7fcb6c071c60 2024-06-10T00:17:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.263+0000 7fcb69d9b640 1 -- 172.21.15.79:0/3591977577 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb54032810 con 0x7fcb6c071c60 2024-06-10T00:17:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.264+0000 7fcb70d7e640 1 -- 172.21.15.79:0/3591977577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c071c60 msgr2=0x7fcb6c0720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.264+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/3591977577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c071c60 0x7fcb6c0720e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb540097a0 tx=0x7fcb5402a180 comp rx=0 tx=0).stop 2024-06-10T00:17:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.264+0000 7fcb70d7e640 1 -- 172.21.15.79:0/3591977577 shutdown_connections 2024-06-10T00:17:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.264+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/3591977577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c071c60 0x7fcb6c0720e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.264+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/3591977577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.264+0000 7fcb70d7e640 1 -- 172.21.15.79:0/3591977577 >> 172.21.15.79:0/3591977577 conn(0x7fcb6c0b19f0 msgr2=0x7fcb6c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.264+0000 7fcb70d7e640 1 -- 172.21.15.79:0/3591977577 shutdown_connections 2024-06-10T00:17:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.264+0000 7fcb70d7e640 1 -- 172.21.15.79:0/3591977577 wait complete. 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.265+0000 7fcb70d7e640 1 Processor -- start 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.265+0000 7fcb70d7e640 1 -- start start 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb70d7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c071c60 0x7fcb6c15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb70d7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0b36c0 0x7fcb6c0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb70d7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb70d7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c159f60 con 0x7fcb6c071c60 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb70d7e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c15c890 con 0x7fcb6c0cc6d0 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb70d7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c0b4240 con 0x7fcb6c0b36c0 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c071c60 0x7fcb6c15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c071c60 0x7fcb6c15b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48672/0 (socket says 172.21.15.79:48672) 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6a59c640 1 -- 172.21.15.79:0/733531451 learned_addr learned my addr 172.21.15.79:0/733531451 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb63fff640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0b36c0 0x7fcb6c0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6ad9d640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6a59c640 1 -- 172.21.15.79:0/733531451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0b36c0 msgr2=0x7fcb6c0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6a59c640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0b36c0 0x7fcb6c0ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6a59c640 1 -- 172.21.15.79:0/733531451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0cc6d0 msgr2=0x7fcb6c0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6a59c640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.266+0000 7fcb6a59c640 1 -- 172.21.15.79:0/733531451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c0cf540 con 0x7fcb6c071c60 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.267+0000 7fcb6a59c640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c071c60 0x7fcb6c15b3a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00e990 tx=0x7fcb5c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.267+0000 7fcb62ffd640 1 -- 172.21.15.79:0/733531451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c017070 con 0x7fcb6c071c60 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.267+0000 7fcb62ffd640 1 -- 172.21.15.79:0/733531451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c00c9e0 con 0x7fcb6c071c60 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.267+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c0cf820 con 0x7fcb6c071c60 2024-06-10T00:17:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.267+0000 7fcb62ffd640 1 -- 172.21.15.79:0/733531451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00cdb0 con 0x7fcb6c071c60 2024-06-10T00:17:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.267+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c0cf1f0 con 0x7fcb6c071c60 2024-06-10T00:17:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.268+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c068430 con 0x7fcb6c071c60 2024-06-10T00:17:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.268+0000 7fcb62ffd640 1 -- 172.21.15.79:0/733531451 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb5c01a070 con 0x7fcb6c071c60 2024-06-10T00:17:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.269+0000 7fcb62ffd640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb4c06be30 0x7fcb4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.269+0000 7fcb62ffd640 1 -- 172.21.15.79:0/733531451 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fcb5c08b120 con 0x7fcb6c071c60 2024-06-10T00:17:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.269+0000 7fcb63fff640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb4c06be30 0x7fcb4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.269+0000 7fcb63fff640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb4c06be30 0x7fcb4c06e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb54034000 tx=0x7fcb5402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.273+0000 7fcb62ffd640 1 -- 172.21.15.79:0/733531451 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcb5c059380 con 0x7fcb6c071c60 2024-06-10T00:17:05.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.485+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb6c0b3e70 con 0x7fcb6c071c60 2024-06-10T00:17:05.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.485+0000 7fcb62ffd640 1 -- 172.21.15.79:0/733531451 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5184 (secure 0 0 0) 0x7fcb5c05d680 con 0x7fcb6c071c60 2024-06-10T00:17:05.485 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:05.486 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:16:20.631079+0000","modified":"2024-06-10T00:16:22.637364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1724490819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1724490819},{"type":"v1","addr":"172.21.15.117:6835","nonce":1724490819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":3}]} 2024-06-10T00:17:05.486 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-06-10T00:17:05.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb4c06be30 msgr2=0x7fcb4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb4c06be30 0x7fcb4c06e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb54034000 tx=0x7fcb5402e000 comp rx=0 tx=0).stop 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c071c60 msgr2=0x7fcb6c15b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c071c60 0x7fcb6c15b3a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00e990 tx=0x7fcb5c00ee50 comp rx=0 tx=0).stop 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 shutdown_connections 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb4c06be30 0x7fcb4c06e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0cc6d0 0x7fcb6c0cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0b36c0 0x7fcb6c0ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 --2- 172.21.15.79:0/733531451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c071c60 0x7fcb6c15b3a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 >> 172.21.15.79:0/733531451 conn(0x7fcb6c0b19f0 msgr2=0x7fcb6c0747a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 shutdown_connections 2024-06-10T00:17:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.487+0000 7fcb70d7e640 1 -- 172.21.15.79:0/733531451 wait complete. 2024-06-10T00:17:05.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:17:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.598+0000 7f6646d63640 1 Processor -- start 2024-06-10T00:17:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.599+0000 7f6646d63640 1 -- start start 2024-06-10T00:17:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.599+0000 7f6646d63640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66400ae910 0x7f664006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.599+0000 7f6646d63640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f664006ea20 0x7f66400cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.599+0000 7f6646d63640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664006d130 con 0x7f66400cf190 2024-06-10T00:17:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.599+0000 7f6646d63640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f664006ee90 con 0x7f66400ae910 2024-06-10T00:17:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.599+0000 7f6646d63640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f664006d410 con 0x7f664006ea20 2024-06-10T00:17:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f6644aff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66400ae910 0x7f664006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f6644aff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66400ae910 0x7f664006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48686/0 (socket says 172.21.15.79:48686) 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f6644aff640 1 -- 172.21.15.79:0/3218554117 learned_addr learned my addr 172.21.15.79:0/3218554117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f663ffff640 1 --2- 172.21.15.79:0/3218554117 >> v2:172.21.15.117:3300/0 conn(0x7f664006ea20 0x7f66400cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f6644aff640 1 -- 172.21.15.79:0/3218554117 >> v2:172.21.15.117:3300/0 conn(0x7f664006ea20 msgr2=0x7f66400cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f6644aff640 1 --2- 172.21.15.79:0/3218554117 >> v2:172.21.15.117:3300/0 conn(0x7f664006ea20 0x7f66400cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f6644aff640 1 -- 172.21.15.79:0/3218554117 >> v1:172.21.15.117:6789/0 conn(0x7f66400cf190 legacy=0x7f664015ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f6644aff640 1 -- 172.21.15.79:0/3218554117 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664006d6f0 con 0x7f66400ae910 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.600+0000 7f663ffff640 1 --2- 172.21.15.79:0/3218554117 >> v2:172.21.15.117:3300/0 conn(0x7f664006ea20 0x7f66400cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6644aff640 1 --2- 172.21.15.79:0/3218554117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400ae910 0x7f664006e4e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6640070c80 tx=0x7f663402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d5bdacc7da1805 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f663f7fe640 1 -- 172.21.15.79:0/3218554117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634037070 con 0x7f66400ae910 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f663f7fe640 1 -- 172.21.15.79:0/3218554117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6634032440 con 0x7f66400ae910 2024-06-10T00:17:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f663f7fe640 1 -- 172.21.15.79:0/3218554117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634032810 con 0x7f66400ae910 2024-06-10T00:17:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6646d63640 1 -- 172.21.15.79:0/3218554117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400ae910 msgr2=0x7f664006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6646d63640 1 --2- 172.21.15.79:0/3218554117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400ae910 0x7f664006e4e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6640070c80 tx=0x7f663402a1a0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6646d63640 1 -- 172.21.15.79:0/3218554117 shutdown_connections 2024-06-10T00:17:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6646d63640 1 --2- 172.21.15.79:0/3218554117 >> v2:172.21.15.117:3300/0 conn(0x7f664006ea20 0x7f66400cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6646d63640 1 --2- 172.21.15.79:0/3218554117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400ae910 0x7f664006e4e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6646d63640 1 -- 172.21.15.79:0/3218554117 >> 172.21.15.79:0/3218554117 conn(0x7f66400b19f0 msgr2=0x7f66400b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6646d63640 1 -- 172.21.15.79:0/3218554117 shutdown_connections 2024-06-10T00:17:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.601+0000 7f6646d63640 1 -- 172.21.15.79:0/3218554117 wait complete. 2024-06-10T00:17:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.602+0000 7f6646d63640 1 Processor -- start 2024-06-10T00:17:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.602+0000 7f6646d63640 1 -- start start 2024-06-10T00:17:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6646d63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664006ea20 0x7f664013e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6646d63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66400ae910 0x7f664015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6646d63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400cf190 0x7f6640071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6646d63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f66400aecf0 con 0x7f66400cf190 2024-06-10T00:17:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6646d63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66400cf5e0 con 0x7f664006ea20 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6646d63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66400add50 con 0x7f66400ae910 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6645300640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400cf190 0x7f6640071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6645300640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400cf190 0x7f6640071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48692/0 (socket says 172.21.15.79:48692) 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.603+0000 7f6645300640 1 -- 172.21.15.79:0/1048509999 learned_addr learned my addr 172.21.15.79:0/1048509999 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6644aff640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664006ea20 0x7f664013e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6645300640 1 -- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66400ae910 msgr2=0x7f664015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f663ffff640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66400ae910 0x7f664015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6645300640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66400ae910 0x7f664015c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6645300640 1 -- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664006ea20 msgr2=0x7f664013e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6645300640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664006ea20 0x7f664013e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6645300640 1 -- 172.21.15.79:0/1048509999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66401501b0 con 0x7f66400cf190 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6644aff640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664006ea20 0x7f664013e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6645300640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400cf190 0x7f6640071030 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f663800c7b0 tx=0x7f663800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f663d7fa640 1 -- 172.21.15.79:0/1048509999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638004b60 con 0x7f66400cf190 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f663d7fa640 1 -- 172.21.15.79:0/1048509999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6638004d00 con 0x7f66400cf190 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6640150490 con 0x7f66400cf190 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f663d7fa640 1 -- 172.21.15.79:0/1048509999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663800aa90 con 0x7f66400cf190 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.604+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6640150a50 con 0x7f66400cf190 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.605+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66400ce240 con 0x7f66400cf190 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.605+0000 7f663d7fa640 1 -- 172.21.15.79:0/1048509999 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f663800ac30 con 0x7f66400cf190 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.606+0000 7f663d7fa640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f662406be60 0x7f662406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.606+0000 7f663d7fa640 1 -- 172.21.15.79:0/1048509999 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f663808b290 con 0x7f66400cf190 2024-06-10T00:17:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.606+0000 7f6644aff640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f662406be60 0x7f662406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.606+0000 7f6644aff640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f662406be60 0x7f662406e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6634034000 tx=0x7f663402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.610+0000 7f663d7fa640 1 -- 172.21.15.79:0/1048509999 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f66400ce240 con 0x7f66400cf190 2024-06-10T00:17:05.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.784+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66400af400 con 0x7f66400cf190 2024-06-10T00:17:05.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.785+0000 7f663d7fa640 1 -- 172.21.15.79:0/1048509999 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16894 (secure 0 0 0) 0x7f6638020070 con 0x7f66400cf190 2024-06-10T00:17:05.785 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:05.785 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:16:22.285313+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:16:19.229807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-10T00:16:19.607050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f662406be60 msgr2=0x7f662406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f662406be60 0x7f662406e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6634034000 tx=0x7f663402e000 comp rx=0 tx=0).stop 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400cf190 msgr2=0x7f6640071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400cf190 0x7f6640071030 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f663800c7b0 tx=0x7f663800cc70 comp rx=0 tx=0).stop 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 shutdown_connections 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f662406be60 0x7f662406e320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66400cf190 0x7f6640071030 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66400ae910 0x7f664015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 --2- 172.21.15.79:0/1048509999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664006ea20 0x7f664013e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 >> 172.21.15.79:0/1048509999 conn(0x7f66400b19f0 msgr2=0x7f66400cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:05.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 shutdown_connections 2024-06-10T00:17:05.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.787+0000 7f6646d63640 1 -- 172.21.15.79:0/1048509999 wait complete. 2024-06-10T00:17:05.798 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:17:05.798 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.897+0000 7f4c723f9640 1 Processor -- start 2024-06-10T00:17:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.897+0000 7f4c723f9640 1 -- start start 2024-06-10T00:17:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.897+0000 7f4c723f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c6c161cc0 0x7f4c6c0d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c723f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c0d4cd0 0x7f4c6c0d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c723f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c6c0d03e0 con 0x7f4c6c1618e0 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c723f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4c6c0b4130 con 0x7f4c6c161cc0 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c723f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6c0d0100 con 0x7f4c6c0d4cd0 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c6b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c6c161cc0 0x7f4c6c0d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c6b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c6c161cc0 0x7f4c6c0d2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48706/0 (socket says 172.21.15.79:48706) 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c6b7fe640 1 -- 172.21.15.79:0/4283427458 learned_addr learned my addr 172.21.15.79:0/4283427458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c70996640 1 --2- 172.21.15.79:0/4283427458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c0d4cd0 0x7f4c6c0d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c6b7fe640 1 -- 172.21.15.79:0/4283427458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c0d4cd0 msgr2=0x7f4c6c0d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c6b7fe640 1 --2- 172.21.15.79:0/4283427458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c0d4cd0 0x7f4c6c0d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c6b7fe640 1 -- 172.21.15.79:0/4283427458 >> v1:172.21.15.79:6789/0 conn(0x7f4c6c1618e0 legacy=0x7f4c6c0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.898+0000 7f4c6b7fe640 1 -- 172.21.15.79:0/4283427458 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c0b3ae0 con 0x7f4c6c161cc0 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c6b7fe640 1 --2- 172.21.15.79:0/4283427458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c0d2510 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009870 tx=0x7f4c6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb1d2f0285973c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c6affd640 1 -- 172.21.15.79:0/4283427458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60037070 con 0x7f4c6c161cc0 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c6affd640 1 -- 172.21.15.79:0/4283427458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c60032440 con 0x7f4c6c161cc0 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c6affd640 1 -- 172.21.15.79:0/4283427458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60032810 con 0x7f4c6c161cc0 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c723f9640 1 -- 172.21.15.79:0/4283427458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 msgr2=0x7f4c6c0d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c723f9640 1 --2- 172.21.15.79:0/4283427458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c0d2510 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009870 tx=0x7f4c6002a270 comp rx=0 tx=0).stop 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c723f9640 1 -- 172.21.15.79:0/4283427458 shutdown_connections 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c723f9640 1 --2- 172.21.15.79:0/4283427458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c0d4cd0 0x7f4c6c0d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c723f9640 1 --2- 172.21.15.79:0/4283427458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c0d2510 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.899+0000 7f4c723f9640 1 -- 172.21.15.79:0/4283427458 >> 172.21.15.79:0/4283427458 conn(0x7f4c6c09d410 msgr2=0x7f4c6c0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:05.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.900+0000 7f4c723f9640 1 -- 172.21.15.79:0/4283427458 shutdown_connections 2024-06-10T00:17:05.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.900+0000 7f4c723f9640 1 -- 172.21.15.79:0/4283427458 wait complete. 2024-06-10T00:17:05.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.901+0000 7f4c723f9640 1 Processor -- start 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.901+0000 7f4c723f9640 1 -- start start 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.901+0000 7f4c723f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c6c0d4cd0 0x7f4c6c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.901+0000 7f4c723f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c1618e0 0x7f4c6c1f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c723f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c723f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b4740 con 0x7f4c6c161cc0 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c723f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b45c0 con 0x7f4c6c0d4cd0 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c723f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b48c0 con 0x7f4c6c1618e0 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48714/0 (socket says 172.21.15.79:48714) 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 -- 172.21.15.79:0/3127379542 learned_addr learned my addr 172.21.15.79:0/3127379542 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:05.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c6b7fe640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c1618e0 0x7f4c6c1f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 -- 172.21.15.79:0/3127379542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c1618e0 msgr2=0x7f4c6c1f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c1618e0 0x7f4c6c1f7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 -- 172.21.15.79:0/3127379542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c6c0d4cd0 msgr2=0x7f4c6c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c6bfff640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c6c0d4cd0 0x7f4c6c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c6c0d4cd0 0x7f4c6c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 -- 172.21.15.79:0/3127379542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c0ccd70 con 0x7f4c6c161cc0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c70996640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c155b70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009e30 tx=0x7f4c6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c68ff9640 1 -- 172.21.15.79:0/3127379542 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64018020 con 0x7f4c6c161cc0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c68ff9640 1 -- 172.21.15.79:0/3127379542 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64014480 con 0x7f4c6c161cc0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c0cb370 con 0x7f4c6c161cc0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c68ff9640 1 -- 172.21.15.79:0/3127379542 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64014870 con 0x7f4c6c161cc0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.902+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6c0cb930 con 0x7f4c6c161cc0 2024-06-10T00:17:05.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.903+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c6c068430 con 0x7f4c6c161cc0 2024-06-10T00:17:05.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.904+0000 7f4c68ff9640 1 -- 172.21.15.79:0/3127379542 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c64005d10 con 0x7f4c6c161cc0 2024-06-10T00:17:05.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.904+0000 7f4c68ff9640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5806be30 0x7f4c5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:05.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.904+0000 7f4c68ff9640 1 -- 172.21.15.79:0/3127379542 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f4c6408beb0 con 0x7f4c6c161cc0 2024-06-10T00:17:05.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.904+0000 7f4c6bfff640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5806be30 0x7f4c5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:05.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.905+0000 7f4c6bfff640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5806be30 0x7f4c5806e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0015a0 tx=0x7f4c5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:05.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:05.908+0000 7f4c68ff9640 1 -- 172.21.15.79:0/3127379542 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4c64022030 con 0x7f4c6c161cc0 2024-06-10T00:17:06.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.119+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c6c0ced50 con 0x7f4c6c161cc0 2024-06-10T00:17:06.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.119+0000 7f4c68ff9640 1 -- 172.21.15.79:0/3127379542 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5184 (secure 0 0 0) 0x7f4c64010040 con 0x7f4c6c161cc0 2024-06-10T00:17:06.119 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:16:20.631079+0000","modified":"2024-06-10T00:16:22.637364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1724490819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1724490819},{"type":"v1","addr":"172.21.15.117:6835","nonce":1724490819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":3}]} 2024-06-10T00:17:06.120 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5806be30 msgr2=0x7f4c5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5806be30 0x7f4c5806e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0015a0 tx=0x7f4c5c009040 comp rx=0 tx=0).stop 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 msgr2=0x7f4c6c155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c155b70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009e30 tx=0x7f4c6400c490 comp rx=0 tx=0).stop 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 shutdown_connections 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5806be30 0x7f4c5806e2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6c161cc0 0x7f4c6c155b70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c6c1618e0 0x7f4c6c1f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 --2- 172.21.15.79:0/3127379542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c6c0d4cd0 0x7f4c6c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 >> 172.21.15.79:0/3127379542 conn(0x7f4c6c09d410 msgr2=0x7f4c6c0d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 shutdown_connections 2024-06-10T00:17:06.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.122+0000 7f4c723f9640 1 -- 172.21.15.79:0/3127379542 wait complete. 2024-06-10T00:17:06.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.233+0000 7f215f97e640 1 Processor -- start 2024-06-10T00:17:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.233+0000 7f215f97e640 1 -- start start 2024-06-10T00:17:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f215f97e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21580add50 0x7f2158165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f215f97e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215806d130 con 0x7f21580ae910 2024-06-10T00:17:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f215f97e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215806d410 con 0x7f215806ebf0 2024-06-10T00:17:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f215f97e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f215806d6f0 con 0x7f21580add50 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f215d71a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f21580ae910 0x7f215806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42122/0 (socket says 172.21.15.79:42122) 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f215d71a640 1 -- 172.21.15.79:0/1512626060 learned_addr learned my addr 172.21.15.79:0/1512626060 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154167953 0 0) 0x7f215806d130 con 0x7f21580ae910 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f215df1b640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21580add50 0x7f2158165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2144003520 con 0x7f21580ae910 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3781528253 0 0) 0x7f2144003520 con 0x7f21580ae910 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21580add50 msgr2=0x7f2158165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21580add50 0x7f2158165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 >> v1:172.21.15.117:6789/0 conn(0x7f215806ebf0 legacy=0x7f21580cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215806d9d0 con 0x7f21580ae910 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f2154001670 con 0x7f21580ae910 2024-06-10T00:17:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 >> v1:172.21.15.79:6789/0 conn(0x7f21580ae910 legacy=0x7f215806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f2144003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2144004800 0x7f2144004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21580add50 0x7f2144005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f215806d6f0 con 0x7f21440039e0 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f214400bb20 con 0x7f2144004800 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.234+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f214400df30 con 0x7f21580add50 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215d71a640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f2144003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215cf19640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2144004800 0x7f2144004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215df1b640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21580add50 0x7f2144005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215d71a640 1 -- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21580add50 msgr2=0x7f2144005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215d71a640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21580add50 0x7f2144005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215d71a640 1 -- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2144004800 msgr2=0x7f2144004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215d71a640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2144004800 0x7f2144004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215d71a640 1 -- 172.21.15.79:0/1512626060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2144003520 con 0x7f21440039e0 2024-06-10T00:17:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.235+0000 7f215cf19640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2144004800 0x7f2144004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f215d71a640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f2144003e00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f215400c240 tx=0x7f2144005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d41b2bc9374c14c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154007d10 con 0x7f21440039e0 2024-06-10T00:17:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2154005ad0 con 0x7f21440039e0 2024-06-10T00:17:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f214bfff640 1 -- 172.21.15.79:0/1512626060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154007070 con 0x7f21440039e0 2024-06-10T00:17:06.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f215f97e640 1 -- 172.21.15.79:0/1512626060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 msgr2=0x7f2144003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f215f97e640 1 --2- 172.21.15.79:0/1512626060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f2144003e00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f215400c240 tx=0x7f2144005830 comp rx=0 tx=0).stop 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f215df1b640 1 -- 172.21.15.79:0/1512626060 reap_dead start 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f215f97e640 1 -- 172.21.15.79:0/1512626060 shutdown_connections 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f215f97e640 1 -- 172.21.15.79:0/1512626060 >> 172.21.15.79:0/1512626060 conn(0x7f21580b19f0 msgr2=0x7f21580b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f215f97e640 1 -- 172.21.15.79:0/1512626060 shutdown_connections 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.236+0000 7f215f97e640 1 -- 172.21.15.79:0/1512626060 wait complete. 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.237+0000 7f215f97e640 1 Processor -- start 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.237+0000 7f215f97e640 1 -- start start 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215f97e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f215814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215f97e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21581502a0 0x7f21580b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215f97e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21580b0db0 0x7f215809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215f97e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f21580cf4e0 con 0x7f21440039e0 2024-06-10T00:17:06.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215f97e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f21580cf360 con 0x7f21580b0db0 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215f97e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f21580cf660 con 0x7f21581502a0 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215d71a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f215814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215d71a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f215814f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48734/0 (socket says 172.21.15.79:48734) 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215d71a640 1 -- 172.21.15.79:0/4113919439 learned_addr learned my addr 172.21.15.79:0/4113919439 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215cf19640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21581502a0 0x7f21580b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.238+0000 7f215df1b640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21580b0db0 0x7f215809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215d71a640 1 -- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21581502a0 msgr2=0x7f21580b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215d71a640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21581502a0 0x7f21580b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215d71a640 1 -- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21580b0db0 msgr2=0x7f215809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215d71a640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21580b0db0 0x7f215809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215d71a640 1 -- 172.21.15.79:0/4113919439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215809b5f0 con 0x7f21440039e0 2024-06-10T00:17:06.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215df1b640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21580b0db0 0x7f215809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215cf19640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21581502a0 0x7f21580b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215d71a640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f215814f040 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2154034040 tx=0x7f215806d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f2149ffb640 1 -- 172.21.15.79:0/4113919439 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154042020 con 0x7f21440039e0 2024-06-10T00:17:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f2149ffb640 1 -- 172.21.15.79:0/4113919439 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2154004bf0 con 0x7f21440039e0 2024-06-10T00:17:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215815b5f0 con 0x7f21440039e0 2024-06-10T00:17:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f2149ffb640 1 -- 172.21.15.79:0/4113919439 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154007d10 con 0x7f21440039e0 2024-06-10T00:17:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.239+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215815bbb0 con 0x7f21440039e0 2024-06-10T00:17:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.240+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2158068430 con 0x7f21440039e0 2024-06-10T00:17:06.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.241+0000 7f2149ffb640 1 -- 172.21.15.79:0/4113919439 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2154045020 con 0x7f21440039e0 2024-06-10T00:17:06.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.241+0000 7f2149ffb640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f213c06be60 0x7f213c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.241+0000 7f2149ffb640 1 -- 172.21.15.79:0/4113919439 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f21540ab070 con 0x7f21440039e0 2024-06-10T00:17:06.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.241+0000 7f215cf19640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f213c06be60 0x7f213c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.242+0000 7f215cf19640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f213c06be60 0x7f213c06e320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f214c007fd0 tx=0x7f214c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.245+0000 7f2149ffb640 1 -- 172.21.15.79:0/4113919439 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f215404c020 con 0x7f21440039e0 2024-06-10T00:17:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.455+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f215815a910 con 0x7f21440039e0 2024-06-10T00:17:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.455+0000 7f2149ffb640 1 -- 172.21.15.79:0/4113919439 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5184 (secure 0 0 0) 0x7f2154079920 con 0x7f21440039e0 2024-06-10T00:17:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:06.455 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:16:20.631079+0000","modified":"2024-06-10T00:16:22.637364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1724490819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1724490819},{"type":"v1","addr":"172.21.15.117:6835","nonce":1724490819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":3}]} 2024-06-10T00:17:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-06-10T00:17:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f213c06be60 msgr2=0x7f213c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f213c06be60 0x7f213c06e320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f214c007fd0 tx=0x7f214c009040 comp rx=0 tx=0).stop 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 msgr2=0x7f215814f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f215814f040 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2154034040 tx=0x7f215806d5e0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 shutdown_connections 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f213c06be60 0x7f213c06e320 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21580b0db0 0x7f215809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21581502a0 0x7f21580b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 --2- 172.21.15.79:0/4113919439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21440039e0 0x7f215814f040 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 >> 172.21.15.79:0/4113919439 conn(0x7f21580b19f0 msgr2=0x7f21580b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 shutdown_connections 2024-06-10T00:17:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.458+0000 7f215f97e640 1 -- 172.21.15.79:0/4113919439 wait complete. 2024-06-10T00:17:06.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:17:06.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.567+0000 7fc16cc38640 1 Processor -- start 2024-06-10T00:17:06.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.567+0000 7fc16cc38640 1 -- start start 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc16cc38640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc16806ebf0 0x7fc1680cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc16cc38640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1680cf190 0x7fc1680acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc16cc38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1680cf600 con 0x7fc1680ae910 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc16cc38640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc16806d130 con 0x7fc1680cf190 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc16cc38640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc16806d410 con 0x7fc16806ebf0 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc166d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1680cf190 0x7fc1680acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc166d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc1680cf190 0x7fc1680acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48750/0 (socket says 172.21.15.79:48750) 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc166d9d640 1 -- 172.21.15.79:0/376777203 learned_addr learned my addr 172.21.15.79:0/376777203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc165d9b640 1 --2- 172.21.15.79:0/376777203 >> v2:172.21.15.117:3300/0 conn(0x7fc16806ebf0 0x7fc1680cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc166d9d640 1 -- 172.21.15.79:0/376777203 >> v2:172.21.15.117:3300/0 conn(0x7fc16806ebf0 msgr2=0x7fc1680cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:06.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc166d9d640 1 --2- 172.21.15.79:0/376777203 >> v2:172.21.15.117:3300/0 conn(0x7fc16806ebf0 0x7fc1680cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc166d9d640 1 -- 172.21.15.79:0/376777203 >> v1:172.21.15.79:6789/0 conn(0x7fc1680ae910 legacy=0x7fc16806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc166d9d640 1 -- 172.21.15.79:0/376777203 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16806d6f0 con 0x7fc1680cf190 2024-06-10T00:17:06.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.568+0000 7fc165d9b640 1 --2- 172.21.15.79:0/376777203 >> v2:172.21.15.117:3300/0 conn(0x7fc16806ebf0 0x7fc1680cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc166d9d640 1 --2- 172.21.15.79:0/376777203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680cf190 0x7fc1680acd40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc168070c80 tx=0x7fc16002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609f4f357396afac server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16559a640 1 -- 172.21.15.79:0/376777203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16000b2d0 con 0x7fc1680cf190 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16559a640 1 -- 172.21.15.79:0/376777203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16000b470 con 0x7fc1680cf190 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16559a640 1 -- 172.21.15.79:0/376777203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160009820 con 0x7fc1680cf190 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16cc38640 1 -- 172.21.15.79:0/376777203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680cf190 msgr2=0x7fc1680acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16cc38640 1 --2- 172.21.15.79:0/376777203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680cf190 0x7fc1680acd40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc168070c80 tx=0x7fc16002c8b0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16cc38640 1 -- 172.21.15.79:0/376777203 shutdown_connections 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16cc38640 1 --2- 172.21.15.79:0/376777203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680cf190 0x7fc1680acd40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16cc38640 1 --2- 172.21.15.79:0/376777203 >> v2:172.21.15.117:3300/0 conn(0x7fc16806ebf0 0x7fc1680cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16cc38640 1 -- 172.21.15.79:0/376777203 >> 172.21.15.79:0/376777203 conn(0x7fc1680b19f0 msgr2=0x7fc1680b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16cc38640 1 -- 172.21.15.79:0/376777203 shutdown_connections 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.569+0000 7fc16cc38640 1 -- 172.21.15.79:0/376777203 wait complete. 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.571+0000 7fc16cc38640 1 Processor -- start 2024-06-10T00:17:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.571+0000 7fc16cc38640 1 -- start start 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16cc38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc16806ebf0 0x7fc16815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16cc38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680ae910 0x7fc16814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16cc38640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1680cf190 0x7fc1681f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16cc38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1680ad280 con 0x7fc1680ae910 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16cc38640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc1680aecf0 con 0x7fc16806ebf0 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16cc38640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc1680ad400 con 0x7fc1680cf190 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680ae910 0x7fc16814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680ae910 0x7fc16814c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48752/0 (socket says 172.21.15.79:48752) 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 -- 172.21.15.79:0/671099855 learned_addr learned my addr 172.21.15.79:0/671099855 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc166d9d640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1680cf190 0x7fc1681f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16659c640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc16806ebf0 0x7fc16815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 -- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1680cf190 msgr2=0x7fc1681f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1680cf190 0x7fc1681f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 -- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc16806ebf0 msgr2=0x7fc16815bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc16806ebf0 0x7fc16815bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 -- 172.21.15.79:0/671099855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16814cd60 con 0x7fc1680ae910 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc166d9d640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1680cf190 0x7fc1681f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16659c640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc16806ebf0 0x7fc16815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc165d9b640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680ae910 0x7fc16814c820 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c7f0 tx=0x7fc15000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc15effd640 1 -- 172.21.15.79:0/671099855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150015070 con 0x7fc1680ae910 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc15effd640 1 -- 172.21.15.79:0/671099855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150007820 con 0x7fc1680ae910 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1681f4520 con 0x7fc1680ae910 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc15effd640 1 -- 172.21.15.79:0/671099855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150007bd0 con 0x7fc1680ae910 2024-06-10T00:17:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.572+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1681f4ae0 con 0x7fc1680ae910 2024-06-10T00:17:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.573+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc168068430 con 0x7fc1680ae910 2024-06-10T00:17:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.574+0000 7fc15effd640 1 -- 172.21.15.79:0/671099855 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc150018070 con 0x7fc1680ae910 2024-06-10T00:17:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.574+0000 7fc15effd640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc14806be30 0x7fc14806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.574+0000 7fc16659c640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc14806be30 0x7fc14806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.574+0000 7fc15effd640 1 -- 172.21.15.79:0/671099855 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fc15008aec0 con 0x7fc1680ae910 2024-06-10T00:17:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.575+0000 7fc16659c640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc14806be30 0x7fc14806e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc16815a9f0 tx=0x7fc158009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.579+0000 7fc15effd640 1 -- 172.21.15.79:0/671099855 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc1500596e0 con 0x7fc1680ae910 2024-06-10T00:17:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.751+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1680b3f50 con 0x7fc1680ae910 2024-06-10T00:17:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.752+0000 7fc15effd640 1 -- 172.21.15.79:0/671099855 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16894 (secure 0 0 0) 0x7fc150058fe0 con 0x7fc1680ae910 2024-06-10T00:17:06.752 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:06.752 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:16:22.285313+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:16:19.229807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-10T00:16:19.607050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:17:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc14806be30 msgr2=0x7fc14806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc14806be30 0x7fc14806e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc16815a9f0 tx=0x7fc158009040 comp rx=0 tx=0).stop 2024-06-10T00:17:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680ae910 msgr2=0x7fc16814c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680ae910 0x7fc16814c820 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c7f0 tx=0x7fc15000ccb0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 shutdown_connections 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc14806be30 0x7fc14806e2f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1680cf190 0x7fc1681f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1680ae910 0x7fc16814c820 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 --2- 172.21.15.79:0/671099855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc16806ebf0 0x7fc16815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 >> 172.21.15.79:0/671099855 conn(0x7fc1680b19f0 msgr2=0x7fc168071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 shutdown_connections 2024-06-10T00:17:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.754+0000 7fc16cc38640 1 -- 172.21.15.79:0/671099855 wait complete. 2024-06-10T00:17:06.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:17:06.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.866+0000 7feaa9390640 1 Processor -- start 2024-06-10T00:17:06.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.866+0000 7feaa9390640 1 -- start start 2024-06-10T00:17:06.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa9390640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa40cede0 0x7feaa4169050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa9390640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa40b7d20 con 0x7feaa40b4c80 2024-06-10T00:17:06.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa9390640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa40d1200 con 0x7feaa40b7940 2024-06-10T00:17:06.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa9390640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feaa40cc620 con 0x7feaa40cede0 2024-06-10T00:17:06.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7fea9a7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feaa40b4c80 0x7feaa40ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42138/0 (socket says 172.21.15.79:42138) 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7fea9a7fc640 1 -- 172.21.15.79:0/4258110621 learned_addr learned my addr 172.21.15.79:0/4258110621 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1239387341 0 0) 0x7feaa40b7d20 con 0x7feaa40b4c80 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa37fe640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa40cede0 0x7feaa4169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea90003520 con 0x7feaa40b4c80 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 625588288 0 0) 0x7fea90003520 con 0x7feaa40b4c80 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.867+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa40cede0 msgr2=0x7feaa4169050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa40cede0 0x7feaa4169050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 >> v1:172.21.15.117:6789/0 conn(0x7feaa40b7940 legacy=0x7feaa40d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa40cc900 con 0x7feaa40b4c80 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fea8c001670 con 0x7feaa40b4c80 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 >> v1:172.21.15.79:6789/0 conn(0x7feaa40b4c80 legacy=0x7feaa40ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa40cede0 0x7fea900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea90004010 0x7fea90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90004d40 0x7fea900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feaa40cc620 con 0x7fea90004010 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fea9000bb80 con 0x7fea90004d40 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fea9000bd80 con 0x7feaa40cede0 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7fea9a7fc640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea90004010 0x7fea90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa2ffd640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa40cede0 0x7fea900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7feaa37fe640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90004d40 0x7fea900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7fea9a7fc640 1 -- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa40cede0 msgr2=0x7fea900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7fea9a7fc640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa40cede0 0x7fea900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7fea9a7fc640 1 -- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90004d40 msgr2=0x7fea900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7fea9a7fc640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90004d40 0x7fea900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.868+0000 7fea9a7fc640 1 -- 172.21.15.79:0/4258110621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea90003520 con 0x7fea90004010 2024-06-10T00:17:06.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7fea9a7fc640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea90004010 0x7fea90004800 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00c210 tx=0x7fea90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4801837b9a8e66 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c007d30 con 0x7fea90004010 2024-06-10T00:17:06.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c005af0 con 0x7fea90004010 2024-06-10T00:17:06.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa27fc640 1 -- 172.21.15.79:0/4258110621 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c007070 con 0x7fea90004010 2024-06-10T00:17:06.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa9390640 1 -- 172.21.15.79:0/4258110621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea90004010 msgr2=0x7fea90004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa9390640 1 --2- 172.21.15.79:0/4258110621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea90004010 0x7fea90004800 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00c210 tx=0x7fea90005830 comp rx=0 tx=0).stop 2024-06-10T00:17:06.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa37fe640 1 -- 172.21.15.79:0/4258110621 reap_dead start 2024-06-10T00:17:06.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa9390640 1 -- 172.21.15.79:0/4258110621 shutdown_connections 2024-06-10T00:17:06.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa9390640 1 -- 172.21.15.79:0/4258110621 >> 172.21.15.79:0/4258110621 conn(0x7feaa40d1e50 msgr2=0x7feaa40d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:06.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa9390640 1 -- 172.21.15.79:0/4258110621 shutdown_connections 2024-06-10T00:17:06.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.869+0000 7feaa9390640 1 -- 172.21.15.79:0/4258110621 wait complete. 2024-06-10T00:17:06.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.871+0000 7feaa9390640 1 Processor -- start 2024-06-10T00:17:06.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.871+0000 7feaa9390640 1 -- start start 2024-06-10T00:17:06.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.871+0000 7feaa9390640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90004010 0x7feaa40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa9390640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa406d710 0x7feaa414e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa9390640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa414abc0 0x7feaa414b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa9390640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feaa40d2a90 con 0x7feaa414abc0 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa9390640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feaa40ccec0 con 0x7fea90004010 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa9390640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feaa40d2c10 con 0x7feaa406d710 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa414abc0 0x7feaa414b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa414abc0 0x7feaa414b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48778/0 (socket says 172.21.15.79:48778) 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 -- 172.21.15.79:0/1897191036 learned_addr learned my addr 172.21.15.79:0/1897191036 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 -- 172.21.15.79:0/1897191036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa406d710 msgr2=0x7feaa414e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa406d710 0x7feaa414e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 -- 172.21.15.79:0/1897191036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90004010 msgr2=0x7feaa40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90004010 0x7feaa40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 -- 172.21.15.79:0/1897191036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa406db90 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa37fe640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa414abc0 0x7feaa414b040 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7feaa4073670 tx=0x7fea9c010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7fea9bfff640 1 -- 172.21.15.79:0/1897191036 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c010d90 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7fea9bfff640 1 -- 172.21.15.79:0/1897191036 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c01c070 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa414b8f0 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7fea9bfff640 1 -- 172.21.15.79:0/1897191036 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c017670 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.872+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa414beb0 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.873+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa4068430 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.874+0000 7fea9bfff640 1 -- 172.21.15.79:0/1897191036 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea9c017810 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.874+0000 7fea9bfff640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fea8406be60 0x7fea8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.874+0000 7fea9bfff640 1 -- 172.21.15.79:0/1897191036 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fea9c08bbf0 con 0x7feaa414abc0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.874+0000 7feaa2ffd640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fea8406be60 0x7fea8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:06.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.875+0000 7feaa2ffd640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fea8406be60 0x7fea8406e320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fea94001750 tx=0x7fea94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:06.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:06.878+0000 7fea9bfff640 1 -- 172.21.15.79:0/1897191036 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fea9c026020 con 0x7feaa414abc0 2024-06-10T00:17:07.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.087+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feaa4068d20 con 0x7feaa414abc0 2024-06-10T00:17:07.087 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:17:07.088+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:17:07.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.089+0000 7fea9bfff640 1 -- 172.21.15.79:0/1897191036 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7fea9c05a4a0 con 0x7feaa414abc0 2024-06-10T00:17:07.089 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:17:07.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fea8406be60 msgr2=0x7fea8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:07.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fea8406be60 0x7fea8406e320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fea94001750 tx=0x7fea94009040 comp rx=0 tx=0).stop 2024-06-10T00:17:07.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa414abc0 msgr2=0x7feaa414b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:07.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa414abc0 0x7feaa414b040 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7feaa4073670 tx=0x7fea9c010530 comp rx=0 tx=0).stop 2024-06-10T00:17:07.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 shutdown_connections 2024-06-10T00:17:07.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fea8406be60 0x7fea8406e320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa414abc0 0x7feaa414b040 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaa406d710 0x7feaa414e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 --2- 172.21.15.79:0/1897191036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90004010 0x7feaa40c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 >> 172.21.15.79:0/1897191036 conn(0x7feaa40d1e50 msgr2=0x7feaa4161400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:07.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 shutdown_connections 2024-06-10T00:17:07.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.092+0000 7feaa9390640 1 -- 172.21.15.79:0/1897191036 wait complete. 2024-06-10T00:17:07.096 INFO:tasks.ceph.mds.d.smithi117.stderr: -4915> 2024-06-10T00:16:22.522+0000 7f477ca6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:17:07.098 INFO:tasks.ceph.mds.d.smithi117.stderr: -3066> 2024-06-10T00:16:32.917+0000 7f4778a65640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5547=0-4194304@1} caps={5547=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5547 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x56265624e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-10T00:17:07.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-10T00:17:07.126 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:17:07.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.205+0000 7f87cbbf9640 1 Processor -- start 2024-06-10T00:17:07.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87cbbf9640 1 -- start start 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87cbbf9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87c40b3800 0x7f87c40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87cbbf9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87c40cf190 0x7f87c40d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87cbbf9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c40cf600 con 0x7f87c40d08f0 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87cbbf9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f87c40d1c80 con 0x7f87c40b3800 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87cbbf9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f87c40b3cb0 con 0x7f87c40cf190 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87c9194640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87c40b3800 0x7f87c40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87c9995640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f87c40d08f0 0x7f87c40d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42140/0 (socket says 172.21.15.79:42140) 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87c9995640 1 -- 172.21.15.79:0/2634952144 learned_addr learned my addr 172.21.15.79:0/2634952144 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.206+0000 7f87c9194640 1 --2- 172.21.15.79:0/2634952144 >> v2:172.21.15.79:3300/0 conn(0x7f87c40b3800 0x7f87c40cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48780/0 (socket says 172.21.15.79:48780) 2024-06-10T00:17:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.207+0000 7f87ca196640 1 --2- 172.21.15.79:0/2634952144 >> v2:172.21.15.117:3300/0 conn(0x7f87c40cf190 0x7f87c40d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.207+0000 7f87c9194640 1 -- 172.21.15.79:0/2634952144 >> v2:172.21.15.117:3300/0 conn(0x7f87c40cf190 msgr2=0x7f87c40d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.207+0000 7f87c9194640 1 --2- 172.21.15.79:0/2634952144 >> v2:172.21.15.117:3300/0 conn(0x7f87c40cf190 0x7f87c40d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.207+0000 7f87c9194640 1 -- 172.21.15.79:0/2634952144 >> v1:172.21.15.79:6789/0 conn(0x7f87c40d08f0 legacy=0x7f87c40d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.207+0000 7f87c9194640 1 -- 172.21.15.79:0/2634952144 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c40cf8a0 con 0x7f87c40b3800 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.207+0000 7f87c8993640 1 -- 172.21.15.79:0/2634952144 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879305038 0 0) 0x7f87c40cf600 con 0x7f87c40d08f0 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.207+0000 7f87ca196640 1 --2- 172.21.15.79:0/2634952144 >> v2:172.21.15.117:3300/0 conn(0x7f87c40cf190 0x7f87c40d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.207+0000 7f87c9194640 1 --2- 172.21.15.79:0/2634952144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40b3800 0x7f87c40cec50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f87b40097a0 tx=0x7f87b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27aff63e840b2d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87c8993640 1 -- 172.21.15.79:0/2634952144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4037070 con 0x7f87c40b3800 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87c8993640 1 -- 172.21.15.79:0/2634952144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b4032440 con 0x7f87c40b3800 2024-06-10T00:17:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87c8993640 1 -- 172.21.15.79:0/2634952144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4032810 con 0x7f87c40b3800 2024-06-10T00:17:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87cbbf9640 1 -- 172.21.15.79:0/2634952144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40b3800 msgr2=0x7f87c40cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/2634952144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40b3800 0x7f87c40cec50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f87b40097a0 tx=0x7f87b402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87cbbf9640 1 -- 172.21.15.79:0/2634952144 shutdown_connections 2024-06-10T00:17:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/2634952144 >> v2:172.21.15.117:3300/0 conn(0x7f87c40cf190 0x7f87c40d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/2634952144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40b3800 0x7f87c40cec50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87cbbf9640 1 -- 172.21.15.79:0/2634952144 >> 172.21.15.79:0/2634952144 conn(0x7f87c409d3c0 msgr2=0x7f87c40d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87cbbf9640 1 -- 172.21.15.79:0/2634952144 shutdown_connections 2024-06-10T00:17:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.208+0000 7f87cbbf9640 1 -- 172.21.15.79:0/2634952144 wait complete. 2024-06-10T00:17:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.209+0000 7f87cbbf9640 1 Processor -- start 2024-06-10T00:17:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.209+0000 7f87cbbf9640 1 -- start start 2024-06-10T00:17:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87cbbf9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87c40b3800 0x7f87c4159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87cbbf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40cf190 0x7f87c40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87cbbf9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40d08f0 0x7f87c40b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87cbbf9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f87c40d1ed0 con 0x7f87c40cf190 2024-06-10T00:17:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87cbbf9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f87c40cfe60 con 0x7f87c40b3800 2024-06-10T00:17:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87cbbf9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87c40b50c0 con 0x7f87c40d08f0 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9194640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40cf190 0x7f87c40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9194640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40cf190 0x7f87c40b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48786/0 (socket says 172.21.15.79:48786) 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9194640 1 -- 172.21.15.79:0/3106069529 learned_addr learned my addr 172.21.15.79:0/3106069529 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9995640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87c40b3800 0x7f87c4159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87ca196640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40d08f0 0x7f87c40b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9194640 1 -- 172.21.15.79:0/3106069529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40d08f0 msgr2=0x7f87c40b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9194640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40d08f0 0x7f87c40b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9194640 1 -- 172.21.15.79:0/3106069529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87c40b3800 msgr2=0x7f87c4159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9194640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87c40b3800 0x7f87c4159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.210+0000 7f87c9194640 1 -- 172.21.15.79:0/3106069529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c40b7ac0 con 0x7f87c40cf190 2024-06-10T00:17:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.211+0000 7f87c9194640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40cf190 0x7f87c40b7150 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87b40098c0 tx=0x7f87b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.211+0000 7f87ba7fc640 1 -- 172.21.15.79:0/3106069529 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4037040 con 0x7f87c40cf190 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.211+0000 7f87ba7fc640 1 -- 172.21.15.79:0/3106069529 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b4030770 con 0x7f87c40cf190 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.211+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c40b7da0 con 0x7f87c40cf190 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.211+0000 7f87ba7fc640 1 -- 172.21.15.79:0/3106069529 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4030b40 con 0x7f87c40cf190 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.211+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c40b8840 con 0x7f87c40cf190 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.212+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c40b8650 con 0x7f87c40cf190 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.212+0000 7f87ba7fc640 1 -- 172.21.15.79:0/3106069529 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87b4044020 con 0x7f87c40cf190 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.213+0000 7f87ba7fc640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f87a806be30 0x7f87a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.213+0000 7f87ba7fc640 1 -- 172.21.15.79:0/3106069529 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6187+0+0 (secure 0 0 0) 0x7f87b40ab3f0 con 0x7f87c40cf190 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.213+0000 7f87c9995640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f87a806be30 0x7f87a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:07.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.213+0000 7f87c9995640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f87a806be30 0x7f87a806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f87c00012e0 tx=0x7f87c0001630 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:07.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.217+0000 7f87ba7fc640 1 -- 172.21.15.79:0/3106069529 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f87b4032e20 con 0x7f87c40cf190 2024-06-10T00:17:07.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:07.425+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f87c40683c0 con 0x7f87c40cf190 2024-06-10T00:17:08.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.095+0000 7f87ba7fc640 1 -- 172.21.15.79:0/3106069529 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f87b4079570 con 0x7f87c40cf190 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f87a806be30 msgr2=0x7f87a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f87a806be30 0x7f87a806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f87c00012e0 tx=0x7f87c0001630 comp rx=0 tx=0).stop 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40cf190 msgr2=0x7f87c40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40cf190 0x7f87c40b7150 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87b40098c0 tx=0x7f87b40046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 shutdown_connections 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f87a806be30 0x7f87a806e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40d08f0 0x7f87c40b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87c40cf190 0x7f87c40b7150 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 --2- 172.21.15.79:0/3106069529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87c40b3800 0x7f87c4159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 >> 172.21.15.79:0/3106069529 conn(0x7f87c409d3c0 msgr2=0x7f87c40b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:08.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 shutdown_connections 2024-06-10T00:17:08.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.097+0000 7f87cbbf9640 1 -- 172.21.15.79:0/3106069529 wait complete. 2024-06-10T00:17:08.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-10T00:17:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.216+0000 7fb6af59e640 1 Processor -- start 2024-06-10T00:17:08.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.216+0000 7fb6af59e640 1 -- start start 2024-06-10T00:17:08.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.217+0000 7fb6af59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b0144590 0x7fb6b006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.217+0000 7fb6af59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb6b00cab60 0x7fb6b006e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.217+0000 7fb6af59e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b006f220 con 0x7fb6b006edf0 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.217+0000 7fb6af59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b00cbc30 con 0x7fb6b00cab60 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.217+0000 7fb6af59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b00cb020 con 0x7fb6b0144590 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6aed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb6b006edf0 0x7fb6b015e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52100/0 (socket says 172.21.15.79:52100) 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6aed9d640 1 -- 172.21.15.79:0/2974831314 learned_addr learned my addr 172.21.15.79:0/2974831314 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ae59c640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b0144590 0x7fb6b006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6add9b640 1 --2- 172.21.15.79:0/2974831314 >> v2:172.21.15.117:3300/0 conn(0x7fb6b00cab60 0x7fb6b006e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2030347408 0 0) 0x7fb6b006f220 con 0x7fb6b006edf0 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb69c003520 con 0x7fb6b006edf0 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3072190535 0 0) 0x7fb69c003520 con 0x7fb6b006edf0 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b0144590 msgr2=0x7fb6b006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:08.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b0144590 0x7fb6b006cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 >> v2:172.21.15.117:3300/0 conn(0x7fb6b00cab60 msgr2=0x7fb6b006e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 --2- 172.21.15.79:0/2974831314 >> v2:172.21.15.117:3300/0 conn(0x7fb6b00cab60 0x7fb6b006e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b00cb300 con 0x7fb6b006edf0 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fb6a80019f0 con 0x7fb6b006edf0 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 >> v1:172.21.15.79:6789/0 conn(0x7fb6b006edf0 legacy=0x7fb6b015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b0144590 0x7fb69c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb69c003f30 0x7fb69c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69c004d40 0x7fb69c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00cbc30 con 0x7fb69c003f30 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00cb020 con 0x7fb69c004d40 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb69c00b9c0 con 0x7fb6b0144590 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6add9b640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb69c003f30 0x7fb69c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6aed9d640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69c004d40 0x7fb69c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.218+0000 7fb6ae59c640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b0144590 0x7fb69c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6add9b640 1 -- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b0144590 msgr2=0x7fb69c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6add9b640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b0144590 0x7fb69c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6add9b640 1 -- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69c004d40 msgr2=0x7fb69c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6add9b640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69c004d40 0x7fb69c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6add9b640 1 -- 172.21.15.79:0/2974831314 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69c003520 con 0x7fb69c003f30 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6add9b640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb69c003f30 0x7fb69c004800 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009ac0 tx=0x7fb69c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cc4be38de3b13f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0036070 con 0x7fb69c003f30 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a0031400 con 0x7fb69c003f30 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.219+0000 7fb6ad59a640 1 -- 172.21.15.79:0/2974831314 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0009690 con 0x7fb69c003f30 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.220+0000 7fb6af59e640 1 -- 172.21.15.79:0/2974831314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb69c003f30 msgr2=0x7fb69c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.220+0000 7fb6af59e640 1 --2- 172.21.15.79:0/2974831314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb69c003f30 0x7fb69c004800 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009ac0 tx=0x7fb69c005830 comp rx=0 tx=0).stop 2024-06-10T00:17:08.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.220+0000 7fb6aed9d640 1 -- 172.21.15.79:0/2974831314 reap_dead start 2024-06-10T00:17:08.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.220+0000 7fb6af59e640 1 -- 172.21.15.79:0/2974831314 shutdown_connections 2024-06-10T00:17:08.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.220+0000 7fb6af59e640 1 -- 172.21.15.79:0/2974831314 >> 172.21.15.79:0/2974831314 conn(0x7fb6b00cfa90 msgr2=0x7fb6b00cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:08.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.220+0000 7fb6af59e640 1 -- 172.21.15.79:0/2974831314 shutdown_connections 2024-06-10T00:17:08.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.220+0000 7fb6af59e640 1 -- 172.21.15.79:0/2974831314 wait complete. 2024-06-10T00:17:08.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.221+0000 7fb6af59e640 1 Processor -- start 2024-06-10T00:17:08.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.221+0000 7fb6af59e640 1 -- start start 2024-06-10T00:17:08.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6af59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb69c003f30 0x7fb6b00ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6af59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b00c6e00 0x7fb6b00c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6af59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b013d190 0x7fb6b013d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6af59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b0144970 con 0x7fb6b013d190 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6af59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00cb8c0 con 0x7fb6b00c6e00 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6af59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b0071ec0 con 0x7fb69c003f30 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b013d190 0x7fb6b013d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b013d190 0x7fb6b013d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48240/0 (socket says 172.21.15.79:48240) 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6aed9d640 1 -- 172.21.15.79:0/2007448043 learned_addr learned my addr 172.21.15.79:0/2007448043 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6ae59c640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb69c003f30 0x7fb6b00ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6add9b640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b00c6e00 0x7fb6b00c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6aed9d640 1 -- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb69c003f30 msgr2=0x7fb6b00ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6aed9d640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb69c003f30 0x7fb6b00ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6aed9d640 1 -- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b00c6e00 msgr2=0x7fb6b00c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:08.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6aed9d640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b00c6e00 0x7fb6b00c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6aed9d640 1 -- 172.21.15.79:0/2007448043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b013dd60 con 0x7fb6b013d190 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.222+0000 7fb6add9b640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b00c6e00 0x7fb6b00c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.223+0000 7fb6aed9d640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b013d190 0x7fb6b013d5d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00cbdb0 tx=0x7fb6a800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.223+0000 7fb6a6ffd640 1 -- 172.21.15.79:0/2007448043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a800ee20 con 0x7fb6b013d190 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.223+0000 7fb6a6ffd640 1 -- 172.21.15.79:0/2007448043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a8018070 con 0x7fb6b013d190 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.223+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b013db10 con 0x7fb6b013d190 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.223+0000 7fb6a6ffd640 1 -- 172.21.15.79:0/2007448043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8013660 con 0x7fb6b013d190 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.223+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b00aee50 con 0x7fb6b013d190 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.224+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b00683c0 con 0x7fb6b013d190 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.224+0000 7fb6a6ffd640 1 -- 172.21.15.79:0/2007448043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6a8013800 con 0x7fb6b013d190 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.225+0000 7fb6a6ffd640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb69006be60 0x7fb69006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.225+0000 7fb6a6ffd640 1 -- 172.21.15.79:0/2007448043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6187+0+0 (secure 0 0 0) 0x7fb6a808b320 con 0x7fb6b013d190 2024-06-10T00:17:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.225+0000 7fb6ae59c640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb69006be60 0x7fb69006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.225+0000 7fb6ae59c640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb69006be60 0x7fb69006e320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb6980099e0 tx=0x7fb698008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:08.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.229+0000 7fb6a6ffd640 1 -- 172.21.15.79:0/2007448043 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb6a8059b80 con 0x7fb6b013d190 2024-06-10T00:17:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:08.409+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb6b00cdfd0 con 0x7fb6b013d190 2024-06-10T00:17:09.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.400+0000 7fb6a6ffd640 1 -- 172.21.15.79:0/2007448043 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) ==== 181+0+0 (secure 0 0 0) 0x7fb6a8059480 con 0x7fb6b013d190 2024-06-10T00:17:09.400 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-06-10T00:17:09.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb69006be60 msgr2=0x7fb69006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:09.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb69006be60 0x7fb69006e320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb6980099e0 tx=0x7fb698008040 comp rx=0 tx=0).stop 2024-06-10T00:17:09.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b013d190 msgr2=0x7fb6b013d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b013d190 0x7fb6b013d5d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00cbdb0 tx=0x7fb6a800e530 comp rx=0 tx=0).stop 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 shutdown_connections 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb69006be60 0x7fb69006e320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b013d190 0x7fb6b013d5d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b00c6e00 0x7fb6b00c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 --2- 172.21.15.79:0/2007448043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb69c003f30 0x7fb6b00ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.403+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 >> 172.21.15.79:0/2007448043 conn(0x7fb6b00cfa90 msgr2=0x7fb6b006ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.404+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 shutdown_connections 2024-06-10T00:17:09.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.404+0000 7fb6af59e640 1 -- 172.21.15.79:0/2007448043 wait complete. 2024-06-10T00:17:09.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-10T00:17:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.527+0000 7f1bbcee7640 1 Processor -- start 2024-06-10T00:17:09.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.528+0000 7f1bbcee7640 1 -- start start 2024-06-10T00:17:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.528+0000 7f1bbcee7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1bb8155590 0x7f1bb815b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.528+0000 7f1bbcee7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1bb815b9a0 0x7f1bb80cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.528+0000 7f1bbcee7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb815eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bbcee7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb80acd40 con 0x7f1bb815b9a0 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bbcee7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb815bfe0 con 0x7f1bb8155590 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bbcee7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb815c2c0 con 0x7f1bb80cf1a0 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb5d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1bb815b9a0 0x7f1bb80cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb5d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1bb815b9a0 0x7f1bb80cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48256/0 (socket says 172.21.15.79:48256) 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb5d9b640 1 -- 172.21.15.79:0/3221467103 learned_addr learned my addr 172.21.15.79:0/3221467103 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb6d9d640 1 --2- 172.21.15.79:0/3221467103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb815eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb659c640 1 --2- 172.21.15.79:0/3221467103 >> v2:172.21.15.117:3300/0 conn(0x7f1bb8155590 0x7f1bb815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb5d9b640 1 -- 172.21.15.79:0/3221467103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 msgr2=0x7f1bb815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb5d9b640 1 --2- 172.21.15.79:0/3221467103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb815eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb5d9b640 1 -- 172.21.15.79:0/3221467103 >> v2:172.21.15.117:3300/0 conn(0x7f1bb8155590 msgr2=0x7f1bb815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb5d9b640 1 --2- 172.21.15.79:0/3221467103 >> v2:172.21.15.117:3300/0 conn(0x7f1bb8155590 0x7f1bb815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb5d9b640 1 -- 172.21.15.79:0/3221467103 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb80ad000 con 0x7f1bb815b9a0 2024-06-10T00:17:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb6d9d640 1 --2- 172.21.15.79:0/3221467103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.529+0000 7f1bb659c640 1 --2- 172.21.15.79:0/3221467103 >> v2:172.21.15.117:3300/0 conn(0x7f1bb8155590 0x7f1bb815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bb5d9b640 1 --2- 172.21.15.79:0/3221467103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb815b9a0 0x7f1bb80cec60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8074220 tx=0x7f1bac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ab489b55adf90f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bb559a640 1 -- 172.21.15.79:0/3221467103 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac037070 con 0x7f1bb815b9a0 2024-06-10T00:17:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bb559a640 1 -- 172.21.15.79:0/3221467103 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac032440 con 0x7f1bb815b9a0 2024-06-10T00:17:09.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bb559a640 1 -- 172.21.15.79:0/3221467103 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac032810 con 0x7f1bb815b9a0 2024-06-10T00:17:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bbcee7640 1 -- 172.21.15.79:0/3221467103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb815b9a0 msgr2=0x7f1bb80cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:09.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/3221467103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb815b9a0 0x7f1bb80cec60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8074220 tx=0x7f1bac02a1e0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bbcee7640 1 -- 172.21.15.79:0/3221467103 shutdown_connections 2024-06-10T00:17:09.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/3221467103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/3221467103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb815b9a0 0x7f1bb80cec60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/3221467103 >> v2:172.21.15.117:3300/0 conn(0x7f1bb8155590 0x7f1bb815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.530+0000 7f1bbcee7640 1 -- 172.21.15.79:0/3221467103 >> 172.21.15.79:0/3221467103 conn(0x7f1bb80b1980 msgr2=0x7f1bb80b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.531+0000 7f1bbcee7640 1 -- 172.21.15.79:0/3221467103 shutdown_connections 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.531+0000 7f1bbcee7640 1 -- 172.21.15.79:0/3221467103 wait complete. 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.532+0000 7f1bbcee7640 1 Processor -- start 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.532+0000 7f1bbcee7640 1 -- start start 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bbcee7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb81476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bbcee7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb8155590 0x7f1bb815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bbcee7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb815b9a0 0x7f1bb80cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bbcee7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb815efe0 con 0x7f1bb8155590 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bbcee7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80b26d0 con 0x7f1bb815b9a0 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bbcee7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb815f160 con 0x7f1bb80cf1a0 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb8155590 0x7f1bb815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb8155590 0x7f1bb815e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48268/0 (socket says 172.21.15.79:48268) 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 -- 172.21.15.79:0/2080773059 learned_addr learned my addr 172.21.15.79:0/2080773059 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb6d9d640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb815b9a0 0x7f1bb80cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb659c640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb81476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 -- 172.21.15.79:0/2080773059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 msgr2=0x7f1bb81476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb81476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 -- 172.21.15.79:0/2080773059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb815b9a0 msgr2=0x7f1bb80cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb815b9a0 0x7f1bb80cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 -- 172.21.15.79:0/2080773059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8147c20 con 0x7f1bb8155590 2024-06-10T00:17:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bb5d9b640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb8155590 0x7f1bb815e150 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1bac000c00 tx=0x7f1bac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1ba6ffd640 1 -- 172.21.15.79:0/2080773059 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac041020 con 0x7f1bb8155590 2024-06-10T00:17:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1ba6ffd640 1 -- 172.21.15.79:0/2080773059 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac0306c0 con 0x7f1bb8155590 2024-06-10T00:17:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb81f7600 con 0x7f1bb8155590 2024-06-10T00:17:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1ba6ffd640 1 -- 172.21.15.79:0/2080773059 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac037040 con 0x7f1bb8155590 2024-06-10T00:17:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.533+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb81f7bc0 con 0x7f1bb8155590 2024-06-10T00:17:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.534+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb809c1f0 con 0x7f1bb8155590 2024-06-10T00:17:09.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.535+0000 7f1ba6ffd640 1 -- 172.21.15.79:0/2080773059 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bac044020 con 0x7f1bb8155590 2024-06-10T00:17:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.535+0000 7f1ba6ffd640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1b9806be30 0x7f1b9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.535+0000 7f1ba6ffd640 1 -- 172.21.15.79:0/2080773059 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5749+0+0 (secure 0 0 0) 0x7f1bac0ab6d0 con 0x7f1bb8155590 2024-06-10T00:17:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.535+0000 7f1bb659c640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1b9806be30 0x7f1b9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.536+0000 7f1bb659c640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1b9806be30 0x7f1b9806e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009f70 tx=0x7f1ba800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.539+0000 7f1ba6ffd640 1 -- 172.21.15.79:0/2080773059 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1bac04b030 con 0x7f1bb8155590 2024-06-10T00:17:09.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:09.717+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1bb815b5e0 con 0x7f1bb8155590 2024-06-10T00:17:10.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.404+0000 7f1ba6ffd640 1 -- 172.21.15.79:0/2080773059 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) ==== 169+0+0 (secure 0 0 0) 0x7f1bb8147c20 con 0x7f1bb8155590 2024-06-10T00:17:10.404 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-06-10T00:17:10.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1b9806be30 msgr2=0x7f1b9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1b9806be30 0x7f1b9806e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009f70 tx=0x7f1ba800b040 comp rx=0 tx=0).stop 2024-06-10T00:17:10.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb8155590 msgr2=0x7f1bb815e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb8155590 0x7f1bb815e150 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1bac000c00 tx=0x7f1bac0046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 shutdown_connections 2024-06-10T00:17:10.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1b9806be30 0x7f1b9806e2f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb815b9a0 0x7f1bb80cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb8155590 0x7f1bb815e150 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 --2- 172.21.15.79:0/2080773059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb80cf1a0 0x7f1bb81476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 >> 172.21.15.79:0/2080773059 conn(0x7f1bb80b1980 msgr2=0x7f1bb80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:10.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 shutdown_connections 2024-06-10T00:17:10.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.408+0000 7f1bbcee7640 1 -- 172.21.15.79:0/2080773059 wait complete. 2024-06-10T00:17:10.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-10T00:17:10.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.524+0000 7fe654990640 1 Processor -- start 2024-06-10T00:17:10.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.524+0000 7fe654990640 1 -- start start 2024-06-10T00:17:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.525+0000 7fe654990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500b3800 0x7fe6500cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.525+0000 7fe654990640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6500cf190 0x7fe6500d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.525+0000 7fe654990640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6500b3c80 con 0x7fe6500d08f0 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.525+0000 7fe654990640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe6500d1c80 con 0x7fe6500cf190 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.525+0000 7fe654990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe6500cf620 con 0x7fe6500b3800 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6500cf190 0x7fe6500d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6500cf190 0x7fe6500d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48284/0 (socket says 172.21.15.79:48284) 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64ed9d640 1 -- 172.21.15.79:0/3417403736 learned_addr learned my addr 172.21.15.79:0/3417403736 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64dd9b640 1 --2- 172.21.15.79:0/3417403736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500b3800 0x7fe6500cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64ed9d640 1 -- 172.21.15.79:0/3417403736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500b3800 msgr2=0x7fe6500cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64ed9d640 1 --2- 172.21.15.79:0/3417403736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500b3800 0x7fe6500cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64ed9d640 1 -- 172.21.15.79:0/3417403736 >> v1:172.21.15.117:6789/0 conn(0x7fe6500d08f0 legacy=0x7fe6500d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64ed9d640 1 -- 172.21.15.79:0/3417403736 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500cf8a0 con 0x7fe6500cf190 2024-06-10T00:17:10.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.526+0000 7fe64dd9b640 1 --2- 172.21.15.79:0/3417403736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500b3800 0x7fe6500cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe64ed9d640 1 --2- 172.21.15.79:0/3417403736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500cf190 0x7fe6500d23f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe648009870 tx=0x7fe64802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbb658d3d259336 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe64d59a640 1 -- 172.21.15.79:0/3417403736 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648037070 con 0x7fe6500cf190 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe64d59a640 1 -- 172.21.15.79:0/3417403736 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648032440 con 0x7fe6500cf190 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe64d59a640 1 -- 172.21.15.79:0/3417403736 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648032810 con 0x7fe6500cf190 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe654990640 1 -- 172.21.15.79:0/3417403736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500cf190 msgr2=0x7fe6500d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe654990640 1 --2- 172.21.15.79:0/3417403736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500cf190 0x7fe6500d23f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe648009870 tx=0x7fe64802a270 comp rx=0 tx=0).stop 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe654990640 1 -- 172.21.15.79:0/3417403736 shutdown_connections 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe654990640 1 --2- 172.21.15.79:0/3417403736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500cf190 0x7fe6500d23f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe654990640 1 --2- 172.21.15.79:0/3417403736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500b3800 0x7fe6500cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe654990640 1 -- 172.21.15.79:0/3417403736 >> 172.21.15.79:0/3417403736 conn(0x7fe65009d3c0 msgr2=0x7fe6500d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe654990640 1 -- 172.21.15.79:0/3417403736 shutdown_connections 2024-06-10T00:17:10.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.527+0000 7fe654990640 1 -- 172.21.15.79:0/3417403736 wait complete. 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe654990640 1 Processor -- start 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe654990640 1 -- start start 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe654990640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500b3800 0x7fe650157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe654990640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6500cf190 0x7fe6500b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe654990640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500d08f0 0x7fe650159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe654990640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6500d1ed0 con 0x7fe6500b3800 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe654990640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6500cfe60 con 0x7fe6500cf190 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe654990640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe6500b50c0 con 0x7fe6500d08f0 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe64e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500b3800 0x7fe650157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe64e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500b3800 0x7fe650157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48286/0 (socket says 172.21.15.79:48286) 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.529+0000 7fe64e59c640 1 -- 172.21.15.79:0/1597672663 learned_addr learned my addr 172.21.15.79:0/1597672663 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:10.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64dd9b640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6500cf190 0x7fe6500b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64ed9d640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500d08f0 0x7fe650159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64e59c640 1 -- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500d08f0 msgr2=0x7fe650159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64e59c640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500d08f0 0x7fe650159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64e59c640 1 -- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6500cf190 msgr2=0x7fe6500b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64e59c640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6500cf190 0x7fe6500b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64e59c640 1 -- 172.21.15.79:0/1597672663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500b8430 con 0x7fe6500b3800 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64dd9b640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6500cf190 0x7fe6500b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64ed9d640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500d08f0 0x7fe650159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe64e59c640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500b3800 0x7fe650157ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe64000c7c0 tx=0x7fe64000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe646ffd640 1 -- 172.21.15.79:0/1597672663 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640016020 con 0x7fe6500b3800 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe646ffd640 1 -- 172.21.15.79:0/1597672663 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe640006d50 con 0x7fe6500b3800 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6500b8710 con 0x7fe6500b3800 2024-06-10T00:17:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe646ffd640 1 -- 172.21.15.79:0/1597672663 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640003bb0 con 0x7fe6500b3800 2024-06-10T00:17:10.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.530+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6500b8cd0 con 0x7fe6500b3800 2024-06-10T00:17:10.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.531+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6500b9110 con 0x7fe6500b3800 2024-06-10T00:17:10.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.531+0000 7fe646ffd640 1 -- 172.21.15.79:0/1597672663 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe64000a850 con 0x7fe6500b3800 2024-06-10T00:17:10.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.532+0000 7fe646ffd640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.532+0000 7fe646ffd640 1 -- 172.21.15.79:0/1597672663 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fe64008a9c0 con 0x7fe6500b3800 2024-06-10T00:17:10.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.532+0000 7fe64dd9b640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.532+0000 7fe64dd9b640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe638006fd0 tx=0x7fe638008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:10.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.536+0000 7fe646ffd640 1 -- 172.21.15.79:0/1597672663 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe64008ce20 con 0x7fe6500b3800 2024-06-10T00:17:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.710+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe6500683c0 con 0x7fe6500b3800 2024-06-10T00:17:10.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.713+0000 7fe646ffd640 1 -- 172.21.15.79:0/1597672663 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fe640020020 con 0x7fe6500b3800 2024-06-10T00:17:10.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 msgr2=0x7fe63006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe638006fd0 tx=0x7fe638008040 comp rx=0 tx=0).stop 2024-06-10T00:17:10.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500b3800 msgr2=0x7fe650157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500b3800 0x7fe650157ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe64000c7c0 tx=0x7fe64000cc80 comp rx=0 tx=0).stop 2024-06-10T00:17:10.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 shutdown_connections 2024-06-10T00:17:10.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6500d08f0 0x7fe650159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6500cf190 0x7fe6500b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 --2- 172.21.15.79:0/1597672663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6500b3800 0x7fe650157ad0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 >> 172.21.15.79:0/1597672663 conn(0x7fe65009d3c0 msgr2=0x7fe65006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:10.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 shutdown_connections 2024-06-10T00:17:10.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.715+0000 7fe654990640 1 -- 172.21.15.79:0/1597672663 wait complete. 2024-06-10T00:17:10.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-06-10T00:17:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.825+0000 7fa18f7f9640 1 Processor -- start 2024-06-10T00:17:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.826+0000 7fa18f7f9640 1 -- start start 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.826+0000 7fa18f7f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1880d2680 0x7fa18815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.826+0000 7fa18f7f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880cef70 0x7fa1880cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.826+0000 7fa18f7f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1880d0ad0 con 0x7fa1880d1fc0 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.826+0000 7fa18f7f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa1880d13e0 con 0x7fa1880d2680 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.826+0000 7fa18f7f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa18815f890 con 0x7fa1880cef70 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18d595640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1880d2680 0x7fa18815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18cd94640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa1880d1fc0 0x7fa1880d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52110/0 (socket says 172.21.15.79:52110) 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18cd94640 1 -- 172.21.15.79:0/3048370407 learned_addr learned my addr 172.21.15.79:0/3048370407 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18dd96640 1 --2- 172.21.15.79:0/3048370407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880cef70 0x7fa1880cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18d595640 1 -- 172.21.15.79:0/3048370407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880cef70 msgr2=0x7fa1880cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18d595640 1 --2- 172.21.15.79:0/3048370407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880cef70 0x7fa1880cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18d595640 1 -- 172.21.15.79:0/3048370407 >> v1:172.21.15.79:6789/0 conn(0x7fa1880d1fc0 legacy=0x7fa1880d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa187fff640 1 -- 172.21.15.79:0/3048370407 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194118223 0 0) 0x7fa1880d0ad0 con 0x7fa1880d1fc0 2024-06-10T00:17:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18d595640 1 -- 172.21.15.79:0/3048370407 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1880d0d90 con 0x7fa1880d2680 2024-06-10T00:17:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.827+0000 7fa18dd96640 1 --2- 172.21.15.79:0/3048370407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880cef70 0x7fa1880cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18d595640 1 --2- 172.21.15.79:0/3048370407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815f1a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa178009d90 tx=0x7fa17802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8300aa60b562f350 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa187fff640 1 -- 172.21.15.79:0/3048370407 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178007740 con 0x7fa1880d2680 2024-06-10T00:17:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa187fff640 1 -- 172.21.15.79:0/3048370407 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1780078e0 con 0x7fa1880d2680 2024-06-10T00:17:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa187fff640 1 -- 172.21.15.79:0/3048370407 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178007cb0 con 0x7fa1880d2680 2024-06-10T00:17:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3048370407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 msgr2=0x7fa18815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3048370407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815f1a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa178009d90 tx=0x7fa17802a660 comp rx=0 tx=0).stop 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3048370407 shutdown_connections 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3048370407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880cef70 0x7fa1880cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3048370407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815f1a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3048370407 >> 172.21.15.79:0/3048370407 conn(0x7fa18809d3f0 msgr2=0x7fa1880d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3048370407 shutdown_connections 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.828+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3048370407 wait complete. 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.829+0000 7fa18f7f9640 1 Processor -- start 2024-06-10T00:17:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18f7f9640 1 -- start start 2024-06-10T00:17:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18f7f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1880cef70 0x7fa1880cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18f7f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880d1fc0 0x7fa18815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18f7f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18f7f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1880d4f00 con 0x7fa1880d2680 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18f7f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa1880d2400 con 0x7fa1880cef70 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18f7f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa1880d1870 con 0x7fa1880d1fc0 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18dd96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18dd96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48298/0 (socket says 172.21.15.79:48298) 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.830+0000 7fa18dd96640 1 -- 172.21.15.79:0/3234533419 learned_addr learned my addr 172.21.15.79:0/3234533419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18cd94640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880d1fc0 0x7fa18815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18d595640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1880cef70 0x7fa1880cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18dd96640 1 -- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880d1fc0 msgr2=0x7fa18815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18dd96640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880d1fc0 0x7fa18815d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18dd96640 1 -- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1880cef70 msgr2=0x7fa1880cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18dd96640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1880cef70 0x7fa1880cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18dd96640 1 -- 172.21.15.79:0/3234533419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18815ea10 con 0x7fa1880d2680 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18cd94640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880d1fc0 0x7fa18815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18dd96640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815b230 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa18000c7c0 tx=0x7fa18000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa185ffb640 1 -- 172.21.15.79:0/3234533419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa180015020 con 0x7fa1880d2680 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa185ffb640 1 -- 172.21.15.79:0/3234533419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa180004230 con 0x7fa1880d2680 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18815def0 con 0x7fa1880d2680 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa185ffb640 1 -- 172.21.15.79:0/3234533419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa180007620 con 0x7fa1880d2680 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.831+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18815e730 con 0x7fa1880d2680 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.832+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa188068430 con 0x7fa1880d2680 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.832+0000 7fa185ffb640 1 -- 172.21.15.79:0/3234533419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa180018020 con 0x7fa1880d2680 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.833+0000 7fa185ffb640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa17406be30 0x7fa17406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.833+0000 7fa185ffb640 1 -- 172.21.15.79:0/3234533419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fa18008ad70 con 0x7fa1880d2680 2024-06-10T00:17:10.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.833+0000 7fa18d595640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa17406be30 0x7fa17406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:10.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.833+0000 7fa18d595640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa17406be30 0x7fa17406e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa178034000 tx=0x7fa17802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:10.837+0000 7fa185ffb640 1 -- 172.21.15.79:0/3234533419 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa18001f020 con 0x7fa1880d2680 2024-06-10T00:17:11.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.078+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7fa1880d3af0 con 0x7fa1880d2680 2024-06-10T00:17:11.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.406+0000 7fa185ffb640 1 -- 172.21.15.79:0/3234533419 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v140) ==== 149+0+0 (secure 0 0 0) 0x7fa18815def0 con 0x7fa1880d2680 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa17406be30 msgr2=0x7fa17406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa17406be30 0x7fa17406e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa178034000 tx=0x7fa17802f000 comp rx=0 tx=0).stop 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 msgr2=0x7fa18815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815b230 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa18000c7c0 tx=0x7fa18000cc80 comp rx=0 tx=0).stop 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 shutdown_connections 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa17406be30 0x7fa17406e2f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1880d2680 0x7fa18815b230 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1880d1fc0 0x7fa18815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 --2- 172.21.15.79:0/3234533419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1880cef70 0x7fa1880cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 >> 172.21.15.79:0/3234533419 conn(0x7fa18809d3f0 msgr2=0x7fa1880d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 shutdown_connections 2024-06-10T00:17:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.408+0000 7fa18f7f9640 1 -- 172.21.15.79:0/3234533419 wait complete. 2024-06-10T00:17:11.419 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-06-10T00:17:11.419 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-06-10T00:17:11.419 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-06-10T00:17:11.420 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:17:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.522+0000 7fc10dc4d640 1 Processor -- start 2024-06-10T00:17:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.522+0000 7fc10dc4d640 1 -- start start 2024-06-10T00:17:11.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.522+0000 7fc10dc4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1080d2680 0x7fc10815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.522+0000 7fc10dc4d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1080d0ad0 con 0x7fc1080d1fc0 2024-06-10T00:17:11.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.522+0000 7fc10dc4d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10815f890 con 0x7fc1080cef70 2024-06-10T00:17:11.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.522+0000 7fc10dc4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc1080d13e0 con 0x7fc1080d2680 2024-06-10T00:17:11.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc106ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc1080d1fc0 0x7fc1080d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52126/0 (socket says 172.21.15.79:52126) 2024-06-10T00:17:11.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc106ffd640 1 -- 172.21.15.79:0/2698863589 learned_addr learned my addr 172.21.15.79:0/2698863589 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1077fe640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1080d2680 0x7fc10815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668548135 0 0) 0x7fc1080d0ad0 con 0x7fc1080d1fc0 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0f0003520 con 0x7fc1080d1fc0 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1373916874 0 0) 0x7fc0f0003520 con 0x7fc1080d1fc0 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1080d2680 msgr2=0x7fc10815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1080d2680 0x7fc10815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 >> v1:172.21.15.117:6789/0 conn(0x7fc1080cef70 legacy=0x7fc1080cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1080d0d90 con 0x7fc1080d1fc0 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fc0fc001670 con 0x7fc1080d1fc0 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 >> v1:172.21.15.79:6789/0 conn(0x7fc1080d1fc0 legacy=0x7fc1080d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc0f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1080d2680 0x7fc0f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0f0004d40 0x7fc0f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080d13e0 con 0x7fc0f00039e0 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f000b9c0 con 0x7fc0f0004d40 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f000bbc0 con 0x7fc1080d2680 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc1077fe640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc0f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc106ffd640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1080d2680 0x7fc0f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.523+0000 7fc107fff640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0f0004d40 0x7fc0f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1077fe640 1 -- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1080d2680 msgr2=0x7fc0f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1077fe640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1080d2680 0x7fc0f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1077fe640 1 -- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0f0004d40 msgr2=0x7fc0f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1077fe640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0f0004d40 0x7fc0f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1077fe640 1 -- 172.21.15.79:0/2698863589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f0003520 con 0x7fc0f00039e0 2024-06-10T00:17:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1077fe640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc0f0003dc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009ac0 tx=0x7fc0f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3980a80175851d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:11.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8036070 con 0x7fc0f00039e0 2024-06-10T00:17:11.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f8031400 con 0x7fc0f00039e0 2024-06-10T00:17:11.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.524+0000 7fc1067fc640 1 -- 172.21.15.79:0/2698863589 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8009690 con 0x7fc0f00039e0 2024-06-10T00:17:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.525+0000 7fc10dc4d640 1 -- 172.21.15.79:0/2698863589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 msgr2=0x7fc0f0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.525+0000 7fc10dc4d640 1 --2- 172.21.15.79:0/2698863589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc0f0003dc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009ac0 tx=0x7fc0f0005830 comp rx=0 tx=0).stop 2024-06-10T00:17:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.525+0000 7fc107fff640 1 -- 172.21.15.79:0/2698863589 reap_dead start 2024-06-10T00:17:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.525+0000 7fc10dc4d640 1 -- 172.21.15.79:0/2698863589 shutdown_connections 2024-06-10T00:17:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.525+0000 7fc10dc4d640 1 -- 172.21.15.79:0/2698863589 >> 172.21.15.79:0/2698863589 conn(0x7fc10809d3f0 msgr2=0x7fc1080d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.525+0000 7fc10dc4d640 1 -- 172.21.15.79:0/2698863589 shutdown_connections 2024-06-10T00:17:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.525+0000 7fc10dc4d640 1 -- 172.21.15.79:0/2698863589 wait complete. 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.526+0000 7fc10dc4d640 1 Processor -- start 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.526+0000 7fc10dc4d640 1 -- start start 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc10dc4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc1081f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc10dc4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10815da20 0x7fc10815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc10dc4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1081f7ba0 0x7fc10809dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc10dc4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080d4f00 con 0x7fc0f00039e0 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc10dc4d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080d2400 con 0x7fc10815da20 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc10dc4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc1080d1870 con 0x7fc1081f7ba0 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc1081f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc1081f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48316/0 (socket says 172.21.15.79:48316) 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc1077fe640 1 -- 172.21.15.79:0/1512617575 learned_addr learned my addr 172.21.15.79:0/1512617575 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:11.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc106ffd640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10815da20 0x7fc10815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc107fff640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1081f7ba0 0x7fc10809dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.527+0000 7fc1077fe640 1 -- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1081f7ba0 msgr2=0x7fc10809dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc1077fe640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1081f7ba0 0x7fc10809dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc1077fe640 1 -- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10815da20 msgr2=0x7fc10815a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc1077fe640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10815da20 0x7fc10815a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc1077fe640 1 -- 172.21.15.79:0/1512617575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10815dea0 con 0x7fc0f00039e0 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc106ffd640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10815da20 0x7fc10815a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc107fff640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1081f7ba0 0x7fc10809dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc1077fe640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc1081f3f60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009b20 tx=0x7fc0f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc0effff640 1 -- 172.21.15.79:0/1512617575 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8040020 con 0x7fc0f00039e0 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc0effff640 1 -- 172.21.15.79:0/1512617575 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f8003940 con 0x7fc0f00039e0 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1081f45d0 con 0x7fc0f00039e0 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc0effff640 1 -- 172.21.15.79:0/1512617575 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8036040 con 0x7fc0f00039e0 2024-06-10T00:17:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.528+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1081f4b90 con 0x7fc0f00039e0 2024-06-10T00:17:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.529+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc108068430 con 0x7fc0f00039e0 2024-06-10T00:17:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.529+0000 7fc0effff640 1 -- 172.21.15.79:0/1512617575 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0f8043020 con 0x7fc0f00039e0 2024-06-10T00:17:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.530+0000 7fc0effff640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0f406be60 0x7fc0f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.530+0000 7fc106ffd640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0f406be60 0x7fc0f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.530+0000 7fc0effff640 1 -- 172.21.15.79:0/1512617575 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fc0f80aadf0 con 0x7fc0f00039e0 2024-06-10T00:17:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.530+0000 7fc106ffd640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0f406be60 0x7fc0f406e320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc108161b60 tx=0x7fc0fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.534+0000 7fc0effff640 1 -- 172.21.15.79:0/1512617575 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc0f804a070 con 0x7fc0f00039e0 2024-06-10T00:17:11.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.709+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1081f4d90 con 0x7fc0f00039e0 2024-06-10T00:17:11.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.710+0000 7fc0effff640 1 -- 172.21.15.79:0/1512617575 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+13247 (secure 0 0 0) 0x7fc0f80392d0 con 0x7fc0f00039e0 2024-06-10T00:17:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:11.709 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":53,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:17:10.400984+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6835/1724490819":"2024-06-11T00:17:07.088934+0000","172.21.15.117:6833/1724490819":"2024-06-11T00:17:07.088934+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0f406be60 msgr2=0x7fc0f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0f406be60 0x7fc0f406e320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc108161b60 tx=0x7fc0fc009040 comp rx=0 tx=0).stop 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 msgr2=0x7fc1081f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc1081f3f60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009b20 tx=0x7fc0f8004730 comp rx=0 tx=0).stop 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 shutdown_connections 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0f406be60 0x7fc0f406e320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1081f7ba0 0x7fc10809dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10815da20 0x7fc10815a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 --2- 172.21.15.79:0/1512617575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0f00039e0 0x7fc1081f3f60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 >> 172.21.15.79:0/1512617575 conn(0x7fc10809d3f0 msgr2=0x7fc1080c7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 shutdown_connections 2024-06-10T00:17:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.712+0000 7fc10dc4d640 1 -- 172.21.15.79:0/1512617575 wait complete. 2024-06-10T00:17:11.723 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-10T00:14:31.177808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-10T00:17:11.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-10T00:17:11.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.832+0000 7f48d5f7e640 1 Processor -- start 2024-06-10T00:17:11.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.832+0000 7f48d5f7e640 1 -- start start 2024-06-10T00:17:11.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.832+0000 7f48d5f7e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48d0154c20 0x7f48d00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48d5f7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48d00b3a20 0x7f48d006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48d5f7e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d0155000 con 0x7f48d006d500 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48d5f7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f48d006dd30 con 0x7f48d00b3a20 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48d5f7e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f48d006e010 con 0x7f48d0154c20 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48ceffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48d00b3a20 0x7f48d006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48ceffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48d00b3a20 0x7f48d006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48320/0 (socket says 172.21.15.79:48320) 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48ceffd640 1 -- 172.21.15.79:0/2073193103 learned_addr learned my addr 172.21.15.79:0/2073193103 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48ceffd640 1 -- 172.21.15.79:0/2073193103 >> v2:172.21.15.117:3300/0 conn(0x7f48d0154c20 msgr2=0x7f48d00b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48ceffd640 1 --2- 172.21.15.79:0/2073193103 >> v2:172.21.15.117:3300/0 conn(0x7f48d0154c20 0x7f48d00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48ceffd640 1 -- 172.21.15.79:0/2073193103 >> v1:172.21.15.117:6789/0 conn(0x7f48d006d500 legacy=0x7f48d015e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.833+0000 7f48ceffd640 1 -- 172.21.15.79:0/2073193103 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d006e2f0 con 0x7f48d00b3a20 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48ceffd640 1 --2- 172.21.15.79:0/2073193103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d006cfc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f48d006f210 tx=0x7f48c402c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2748ae0f0c14a8ee server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48ce7fc640 1 -- 172.21.15.79:0/2073193103 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c403a070 con 0x7f48d00b3a20 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48ce7fc640 1 -- 172.21.15.79:0/2073193103 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c4032480 con 0x7f48d00b3a20 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48ce7fc640 1 -- 172.21.15.79:0/2073193103 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4032850 con 0x7f48d00b3a20 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48d5f7e640 1 -- 172.21.15.79:0/2073193103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 msgr2=0x7f48d006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/2073193103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d006cfc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f48d006f210 tx=0x7f48c402c6b0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48d5f7e640 1 -- 172.21.15.79:0/2073193103 shutdown_connections 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/2073193103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d006cfc0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/2073193103 >> v2:172.21.15.117:3300/0 conn(0x7f48d0154c20 0x7f48d00b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48d5f7e640 1 -- 172.21.15.79:0/2073193103 >> 172.21.15.79:0/2073193103 conn(0x7f48d00b1d10 msgr2=0x7f48d00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:11.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48d5f7e640 1 -- 172.21.15.79:0/2073193103 shutdown_connections 2024-06-10T00:17:11.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.834+0000 7f48d5f7e640 1 -- 172.21.15.79:0/2073193103 wait complete. 2024-06-10T00:17:11.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.836+0000 7f48d5f7e640 1 Processor -- start 2024-06-10T00:17:11.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.836+0000 7f48d5f7e640 1 -- start start 2024-06-10T00:17:11.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.836+0000 7f48d5f7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48d006d500 0x7f48d01f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.836+0000 7f48d5f7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d00ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.836+0000 7f48d5f7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48d0154c20 0x7f48d00af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.836+0000 7f48d5f7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48d006daf0 con 0x7f48d00b3a20 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.836+0000 7f48d5f7e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48d006d970 con 0x7f48d006d500 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.836+0000 7f48d5f7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f48d0072560 con 0x7f48d0154c20 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d00ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d00ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48328/0 (socket says 172.21.15.79:48328) 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 -- 172.21.15.79:0/639992525 learned_addr learned my addr 172.21.15.79:0/639992525 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 -- 172.21.15.79:0/639992525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48d0154c20 msgr2=0x7f48d00af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48d0154c20 0x7f48d00af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 -- 172.21.15.79:0/639992525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48d006d500 msgr2=0x7f48d01f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48d006d500 0x7f48d01f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48d006d500 0x7f48d01f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 -- 172.21.15.79:0/639992525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00afed0 con 0x7f48d00b3a20 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48d006d500 0x7f48d01f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48ceffd640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d00ae850 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f48c4038040 tx=0x7f48c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48b7fff640 1 -- 172.21.15.79:0/639992525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c403a040 con 0x7f48d00b3a20 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48b7fff640 1 -- 172.21.15.79:0/639992525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c4032070 con 0x7f48d00b3a20 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d00b01b0 con 0x7f48d00b3a20 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48b7fff640 1 -- 172.21.15.79:0/639992525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4032e60 con 0x7f48d00b3a20 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.837+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d00b0770 con 0x7f48d00b3a20 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.838+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d00d0590 con 0x7f48d00b3a20 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.839+0000 7f48b7fff640 1 -- 172.21.15.79:0/639992525 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48c4047020 con 0x7f48d00b3a20 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.839+0000 7f48b7fff640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48bc06be30 0x7f48bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:11.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.839+0000 7f48b7fff640 1 -- 172.21.15.79:0/639992525 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f48c40ab500 con 0x7f48d00b3a20 2024-06-10T00:17:11.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.839+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48bc06be30 0x7f48bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:11.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.840+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48bc06be30 0x7f48bc06e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f48c000a870 tx=0x7f48c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:11.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:11.843+0000 7f48b7fff640 1 -- 172.21.15.79:0/639992525 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f48d00d0590 con 0x7f48d00b3a20 2024-06-10T00:17:12.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.017+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f48d00683c0 con 0x7f48d00b3a20 2024-06-10T00:17:12.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.018+0000 7f48b7fff640 1 -- 172.21.15.79:0/639992525 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f48c404e020 con 0x7f48d00b3a20 2024-06-10T00:17:12.018 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48bc06be30 msgr2=0x7f48bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48bc06be30 0x7f48bc06e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f48c000a870 tx=0x7f48c0008040 comp rx=0 tx=0).stop 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 msgr2=0x7f48d00ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d00ae850 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f48c4038040 tx=0x7f48c40046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 shutdown_connections 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48bc06be30 0x7f48bc06e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48d0154c20 0x7f48d00af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d00b3a20 0x7f48d00ae850 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 --2- 172.21.15.79:0/639992525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48d006d500 0x7f48d01f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 >> 172.21.15.79:0/639992525 conn(0x7f48d00b1d10 msgr2=0x7f48d00b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:12.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 shutdown_connections 2024-06-10T00:17:12.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.020+0000 7f48d5f7e640 1 -- 172.21.15.79:0/639992525 wait complete. 2024-06-10T00:17:12.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-06-10T00:17:12.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.130+0000 7fc817238640 1 Processor -- start 2024-06-10T00:17:12.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.131+0000 7fc817238640 1 -- start start 2024-06-10T00:17:12.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.131+0000 7fc817238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 0x7fc8100d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.131+0000 7fc817238640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc81015f5e0 con 0x7fc8100cef70 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.131+0000 7fc817238640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8100d0ad0 con 0x7fc8100d2680 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.131+0000 7fc817238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8100d13e0 con 0x7fc81015f1a0 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc8157d5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc8100cef70 0x7fc8100cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52128/0 (socket says 172.21.15.79:52128) 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc8157d5640 1 -- 172.21.15.79:0/930267310 learned_addr learned my addr 172.21.15.79:0/930267310 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80ffff640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 0x7fc8100d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489473263 0 0) 0x7fc81015f5e0 con 0x7fc8100cef70 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc800003520 con 0x7fc8100cef70 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3312216730 0 0) 0x7fc800003520 con 0x7fc8100cef70 2024-06-10T00:17:12.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 msgr2=0x7fc8100d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 0x7fc8100d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 >> v1:172.21.15.117:6789/0 conn(0x7fc8100d2680 legacy=0x7fc8100d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81015f890 con 0x7fc8100cef70 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fc8080019f0 con 0x7fc8100cef70 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 >> v1:172.21.15.79:6789/0 conn(0x7fc8100cef70 legacy=0x7fc8100cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8000039e0 0x7fc800003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 0x7fc800004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc800004d40 0x7fc8000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100d13e0 con 0x7fc8000039e0 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc80000b9c0 con 0x7fc800004d40 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc80000bbc0 con 0x7fc81015f1a0 2024-06-10T00:17:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc814fd4640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8000039e0 0x7fc800003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80ffff640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 0x7fc800004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc8157d5640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc800004d40 0x7fc8000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc814fd4640 1 -- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 msgr2=0x7fc800004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:12.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc814fd4640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 0x7fc800004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc814fd4640 1 -- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc800004d40 msgr2=0x7fc8000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:12.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc814fd4640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc800004d40 0x7fc8000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc814fd4640 1 -- 172.21.15.79:0/930267310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc800003520 con 0x7fc8000039e0 2024-06-10T00:17:12.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc8157d5640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc800004d40 0x7fc8000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:12.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.132+0000 7fc80ffff640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc81015f1a0 0x7fc800004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:12.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.133+0000 7fc814fd4640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8000039e0 0x7fc800003dc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc804001860 tx=0x7fc800005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8879bd2bbf00489b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:12.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.133+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804037070 con 0x7fc8000039e0 2024-06-10T00:17:12.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.133+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80402ab60 con 0x7fc8000039e0 2024-06-10T00:17:12.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.133+0000 7fc80f7fe640 1 -- 172.21.15.79:0/930267310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804001430 con 0x7fc8000039e0 2024-06-10T00:17:12.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.134+0000 7fc817238640 1 -- 172.21.15.79:0/930267310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8000039e0 msgr2=0x7fc800003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.134+0000 7fc817238640 1 --2- 172.21.15.79:0/930267310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8000039e0 0x7fc800003dc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc804001860 tx=0x7fc800005830 comp rx=0 tx=0).stop 2024-06-10T00:17:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.134+0000 7fc8157d5640 1 -- 172.21.15.79:0/930267310 reap_dead start 2024-06-10T00:17:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.134+0000 7fc817238640 1 -- 172.21.15.79:0/930267310 shutdown_connections 2024-06-10T00:17:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.134+0000 7fc817238640 1 -- 172.21.15.79:0/930267310 >> 172.21.15.79:0/930267310 conn(0x7fc81009d3f0 msgr2=0x7fc8100d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.134+0000 7fc817238640 1 -- 172.21.15.79:0/930267310 shutdown_connections 2024-06-10T00:17:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.134+0000 7fc817238640 1 -- 172.21.15.79:0/930267310 wait complete. 2024-06-10T00:17:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.135+0000 7fc817238640 1 Processor -- start 2024-06-10T00:17:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.135+0000 7fc817238640 1 -- start start 2024-06-10T00:17:12.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc817238640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8000039e0 0x7fc81015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc817238640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc810150eb0 0x7fc81015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc817238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8100b4bc0 0x7fc8100b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc817238640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100d4f00 con 0x7fc810150eb0 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc817238640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100d1070 con 0x7fc8000039e0 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc817238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8100d1870 con 0x7fc8100b4bc0 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc80ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc810150eb0 0x7fc81015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc80ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc810150eb0 0x7fc81015db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48346/0 (socket says 172.21.15.79:48346) 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc80ffff640 1 -- 172.21.15.79:0/1502398794 learned_addr learned my addr 172.21.15.79:0/1502398794 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc8157d5640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8100b4bc0 0x7fc8100b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc814fd4640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8000039e0 0x7fc81015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc80ffff640 1 -- 172.21.15.79:0/1502398794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8100b4bc0 msgr2=0x7fc8100b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc80ffff640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8100b4bc0 0x7fc8100b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc80ffff640 1 -- 172.21.15.79:0/1502398794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8000039e0 msgr2=0x7fc81015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc80ffff640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8000039e0 0x7fc81015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.136+0000 7fc80ffff640 1 -- 172.21.15.79:0/1502398794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81015e750 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.137+0000 7fc80ffff640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc810150eb0 0x7fc81015db40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc011700 tx=0x7fc7fc011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.137+0000 7fc80d7fa640 1 -- 172.21.15.79:0/1502398794 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00f9c0 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.137+0000 7fc80d7fa640 1 -- 172.21.15.79:0/1502398794 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7fc00fb60 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.137+0000 7fc80d7fa640 1 -- 172.21.15.79:0/1502398794 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc015460 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.137+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81015e470 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.137+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8100cb580 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.138+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc810068430 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.138+0000 7fc80d7fa640 1 -- 172.21.15.79:0/1502398794 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7fc015600 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.139+0000 7fc80d7fa640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7f406be60 0x7fc7f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.139+0000 7fc80d7fa640 1 -- 172.21.15.79:0/1502398794 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fc7fc08b630 con 0x7fc810150eb0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.139+0000 7fc814fd4640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7f406be60 0x7fc7f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.139+0000 7fc814fd4640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7f406be60 0x7fc7f406e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc804034000 tx=0x7fc804009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:12.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.143+0000 7fc80d7fa640 1 -- 172.21.15.79:0/1502398794 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc7fc019030 con 0x7fc810150eb0 2024-06-10T00:17:12.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.383+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7fc8100b9e20 con 0x7fc810150eb0 2024-06-10T00:17:12.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.407+0000 7fc80d7fa640 1 -- 172.21.15.79:0/1502398794 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v141) ==== 172+0+0 (secure 0 0 0) 0x7fc7fc05a150 con 0x7fc810150eb0 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7f406be60 msgr2=0x7fc7f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7f406be60 0x7fc7f406e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc804034000 tx=0x7fc804009030 comp rx=0 tx=0).stop 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc810150eb0 msgr2=0x7fc81015db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc810150eb0 0x7fc81015db40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc011700 tx=0x7fc7fc011bc0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 shutdown_connections 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc7f406be60 0x7fc7f406e320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8100b4bc0 0x7fc8100b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc810150eb0 0x7fc81015db40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 --2- 172.21.15.79:0/1502398794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8000039e0 0x7fc81015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 >> 172.21.15.79:0/1502398794 conn(0x7fc81009d3f0 msgr2=0x7fc8100d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:12.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 shutdown_connections 2024-06-10T00:17:12.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.410+0000 7fc817238640 1 -- 172.21.15.79:0/1502398794 wait complete. 2024-06-10T00:17:12.420 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-10T00:17:12.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.523+0000 7f279b838640 1 Processor -- start 2024-06-10T00:17:12.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.523+0000 7f279b838640 1 -- start start 2024-06-10T00:17:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f279b838640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27940d0020 0x7f27940d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f279b838640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f279406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f279b838640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2794155700 con 0x7f2794155320 2024-06-10T00:17:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f279b838640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f27940d09c0 con 0x7f27940d0020 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f279b838640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f279415b6b0 con 0x7f279406e1f0 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f27995d4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2794155320 0x7f27940b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52142/0 (socket says 172.21.15.79:52142) 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f27995d4640 1 -- 172.21.15.79:0/3833168621 learned_addr learned my addr 172.21.15.79:0/3833168621 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f2798dd3640 1 --2- 172.21.15.79:0/3833168621 >> v2:172.21.15.117:3300/0 conn(0x7f27940d0020 0x7f27940d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f2799dd5640 1 --2- 172.21.15.79:0/3833168621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f279406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f278bfff640 1 -- 172.21.15.79:0/3833168621 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449783104 0 0) 0x7f2794155700 con 0x7f2794155320 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f278bfff640 1 -- 172.21.15.79:0/3833168621 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2780003520 con 0x7f2794155320 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f2799dd5640 1 -- 172.21.15.79:0/3833168621 >> v2:172.21.15.117:3300/0 conn(0x7f27940d0020 msgr2=0x7f27940d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f2799dd5640 1 --2- 172.21.15.79:0/3833168621 >> v2:172.21.15.117:3300/0 conn(0x7f27940d0020 0x7f27940d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f2799dd5640 1 -- 172.21.15.79:0/3833168621 >> v1:172.21.15.79:6789/0 conn(0x7f2794155320 legacy=0x7f27940b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.524+0000 7f2799dd5640 1 -- 172.21.15.79:0/3833168621 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279415b990 con 0x7f279406e1f0 2024-06-10T00:17:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.525+0000 7f2798dd3640 1 --2- 172.21.15.79:0/3833168621 >> v2:172.21.15.117:3300/0 conn(0x7f27940d0020 0x7f27940d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.525+0000 7f2799dd5640 1 --2- 172.21.15.79:0/3833168621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f279406e680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f278c009d90 tx=0x7f278c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e3474c6d31d963 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.525+0000 7f278bfff640 1 -- 172.21.15.79:0/3833168621 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c007740 con 0x7f279406e1f0 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.525+0000 7f278bfff640 1 -- 172.21.15.79:0/3833168621 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c0078e0 con 0x7f279406e1f0 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.525+0000 7f278bfff640 1 -- 172.21.15.79:0/3833168621 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c007c90 con 0x7f279406e1f0 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.526+0000 7f279b838640 1 -- 172.21.15.79:0/3833168621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 msgr2=0x7f279406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.526+0000 7f279b838640 1 --2- 172.21.15.79:0/3833168621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f279406e680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f278c009d90 tx=0x7f278c02a660 comp rx=0 tx=0).stop 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.526+0000 7f279b838640 1 -- 172.21.15.79:0/3833168621 shutdown_connections 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.526+0000 7f279b838640 1 --2- 172.21.15.79:0/3833168621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f279406e680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.526+0000 7f279b838640 1 --2- 172.21.15.79:0/3833168621 >> v2:172.21.15.117:3300/0 conn(0x7f27940d0020 0x7f27940d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.526+0000 7f279b838640 1 -- 172.21.15.79:0/3833168621 >> 172.21.15.79:0/3833168621 conn(0x7f27940b1d10 msgr2=0x7f27940b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:12.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.526+0000 7f279b838640 1 -- 172.21.15.79:0/3833168621 shutdown_connections 2024-06-10T00:17:12.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.526+0000 7f279b838640 1 -- 172.21.15.79:0/3833168621 wait complete. 2024-06-10T00:17:12.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.527+0000 7f279b838640 1 Processor -- start 2024-06-10T00:17:12.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.527+0000 7f279b838640 1 -- start start 2024-06-10T00:17:12.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f279b838640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f27940adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f279b838640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27940d0020 0x7f27941501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f279b838640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2794155320 0x7f2794157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f279b838640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f279406ebc0 con 0x7f2794155320 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f279b838640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f279415bf50 con 0x7f27940d0020 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f279b838640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f27941e5d70 con 0x7f279406e1f0 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2799dd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2794155320 0x7f2794157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2799dd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2794155320 0x7f2794157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48356/0 (socket says 172.21.15.79:48356) 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2799dd5640 1 -- 172.21.15.79:0/1737123270 learned_addr learned my addr 172.21.15.79:0/1737123270 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2798dd3640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27940d0020 0x7f27941501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f27995d4640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f27940adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2799dd5640 1 -- 172.21.15.79:0/1737123270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 msgr2=0x7f27940adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2799dd5640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f27940adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2799dd5640 1 -- 172.21.15.79:0/1737123270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27940d0020 msgr2=0x7f27941501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2799dd5640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27940d0020 0x7f27941501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.528+0000 7f2799dd5640 1 -- 172.21.15.79:0/1737123270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27941e6050 con 0x7f2794155320 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.529+0000 7f2799dd5640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2794155320 0x7f2794157b30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f278c009eb0 tx=0x7f278c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.529+0000 7f2789ffb640 1 -- 172.21.15.79:0/1737123270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c03f070 con 0x7f2794155320 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.529+0000 7f2789ffb640 1 -- 172.21.15.79:0/1737123270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c031c60 con 0x7f2794155320 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.529+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27941e6330 con 0x7f2794155320 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.529+0000 7f2789ffb640 1 -- 172.21.15.79:0/1737123270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c009450 con 0x7f2794155320 2024-06-10T00:17:12.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.529+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27941e68f0 con 0x7f2794155320 2024-06-10T00:17:12.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.530+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27940683c0 con 0x7f2794155320 2024-06-10T00:17:12.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.530+0000 7f2789ffb640 1 -- 172.21.15.79:0/1737123270 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f278c03b410 con 0x7f2794155320 2024-06-10T00:17:12.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.531+0000 7f2789ffb640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f277806be30 0x7f277806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:12.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.531+0000 7f2789ffb640 1 -- 172.21.15.79:0/1737123270 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f278c0abea0 con 0x7f2794155320 2024-06-10T00:17:12.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.531+0000 7f27995d4640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f277806be30 0x7f277806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:12.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.531+0000 7f27995d4640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f277806be30 0x7f277806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f279415f170 tx=0x7f2790000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:12.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.535+0000 7f2789ffb640 1 -- 172.21.15.79:0/1737123270 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f278c07a400 con 0x7f2794155320 2024-06-10T00:17:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.709+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f27940b2300 con 0x7f2794155320 2024-06-10T00:17:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.713+0000 7f2789ffb640 1 -- 172.21.15.79:0/1737123270 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f278c07e700 con 0x7f2794155320 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f277806be30 msgr2=0x7f277806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f277806be30 0x7f277806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f279415f170 tx=0x7f2790000bc0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2794155320 msgr2=0x7f2794157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2794155320 0x7f2794157b30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f278c009eb0 tx=0x7f278c004a40 comp rx=0 tx=0).stop 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 shutdown_connections 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f277806be30 0x7f277806e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2794155320 0x7f2794157b30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27940d0020 0x7f27941501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 --2- 172.21.15.79:0/1737123270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f279406e1f0 0x7f27940adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 >> 172.21.15.79:0/1737123270 conn(0x7f27940b1d10 msgr2=0x7f27940b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 shutdown_connections 2024-06-10T00:17:12.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:12.715+0000 7f279b838640 1 -- 172.21.15.79:0/1737123270 wait complete. 2024-06-10T00:17:12.725 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:17:12.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:17:12.774 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:17:12.825 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:17:12.825 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:17:12.825 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:17:12.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:17:12.841 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:17:12.841 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:17:12.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:17:12.859 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:17:12.859 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:17:12.896 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:17:12.897 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:17:12.897 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:17:12.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:17:12.916 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-10T00:17:12.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:13.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.036+0000 7f15e5c12640 1 Processor -- start 2024-06-10T00:17:13.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.036+0000 7f15e5c12640 1 -- start start 2024-06-10T00:17:13.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.036+0000 7f15e5c12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15e00d2680 0x7f15e015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.036+0000 7f15e5c12640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15e00d1fc0 0x7f15e00d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.036+0000 7f15e5c12640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e00d2fa0 con 0x7f15e0161fa0 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.036+0000 7f15e5c12640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f15e00cff80 con 0x7f15e00d1fc0 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.036+0000 7f15e5c12640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f15e00d13e0 con 0x7f15e00d2680 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15d7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15e00d1fc0 0x7f15e00d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15d7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15e00d1fc0 0x7f15e00d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48372/0 (socket says 172.21.15.79:48372) 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15dffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f15e0161fa0 0x7f15e01623d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52158/0 (socket says 172.21.15.79:52158) 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15d7fff640 1 -- 172.21.15.79:0/3520256466 learned_addr learned my addr 172.21.15.79:0/3520256466 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15d7fff640 1 -- 172.21.15.79:0/3520256466 >> v2:172.21.15.117:3300/0 conn(0x7f15e00d2680 msgr2=0x7f15e015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15df7fe640 1 --2- 172.21.15.79:0/3520256466 >> v2:172.21.15.117:3300/0 conn(0x7f15e00d2680 0x7f15e015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15d7fff640 1 --2- 172.21.15.79:0/3520256466 >> v2:172.21.15.117:3300/0 conn(0x7f15e00d2680 0x7f15e015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15d7fff640 1 -- 172.21.15.79:0/3520256466 >> v1:172.21.15.79:6789/0 conn(0x7f15e0161fa0 legacy=0x7f15e01623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15d7fff640 1 -- 172.21.15.79:0/3520256466 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e00d0ad0 con 0x7f15e00d1fc0 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15deffd640 1 -- 172.21.15.79:0/3520256466 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065648148 0 0) 0x7f15e00d2fa0 con 0x7f15e0161fa0 2024-06-10T00:17:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.037+0000 7f15df7fe640 1 --2- 172.21.15.79:0/3520256466 >> v2:172.21.15.117:3300/0 conn(0x7f15e00d2680 0x7f15e015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:13.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15d7fff640 1 --2- 172.21.15.79:0/3520256466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d1fc0 0x7f15e00d2a60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f15e008ca40 tx=0x7f15c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d79d72e1e55c14d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15deffd640 1 -- 172.21.15.79:0/3520256466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8037070 con 0x7f15e00d1fc0 2024-06-10T00:17:13.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15deffd640 1 -- 172.21.15.79:0/3520256466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c8032440 con 0x7f15e00d1fc0 2024-06-10T00:17:13.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15deffd640 1 -- 172.21.15.79:0/3520256466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8032810 con 0x7f15e00d1fc0 2024-06-10T00:17:13.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15e5c12640 1 -- 172.21.15.79:0/3520256466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d1fc0 msgr2=0x7f15e00d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15e5c12640 1 --2- 172.21.15.79:0/3520256466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d1fc0 0x7f15e00d2a60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f15e008ca40 tx=0x7f15c802a270 comp rx=0 tx=0).stop 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15e5c12640 1 -- 172.21.15.79:0/3520256466 shutdown_connections 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15e5c12640 1 --2- 172.21.15.79:0/3520256466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d1fc0 0x7f15e00d2a60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15e5c12640 1 --2- 172.21.15.79:0/3520256466 >> v2:172.21.15.117:3300/0 conn(0x7f15e00d2680 0x7f15e015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15e5c12640 1 -- 172.21.15.79:0/3520256466 >> 172.21.15.79:0/3520256466 conn(0x7f15e009d3f0 msgr2=0x7f15e00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15e5c12640 1 -- 172.21.15.79:0/3520256466 shutdown_connections 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.038+0000 7f15e5c12640 1 -- 172.21.15.79:0/3520256466 wait complete. 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15e5c12640 1 Processor -- start 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15e5c12640 1 -- start start 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15e5c12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00d1fc0 0x7f15e00ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15e5c12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d2680 0x7f15e01f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15e5c12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e0161fa0 0x7f15e0157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15e5c12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15e00d1070 con 0x7f15e00d2680 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15e5c12640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15e00d0d90 con 0x7f15e0161fa0 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15e5c12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15e00d2400 con 0x7f15e00d1fc0 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d2680 0x7f15e01f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d2680 0x7f15e01f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48380/0 (socket says 172.21.15.79:48380) 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.040+0000 7f15d7fff640 1 -- 172.21.15.79:0/4009350258 learned_addr learned my addr 172.21.15.79:0/4009350258 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15dffff640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e0161fa0 0x7f15e0157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15df7fe640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00d1fc0 0x7f15e00ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15d7fff640 1 -- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00d1fc0 msgr2=0x7f15e00ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15d7fff640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00d1fc0 0x7f15e00ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15d7fff640 1 -- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e0161fa0 msgr2=0x7f15e0157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15d7fff640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e0161fa0 0x7f15e0157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15d7fff640 1 -- 172.21.15.79:0/4009350258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e01565c0 con 0x7f15e00d2680 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15dffff640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e0161fa0 0x7f15e0157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15d7fff640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d2680 0x7f15e01f71e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f15c802a2b0 tx=0x7f15c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15dcff9640 1 -- 172.21.15.79:0/4009350258 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8037040 con 0x7f15e00d2680 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15dcff9640 1 -- 172.21.15.79:0/4009350258 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c8042070 con 0x7f15e00d2680 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15dcff9640 1 -- 172.21.15.79:0/4009350258 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8030bb0 con 0x7f15e00d2680 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e01568a0 con 0x7f15e00d2680 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.041+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e0156e60 con 0x7f15e00d2680 2024-06-10T00:17:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.042+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e0068430 con 0x7f15e00d2680 2024-06-10T00:17:13.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.043+0000 7f15dcff9640 1 -- 172.21.15.79:0/4009350258 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15c8047460 con 0x7f15e00d2680 2024-06-10T00:17:13.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.043+0000 7f15dcff9640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f15c006be30 0x7f15c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.043+0000 7f15dcff9640 1 -- 172.21.15.79:0/4009350258 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f15c80ab8e0 con 0x7f15e00d2680 2024-06-10T00:17:13.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.043+0000 7f15df7fe640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f15c006be30 0x7f15c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.043+0000 7f15df7fe640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f15c006be30 0x7f15c006e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f15e0154a00 tx=0x7f15d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.047+0000 7f15dcff9640 1 -- 172.21.15.79:0/4009350258 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f15c8045360 con 0x7f15e00d2680 2024-06-10T00:17:13.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.258+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15e00d04e0 con 0x7f15e00d2680 2024-06-10T00:17:13.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.258+0000 7f15dcff9640 1 -- 172.21.15.79:0/4009350258 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3869 (secure 0 0 0) 0x7f15c807a490 con 0x7f15e00d2680 2024-06-10T00:17:13.258 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:13.258 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3516346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3516346239},{"type":"v1","addr":"172.21.15.117:6834","nonce":3516346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/960016099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":960016099},{"type":"v1","addr":"172.21.15.79:6836","nonce":960016099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5218,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/468349778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":468349778},{"type":"v1","addr":"172.21.15.117:6835","nonce":468349778}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4174195471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4174195471},{"type":"v1","addr":"172.21.15.79:6837","nonce":4174195471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-06-10T00:17:13.259 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2024-06-10T00:17:13.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f15c006be30 msgr2=0x7f15c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f15c006be30 0x7f15c006e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f15e0154a00 tx=0x7f15d0008040 comp rx=0 tx=0).stop 2024-06-10T00:17:13.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d2680 msgr2=0x7f15e01f71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d2680 0x7f15e01f71e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f15c802a2b0 tx=0x7f15c80046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 shutdown_connections 2024-06-10T00:17:13.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f15c006be30 0x7f15c006e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e0161fa0 0x7f15e0157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e00d2680 0x7f15e01f71e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 --2- 172.21.15.79:0/4009350258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00d1fc0 0x7f15e00ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 >> 172.21.15.79:0/4009350258 conn(0x7f15e009d3f0 msgr2=0x7f15e00b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:13.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 shutdown_connections 2024-06-10T00:17:13.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.260+0000 7f15e5c12640 1 -- 172.21.15.79:0/4009350258 wait complete. 2024-06-10T00:17:13.272 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-10T00:17:13.272 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-10T00:17:13.272 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-10T00:17:13.272 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:17:13.272 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-10T00:17:13.272 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-10T00:17:13.272 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-10T00:17:13.273 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:17:13.273 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-10T00:17:13.273 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-10T00:17:13.273 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-10T00:17:13.273 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:17:13.273 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-10T00:17:13.273 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-10T00:17:13.274 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-10T00:17:13.274 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:17:13.282 INFO:tasks.ceph.mds.a:Stopped 2024-06-10T00:17:13.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-10T00:17:13.283 INFO:tasks.ceph.mds.c:Stopped 2024-06-10T00:17:13.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-10T00:17:13.285 INFO:tasks.ceph.mds.b:Stopped 2024-06-10T00:17:13.285 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-10T00:17:13.286 INFO:tasks.ceph.mds.d:Stopped 2024-06-10T00:17:13.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-10T00:17:13.325 INFO:tasks.ceph.mds.a:Started 2024-06-10T00:17:13.325 DEBUG:teuthology.parallel:result is None 2024-06-10T00:17:13.326 INFO:tasks.ceph.mds.c:Started 2024-06-10T00:17:13.326 DEBUG:teuthology.parallel:result is None 2024-06-10T00:17:13.327 INFO:tasks.ceph.mds.b:Started 2024-06-10T00:17:13.327 DEBUG:teuthology.parallel:result is None 2024-06-10T00:17:13.328 INFO:tasks.ceph.mds.d:Started 2024-06-10T00:17:13.328 DEBUG:teuthology.parallel:result is None 2024-06-10T00:17:13.328 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-10T00:17:13.400 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:17:13.400 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:17:13.412 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:17:13.412 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:17:13.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.433+0000 7fe64a9f9640 1 Processor -- start 2024-06-10T00:17:13.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.433+0000 7fe64a9f9640 1 -- start start 2024-06-10T00:17:13.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe64a9f9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6440d2680 0x7fe64415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe64a9f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6440cef70 0x7fe6440cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe648f96640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6440cef70 0x7fe6440cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe648f96640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6440cef70 0x7fe6440cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48408/0 (socket says 172.21.15.79:48408) 2024-06-10T00:17:13.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe648f96640 1 -- 172.21.15.79:0/2865724611 learned_addr learned my addr 172.21.15.79:0/2865724611 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:13.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe64a9f9640 1 -- 172.21.15.79:0/2865724611 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6440d0ad0 con 0x7fe6440d1fc0 2024-06-10T00:17:13.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe64a9f9640 1 -- 172.21.15.79:0/2865724611 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe6440d13e0 con 0x7fe6440cef70 2024-06-10T00:17:13.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe64a9f9640 1 -- 172.21.15.79:0/2865724611 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe64415f890 con 0x7fe6440d2680 2024-06-10T00:17:13.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe643fff640 1 --2- 172.21.15.79:0/2865724611 >> v2:172.21.15.117:3300/0 conn(0x7fe6440d2680 0x7fe64415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe648f96640 1 -- 172.21.15.79:0/2865724611 >> v2:172.21.15.117:3300/0 conn(0x7fe6440d2680 msgr2=0x7fe64415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:13.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe648f96640 1 --2- 172.21.15.79:0/2865724611 >> v2:172.21.15.117:3300/0 conn(0x7fe6440d2680 0x7fe64415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe648f96640 1 -- 172.21.15.79:0/2865724611 >> v1:172.21.15.117:6789/0 conn(0x7fe6440d1fc0 legacy=0x7fe6440d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.434+0000 7fe648f96640 1 -- 172.21.15.79:0/2865724611 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6440d0d90 con 0x7fe6440cef70 2024-06-10T00:17:13.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.435+0000 7fe648f96640 1 --2- 172.21.15.79:0/2865724611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440cef70 0x7fe6440cf3c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe6440d1560 tx=0x7fe63c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df59422c3cad5bf4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.435+0000 7fe642ffd640 1 -- 172.21.15.79:0/2865724611 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c036070 con 0x7fe6440cef70 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.435+0000 7fe642ffd640 1 -- 172.21.15.79:0/2865724611 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c031600 con 0x7fe6440cef70 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.435+0000 7fe642ffd640 1 -- 172.21.15.79:0/2865724611 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0319d0 con 0x7fe6440cef70 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.436+0000 7fe64a9f9640 1 -- 172.21.15.79:0/2865724611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440cef70 msgr2=0x7fe6440cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.436+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/2865724611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440cef70 0x7fe6440cf3c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe6440d1560 tx=0x7fe63c02a730 comp rx=0 tx=0).stop 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.436+0000 7fe64a9f9640 1 -- 172.21.15.79:0/2865724611 shutdown_connections 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.436+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/2865724611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440cef70 0x7fe6440cf3c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.436+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/2865724611 >> v2:172.21.15.117:3300/0 conn(0x7fe6440d2680 0x7fe64415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.436+0000 7fe64a9f9640 1 -- 172.21.15.79:0/2865724611 >> 172.21.15.79:0/2865724611 conn(0x7fe64409d3f0 msgr2=0x7fe6440d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.436+0000 7fe64a9f9640 1 -- 172.21.15.79:0/2865724611 shutdown_connections 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.436+0000 7fe64a9f9640 1 -- 172.21.15.79:0/2865724611 wait complete. 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.437+0000 7fe64a9f9640 1 Processor -- start 2024-06-10T00:17:13.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.437+0000 7fe64a9f9640 1 -- start start 2024-06-10T00:17:13.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe64a9f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6440cef70 0x7fe64415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe64a9f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440d1fc0 0x7fe6440cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe64a9f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6440d2680 0x7fe64409ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe64a9f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6440d4f00 con 0x7fe6440d1fc0 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe64a9f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6440d2400 con 0x7fe6440cef70 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe64a9f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe6440d1870 con 0x7fe6440d2680 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe6437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440d1fc0 0x7fe6440cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe6437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440d1fc0 0x7fe6440cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48422/0 (socket says 172.21.15.79:48422) 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe6437fe640 1 -- 172.21.15.79:0/1562625084 learned_addr learned my addr 172.21.15.79:0/1562625084 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe643fff640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6440cef70 0x7fe64415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe648f96640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6440d2680 0x7fe64409ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe6437fe640 1 -- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6440d2680 msgr2=0x7fe64409ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe6437fe640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6440d2680 0x7fe64409ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe6437fe640 1 -- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6440cef70 msgr2=0x7fe64415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe6437fe640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6440cef70 0x7fe64415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe6437fe640 1 -- 172.21.15.79:0/1562625084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6440cb7d0 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.438+0000 7fe643fff640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6440cef70 0x7fe64415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.439+0000 7fe6437fe640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440d1fc0 0x7fe6440cc870 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe63800c450 tx=0x7fe63800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.439+0000 7fe640ff9640 1 -- 172.21.15.79:0/1562625084 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6380052d0 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.439+0000 7fe640ff9640 1 -- 172.21.15.79:0/1562625084 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe638005470 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.439+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6440cbab0 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.439+0000 7fe640ff9640 1 -- 172.21.15.79:0/1562625084 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638012870 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.439+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6440cc070 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.440+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe644068430 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.440+0000 7fe640ff9640 1 -- 172.21.15.79:0/1562625084 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe638012a10 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.441+0000 7fe640ff9640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.441+0000 7fe640ff9640 1 -- 172.21.15.79:0/1562625084 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7fe63808a960 con 0x7fe6440d1fc0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.441+0000 7fe643fff640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.441+0000 7fe643fff640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe634006fd0 tx=0x7fe634008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.445+0000 7fe640ff9640 1 -- 172.21.15.79:0/1562625084 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe6380593f0 con 0x7fe6440d1fc0 2024-06-10T00:17:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.628+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe6440d04e0 con 0x7fe6440d1fc0 2024-06-10T00:17:13.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:17:13.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:17:13.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.727+0000 7fe640ff9640 1 -- 172.21.15.79:0/1562625084 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) ==== 97+0+0 (secure 0 0 0) 0x7fe638058cf0 con 0x7fe6440d1fc0 2024-06-10T00:17:13.726 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 msgr2=0x7fe63006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe634006fd0 tx=0x7fe634008040 comp rx=0 tx=0).stop 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440d1fc0 msgr2=0x7fe6440cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440d1fc0 0x7fe6440cc870 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe63800c450 tx=0x7fe63800c910 comp rx=0 tx=0).stop 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 shutdown_connections 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe63006be60 0x7fe63006e320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6440d2680 0x7fe64409ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6440d1fc0 0x7fe6440cc870 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 --2- 172.21.15.79:0/1562625084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6440cef70 0x7fe64415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 >> 172.21.15.79:0/1562625084 conn(0x7fe64409d3f0 msgr2=0x7fe6440c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:13.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 shutdown_connections 2024-06-10T00:17:13.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.729+0000 7fe64a9f9640 1 -- 172.21.15.79:0/1562625084 wait complete. 2024-06-10T00:17:13.740 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-10T00:17:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.880+0000 7fc999276640 1 Processor -- start 2024-06-10T00:17:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.880+0000 7fc999276640 1 -- start start 2024-06-10T00:17:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc999276640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc99406cae0 0x7fc994169210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc999276640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99406e670 con 0x7fc994158b50 2024-06-10T00:17:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc999276640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99406e950 con 0x7fc994158770 2024-06-10T00:17:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc999276640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc99406ec30 con 0x7fc99406cae0 2024-06-10T00:17:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc98a7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc994158b50 0x7fc99406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52172/0 (socket says 172.21.15.79:52172) 2024-06-10T00:17:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc98a7fc640 1 -- 172.21.15.79:0/991657973 learned_addr learned my addr 172.21.15.79:0/991657973 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc9937fe640 1 --2- 172.21.15.79:0/991657973 >> v2:172.21.15.117:3300/0 conn(0x7fc99406cae0 0x7fc994169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc9927fc640 1 -- 172.21.15.79:0/991657973 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1692476793 0 0) 0x7fc99406e670 con 0x7fc994158b50 2024-06-10T00:17:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc9927fc640 1 -- 172.21.15.79:0/991657973 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc980003520 con 0x7fc994158b50 2024-06-10T00:17:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc9937fe640 1 -- 172.21.15.79:0/991657973 >> v1:172.21.15.117:6789/0 conn(0x7fc994158770 legacy=0x7fc99406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc9937fe640 1 -- 172.21.15.79:0/991657973 >> v1:172.21.15.79:6789/0 conn(0x7fc994158b50 legacy=0x7fc99406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.881+0000 7fc9937fe640 1 -- 172.21.15.79:0/991657973 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9940ae890 con 0x7fc99406cae0 2024-06-10T00:17:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.882+0000 7fc9937fe640 1 --2- 172.21.15.79:0/991657973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99406cae0 0x7fc994169210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009d90 tx=0x7fc98c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f228173f83800162 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.882+0000 7fc9927fc640 1 -- 172.21.15.79:0/991657973 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c007740 con 0x7fc99406cae0 2024-06-10T00:17:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.882+0000 7fc9927fc640 1 -- 172.21.15.79:0/991657973 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc98c0078e0 con 0x7fc99406cae0 2024-06-10T00:17:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.882+0000 7fc9927fc640 1 -- 172.21.15.79:0/991657973 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c007cb0 con 0x7fc99406cae0 2024-06-10T00:17:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.883+0000 7fc999276640 1 -- 172.21.15.79:0/991657973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99406cae0 msgr2=0x7fc994169210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.883+0000 7fc999276640 1 --2- 172.21.15.79:0/991657973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99406cae0 0x7fc994169210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009d90 tx=0x7fc98c02a660 comp rx=0 tx=0).stop 2024-06-10T00:17:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.883+0000 7fc999276640 1 -- 172.21.15.79:0/991657973 shutdown_connections 2024-06-10T00:17:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.883+0000 7fc999276640 1 --2- 172.21.15.79:0/991657973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99406cae0 0x7fc994169210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.883+0000 7fc999276640 1 -- 172.21.15.79:0/991657973 >> 172.21.15.79:0/991657973 conn(0x7fc994071950 msgr2=0x7fc994071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:13.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.883+0000 7fc999276640 1 -- 172.21.15.79:0/991657973 shutdown_connections 2024-06-10T00:17:13.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.883+0000 7fc999276640 1 -- 172.21.15.79:0/991657973 wait complete. 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.884+0000 7fc999276640 1 Processor -- start 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.884+0000 7fc999276640 1 -- start start 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc999276640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99406cae0 0x7fc994146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc999276640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994158770 0x7fc994158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc999276640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc994158b50 0x7fc9940b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc999276640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc9940aff40 con 0x7fc99406cae0 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc999276640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9940afdc0 con 0x7fc994158770 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc999276640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc9940b00c0 con 0x7fc994158b50 2024-06-10T00:17:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc992ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99406cae0 0x7fc994146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc992ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99406cae0 0x7fc994146f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48430/0 (socket says 172.21.15.79:48430) 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc992ffd640 1 -- 172.21.15.79:0/3569776310 learned_addr learned my addr 172.21.15.79:0/3569776310 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc98a7fc640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994158770 0x7fc994158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc9937fe640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc994158b50 0x7fc9940b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc992ffd640 1 -- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc994158b50 msgr2=0x7fc9940b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc992ffd640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc994158b50 0x7fc9940b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc992ffd640 1 -- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994158770 msgr2=0x7fc994158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc992ffd640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994158770 0x7fc994158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc992ffd640 1 -- 172.21.15.79:0/3569776310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9941597a0 con 0x7fc99406cae0 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.885+0000 7fc98a7fc640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994158770 0x7fc994158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.886+0000 7fc992ffd640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99406cae0 0x7fc994146f60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c430 tx=0x7fc98400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.886+0000 7fc98bfff640 1 -- 172.21.15.79:0/3569776310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9840052d0 con 0x7fc99406cae0 2024-06-10T00:17:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.886+0000 7fc98bfff640 1 -- 172.21.15.79:0/3569776310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc984005490 con 0x7fc99406cae0 2024-06-10T00:17:13.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.886+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc994159a80 con 0x7fc99406cae0 2024-06-10T00:17:13.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.886+0000 7fc98bfff640 1 -- 172.21.15.79:0/3569776310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984007260 con 0x7fc99406cae0 2024-06-10T00:17:13.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.886+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99415a040 con 0x7fc99406cae0 2024-06-10T00:17:13.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.887+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc994068430 con 0x7fc99406cae0 2024-06-10T00:17:13.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.887+0000 7fc98bfff640 1 -- 172.21.15.79:0/3569776310 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc984007400 con 0x7fc99406cae0 2024-06-10T00:17:13.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.888+0000 7fc98bfff640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97406be30 0x7fc97406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:13.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.888+0000 7fc98a7fc640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97406be30 0x7fc97406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:13.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.888+0000 7fc98bfff640 1 -- 172.21.15.79:0/3569776310 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5249+0+0 (secure 0 0 0) 0x7fc98408a080 con 0x7fc99406cae0 2024-06-10T00:17:13.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.888+0000 7fc98a7fc640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97406be30 0x7fc97406e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc99415c3c0 tx=0x7fc97c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:13.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:13.892+0000 7fc98bfff640 1 -- 172.21.15.79:0/3569776310 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc984058630 con 0x7fc99406cae0 2024-06-10T00:17:14.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.131+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc9941532f0 con 0x7fc99406cae0 2024-06-10T00:17:14.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.131+0000 7fc98bfff640 1 -- 172.21.15.79:0/3569776310 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7fc98405c930 con 0x7fc99406cae0 2024-06-10T00:17:14.131 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:14.131 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:14.131 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-06-10T00:17:14.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA==", 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow==", 2024-06-10T00:17:14.132 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ==", 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:17:14.133 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw==", 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw==", 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg==", 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:17:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg==", 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g==", 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw==", 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:17:14.137 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw==", 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ==", 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA==", 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw==", 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-06-10T00:17:14.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA==", 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-06-10T00:17:14.141 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A==", 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw==", 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.142 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmQYVlARAAk+Jo8bykvpKKZY5XAPe2ZA==", 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:17:14.143 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA==", 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.144 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw==", 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-10T00:17:14.145 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97406be30 msgr2=0x7fc97406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97406be30 0x7fc97406e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc99415c3c0 tx=0x7fc97c007d30 comp rx=0 tx=0).stop 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99406cae0 msgr2=0x7fc994146f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99406cae0 0x7fc994146f60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c430 tx=0x7fc98400c8f0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 shutdown_connections 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97406be30 0x7fc97406e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc994158b50 0x7fc9940b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994158770 0x7fc994158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 --2- 172.21.15.79:0/3569776310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99406cae0 0x7fc994146f60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 >> 172.21.15.79:0/3569776310 conn(0x7fc994071950 msgr2=0x7fc994161e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 shutdown_connections 2024-06-10T00:17:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.133+0000 7fc999276640 1 -- 172.21.15.79:0/3569776310 wait complete. 2024-06-10T00:17:14.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-10T00:17:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.248+0000 7f873635a640 1 Processor -- start 2024-06-10T00:17:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.248+0000 7f873635a640 1 -- start start 2024-06-10T00:17:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f873635a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87300b46d0 0x7f8730071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f873635a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f8730165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f873635a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8730072820 con 0x7f87300cc6d0 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f873635a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8730072b00 con 0x7f87300b46d0 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f873635a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8730072de0 con 0x7f87300721a0 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87300b46d0 0x7f8730071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f87300cc6d0 0x7f87300ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52174/0 (socket says 172.21.15.79:52174) 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872ffff640 1 -- 172.21.15.79:0/3805256725 learned_addr learned my addr 172.21.15.79:0/3805256725 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f87348f7640 1 --2- 172.21.15.79:0/3805256725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f8730165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872effd640 1 -- 172.21.15.79:0/3805256725 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740754566 0 0) 0x7f8730072820 con 0x7f87300cc6d0 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872effd640 1 -- 172.21.15.79:0/3805256725 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8718003520 con 0x7f87300cc6d0 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872f7fe640 1 -- 172.21.15.79:0/3805256725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 msgr2=0x7f8730165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872f7fe640 1 --2- 172.21.15.79:0/3805256725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f8730165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872f7fe640 1 -- 172.21.15.79:0/3805256725 >> v1:172.21.15.79:6789/0 conn(0x7f87300cc6d0 legacy=0x7f87300ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f872f7fe640 1 -- 172.21.15.79:0/3805256725 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87300b31a0 con 0x7f87300b46d0 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.249+0000 7f87348f7640 1 --2- 172.21.15.79:0/3805256725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f8730165c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.250+0000 7f872f7fe640 1 --2- 172.21.15.79:0/3805256725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730071c60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f87240097a0 tx=0x7f872402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699a6d690ca20feb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.250+0000 7f872effd640 1 -- 172.21.15.79:0/3805256725 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724037070 con 0x7f87300b46d0 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.250+0000 7f872effd640 1 -- 172.21.15.79:0/3805256725 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8724032440 con 0x7f87300b46d0 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.250+0000 7f872effd640 1 -- 172.21.15.79:0/3805256725 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724032810 con 0x7f87300b46d0 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.251+0000 7f873635a640 1 -- 172.21.15.79:0/3805256725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 msgr2=0x7f8730071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.251+0000 7f873635a640 1 --2- 172.21.15.79:0/3805256725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730071c60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f87240097a0 tx=0x7f872402a180 comp rx=0 tx=0).stop 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.251+0000 7f873635a640 1 -- 172.21.15.79:0/3805256725 shutdown_connections 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.251+0000 7f873635a640 1 --2- 172.21.15.79:0/3805256725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f8730165c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.251+0000 7f873635a640 1 --2- 172.21.15.79:0/3805256725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730071c60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.251+0000 7f873635a640 1 -- 172.21.15.79:0/3805256725 >> 172.21.15.79:0/3805256725 conn(0x7f87300b19f0 msgr2=0x7f87300b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.251+0000 7f873635a640 1 -- 172.21.15.79:0/3805256725 shutdown_connections 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.251+0000 7f873635a640 1 -- 172.21.15.79:0/3805256725 wait complete. 2024-06-10T00:17:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.252+0000 7f873635a640 1 Processor -- start 2024-06-10T00:17:14.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.252+0000 7f873635a640 1 -- start start 2024-06-10T00:17:14.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f873635a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f873014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f873635a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f873635a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87300cc6d0 0x7f8730155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f873635a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8730166170 con 0x7f87300b46d0 2024-06-10T00:17:14.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f873635a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8730159f60 con 0x7f87300cc6d0 2024-06-10T00:17:14.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f873635a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87301662f0 con 0x7f87300721a0 2024-06-10T00:17:14.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48438/0 (socket says 172.21.15.79:48438) 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 -- 172.21.15.79:0/3663651486 learned_addr learned my addr 172.21.15.79:0/3663651486 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872ffff640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f873014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f87348f7640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87300cc6d0 0x7f8730155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 -- 172.21.15.79:0/3663651486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 msgr2=0x7f873014d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f873014d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 -- 172.21.15.79:0/3663651486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87300cc6d0 msgr2=0x7f8730155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87300cc6d0 0x7f8730155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 -- 172.21.15.79:0/3663651486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873015b170 con 0x7f87300b46d0 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.253+0000 7f872f7fe640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730154cd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f87240098c0 tx=0x7f87240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.254+0000 7f872cff9640 1 -- 172.21.15.79:0/3663651486 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724037040 con 0x7f87300b46d0 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.254+0000 7f872cff9640 1 -- 172.21.15.79:0/3663651486 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8724030500 con 0x7f87300b46d0 2024-06-10T00:17:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.254+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873015b450 con 0x7f87300b46d0 2024-06-10T00:17:14.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.254+0000 7f872cff9640 1 -- 172.21.15.79:0/3663651486 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240308d0 con 0x7f87300b46d0 2024-06-10T00:17:14.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.254+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873015ba10 con 0x7f87300b46d0 2024-06-10T00:17:14.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.255+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8730068430 con 0x7f87300b46d0 2024-06-10T00:17:14.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.255+0000 7f872cff9640 1 -- 172.21.15.79:0/3663651486 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8724044020 con 0x7f87300b46d0 2024-06-10T00:17:14.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.256+0000 7f872cff9640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f871c06be30 0x7f871c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.256+0000 7f872cff9640 1 -- 172.21.15.79:0/3663651486 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5249+0+0 (secure 0 0 0) 0x7f87240aae00 con 0x7f87300b46d0 2024-06-10T00:17:14.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.256+0000 7f872ffff640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f871c06be30 0x7f871c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.256+0000 7f872ffff640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f871c06be30 0x7f871c06e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8720005880 tx=0x7f8720009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:14.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.260+0000 7f872cff9640 1 -- 172.21.15.79:0/3663651486 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8724079310 con 0x7f87300b46d0 2024-06-10T00:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.435+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f87300b1590 con 0x7f87300b46d0 2024-06-10T00:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.435+0000 7f872cff9640 1 -- 172.21.15.79:0/3663651486 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) ==== 84+0+65 (secure 0 0 0) 0x7f872407d610 con 0x7f87300b46d0 2024-06-10T00:17:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:14.435 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:17:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-06-10T00:17:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-06-10T00:17:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:14.436 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f871c06be30 msgr2=0x7f871c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f871c06be30 0x7f871c06e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8720005880 tx=0x7f8720009040 comp rx=0 tx=0).stop 2024-06-10T00:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 msgr2=0x7f8730154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730154cd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f87240098c0 tx=0x7f87240046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 shutdown_connections 2024-06-10T00:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f871c06be30 0x7f871c06e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87300cc6d0 0x7f8730155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87300b46d0 0x7f8730154cd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 --2- 172.21.15.79:0/3663651486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87300721a0 0x7f873014d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 >> 172.21.15.79:0/3663651486 conn(0x7f87300b19f0 msgr2=0x7f87300ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 shutdown_connections 2024-06-10T00:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.437+0000 7f873635a640 1 -- 172.21.15.79:0/3663651486 wait complete. 2024-06-10T00:17:14.448 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-10T00:17:14.448 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-10T00:17:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.552+0000 7f67ba389640 1 Processor -- start 2024-06-10T00:17:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.552+0000 7f67ba389640 1 -- start start 2024-06-10T00:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.552+0000 7f67ba389640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67ba389640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67b40d1f30 0x7f67b40d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67ba389640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b415ec90 con 0x7f67b40d0c30 2024-06-10T00:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67ba389640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f67b415fa50 con 0x7f67b40d1f30 2024-06-10T00:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67ba389640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f67b40d1090 con 0x7f67b415e670 2024-06-10T00:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67abfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67b40d1f30 0x7f67b40d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40d49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:34312/0 (socket says 172.21.15.79:34312) 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b3fff640 1 -- 172.21.15.79:0/3191584818 learned_addr learned my addr 172.21.15.79:0/3191584818 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b37fe640 1 -- 172.21.15.79:0/3191584818 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 790129136 0 0) 0x7f67b415ec90 con 0x7f67b40d0c30 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b37fe640 1 -- 172.21.15.79:0/3191584818 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67a0003520 con 0x7f67b40d0c30 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b3fff640 1 -- 172.21.15.79:0/3191584818 >> v2:172.21.15.117:3300/0 conn(0x7f67b40d1f30 msgr2=0x7f67b40d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b3fff640 1 --2- 172.21.15.79:0/3191584818 >> v2:172.21.15.117:3300/0 conn(0x7f67b40d1f30 0x7f67b40d06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b3fff640 1 -- 172.21.15.79:0/3191584818 >> v1:172.21.15.117:6789/0 conn(0x7f67b40d0c30 legacy=0x7f67b4162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67b3fff640 1 -- 172.21.15.79:0/3191584818 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b415ef70 con 0x7f67b415e670 2024-06-10T00:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.553+0000 7f67abfff640 1 --2- 172.21.15.79:0/3191584818 >> v2:172.21.15.117:3300/0 conn(0x7f67b40d1f30 0x7f67b40d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:17:14.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.554+0000 7f67b3fff640 1 --2- 172.21.15.79:0/3191584818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40d49f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009870 tx=0x7f67a402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e0e106122aea07 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.554+0000 7f67b37fe640 1 -- 172.21.15.79:0/3191584818 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4037070 con 0x7f67b415e670 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.554+0000 7f67b37fe640 1 -- 172.21.15.79:0/3191584818 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a402ae50 con 0x7f67b415e670 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.554+0000 7f67b37fe640 1 -- 172.21.15.79:0/3191584818 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4032840 con 0x7f67b415e670 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.555+0000 7f67ba389640 1 -- 172.21.15.79:0/3191584818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 msgr2=0x7f67b40d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.555+0000 7f67ba389640 1 --2- 172.21.15.79:0/3191584818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40d49f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009870 tx=0x7f67a402a300 comp rx=0 tx=0).stop 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.555+0000 7f67ba389640 1 -- 172.21.15.79:0/3191584818 shutdown_connections 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.555+0000 7f67ba389640 1 --2- 172.21.15.79:0/3191584818 >> v2:172.21.15.117:3300/0 conn(0x7f67b40d1f30 0x7f67b40d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.555+0000 7f67ba389640 1 --2- 172.21.15.79:0/3191584818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40d49f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.555+0000 7f67ba389640 1 -- 172.21.15.79:0/3191584818 >> 172.21.15.79:0/3191584818 conn(0x7f67b409d400 msgr2=0x7f67b40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.555+0000 7f67ba389640 1 -- 172.21.15.79:0/3191584818 shutdown_connections 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.555+0000 7f67ba389640 1 -- 172.21.15.79:0/3191584818 wait complete. 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.556+0000 7f67ba389640 1 Processor -- start 2024-06-10T00:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.556+0000 7f67ba389640 1 -- start start 2024-06-10T00:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67ba389640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b40d0c30 0x7f67b415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67ba389640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67b40d1f30 0x7f67b41f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67ba389640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67ba389640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67b415f530 con 0x7f67b40d0c30 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67ba389640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67b415ea50 con 0x7f67b40d1f30 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67ba389640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f67b40d2370 con 0x7f67b415e670 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b40d0c30 0x7f67b415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b40d0c30 0x7f67b415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48442/0 (socket says 172.21.15.79:48442) 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 -- 172.21.15.79:0/2446396137 learned_addr learned my addr 172.21.15.79:0/2446396137 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67abfff640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67b40d1f30 0x7f67b41f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b8926640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 -- 172.21.15.79:0/2446396137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 msgr2=0x7f67b40c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 -- 172.21.15.79:0/2446396137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67b40d1f30 msgr2=0x7f67b41f7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67b40d1f30 0x7f67b41f7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 -- 172.21.15.79:0/2446396137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b41f7aa0 con 0x7f67b40d0c30 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.557+0000 7f67b3fff640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b40d0c30 0x7f67b415d210 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f67a4000c00 tx=0x7f67a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.558+0000 7f67b17fa640 1 -- 172.21.15.79:0/2446396137 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4041070 con 0x7f67b40d0c30 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.558+0000 7f67b17fa640 1 -- 172.21.15.79:0/2446396137 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a403c660 con 0x7f67b40d0c30 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.558+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b40b6ec0 con 0x7f67b40d0c30 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.558+0000 7f67b17fa640 1 -- 172.21.15.79:0/2446396137 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4037040 con 0x7f67b40d0c30 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.558+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b40b7480 con 0x7f67b40d0c30 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.559+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b4068540 con 0x7f67b40d0c30 2024-06-10T00:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.559+0000 7f67b17fa640 1 -- 172.21.15.79:0/2446396137 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67a4044070 con 0x7f67b40d0c30 2024-06-10T00:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.560+0000 7f67b17fa640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.560+0000 7f67b17fa640 1 -- 172.21.15.79:0/2446396137 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5249+0+0 (secure 0 0 0) 0x7f67a40ab360 con 0x7f67b40d0c30 2024-06-10T00:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.560+0000 7f67abfff640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.560+0000 7f67abfff640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f679406be30 0x7f679406e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f679c009560 tx=0x7f679c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.564+0000 7f67b17fa640 1 -- 172.21.15.79:0/2446396137 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f67a4079f60 con 0x7f67b40d0c30 2024-06-10T00:17:14.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:14.739+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f67b40d47d0 con 0x7f67b40d0c30 2024-06-10T00:17:15.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.725+0000 7f67b17fa640 1 -- 172.21.15.79:0/2446396137 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) ==== 138+0+0 (secure 0 0 0) 0x7f67a4079860 con 0x7f67b40d0c30 2024-06-10T00:17:15.725 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-06-10T00:17:15.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f679406be30 msgr2=0x7f679406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:15.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f679406be30 0x7f679406e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f679c009560 tx=0x7f679c008040 comp rx=0 tx=0).stop 2024-06-10T00:17:15.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b40d0c30 msgr2=0x7f67b415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:15.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b40d0c30 0x7f67b415d210 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f67a4000c00 tx=0x7f67a40046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 shutdown_connections 2024-06-10T00:17:15.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67b415e670 0x7f67b40c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67b40d1f30 0x7f67b41f7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 --2- 172.21.15.79:0/2446396137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b40d0c30 0x7f67b415d210 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 >> 172.21.15.79:0/2446396137 conn(0x7f67b409d400 msgr2=0x7f67b406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:15.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 shutdown_connections 2024-06-10T00:17:15.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.728+0000 7f67ba389640 1 -- 172.21.15.79:0/2446396137 wait complete. 2024-06-10T00:17:15.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-10T00:17:15.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.856+0000 7f9cd104d640 1 Processor -- start 2024-06-10T00:17:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.856+0000 7f9cd104d640 1 -- start start 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cd104d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ccc159a10 0x7f9ccc06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cd104d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc0ae960 con 0x7f9ccc0cffd0 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cd104d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc0aec00 con 0x7f9ccc0acd40 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cd104d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9ccc0aeee0 con 0x7f9ccc159a10 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9ccb59e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9ccc0cffd0 0x7f9ccc0d03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52184/0 (socket says 172.21.15.79:52184) 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9ccb59e640 1 -- 172.21.15.79:0/2561306705 learned_addr learned my addr 172.21.15.79:0/2561306705 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9ccad9d640 1 --2- 172.21.15.79:0/2561306705 >> v2:172.21.15.117:3300/0 conn(0x7f9ccc159a10 0x7f9ccc06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1259649390 0 0) 0x7f9ccc0ae960 con 0x7f9ccc0cffd0 2024-06-10T00:17:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb8003520 con 0x7f9ccc0cffd0 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3988304292 0 0) 0x7f9cb8003520 con 0x7f9ccc0cffd0 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 >> v2:172.21.15.117:3300/0 conn(0x7f9ccc159a10 msgr2=0x7f9ccc06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 --2- 172.21.15.79:0/2561306705 >> v2:172.21.15.117:3300/0 conn(0x7f9ccc159a10 0x7f9ccc06cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 >> v1:172.21.15.117:6789/0 conn(0x7f9ccc0acd40 legacy=0x7f9ccc0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc0af1c0 con 0x7f9ccc0cffd0 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f9cc4001a10 con 0x7f9ccc0cffd0 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 >> v1:172.21.15.79:6789/0 conn(0x7f9ccc0cffd0 legacy=0x7f9ccc0d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80039b0 0x7f9cb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb8004800 0x7f9cb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80051c0 0x7f9cb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc0aeee0 con 0x7f9cb80051c0 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb800c060 con 0x7f9cb8004800 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.857+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb800c260 con 0x7f9cb80039b0 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccb59e640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80051c0 0x7f9cb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9cc3fff640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb8004800 0x7f9cb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccad9d640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80039b0 0x7f9cb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccb59e640 1 -- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80039b0 msgr2=0x7f9cb8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccb59e640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80039b0 0x7f9cb8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccb59e640 1 -- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb8004800 msgr2=0x7f9cb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccb59e640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb8004800 0x7f9cb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccb59e640 1 -- 172.21.15.79:0/2561306705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb8003520 con 0x7f9cb80051c0 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccad9d640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80039b0 0x7f9cb8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccb59e640 1 -- 172.21.15.79:0/2561306705 reap_dead start 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.858+0000 7f9ccb59e640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80051c0 0x7f9cb800b9c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400a830 tx=0x7f9cb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9aa85a32de6d76 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400a480 con 0x7f9cb80051c0 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc402f070 con 0x7f9cb80051c0 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cca59c640 1 -- 172.21.15.79:0/2561306705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc402bc90 con 0x7f9cb80051c0 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cd104d640 1 -- 172.21.15.79:0/2561306705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80051c0 msgr2=0x7f9cb800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cd104d640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80051c0 0x7f9cb800b9c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400a830 tx=0x7f9cb8005830 comp rx=0 tx=0).stop 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cd104d640 1 -- 172.21.15.79:0/2561306705 shutdown_connections 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cd104d640 1 --2- 172.21.15.79:0/2561306705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80051c0 0x7f9cb800b9c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cd104d640 1 -- 172.21.15.79:0/2561306705 >> 172.21.15.79:0/2561306705 conn(0x7f9ccc06b7e0 msgr2=0x7f9ccc06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cd104d640 1 -- 172.21.15.79:0/2561306705 shutdown_connections 2024-06-10T00:17:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.859+0000 7f9cd104d640 1 -- 172.21.15.79:0/2561306705 wait complete. 2024-06-10T00:17:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9cd104d640 1 Processor -- start 2024-06-10T00:17:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9cd104d640 1 -- start start 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9cd104d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80051c0 0x7f9ccc09ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9cd104d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc153020 0x7f9ccc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9cd104d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ccc0b2a70 0x7f9ccc1492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9cd104d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc06cde0 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9cd104d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc159df0 con 0x7f9ccc153020 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9cd104d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc06cf60 con 0x7f9cb80051c0 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9ccb59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ccc0b2a70 0x7f9ccc1492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9ccb59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ccc0b2a70 0x7f9ccc1492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48452/0 (socket says 172.21.15.79:48452) 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.861+0000 7f9ccb59e640 1 -- 172.21.15.79:0/1680592073 learned_addr learned my addr 172.21.15.79:0/1680592073 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9ccad9d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80051c0 0x7f9ccc09ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9cc3fff640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc153020 0x7f9ccc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9ccb59e640 1 -- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80051c0 msgr2=0x7f9ccc09ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9ccb59e640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80051c0 0x7f9ccc09ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9ccb59e640 1 -- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc153020 msgr2=0x7f9ccc0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9ccb59e640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc153020 0x7f9ccc0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9ccb59e640 1 -- 172.21.15.79:0/1680592073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc152260 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9cc3fff640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc153020 0x7f9ccc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9ccb59e640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ccc0b2a70 0x7f9ccc1492a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400a830 tx=0x7f9ccc0aedd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9cc37fe640 1 -- 172.21.15.79:0/1680592073 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4001fd0 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9cc37fe640 1 -- 172.21.15.79:0/1680592073 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc4004b60 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc152540 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9cc37fe640 1 -- 172.21.15.79:0/1680592073 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4034470 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.862+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc151ba0 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.863+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ccc0683c0 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.864+0000 7f9cc37fe640 1 -- 172.21.15.79:0/1680592073 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cc4034610 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.864+0000 7f9cc37fe640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9cac06be30 0x7f9cac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.864+0000 7f9ccad9d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9cac06be30 0x7f9cac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.864+0000 7f9cc37fe640 1 -- 172.21.15.79:0/1680592073 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5619+0+0 (secure 0 0 0) 0x7f9cc40aa850 con 0x7f9ccc0b2a70 2024-06-10T00:17:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.865+0000 7f9ccad9d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9cac06be30 0x7f9cac06e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0b5190 tx=0x7f9cbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:15.869+0000 7f9cc37fe640 1 -- 172.21.15.79:0/1680592073 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9cc4078c10 con 0x7f9ccc0b2a70 2024-06-10T00:17:16.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.042+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9ccc0683c0 con 0x7f9ccc0b2a70 2024-06-10T00:17:16.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.728+0000 7f9cc37fe640 1 -- 172.21.15.79:0/1680592073 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) ==== 170+0+0 (secure 0 0 0) 0x7f9cc407cf10 con 0x7f9ccc0b2a70 2024-06-10T00:17:16.727 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9cac06be30 msgr2=0x7f9cac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9cac06be30 0x7f9cac06e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0b5190 tx=0x7f9cbc008040 comp rx=0 tx=0).stop 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ccc0b2a70 msgr2=0x7f9ccc1492a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ccc0b2a70 0x7f9ccc1492a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400a830 tx=0x7f9ccc0aedd0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 shutdown_connections 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9cac06be30 0x7f9cac06e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ccc0b2a70 0x7f9ccc1492a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc153020 0x7f9ccc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 --2- 172.21.15.79:0/1680592073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80051c0 0x7f9ccc09ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 >> 172.21.15.79:0/1680592073 conn(0x7f9ccc06b7e0 msgr2=0x7f9ccc15a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 shutdown_connections 2024-06-10T00:17:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.731+0000 7f9cd104d640 1 -- 172.21.15.79:0/1680592073 wait complete. 2024-06-10T00:17:16.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-10T00:17:16.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.861+0000 7fa7be116640 1 Processor -- start 2024-06-10T00:17:16.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.861+0000 7fa7be116640 1 -- start start 2024-06-10T00:17:16.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7be116640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7b8155320 0x7fa7b80b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:16.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7be116640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b80d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:16.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7be116640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa7b80d0560 0x7fa7b806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:16.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7be116640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b8155700 con 0x7fa7b8155320 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7be116640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b815b6b0 con 0x7fa7b80d0560 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7be116640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b815b990 con 0x7fa7b80b34e0 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7b8155320 0x7fa7b80b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7b8155320 0x7fa7b80b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48466/0 (socket says 172.21.15.79:48466) 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b77fe640 1 -- 172.21.15.79:0/477207167 learned_addr learned my addr 172.21.15.79:0/477207167 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b7fff640 1 --2- 172.21.15.79:0/477207167 >> v2:172.21.15.117:3300/0 conn(0x7fa7b80d0560 0x7fa7b806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b6ffd640 1 --2- 172.21.15.79:0/477207167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b80d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b77fe640 1 -- 172.21.15.79:0/477207167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 msgr2=0x7fa7b80d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b77fe640 1 --2- 172.21.15.79:0/477207167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b80d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b77fe640 1 -- 172.21.15.79:0/477207167 >> v2:172.21.15.117:3300/0 conn(0x7fa7b80d0560 msgr2=0x7fa7b806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:16.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b77fe640 1 --2- 172.21.15.79:0/477207167 >> v2:172.21.15.117:3300/0 conn(0x7fa7b80d0560 0x7fa7b806e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.862+0000 7fa7b77fe640 1 -- 172.21.15.79:0/477207167 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b815bc70 con 0x7fa7b8155320 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.863+0000 7fa7b77fe640 1 --2- 172.21.15.79:0/477207167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b80b2fa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8158e20 tx=0x7fa7a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e1a8128a3e64cc server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.863+0000 7fa7b67fc640 1 -- 172.21.15.79:0/477207167 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8037070 con 0x7fa7b8155320 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.863+0000 7fa7b67fc640 1 -- 172.21.15.79:0/477207167 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a8032440 con 0x7fa7b8155320 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.863+0000 7fa7b67fc640 1 -- 172.21.15.79:0/477207167 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8032810 con 0x7fa7b8155320 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 -- 172.21.15.79:0/477207167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 msgr2=0x7fa7b80b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 --2- 172.21.15.79:0/477207167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b80b2fa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8158e20 tx=0x7fa7a802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 -- 172.21.15.79:0/477207167 shutdown_connections 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 --2- 172.21.15.79:0/477207167 >> v2:172.21.15.117:3300/0 conn(0x7fa7b80d0560 0x7fa7b806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 --2- 172.21.15.79:0/477207167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b80d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 --2- 172.21.15.79:0/477207167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b80b2fa0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 -- 172.21.15.79:0/477207167 >> 172.21.15.79:0/477207167 conn(0x7fa7b80b1d10 msgr2=0x7fa7b80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:16.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 -- 172.21.15.79:0/477207167 shutdown_connections 2024-06-10T00:17:16.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.864+0000 7fa7be116640 1 -- 172.21.15.79:0/477207167 wait complete. 2024-06-10T00:17:16.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.865+0000 7fa7be116640 1 Processor -- start 2024-06-10T00:17:16.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.865+0000 7fa7be116640 1 -- start start 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7be116640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7be116640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7b80d0560 0x7fa7b815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7be116640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7be116640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b815b470 con 0x7fa7b8155320 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7be116640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b815b2f0 con 0x7fa7b80d0560 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7be116640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b806e730 con 0x7fa7b80b34e0 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b815e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48476/0 (socket says 172.21.15.79:48476) 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 -- 172.21.15.79:0/2903279450 learned_addr learned my addr 172.21.15.79:0/2903279450 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b6ffd640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7b80d0560 0x7fa7b815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b77fe640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 -- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 msgr2=0x7fa7b814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:16.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 -- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7b80d0560 msgr2=0x7fa7b815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7b80d0560 0x7fa7b815e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 -- 172.21.15.79:0/2903279450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b8155920 con 0x7fa7b8155320 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b77fe640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa7b7fff640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b815e950 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0007e40 tx=0x7fa7b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.866+0000 7fa79ffff640 1 -- 172.21.15.79:0/2903279450 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0014620 con 0x7fa7b8155320 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.867+0000 7fa79ffff640 1 -- 172.21.15.79:0/2903279450 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b0019070 con 0x7fa7b8155320 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.867+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b8155c00 con 0x7fa7b8155320 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.867+0000 7fa79ffff640 1 -- 172.21.15.79:0/2903279450 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0014a20 con 0x7fa7b8155320 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.867+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b81561c0 con 0x7fa7b8155320 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.867+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b80683c0 con 0x7fa7b8155320 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.868+0000 7fa79ffff640 1 -- 172.21.15.79:0/2903279450 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7b0014bc0 con 0x7fa7b8155320 2024-06-10T00:17:16.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.869+0000 7fa79ffff640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7a406be30 0x7fa7a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:16.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.869+0000 7fa7b77fe640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7a406be30 0x7fa7a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:16.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.869+0000 7fa79ffff640 1 -- 172.21.15.79:0/2903279450 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6001+0+0 (secure 0 0 0) 0x7fa7b008b870 con 0x7fa7b8155320 2024-06-10T00:17:16.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.869+0000 7fa7b77fe640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7a406be30 0x7fa7a406e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8034000 tx=0x7fa7a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:16.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:16.873+0000 7fa79ffff640 1 -- 172.21.15.79:0/2903279450 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa7b005a0d0 con 0x7fa7b8155320 2024-06-10T00:17:17.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.082+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa7b8068b20 con 0x7fa7b8155320 2024-06-10T00:17:17.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.758+0000 7fa79ffff640 1 -- 172.21.15.79:0/2903279450 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) ==== 173+0+0 (secure 0 0 0) 0x7fa7b00599d0 con 0x7fa7b8155320 2024-06-10T00:17:17.758 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 9 and data pool 10 2024-06-10T00:17:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.763+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7a406be30 msgr2=0x7fa7a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.763+0000 7fa7be116640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7a406be30 0x7fa7a406e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8034000 tx=0x7fa7a802e000 comp rx=0 tx=0).stop 2024-06-10T00:17:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.763+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 msgr2=0x7fa7b815e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.763+0000 7fa7be116640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b815e950 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0007e40 tx=0x7fa7b000e4b0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.764+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 shutdown_connections 2024-06-10T00:17:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.764+0000 7fa7be116640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7a406be30 0x7fa7a406e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.764+0000 7fa7be116640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b8155320 0x7fa7b815e950 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.764+0000 7fa7be116640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7b80d0560 0x7fa7b815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.764+0000 7fa7be116640 1 --2- 172.21.15.79:0/2903279450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b80b34e0 0x7fa7b814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.766+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 >> 172.21.15.79:0/2903279450 conn(0x7fa7b80b1d10 msgr2=0x7fa7b80b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.770+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 shutdown_connections 2024-06-10T00:17:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.771+0000 7fa7be116640 1 -- 172.21.15.79:0/2903279450 wait complete. 2024-06-10T00:17:17.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:17:17.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.892+0000 7f9f86aa7640 1 Processor -- start 2024-06-10T00:17:17.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.892+0000 7f9f86aa7640 1 -- start start 2024-06-10T00:17:17.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f86aa7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9f8015a870 0x7f9f8006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f86aa7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9f800af3d0 0x7f9f800cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f86aa7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8006e390 con 0x7f9f800aef70 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f86aa7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9f8015ac50 con 0x7f9f8015a870 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f86aa7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9f8006cdb0 con 0x7f9f800af3d0 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f84843640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9f8015a870 0x7f9f8006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f77fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9f800aef70 0x7f9f800b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52200/0 (socket says 172.21.15.79:52200) 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f77fff640 1 -- 172.21.15.79:0/2896709216 learned_addr learned my addr 172.21.15.79:0/2896709216 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f85044640 1 --2- 172.21.15.79:0/2896709216 >> v2:172.21.15.117:3300/0 conn(0x7f9f800af3d0 0x7f9f800cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f84843640 1 -- 172.21.15.79:0/2896709216 >> v2:172.21.15.117:3300/0 conn(0x7f9f800af3d0 msgr2=0x7f9f800cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f84843640 1 --2- 172.21.15.79:0/2896709216 >> v2:172.21.15.117:3300/0 conn(0x7f9f800af3d0 0x7f9f800cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f84843640 1 -- 172.21.15.79:0/2896709216 >> v1:172.21.15.79:6789/0 conn(0x7f9f800aef70 legacy=0x7f9f800b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f84843640 1 -- 172.21.15.79:0/2896709216 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8006d090 con 0x7f9f8015a870 2024-06-10T00:17:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.893+0000 7f9f777fe640 1 -- 172.21.15.79:0/2896709216 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959532893 0 0) 0x7f9f8006e390 con 0x7f9f800aef70 2024-06-10T00:17:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.894+0000 7f9f84843640 1 --2- 172.21.15.79:0/2896709216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8015a870 0x7f9f8006de50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9f8006c8b0 tx=0x7f9f7c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3504aa12b695ec8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.894+0000 7f9f777fe640 1 -- 172.21.15.79:0/2896709216 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c037070 con 0x7f9f8015a870 2024-06-10T00:17:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.894+0000 7f9f777fe640 1 -- 172.21.15.79:0/2896709216 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f7c02ae50 con 0x7f9f8015a870 2024-06-10T00:17:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.894+0000 7f9f777fe640 1 -- 172.21.15.79:0/2896709216 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c032660 con 0x7f9f8015a870 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.895+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2896709216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8015a870 msgr2=0x7f9f8006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.895+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2896709216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8015a870 0x7f9f8006de50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9f8006c8b0 tx=0x7f9f7c02a140 comp rx=0 tx=0).stop 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.895+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2896709216 shutdown_connections 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.895+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2896709216 >> v2:172.21.15.117:3300/0 conn(0x7f9f800af3d0 0x7f9f800cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.895+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2896709216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f8015a870 0x7f9f8006de50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.895+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2896709216 >> 172.21.15.79:0/2896709216 conn(0x7f9f800b19f0 msgr2=0x7f9f800b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.895+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2896709216 shutdown_connections 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.895+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2896709216 wait complete. 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.896+0000 7f9f86aa7640 1 Processor -- start 2024-06-10T00:17:17.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.896+0000 7f9f86aa7640 1 -- start start 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f86aa7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f800aef70 0x7f9f8014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f86aa7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f800af3d0 0x7f9f80072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f86aa7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8015a870 0x7f9f80143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f86aa7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8006d930 con 0x7f9f800af3d0 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f86aa7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8006d650 con 0x7f9f8015a870 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f86aa7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9f800b2e40 con 0x7f9f800aef70 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f800af3d0 0x7f9f80072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f800af3d0 0x7f9f80072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48490/0 (socket says 172.21.15.79:48490) 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 -- 172.21.15.79:0/2039661630 learned_addr learned my addr 172.21.15.79:0/2039661630 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 -- 172.21.15.79:0/2039661630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f800aef70 msgr2=0x7f9f8014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f84843640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f800aef70 0x7f9f8014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f85044640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8015a870 0x7f9f80143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f800aef70 0x7f9f8014ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 -- 172.21.15.79:0/2039661630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8015a870 msgr2=0x7f9f80143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8015a870 0x7f9f80143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 -- 172.21.15.79:0/2039661630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8014ebd0 con 0x7f9f800af3d0 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f77fff640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f800af3d0 0x7f9f80072a90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000c500 tx=0x7f9f7000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f757fa640 1 -- 172.21.15.79:0/2039661630 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70018070 con 0x7f9f800af3d0 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f757fa640 1 -- 172.21.15.79:0/2039661630 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f70007580 con 0x7f9f800af3d0 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f757fa640 1 -- 172.21.15.79:0/2039661630 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70004a20 con 0x7f9f800af3d0 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f800cc870 con 0x7f9f800af3d0 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.897+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f80071ae0 con 0x7f9f800af3d0 2024-06-10T00:17:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.898+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8006f1f0 con 0x7f9f800af3d0 2024-06-10T00:17:17.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.899+0000 7f9f757fa640 1 -- 172.21.15.79:0/2039661630 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f7001b070 con 0x7f9f800af3d0 2024-06-10T00:17:17.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.899+0000 7f9f757fa640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f6c06be60 0x7f9f6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:17.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.899+0000 7f9f757fa640 1 -- 172.21.15.79:0/2039661630 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6101+0+0 (secure 0 0 0) 0x7f9f7008a260 con 0x7f9f800af3d0 2024-06-10T00:17:17.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.899+0000 7f9f84843640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f6c06be60 0x7f9f6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:17.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.900+0000 7f9f84843640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f6c06be60 0x7f9f6c06e320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c034000 tx=0x7f9f7c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:17.904+0000 7f9f757fa640 1 -- 172.21.15.79:0/2039661630 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f8006f1f0 con 0x7f9f800af3d0 2024-06-10T00:17:18.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.079+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f80068d00 con 0x7f9f800af3d0 2024-06-10T00:17:18.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.080+0000 7f9f757fa640 1 -- 172.21.15.79:0/2039661630 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16849 (secure 0 0 0) 0x7f9f70058b10 con 0x7f9f800af3d0 2024-06-10T00:17:18.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:18.080 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":60,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:17:17.083093+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:17:14.757444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-06-10T00:17:16.061305+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f6c06be60 msgr2=0x7f9f6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f6c06be60 0x7f9f6c06e320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c034000 tx=0x7f9f7c02e000 comp rx=0 tx=0).stop 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f800af3d0 msgr2=0x7f9f80072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f800af3d0 0x7f9f80072a90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000c500 tx=0x7f9f7000c9c0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 shutdown_connections 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f6c06be60 0x7f9f6c06e320 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8015a870 0x7f9f80143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f800af3d0 0x7f9f80072a90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 --2- 172.21.15.79:0/2039661630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f800aef70 0x7f9f8014ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 >> 172.21.15.79:0/2039661630 conn(0x7f9f800b19f0 msgr2=0x7f9f800cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:18.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 shutdown_connections 2024-06-10T00:17:18.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.082+0000 7f9f86aa7640 1 -- 172.21.15.79:0/2039661630 wait complete. 2024-06-10T00:17:18.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:17:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.193+0000 7fba2ddee640 1 Processor -- start 2024-06-10T00:17:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.194+0000 7fba2ddee640 1 -- start start 2024-06-10T00:17:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.194+0000 7fba2ddee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba2815f1a0 0x7fba280d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.194+0000 7fba2ddee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba2815f5e0 con 0x7fba280cef70 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.194+0000 7fba2ddee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba280d0ad0 con 0x7fba280d2680 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.194+0000 7fba2ddee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fba280d13e0 con 0x7fba2815f1a0 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.194+0000 7fba27fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fba280cef70 0x7fba280cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36412/0 (socket says 172.21.15.79:36412) 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.194+0000 7fba27fff640 1 -- 172.21.15.79:0/1777953979 learned_addr learned my addr 172.21.15.79:0/1777953979 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba26ffd640 1 --2- 172.21.15.79:0/1777953979 >> v2:172.21.15.117:3300/0 conn(0x7fba2815f1a0 0x7fba280d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702405672 0 0) 0x7fba2815f5e0 con 0x7fba280cef70 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba14003520 con 0x7fba280cef70 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3507633604 0 0) 0x7fba14003520 con 0x7fba280cef70 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 >> v2:172.21.15.117:3300/0 conn(0x7fba2815f1a0 msgr2=0x7fba280d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 --2- 172.21.15.79:0/1777953979 >> v2:172.21.15.117:3300/0 conn(0x7fba2815f1a0 0x7fba280d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 >> v1:172.21.15.117:6789/0 conn(0x7fba280d2680 legacy=0x7fba280d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2815f890 con 0x7fba280cef70 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fba20001670 con 0x7fba280cef70 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 >> v1:172.21.15.79:6789/0 conn(0x7fba280cef70 legacy=0x7fba280cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140039b0 0x7fba14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba14004800 0x7fba14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba140051c0 0x7fba1400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba280d13e0 con 0x7fba140051c0 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba1400c060 con 0x7fba14004800 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba1400c260 con 0x7fba140039b0 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba27fff640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba140051c0 0x7fba1400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba26ffd640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba14004800 0x7fba14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba277fe640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140039b0 0x7fba14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba27fff640 1 -- 172.21.15.79:0/1777953979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140039b0 msgr2=0x7fba14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba27fff640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140039b0 0x7fba14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba27fff640 1 -- 172.21.15.79:0/1777953979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba14004800 msgr2=0x7fba14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba27fff640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba14004800 0x7fba14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.195+0000 7fba27fff640 1 -- 172.21.15.79:0/1777953979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba14003520 con 0x7fba140051c0 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.196+0000 7fba27fff640 1 -- 172.21.15.79:0/1777953979 reap_dead start 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.196+0000 7fba27fff640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba140051c0 0x7fba1400b9c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fba2000c240 tx=0x7fba14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d1d37d2de2c000 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.196+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20007d10 con 0x7fba140051c0 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.196+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba20005ad0 con 0x7fba140051c0 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.196+0000 7fba267fc640 1 -- 172.21.15.79:0/1777953979 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20007070 con 0x7fba140051c0 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.197+0000 7fba2ddee640 1 -- 172.21.15.79:0/1777953979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba140051c0 msgr2=0x7fba1400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.197+0000 7fba2ddee640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba140051c0 0x7fba1400b9c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fba2000c240 tx=0x7fba14005830 comp rx=0 tx=0).stop 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.197+0000 7fba2ddee640 1 -- 172.21.15.79:0/1777953979 shutdown_connections 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.197+0000 7fba2ddee640 1 --2- 172.21.15.79:0/1777953979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba140051c0 0x7fba1400b9c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.197+0000 7fba2ddee640 1 -- 172.21.15.79:0/1777953979 >> 172.21.15.79:0/1777953979 conn(0x7fba2809d3f0 msgr2=0x7fba280d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.197+0000 7fba2ddee640 1 -- 172.21.15.79:0/1777953979 shutdown_connections 2024-06-10T00:17:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.197+0000 7fba2ddee640 1 -- 172.21.15.79:0/1777953979 wait complete. 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.198+0000 7fba2ddee640 1 Processor -- start 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.198+0000 7fba2ddee640 1 -- start start 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba2ddee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140051c0 0x7fba281f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba2ddee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba281f8250 0x7fba280b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba2ddee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba281f40d0 0x7fba281f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba2ddee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba280d4f00 con 0x7fba281f40d0 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba2ddee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba280d1070 con 0x7fba281f8250 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba2ddee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba280d1870 con 0x7fba140051c0 2024-06-10T00:17:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba281f40d0 0x7fba281f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba281f40d0 0x7fba281f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59264/0 (socket says 172.21.15.79:59264) 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 -- 172.21.15.79:0/3816860814 learned_addr learned my addr 172.21.15.79:0/3816860814 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba26ffd640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba281f8250 0x7fba280b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba277fe640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140051c0 0x7fba281f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 -- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140051c0 msgr2=0x7fba281f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140051c0 0x7fba281f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 -- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba281f8250 msgr2=0x7fba280b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba281f8250 0x7fba280b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 -- 172.21.15.79:0/3816860814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba280c9ca0 con 0x7fba281f40d0 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba26ffd640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba281f8250 0x7fba280b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba27fff640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba281f40d0 0x7fba281f4560 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fba20000c00 tx=0x7fba280d4050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.199+0000 7fba1ffff640 1 -- 172.21.15.79:0/3816860814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20007d10 con 0x7fba281f40d0 2024-06-10T00:17:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.200+0000 7fba1ffff640 1 -- 172.21.15.79:0/3816860814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba20000ed0 con 0x7fba281f40d0 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.200+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba281f8730 con 0x7fba281f40d0 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.200+0000 7fba1ffff640 1 -- 172.21.15.79:0/3816860814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20007070 con 0x7fba281f40d0 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.200+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba281f8cf0 con 0x7fba281f40d0 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.200+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba28068430 con 0x7fba281f40d0 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.201+0000 7fba1ffff640 1 -- 172.21.15.79:0/3816860814 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba20044020 con 0x7fba281f40d0 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.201+0000 7fba1ffff640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba0806be60 0x7fba0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.202+0000 7fba1ffff640 1 -- 172.21.15.79:0/3816860814 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6101+0+0 (secure 0 0 0) 0x7fba200aabc0 con 0x7fba281f40d0 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.202+0000 7fba277fe640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba0806be60 0x7fba0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.202+0000 7fba277fe640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba0806be60 0x7fba0806e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fba280ca680 tx=0x7fba18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.206+0000 7fba1ffff640 1 -- 172.21.15.79:0/3816860814 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fba200794c0 con 0x7fba281f40d0 2024-06-10T00:17:18.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.381+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba28068bd0 con 0x7fba281f40d0 2024-06-10T00:17:18.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.382+0000 7fba1ffff640 1 -- 172.21.15.79:0/3816860814 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16849 (secure 0 0 0) 0x7fba200ae020 con 0x7fba281f40d0 2024-06-10T00:17:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:18.383 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":60,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:17:17.083093+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:17:14.757444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-06-10T00:17:16.061305+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:17:18.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba0806be60 msgr2=0x7fba0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba0806be60 0x7fba0806e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fba280ca680 tx=0x7fba18009040 comp rx=0 tx=0).stop 2024-06-10T00:17:18.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba281f40d0 msgr2=0x7fba281f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba281f40d0 0x7fba281f4560 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fba20000c00 tx=0x7fba280d4050 comp rx=0 tx=0).stop 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 shutdown_connections 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba0806be60 0x7fba0806e320 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba281f40d0 0x7fba281f4560 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba281f8250 0x7fba280b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.384+0000 7fba2ddee640 1 --2- 172.21.15.79:0/3816860814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba140051c0 0x7fba281f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.385+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 >> 172.21.15.79:0/3816860814 conn(0x7fba2809d3f0 msgr2=0x7fba280b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.385+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 shutdown_connections 2024-06-10T00:17:18.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.385+0000 7fba2ddee640 1 -- 172.21.15.79:0/3816860814 wait complete. 2024-06-10T00:17:18.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-10T00:17:18.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.497+0000 7f62889f4640 1 Processor -- start 2024-06-10T00:17:18.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.497+0000 7f62889f4640 1 -- start start 2024-06-10T00:17:18.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f62889f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 0x7f62840b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f62889f4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62840d0cd0 0x7f62840cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f62889f4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62840cf190 0x7f62840d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f62889f4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f62840d1c80 con 0x7f62840cf190 2024-06-10T00:17:18.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f62889f4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f62840cf620 con 0x7f62840d0cd0 2024-06-10T00:17:18.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f62889f4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62840cf8a0 con 0x7f62840d08f0 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f6282d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62840cf190 0x7f62840d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f6282d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62840cf190 0x7f62840d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59278/0 (socket says 172.21.15.79:59278) 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.498+0000 7f6282d9d640 1 -- 172.21.15.79:0/2472944540 learned_addr learned my addr 172.21.15.79:0/2472944540 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f6281d9b640 1 --2- 172.21.15.79:0/2472944540 >> v2:172.21.15.117:3300/0 conn(0x7f62840d0cd0 0x7f62840cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f628259c640 1 --2- 172.21.15.79:0/2472944540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 0x7f62840b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f6282d9d640 1 -- 172.21.15.79:0/2472944540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 msgr2=0x7f62840b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f6282d9d640 1 --2- 172.21.15.79:0/2472944540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 0x7f62840b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f6282d9d640 1 -- 172.21.15.79:0/2472944540 >> v2:172.21.15.117:3300/0 conn(0x7f62840d0cd0 msgr2=0x7f62840cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f6282d9d640 1 --2- 172.21.15.79:0/2472944540 >> v2:172.21.15.117:3300/0 conn(0x7f62840d0cd0 0x7f62840cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f6282d9d640 1 -- 172.21.15.79:0/2472944540 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62840cfb80 con 0x7f62840cf190 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f6282d9d640 1 --2- 172.21.15.79:0/2472944540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840cf190 0x7f62840d23f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f628406bcc0 tx=0x7f627c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a51b5d02baa057c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f628159a640 1 -- 172.21.15.79:0/2472944540 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c036070 con 0x7f62840cf190 2024-06-10T00:17:18.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f628159a640 1 -- 172.21.15.79:0/2472944540 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c031600 con 0x7f62840cf190 2024-06-10T00:17:18.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.499+0000 7f628159a640 1 -- 172.21.15.79:0/2472944540 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c0319d0 con 0x7f62840cf190 2024-06-10T00:17:18.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 -- 172.21.15.79:0/2472944540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840cf190 msgr2=0x7f62840d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 --2- 172.21.15.79:0/2472944540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840cf190 0x7f62840d23f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f628406bcc0 tx=0x7f627c02a6a0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 -- 172.21.15.79:0/2472944540 shutdown_connections 2024-06-10T00:17:18.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 --2- 172.21.15.79:0/2472944540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840cf190 0x7f62840d23f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 --2- 172.21.15.79:0/2472944540 >> v2:172.21.15.117:3300/0 conn(0x7f62840d0cd0 0x7f62840cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 --2- 172.21.15.79:0/2472944540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 0x7f62840b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 -- 172.21.15.79:0/2472944540 >> 172.21.15.79:0/2472944540 conn(0x7f628409d3c0 msgr2=0x7f62840d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 -- 172.21.15.79:0/2472944540 shutdown_connections 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.500+0000 7f62889f4640 1 -- 172.21.15.79:0/2472944540 wait complete. 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.501+0000 7f62889f4640 1 Processor -- start 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.501+0000 7f62889f4640 1 -- start start 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f62889f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62840cf190 0x7f62840c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f62889f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 0x7f62840ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f62889f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840d0cd0 0x7f62840cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f62889f4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62840b50c0 con 0x7f62840d0cd0 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f62889f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62840d1ed0 con 0x7f62840cf190 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f62889f4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62840d1150 con 0x7f62840d08f0 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f6282d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840d0cd0 0x7f62840cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f6282d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840d0cd0 0x7f62840cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59286/0 (socket says 172.21.15.79:59286) 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f6282d9d640 1 -- 172.21.15.79:0/727296284 learned_addr learned my addr 172.21.15.79:0/727296284 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f628259c640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62840cf190 0x7f62840c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.502+0000 7f6281d9b640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 0x7f62840ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6282d9d640 1 -- 172.21.15.79:0/727296284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 msgr2=0x7f62840ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6282d9d640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 0x7f62840ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6282d9d640 1 -- 172.21.15.79:0/727296284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62840cf190 msgr2=0x7f62840c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6282d9d640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62840cf190 0x7f62840c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6282d9d640 1 -- 172.21.15.79:0/727296284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62840cae80 con 0x7f62840d0cd0 2024-06-10T00:17:18.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6282d9d640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840d0cd0 0x7f62840cdcc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f627c009f40 tx=0x7f627c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6272ffd640 1 -- 172.21.15.79:0/727296284 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c036050 con 0x7f62840d0cd0 2024-06-10T00:17:18.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6272ffd640 1 -- 172.21.15.79:0/727296284 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c042070 con 0x7f62840d0cd0 2024-06-10T00:17:18.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62840c81b0 con 0x7f62840d0cd0 2024-06-10T00:17:18.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f6272ffd640 1 -- 172.21.15.79:0/727296284 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c009510 con 0x7f62840d0cd0 2024-06-10T00:17:18.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.503+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62840c8770 con 0x7f62840d0cd0 2024-06-10T00:17:18.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.504+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62840683c0 con 0x7f62840d0cd0 2024-06-10T00:17:18.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.504+0000 7f6272ffd640 1 -- 172.21.15.79:0/727296284 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f627c007bd0 con 0x7f62840d0cd0 2024-06-10T00:17:18.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.505+0000 7f6272ffd640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f626406be30 0x7f626406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.505+0000 7f6272ffd640 1 -- 172.21.15.79:0/727296284 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6101+0+0 (secure 0 0 0) 0x7f627c0abd40 con 0x7f62840d0cd0 2024-06-10T00:17:18.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.505+0000 7f628259c640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f626406be30 0x7f626406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.505+0000 7f628259c640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f626406be30 0x7f626406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6274006fd0 tx=0x7f6274008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.509+0000 7f6272ffd640 1 -- 172.21.15.79:0/727296284 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f627c079f10 con 0x7f62840d0cd0 2024-06-10T00:17:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.719+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f62840a1de0 con 0x7f62840d0cd0 2024-06-10T00:17:18.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.760+0000 7f6272ffd640 1 -- 172.21.15.79:0/727296284 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f627c07e210 con 0x7f62840d0cd0 2024-06-10T00:17:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f626406be30 msgr2=0x7f626406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f626406be30 0x7f626406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6274006fd0 tx=0x7f6274008040 comp rx=0 tx=0).stop 2024-06-10T00:17:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840d0cd0 msgr2=0x7f62840cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840d0cd0 0x7f62840cdcc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f627c009f40 tx=0x7f627c004a40 comp rx=0 tx=0).stop 2024-06-10T00:17:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 shutdown_connections 2024-06-10T00:17:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f626406be30 0x7f626406e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62840d0cd0 0x7f62840cdcc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840d08f0 0x7f62840ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 --2- 172.21.15.79:0/727296284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62840cf190 0x7f62840c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 >> 172.21.15.79:0/727296284 conn(0x7f628409d3c0 msgr2=0x7f62840d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:18.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 shutdown_connections 2024-06-10T00:17:18.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.762+0000 7f62889f4640 1 -- 172.21.15.79:0/727296284 wait complete. 2024-06-10T00:17:18.773 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-10T00:17:18.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-10T00:17:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.876+0000 7f222a0fc640 1 Processor -- start 2024-06-10T00:17:18.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.876+0000 7f222a0fc640 1 -- start start 2024-06-10T00:17:18.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.877+0000 7f222a0fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22240b2bf0 0x7f22240d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.877+0000 7f222a0fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22240d0560 0x7f222406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.877+0000 7f222a0fc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22240b3080 con 0x7f22240b3b40 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.877+0000 7f222a0fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f22240d09b0 con 0x7f22240d0560 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.877+0000 7f222a0fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f222415c870 con 0x7f22240b2bf0 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.877+0000 7f22237fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f22240b3b40 0x7f22240b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36416/0 (socket says 172.21.15.79:36416) 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.877+0000 7f22237fe640 1 -- 172.21.15.79:0/3301272904 learned_addr learned my addr 172.21.15.79:0/3301272904 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.877+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217229093 0 0) 0x7f22240b3080 con 0x7f22240b3b40 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2222ffd640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22240b2bf0 0x7f22240d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2223fff640 1 --2- 172.21.15.79:0/3301272904 >> v2:172.21.15.117:3300/0 conn(0x7f22240d0560 0x7f222406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f220c003520 con 0x7f22240b3b40 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 947808903 0 0) 0x7f220c003520 con 0x7f22240b3b40 2024-06-10T00:17:18.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22240b2bf0 msgr2=0x7f22240d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22240b2bf0 0x7f22240d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 >> v2:172.21.15.117:3300/0 conn(0x7f22240d0560 msgr2=0x7f222406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 --2- 172.21.15.79:0/3301272904 >> v2:172.21.15.117:3300/0 conn(0x7f22240d0560 0x7f222406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222415cb50 con 0x7f22240b3b40 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f2214001670 con 0x7f22240b3b40 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 >> v1:172.21.15.79:6789/0 conn(0x7f22240b3b40 legacy=0x7f22240b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22240b2bf0 0x7f220c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f220c003f30 0x7f220c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f220c004d40 0x7f220c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22240d09b0 con 0x7f220c004d40 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f222415c870 con 0x7f220c003f30 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f220c00b9c0 con 0x7f22240b2bf0 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2223fff640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f220c004d40 0x7f220c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f22237fe640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22240b2bf0 0x7f220c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2222ffd640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f220c003f30 0x7f220c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2223fff640 1 -- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22240b2bf0 msgr2=0x7f220c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2223fff640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22240b2bf0 0x7f220c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2223fff640 1 -- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f220c003f30 msgr2=0x7f220c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2223fff640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f220c003f30 0x7f220c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.878+0000 7f2223fff640 1 -- 172.21.15.79:0/3301272904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220c003520 con 0x7f220c004d40 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.879+0000 7f2223fff640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f220c004d40 0x7f220c0051c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f221c009fc0 tx=0x7f220c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6640ae66aa6cfd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.879+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c009c10 con 0x7f220c004d40 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.879+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c036070 con 0x7f220c004d40 2024-06-10T00:17:18.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.879+0000 7f22227fc640 1 -- 172.21.15.79:0/3301272904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c02d070 con 0x7f220c004d40 2024-06-10T00:17:18.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.880+0000 7f222a0fc640 1 -- 172.21.15.79:0/3301272904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f220c004d40 msgr2=0x7f220c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.880+0000 7f222a0fc640 1 --2- 172.21.15.79:0/3301272904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f220c004d40 0x7f220c0051c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f221c009fc0 tx=0x7f220c005830 comp rx=0 tx=0).stop 2024-06-10T00:17:18.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.880+0000 7f2223fff640 1 -- 172.21.15.79:0/3301272904 reap_dead start 2024-06-10T00:17:18.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.880+0000 7f222a0fc640 1 -- 172.21.15.79:0/3301272904 shutdown_connections 2024-06-10T00:17:18.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.880+0000 7f222a0fc640 1 -- 172.21.15.79:0/3301272904 >> 172.21.15.79:0/3301272904 conn(0x7f22240b1d10 msgr2=0x7f22240b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:18.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.880+0000 7f222a0fc640 1 -- 172.21.15.79:0/3301272904 shutdown_connections 2024-06-10T00:17:18.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.880+0000 7f222a0fc640 1 -- 172.21.15.79:0/3301272904 wait complete. 2024-06-10T00:17:18.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.881+0000 7f222a0fc640 1 Processor -- start 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.881+0000 7f222a0fc640 1 -- start start 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f222a0fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f220c004d40 0x7f2224149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f222a0fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f222414bb40 0x7f222414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f222a0fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22240cba30 0x7f22240cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f222a0fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f222415d3f0 con 0x7f222414bb40 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f222a0fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f222415d110 con 0x7f22240cba30 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f222a0fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22240b3f20 con 0x7f220c004d40 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f222414bb40 0x7f222414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f222414bb40 0x7f222414bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59300/0 (socket says 172.21.15.79:59300) 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 -- 172.21.15.79:0/879239119 learned_addr learned my addr 172.21.15.79:0/879239119 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 -- 172.21.15.79:0/879239119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f220c004d40 msgr2=0x7f2224149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f220c004d40 0x7f2224149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 -- 172.21.15.79:0/879239119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22240cba30 msgr2=0x7f22240cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2223fff640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22240cba30 0x7f22240cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22240cba30 0x7f22240cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 -- 172.21.15.79:0/879239119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22241497a0 con 0x7f222414bb40 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f2222ffd640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f222414bb40 0x7f222414bfa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2218011940 tx=0x7f2218011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f220bfff640 1 -- 172.21.15.79:0/879239119 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221800faf0 con 0x7f222414bb40 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f220bfff640 1 -- 172.21.15.79:0/879239119 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221800fc90 con 0x7f222414bb40 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222414c600 con 0x7f222414bb40 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.882+0000 7f220bfff640 1 -- 172.21.15.79:0/879239119 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218014440 con 0x7f222414bb40 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.883+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22240cb230 con 0x7f222414bb40 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.884+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22240ade00 con 0x7f222414bb40 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.884+0000 7f220bfff640 1 -- 172.21.15.79:0/879239119 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2218012040 con 0x7f222414bb40 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.884+0000 7f220bfff640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f221006be30 0x7f221006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:18.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.885+0000 7f220bfff640 1 -- 172.21.15.79:0/879239119 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f221808b670 con 0x7f222414bb40 2024-06-10T00:17:18.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.885+0000 7f22237fe640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f221006be30 0x7f221006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:18.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.885+0000 7f22237fe640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f221006be30 0x7f221006e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2214001be0 tx=0x7f2214001b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:18.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:18.889+0000 7f220bfff640 1 -- 172.21.15.79:0/879239119 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f22240ade00 con 0x7f222414bb40 2024-06-10T00:17:19.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.102+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f22240683c0 con 0x7f222414bb40 2024-06-10T00:17:19.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.767+0000 7f220bfff640 1 -- 172.21.15.79:0/879239119 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7f2218019030 con 0x7f222414bb40 2024-06-10T00:17:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f221006be30 msgr2=0x7f221006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f221006be30 0x7f221006e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2214001be0 tx=0x7f2214001b70 comp rx=0 tx=0).stop 2024-06-10T00:17:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f222414bb40 msgr2=0x7f222414bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f222414bb40 0x7f222414bfa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2218011940 tx=0x7f2218011e00 comp rx=0 tx=0).stop 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 shutdown_connections 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f221006be30 0x7f221006e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22240cba30 0x7f22240cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f222414bb40 0x7f222414bfa0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 --2- 172.21.15.79:0/879239119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f220c004d40 0x7f2224149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.769+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 >> 172.21.15.79:0/879239119 conn(0x7f22240b1d10 msgr2=0x7f22240b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.770+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 shutdown_connections 2024-06-10T00:17:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.770+0000 7f222a0fc640 1 -- 172.21.15.79:0/879239119 wait complete. 2024-06-10T00:17:19.781 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-10T00:17:19.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:19.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.882+0000 7f86e05e9640 1 Processor -- start 2024-06-10T00:17:19.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.882+0000 7f86e05e9640 1 -- start start 2024-06-10T00:17:19.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86e05e9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86d80cc6d0 0x7f86d80ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86e05e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d8071c60 0x7f86d80720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86e05e9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d80ccff0 con 0x7f86d80b36c0 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86e05e9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f86d8072820 con 0x7f86d80cc6d0 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86e05e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86d8072b00 con 0x7f86d8071c60 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86deb86640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f86d80b36c0 0x7f86d80b3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36432/0 (socket says 172.21.15.79:36432) 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86deb86640 1 -- 172.21.15.79:0/3491062210 learned_addr learned my addr 172.21.15.79:0/3491062210 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86ddb84640 1 --2- 172.21.15.79:0/3491062210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d8071c60 0x7f86d80720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.883+0000 7f86de385640 1 --2- 172.21.15.79:0/3491062210 >> v2:172.21.15.117:3300/0 conn(0x7f86d80cc6d0 0x7f86d80ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.884+0000 7f86dd383640 1 -- 172.21.15.79:0/3491062210 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536134339 0 0) 0x7f86d80ccff0 con 0x7f86d80b36c0 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.884+0000 7f86dd383640 1 -- 172.21.15.79:0/3491062210 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86c4003520 con 0x7f86d80b36c0 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.884+0000 7f86ddb84640 1 -- 172.21.15.79:0/3491062210 >> v2:172.21.15.117:3300/0 conn(0x7f86d80cc6d0 msgr2=0x7f86d80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:19.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.884+0000 7f86ddb84640 1 --2- 172.21.15.79:0/3491062210 >> v2:172.21.15.117:3300/0 conn(0x7f86d80cc6d0 0x7f86d80ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.884+0000 7f86ddb84640 1 -- 172.21.15.79:0/3491062210 >> v1:172.21.15.79:6789/0 conn(0x7f86d80b36c0 legacy=0x7f86d80b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:19.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.884+0000 7f86ddb84640 1 -- 172.21.15.79:0/3491062210 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d8072de0 con 0x7f86d8071c60 2024-06-10T00:17:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86ddb84640 1 --2- 172.21.15.79:0/3491062210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d8071c60 0x7f86d80720e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f86c80097a0 tx=0x7f86c802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8927d94009b2e4bb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86dd383640 1 -- 172.21.15.79:0/3491062210 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8037070 con 0x7f86d8071c60 2024-06-10T00:17:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86dd383640 1 -- 172.21.15.79:0/3491062210 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8032440 con 0x7f86d8071c60 2024-06-10T00:17:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86dd383640 1 -- 172.21.15.79:0/3491062210 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c80327f0 con 0x7f86d8071c60 2024-06-10T00:17:19.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86e05e9640 1 -- 172.21.15.79:0/3491062210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d8071c60 msgr2=0x7f86d80720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86e05e9640 1 --2- 172.21.15.79:0/3491062210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d8071c60 0x7f86d80720e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f86c80097a0 tx=0x7f86c802a180 comp rx=0 tx=0).stop 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86e05e9640 1 -- 172.21.15.79:0/3491062210 shutdown_connections 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86e05e9640 1 --2- 172.21.15.79:0/3491062210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d8071c60 0x7f86d80720e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86e05e9640 1 --2- 172.21.15.79:0/3491062210 >> v2:172.21.15.117:3300/0 conn(0x7f86d80cc6d0 0x7f86d80ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86e05e9640 1 -- 172.21.15.79:0/3491062210 >> 172.21.15.79:0/3491062210 conn(0x7f86d80b19f0 msgr2=0x7f86d80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86e05e9640 1 -- 172.21.15.79:0/3491062210 shutdown_connections 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.885+0000 7f86e05e9640 1 -- 172.21.15.79:0/3491062210 wait complete. 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86e05e9640 1 Processor -- start 2024-06-10T00:17:19.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86e05e9640 1 -- start start 2024-06-10T00:17:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86e05e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d8071c60 0x7f86d80d0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86e05e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86d80b36c0 0x7f86d8146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86e05e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d80cc6d0 0x7f86d80afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86e05e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f86d8159f60 con 0x7f86d80b36c0 2024-06-10T00:17:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86e05e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86d815c890 con 0x7f86d8071c60 2024-06-10T00:17:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86e05e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86d80b4240 con 0x7f86d80cc6d0 2024-06-10T00:17:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86ddb84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86d80b36c0 0x7f86d8146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86ddb84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86d80b36c0 0x7f86d8146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59314/0 (socket says 172.21.15.79:59314) 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.887+0000 7f86ddb84640 1 -- 172.21.15.79:0/1504779369 learned_addr learned my addr 172.21.15.79:0/1504779369 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86deb86640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d80cc6d0 0x7f86d80afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ddb84640 1 -- 172.21.15.79:0/1504779369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d80cc6d0 msgr2=0x7f86d80afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86de385640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d8071c60 0x7f86d80d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ddb84640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d80cc6d0 0x7f86d80afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ddb84640 1 -- 172.21.15.79:0/1504779369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d8071c60 msgr2=0x7f86d80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ddb84640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d8071c60 0x7f86d80d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ddb84640 1 -- 172.21.15.79:0/1504779369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d815a7c0 con 0x7f86d80b36c0 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ddb84640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86d80b36c0 0x7f86d8146590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f86c802a1c0 tx=0x7f86c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ceffd640 1 -- 172.21.15.79:0/1504779369 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8037040 con 0x7f86d80b36c0 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ceffd640 1 -- 172.21.15.79:0/1504779369 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8042070 con 0x7f86d80b36c0 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d815aaa0 con 0x7f86d80b36c0 2024-06-10T00:17:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86ceffd640 1 -- 172.21.15.79:0/1504779369 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c803b930 con 0x7f86d80b36c0 2024-06-10T00:17:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.888+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d815b060 con 0x7f86d80b36c0 2024-06-10T00:17:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.889+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d8068430 con 0x7f86d80b36c0 2024-06-10T00:17:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.890+0000 7f86ceffd640 1 -- 172.21.15.79:0/1504779369 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86c803bad0 con 0x7f86d80b36c0 2024-06-10T00:17:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.890+0000 7f86ceffd640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86bc06be30 0x7f86bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.890+0000 7f86ceffd640 1 -- 172.21.15.79:0/1504779369 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f86c80ab890 con 0x7f86d80b36c0 2024-06-10T00:17:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.890+0000 7f86de385640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86bc06be30 0x7f86bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.890+0000 7f86de385640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86bc06be30 0x7f86bc06e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009970 tx=0x7f86d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:19.894+0000 7f86ceffd640 1 -- 172.21.15.79:0/1504779369 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f86c807a1d0 con 0x7f86d80b36c0 2024-06-10T00:17:20.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.106+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86d80b3fd0 con 0x7f86d80b36c0 2024-06-10T00:17:20.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.106+0000 7f86ceffd640 1 -- 172.21.15.79:0/1504779369 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5185 (secure 0 0 0) 0x7f86c8079ad0 con 0x7f86d80b36c0 2024-06-10T00:17:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:20.107 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:17:19.103976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:17:20.109 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 29 2024-06-10T00:17:20.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86bc06be30 msgr2=0x7f86bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86bc06be30 0x7f86bc06e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009970 tx=0x7f86d4008040 comp rx=0 tx=0).stop 2024-06-10T00:17:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86d80b36c0 msgr2=0x7f86d8146590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86d80b36c0 0x7f86d8146590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f86c802a1c0 tx=0x7f86c80046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 shutdown_connections 2024-06-10T00:17:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86bc06be30 0x7f86bc06e2f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d80cc6d0 0x7f86d80afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86d80b36c0 0x7f86d8146590 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 --2- 172.21.15.79:0/1504779369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d8071c60 0x7f86d80d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 >> 172.21.15.79:0/1504779369 conn(0x7f86d80b19f0 msgr2=0x7f86d8072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.108+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 shutdown_connections 2024-06-10T00:17:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.109+0000 7f86e05e9640 1 -- 172.21.15.79:0/1504779369 wait complete. 2024-06-10T00:17:20.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:17:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.219+0000 7fb79df09640 1 Processor -- start 2024-06-10T00:17:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.219+0000 7fb79df09640 1 -- start start 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb79df09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7980cc6d0 0x7fb7980ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb79df09640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb798071c60 0x7fb798072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb79df09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7980ccff0 con 0x7fb7980b36c0 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb79df09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb798072820 con 0x7fb7980cc6d0 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb79df09640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb798072b00 con 0x7fb798071c60 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb7977fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7980cc6d0 0x7fb7980ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb797fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb7980b36c0 0x7fb7980b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36442/0 (socket says 172.21.15.79:36442) 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb797fff640 1 -- 172.21.15.79:0/3064422418 learned_addr learned my addr 172.21.15.79:0/3064422418 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb796ffd640 1 --2- 172.21.15.79:0/3064422418 >> v2:172.21.15.117:3300/0 conn(0x7fb798071c60 0x7fb798072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb7977fe640 1 -- 172.21.15.79:0/3064422418 >> v2:172.21.15.117:3300/0 conn(0x7fb798071c60 msgr2=0x7fb798072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb7977fe640 1 --2- 172.21.15.79:0/3064422418 >> v2:172.21.15.117:3300/0 conn(0x7fb798071c60 0x7fb798072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb7977fe640 1 -- 172.21.15.79:0/3064422418 >> v1:172.21.15.79:6789/0 conn(0x7fb7980b36c0 legacy=0x7fb7980b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb7967fc640 1 -- 172.21.15.79:0/3064422418 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372153444 0 0) 0x7fb7980ccff0 con 0x7fb7980b36c0 2024-06-10T00:17:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.220+0000 7fb7977fe640 1 -- 172.21.15.79:0/3064422418 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb798072de0 con 0x7fb7980cc6d0 2024-06-10T00:17:20.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.221+0000 7fb7977fe640 1 --2- 172.21.15.79:0/3064422418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980ccab0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb7980b51c0 tx=0x7fb78802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc7fb3c0561046e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.221+0000 7fb7967fc640 1 -- 172.21.15.79:0/3064422418 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788037070 con 0x7fb7980cc6d0 2024-06-10T00:17:20.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.221+0000 7fb7967fc640 1 -- 172.21.15.79:0/3064422418 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb788032440 con 0x7fb7980cc6d0 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.221+0000 7fb7967fc640 1 -- 172.21.15.79:0/3064422418 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788032810 con 0x7fb7980cc6d0 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.222+0000 7fb79df09640 1 -- 172.21.15.79:0/3064422418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 msgr2=0x7fb7980ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.222+0000 7fb79df09640 1 --2- 172.21.15.79:0/3064422418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980ccab0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb7980b51c0 tx=0x7fb78802a1a0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.222+0000 7fb79df09640 1 -- 172.21.15.79:0/3064422418 shutdown_connections 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.222+0000 7fb79df09640 1 --2- 172.21.15.79:0/3064422418 >> v2:172.21.15.117:3300/0 conn(0x7fb798071c60 0x7fb798072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.222+0000 7fb79df09640 1 --2- 172.21.15.79:0/3064422418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980ccab0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.222+0000 7fb79df09640 1 -- 172.21.15.79:0/3064422418 >> 172.21.15.79:0/3064422418 conn(0x7fb7980b19f0 msgr2=0x7fb7980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.222+0000 7fb79df09640 1 -- 172.21.15.79:0/3064422418 shutdown_connections 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.222+0000 7fb79df09640 1 -- 172.21.15.79:0/3064422418 wait complete. 2024-06-10T00:17:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.223+0000 7fb79df09640 1 Processor -- start 2024-06-10T00:17:20.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.223+0000 7fb79df09640 1 -- start start 2024-06-10T00:17:20.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb79df09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb798071c60 0x7fb79806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb79df09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7980b36c0 0x7fb79814c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb79df09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb79df09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb798159f60 con 0x7fb7980cc6d0 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb79df09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb79815c890 con 0x7fb7980b36c0 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb79df09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb7980b4200 con 0x7fb798071c60 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59324/0 (socket says 172.21.15.79:59324) 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 -- 172.21.15.79:0/392805353 learned_addr learned my addr 172.21.15.79:0/392805353 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb796ffd640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7980b36c0 0x7fb79814c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb7977fe640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb798071c60 0x7fb79806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 -- 172.21.15.79:0/392805353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb798071c60 msgr2=0x7fb79806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb798071c60 0x7fb79806d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 -- 172.21.15.79:0/392805353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7980b36c0 msgr2=0x7fb79814c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7980b36c0 0x7fb79814c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 -- 172.21.15.79:0/392805353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79806dec0 con 0x7fb7980cc6d0 2024-06-10T00:17:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.224+0000 7fb797fff640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980cfe80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb79000c7a0 tx=0x7fb79000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.225+0000 7fb77ffff640 1 -- 172.21.15.79:0/392805353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790018070 con 0x7fb7980cc6d0 2024-06-10T00:17:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.225+0000 7fb77ffff640 1 -- 172.21.15.79:0/392805353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79000a640 con 0x7fb7980cc6d0 2024-06-10T00:17:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.225+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79806e1a0 con 0x7fb7980cc6d0 2024-06-10T00:17:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.225+0000 7fb77ffff640 1 -- 172.21.15.79:0/392805353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79000aa70 con 0x7fb7980cc6d0 2024-06-10T00:17:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.225+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb798153d80 con 0x7fb7980cc6d0 2024-06-10T00:17:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.226+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb798068430 con 0x7fb7980cc6d0 2024-06-10T00:17:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.226+0000 7fb77ffff640 1 -- 172.21.15.79:0/392805353 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb79001b070 con 0x7fb7980cc6d0 2024-06-10T00:17:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.227+0000 7fb77ffff640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb78406be30 0x7fb78406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.227+0000 7fb7977fe640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb78406be30 0x7fb78406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.227+0000 7fb77ffff640 1 -- 172.21.15.79:0/392805353 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7fb79008a5b0 con 0x7fb7980cc6d0 2024-06-10T00:17:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.227+0000 7fb7977fe640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb78406be30 0x7fb78406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb788034000 tx=0x7fb78802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.231+0000 7fb77ffff640 1 -- 172.21.15.79:0/392805353 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb790058e60 con 0x7fb7980cc6d0 2024-06-10T00:17:20.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.406+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb79806e6c0 con 0x7fb7980cc6d0 2024-06-10T00:17:20.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.407+0000 7fb77ffff640 1 -- 172.21.15.79:0/392805353 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16836 (secure 0 0 0) 0x7fb790058760 con 0x7fb7980cc6d0 2024-06-10T00:17:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:20.407 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:17:18.748840+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:17:14.757444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-06-10T00:17:16.061305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:17:20.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb78406be30 msgr2=0x7fb78406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb78406be30 0x7fb78406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb788034000 tx=0x7fb78802e000 comp rx=0 tx=0).stop 2024-06-10T00:17:20.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 msgr2=0x7fb7980cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980cfe80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb79000c7a0 tx=0x7fb79000cc60 comp rx=0 tx=0).stop 2024-06-10T00:17:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 shutdown_connections 2024-06-10T00:17:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb78406be30 0x7fb78406e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980cc6d0 0x7fb7980cfe80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7980b36c0 0x7fb79814c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 --2- 172.21.15.79:0/392805353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb798071c60 0x7fb79806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 >> 172.21.15.79:0/392805353 conn(0x7fb7980b19f0 msgr2=0x7fb79815dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 shutdown_connections 2024-06-10T00:17:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.409+0000 7fb79df09640 1 -- 172.21.15.79:0/392805353 wait complete. 2024-06-10T00:17:20.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:17:20.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:17:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.522+0000 7f12420f5640 1 Processor -- start 2024-06-10T00:17:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.522+0000 7f12420f5640 1 -- start start 2024-06-10T00:17:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.522+0000 7f12420f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c161830 0x7f123c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.522+0000 7f12420f5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f123c0d1110 0x7f123c0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.522+0000 7f12420f5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123c0cebb0 con 0x7f123c161c10 2024-06-10T00:17:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.522+0000 7f12420f5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f123c0d4cf0 con 0x7f123c0d1110 2024-06-10T00:17:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.522+0000 7f12420f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f123c0d2fc0 con 0x7f123c161830 2024-06-10T00:17:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f123c161c10 0x7f123c0d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36454/0 (socket says 172.21.15.79:36454) 2024-06-10T00:17:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123affd640 1 -- 172.21.15.79:0/1214034040 learned_addr learned my addr 172.21.15.79:0/1214034040 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123bfff640 1 --2- 172.21.15.79:0/1214034040 >> v2:172.21.15.117:3300/0 conn(0x7f123c0d1110 0x7f123c0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123b7fe640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c161830 0x7f123c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265672928 0 0) 0x7f123c0cebb0 con 0x7f123c161c10 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1224003520 con 0x7f123c161c10 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4283253774 0 0) 0x7f1224003520 con 0x7f123c161c10 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c161830 msgr2=0x7f123c0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c161830 0x7f123c0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 >> v2:172.21.15.117:3300/0 conn(0x7f123c0d1110 msgr2=0x7f123c0d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 --2- 172.21.15.79:0/1214034040 >> v2:172.21.15.117:3300/0 conn(0x7f123c0d1110 0x7f123c0d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c0d4f20 con 0x7f123c161c10 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f1230001670 con 0x7f123c161c10 2024-06-10T00:17:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123bfff640 1 --2- 172.21.15.79:0/1214034040 >> v2:172.21.15.117:3300/0 conn(0x7f123c0d1110 0x7f123c0d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 >> v1:172.21.15.79:6789/0 conn(0x7f123c161c10 legacy=0x7f123c0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c161830 0x7f12240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1224003f30 0x7f1224004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1224004d40 0x7f12240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f123c0d2fc0 con 0x7f1224004d40 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f122400b9c0 con 0x7f1224003f30 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f122400bb40 con 0x7f123c161830 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123bfff640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1224004d40 0x7f12240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123affd640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1224003f30 0x7f1224004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.523+0000 7f123b7fe640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c161830 0x7f12240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123bfff640 1 -- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c161830 msgr2=0x7f12240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123bfff640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c161830 0x7f12240039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123bfff640 1 -- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1224003f30 msgr2=0x7f1224004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123bfff640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1224003f30 0x7f1224004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123bfff640 1 -- 172.21.15.79:0/1214034040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1224003520 con 0x7f1224004d40 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123bfff640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1224004d40 0x7f12240051c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f123c08d360 tx=0x7f1224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d38fb06fb142d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234033070 con 0x7f1224004d40 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123402f670 con 0x7f1224004d40 2024-06-10T00:17:20.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.524+0000 7f123a7fc640 1 -- 172.21.15.79:0/1214034040 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234009de0 con 0x7f1224004d40 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.525+0000 7f12420f5640 1 -- 172.21.15.79:0/1214034040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1224004d40 msgr2=0x7f12240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.525+0000 7f12420f5640 1 --2- 172.21.15.79:0/1214034040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1224004d40 0x7f12240051c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f123c08d360 tx=0x7f1224005830 comp rx=0 tx=0).stop 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.525+0000 7f123bfff640 1 -- 172.21.15.79:0/1214034040 reap_dead start 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.525+0000 7f12420f5640 1 -- 172.21.15.79:0/1214034040 shutdown_connections 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.525+0000 7f12420f5640 1 -- 172.21.15.79:0/1214034040 >> 172.21.15.79:0/1214034040 conn(0x7f123c09d3e0 msgr2=0x7f123c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.525+0000 7f12420f5640 1 -- 172.21.15.79:0/1214034040 shutdown_connections 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.525+0000 7f12420f5640 1 -- 172.21.15.79:0/1214034040 wait complete. 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.526+0000 7f12420f5640 1 Processor -- start 2024-06-10T00:17:20.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.526+0000 7f12420f5640 1 -- start start 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f12420f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1224004d40 0x7f123c1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f12420f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c1f8280 0x7f123c0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f12420f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f123c0cf530 0x7f123c1f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f12420f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f123c0d2ce0 con 0x7f123c0cf530 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f12420f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f123c0d2a00 con 0x7f123c1f8280 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f12420f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f123c0c7bf0 con 0x7f1224004d40 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f123bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f123c0cf530 0x7f123c1f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f123bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f123c0cf530 0x7f123c1f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59342/0 (socket says 172.21.15.79:59342) 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f123bfff640 1 -- 172.21.15.79:0/942159520 learned_addr learned my addr 172.21.15.79:0/942159520 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f123b7fe640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1224004d40 0x7f123c1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.527+0000 7f123affd640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c1f8280 0x7f123c0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f123bfff640 1 -- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1224004d40 msgr2=0x7f123c1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f123bfff640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1224004d40 0x7f123c1556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f123bfff640 1 -- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c1f8280 msgr2=0x7f123c0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f123bfff640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c1f8280 0x7f123c0ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f123bfff640 1 -- 172.21.15.79:0/942159520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c1f4d60 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f123affd640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c1f8280 0x7f123c0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f123bfff640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f123c0cf530 0x7f123c1f4000 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f123400e3e0 tx=0x7f1234009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f1223fff640 1 -- 172.21.15.79:0/942159520 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234033040 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f1223fff640 1 -- 172.21.15.79:0/942159520 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123402f470 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c1f77a0 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f1223fff640 1 -- 172.21.15.79:0/942159520 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234009de0 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.528+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c155c20 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.529+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123c068430 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.529+0000 7f1223fff640 1 -- 172.21.15.79:0/942159520 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f123404a020 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.530+0000 7f1223fff640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f122806be60 0x7f122806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.530+0000 7f1223fff640 1 -- 172.21.15.79:0/942159520 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f12340abde0 con 0x7f123c0cf530 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.530+0000 7f123b7fe640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f122806be60 0x7f122806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.530+0000 7f123b7fe640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f122806be60 0x7f122806e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f122c009bc0 tx=0x7f122c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.534+0000 7f1223fff640 1 -- 172.21.15.79:0/942159520 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f123407a720 con 0x7f123c0cf530 2024-06-10T00:17:20.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.704+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f123c06d8f0 con 0x7f122806be60 2024-06-10T00:17:20.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.710+0000 7f1223fff640 1 -- 172.21.15.79:0/942159520 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239886 (secure 0 0 0) 0x7f123c06d8f0 con 0x7f122806be60 2024-06-10T00:17:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:20.714 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:17:20.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f122806be60 msgr2=0x7f122806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f122806be60 0x7f122806e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f122c009bc0 tx=0x7f122c009190 comp rx=0 tx=0).stop 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f123c0cf530 msgr2=0x7f123c1f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f123c0cf530 0x7f123c1f4000 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f123400e3e0 tx=0x7f1234009750 comp rx=0 tx=0).stop 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 shutdown_connections 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f122806be60 0x7f122806e320 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f123c0cf530 0x7f123c1f4000 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c1f8280 0x7f123c0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 --2- 172.21.15.79:0/942159520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1224004d40 0x7f123c1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 >> 172.21.15.79:0/942159520 conn(0x7f123c09d3e0 msgr2=0x7f123c0cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 shutdown_connections 2024-06-10T00:17:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.713+0000 7f12420f5640 1 -- 172.21.15.79:0/942159520 wait complete. 2024-06-10T00:17:20.724 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-06-10T00:17:19.179772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222784,"kb_used_data":6596,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751936,"statfs":{"total":773094113280,"available":772865982464,"internally_reserved":0,"allocated":6754304,"data_stored":3645349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000868"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731240+0000","last_change":"2024-06-10T00:17:15.731240+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731240+0000","last_undegraded":"2024-06-10T00:17:15.731240+0000","last_fullsized":"2024-06-10T00:17:15.731240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739155+0000","last_change":"2024-06-10T00:17:15.739155+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739155+0000","last_undegraded":"2024-06-10T00:17:15.739155+0000","last_fullsized":"2024-06-10T00:17:15.739155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739628+0000","last_change":"2024-06-10T00:17:15.739628+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739628+0000","last_undegraded":"2024-06-10T00:17:15.739628+0000","last_fullsized":"2024-06-10T00:17:15.739628+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739149+0000","last_change":"2024-06-10T00:17:15.739149+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739149+0000","last_undegraded":"2024-06-10T00:17:15.739149+0000","last_fullsized":"2024-06-10T00:17:15.739149+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735493+0000","last_change":"2024-06-10T00:17:15.735493+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735493+0000","last_undegraded":"2024-06-10T00:17:15.735493+0000","last_fullsized":"2024-06-10T00:17:15.735493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.736410+0000","last_change":"2024-06-10T00:17:15.736410+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.736410+0000","last_undegraded":"2024-06-10T00:17:15.736410+0000","last_fullsized":"2024-06-10T00:17:15.736410+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.736423+0000","last_change":"2024-06-10T00:17:15.736423+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.736423+0000","last_undegraded":"2024-06-10T00:17:15.736423+0000","last_fullsized":"2024-06-10T00:17:15.736423+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729426+0000","last_change":"2024-06-10T00:17:15.729426+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729426+0000","last_undegraded":"2024-06-10T00:17:15.729426+0000","last_fullsized":"2024-06-10T00:17:15.729426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731771+0000","last_change":"2024-06-10T00:17:15.731771+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731771+0000","last_undegraded":"2024-06-10T00:17:15.731771+0000","last_fullsized":"2024-06-10T00:17:15.731771+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729391+0000","last_change":"2024-06-10T00:17:15.729391+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729391+0000","last_undegraded":"2024-06-10T00:17:15.729391+0000","last_fullsized":"2024-06-10T00:17:15.729391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731994+0000","last_change":"2024-06-10T00:17:15.731994+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731994+0000","last_undegraded":"2024-06-10T00:17:15.731994+0000","last_fullsized":"2024-06-10T00:17:15.731994+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731720+0000","last_change":"2024-06-10T00:17:15.731720+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731720+0000","last_undegraded":"2024-06-10T00:17:15.731720+0000","last_fullsized":"2024-06-10T00:17:15.731720+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731874+0000","last_change":"2024-06-10T00:17:15.731874+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731874+0000","last_undegraded":"2024-06-10T00:17:15.731874+0000","last_fullsized":"2024-06-10T00:17:15.731874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741625+0000","last_change":"2024-06-10T00:17:15.741625+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741625+0000","last_undegraded":"2024-06-10T00:17:15.741625+0000","last_fullsized":"2024-06-10T00:17:15.741625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731362+0000","last_change":"2024-06-10T00:17:15.731362+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731362+0000","last_undegraded":"2024-06-10T00:17:15.731362+0000","last_fullsized":"2024-06-10T00:17:15.731362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729386+0000","last_change":"2024-06-10T00:17:15.729386+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729386+0000","last_undegraded":"2024-06-10T00:17:15.729386+0000","last_fullsized":"2024-06-10T00:17:15.729386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741579+0000","last_change":"2024-06-10T00:17:15.741579+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741579+0000","last_undegraded":"2024-06-10T00:17:15.741579+0000","last_fullsized":"2024-06-10T00:17:15.741579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731387+0000","last_change":"2024-06-10T00:17:15.731387+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731387+0000","last_undegraded":"2024-06-10T00:17:15.731387+0000","last_fullsized":"2024-06-10T00:17:15.731387+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731346+0000","last_change":"2024-06-10T00:17:15.731346+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731346+0000","last_undegraded":"2024-06-10T00:17:15.731346+0000","last_fullsized":"2024-06-10T00:17:15.731346+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735622+0000","last_change":"2024-06-10T00:17:15.735622+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735622+0000","last_undegraded":"2024-06-10T00:17:15.735622+0000","last_fullsized":"2024-06-10T00:17:15.735622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739167+0000","last_change":"2024-06-10T00:17:15.739167+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739167+0000","last_undegraded":"2024-06-10T00:17:15.739167+0000","last_fullsized":"2024-06-10T00:17:15.739167+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741074+0000","last_change":"2024-06-10T00:17:15.741074+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741074+0000","last_undegraded":"2024-06-10T00:17:15.741074+0000","last_fullsized":"2024-06-10T00:17:15.741074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739215+0000","last_change":"2024-06-10T00:17:15.739215+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739215+0000","last_undegraded":"2024-06-10T00:17:15.739215+0000","last_fullsized":"2024-06-10T00:17:15.739215+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741073+0000","last_change":"2024-06-10T00:17:15.741073+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741073+0000","last_undegraded":"2024-06-10T00:17:15.741073+0000","last_fullsized":"2024-06-10T00:17:15.741073+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741026+0000","last_change":"2024-06-10T00:17:15.741026+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741026+0000","last_undegraded":"2024-06-10T00:17:15.741026+0000","last_fullsized":"2024-06-10T00:17:15.741026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739172+0000","last_change":"2024-06-10T00:17:15.739172+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739172+0000","last_undegraded":"2024-06-10T00:17:15.739172+0000","last_fullsized":"2024-06-10T00:17:15.739172+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731269+0000","last_change":"2024-06-10T00:17:15.731269+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731269+0000","last_undegraded":"2024-06-10T00:17:15.731269+0000","last_fullsized":"2024-06-10T00:17:15.731269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731377+0000","last_change":"2024-06-10T00:17:15.731377+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731377+0000","last_undegraded":"2024-06-10T00:17:15.731377+0000","last_fullsized":"2024-06-10T00:17:15.731377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735586+0000","last_change":"2024-06-10T00:17:15.735586+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735586+0000","last_undegraded":"2024-06-10T00:17:15.735586+0000","last_fullsized":"2024-06-10T00:17:15.735586+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735546+0000","last_change":"2024-06-10T00:17:15.735546+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735546+0000","last_undegraded":"2024-06-10T00:17:15.735546+0000","last_fullsized":"2024-06-10T00:17:15.735546+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731269+0000","last_change":"2024-06-10T00:17:15.731269+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731269+0000","last_undegraded":"2024-06-10T00:17:15.731269+0000","last_fullsized":"2024-06-10T00:17:15.731269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735562+0000","last_change":"2024-06-10T00:17:15.735562+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735562+0000","last_undegraded":"2024-06-10T00:17:15.735562+0000","last_fullsized":"2024-06-10T00:17:15.735562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":238,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-10T00:17:15.732363+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:17:15.732363+0000","last_peered":"2024-06-10T00:17:15.732363+0000","last_clean":"2024-06-10T00:17:15.732363+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:17:15.732363+0000","last_undegraded":"2024-06-10T00:17:15.732363+0000","last_fullsized":"2024-06-10T00:17:15.732363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1294336,"data_stored":900773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":304196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":304196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1282048,"data_stored":894564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:17:20.728 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:17:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.864+0000 7f6ac334f640 1 Processor -- start 2024-06-10T00:17:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.865+0000 7f6ac334f640 1 -- start start 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.865+0000 7f6ac334f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6abc0d2680 0x7f6abc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.865+0000 7f6ac334f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc0d1fc0 0x7f6abc0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.865+0000 7f6ac334f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc0d2fa0 con 0x7f6abc161fa0 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.865+0000 7f6ac334f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6abc0cff80 con 0x7f6abc0d2680 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.865+0000 7f6ac334f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc0d13e0 con 0x7f6abc0d1fc0 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.865+0000 7f6ac18ec640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6abc161fa0 0x7f6abc162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36466/0 (socket says 172.21.15.79:36466) 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.865+0000 7f6ac18ec640 1 -- 172.21.15.79:0/511972171 learned_addr learned my addr 172.21.15.79:0/511972171 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237516420 0 0) 0x7f6abc0d2fa0 con 0x7f6abc161fa0 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa4003520 con 0x7f6abc161fa0 2024-06-10T00:17:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac10eb640 1 --2- 172.21.15.79:0/511972171 >> v2:172.21.15.117:3300/0 conn(0x7f6abc0d2680 0x7f6abc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac08ea640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc0d1fc0 0x7f6abc0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2738630384 0 0) 0x7f6aa4003520 con 0x7f6abc161fa0 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc0d1fc0 msgr2=0x7f6abc0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc0d1fc0 0x7f6abc0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 >> v2:172.21.15.117:3300/0 conn(0x7f6abc0d2680 msgr2=0x7f6abc15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 --2- 172.21.15.79:0/511972171 >> v2:172.21.15.117:3300/0 conn(0x7f6abc0d2680 0x7f6abc15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc0d0ad0 con 0x7f6abc161fa0 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f6ab4001670 con 0x7f6abc161fa0 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac10eb640 1 --2- 172.21.15.79:0/511972171 >> v2:172.21.15.117:3300/0 conn(0x7f6abc0d2680 0x7f6abc15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 >> v1:172.21.15.79:6789/0 conn(0x7f6abc161fa0 legacy=0x7f6abc162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039b0 0x7f6aa4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4004800 0x7f6aa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc0d1fc0 0x7f6aa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0cff80 con 0x7f6aa4004800 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0d13e0 con 0x7f6aa40039b0 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa400ba70 con 0x7f6abc0d1fc0 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac08ea640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4004800 0x7f6aa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac10eb640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039b0 0x7f6aa4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac18ec640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc0d1fc0 0x7f6aa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac08ea640 1 -- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc0d1fc0 msgr2=0x7f6aa40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac08ea640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc0d1fc0 0x7f6aa40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac08ea640 1 -- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039b0 msgr2=0x7f6aa4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac08ea640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039b0 0x7f6aa4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.866+0000 7f6ac08ea640 1 -- 172.21.15.79:0/511972171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa4003520 con 0x7f6aa4004800 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.867+0000 7f6ac08ea640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4004800 0x7f6aa4004c80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000ba00 tx=0x7f6aa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cc4eb4cd566deb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.867+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0030070 con 0x7f6aa4004800 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.867+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab002ad80 con 0x7f6aa4004800 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.867+0000 7f6abbfff640 1 -- 172.21.15.79:0/511972171 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000b600 con 0x7f6aa4004800 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.868+0000 7f6ac334f640 1 -- 172.21.15.79:0/511972171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4004800 msgr2=0x7f6aa4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.868+0000 7f6ac334f640 1 --2- 172.21.15.79:0/511972171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa4004800 0x7f6aa4004c80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000ba00 tx=0x7f6aa4005830 comp rx=0 tx=0).stop 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.868+0000 7f6ac18ec640 1 -- 172.21.15.79:0/511972171 reap_dead start 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.868+0000 7f6ac334f640 1 -- 172.21.15.79:0/511972171 shutdown_connections 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.868+0000 7f6ac334f640 1 -- 172.21.15.79:0/511972171 >> 172.21.15.79:0/511972171 conn(0x7f6abc09d3f0 msgr2=0x7f6abc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.868+0000 7f6ac334f640 1 -- 172.21.15.79:0/511972171 shutdown_connections 2024-06-10T00:17:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.868+0000 7f6ac334f640 1 -- 172.21.15.79:0/511972171 wait complete. 2024-06-10T00:17:20.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.869+0000 7f6ac334f640 1 Processor -- start 2024-06-10T00:17:20.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.869+0000 7f6ac334f640 1 -- start start 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac334f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc15a750 0x7f6abc0b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac334f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15d080 0x7f6abc0b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac334f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6abc0b8eb0 0x7f6abc0b9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac334f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0d1070 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac334f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0d0d90 con 0x7f6abc15d080 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac334f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc0d2400 con 0x7f6abc15a750 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6abc0b8eb0 0x7f6abc0b9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6abc0b8eb0 0x7f6abc0b9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59362/0 (socket says 172.21.15.79:59362) 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 -- 172.21.15.79:0/1384850225 learned_addr learned my addr 172.21.15.79:0/1384850225 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 -- 172.21.15.79:0/1384850225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc15a750 msgr2=0x7f6abc0b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc15a750 0x7f6abc0b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 -- 172.21.15.79:0/1384850225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15d080 msgr2=0x7f6abc0b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac08ea640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15d080 0x7f6abc0b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15d080 0x7f6abc0b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 -- 172.21.15.79:0/1384850225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc0b7350 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ac18ec640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6abc0b8eb0 0x7f6abc0b9330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6abc06bfd0 tx=0x7f6ab4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.870+0000 7f6ab9ffb640 1 -- 172.21.15.79:0/1384850225 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400f620 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.871+0000 7f6ab9ffb640 1 -- 172.21.15.79:0/1384850225 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab4018070 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.871+0000 7f6ab9ffb640 1 -- 172.21.15.79:0/1384850225 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400fa20 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.871+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc0b7630 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.871+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc0b7bf0 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.872+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6abc068430 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.872+0000 7f6ab9ffb640 1 -- 172.21.15.79:0/1384850225 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ab400fbc0 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.872+0000 7f6ab9ffb640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.873+0000 7f6ac10eb640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:20.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.873+0000 7f6ab9ffb640 1 -- 172.21.15.79:0/1384850225 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f6ab408ac20 con 0x7f6abc0b8eb0 2024-06-10T00:17:20.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.873+0000 7f6ac10eb640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6aa806be30 0x7f6aa806e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007440 tx=0x7f6aac009bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:20.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:20.877+0000 7f6ab9ffb640 1 -- 172.21.15.79:0/1384850225 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6ab40594d0 con 0x7f6abc0b8eb0 2024-06-10T00:17:21.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.045+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6abc0d04e0 con 0x7f6aa806be30 2024-06-10T00:17:21.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.050+0000 7f6ab9ffb640 1 -- 172.21.15.79:0/1384850225 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239886 (secure 0 0 0) 0x7f6abc0d04e0 con 0x7f6aa806be30 2024-06-10T00:17:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:21.054 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:17:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6aa806be30 msgr2=0x7f6aa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6aa806be30 0x7f6aa806e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007440 tx=0x7f6aac009bc0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6abc0b8eb0 msgr2=0x7f6abc0b9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6abc0b8eb0 0x7f6abc0b9330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6abc06bfd0 tx=0x7f6ab4007430 comp rx=0 tx=0).stop 2024-06-10T00:17:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 shutdown_connections 2024-06-10T00:17:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6abc0b8eb0 0x7f6abc0b9330 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15d080 0x7f6abc0b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 --2- 172.21.15.79:0/1384850225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc15a750 0x7f6abc0b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 >> 172.21.15.79:0/1384850225 conn(0x7f6abc09d3f0 msgr2=0x7f6abc1613a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 shutdown_connections 2024-06-10T00:17:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.053+0000 7f6ac334f640 1 -- 172.21.15.79:0/1384850225 wait complete. 2024-06-10T00:17:21.064 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-06-10T00:17:19.179772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222784,"kb_used_data":6596,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751936,"statfs":{"total":773094113280,"available":772865982464,"internally_reserved":0,"allocated":6754304,"data_stored":3645349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000868"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731240+0000","last_change":"2024-06-10T00:17:15.731240+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731240+0000","last_undegraded":"2024-06-10T00:17:15.731240+0000","last_fullsized":"2024-06-10T00:17:15.731240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739155+0000","last_change":"2024-06-10T00:17:15.739155+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739155+0000","last_undegraded":"2024-06-10T00:17:15.739155+0000","last_fullsized":"2024-06-10T00:17:15.739155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739628+0000","last_change":"2024-06-10T00:17:15.739628+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739628+0000","last_undegraded":"2024-06-10T00:17:15.739628+0000","last_fullsized":"2024-06-10T00:17:15.739628+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739149+0000","last_change":"2024-06-10T00:17:15.739149+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739149+0000","last_undegraded":"2024-06-10T00:17:15.739149+0000","last_fullsized":"2024-06-10T00:17:15.739149+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735493+0000","last_change":"2024-06-10T00:17:15.735493+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735493+0000","last_undegraded":"2024-06-10T00:17:15.735493+0000","last_fullsized":"2024-06-10T00:17:15.735493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.736410+0000","last_change":"2024-06-10T00:17:15.736410+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.736410+0000","last_undegraded":"2024-06-10T00:17:15.736410+0000","last_fullsized":"2024-06-10T00:17:15.736410+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.736423+0000","last_change":"2024-06-10T00:17:15.736423+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.736423+0000","last_undegraded":"2024-06-10T00:17:15.736423+0000","last_fullsized":"2024-06-10T00:17:15.736423+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729426+0000","last_change":"2024-06-10T00:17:15.729426+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729426+0000","last_undegraded":"2024-06-10T00:17:15.729426+0000","last_fullsized":"2024-06-10T00:17:15.729426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731771+0000","last_change":"2024-06-10T00:17:15.731771+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731771+0000","last_undegraded":"2024-06-10T00:17:15.731771+0000","last_fullsized":"2024-06-10T00:17:15.731771+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729391+0000","last_change":"2024-06-10T00:17:15.729391+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729391+0000","last_undegraded":"2024-06-10T00:17:15.729391+0000","last_fullsized":"2024-06-10T00:17:15.729391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731994+0000","last_change":"2024-06-10T00:17:15.731994+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731994+0000","last_undegraded":"2024-06-10T00:17:15.731994+0000","last_fullsized":"2024-06-10T00:17:15.731994+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731720+0000","last_change":"2024-06-10T00:17:15.731720+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731720+0000","last_undegraded":"2024-06-10T00:17:15.731720+0000","last_fullsized":"2024-06-10T00:17:15.731720+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731874+0000","last_change":"2024-06-10T00:17:15.731874+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731874+0000","last_undegraded":"2024-06-10T00:17:15.731874+0000","last_fullsized":"2024-06-10T00:17:15.731874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741625+0000","last_change":"2024-06-10T00:17:15.741625+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741625+0000","last_undegraded":"2024-06-10T00:17:15.741625+0000","last_fullsized":"2024-06-10T00:17:15.741625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731362+0000","last_change":"2024-06-10T00:17:15.731362+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731362+0000","last_undegraded":"2024-06-10T00:17:15.731362+0000","last_fullsized":"2024-06-10T00:17:15.731362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729386+0000","last_change":"2024-06-10T00:17:15.729386+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729386+0000","last_undegraded":"2024-06-10T00:17:15.729386+0000","last_fullsized":"2024-06-10T00:17:15.729386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741579+0000","last_change":"2024-06-10T00:17:15.741579+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741579+0000","last_undegraded":"2024-06-10T00:17:15.741579+0000","last_fullsized":"2024-06-10T00:17:15.741579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731387+0000","last_change":"2024-06-10T00:17:15.731387+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731387+0000","last_undegraded":"2024-06-10T00:17:15.731387+0000","last_fullsized":"2024-06-10T00:17:15.731387+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731346+0000","last_change":"2024-06-10T00:17:15.731346+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731346+0000","last_undegraded":"2024-06-10T00:17:15.731346+0000","last_fullsized":"2024-06-10T00:17:15.731346+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735622+0000","last_change":"2024-06-10T00:17:15.735622+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735622+0000","last_undegraded":"2024-06-10T00:17:15.735622+0000","last_fullsized":"2024-06-10T00:17:15.735622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739167+0000","last_change":"2024-06-10T00:17:15.739167+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739167+0000","last_undegraded":"2024-06-10T00:17:15.739167+0000","last_fullsized":"2024-06-10T00:17:15.739167+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741074+0000","last_change":"2024-06-10T00:17:15.741074+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741074+0000","last_undegraded":"2024-06-10T00:17:15.741074+0000","last_fullsized":"2024-06-10T00:17:15.741074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739215+0000","last_change":"2024-06-10T00:17:15.739215+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739215+0000","last_undegraded":"2024-06-10T00:17:15.739215+0000","last_fullsized":"2024-06-10T00:17:15.739215+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741073+0000","last_change":"2024-06-10T00:17:15.741073+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741073+0000","last_undegraded":"2024-06-10T00:17:15.741073+0000","last_fullsized":"2024-06-10T00:17:15.741073+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741026+0000","last_change":"2024-06-10T00:17:15.741026+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741026+0000","last_undegraded":"2024-06-10T00:17:15.741026+0000","last_fullsized":"2024-06-10T00:17:15.741026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.739172+0000","last_change":"2024-06-10T00:17:15.739172+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.739172+0000","last_undegraded":"2024-06-10T00:17:15.739172+0000","last_fullsized":"2024-06-10T00:17:15.739172+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731269+0000","last_change":"2024-06-10T00:17:15.731269+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731269+0000","last_undegraded":"2024-06-10T00:17:15.731269+0000","last_fullsized":"2024-06-10T00:17:15.731269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731377+0000","last_change":"2024-06-10T00:17:15.731377+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731377+0000","last_undegraded":"2024-06-10T00:17:15.731377+0000","last_fullsized":"2024-06-10T00:17:15.731377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735586+0000","last_change":"2024-06-10T00:17:15.735586+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735586+0000","last_undegraded":"2024-06-10T00:17:15.735586+0000","last_fullsized":"2024-06-10T00:17:15.735586+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735546+0000","last_change":"2024-06-10T00:17:15.735546+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735546+0000","last_undegraded":"2024-06-10T00:17:15.735546+0000","last_fullsized":"2024-06-10T00:17:15.735546+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731269+0000","last_change":"2024-06-10T00:17:15.731269+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731269+0000","last_undegraded":"2024-06-10T00:17:15.731269+0000","last_fullsized":"2024-06-10T00:17:15.731269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.735562+0000","last_change":"2024-06-10T00:17:15.735562+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.735562+0000","last_undegraded":"2024-06-10T00:17:15.735562+0000","last_fullsized":"2024-06-10T00:17:15.735562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":238,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-10T00:17:15.732363+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:17:15.732363+0000","last_peered":"2024-06-10T00:17:15.732363+0000","last_clean":"2024-06-10T00:17:15.732363+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:17:15.732363+0000","last_undegraded":"2024-06-10T00:17:15.732363+0000","last_fullsized":"2024-06-10T00:17:15.732363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1294336,"data_stored":900773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":304196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":304196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1282048,"data_stored":894564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:17:21.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:17:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.205+0000 7fef2bcee640 1 Processor -- start 2024-06-10T00:17:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.206+0000 7fef2bcee640 1 -- start start 2024-06-10T00:17:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.206+0000 7fef2bcee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415f1a0 0x7fef240d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.206+0000 7fef2bcee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef240cef70 0x7fef240cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.206+0000 7fef2bcee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef2415f5e0 con 0x7fef240d2680 2024-06-10T00:17:21.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.206+0000 7fef2bcee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fef240d13e0 con 0x7fef240cef70 2024-06-10T00:17:21.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.206+0000 7fef2bcee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef240d0ad0 con 0x7fef2415f1a0 2024-06-10T00:17:21.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef29289640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415f1a0 0x7fef240d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef2a28b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef240cef70 0x7fef240cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef29289640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415f1a0 0x7fef240d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:56670/0 (socket says 172.21.15.79:56670) 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef29a8a640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fef240d2680 0x7fef240d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:34044/0 (socket says 172.21.15.79:34044) 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef29289640 1 -- 172.21.15.79:0/563304685 learned_addr learned my addr 172.21.15.79:0/563304685 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef29289640 1 -- 172.21.15.79:0/563304685 >> v2:172.21.15.117:3300/0 conn(0x7fef240cef70 msgr2=0x7fef240cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef29289640 1 --2- 172.21.15.79:0/563304685 >> v2:172.21.15.117:3300/0 conn(0x7fef240cef70 0x7fef240cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef29289640 1 -- 172.21.15.79:0/563304685 >> v1:172.21.15.117:6789/0 conn(0x7fef240d2680 legacy=0x7fef240d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef29289640 1 -- 172.21.15.79:0/563304685 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2415f890 con 0x7fef2415f1a0 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.207+0000 7fef2a28b640 1 --2- 172.21.15.79:0/563304685 >> v2:172.21.15.117:3300/0 conn(0x7fef240cef70 0x7fef240cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.208+0000 7fef29289640 1 --2- 172.21.15.79:0/563304685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415f1a0 0x7fef240d1fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef18009870 tx=0x7fef1802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e2527c7ba193863 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.208+0000 7fef28a88640 1 -- 172.21.15.79:0/563304685 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18037070 con 0x7fef2415f1a0 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.208+0000 7fef28a88640 1 -- 172.21.15.79:0/563304685 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef18032440 con 0x7fef2415f1a0 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.208+0000 7fef28a88640 1 -- 172.21.15.79:0/563304685 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18032810 con 0x7fef2415f1a0 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.209+0000 7fef2bcee640 1 -- 172.21.15.79:0/563304685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415f1a0 msgr2=0x7fef240d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.209+0000 7fef2bcee640 1 --2- 172.21.15.79:0/563304685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415f1a0 0x7fef240d1fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef18009870 tx=0x7fef1802a270 comp rx=0 tx=0).stop 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.209+0000 7fef2bcee640 1 -- 172.21.15.79:0/563304685 shutdown_connections 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.209+0000 7fef2bcee640 1 --2- 172.21.15.79:0/563304685 >> v2:172.21.15.117:3300/0 conn(0x7fef240cef70 0x7fef240cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.209+0000 7fef2bcee640 1 --2- 172.21.15.79:0/563304685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415f1a0 0x7fef240d1fc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.209+0000 7fef2bcee640 1 -- 172.21.15.79:0/563304685 >> 172.21.15.79:0/563304685 conn(0x7fef2409d3f0 msgr2=0x7fef240d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.209+0000 7fef2bcee640 1 -- 172.21.15.79:0/563304685 shutdown_connections 2024-06-10T00:17:21.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.209+0000 7fef2bcee640 1 -- 172.21.15.79:0/563304685 wait complete. 2024-06-10T00:17:21.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.210+0000 7fef2bcee640 1 Processor -- start 2024-06-10T00:17:21.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.210+0000 7fef2bcee640 1 -- start start 2024-06-10T00:17:21.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef2bcee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef240cef70 0x7fef2415fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef2bcee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d2680 0x7fef241f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef2bcee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415f1a0 0x7fef241f8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef2bcee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef240d4f00 con 0x7fef240cef70 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef2bcee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef240d1070 con 0x7fef2415f1a0 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef2bcee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef240d1870 con 0x7fef240d2680 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef240cef70 0x7fef2415fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef240cef70 0x7fef2415fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59374/0 (socket says 172.21.15.79:59374) 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 -- 172.21.15.79:0/3059997107 learned_addr learned my addr 172.21.15.79:0/3059997107 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29289640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d2680 0x7fef241f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef2a28b640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415f1a0 0x7fef241f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 -- 172.21.15.79:0/3059997107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d2680 msgr2=0x7fef241f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d2680 0x7fef241f7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 -- 172.21.15.79:0/3059997107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415f1a0 msgr2=0x7fef241f8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415f1a0 0x7fef241f8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 -- 172.21.15.79:0/3059997107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef240b0fa0 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef29a8a640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef240cef70 0x7fef2415fe00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00c400 tx=0x7fef1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef227fc640 1 -- 172.21.15.79:0/3059997107 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0074e0 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef227fc640 1 -- 172.21.15.79:0/3059997107 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c007680 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef240b1280 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.211+0000 7fef227fc640 1 -- 172.21.15.79:0/3059997107 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c004a00 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.212+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef241f88c0 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.213+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef24068430 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.213+0000 7fef227fc640 1 -- 172.21.15.79:0/3059997107 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef1c01a020 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.213+0000 7fef227fc640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef1006be60 0x7fef1006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.213+0000 7fef227fc640 1 -- 172.21.15.79:0/3059997107 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7fef1c08a760 con 0x7fef240cef70 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.214+0000 7fef29289640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef1006be60 0x7fef1006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.214+0000 7fef29289640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef1006be60 0x7fef1006e320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef18034000 tx=0x7fef1802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.218+0000 7fef227fc640 1 -- 172.21.15.79:0/3059997107 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fef1c010300 con 0x7fef240cef70 2024-06-10T00:17:21.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.387+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef240d04e0 con 0x7fef1006be60 2024-06-10T00:17:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.392+0000 7fef227fc640 1 -- 172.21.15.79:0/3059997107 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242550 (secure 0 0 0) 0x7fef240d04e0 con 0x7fef1006be60 2024-06-10T00:17:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:21.397 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:17:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef1006be60 msgr2=0x7fef1006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef1006be60 0x7fef1006e320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef18034000 tx=0x7fef1802e000 comp rx=0 tx=0).stop 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef240cef70 msgr2=0x7fef2415fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef240cef70 0x7fef2415fe00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00c400 tx=0x7fef1c00c8c0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 shutdown_connections 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef1006be60 0x7fef1006e320 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415f1a0 0x7fef241f8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d2680 0x7fef241f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 --2- 172.21.15.79:0/3059997107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef240cef70 0x7fef2415fe00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 >> 172.21.15.79:0/3059997107 conn(0x7fef2409d3f0 msgr2=0x7fef240d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 shutdown_connections 2024-06-10T00:17:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.395+0000 7fef2bcee640 1 -- 172.21.15.79:0/3059997107 wait complete. 2024-06-10T00:17:21.406 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-06-10T00:17:21.180055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222884,"kb_used_data":6692,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751836,"statfs":{"total":773094113280,"available":772865880064,"internally_reserved":0,"allocated":6852608,"data_stored":3698803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.453287"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655923+0000","last_change":"2024-06-10T00:17:17.774030+0000","last_active":"2024-06-10T00:17:19.655923+0000","last_peered":"2024-06-10T00:17:19.655923+0000","last_clean":"2024-06-10T00:17:19.655923+0000","last_became_active":"2024-06-10T00:17:17.773325+0000","last_became_peered":"2024-06-10T00:17:17.773325+0000","last_unstale":"2024-06-10T00:17:19.655923+0000","last_undegraded":"2024-06-10T00:17:19.655923+0000","last_fullsized":"2024-06-10T00:17:19.655923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:49:55.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133461+0000","last_change":"2024-06-10T00:17:17.773580+0000","last_active":"2024-06-10T00:17:19.133461+0000","last_peered":"2024-06-10T00:17:19.133461+0000","last_clean":"2024-06-10T00:17:19.133461+0000","last_became_active":"2024-06-10T00:17:17.773221+0000","last_became_peered":"2024-06-10T00:17:17.773221+0000","last_unstale":"2024-06-10T00:17:19.133461+0000","last_undegraded":"2024-06-10T00:17:19.133461+0000","last_fullsized":"2024-06-10T00:17:19.133461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:32:01.995484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133255+0000","last_change":"2024-06-10T00:17:17.769441+0000","last_active":"2024-06-10T00:17:19.133255+0000","last_peered":"2024-06-10T00:17:19.133255+0000","last_clean":"2024-06-10T00:17:19.133255+0000","last_became_active":"2024-06-10T00:17:17.769128+0000","last_became_peered":"2024-06-10T00:17:17.769128+0000","last_unstale":"2024-06-10T00:17:19.133255+0000","last_undegraded":"2024-06-10T00:17:19.133255+0000","last_fullsized":"2024-06-10T00:17:19.133255+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133236+0000","last_change":"2024-06-10T00:17:17.768653+0000","last_active":"2024-06-10T00:17:19.133236+0000","last_peered":"2024-06-10T00:17:19.133236+0000","last_clean":"2024-06-10T00:17:19.133236+0000","last_became_active":"2024-06-10T00:17:17.768406+0000","last_became_peered":"2024-06-10T00:17:17.768406+0000","last_unstale":"2024-06-10T00:17:19.133236+0000","last_undegraded":"2024-06-10T00:17:19.133236+0000","last_fullsized":"2024-06-10T00:17:19.133236+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:17.257998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655718+0000","last_change":"2024-06-10T00:17:17.777802+0000","last_active":"2024-06-10T00:17:19.655718+0000","last_peered":"2024-06-10T00:17:19.655718+0000","last_clean":"2024-06-10T00:17:19.655718+0000","last_became_active":"2024-06-10T00:17:17.777493+0000","last_became_peered":"2024-06-10T00:17:17.777493+0000","last_unstale":"2024-06-10T00:17:19.655718+0000","last_undegraded":"2024-06-10T00:17:19.655718+0000","last_fullsized":"2024-06-10T00:17:19.655718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:24:29.904612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731240+0000","last_change":"2024-06-10T00:17:15.731240+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731240+0000","last_undegraded":"2024-06-10T00:17:15.731240+0000","last_fullsized":"2024-06-10T00:17:15.731240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656204+0000","last_change":"2024-06-10T00:17:16.743822+0000","last_active":"2024-06-10T00:17:19.656204+0000","last_peered":"2024-06-10T00:17:19.656204+0000","last_clean":"2024-06-10T00:17:19.656204+0000","last_became_active":"2024-06-10T00:17:16.743547+0000","last_became_peered":"2024-06-10T00:17:16.743547+0000","last_unstale":"2024-06-10T00:17:19.656204+0000","last_undegraded":"2024-06-10T00:17:19.656204+0000","last_fullsized":"2024-06-10T00:17:19.656204+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:01:05.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656057+0000","last_change":"2024-06-10T00:17:17.777592+0000","last_active":"2024-06-10T00:17:19.656057+0000","last_peered":"2024-06-10T00:17:19.656057+0000","last_clean":"2024-06-10T00:17:19.656057+0000","last_became_active":"2024-06-10T00:17:17.777316+0000","last_became_peered":"2024-06-10T00:17:17.777316+0000","last_unstale":"2024-06-10T00:17:19.656057+0000","last_undegraded":"2024-06-10T00:17:19.656057+0000","last_fullsized":"2024-06-10T00:17:19.656057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656075+0000","last_change":"2024-06-10T00:17:16.749259+0000","last_active":"2024-06-10T00:17:19.656075+0000","last_peered":"2024-06-10T00:17:19.656075+0000","last_clean":"2024-06-10T00:17:19.656075+0000","last_became_active":"2024-06-10T00:17:16.748987+0000","last_became_peered":"2024-06-10T00:17:16.748987+0000","last_unstale":"2024-06-10T00:17:19.656075+0000","last_undegraded":"2024-06-10T00:17:19.656075+0000","last_fullsized":"2024-06-10T00:17:19.656075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:54:11.981027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656013+0000","last_change":"2024-06-10T00:17:16.751333+0000","last_active":"2024-06-10T00:17:19.656013+0000","last_peered":"2024-06-10T00:17:19.656013+0000","last_clean":"2024-06-10T00:17:19.656013+0000","last_became_active":"2024-06-10T00:17:16.751023+0000","last_became_peered":"2024-06-10T00:17:16.751023+0000","last_unstale":"2024-06-10T00:17:19.656013+0000","last_undegraded":"2024-06-10T00:17:19.656013+0000","last_fullsized":"2024-06-10T00:17:19.656013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:01:18.500623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133336+0000","last_change":"2024-06-10T00:17:16.746309+0000","last_active":"2024-06-10T00:17:19.133336+0000","last_peered":"2024-06-10T00:17:19.133336+0000","last_clean":"2024-06-10T00:17:19.133336+0000","last_became_active":"2024-06-10T00:17:16.745874+0000","last_became_peered":"2024-06-10T00:17:16.745874+0000","last_unstale":"2024-06-10T00:17:19.133336+0000","last_undegraded":"2024-06-10T00:17:19.133336+0000","last_fullsized":"2024-06-10T00:17:19.133336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:31:34.194824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133185+0000","last_change":"2024-06-10T00:17:16.748542+0000","last_active":"2024-06-10T00:17:19.133185+0000","last_peered":"2024-06-10T00:17:19.133185+0000","last_clean":"2024-06-10T00:17:19.133185+0000","last_became_active":"2024-06-10T00:17:16.748269+0000","last_became_peered":"2024-06-10T00:17:16.748269+0000","last_unstale":"2024-06-10T00:17:19.133185+0000","last_undegraded":"2024-06-10T00:17:19.133185+0000","last_fullsized":"2024-06-10T00:17:19.133185+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:54:11.981027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133193+0000","last_change":"2024-06-10T00:17:16.747249+0000","last_active":"2024-06-10T00:17:19.133193+0000","last_peered":"2024-06-10T00:17:19.133193+0000","last_clean":"2024-06-10T00:17:19.133193+0000","last_became_active":"2024-06-10T00:17:16.746964+0000","last_became_peered":"2024-06-10T00:17:16.746964+0000","last_unstale":"2024-06-10T00:17:19.133193+0000","last_undegraded":"2024-06-10T00:17:19.133193+0000","last_fullsized":"2024-06-10T00:17:19.133193+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:01:05.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133500+0000","last_change":"2024-06-10T00:17:17.764883+0000","last_active":"2024-06-10T00:17:19.133500+0000","last_peered":"2024-06-10T00:17:19.133500+0000","last_clean":"2024-06-10T00:17:19.133500+0000","last_became_active":"2024-06-10T00:17:17.764356+0000","last_became_peered":"2024-06-10T00:17:17.764356+0000","last_unstale":"2024-06-10T00:17:19.133500+0000","last_undegraded":"2024-06-10T00:17:19.133500+0000","last_fullsized":"2024-06-10T00:17:19.133500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:30:09.521064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729426+0000","last_change":"2024-06-10T00:17:15.729426+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729426+0000","last_undegraded":"2024-06-10T00:17:15.729426+0000","last_fullsized":"2024-06-10T00:17:15.729426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731771+0000","last_change":"2024-06-10T00:17:15.731771+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731771+0000","last_undegraded":"2024-06-10T00:17:15.731771+0000","last_fullsized":"2024-06-10T00:17:15.731771+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133389+0000","last_change":"2024-06-10T00:17:17.764570+0000","last_active":"2024-06-10T00:17:19.133389+0000","last_peered":"2024-06-10T00:17:19.133389+0000","last_clean":"2024-06-10T00:17:19.133389+0000","last_became_active":"2024-06-10T00:17:17.764268+0000","last_became_peered":"2024-06-10T00:17:17.764268+0000","last_unstale":"2024-06-10T00:17:19.133389+0000","last_undegraded":"2024-06-10T00:17:19.133389+0000","last_fullsized":"2024-06-10T00:17:19.133389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:58:51.504905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729391+0000","last_change":"2024-06-10T00:17:15.729391+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729391+0000","last_undegraded":"2024-06-10T00:17:15.729391+0000","last_fullsized":"2024-06-10T00:17:15.729391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731994+0000","last_change":"2024-06-10T00:17:15.731994+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731994+0000","last_undegraded":"2024-06-10T00:17:15.731994+0000","last_fullsized":"2024-06-10T00:17:15.731994+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731720+0000","last_change":"2024-06-10T00:17:15.731720+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731720+0000","last_undegraded":"2024-06-10T00:17:15.731720+0000","last_fullsized":"2024-06-10T00:17:15.731720+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731874+0000","last_change":"2024-06-10T00:17:15.731874+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731874+0000","last_undegraded":"2024-06-10T00:17:15.731874+0000","last_fullsized":"2024-06-10T00:17:15.731874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741625+0000","last_change":"2024-06-10T00:17:15.741625+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741625+0000","last_undegraded":"2024-06-10T00:17:15.741625+0000","last_fullsized":"2024-06-10T00:17:15.741625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731362+0000","last_change":"2024-06-10T00:17:15.731362+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731362+0000","last_undegraded":"2024-06-10T00:17:15.731362+0000","last_fullsized":"2024-06-10T00:17:15.731362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729386+0000","last_change":"2024-06-10T00:17:15.729386+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729386+0000","last_undegraded":"2024-06-10T00:17:15.729386+0000","last_fullsized":"2024-06-10T00:17:15.729386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741579+0000","last_change":"2024-06-10T00:17:15.741579+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741579+0000","last_undegraded":"2024-06-10T00:17:15.741579+0000","last_fullsized":"2024-06-10T00:17:15.741579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731387+0000","last_change":"2024-06-10T00:17:15.731387+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731387+0000","last_undegraded":"2024-06-10T00:17:15.731387+0000","last_fullsized":"2024-06-10T00:17:15.731387+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731346+0000","last_change":"2024-06-10T00:17:15.731346+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731346+0000","last_undegraded":"2024-06-10T00:17:15.731346+0000","last_fullsized":"2024-06-10T00:17:15.731346+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133337+0000","last_change":"2024-06-10T00:17:16.749303+0000","last_active":"2024-06-10T00:17:19.133337+0000","last_peered":"2024-06-10T00:17:19.133337+0000","last_clean":"2024-06-10T00:17:19.133337+0000","last_became_active":"2024-06-10T00:17:16.749030+0000","last_became_peered":"2024-06-10T00:17:16.749030+0000","last_unstale":"2024-06-10T00:17:19.133337+0000","last_undegraded":"2024-06-10T00:17:19.133337+0000","last_fullsized":"2024-06-10T00:17:19.133337+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:52:12.115450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655807+0000","last_change":"2024-06-10T00:17:17.777638+0000","last_active":"2024-06-10T00:17:19.655807+0000","last_peered":"2024-06-10T00:17:19.655807+0000","last_clean":"2024-06-10T00:17:19.655807+0000","last_became_active":"2024-06-10T00:17:17.777359+0000","last_became_peered":"2024-06-10T00:17:17.777359+0000","last_unstale":"2024-06-10T00:17:19.655807+0000","last_undegraded":"2024-06-10T00:17:19.655807+0000","last_fullsized":"2024-06-10T00:17:19.655807+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:46:42.871896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656075+0000","last_change":"2024-06-10T00:17:16.745677+0000","last_active":"2024-06-10T00:17:19.656075+0000","last_peered":"2024-06-10T00:17:19.656075+0000","last_clean":"2024-06-10T00:17:19.656075+0000","last_became_active":"2024-06-10T00:17:16.745380+0000","last_became_peered":"2024-06-10T00:17:16.745380+0000","last_unstale":"2024-06-10T00:17:19.656075+0000","last_undegraded":"2024-06-10T00:17:19.656075+0000","last_fullsized":"2024-06-10T00:17:19.656075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:48:17.470159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741074+0000","last_change":"2024-06-10T00:17:15.741074+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741074+0000","last_undegraded":"2024-06-10T00:17:15.741074+0000","last_fullsized":"2024-06-10T00:17:15.741074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655553+0000","last_change":"2024-06-10T00:17:16.742707+0000","last_active":"2024-06-10T00:17:19.655553+0000","last_peered":"2024-06-10T00:17:19.655553+0000","last_clean":"2024-06-10T00:17:19.655553+0000","last_became_active":"2024-06-10T00:17:16.742427+0000","last_became_peered":"2024-06-10T00:17:16.742427+0000","last_unstale":"2024-06-10T00:17:19.655553+0000","last_undegraded":"2024-06-10T00:17:19.655553+0000","last_fullsized":"2024-06-10T00:17:19.655553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:26:23.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656037+0000","last_change":"2024-06-10T00:17:17.773155+0000","last_active":"2024-06-10T00:17:19.656037+0000","last_peered":"2024-06-10T00:17:19.656037+0000","last_clean":"2024-06-10T00:17:19.656037+0000","last_became_active":"2024-06-10T00:17:17.772809+0000","last_became_peered":"2024-06-10T00:17:17.772809+0000","last_unstale":"2024-06-10T00:17:19.656037+0000","last_undegraded":"2024-06-10T00:17:19.656037+0000","last_fullsized":"2024-06-10T00:17:19.656037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:17.257998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741073+0000","last_change":"2024-06-10T00:17:15.741073+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741073+0000","last_undegraded":"2024-06-10T00:17:15.741073+0000","last_fullsized":"2024-06-10T00:17:15.741073+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741026+0000","last_change":"2024-06-10T00:17:15.741026+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741026+0000","last_undegraded":"2024-06-10T00:17:15.741026+0000","last_fullsized":"2024-06-10T00:17:15.741026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656177+0000","last_change":"2024-06-10T00:17:16.748571+0000","last_active":"2024-06-10T00:17:19.656177+0000","last_peered":"2024-06-10T00:17:19.656177+0000","last_clean":"2024-06-10T00:17:19.656177+0000","last_became_active":"2024-06-10T00:17:16.748269+0000","last_became_peered":"2024-06-10T00:17:16.748269+0000","last_unstale":"2024-06-10T00:17:19.656177+0000","last_undegraded":"2024-06-10T00:17:19.656177+0000","last_fullsized":"2024-06-10T00:17:19.656177+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:31:20.182156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731269+0000","last_change":"2024-06-10T00:17:15.731269+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731269+0000","last_undegraded":"2024-06-10T00:17:15.731269+0000","last_fullsized":"2024-06-10T00:17:15.731269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731377+0000","last_change":"2024-06-10T00:17:15.731377+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731377+0000","last_undegraded":"2024-06-10T00:17:15.731377+0000","last_fullsized":"2024-06-10T00:17:15.731377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133298+0000","last_change":"2024-06-10T00:17:16.743992+0000","last_active":"2024-06-10T00:17:19.133298+0000","last_peered":"2024-06-10T00:17:19.133298+0000","last_clean":"2024-06-10T00:17:19.133298+0000","last_became_active":"2024-06-10T00:17:16.743724+0000","last_became_peered":"2024-06-10T00:17:16.743724+0000","last_unstale":"2024-06-10T00:17:19.133298+0000","last_undegraded":"2024-06-10T00:17:19.133298+0000","last_fullsized":"2024-06-10T00:17:19.133298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:31:20.182156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133289+0000","last_change":"2024-06-10T00:17:16.747639+0000","last_active":"2024-06-10T00:17:19.133289+0000","last_peered":"2024-06-10T00:17:19.133289+0000","last_clean":"2024-06-10T00:17:19.133289+0000","last_became_active":"2024-06-10T00:17:16.747219+0000","last_became_peered":"2024-06-10T00:17:16.747219+0000","last_unstale":"2024-06-10T00:17:19.133289+0000","last_undegraded":"2024-06-10T00:17:19.133289+0000","last_fullsized":"2024-06-10T00:17:19.133289+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:09:43.971552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731269+0000","last_change":"2024-06-10T00:17:15.731269+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731269+0000","last_undegraded":"2024-06-10T00:17:15.731269+0000","last_fullsized":"2024-06-10T00:17:15.731269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133112+0000","last_change":"2024-06-10T00:17:16.744881+0000","last_active":"2024-06-10T00:17:19.133112+0000","last_peered":"2024-06-10T00:17:19.133112+0000","last_clean":"2024-06-10T00:17:19.133112+0000","last_became_active":"2024-06-10T00:17:16.744583+0000","last_became_peered":"2024-06-10T00:17:16.744583+0000","last_unstale":"2024-06-10T00:17:19.133112+0000","last_undegraded":"2024-06-10T00:17:19.133112+0000","last_fullsized":"2024-06-10T00:17:19.133112+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:26:23.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":238,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-10T00:17:15.732363+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:17:15.732363+0000","last_peered":"2024-06-10T00:17:15.732363+0000","last_clean":"2024-06-10T00:17:15.732363+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:17:15.732363+0000","last_undegraded":"2024-06-10T00:17:15.732363+0000","last_fullsized":"2024-06-10T00:17:15.732363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1294336,"data_stored":900773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":304196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":737280,"data_stored":330923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1331200,"data_stored":921291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:17:21.409 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3f is not active+clean 2024-06-10T00:17:21.409 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3e is not active+clean 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3d is not active+clean 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3c is not active+clean 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3b is not active+clean 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.410 INFO:tasks.ceph.ceph_manager.ceph:PG 10.39 is not active+clean 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:PG 10.38 is not active+clean 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:PG 10.37 is not active+clean 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:PG 10.36 is not active+clean 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:PG 10.35 is not active+clean 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.411 INFO:tasks.ceph.ceph_manager.ceph:PG 10.34 is not active+clean 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:PG 10.33 is not active+clean 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:PG 10.32 is not active+clean 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:PG 10.31 is not active+clean 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:PG 10.30 is not active+clean 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.412 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2f is not active+clean 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2e is not active+clean 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2d is not active+clean 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2b is not active+clean 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:PG 10.28 is not active+clean 2024-06-10T00:17:21.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:PG 10.27 is not active+clean 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:PG 10.26 is not active+clean 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:PG 10.25 is not active+clean 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:PG 10.24 is not active+clean 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:PG 10.23 is not active+clean 2024-06-10T00:17:21.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:PG 10.22 is not active+clean 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:PG 10.21 is not active+clean 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731240+0000', 'last_change': '2024-06-10T00:17:15.731240+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731240+0000', 'last_undegraded': '2024-06-10T00:17:15.731240+0000', 'last_fullsized': '2024-06-10T00:17:15.731240+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:17:21.415 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-06-10T00:17:21.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.729426+0000', 'last_change': '2024-06-10T00:17:15.729426+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.729426+0000', 'last_undegraded': '2024-06-10T00:17:15.729426+0000', 'last_fullsized': '2024-06-10T00:17:15.729426+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731771+0000', 'last_change': '2024-06-10T00:17:15.731771+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731771+0000', 'last_undegraded': '2024-06-10T00:17:15.731771+0000', 'last_fullsized': '2024-06-10T00:17:15.731771+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.729391+0000', 'last_change': '2024-06-10T00:17:15.729391+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.729391+0000', 'last_undegraded': '2024-06-10T00:17:15.729391+0000', 'last_fullsized': '2024-06-10T00:17:15.729391+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-06-10T00:17:21.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731994+0000', 'last_change': '2024-06-10T00:17:15.731994+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731994+0000', 'last_undegraded': '2024-06-10T00:17:15.731994+0000', 'last_fullsized': '2024-06-10T00:17:15.731994+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731720+0000', 'last_change': '2024-06-10T00:17:15.731720+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731720+0000', 'last_undegraded': '2024-06-10T00:17:15.731720+0000', 'last_fullsized': '2024-06-10T00:17:15.731720+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.418 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731874+0000', 'last_change': '2024-06-10T00:17:15.731874+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731874+0000', 'last_undegraded': '2024-06-10T00:17:15.731874+0000', 'last_fullsized': '2024-06-10T00:17:15.731874+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.741625+0000', 'last_change': '2024-06-10T00:17:15.741625+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.741625+0000', 'last_undegraded': '2024-06-10T00:17:15.741625+0000', 'last_fullsized': '2024-06-10T00:17:15.741625+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731362+0000', 'last_change': '2024-06-10T00:17:15.731362+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731362+0000', 'last_undegraded': '2024-06-10T00:17:15.731362+0000', 'last_fullsized': '2024-06-10T00:17:15.731362+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:17:21.419 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.729386+0000', 'last_change': '2024-06-10T00:17:15.729386+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.729386+0000', 'last_undegraded': '2024-06-10T00:17:15.729386+0000', 'last_fullsized': '2024-06-10T00:17:15.729386+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.741579+0000', 'last_change': '2024-06-10T00:17:15.741579+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.741579+0000', 'last_undegraded': '2024-06-10T00:17:15.741579+0000', 'last_fullsized': '2024-06-10T00:17:15.741579+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.420 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731387+0000', 'last_change': '2024-06-10T00:17:15.731387+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731387+0000', 'last_undegraded': '2024-06-10T00:17:15.731387+0000', 'last_fullsized': '2024-06-10T00:17:15.731387+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731346+0000', 'last_change': '2024-06-10T00:17:15.731346+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731346+0000', 'last_undegraded': '2024-06-10T00:17:15.731346+0000', 'last_fullsized': '2024-06-10T00:17:15.731346+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-06-10T00:17:21.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.741074+0000', 'last_change': '2024-06-10T00:17:15.741074+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.741074+0000', 'last_undegraded': '2024-06-10T00:17:15.741074+0000', 'last_fullsized': '2024-06-10T00:17:15.741074+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.741073+0000', 'last_change': '2024-06-10T00:17:15.741073+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.741073+0000', 'last_undegraded': '2024-06-10T00:17:15.741073+0000', 'last_fullsized': '2024-06-10T00:17:15.741073+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.422 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.741026+0000', 'last_change': '2024-06-10T00:17:15.741026+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.741026+0000', 'last_undegraded': '2024-06-10T00:17:15.741026+0000', 'last_fullsized': '2024-06-10T00:17:15.741026+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731269+0000', 'last_change': '2024-06-10T00:17:15.731269+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731269+0000', 'last_undegraded': '2024-06-10T00:17:15.731269+0000', 'last_fullsized': '2024-06-10T00:17:15.731269+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.423 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731377+0000', 'last_change': '2024-06-10T00:17:15.731377+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731377+0000', 'last_undegraded': '2024-06-10T00:17:15.731377+0000', 'last_fullsized': '2024-06-10T00:17:15.731377+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-06-10T00:17:21.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:17:15.731269+0000', 'last_change': '2024-06-10T00:17:15.731269+0000', 'last_active': '2024-06-10T00:17:15.721310+0000', 'last_peered': '2024-06-10T00:17:15.721310+0000', 'last_clean': '2024-06-10T00:17:15.721310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:15.731269+0000', 'last_undegraded': '2024-06-10T00:17:15.731269+0000', 'last_fullsized': '2024-06-10T00:17:15.731269+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:15.721310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:17:21.425 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-06-10T00:17:21.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-10T00:17:16.726199+0000', 'last_change': '2024-06-10T00:17:16.726199+0000', 'last_active': '2024-06-10T00:17:16.726199+0000', 'last_peered': '2024-06-10T00:17:16.726199+0000', 'last_clean': '2024-06-10T00:17:16.726199+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:17:16.726199+0000', 'last_undegraded': '2024-06-10T00:17:16.726199+0000', 'last_fullsized': '2024-06-10T00:17:16.726199+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'last_clean_scrub_stamp': '2024-06-10T00:17:16.726199+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-10T00:17:21.425 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-10T00:17:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.545+0000 7fa3963a9640 1 Processor -- start 2024-06-10T00:17:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.545+0000 7fa3963a9640 1 -- start start 2024-06-10T00:17:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa3963a9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa39006ebf0 0x7fa3900cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa3963a9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3900cf600 con 0x7fa3900cf190 2024-06-10T00:17:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa3963a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa39006d130 con 0x7fa3900ae910 2024-06-10T00:17:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa3963a9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa39006d410 con 0x7fa39006ebf0 2024-06-10T00:17:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa38f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa39006ebf0 0x7fa3900cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa394946640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa3900cf190 0x7fa3900acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36468/0 (socket says 172.21.15.79:36468) 2024-06-10T00:17:21.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa394946640 1 -- 172.21.15.79:0/2407169863 learned_addr learned my addr 172.21.15.79:0/2407169863 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:21.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa38f7fe640 1 -- 172.21.15.79:0/2407169863 >> v1:172.21.15.117:6789/0 conn(0x7fa3900ae910 legacy=0x7fa39006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:21.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa38f7fe640 1 -- 172.21.15.79:0/2407169863 >> v1:172.21.15.79:6789/0 conn(0x7fa3900cf190 legacy=0x7fa3900acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa38f7fe640 1 -- 172.21.15.79:0/2407169863 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39006d6f0 con 0x7fa39006ebf0 2024-06-10T00:17:21.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.546+0000 7fa38effd640 1 -- 172.21.15.79:0/2407169863 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90686596 0 0) 0x7fa3900cf600 con 0x7fa3900cf190 2024-06-10T00:17:21.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.547+0000 7fa38f7fe640 1 --2- 172.21.15.79:0/2407169863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900cec50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa3840097a0 tx=0x7fa38402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae6353993cb4025 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.547+0000 7fa38effd640 1 -- 172.21.15.79:0/2407169863 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384037070 con 0x7fa39006ebf0 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.547+0000 7fa38effd640 1 -- 172.21.15.79:0/2407169863 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38402ae50 con 0x7fa39006ebf0 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.547+0000 7fa38effd640 1 -- 172.21.15.79:0/2407169863 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384032660 con 0x7fa39006ebf0 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.548+0000 7fa3963a9640 1 -- 172.21.15.79:0/2407169863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 msgr2=0x7fa3900cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.548+0000 7fa3963a9640 1 --2- 172.21.15.79:0/2407169863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900cec50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa3840097a0 tx=0x7fa38402a140 comp rx=0 tx=0).stop 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.548+0000 7fa3963a9640 1 -- 172.21.15.79:0/2407169863 shutdown_connections 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.548+0000 7fa3963a9640 1 --2- 172.21.15.79:0/2407169863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900cec50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.548+0000 7fa3963a9640 1 -- 172.21.15.79:0/2407169863 >> 172.21.15.79:0/2407169863 conn(0x7fa3900b19f0 msgr2=0x7fa3900b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.548+0000 7fa3963a9640 1 -- 172.21.15.79:0/2407169863 shutdown_connections 2024-06-10T00:17:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.548+0000 7fa3963a9640 1 -- 172.21.15.79:0/2407169863 wait complete. 2024-06-10T00:17:21.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.549+0000 7fa3963a9640 1 Processor -- start 2024-06-10T00:17:21.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.549+0000 7fa3963a9640 1 -- start start 2024-06-10T00:17:21.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa3963a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa3963a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3900ae910 0x7fa3900cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa3963a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900cf190 0x7fa39014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa3963a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa3900ad450 con 0x7fa39006ebf0 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa3963a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3900aecf0 con 0x7fa3900ae910 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa3963a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3900ad5d0 con 0x7fa3900cf190 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59386/0 (socket says 172.21.15.79:59386) 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 -- 172.21.15.79:0/3384883411 learned_addr learned my addr 172.21.15.79:0/3384883411 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa394946640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900cf190 0x7fa39014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38f7fe640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3900ae910 0x7fa3900cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 -- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900cf190 msgr2=0x7fa39014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900cf190 0x7fa39014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 -- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3900ae910 msgr2=0x7fa3900cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3900ae910 0x7fa3900cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 -- 172.21.15.79:0/3384883411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39015d0c0 con 0x7fa39006ebf0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa394946640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900cf190 0x7fa39014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38f7fe640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3900ae910 0x7fa3900cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38ffff640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900c4c60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa38000c430 tx=0x7fa38000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38cff9640 1 -- 172.21.15.79:0/3384883411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380011790 con 0x7fa39006ebf0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38cff9640 1 -- 172.21.15.79:0/3384883411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa380017070 con 0x7fa39006ebf0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39015d3a0 con 0x7fa39006ebf0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa38cff9640 1 -- 172.21.15.79:0/3384883411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380011bb0 con 0x7fa39006ebf0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.550+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa39015d960 con 0x7fa39006ebf0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.551+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa390068430 con 0x7fa39006ebf0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.552+0000 7fa38cff9640 1 -- 172.21.15.79:0/3384883411 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa38001c460 con 0x7fa39006ebf0 2024-06-10T00:17:21.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.552+0000 7fa38cff9640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa37c06be30 0x7fa37c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.552+0000 7fa38f7fe640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa37c06be30 0x7fa37c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.552+0000 7fa38cff9640 1 -- 172.21.15.79:0/3384883411 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7fa38008ae40 con 0x7fa39006ebf0 2024-06-10T00:17:21.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.553+0000 7fa38f7fe640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa37c06be30 0x7fa37c06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa384034000 tx=0x7fa38402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.557+0000 7fa38cff9640 1 -- 172.21.15.79:0/3384883411 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa3800596f0 con 0x7fa39006ebf0 2024-06-10T00:17:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.798+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa3900b33e0 con 0x7fa39006ebf0 2024-06-10T00:17:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.798+0000 7fa38cff9640 1 -- 172.21.15.79:0/3384883411 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1590 (secure 0 0 0) 0x7fa380058ff0 con 0x7fa39006ebf0 2024-06-10T00:17:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:21.798 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":182,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1717978470,"num_in_osds":8,"osd_in_since":1717978461,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":54},{"state_name":"active+clean","count":24},{"state_name":"creating+peering","count":19}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590368,"bytes_used":228233216,"bytes_avail":772865880064,"bytes_total":773094113280,"unknown_pgs_ratio":0.55670100450515747,"inactive_pgs_ratio":0.19587628543376923,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":29,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5784}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-06-10T00:17:07.177700+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-06-10T00:17:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa37c06be30 msgr2=0x7fa37c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa37c06be30 0x7fa37c06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa384034000 tx=0x7fa38402e000 comp rx=0 tx=0).stop 2024-06-10T00:17:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 msgr2=0x7fa3900c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900c4c60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa38000c430 tx=0x7fa38000c8f0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 shutdown_connections 2024-06-10T00:17:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa37c06be30 0x7fa37c06e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900cf190 0x7fa39014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3900ae910 0x7fa3900cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 --2- 172.21.15.79:0/3384883411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39006ebf0 0x7fa3900c4c60 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.800+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 >> 172.21.15.79:0/3384883411 conn(0x7fa3900b19f0 msgr2=0x7fa39009ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.801+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 shutdown_connections 2024-06-10T00:17:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.801+0000 7fa3963a9640 1 -- 172.21.15.79:0/3384883411 wait complete. 2024-06-10T00:17:21.811 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-10T00:17:21.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:17:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.910+0000 7f41ae4c1640 1 Processor -- start 2024-06-10T00:17:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.910+0000 7f41ae4c1640 1 -- start start 2024-06-10T00:17:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41ae4c1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a806ebf0 0x7f41a80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41ae4c1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41a80cf190 0x7f41a80acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41ae4c1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a80cf640 con 0x7f41a80ae910 2024-06-10T00:17:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41ae4c1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f41a806d130 con 0x7f41a80cf190 2024-06-10T00:17:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41ae4c1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41a806d410 con 0x7f41a806ebf0 2024-06-10T00:17:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f41a80ae910 0x7f41a806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36472/0 (socket says 172.21.15.79:36472) 2024-06-10T00:17:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a7fff640 1 -- 172.21.15.79:0/3005881841 learned_addr learned my addr 172.21.15.79:0/3005881841 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41aca5e640 1 --2- 172.21.15.79:0/3005881841 >> v2:172.21.15.117:3300/0 conn(0x7f41a80cf190 0x7f41a80acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a77fe640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a806ebf0 0x7f41a80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320466954 0 0) 0x7f41a80cf640 con 0x7f41a80ae910 2024-06-10T00:17:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4190003520 con 0x7f41a80ae910 2024-06-10T00:17:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3549176408 0 0) 0x7f4190003520 con 0x7f41a80ae910 2024-06-10T00:17:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a806ebf0 msgr2=0x7f41a80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a806ebf0 0x7f41a80cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 >> v2:172.21.15.117:3300/0 conn(0x7f41a80cf190 msgr2=0x7f41a80acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 --2- 172.21.15.79:0/3005881841 >> v2:172.21.15.117:3300/0 conn(0x7f41a80cf190 0x7f41a80acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a806d6f0 con 0x7f41a80ae910 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f4198001670 con 0x7f41a80ae910 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 >> v1:172.21.15.79:6789/0 conn(0x7f41a80ae910 legacy=0x7f41a806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.911+0000 7f41a6ffd640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a806ebf0 0x7f41900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41a6ffd640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4190003f30 0x7f4190004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41a6ffd640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4190004d40 0x7f41900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41a806d130 con 0x7f4190004d40 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41a806d410 con 0x7f4190003f30 2024-06-10T00:17:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f419000dc20 con 0x7f41a806ebf0 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41aca5e640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4190004d40 0x7f41900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41a7fff640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a806ebf0 0x7f41900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41a77fe640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4190003f30 0x7f4190004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41aca5e640 1 -- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a806ebf0 msgr2=0x7f41900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41aca5e640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a806ebf0 0x7f41900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41aca5e640 1 -- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4190003f30 msgr2=0x7f4190004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41aca5e640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4190003f30 0x7f4190004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41aca5e640 1 -- 172.21.15.79:0/3005881841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4190003520 con 0x7f4190004d40 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.912+0000 7f41a77fe640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4190003f30 0x7f4190004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41aca5e640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4190004d40 0x7f41900051c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f41a000e170 tx=0x7f4190005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb8a724dee9a774 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0034020 con 0x7f4190004d40 2024-06-10T00:17:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a0030430 con 0x7f4190004d40 2024-06-10T00:17:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41a6ffd640 1 -- 172.21.15.79:0/3005881841 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0009c10 con 0x7f4190004d40 2024-06-10T00:17:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3005881841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4190004d40 msgr2=0x7f41900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41ae4c1640 1 --2- 172.21.15.79:0/3005881841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4190004d40 0x7f41900051c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f41a000e170 tx=0x7f4190005830 comp rx=0 tx=0).stop 2024-06-10T00:17:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41aca5e640 1 -- 172.21.15.79:0/3005881841 reap_dead start 2024-06-10T00:17:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3005881841 shutdown_connections 2024-06-10T00:17:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3005881841 >> 172.21.15.79:0/3005881841 conn(0x7f41a80b19f0 msgr2=0x7f41a80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3005881841 shutdown_connections 2024-06-10T00:17:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.913+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3005881841 wait complete. 2024-06-10T00:17:21.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.914+0000 7f41ae4c1640 1 Processor -- start 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41ae4c1640 1 -- start start 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41ae4c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a814d730 0x7f41a81e45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41ae4c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a815d000 0x7f41a81580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41ae4c1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8158630 0x7f41a81e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41ae4c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80ad280 con 0x7f41a815d000 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41ae4c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80aecf0 con 0x7f41a814d730 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41ae4c1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41a80ad400 con 0x7f41a8158630 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a815d000 0x7f41a81580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a815d000 0x7f41a81580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59398/0 (socket says 172.21.15.79:59398) 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.915+0000 7f41a77fe640 1 -- 172.21.15.79:0/3564323314 learned_addr learned my addr 172.21.15.79:0/3564323314 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a7fff640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a814d730 0x7f41a81e45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41aca5e640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8158630 0x7f41a81e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a77fe640 1 -- 172.21.15.79:0/3564323314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8158630 msgr2=0x7f41a81e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a77fe640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8158630 0x7f41a81e3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a77fe640 1 -- 172.21.15.79:0/3564323314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a814d730 msgr2=0x7f41a81e45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a77fe640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a814d730 0x7f41a81e45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a77fe640 1 -- 172.21.15.79:0/3564323314 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a81e4cc0 con 0x7f41a815d000 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a77fe640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a815d000 0x7f41a81580f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f419c011540 tx=0x7f419c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a4ff9640 1 -- 172.21.15.79:0/3564323314 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c015870 con 0x7f41a815d000 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a4ff9640 1 -- 172.21.15.79:0/3564323314 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f419c015a10 con 0x7f41a815d000 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a81e4fa0 con 0x7f41a815d000 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41a4ff9640 1 -- 172.21.15.79:0/3564323314 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c015dc0 con 0x7f41a815d000 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.916+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81e5560 con 0x7f41a815d000 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.917+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a8068430 con 0x7f41a815d000 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.918+0000 7f41a4ff9640 1 -- 172.21.15.79:0/3564323314 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f419c00f460 con 0x7f41a815d000 2024-06-10T00:17:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.918+0000 7f41a4ff9640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f419406be60 0x7f419406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:21.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.918+0000 7f41a4ff9640 1 -- 172.21.15.79:0/3564323314 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f419c08b750 con 0x7f41a815d000 2024-06-10T00:17:21.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.918+0000 7f41a7fff640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f419406be60 0x7f419406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:21.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.919+0000 7f41a7fff640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f419406be60 0x7f419406e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4198001050 tx=0x7f4198000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:21.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:21.922+0000 7f41a4ff9640 1 -- 172.21.15.79:0/3564323314 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f419c019030 con 0x7f41a815d000 2024-06-10T00:17:22.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.091+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41a81e5730 con 0x7f419406be60 2024-06-10T00:17:22.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.097+0000 7f41a4ff9640 1 -- 172.21.15.79:0/3564323314 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242550 (secure 0 0 0) 0x7f41a81e5730 con 0x7f419406be60 2024-06-10T00:17:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:22.100 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:17:22.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f419406be60 msgr2=0x7f419406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:22.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f419406be60 0x7f419406e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4198001050 tx=0x7f4198000f80 comp rx=0 tx=0).stop 2024-06-10T00:17:22.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a815d000 msgr2=0x7f41a81580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:22.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a815d000 0x7f41a81580f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f419c011540 tx=0x7f419c011a00 comp rx=0 tx=0).stop 2024-06-10T00:17:22.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 shutdown_connections 2024-06-10T00:17:22.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f419406be60 0x7f419406e320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:22.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8158630 0x7f41a81e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:22.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a815d000 0x7f41a81580f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:22.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 --2- 172.21.15.79:0/3564323314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a814d730 0x7f41a81e45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:22.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 >> 172.21.15.79:0/3564323314 conn(0x7f41a80b19f0 msgr2=0x7f41a8071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:22.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 shutdown_connections 2024-06-10T00:17:22.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:22.100+0000 7f41ae4c1640 1 -- 172.21.15.79:0/3564323314 wait complete. 2024-06-10T00:17:22.110 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-06-10T00:17:21.180055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222884,"kb_used_data":6692,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751836,"statfs":{"total":773094113280,"available":772865880064,"internally_reserved":0,"allocated":6852608,"data_stored":3698803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.453287"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655923+0000","last_change":"2024-06-10T00:17:17.774030+0000","last_active":"2024-06-10T00:17:19.655923+0000","last_peered":"2024-06-10T00:17:19.655923+0000","last_clean":"2024-06-10T00:17:19.655923+0000","last_became_active":"2024-06-10T00:17:17.773325+0000","last_became_peered":"2024-06-10T00:17:17.773325+0000","last_unstale":"2024-06-10T00:17:19.655923+0000","last_undegraded":"2024-06-10T00:17:19.655923+0000","last_fullsized":"2024-06-10T00:17:19.655923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:49:55.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133461+0000","last_change":"2024-06-10T00:17:17.773580+0000","last_active":"2024-06-10T00:17:19.133461+0000","last_peered":"2024-06-10T00:17:19.133461+0000","last_clean":"2024-06-10T00:17:19.133461+0000","last_became_active":"2024-06-10T00:17:17.773221+0000","last_became_peered":"2024-06-10T00:17:17.773221+0000","last_unstale":"2024-06-10T00:17:19.133461+0000","last_undegraded":"2024-06-10T00:17:19.133461+0000","last_fullsized":"2024-06-10T00:17:19.133461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:32:01.995484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133255+0000","last_change":"2024-06-10T00:17:17.769441+0000","last_active":"2024-06-10T00:17:19.133255+0000","last_peered":"2024-06-10T00:17:19.133255+0000","last_clean":"2024-06-10T00:17:19.133255+0000","last_became_active":"2024-06-10T00:17:17.769128+0000","last_became_peered":"2024-06-10T00:17:17.769128+0000","last_unstale":"2024-06-10T00:17:19.133255+0000","last_undegraded":"2024-06-10T00:17:19.133255+0000","last_fullsized":"2024-06-10T00:17:19.133255+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133236+0000","last_change":"2024-06-10T00:17:17.768653+0000","last_active":"2024-06-10T00:17:19.133236+0000","last_peered":"2024-06-10T00:17:19.133236+0000","last_clean":"2024-06-10T00:17:19.133236+0000","last_became_active":"2024-06-10T00:17:17.768406+0000","last_became_peered":"2024-06-10T00:17:17.768406+0000","last_unstale":"2024-06-10T00:17:19.133236+0000","last_undegraded":"2024-06-10T00:17:19.133236+0000","last_fullsized":"2024-06-10T00:17:19.133236+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:17.257998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655718+0000","last_change":"2024-06-10T00:17:17.777802+0000","last_active":"2024-06-10T00:17:19.655718+0000","last_peered":"2024-06-10T00:17:19.655718+0000","last_clean":"2024-06-10T00:17:19.655718+0000","last_became_active":"2024-06-10T00:17:17.777493+0000","last_became_peered":"2024-06-10T00:17:17.777493+0000","last_unstale":"2024-06-10T00:17:19.655718+0000","last_undegraded":"2024-06-10T00:17:19.655718+0000","last_fullsized":"2024-06-10T00:17:19.655718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:24:29.904612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731240+0000","last_change":"2024-06-10T00:17:15.731240+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731240+0000","last_undegraded":"2024-06-10T00:17:15.731240+0000","last_fullsized":"2024-06-10T00:17:15.731240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656204+0000","last_change":"2024-06-10T00:17:16.743822+0000","last_active":"2024-06-10T00:17:19.656204+0000","last_peered":"2024-06-10T00:17:19.656204+0000","last_clean":"2024-06-10T00:17:19.656204+0000","last_became_active":"2024-06-10T00:17:16.743547+0000","last_became_peered":"2024-06-10T00:17:16.743547+0000","last_unstale":"2024-06-10T00:17:19.656204+0000","last_undegraded":"2024-06-10T00:17:19.656204+0000","last_fullsized":"2024-06-10T00:17:19.656204+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:01:05.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656057+0000","last_change":"2024-06-10T00:17:17.777592+0000","last_active":"2024-06-10T00:17:19.656057+0000","last_peered":"2024-06-10T00:17:19.656057+0000","last_clean":"2024-06-10T00:17:19.656057+0000","last_became_active":"2024-06-10T00:17:17.777316+0000","last_became_peered":"2024-06-10T00:17:17.777316+0000","last_unstale":"2024-06-10T00:17:19.656057+0000","last_undegraded":"2024-06-10T00:17:19.656057+0000","last_fullsized":"2024-06-10T00:17:19.656057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656075+0000","last_change":"2024-06-10T00:17:16.749259+0000","last_active":"2024-06-10T00:17:19.656075+0000","last_peered":"2024-06-10T00:17:19.656075+0000","last_clean":"2024-06-10T00:17:19.656075+0000","last_became_active":"2024-06-10T00:17:16.748987+0000","last_became_peered":"2024-06-10T00:17:16.748987+0000","last_unstale":"2024-06-10T00:17:19.656075+0000","last_undegraded":"2024-06-10T00:17:19.656075+0000","last_fullsized":"2024-06-10T00:17:19.656075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:54:11.981027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656013+0000","last_change":"2024-06-10T00:17:16.751333+0000","last_active":"2024-06-10T00:17:19.656013+0000","last_peered":"2024-06-10T00:17:19.656013+0000","last_clean":"2024-06-10T00:17:19.656013+0000","last_became_active":"2024-06-10T00:17:16.751023+0000","last_became_peered":"2024-06-10T00:17:16.751023+0000","last_unstale":"2024-06-10T00:17:19.656013+0000","last_undegraded":"2024-06-10T00:17:19.656013+0000","last_fullsized":"2024-06-10T00:17:19.656013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:01:18.500623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133336+0000","last_change":"2024-06-10T00:17:16.746309+0000","last_active":"2024-06-10T00:17:19.133336+0000","last_peered":"2024-06-10T00:17:19.133336+0000","last_clean":"2024-06-10T00:17:19.133336+0000","last_became_active":"2024-06-10T00:17:16.745874+0000","last_became_peered":"2024-06-10T00:17:16.745874+0000","last_unstale":"2024-06-10T00:17:19.133336+0000","last_undegraded":"2024-06-10T00:17:19.133336+0000","last_fullsized":"2024-06-10T00:17:19.133336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:31:34.194824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133185+0000","last_change":"2024-06-10T00:17:16.748542+0000","last_active":"2024-06-10T00:17:19.133185+0000","last_peered":"2024-06-10T00:17:19.133185+0000","last_clean":"2024-06-10T00:17:19.133185+0000","last_became_active":"2024-06-10T00:17:16.748269+0000","last_became_peered":"2024-06-10T00:17:16.748269+0000","last_unstale":"2024-06-10T00:17:19.133185+0000","last_undegraded":"2024-06-10T00:17:19.133185+0000","last_fullsized":"2024-06-10T00:17:19.133185+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:54:11.981027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133193+0000","last_change":"2024-06-10T00:17:16.747249+0000","last_active":"2024-06-10T00:17:19.133193+0000","last_peered":"2024-06-10T00:17:19.133193+0000","last_clean":"2024-06-10T00:17:19.133193+0000","last_became_active":"2024-06-10T00:17:16.746964+0000","last_became_peered":"2024-06-10T00:17:16.746964+0000","last_unstale":"2024-06-10T00:17:19.133193+0000","last_undegraded":"2024-06-10T00:17:19.133193+0000","last_fullsized":"2024-06-10T00:17:19.133193+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:01:05.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133500+0000","last_change":"2024-06-10T00:17:17.764883+0000","last_active":"2024-06-10T00:17:19.133500+0000","last_peered":"2024-06-10T00:17:19.133500+0000","last_clean":"2024-06-10T00:17:19.133500+0000","last_became_active":"2024-06-10T00:17:17.764356+0000","last_became_peered":"2024-06-10T00:17:17.764356+0000","last_unstale":"2024-06-10T00:17:19.133500+0000","last_undegraded":"2024-06-10T00:17:19.133500+0000","last_fullsized":"2024-06-10T00:17:19.133500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:30:09.521064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729426+0000","last_change":"2024-06-10T00:17:15.729426+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729426+0000","last_undegraded":"2024-06-10T00:17:15.729426+0000","last_fullsized":"2024-06-10T00:17:15.729426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731771+0000","last_change":"2024-06-10T00:17:15.731771+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731771+0000","last_undegraded":"2024-06-10T00:17:15.731771+0000","last_fullsized":"2024-06-10T00:17:15.731771+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133389+0000","last_change":"2024-06-10T00:17:17.764570+0000","last_active":"2024-06-10T00:17:19.133389+0000","last_peered":"2024-06-10T00:17:19.133389+0000","last_clean":"2024-06-10T00:17:19.133389+0000","last_became_active":"2024-06-10T00:17:17.764268+0000","last_became_peered":"2024-06-10T00:17:17.764268+0000","last_unstale":"2024-06-10T00:17:19.133389+0000","last_undegraded":"2024-06-10T00:17:19.133389+0000","last_fullsized":"2024-06-10T00:17:19.133389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:58:51.504905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729391+0000","last_change":"2024-06-10T00:17:15.729391+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729391+0000","last_undegraded":"2024-06-10T00:17:15.729391+0000","last_fullsized":"2024-06-10T00:17:15.729391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731994+0000","last_change":"2024-06-10T00:17:15.731994+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731994+0000","last_undegraded":"2024-06-10T00:17:15.731994+0000","last_fullsized":"2024-06-10T00:17:15.731994+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731720+0000","last_change":"2024-06-10T00:17:15.731720+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731720+0000","last_undegraded":"2024-06-10T00:17:15.731720+0000","last_fullsized":"2024-06-10T00:17:15.731720+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731874+0000","last_change":"2024-06-10T00:17:15.731874+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731874+0000","last_undegraded":"2024-06-10T00:17:15.731874+0000","last_fullsized":"2024-06-10T00:17:15.731874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741625+0000","last_change":"2024-06-10T00:17:15.741625+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741625+0000","last_undegraded":"2024-06-10T00:17:15.741625+0000","last_fullsized":"2024-06-10T00:17:15.741625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731362+0000","last_change":"2024-06-10T00:17:15.731362+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731362+0000","last_undegraded":"2024-06-10T00:17:15.731362+0000","last_fullsized":"2024-06-10T00:17:15.731362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.729386+0000","last_change":"2024-06-10T00:17:15.729386+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.729386+0000","last_undegraded":"2024-06-10T00:17:15.729386+0000","last_fullsized":"2024-06-10T00:17:15.729386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741579+0000","last_change":"2024-06-10T00:17:15.741579+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741579+0000","last_undegraded":"2024-06-10T00:17:15.741579+0000","last_fullsized":"2024-06-10T00:17:15.741579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731387+0000","last_change":"2024-06-10T00:17:15.731387+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731387+0000","last_undegraded":"2024-06-10T00:17:15.731387+0000","last_fullsized":"2024-06-10T00:17:15.731387+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731346+0000","last_change":"2024-06-10T00:17:15.731346+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731346+0000","last_undegraded":"2024-06-10T00:17:15.731346+0000","last_fullsized":"2024-06-10T00:17:15.731346+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133337+0000","last_change":"2024-06-10T00:17:16.749303+0000","last_active":"2024-06-10T00:17:19.133337+0000","last_peered":"2024-06-10T00:17:19.133337+0000","last_clean":"2024-06-10T00:17:19.133337+0000","last_became_active":"2024-06-10T00:17:16.749030+0000","last_became_peered":"2024-06-10T00:17:16.749030+0000","last_unstale":"2024-06-10T00:17:19.133337+0000","last_undegraded":"2024-06-10T00:17:19.133337+0000","last_fullsized":"2024-06-10T00:17:19.133337+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:52:12.115450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655807+0000","last_change":"2024-06-10T00:17:17.777638+0000","last_active":"2024-06-10T00:17:19.655807+0000","last_peered":"2024-06-10T00:17:19.655807+0000","last_clean":"2024-06-10T00:17:19.655807+0000","last_became_active":"2024-06-10T00:17:17.777359+0000","last_became_peered":"2024-06-10T00:17:17.777359+0000","last_unstale":"2024-06-10T00:17:19.655807+0000","last_undegraded":"2024-06-10T00:17:19.655807+0000","last_fullsized":"2024-06-10T00:17:19.655807+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:46:42.871896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656075+0000","last_change":"2024-06-10T00:17:16.745677+0000","last_active":"2024-06-10T00:17:19.656075+0000","last_peered":"2024-06-10T00:17:19.656075+0000","last_clean":"2024-06-10T00:17:19.656075+0000","last_became_active":"2024-06-10T00:17:16.745380+0000","last_became_peered":"2024-06-10T00:17:16.745380+0000","last_unstale":"2024-06-10T00:17:19.656075+0000","last_undegraded":"2024-06-10T00:17:19.656075+0000","last_fullsized":"2024-06-10T00:17:19.656075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:48:17.470159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741074+0000","last_change":"2024-06-10T00:17:15.741074+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741074+0000","last_undegraded":"2024-06-10T00:17:15.741074+0000","last_fullsized":"2024-06-10T00:17:15.741074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655553+0000","last_change":"2024-06-10T00:17:16.742707+0000","last_active":"2024-06-10T00:17:19.655553+0000","last_peered":"2024-06-10T00:17:19.655553+0000","last_clean":"2024-06-10T00:17:19.655553+0000","last_became_active":"2024-06-10T00:17:16.742427+0000","last_became_peered":"2024-06-10T00:17:16.742427+0000","last_unstale":"2024-06-10T00:17:19.655553+0000","last_undegraded":"2024-06-10T00:17:19.655553+0000","last_fullsized":"2024-06-10T00:17:19.655553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:26:23.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656037+0000","last_change":"2024-06-10T00:17:17.773155+0000","last_active":"2024-06-10T00:17:19.656037+0000","last_peered":"2024-06-10T00:17:19.656037+0000","last_clean":"2024-06-10T00:17:19.656037+0000","last_became_active":"2024-06-10T00:17:17.772809+0000","last_became_peered":"2024-06-10T00:17:17.772809+0000","last_unstale":"2024-06-10T00:17:19.656037+0000","last_undegraded":"2024-06-10T00:17:19.656037+0000","last_fullsized":"2024-06-10T00:17:19.656037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:17.257998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741073+0000","last_change":"2024-06-10T00:17:15.741073+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741073+0000","last_undegraded":"2024-06-10T00:17:15.741073+0000","last_fullsized":"2024-06-10T00:17:15.741073+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.741026+0000","last_change":"2024-06-10T00:17:15.741026+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.741026+0000","last_undegraded":"2024-06-10T00:17:15.741026+0000","last_fullsized":"2024-06-10T00:17:15.741026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656177+0000","last_change":"2024-06-10T00:17:16.748571+0000","last_active":"2024-06-10T00:17:19.656177+0000","last_peered":"2024-06-10T00:17:19.656177+0000","last_clean":"2024-06-10T00:17:19.656177+0000","last_became_active":"2024-06-10T00:17:16.748269+0000","last_became_peered":"2024-06-10T00:17:16.748269+0000","last_unstale":"2024-06-10T00:17:19.656177+0000","last_undegraded":"2024-06-10T00:17:19.656177+0000","last_fullsized":"2024-06-10T00:17:19.656177+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:31:20.182156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731269+0000","last_change":"2024-06-10T00:17:15.731269+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731269+0000","last_undegraded":"2024-06-10T00:17:15.731269+0000","last_fullsized":"2024-06-10T00:17:15.731269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731377+0000","last_change":"2024-06-10T00:17:15.731377+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731377+0000","last_undegraded":"2024-06-10T00:17:15.731377+0000","last_fullsized":"2024-06-10T00:17:15.731377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133298+0000","last_change":"2024-06-10T00:17:16.743992+0000","last_active":"2024-06-10T00:17:19.133298+0000","last_peered":"2024-06-10T00:17:19.133298+0000","last_clean":"2024-06-10T00:17:19.133298+0000","last_became_active":"2024-06-10T00:17:16.743724+0000","last_became_peered":"2024-06-10T00:17:16.743724+0000","last_unstale":"2024-06-10T00:17:19.133298+0000","last_undegraded":"2024-06-10T00:17:19.133298+0000","last_fullsized":"2024-06-10T00:17:19.133298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:31:20.182156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133289+0000","last_change":"2024-06-10T00:17:16.747639+0000","last_active":"2024-06-10T00:17:19.133289+0000","last_peered":"2024-06-10T00:17:19.133289+0000","last_clean":"2024-06-10T00:17:19.133289+0000","last_became_active":"2024-06-10T00:17:16.747219+0000","last_became_peered":"2024-06-10T00:17:16.747219+0000","last_unstale":"2024-06-10T00:17:19.133289+0000","last_undegraded":"2024-06-10T00:17:19.133289+0000","last_fullsized":"2024-06-10T00:17:19.133289+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:09:43.971552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-06-10T00:17:15.731269+0000","last_change":"2024-06-10T00:17:15.731269+0000","last_active":"2024-06-10T00:17:15.721310+0000","last_peered":"2024-06-10T00:17:15.721310+0000","last_clean":"2024-06-10T00:17:15.721310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:15.731269+0000","last_undegraded":"2024-06-10T00:17:15.731269+0000","last_fullsized":"2024-06-10T00:17:15.731269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-10T00:17:16.726199+0000","last_change":"2024-06-10T00:17:16.726199+0000","last_active":"2024-06-10T00:17:16.726199+0000","last_peered":"2024-06-10T00:17:16.726199+0000","last_clean":"2024-06-10T00:17:16.726199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:17:16.726199+0000","last_undegraded":"2024-06-10T00:17:16.726199+0000","last_fullsized":"2024-06-10T00:17:16.726199+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133112+0000","last_change":"2024-06-10T00:17:16.744881+0000","last_active":"2024-06-10T00:17:19.133112+0000","last_peered":"2024-06-10T00:17:19.133112+0000","last_clean":"2024-06-10T00:17:19.133112+0000","last_became_active":"2024-06-10T00:17:16.744583+0000","last_became_peered":"2024-06-10T00:17:16.744583+0000","last_unstale":"2024-06-10T00:17:19.133112+0000","last_undegraded":"2024-06-10T00:17:19.133112+0000","last_fullsized":"2024-06-10T00:17:19.133112+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:26:23.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":238,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-10T00:17:15.732363+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:17:15.732363+0000","last_peered":"2024-06-10T00:17:15.732363+0000","last_clean":"2024-06-10T00:17:15.732363+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:17:15.732363+0000","last_undegraded":"2024-06-10T00:17:15.732363+0000","last_fullsized":"2024-06-10T00:17:15.732363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1294336,"data_stored":900773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":304196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":737280,"data_stored":330923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":700416,"data_stored":310405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1331200,"data_stored":921291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:17:23.724 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:17:23.724+0000 7fd0a7c1b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:17:25.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:17:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.226+0000 7fe34424d640 1 Processor -- start 2024-06-10T00:17:25.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.226+0000 7fe34424d640 1 -- start start 2024-06-10T00:17:25.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.227+0000 7fe34424d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c0cc6d0 0x7fe33c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.227+0000 7fe34424d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe33c0720e0 0x7fe33c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.227+0000 7fe34424d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33c0ccff0 con 0x7fe33c071c60 2024-06-10T00:17:25.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.227+0000 7fe34424d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe33c072550 con 0x7fe33c0720e0 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.227+0000 7fe34424d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c072820 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.227+0000 7fe3427ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe33c0720e0 0x7fe33c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.227+0000 7fe3417e8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe33c071c60 0x7fe33c0b36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36482/0 (socket says 172.21.15.79:36482) 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.227+0000 7fe3417e8640 1 -- 172.21.15.79:0/1240989838 learned_addr learned my addr 172.21.15.79:0/1240989838 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.228+0000 7fe341fe9640 1 --2- 172.21.15.79:0/1240989838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c0cc6d0 0x7fe33c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.228+0000 7fe3427ea640 1 -- 172.21.15.79:0/1240989838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c0cc6d0 msgr2=0x7fe33c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.228+0000 7fe3427ea640 1 --2- 172.21.15.79:0/1240989838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c0cc6d0 0x7fe33c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.228+0000 7fe3427ea640 1 -- 172.21.15.79:0/1240989838 >> v1:172.21.15.79:6789/0 conn(0x7fe33c071c60 legacy=0x7fe33c0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.228+0000 7fe340fe7640 1 -- 172.21.15.79:0/1240989838 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4269345836 0 0) 0x7fe33c0ccff0 con 0x7fe33c071c60 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.228+0000 7fe3427ea640 1 -- 172.21.15.79:0/1240989838 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c072b00 con 0x7fe33c0720e0 2024-06-10T00:17:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.228+0000 7fe341fe9640 1 --2- 172.21.15.79:0/1240989838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c0cc6d0 0x7fe33c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:25.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.228+0000 7fe3427ea640 1 --2- 172.21.15.79:0/1240989838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0720e0 0x7fe33c0b3dd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe334009d90 tx=0x7fe33402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a682ae23049c5b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe340fe7640 1 -- 172.21.15.79:0/1240989838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334007740 con 0x7fe33c0720e0 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe340fe7640 1 -- 172.21.15.79:0/1240989838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3340078e0 con 0x7fe33c0720e0 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe340fe7640 1 -- 172.21.15.79:0/1240989838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334007cb0 con 0x7fe33c0720e0 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe34424d640 1 -- 172.21.15.79:0/1240989838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0720e0 msgr2=0x7fe33c0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe34424d640 1 --2- 172.21.15.79:0/1240989838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0720e0 0x7fe33c0b3dd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe334009d90 tx=0x7fe33402a660 comp rx=0 tx=0).stop 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe34424d640 1 -- 172.21.15.79:0/1240989838 shutdown_connections 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe34424d640 1 --2- 172.21.15.79:0/1240989838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0720e0 0x7fe33c0b3dd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe34424d640 1 --2- 172.21.15.79:0/1240989838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c0cc6d0 0x7fe33c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe34424d640 1 -- 172.21.15.79:0/1240989838 >> 172.21.15.79:0/1240989838 conn(0x7fe33c0b19f0 msgr2=0x7fe33c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe34424d640 1 -- 172.21.15.79:0/1240989838 shutdown_connections 2024-06-10T00:17:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.229+0000 7fe34424d640 1 -- 172.21.15.79:0/1240989838 wait complete. 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.231+0000 7fe34424d640 1 Processor -- start 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.231+0000 7fe34424d640 1 -- start start 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.231+0000 7fe34424d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c071c60 0x7fe33c0ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe34424d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe33c0720e0 0x7fe33c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe34424d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0cc6d0 0x7fe33c155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe34424d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c15c890 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe34424d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c0b31a0 con 0x7fe33c0720e0 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe34424d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c159f60 con 0x7fe33c071c60 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0cc6d0 0x7fe33c155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0cc6d0 0x7fe33c155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59412/0 (socket says 172.21.15.79:59412) 2024-06-10T00:17:25.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 -- 172.21.15.79:0/3838403285 learned_addr learned my addr 172.21.15.79:0/3838403285 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe341fe9640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c071c60 0x7fe33c0ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3417e8640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe33c0720e0 0x7fe33c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 -- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c071c60 msgr2=0x7fe33c0ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c071c60 0x7fe33c0ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 -- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe33c0720e0 msgr2=0x7fe33c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe33c0720e0 0x7fe33c154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 -- 172.21.15.79:0/3838403285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c1f1f70 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe341fe9640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c071c60 0x7fe33c0ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3427ea640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0cc6d0 0x7fe33c155380 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe334009eb0 tx=0x7fe334004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3327fc640 1 -- 172.21.15.79:0/3838403285 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334040070 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3327fc640 1 -- 172.21.15.79:0/3838403285 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe334031bc0 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe3327fc640 1 -- 172.21.15.79:0/3838403285 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334045460 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.232+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c1f2250 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.233+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c1f2af0 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.234+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33c15d530 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.234+0000 7fe3327fc640 1 -- 172.21.15.79:0/3838403285 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe334039040 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.234+0000 7fe3327fc640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe32006be30 0x7fe32006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.235+0000 7fe3327fc640 1 -- 172.21.15.79:0/3838403285 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6217+0+0 (secure 0 0 0) 0x7fe3340aca00 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.235+0000 7fe341fe9640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe32006be30 0x7fe32006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.235+0000 7fe341fe9640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe32006be30 0x7fe32006e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe338006fd0 tx=0x7fe338008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.239+0000 7fe3327fc640 1 -- 172.21.15.79:0/3838403285 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe33c15d530 con 0x7fe33c0cc6d0 2024-06-10T00:17:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.408+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe33c15a230 con 0x7fe32006be30 2024-06-10T00:17:25.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.414+0000 7fe3327fc640 1 -- 172.21.15.79:0/3838403285 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252020 (secure 0 0 0) 0x7fe338003e90 con 0x7fe32006be30 2024-06-10T00:17:25.417 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:25.418 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe32006be30 msgr2=0x7fe32006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe32006be30 0x7fe32006e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe338006fd0 tx=0x7fe338008040 comp rx=0 tx=0).stop 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0cc6d0 msgr2=0x7fe33c155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0cc6d0 0x7fe33c155380 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe334009eb0 tx=0x7fe334004a40 comp rx=0 tx=0).stop 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 shutdown_connections 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe32006be30 0x7fe32006e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe33c0cc6d0 0x7fe33c155380 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe33c0720e0 0x7fe33c154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 --2- 172.21.15.79:0/3838403285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe33c071c60 0x7fe33c0ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 >> 172.21.15.79:0/3838403285 conn(0x7fe33c0b19f0 msgr2=0x7fe33c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 shutdown_connections 2024-06-10T00:17:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.417+0000 7fe34424d640 1 -- 172.21.15.79:0/3838403285 wait complete. 2024-06-10T00:17:25.428 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-06-10T00:17:25.181074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223188,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751532,"statfs":{"total":773094113280,"available":772865568768,"internally_reserved":0,"allocated":7151616,"data_stored":3832940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.431810"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656303+0000","last_change":"2024-06-10T00:17:17.766574+0000","last_active":"2024-06-10T00:17:19.656303+0000","last_peered":"2024-06-10T00:17:19.656303+0000","last_clean":"2024-06-10T00:17:19.656303+0000","last_became_active":"2024-06-10T00:17:17.766301+0000","last_became_peered":"2024-06-10T00:17:17.766301+0000","last_unstale":"2024-06-10T00:17:19.656303+0000","last_undegraded":"2024-06-10T00:17:19.656303+0000","last_fullsized":"2024-06-10T00:17:19.656303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:46:53.710131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656440+0000","last_change":"2024-06-10T00:17:17.769661+0000","last_active":"2024-06-10T00:17:19.656440+0000","last_peered":"2024-06-10T00:17:19.656440+0000","last_clean":"2024-06-10T00:17:19.656440+0000","last_became_active":"2024-06-10T00:17:17.769408+0000","last_became_peered":"2024-06-10T00:17:17.769408+0000","last_unstale":"2024-06-10T00:17:19.656440+0000","last_undegraded":"2024-06-10T00:17:19.656440+0000","last_fullsized":"2024-06-10T00:17:19.656440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:48:18.475049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656128+0000","last_change":"2024-06-10T00:17:17.778188+0000","last_active":"2024-06-10T00:17:19.656128+0000","last_peered":"2024-06-10T00:17:19.656128+0000","last_clean":"2024-06-10T00:17:19.656128+0000","last_became_active":"2024-06-10T00:17:17.777916+0000","last_became_peered":"2024-06-10T00:17:17.777916+0000","last_unstale":"2024-06-10T00:17:19.656128+0000","last_undegraded":"2024-06-10T00:17:19.656128+0000","last_fullsized":"2024-06-10T00:17:19.656128+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:46:42.871896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753281+0000","last_change":"2024-06-10T00:17:17.770623+0000","last_active":"2024-06-10T00:17:18.753281+0000","last_peered":"2024-06-10T00:17:18.753281+0000","last_clean":"2024-06-10T00:17:18.753281+0000","last_became_active":"2024-06-10T00:17:17.770361+0000","last_became_peered":"2024-06-10T00:17:17.770361+0000","last_unstale":"2024-06-10T00:17:18.753281+0000","last_undegraded":"2024-06-10T00:17:18.753281+0000","last_fullsized":"2024-06-10T00:17:18.753281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:05:45.854551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.298887+0000","last_change":"2024-06-10T00:17:17.777212+0000","last_active":"2024-06-10T00:17:19.298887+0000","last_peered":"2024-06-10T00:17:19.298887+0000","last_clean":"2024-06-10T00:17:19.298887+0000","last_became_active":"2024-06-10T00:17:17.776931+0000","last_became_peered":"2024-06-10T00:17:17.776931+0000","last_unstale":"2024-06-10T00:17:19.298887+0000","last_undegraded":"2024-06-10T00:17:19.298887+0000","last_fullsized":"2024-06-10T00:17:19.298887+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:36:01.463706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655923+0000","last_change":"2024-06-10T00:17:17.774030+0000","last_active":"2024-06-10T00:17:19.655923+0000","last_peered":"2024-06-10T00:17:19.655923+0000","last_clean":"2024-06-10T00:17:19.655923+0000","last_became_active":"2024-06-10T00:17:17.773325+0000","last_became_peered":"2024-06-10T00:17:17.773325+0000","last_unstale":"2024-06-10T00:17:19.655923+0000","last_undegraded":"2024-06-10T00:17:19.655923+0000","last_fullsized":"2024-06-10T00:17:19.655923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:49:55.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.751714+0000","last_change":"2024-06-10T00:17:17.767856+0000","last_active":"2024-06-10T00:17:18.751714+0000","last_peered":"2024-06-10T00:17:18.751714+0000","last_clean":"2024-06-10T00:17:18.751714+0000","last_became_active":"2024-06-10T00:17:17.767537+0000","last_became_peered":"2024-06-10T00:17:17.767537+0000","last_unstale":"2024-06-10T00:17:18.751714+0000","last_undegraded":"2024-06-10T00:17:18.751714+0000","last_fullsized":"2024-06-10T00:17:18.751714+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:35:54.781409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753984+0000","last_change":"2024-06-10T00:17:17.774562+0000","last_active":"2024-06-10T00:17:18.753984+0000","last_peered":"2024-06-10T00:17:18.753984+0000","last_clean":"2024-06-10T00:17:18.753984+0000","last_became_active":"2024-06-10T00:17:17.774285+0000","last_became_peered":"2024-06-10T00:17:17.774285+0000","last_unstale":"2024-06-10T00:17:18.753984+0000","last_undegraded":"2024-06-10T00:17:18.753984+0000","last_fullsized":"2024-06-10T00:17:18.753984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:06:49.239579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656389+0000","last_change":"2024-06-10T00:17:17.769431+0000","last_active":"2024-06-10T00:17:19.656389+0000","last_peered":"2024-06-10T00:17:19.656389+0000","last_clean":"2024-06-10T00:17:19.656389+0000","last_became_active":"2024-06-10T00:17:17.769142+0000","last_became_peered":"2024-06-10T00:17:17.769142+0000","last_unstale":"2024-06-10T00:17:19.656389+0000","last_undegraded":"2024-06-10T00:17:19.656389+0000","last_fullsized":"2024-06-10T00:17:19.656389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656248+0000","last_change":"2024-06-10T00:17:17.768677+0000","last_active":"2024-06-10T00:17:19.656248+0000","last_peered":"2024-06-10T00:17:19.656248+0000","last_clean":"2024-06-10T00:17:19.656248+0000","last_became_active":"2024-06-10T00:17:17.768400+0000","last_became_peered":"2024-06-10T00:17:17.768400+0000","last_unstale":"2024-06-10T00:17:19.656248+0000","last_undegraded":"2024-06-10T00:17:19.656248+0000","last_fullsized":"2024-06-10T00:17:19.656248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:49:55.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753422+0000","last_change":"2024-06-10T00:17:17.764738+0000","last_active":"2024-06-10T00:17:18.753422+0000","last_peered":"2024-06-10T00:17:18.753422+0000","last_clean":"2024-06-10T00:17:18.753422+0000","last_became_active":"2024-06-10T00:17:17.764404+0000","last_became_peered":"2024-06-10T00:17:17.764404+0000","last_unstale":"2024-06-10T00:17:18.753422+0000","last_undegraded":"2024-06-10T00:17:18.753422+0000","last_fullsized":"2024-06-10T00:17:18.753422+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:06:04.079586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754217+0000","last_change":"2024-06-10T00:17:17.775254+0000","last_active":"2024-06-10T00:17:18.754217+0000","last_peered":"2024-06-10T00:17:18.754217+0000","last_clean":"2024-06-10T00:17:18.754217+0000","last_became_active":"2024-06-10T00:17:17.774397+0000","last_became_peered":"2024-06-10T00:17:17.774397+0000","last_unstale":"2024-06-10T00:17:18.754217+0000","last_undegraded":"2024-06-10T00:17:18.754217+0000","last_fullsized":"2024-06-10T00:17:18.754217+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:24:29.904612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754088+0000","last_change":"2024-06-10T00:17:17.765336+0000","last_active":"2024-06-10T00:17:18.754088+0000","last_peered":"2024-06-10T00:17:18.754088+0000","last_clean":"2024-06-10T00:17:18.754088+0000","last_became_active":"2024-06-10T00:17:17.765065+0000","last_became_peered":"2024-06-10T00:17:17.765065+0000","last_unstale":"2024-06-10T00:17:18.754088+0000","last_undegraded":"2024-06-10T00:17:18.754088+0000","last_fullsized":"2024-06-10T00:17:18.754088+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:01:26.272895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655897+0000","last_change":"2024-06-10T00:17:17.772783+0000","last_active":"2024-06-10T00:17:19.655897+0000","last_peered":"2024-06-10T00:17:19.655897+0000","last_clean":"2024-06-10T00:17:19.655897+0000","last_became_active":"2024-06-10T00:17:17.772240+0000","last_became_peered":"2024-06-10T00:17:17.772240+0000","last_unstale":"2024-06-10T00:17:19.655897+0000","last_undegraded":"2024-06-10T00:17:19.655897+0000","last_fullsized":"2024-06-10T00:17:19.655897+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:19:42.273789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655800+0000","last_change":"2024-06-10T00:17:17.770012+0000","last_active":"2024-06-10T00:17:19.655800+0000","last_peered":"2024-06-10T00:17:19.655800+0000","last_clean":"2024-06-10T00:17:19.655800+0000","last_became_active":"2024-06-10T00:17:17.769521+0000","last_became_peered":"2024-06-10T00:17:17.769521+0000","last_unstale":"2024-06-10T00:17:19.655800+0000","last_undegraded":"2024-06-10T00:17:19.655800+0000","last_fullsized":"2024-06-10T00:17:19.655800+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:06:49.239579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.751886+0000","last_change":"2024-06-10T00:17:17.763946+0000","last_active":"2024-06-10T00:17:18.751886+0000","last_peered":"2024-06-10T00:17:18.751886+0000","last_clean":"2024-06-10T00:17:18.751886+0000","last_became_active":"2024-06-10T00:17:17.760420+0000","last_became_peered":"2024-06-10T00:17:17.760420+0000","last_unstale":"2024-06-10T00:17:18.751886+0000","last_undegraded":"2024-06-10T00:17:18.751886+0000","last_fullsized":"2024-06-10T00:17:18.751886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:38:46.104598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656454+0000","last_change":"2024-06-10T00:17:17.768114+0000","last_active":"2024-06-10T00:17:19.656454+0000","last_peered":"2024-06-10T00:17:19.656454+0000","last_clean":"2024-06-10T00:17:19.656454+0000","last_became_active":"2024-06-10T00:17:17.767854+0000","last_became_peered":"2024-06-10T00:17:17.767854+0000","last_unstale":"2024-06-10T00:17:19.656454+0000","last_undegraded":"2024-06-10T00:17:19.656454+0000","last_fullsized":"2024-06-10T00:17:19.656454+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:26:24.974061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753504+0000","last_change":"2024-06-10T00:17:17.768044+0000","last_active":"2024-06-10T00:17:18.753504+0000","last_peered":"2024-06-10T00:17:18.753504+0000","last_clean":"2024-06-10T00:17:18.753504+0000","last_became_active":"2024-06-10T00:17:17.767762+0000","last_became_peered":"2024-06-10T00:17:17.767762+0000","last_unstale":"2024-06-10T00:17:18.753504+0000","last_undegraded":"2024-06-10T00:17:18.753504+0000","last_fullsized":"2024-06-10T00:17:18.753504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:05:46.702705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.299048+0000","last_change":"2024-06-10T00:17:17.777161+0000","last_active":"2024-06-10T00:17:19.299048+0000","last_peered":"2024-06-10T00:17:19.299048+0000","last_clean":"2024-06-10T00:17:19.299048+0000","last_became_active":"2024-06-10T00:17:17.776866+0000","last_became_peered":"2024-06-10T00:17:17.776866+0000","last_unstale":"2024-06-10T00:17:19.299048+0000","last_undegraded":"2024-06-10T00:17:19.299048+0000","last_fullsized":"2024-06-10T00:17:19.299048+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:53:41.440351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133461+0000","last_change":"2024-06-10T00:17:17.773580+0000","last_active":"2024-06-10T00:17:19.133461+0000","last_peered":"2024-06-10T00:17:19.133461+0000","last_clean":"2024-06-10T00:17:19.133461+0000","last_became_active":"2024-06-10T00:17:17.773221+0000","last_became_peered":"2024-06-10T00:17:17.773221+0000","last_unstale":"2024-06-10T00:17:19.133461+0000","last_undegraded":"2024-06-10T00:17:19.133461+0000","last_fullsized":"2024-06-10T00:17:19.133461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:32:01.995484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754305+0000","last_change":"2024-06-10T00:17:17.760434+0000","last_active":"2024-06-10T00:17:18.754305+0000","last_peered":"2024-06-10T00:17:18.754305+0000","last_clean":"2024-06-10T00:17:18.754305+0000","last_became_active":"2024-06-10T00:17:17.760132+0000","last_became_peered":"2024-06-10T00:17:17.760132+0000","last_unstale":"2024-06-10T00:17:18.754305+0000","last_undegraded":"2024-06-10T00:17:18.754305+0000","last_fullsized":"2024-06-10T00:17:18.754305+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:49:55.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133255+0000","last_change":"2024-06-10T00:17:17.769441+0000","last_active":"2024-06-10T00:17:19.133255+0000","last_peered":"2024-06-10T00:17:19.133255+0000","last_clean":"2024-06-10T00:17:19.133255+0000","last_became_active":"2024-06-10T00:17:17.769128+0000","last_became_peered":"2024-06-10T00:17:17.769128+0000","last_unstale":"2024-06-10T00:17:19.133255+0000","last_undegraded":"2024-06-10T00:17:19.133255+0000","last_fullsized":"2024-06-10T00:17:19.133255+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133236+0000","last_change":"2024-06-10T00:17:17.768653+0000","last_active":"2024-06-10T00:17:19.133236+0000","last_peered":"2024-06-10T00:17:19.133236+0000","last_clean":"2024-06-10T00:17:19.133236+0000","last_became_active":"2024-06-10T00:17:17.768406+0000","last_became_peered":"2024-06-10T00:17:17.768406+0000","last_unstale":"2024-06-10T00:17:19.133236+0000","last_undegraded":"2024-06-10T00:17:19.133236+0000","last_fullsized":"2024-06-10T00:17:19.133236+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:17.257998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655746+0000","last_change":"2024-06-10T00:17:17.769441+0000","last_active":"2024-06-10T00:17:19.655746+0000","last_peered":"2024-06-10T00:17:19.655746+0000","last_clean":"2024-06-10T00:17:19.655746+0000","last_became_active":"2024-06-10T00:17:17.769155+0000","last_became_peered":"2024-06-10T00:17:17.769155+0000","last_unstale":"2024-06-10T00:17:19.655746+0000","last_undegraded":"2024-06-10T00:17:19.655746+0000","last_fullsized":"2024-06-10T00:17:19.655746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:31:35.199713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754224+0000","last_change":"2024-06-10T00:17:17.770503+0000","last_active":"2024-06-10T00:17:18.754224+0000","last_peered":"2024-06-10T00:17:18.754224+0000","last_clean":"2024-06-10T00:17:18.754224+0000","last_became_active":"2024-06-10T00:17:17.770184+0000","last_became_peered":"2024-06-10T00:17:17.770184+0000","last_unstale":"2024-06-10T00:17:18.754224+0000","last_undegraded":"2024-06-10T00:17:18.754224+0000","last_fullsized":"2024-06-10T00:17:18.754224+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:46:42.871896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753616+0000","last_change":"2024-06-10T00:17:17.762845+0000","last_active":"2024-06-10T00:17:18.753616+0000","last_peered":"2024-06-10T00:17:18.753616+0000","last_clean":"2024-06-10T00:17:18.753616+0000","last_became_active":"2024-06-10T00:17:17.762583+0000","last_became_peered":"2024-06-10T00:17:17.762583+0000","last_unstale":"2024-06-10T00:17:18.753616+0000","last_undegraded":"2024-06-10T00:17:18.753616+0000","last_fullsized":"2024-06-10T00:17:18.753616+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:52:13.120340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753593+0000","last_change":"2024-06-10T00:17:17.764422+0000","last_active":"2024-06-10T00:17:18.753593+0000","last_peered":"2024-06-10T00:17:18.753593+0000","last_clean":"2024-06-10T00:17:18.753593+0000","last_became_active":"2024-06-10T00:17:17.764093+0000","last_became_peered":"2024-06-10T00:17:17.764093+0000","last_unstale":"2024-06-10T00:17:18.753593+0000","last_undegraded":"2024-06-10T00:17:18.753593+0000","last_fullsized":"2024-06-10T00:17:18.753593+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:26:12.829878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656438+0000","last_change":"2024-06-10T00:17:17.773727+0000","last_active":"2024-06-10T00:17:19.656438+0000","last_peered":"2024-06-10T00:17:19.656438+0000","last_clean":"2024-06-10T00:17:19.656438+0000","last_became_active":"2024-06-10T00:17:17.773478+0000","last_became_peered":"2024-06-10T00:17:17.773478+0000","last_unstale":"2024-06-10T00:17:19.656438+0000","last_undegraded":"2024-06-10T00:17:19.656438+0000","last_fullsized":"2024-06-10T00:17:19.656438+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:01:19.505513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655919+0000","last_change":"2024-06-10T00:17:17.768781+0000","last_active":"2024-06-10T00:17:19.655919+0000","last_peered":"2024-06-10T00:17:19.655919+0000","last_clean":"2024-06-10T00:17:19.655919+0000","last_became_active":"2024-06-10T00:17:17.768429+0000","last_became_peered":"2024-06-10T00:17:17.768429+0000","last_unstale":"2024-06-10T00:17:19.655919+0000","last_undegraded":"2024-06-10T00:17:19.655919+0000","last_fullsized":"2024-06-10T00:17:19.655919+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:01:26.272895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754306+0000","last_change":"2024-06-10T00:17:17.773861+0000","last_active":"2024-06-10T00:17:18.754306+0000","last_peered":"2024-06-10T00:17:18.754306+0000","last_clean":"2024-06-10T00:17:18.754306+0000","last_became_active":"2024-06-10T00:17:17.773607+0000","last_became_peered":"2024-06-10T00:17:17.773607+0000","last_unstale":"2024-06-10T00:17:18.754306+0000","last_undegraded":"2024-06-10T00:17:18.754306+0000","last_fullsized":"2024-06-10T00:17:18.754306+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:17.257998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753026+0000","last_change":"2024-06-10T00:17:17.763522+0000","last_active":"2024-06-10T00:17:18.753026+0000","last_peered":"2024-06-10T00:17:18.753026+0000","last_clean":"2024-06-10T00:17:18.753026+0000","last_became_active":"2024-06-10T00:17:17.763173+0000","last_became_peered":"2024-06-10T00:17:17.763173+0000","last_unstale":"2024-06-10T00:17:18.753026+0000","last_undegraded":"2024-06-10T00:17:18.753026+0000","last_fullsized":"2024-06-10T00:17:18.753026+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:34:57.391232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655718+0000","last_change":"2024-06-10T00:17:17.777802+0000","last_active":"2024-06-10T00:17:19.655718+0000","last_peered":"2024-06-10T00:17:19.655718+0000","last_clean":"2024-06-10T00:17:19.655718+0000","last_became_active":"2024-06-10T00:17:17.777493+0000","last_became_peered":"2024-06-10T00:17:17.777493+0000","last_unstale":"2024-06-10T00:17:19.655718+0000","last_undegraded":"2024-06-10T00:17:19.655718+0000","last_fullsized":"2024-06-10T00:17:19.655718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:24:29.904612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.299037+0000","last_change":"2024-06-10T00:17:17.777786+0000","last_active":"2024-06-10T00:17:19.299037+0000","last_peered":"2024-06-10T00:17:19.299037+0000","last_clean":"2024-06-10T00:17:19.299037+0000","last_became_active":"2024-06-10T00:17:17.777523+0000","last_became_peered":"2024-06-10T00:17:17.777523+0000","last_unstale":"2024-06-10T00:17:19.299037+0000","last_undegraded":"2024-06-10T00:17:19.299037+0000","last_fullsized":"2024-06-10T00:17:19.299037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:19:55.102245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656448+0000","last_change":"2024-06-10T00:17:16.743557+0000","last_active":"2024-06-10T00:17:19.656448+0000","last_peered":"2024-06-10T00:17:19.656448+0000","last_clean":"2024-06-10T00:17:19.656448+0000","last_became_active":"2024-06-10T00:17:16.743298+0000","last_became_peered":"2024-06-10T00:17:16.743298+0000","last_unstale":"2024-06-10T00:17:19.656448+0000","last_undegraded":"2024-06-10T00:17:19.656448+0000","last_fullsized":"2024-06-10T00:17:19.656448+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:05:44.849661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753757+0000","last_change":"2024-06-10T00:17:17.773569+0000","last_active":"2024-06-10T00:17:18.753757+0000","last_peered":"2024-06-10T00:17:18.753757+0000","last_clean":"2024-06-10T00:17:18.753757+0000","last_became_active":"2024-06-10T00:17:17.773281+0000","last_became_peered":"2024-06-10T00:17:17.773281+0000","last_unstale":"2024-06-10T00:17:18.753757+0000","last_undegraded":"2024-06-10T00:17:18.753757+0000","last_fullsized":"2024-06-10T00:17:18.753757+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:48:31.878835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656204+0000","last_change":"2024-06-10T00:17:16.743822+0000","last_active":"2024-06-10T00:17:19.656204+0000","last_peered":"2024-06-10T00:17:19.656204+0000","last_clean":"2024-06-10T00:17:19.656204+0000","last_became_active":"2024-06-10T00:17:16.743547+0000","last_became_peered":"2024-06-10T00:17:16.743547+0000","last_unstale":"2024-06-10T00:17:19.656204+0000","last_undegraded":"2024-06-10T00:17:19.656204+0000","last_fullsized":"2024-06-10T00:17:19.656204+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:01:05.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656057+0000","last_change":"2024-06-10T00:17:17.777592+0000","last_active":"2024-06-10T00:17:19.656057+0000","last_peered":"2024-06-10T00:17:19.656057+0000","last_clean":"2024-06-10T00:17:19.656057+0000","last_became_active":"2024-06-10T00:17:17.777316+0000","last_became_peered":"2024-06-10T00:17:17.777316+0000","last_unstale":"2024-06-10T00:17:19.656057+0000","last_undegraded":"2024-06-10T00:17:19.656057+0000","last_fullsized":"2024-06-10T00:17:19.656057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656075+0000","last_change":"2024-06-10T00:17:16.749259+0000","last_active":"2024-06-10T00:17:19.656075+0000","last_peered":"2024-06-10T00:17:19.656075+0000","last_clean":"2024-06-10T00:17:19.656075+0000","last_became_active":"2024-06-10T00:17:16.748987+0000","last_became_peered":"2024-06-10T00:17:16.748987+0000","last_unstale":"2024-06-10T00:17:19.656075+0000","last_undegraded":"2024-06-10T00:17:19.656075+0000","last_fullsized":"2024-06-10T00:17:19.656075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:54:11.981027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656281+0000","last_change":"2024-06-10T00:17:17.778912+0000","last_active":"2024-06-10T00:17:19.656281+0000","last_peered":"2024-06-10T00:17:19.656281+0000","last_clean":"2024-06-10T00:17:19.656281+0000","last_became_active":"2024-06-10T00:17:17.778652+0000","last_became_peered":"2024-06-10T00:17:17.778652+0000","last_unstale":"2024-06-10T00:17:19.656281+0000","last_undegraded":"2024-06-10T00:17:19.656281+0000","last_fullsized":"2024-06-10T00:17:19.656281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:17.257998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656013+0000","last_change":"2024-06-10T00:17:16.751333+0000","last_active":"2024-06-10T00:17:19.656013+0000","last_peered":"2024-06-10T00:17:19.656013+0000","last_clean":"2024-06-10T00:17:19.656013+0000","last_became_active":"2024-06-10T00:17:16.751023+0000","last_became_peered":"2024-06-10T00:17:16.751023+0000","last_unstale":"2024-06-10T00:17:19.656013+0000","last_undegraded":"2024-06-10T00:17:19.656013+0000","last_fullsized":"2024-06-10T00:17:19.656013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:01:18.500623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.751715+0000","last_change":"2024-06-10T00:17:17.757129+0000","last_active":"2024-06-10T00:17:18.751715+0000","last_peered":"2024-06-10T00:17:18.751715+0000","last_clean":"2024-06-10T00:17:18.751715+0000","last_became_active":"2024-06-10T00:17:17.756820+0000","last_became_peered":"2024-06-10T00:17:17.756820+0000","last_unstale":"2024-06-10T00:17:18.751715+0000","last_undegraded":"2024-06-10T00:17:18.751715+0000","last_fullsized":"2024-06-10T00:17:18.751715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:16:48.170837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133336+0000","last_change":"2024-06-10T00:17:16.746309+0000","last_active":"2024-06-10T00:17:19.133336+0000","last_peered":"2024-06-10T00:17:19.133336+0000","last_clean":"2024-06-10T00:17:19.133336+0000","last_became_active":"2024-06-10T00:17:16.745874+0000","last_became_peered":"2024-06-10T00:17:16.745874+0000","last_unstale":"2024-06-10T00:17:19.133336+0000","last_undegraded":"2024-06-10T00:17:19.133336+0000","last_fullsized":"2024-06-10T00:17:19.133336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:31:34.194824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655618+0000","last_change":"2024-06-10T00:17:17.768095+0000","last_active":"2024-06-10T00:17:19.655618+0000","last_peered":"2024-06-10T00:17:19.655618+0000","last_clean":"2024-06-10T00:17:19.655618+0000","last_became_active":"2024-06-10T00:17:17.767805+0000","last_became_peered":"2024-06-10T00:17:17.767805+0000","last_unstale":"2024-06-10T00:17:19.655618+0000","last_undegraded":"2024-06-10T00:17:19.655618+0000","last_fullsized":"2024-06-10T00:17:19.655618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:51:48.686965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133185+0000","last_change":"2024-06-10T00:17:16.748542+0000","last_active":"2024-06-10T00:17:19.133185+0000","last_peered":"2024-06-10T00:17:19.133185+0000","last_clean":"2024-06-10T00:17:19.133185+0000","last_became_active":"2024-06-10T00:17:16.748269+0000","last_became_peered":"2024-06-10T00:17:16.748269+0000","last_unstale":"2024-06-10T00:17:19.133185+0000","last_undegraded":"2024-06-10T00:17:19.133185+0000","last_fullsized":"2024-06-10T00:17:19.133185+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:54:11.981027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.298746+0000","last_change":"2024-06-10T00:17:17.780073+0000","last_active":"2024-06-10T00:17:19.298746+0000","last_peered":"2024-06-10T00:17:19.298746+0000","last_clean":"2024-06-10T00:17:19.298746+0000","last_became_active":"2024-06-10T00:17:17.779629+0000","last_became_peered":"2024-06-10T00:17:17.779629+0000","last_unstale":"2024-06-10T00:17:19.298746+0000","last_undegraded":"2024-06-10T00:17:19.298746+0000","last_fullsized":"2024-06-10T00:17:19.298746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:26:12.829878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133193+0000","last_change":"2024-06-10T00:17:16.747249+0000","last_active":"2024-06-10T00:17:19.133193+0000","last_peered":"2024-06-10T00:17:19.133193+0000","last_clean":"2024-06-10T00:17:19.133193+0000","last_became_active":"2024-06-10T00:17:16.746964+0000","last_became_peered":"2024-06-10T00:17:16.746964+0000","last_unstale":"2024-06-10T00:17:19.133193+0000","last_undegraded":"2024-06-10T00:17:19.133193+0000","last_fullsized":"2024-06-10T00:17:19.133193+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:01:05.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133500+0000","last_change":"2024-06-10T00:17:17.764883+0000","last_active":"2024-06-10T00:17:19.133500+0000","last_peered":"2024-06-10T00:17:19.133500+0000","last_clean":"2024-06-10T00:17:19.133500+0000","last_became_active":"2024-06-10T00:17:17.764356+0000","last_became_peered":"2024-06-10T00:17:17.764356+0000","last_unstale":"2024-06-10T00:17:19.133500+0000","last_undegraded":"2024-06-10T00:17:19.133500+0000","last_fullsized":"2024-06-10T00:17:19.133500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:30:09.521064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.298667+0000","last_change":"2024-06-10T00:17:16.744059+0000","last_active":"2024-06-10T00:17:19.298667+0000","last_peered":"2024-06-10T00:17:19.298667+0000","last_clean":"2024-06-10T00:17:19.298667+0000","last_became_active":"2024-06-10T00:17:16.743625+0000","last_became_peered":"2024-06-10T00:17:16.743625+0000","last_unstale":"2024-06-10T00:17:19.298667+0000","last_undegraded":"2024-06-10T00:17:19.298667+0000","last_fullsized":"2024-06-10T00:17:19.298667+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:31:41.516691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656373+0000","last_change":"2024-06-10T00:17:17.756919+0000","last_active":"2024-06-10T00:17:19.656373+0000","last_peered":"2024-06-10T00:17:19.656373+0000","last_clean":"2024-06-10T00:17:19.656373+0000","last_became_active":"2024-06-10T00:17:17.756597+0000","last_became_peered":"2024-06-10T00:17:17.756597+0000","last_unstale":"2024-06-10T00:17:19.656373+0000","last_undegraded":"2024-06-10T00:17:19.656373+0000","last_fullsized":"2024-06-10T00:17:19.656373+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:45.523804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656397+0000","last_change":"2024-06-10T00:17:16.748675+0000","last_active":"2024-06-10T00:17:19.656397+0000","last_peered":"2024-06-10T00:17:19.656397+0000","last_clean":"2024-06-10T00:17:19.656397+0000","last_became_active":"2024-06-10T00:17:16.748415+0000","last_became_peered":"2024-06-10T00:17:16.748415+0000","last_unstale":"2024-06-10T00:17:19.656397+0000","last_undegraded":"2024-06-10T00:17:19.656397+0000","last_fullsized":"2024-06-10T00:17:19.656397+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:51:47.682075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133389+0000","last_change":"2024-06-10T00:17:17.764570+0000","last_active":"2024-06-10T00:17:19.133389+0000","last_peered":"2024-06-10T00:17:19.133389+0000","last_clean":"2024-06-10T00:17:19.133389+0000","last_became_active":"2024-06-10T00:17:17.764268+0000","last_became_peered":"2024-06-10T00:17:17.764268+0000","last_unstale":"2024-06-10T00:17:19.133389+0000","last_undegraded":"2024-06-10T00:17:19.133389+0000","last_fullsized":"2024-06-10T00:17:19.133389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:58:51.504905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753711+0000","last_change":"2024-06-10T00:17:16.742110+0000","last_active":"2024-06-10T00:17:18.753711+0000","last_peered":"2024-06-10T00:17:18.753711+0000","last_clean":"2024-06-10T00:17:18.753711+0000","last_became_active":"2024-06-10T00:17:16.740634+0000","last_became_peered":"2024-06-10T00:17:16.740634+0000","last_unstale":"2024-06-10T00:17:18.753711+0000","last_undegraded":"2024-06-10T00:17:18.753711+0000","last_fullsized":"2024-06-10T00:17:18.753711+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:59.964932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.299133+0000","last_change":"2024-06-10T00:17:17.774074+0000","last_active":"2024-06-10T00:17:19.299133+0000","last_peered":"2024-06-10T00:17:19.299133+0000","last_clean":"2024-06-10T00:17:19.299133+0000","last_became_active":"2024-06-10T00:17:17.773790+0000","last_became_peered":"2024-06-10T00:17:17.773790+0000","last_unstale":"2024-06-10T00:17:19.299133+0000","last_undegraded":"2024-06-10T00:17:19.299133+0000","last_fullsized":"2024-06-10T00:17:19.299133+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:55:25.997519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656022+0000","last_change":"2024-06-10T00:17:16.751333+0000","last_active":"2024-06-10T00:17:19.656022+0000","last_peered":"2024-06-10T00:17:19.656022+0000","last_clean":"2024-06-10T00:17:19.656022+0000","last_became_active":"2024-06-10T00:17:16.751014+0000","last_became_peered":"2024-06-10T00:17:16.751014+0000","last_unstale":"2024-06-10T00:17:19.656022+0000","last_undegraded":"2024-06-10T00:17:19.656022+0000","last_fullsized":"2024-06-10T00:17:19.656022+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:05:43.587439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753642+0000","last_change":"2024-06-10T00:17:17.764880+0000","last_active":"2024-06-10T00:17:18.753642+0000","last_peered":"2024-06-10T00:17:18.753642+0000","last_clean":"2024-06-10T00:17:18.753642+0000","last_became_active":"2024-06-10T00:17:17.764586+0000","last_became_peered":"2024-06-10T00:17:17.764586+0000","last_unstale":"2024-06-10T00:17:18.753642+0000","last_undegraded":"2024-06-10T00:17:18.753642+0000","last_fullsized":"2024-06-10T00:17:18.753642+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:36:01.463706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656428+0000","last_change":"2024-06-10T00:17:16.750403+0000","last_active":"2024-06-10T00:17:19.656428+0000","last_peered":"2024-06-10T00:17:19.656428+0000","last_clean":"2024-06-10T00:17:19.656428+0000","last_became_active":"2024-06-10T00:17:16.744323+0000","last_became_peered":"2024-06-10T00:17:16.744323+0000","last_unstale":"2024-06-10T00:17:19.656428+0000","last_undegraded":"2024-06-10T00:17:19.656428+0000","last_fullsized":"2024-06-10T00:17:19.656428+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:05:45.697816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.752763+0000","last_change":"2024-06-10T00:17:17.765739+0000","last_active":"2024-06-10T00:17:18.752763+0000","last_peered":"2024-06-10T00:17:18.752763+0000","last_clean":"2024-06-10T00:17:18.752763+0000","last_became_active":"2024-06-10T00:17:17.765468+0000","last_became_peered":"2024-06-10T00:17:17.765468+0000","last_unstale":"2024-06-10T00:17:18.752763+0000","last_undegraded":"2024-06-10T00:17:18.752763+0000","last_fullsized":"2024-06-10T00:17:18.752763+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:47:07.799361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655913+0000","last_change":"2024-06-10T00:17:16.745251+0000","last_active":"2024-06-10T00:17:19.655913+0000","last_peered":"2024-06-10T00:17:19.655913+0000","last_clean":"2024-06-10T00:17:19.655913+0000","last_became_active":"2024-06-10T00:17:16.744932+0000","last_became_peered":"2024-06-10T00:17:16.744932+0000","last_unstale":"2024-06-10T00:17:19.655913+0000","last_undegraded":"2024-06-10T00:17:19.655913+0000","last_fullsized":"2024-06-10T00:17:19.655913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:26.193018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753343+0000","last_change":"2024-06-10T00:17:17.773225+0000","last_active":"2024-06-10T00:17:18.753343+0000","last_peered":"2024-06-10T00:17:18.753343+0000","last_clean":"2024-06-10T00:17:18.753343+0000","last_became_active":"2024-06-10T00:17:17.772314+0000","last_became_peered":"2024-06-10T00:17:17.772314+0000","last_unstale":"2024-06-10T00:17:18.753343+0000","last_undegraded":"2024-06-10T00:17:18.753343+0000","last_fullsized":"2024-06-10T00:17:18.753343+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:09:44.976442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754116+0000","last_change":"2024-06-10T00:17:16.746505+0000","last_active":"2024-06-10T00:17:18.754116+0000","last_peered":"2024-06-10T00:17:18.754116+0000","last_clean":"2024-06-10T00:17:18.754116+0000","last_became_active":"2024-06-10T00:17:16.746231+0000","last_became_peered":"2024-06-10T00:17:16.746231+0000","last_unstale":"2024-06-10T00:17:18.754116+0000","last_undegraded":"2024-06-10T00:17:18.754116+0000","last_fullsized":"2024-06-10T00:17:18.754116+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:26.193018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.298729+0000","last_change":"2024-06-10T00:17:17.777137+0000","last_active":"2024-06-10T00:17:19.298729+0000","last_peered":"2024-06-10T00:17:19.298729+0000","last_clean":"2024-06-10T00:17:19.298729+0000","last_became_active":"2024-06-10T00:17:17.776831+0000","last_became_peered":"2024-06-10T00:17:17.776831+0000","last_unstale":"2024-06-10T00:17:19.298729+0000","last_undegraded":"2024-06-10T00:17:19.298729+0000","last_fullsized":"2024-06-10T00:17:19.298729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:05:46.702705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655854+0000","last_change":"2024-06-10T00:17:16.748668+0000","last_active":"2024-06-10T00:17:19.655854+0000","last_peered":"2024-06-10T00:17:19.655854+0000","last_clean":"2024-06-10T00:17:19.655854+0000","last_became_active":"2024-06-10T00:17:16.748376+0000","last_became_peered":"2024-06-10T00:17:16.748376+0000","last_unstale":"2024-06-10T00:17:19.655854+0000","last_undegraded":"2024-06-10T00:17:19.655854+0000","last_fullsized":"2024-06-10T00:17:19.655854+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:46:52.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656020+0000","last_change":"2024-06-10T00:17:17.768754+0000","last_active":"2024-06-10T00:17:19.656020+0000","last_peered":"2024-06-10T00:17:19.656020+0000","last_clean":"2024-06-10T00:17:19.656020+0000","last_became_active":"2024-06-10T00:17:17.768502+0000","last_became_peered":"2024-06-10T00:17:17.768502+0000","last_unstale":"2024-06-10T00:17:19.656020+0000","last_undegraded":"2024-06-10T00:17:19.656020+0000","last_fullsized":"2024-06-10T00:17:19.656020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:01:34.231427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.752843+0000","last_change":"2024-06-10T00:17:16.745733+0000","last_active":"2024-06-10T00:17:18.752843+0000","last_peered":"2024-06-10T00:17:18.752843+0000","last_clean":"2024-06-10T00:17:18.752843+0000","last_became_active":"2024-06-10T00:17:16.745457+0000","last_became_peered":"2024-06-10T00:17:16.745457+0000","last_unstale":"2024-06-10T00:17:18.752843+0000","last_undegraded":"2024-06-10T00:17:18.752843+0000","last_fullsized":"2024-06-10T00:17:18.752843+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:35:16.652785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656114+0000","last_change":"2024-06-10T00:17:17.767356+0000","last_active":"2024-06-10T00:17:19.656114+0000","last_peered":"2024-06-10T00:17:19.656114+0000","last_clean":"2024-06-10T00:17:19.656114+0000","last_became_active":"2024-06-10T00:17:17.767049+0000","last_became_peered":"2024-06-10T00:17:17.767049+0000","last_unstale":"2024-06-10T00:17:19.656114+0000","last_undegraded":"2024-06-10T00:17:19.656114+0000","last_fullsized":"2024-06-10T00:17:19.656114+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:24:29.904612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754143+0000","last_change":"2024-06-10T00:17:16.739767+0000","last_active":"2024-06-10T00:17:18.754143+0000","last_peered":"2024-06-10T00:17:18.754143+0000","last_clean":"2024-06-10T00:17:18.754143+0000","last_became_active":"2024-06-10T00:17:16.739505+0000","last_became_peered":"2024-06-10T00:17:16.739505+0000","last_unstale":"2024-06-10T00:17:18.754143+0000","last_undegraded":"2024-06-10T00:17:18.754143+0000","last_fullsized":"2024-06-10T00:17:18.754143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:55:22.749416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.299102+0000","last_change":"2024-06-10T00:17:17.779843+0000","last_active":"2024-06-10T00:17:19.299102+0000","last_peered":"2024-06-10T00:17:19.299102+0000","last_clean":"2024-06-10T00:17:19.299102+0000","last_became_active":"2024-06-10T00:17:17.779546+0000","last_became_peered":"2024-06-10T00:17:17.779546+0000","last_unstale":"2024-06-10T00:17:19.299102+0000","last_undegraded":"2024-06-10T00:17:19.299102+0000","last_fullsized":"2024-06-10T00:17:19.299102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:27.197908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656146+0000","last_change":"2024-06-10T00:17:16.748204+0000","last_active":"2024-06-10T00:17:19.656146+0000","last_peered":"2024-06-10T00:17:19.656146+0000","last_clean":"2024-06-10T00:17:19.656146+0000","last_became_active":"2024-06-10T00:17:16.747916+0000","last_became_peered":"2024-06-10T00:17:16.747916+0000","last_unstale":"2024-06-10T00:17:19.656146+0000","last_undegraded":"2024-06-10T00:17:19.656146+0000","last_fullsized":"2024-06-10T00:17:19.656146+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:55:22.749416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753661+0000","last_change":"2024-06-10T00:17:17.774212+0000","last_active":"2024-06-10T00:17:18.753661+0000","last_peered":"2024-06-10T00:17:18.753661+0000","last_clean":"2024-06-10T00:17:18.753661+0000","last_became_active":"2024-06-10T00:17:17.773951+0000","last_became_peered":"2024-06-10T00:17:17.773951+0000","last_unstale":"2024-06-10T00:17:18.753661+0000","last_undegraded":"2024-06-10T00:17:18.753661+0000","last_fullsized":"2024-06-10T00:17:18.753661+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:12:13.398861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656145+0000","last_change":"2024-06-10T00:17:16.751170+0000","last_active":"2024-06-10T00:17:19.656145+0000","last_peered":"2024-06-10T00:17:19.656145+0000","last_clean":"2024-06-10T00:17:19.656145+0000","last_became_active":"2024-06-10T00:17:16.750941+0000","last_became_peered":"2024-06-10T00:17:16.750941+0000","last_unstale":"2024-06-10T00:17:19.656145+0000","last_undegraded":"2024-06-10T00:17:19.656145+0000","last_fullsized":"2024-06-10T00:17:19.656145+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:01:33.226537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.299140+0000","last_change":"2024-06-10T00:17:17.775820+0000","last_active":"2024-06-10T00:17:19.299140+0000","last_peered":"2024-06-10T00:17:19.299140+0000","last_clean":"2024-06-10T00:17:19.299140+0000","last_became_active":"2024-06-10T00:17:17.775565+0000","last_became_peered":"2024-06-10T00:17:17.775565+0000","last_unstale":"2024-06-10T00:17:19.299140+0000","last_undegraded":"2024-06-10T00:17:19.299140+0000","last_fullsized":"2024-06-10T00:17:19.299140+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:55:23.754305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133337+0000","last_change":"2024-06-10T00:17:16.749303+0000","last_active":"2024-06-10T00:17:19.133337+0000","last_peered":"2024-06-10T00:17:19.133337+0000","last_clean":"2024-06-10T00:17:19.133337+0000","last_became_active":"2024-06-10T00:17:16.749030+0000","last_became_peered":"2024-06-10T00:17:16.749030+0000","last_unstale":"2024-06-10T00:17:19.133337+0000","last_undegraded":"2024-06-10T00:17:19.133337+0000","last_fullsized":"2024-06-10T00:17:19.133337+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:52:12.115450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655807+0000","last_change":"2024-06-10T00:17:17.777638+0000","last_active":"2024-06-10T00:17:19.655807+0000","last_peered":"2024-06-10T00:17:19.655807+0000","last_clean":"2024-06-10T00:17:19.655807+0000","last_became_active":"2024-06-10T00:17:17.777359+0000","last_became_peered":"2024-06-10T00:17:17.777359+0000","last_unstale":"2024-06-10T00:17:19.655807+0000","last_undegraded":"2024-06-10T00:17:19.655807+0000","last_fullsized":"2024-06-10T00:17:19.655807+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:46:42.871896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656075+0000","last_change":"2024-06-10T00:17:16.745677+0000","last_active":"2024-06-10T00:17:19.656075+0000","last_peered":"2024-06-10T00:17:19.656075+0000","last_clean":"2024-06-10T00:17:19.656075+0000","last_became_active":"2024-06-10T00:17:16.745380+0000","last_became_peered":"2024-06-10T00:17:16.745380+0000","last_unstale":"2024-06-10T00:17:19.656075+0000","last_undegraded":"2024-06-10T00:17:19.656075+0000","last_fullsized":"2024-06-10T00:17:19.656075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:48:17.470159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754041+0000","last_change":"2024-06-10T00:17:17.769760+0000","last_active":"2024-06-10T00:17:18.754041+0000","last_peered":"2024-06-10T00:17:18.754041+0000","last_clean":"2024-06-10T00:17:18.754041+0000","last_became_active":"2024-06-10T00:17:17.769331+0000","last_became_peered":"2024-06-10T00:17:17.769331+0000","last_unstale":"2024-06-10T00:17:18.754041+0000","last_undegraded":"2024-06-10T00:17:18.754041+0000","last_fullsized":"2024-06-10T00:17:18.754041+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:19:42.273789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754203+0000","last_change":"2024-06-10T00:17:16.737844+0000","last_active":"2024-06-10T00:17:18.754203+0000","last_peered":"2024-06-10T00:17:18.754203+0000","last_clean":"2024-06-10T00:17:18.754203+0000","last_became_active":"2024-06-10T00:17:16.737526+0000","last_became_peered":"2024-06-10T00:17:16.737526+0000","last_unstale":"2024-06-10T00:17:18.754203+0000","last_undegraded":"2024-06-10T00:17:18.754203+0000","last_fullsized":"2024-06-10T00:17:18.754203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:55:24.992629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.298903+0000","last_change":"2024-06-10T00:17:17.779660+0000","last_active":"2024-06-10T00:17:19.298903+0000","last_peered":"2024-06-10T00:17:19.298903+0000","last_clean":"2024-06-10T00:17:19.298903+0000","last_became_active":"2024-06-10T00:17:17.779252+0000","last_became_peered":"2024-06-10T00:17:17.779252+0000","last_unstale":"2024-06-10T00:17:19.298903+0000","last_undegraded":"2024-06-10T00:17:19.298903+0000","last_fullsized":"2024-06-10T00:17:19.298903+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:12:13.398861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655553+0000","last_change":"2024-06-10T00:17:16.742707+0000","last_active":"2024-06-10T00:17:19.655553+0000","last_peered":"2024-06-10T00:17:19.655553+0000","last_clean":"2024-06-10T00:17:19.655553+0000","last_became_active":"2024-06-10T00:17:16.742427+0000","last_became_peered":"2024-06-10T00:17:16.742427+0000","last_unstale":"2024-06-10T00:17:19.655553+0000","last_undegraded":"2024-06-10T00:17:19.655553+0000","last_fullsized":"2024-06-10T00:17:19.655553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:26:23.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656037+0000","last_change":"2024-06-10T00:17:17.773155+0000","last_active":"2024-06-10T00:17:19.656037+0000","last_peered":"2024-06-10T00:17:19.656037+0000","last_clean":"2024-06-10T00:17:19.656037+0000","last_became_active":"2024-06-10T00:17:17.772809+0000","last_became_peered":"2024-06-10T00:17:17.772809+0000","last_unstale":"2024-06-10T00:17:19.656037+0000","last_undegraded":"2024-06-10T00:17:19.656037+0000","last_fullsized":"2024-06-10T00:17:19.656037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:13:17.257998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.754326+0000","last_change":"2024-06-10T00:17:16.744962+0000","last_active":"2024-06-10T00:17:18.754326+0000","last_peered":"2024-06-10T00:17:18.754326+0000","last_clean":"2024-06-10T00:17:18.754326+0000","last_became_active":"2024-06-10T00:17:16.744688+0000","last_became_peered":"2024-06-10T00:17:16.744688+0000","last_unstale":"2024-06-10T00:17:18.754326+0000","last_undegraded":"2024-06-10T00:17:18.754326+0000","last_fullsized":"2024-06-10T00:17:18.754326+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:51:47.682075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.751907+0000","last_change":"2024-06-10T00:17:17.769676+0000","last_active":"2024-06-10T00:17:18.751907+0000","last_peered":"2024-06-10T00:17:18.751907+0000","last_clean":"2024-06-10T00:17:18.751907+0000","last_became_active":"2024-06-10T00:17:17.769364+0000","last_became_peered":"2024-06-10T00:17:17.769364+0000","last_unstale":"2024-06-10T00:17:18.751907+0000","last_undegraded":"2024-06-10T00:17:18.751907+0000","last_fullsized":"2024-06-10T00:17:18.751907+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:37:43.701527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"61'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753993+0000","last_change":"2024-06-10T00:17:16.746678+0000","last_active":"2024-06-10T00:17:18.753993+0000","last_peered":"2024-06-10T00:17:18.753993+0000","last_clean":"2024-06-10T00:17:18.753993+0000","last_became_active":"2024-06-10T00:17:16.746343+0000","last_became_peered":"2024-06-10T00:17:16.746343+0000","last_unstale":"2024-06-10T00:17:18.753993+0000","last_undegraded":"2024-06-10T00:17:18.753993+0000","last_fullsized":"2024-06-10T00:17:18.753993+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:53:40.435462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753788+0000","last_change":"2024-06-10T00:17:17.771000+0000","last_active":"2024-06-10T00:17:18.753788+0000","last_peered":"2024-06-10T00:17:18.753788+0000","last_clean":"2024-06-10T00:17:18.753788+0000","last_became_active":"2024-06-10T00:17:17.770706+0000","last_became_peered":"2024-06-10T00:17:17.770706+0000","last_unstale":"2024-06-10T00:17:18.753788+0000","last_undegraded":"2024-06-10T00:17:18.753788+0000","last_fullsized":"2024-06-10T00:17:18.753788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:31:35.199713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656177+0000","last_change":"2024-06-10T00:17:16.748571+0000","last_active":"2024-06-10T00:17:19.656177+0000","last_peered":"2024-06-10T00:17:19.656177+0000","last_clean":"2024-06-10T00:17:19.656177+0000","last_became_active":"2024-06-10T00:17:16.748269+0000","last_became_peered":"2024-06-10T00:17:16.748269+0000","last_unstale":"2024-06-10T00:17:19.656177+0000","last_undegraded":"2024-06-10T00:17:19.656177+0000","last_fullsized":"2024-06-10T00:17:19.656177+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:31:20.182156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.299228+0000","last_change":"2024-06-10T00:17:17.775178+0000","last_active":"2024-06-10T00:17:19.299228+0000","last_peered":"2024-06-10T00:17:19.299228+0000","last_clean":"2024-06-10T00:17:19.299228+0000","last_became_active":"2024-06-10T00:17:17.774899+0000","last_became_peered":"2024-06-10T00:17:17.774899+0000","last_unstale":"2024-06-10T00:17:19.299228+0000","last_undegraded":"2024-06-10T00:17:19.299228+0000","last_fullsized":"2024-06-10T00:17:19.299228+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:51:48.686965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.656474+0000","last_change":"2024-06-10T00:17:16.744585+0000","last_active":"2024-06-10T00:17:19.656474+0000","last_peered":"2024-06-10T00:17:19.656474+0000","last_clean":"2024-06-10T00:17:19.656474+0000","last_became_active":"2024-06-10T00:17:16.744313+0000","last_became_peered":"2024-06-10T00:17:16.744313+0000","last_unstale":"2024-06-10T00:17:19.656474+0000","last_undegraded":"2024-06-10T00:17:19.656474+0000","last_fullsized":"2024-06-10T00:17:19.656474+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:06:03.074696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.298687+0000","last_change":"2024-06-10T00:17:17.780291+0000","last_active":"2024-06-10T00:17:19.298687+0000","last_peered":"2024-06-10T00:17:19.298687+0000","last_clean":"2024-06-10T00:17:19.298687+0000","last_became_active":"2024-06-10T00:17:17.780017+0000","last_became_peered":"2024-06-10T00:17:17.780017+0000","last_unstale":"2024-06-10T00:17:19.298687+0000","last_undegraded":"2024-06-10T00:17:19.298687+0000","last_fullsized":"2024-06-10T00:17:19.298687+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:06:04.079586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655973+0000","last_change":"2024-06-10T00:17:16.747401+0000","last_active":"2024-06-10T00:17:19.655973+0000","last_peered":"2024-06-10T00:17:19.655973+0000","last_clean":"2024-06-10T00:17:19.655973+0000","last_became_active":"2024-06-10T00:17:16.747133+0000","last_became_peered":"2024-06-10T00:17:16.747133+0000","last_unstale":"2024-06-10T00:17:19.655973+0000","last_undegraded":"2024-06-10T00:17:19.655973+0000","last_fullsized":"2024-06-10T00:17:19.655973+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:55:24.992629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.753091+0000","last_change":"2024-06-10T00:17:17.768758+0000","last_active":"2024-06-10T00:17:18.753091+0000","last_peered":"2024-06-10T00:17:18.753091+0000","last_clean":"2024-06-10T00:17:18.753091+0000","last_became_active":"2024-06-10T00:17:17.768498+0000","last_became_peered":"2024-06-10T00:17:17.768498+0000","last_unstale":"2024-06-10T00:17:18.753091+0000","last_undegraded":"2024-06-10T00:17:18.753091+0000","last_fullsized":"2024-06-10T00:17:18.753091+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:44:17.324307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133298+0000","last_change":"2024-06-10T00:17:16.743992+0000","last_active":"2024-06-10T00:17:19.133298+0000","last_peered":"2024-06-10T00:17:19.133298+0000","last_clean":"2024-06-10T00:17:19.133298+0000","last_became_active":"2024-06-10T00:17:16.743724+0000","last_became_peered":"2024-06-10T00:17:16.743724+0000","last_unstale":"2024-06-10T00:17:19.133298+0000","last_undegraded":"2024-06-10T00:17:19.133298+0000","last_fullsized":"2024-06-10T00:17:19.133298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:31:20.182156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655743+0000","last_change":"2024-06-10T00:17:17.767386+0000","last_active":"2024-06-10T00:17:19.655743+0000","last_peered":"2024-06-10T00:17:19.655743+0000","last_clean":"2024-06-10T00:17:19.655743+0000","last_became_active":"2024-06-10T00:17:17.767122+0000","last_became_peered":"2024-06-10T00:17:17.767122+0000","last_unstale":"2024-06-10T00:17:19.655743+0000","last_undegraded":"2024-06-10T00:17:19.655743+0000","last_fullsized":"2024-06-10T00:17:19.655743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:05:44.592328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133289+0000","last_change":"2024-06-10T00:17:16.747639+0000","last_active":"2024-06-10T00:17:19.133289+0000","last_peered":"2024-06-10T00:17:19.133289+0000","last_clean":"2024-06-10T00:17:19.133289+0000","last_became_active":"2024-06-10T00:17:16.747219+0000","last_became_peered":"2024-06-10T00:17:16.747219+0000","last_unstale":"2024-06-10T00:17:19.133289+0000","last_undegraded":"2024-06-10T00:17:19.133289+0000","last_fullsized":"2024-06-10T00:17:19.133289+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:09:43.971552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:18.751768+0000","last_change":"2024-06-10T00:17:17.760710+0000","last_active":"2024-06-10T00:17:18.751768+0000","last_peered":"2024-06-10T00:17:18.751768+0000","last_clean":"2024-06-10T00:17:18.751768+0000","last_became_active":"2024-06-10T00:17:17.760432+0000","last_became_peered":"2024-06-10T00:17:17.760432+0000","last_unstale":"2024-06-10T00:17:18.751768+0000","last_undegraded":"2024-06-10T00:17:18.751768+0000","last_fullsized":"2024-06-10T00:17:18.751768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:48:23.414553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655526+0000","last_change":"2024-06-10T00:17:16.744850+0000","last_active":"2024-06-10T00:17:19.655526+0000","last_peered":"2024-06-10T00:17:19.655526+0000","last_clean":"2024-06-10T00:17:19.655526+0000","last_became_active":"2024-06-10T00:17:16.744435+0000","last_became_peered":"2024-06-10T00:17:16.744435+0000","last_unstale":"2024-06-10T00:17:19.655526+0000","last_undegraded":"2024-06-10T00:17:19.655526+0000","last_fullsized":"2024-06-10T00:17:19.655526+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:44:16.319417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.298933+0000","last_change":"2024-06-10T00:17:17.781201+0000","last_active":"2024-06-10T00:17:19.298933+0000","last_peered":"2024-06-10T00:17:19.298933+0000","last_clean":"2024-06-10T00:17:19.298933+0000","last_became_active":"2024-06-10T00:17:17.780899+0000","last_became_peered":"2024-06-10T00:17:17.780899+0000","last_unstale":"2024-06-10T00:17:19.298933+0000","last_undegraded":"2024-06-10T00:17:19.298933+0000","last_fullsized":"2024-06-10T00:17:19.298933+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:16.726199+0000","last_clean_scrub_stamp":"2024-06-10T00:17:16.726199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:48:31.878835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.133112+0000","last_change":"2024-06-10T00:17:16.744881+0000","last_active":"2024-06-10T00:17:19.133112+0000","last_peered":"2024-06-10T00:17:19.133112+0000","last_clean":"2024-06-10T00:17:19.133112+0000","last_became_active":"2024-06-10T00:17:16.744583+0000","last_became_peered":"2024-06-10T00:17:16.744583+0000","last_unstale":"2024-06-10T00:17:19.133112+0000","last_undegraded":"2024-06-10T00:17:19.133112+0000","last_fullsized":"2024-06-10T00:17:19.133112+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:17:15.721310+0000","last_clean_scrub_stamp":"2024-06-10T00:17:15.721310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:26:23.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":244,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-06-10T00:17:19.655756+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:17:19.655756+0000","last_peered":"2024-06-10T00:17:19.655756+0000","last_clean":"2024-06-10T00:17:19.655756+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:17:19.655756+0000","last_undegraded":"2024-06-10T00:17:19.655756+0000","last_fullsized":"2024-06-10T00:17:19.655756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1347584,"data_stored":922067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":330957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":330945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":332535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":737280,"data_stored":330923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":737280,"data_stored":330923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":333299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1331200,"data_stored":921291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:17:25.432 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:17:25.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-10T00:17:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.575+0000 7fba4413b640 1 Processor -- start 2024-06-10T00:17:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.575+0000 7fba4413b640 1 -- start start 2024-06-10T00:17:25.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba4413b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c1589e0 0x7fba3c15f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba4413b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba3c0d06e0 0x7fba3c0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba4413b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c158dc0 con 0x7fba3c15ea40 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba4413b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fba3c0721b0 con 0x7fba3c0d06e0 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba4413b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba3c072490 con 0x7fba3c1589e0 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba426d8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba3c0d06e0 0x7fba3c0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba426d8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba3c0d06e0 0x7fba3c0ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59426/0 (socket says 172.21.15.79:59426) 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba426d8640 1 -- 172.21.15.79:0/4047240037 learned_addr learned my addr 172.21.15.79:0/4047240037 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba41ed7640 1 --2- 172.21.15.79:0/4047240037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c1589e0 0x7fba3c15f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba426d8640 1 -- 172.21.15.79:0/4047240037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c1589e0 msgr2=0x7fba3c15f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba426d8640 1 --2- 172.21.15.79:0/4047240037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c1589e0 0x7fba3c15f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba426d8640 1 -- 172.21.15.79:0/4047240037 >> v1:172.21.15.117:6789/0 conn(0x7fba3c15ea40 legacy=0x7fba3c0cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.576+0000 7fba426d8640 1 -- 172.21.15.79:0/4047240037 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c072770 con 0x7fba3c0d06e0 2024-06-10T00:17:25.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.577+0000 7fba426d8640 1 --2- 172.21.15.79:0/4047240037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c0d06e0 0x7fba3c0ad690 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d150 tx=0x7fba3402c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d795ae51697b85af server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.577+0000 7fba40ed5640 1 -- 172.21.15.79:0/4047240037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34009600 con 0x7fba3c0d06e0 2024-06-10T00:17:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.577+0000 7fba40ed5640 1 -- 172.21.15.79:0/4047240037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba34037070 con 0x7fba3c0d06e0 2024-06-10T00:17:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.577+0000 7fba40ed5640 1 -- 172.21.15.79:0/4047240037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba340099c0 con 0x7fba3c0d06e0 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.578+0000 7fba4413b640 1 -- 172.21.15.79:0/4047240037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c0d06e0 msgr2=0x7fba3c0ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.578+0000 7fba4413b640 1 --2- 172.21.15.79:0/4047240037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c0d06e0 0x7fba3c0ad690 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d150 tx=0x7fba3402c930 comp rx=0 tx=0).stop 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.578+0000 7fba4413b640 1 -- 172.21.15.79:0/4047240037 shutdown_connections 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.578+0000 7fba4413b640 1 --2- 172.21.15.79:0/4047240037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c0d06e0 0x7fba3c0ad690 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.578+0000 7fba4413b640 1 --2- 172.21.15.79:0/4047240037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c1589e0 0x7fba3c15f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.578+0000 7fba4413b640 1 -- 172.21.15.79:0/4047240037 >> 172.21.15.79:0/4047240037 conn(0x7fba3c06b7e0 msgr2=0x7fba3c06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.578+0000 7fba4413b640 1 -- 172.21.15.79:0/4047240037 shutdown_connections 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.578+0000 7fba4413b640 1 -- 172.21.15.79:0/4047240037 wait complete. 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.579+0000 7fba4413b640 1 Processor -- start 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.579+0000 7fba4413b640 1 -- start start 2024-06-10T00:17:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba4413b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c0d06e0 0x7fba3c143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba4413b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c1589e0 0x7fba3c156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba4413b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c15ea40 0x7fba3c157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba4413b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c15f7b0 con 0x7fba3c15ea40 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba4413b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c072d30 con 0x7fba3c1589e0 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba4413b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba3c073250 con 0x7fba3c0d06e0 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c15ea40 0x7fba3c157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c15ea40 0x7fba3c157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59434/0 (socket says 172.21.15.79:59434) 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 -- 172.21.15.79:0/2342387837 learned_addr learned my addr 172.21.15.79:0/2342387837 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba41ed7640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c0d06e0 0x7fba3c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba416d6640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c1589e0 0x7fba3c156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 -- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c0d06e0 msgr2=0x7fba3c143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c0d06e0 0x7fba3c143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 -- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c1589e0 msgr2=0x7fba3c156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c1589e0 0x7fba3c156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 -- 172.21.15.79:0/2342387837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c1523e0 con 0x7fba3c15ea40 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba41ed7640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c0d06e0 0x7fba3c143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba416d6640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c1589e0 0x7fba3c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba426d8640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c15ea40 0x7fba3c157050 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d150 tx=0x7fba34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba327fc640 1 -- 172.21.15.79:0/2342387837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34009dc0 con 0x7fba3c15ea40 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba327fc640 1 -- 172.21.15.79:0/2342387837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba34047480 con 0x7fba3c15ea40 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c1526c0 con 0x7fba3c15ea40 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba327fc640 1 -- 172.21.15.79:0/2342387837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34047870 con 0x7fba3c15ea40 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.580+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c152c80 con 0x7fba3c15ea40 2024-06-10T00:17:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.581+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c0683c0 con 0x7fba3c15ea40 2024-06-10T00:17:25.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.582+0000 7fba327fc640 1 -- 172.21.15.79:0/2342387837 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba34032420 con 0x7fba3c15ea40 2024-06-10T00:17:25.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.582+0000 7fba327fc640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba2006be30 0x7fba2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.582+0000 7fba327fc640 1 -- 172.21.15.79:0/2342387837 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6217+0+0 (secure 0 0 0) 0x7fba340ae240 con 0x7fba3c15ea40 2024-06-10T00:17:25.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.582+0000 7fba41ed7640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba2006be30 0x7fba2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.583+0000 7fba41ed7640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba2006be30 0x7fba2006e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba38006fd0 tx=0x7fba38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.587+0000 7fba327fc640 1 -- 172.21.15.79:0/2342387837 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fba3407ca80 con 0x7fba3c15ea40 2024-06-10T00:17:25.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.837+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fba3c071bc0 con 0x7fba3c15ea40 2024-06-10T00:17:25.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.839+0000 7fba327fc640 1 -- 172.21.15.79:0/2342387837 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fba3407c380 con 0x7fba3c15ea40 2024-06-10T00:17:25.838 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-06-10T00:17:25.838 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:17:25.838 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-06-10T00:17:25.839 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-06-10T00:17:25.839 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-10T00:17:25.839 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba2006be30 msgr2=0x7fba2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba2006be30 0x7fba2006e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba38006fd0 tx=0x7fba38008040 comp rx=0 tx=0).stop 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c15ea40 msgr2=0x7fba3c157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c15ea40 0x7fba3c157050 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d150 tx=0x7fba34004a40 comp rx=0 tx=0).stop 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 shutdown_connections 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba2006be30 0x7fba2006e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3c15ea40 0x7fba3c157050 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c1589e0 0x7fba3c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 --2- 172.21.15.79:0/2342387837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c0d06e0 0x7fba3c143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 >> 172.21.15.79:0/2342387837 conn(0x7fba3c06b7e0 msgr2=0x7fba3c06d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 shutdown_connections 2024-06-10T00:17:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.841+0000 7fba4413b640 1 -- 172.21.15.79:0/2342387837 wait complete. 2024-06-10T00:17:25.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.950+0000 7f9343f09640 1 Processor -- start 2024-06-10T00:17:25.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.950+0000 7f9343f09640 1 -- start start 2024-06-10T00:17:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f9343f09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c06ebf0 0x7f933c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f9343f09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f933c0cf190 0x7f933c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f9343f09640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c0cf640 con 0x7f933c0ae910 2024-06-10T00:17:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f9343f09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f933c06d130 con 0x7f933c0cf190 2024-06-10T00:17:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f9343f09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f933c06d410 con 0x7f933c06ebf0 2024-06-10T00:17:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f93424a6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f933c0cf190 0x7f933c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f93424a6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f933c0cf190 0x7f933c0acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59448/0 (socket says 172.21.15.79:59448) 2024-06-10T00:17:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f93424a6640 1 -- 172.21.15.79:0/1108438609 learned_addr learned my addr 172.21.15.79:0/1108438609 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f93414a4640 1 --2- 172.21.15.79:0/1108438609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c06ebf0 0x7f933c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f93424a6640 1 -- 172.21.15.79:0/1108438609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c06ebf0 msgr2=0x7f933c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f93424a6640 1 --2- 172.21.15.79:0/1108438609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c06ebf0 0x7f933c0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f93424a6640 1 -- 172.21.15.79:0/1108438609 >> v1:172.21.15.117:6789/0 conn(0x7f933c0ae910 legacy=0x7f933c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.951+0000 7f93424a6640 1 -- 172.21.15.79:0/1108438609 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c06d6f0 con 0x7f933c0cf190 2024-06-10T00:17:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.952+0000 7f93424a6640 1 --2- 172.21.15.79:0/1108438609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c0cf190 0x7f933c0acd40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f933400d180 tx=0x7f933402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbcaa608fbb0caf server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.952+0000 7f9340ca3640 1 -- 172.21.15.79:0/1108438609 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334039070 con 0x7f933c0cf190 2024-06-10T00:17:25.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.952+0000 7f9340ca3640 1 -- 172.21.15.79:0/1108438609 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933400b2d0 con 0x7f933c0cf190 2024-06-10T00:17:25.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.952+0000 7f9340ca3640 1 -- 172.21.15.79:0/1108438609 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933400b480 con 0x7f933c0cf190 2024-06-10T00:17:25.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.952+0000 7f9343f09640 1 -- 172.21.15.79:0/1108438609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c0cf190 msgr2=0x7f933c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.952+0000 7f9343f09640 1 --2- 172.21.15.79:0/1108438609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c0cf190 0x7f933c0acd40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f933400d180 tx=0x7f933402c870 comp rx=0 tx=0).stop 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.953+0000 7f9343f09640 1 -- 172.21.15.79:0/1108438609 shutdown_connections 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.953+0000 7f9343f09640 1 --2- 172.21.15.79:0/1108438609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c0cf190 0x7f933c0acd40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.953+0000 7f9343f09640 1 --2- 172.21.15.79:0/1108438609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c06ebf0 0x7f933c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.953+0000 7f9343f09640 1 -- 172.21.15.79:0/1108438609 >> 172.21.15.79:0/1108438609 conn(0x7f933c0b19f0 msgr2=0x7f933c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.953+0000 7f9343f09640 1 -- 172.21.15.79:0/1108438609 shutdown_connections 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.953+0000 7f9343f09640 1 -- 172.21.15.79:0/1108438609 wait complete. 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.954+0000 7f9343f09640 1 Processor -- start 2024-06-10T00:17:25.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.954+0000 7f9343f09640 1 -- start start 2024-06-10T00:17:25.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.954+0000 7f9343f09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c06ebf0 0x7f933c09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.954+0000 7f9343f09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0ae910 0x7f933c15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.954+0000 7f9343f09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c0cf190 0x7f933c0b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.954+0000 7f9343f09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0ad280 con 0x7f933c06ebf0 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9343f09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0aecf0 con 0x7f933c0ae910 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9343f09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f933c0ad400 con 0x7f933c0cf190 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c06ebf0 0x7f933c09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c06ebf0 0x7f933c09aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59458/0 (socket says 172.21.15.79:59458) 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 -- 172.21.15.79:0/2360463103 learned_addr learned my addr 172.21.15.79:0/2360463103 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 -- 172.21.15.79:0/2360463103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c0cf190 msgr2=0x7f933c0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c0cf190 0x7f933c0b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 -- 172.21.15.79:0/2360463103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0ae910 msgr2=0x7f933c15cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0ae910 0x7f933c15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 -- 172.21.15.79:0/2360463103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c15d160 con 0x7f933c06ebf0 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9341ca5640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c06ebf0 0x7f933c09aa10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f933800c430 tx=0x7f933800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f93327fc640 1 -- 172.21.15.79:0/2360463103 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338011790 con 0x7f933c06ebf0 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f93327fc640 1 -- 172.21.15.79:0/2360463103 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9338017070 con 0x7f933c06ebf0 2024-06-10T00:17:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c15d440 con 0x7f933c06ebf0 2024-06-10T00:17:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f93327fc640 1 -- 172.21.15.79:0/2360463103 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338011bb0 con 0x7f933c06ebf0 2024-06-10T00:17:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.955+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c15da00 con 0x7f933c06ebf0 2024-06-10T00:17:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.956+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c068430 con 0x7f933c06ebf0 2024-06-10T00:17:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.957+0000 7f93327fc640 1 -- 172.21.15.79:0/2360463103 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f933801c460 con 0x7f933c06ebf0 2024-06-10T00:17:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.957+0000 7f93327fc640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f932006be60 0x7f932006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:25.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.957+0000 7f93327fc640 1 -- 172.21.15.79:0/2360463103 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f933808af10 con 0x7f933c06ebf0 2024-06-10T00:17:25.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.957+0000 7f93414a4640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f932006be60 0x7f932006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:25.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.958+0000 7f93414a4640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f932006be60 0x7f932006e320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f933c0cd300 tx=0x7f932c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:25.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:25.962+0000 7f93327fc640 1 -- 172.21.15.79:0/2360463103 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f93380596c0 con 0x7f933c06ebf0 2024-06-10T00:17:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.173+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f933c068dd0 con 0x7f933c06ebf0 2024-06-10T00:17:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.173+0000 7f93327fc640 1 -- 172.21.15.79:0/2360463103 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5185 (secure 0 0 0) 0x7f9338058fc0 con 0x7f933c06ebf0 2024-06-10T00:17:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:26.173 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:17:19.103976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:17:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 29 2024-06-10T00:17:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f932006be60 msgr2=0x7f932006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f932006be60 0x7f932006e320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f933c0cd300 tx=0x7f932c008040 comp rx=0 tx=0).stop 2024-06-10T00:17:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c06ebf0 msgr2=0x7f933c09aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c06ebf0 0x7f933c09aa10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f933800c430 tx=0x7f933800c8f0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 shutdown_connections 2024-06-10T00:17:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f932006be60 0x7f932006e320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c0cf190 0x7f933c0b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0ae910 0x7f933c15cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 --2- 172.21.15.79:0/2360463103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f933c06ebf0 0x7f933c09aa10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 >> 172.21.15.79:0/2360463103 conn(0x7f933c0b19f0 msgr2=0x7f933c0cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 shutdown_connections 2024-06-10T00:17:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.175+0000 7f9343f09640 1 -- 172.21.15.79:0/2360463103 wait complete. 2024-06-10T00:17:26.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:17:17.083403+0000', 'modified': '2024-06-10T00:17:19.103976+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5784}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5784': {'gid': 5784, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/3634814301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 3634814301}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 3634814301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5784, 'qdb_cluster': [5784]} 2024-06-10T00:17:26.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:17:26.589 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:17:26.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.692+0000 7fc03ca6b640 1 Processor -- start 2024-06-10T00:17:26.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.692+0000 7fc03ca6b640 1 -- start start 2024-06-10T00:17:26.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc03ca6b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0381553c0 0x7fc0380cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc03ca6b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0380b31a0 con 0x7fc0380b2cf0 2024-06-10T00:17:26.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc03ca6b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0380b3420 con 0x7fc0380cec50 2024-06-10T00:17:26.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc03ca6b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc0380cc750 con 0x7fc0381553c0 2024-06-10T00:17:26.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc02ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc0380b2cf0 0x7fc03815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36498/0 (socket says 172.21.15.79:36498) 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc02ffff640 1 -- 172.21.15.79:0/3686091135 learned_addr learned my addr 172.21.15.79:0/3686091135 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc03659c640 1 --2- 172.21.15.79:0/3686091135 >> v2:172.21.15.117:3300/0 conn(0x7fc0381553c0 0x7fc0380cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779815233 0 0) 0x7fc020001110 con 0x7fc0380b2cf0 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc024003520 con 0x7fc0380b2cf0 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3643502323 0 0) 0x7fc024003520 con 0x7fc0380b2cf0 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 >> v2:172.21.15.117:3300/0 conn(0x7fc0381553c0 msgr2=0x7fc0380cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 --2- 172.21.15.79:0/3686091135 >> v2:172.21.15.117:3300/0 conn(0x7fc0381553c0 0x7fc0380cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 >> v1:172.21.15.117:6789/0 conn(0x7fc0380cec50 legacy=0x7fc038071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0380cca30 con 0x7fc0380b2cf0 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fc020001840 con 0x7fc0380b2cf0 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 >> v1:172.21.15.79:6789/0 conn(0x7fc0380b2cf0 legacy=0x7fc03815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0240039b0 0x7fc024003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc024004800 0x7fc024004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240051c0 0x7fc02400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0380cc750 con 0x7fc0240039b0 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc02400c060 con 0x7fc0240051c0 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.693+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc02400c260 con 0x7fc024004800 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc03659c640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0240039b0 0x7fc024003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240051c0 0x7fc02400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc024004800 0x7fc024004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc03659c640 1 -- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc024004800 msgr2=0x7fc024004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc03659c640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc024004800 0x7fc024004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc03659c640 1 -- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240051c0 msgr2=0x7fc02400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc03659c640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240051c0 0x7fc02400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc03659c640 1 -- 172.21.15.79:0/3686091135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc024003520 con 0x7fc0240039b0 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240051c0 0x7fc02400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc036d9d640 1 -- 172.21.15.79:0/3686091135 reap_dead start 2024-06-10T00:17:26.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.694+0000 7fc03659c640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0240039b0 0x7fc024003dd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc028009ac0 tx=0x7fc024005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4998382a2ec0ce server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028036070 con 0x7fc0240039b0 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc028031400 con 0x7fc0240039b0 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc035d9b640 1 -- 172.21.15.79:0/3686091135 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028009690 con 0x7fc0240039b0 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3686091135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0240039b0 msgr2=0x7fc024003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc03ca6b640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0240039b0 0x7fc024003dd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc028009ac0 tx=0x7fc024005830 comp rx=0 tx=0).stop 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3686091135 shutdown_connections 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc03ca6b640 1 --2- 172.21.15.79:0/3686091135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0240039b0 0x7fc024003dd0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3686091135 >> 172.21.15.79:0/3686091135 conn(0x7fc0380b19f0 msgr2=0x7fc0380b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3686091135 shutdown_connections 2024-06-10T00:17:26.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.695+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3686091135 wait complete. 2024-06-10T00:17:26.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.696+0000 7fc03ca6b640 1 Processor -- start 2024-06-10T00:17:26.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc03ca6b640 1 -- start start 2024-06-10T00:17:26.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc03ca6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240039b0 0x7fc03815d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc03ca6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc03815beb0 0x7fc038153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc03ca6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038154340 0x7fc03815e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc03ca6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0381557a0 con 0x7fc03815beb0 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc03ca6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc0380b3700 con 0x7fc0240039b0 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc03ca6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc038155920 con 0x7fc038154340 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc02ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc03815beb0 0x7fc038153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc02ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc03815beb0 0x7fc038153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59482/0 (socket says 172.21.15.79:59482) 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc02ffff640 1 -- 172.21.15.79:0/3081885479 learned_addr learned my addr 172.21.15.79:0/3081885479 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038154340 0x7fc03815e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.697+0000 7fc03659c640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240039b0 0x7fc03815d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02ffff640 1 -- 172.21.15.79:0/3081885479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038154340 msgr2=0x7fc03815e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038154340 0x7fc03815e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02ffff640 1 -- 172.21.15.79:0/3081885479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240039b0 msgr2=0x7fc03815d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240039b0 0x7fc03815d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02ffff640 1 -- 172.21.15.79:0/3081885479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03815c400 con 0x7fc03815beb0 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc03815beb0 0x7fc038153b00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc020007410 tx=0x7fc0200018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02effd640 1 -- 172.21.15.79:0/3081885479 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02000e8d0 con 0x7fc03815beb0 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02effd640 1 -- 172.21.15.79:0/3081885479 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc020018070 con 0x7fc03815beb0 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3081885479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03815c6e0 con 0x7fc03815beb0 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc02effd640 1 -- 172.21.15.79:0/3081885479 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02000ecb0 con 0x7fc03815beb0 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.698+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3081885479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03815cca0 con 0x7fc03815beb0 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.699+0000 7fc02effd640 1 -- 172.21.15.79:0/3081885479 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc02001d460 con 0x7fc03815beb0 2024-06-10T00:17:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.700+0000 7fc02effd640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc01806be30 0x7fc01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.700+0000 7fc02effd640 1 -- 172.21.15.79:0/3081885479 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fc02008af70 con 0x7fc03815beb0 2024-06-10T00:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.700+0000 7fc03659c640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc01806be30 0x7fc01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.700+0000 7fc03659c640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc01806be30 0x7fc01806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc028033000 tx=0x7fc028008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.701+0000 7fc03f77a740 1 Processor -- start 2024-06-10T00:17:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.701+0000 7fc03f77a740 1 -- start start 2024-06-10T00:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b832d00 0x56484b835510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b8330e0 0x56484b835a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b805960 0x56484b809170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03f77a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56484b76e740 con 0x56484b832d00 2024-06-10T00:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03f77a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56484b70ca80 con 0x56484b8330e0 2024-06-10T00:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03f77a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56484b76a700 con 0x56484b805960 2024-06-10T00:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b832d00 0x56484b835510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b832d00 0x56484b835510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59494/0 (socket says 172.21.15.79:59494) 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 -- 172.21.15.79:0/2667937944 learned_addr learned my addr 172.21.15.79:0/2667937944 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc036d9d640 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b805960 0x56484b809170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc02ffff640 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b8330e0 0x56484b835a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 -- 172.21.15.79:0/2667937944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b805960 msgr2=0x56484b809170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b805960 0x56484b809170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 -- 172.21.15.79:0/2667937944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b8330e0 msgr2=0x56484b835a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b8330e0 0x56484b835a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 -- 172.21.15.79:0/2667937944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484b737fb0 con 0x56484b832d00 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc03659c640 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b832d00 0x56484b835510 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc02802abb0 tx=0x7fc02802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ccca1d84a0e195 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc017fff640 1 -- 172.21.15.79:0/2667937944 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028036040 con 0x56484b832d00 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc017fff640 1 -- 172.21.15.79:0/2667937944 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc028037040 con 0x56484b832d00 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.702+0000 7fc017fff640 1 -- 172.21.15.79:0/2667937944 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028003ae0 con 0x56484b832d00 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 -- 172.21.15.79:0/2667937944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b832d00 msgr2=0x56484b835510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b832d00 0x56484b835510 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc02802abb0 tx=0x7fc02802e000 comp rx=0 tx=0).stop 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 -- 172.21.15.79:0/2667937944 shutdown_connections 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b805960 0x56484b809170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b8330e0 0x56484b835a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 --2- 172.21.15.79:0/2667937944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b832d00 0x56484b835510 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 -- 172.21.15.79:0/2667937944 >> 172.21.15.79:0/2667937944 conn(0x56484b807bd0 msgr2=0x56484b850510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 -- 172.21.15.79:0/2667937944 shutdown_connections 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.703+0000 7fc03f77a740 1 -- 172.21.15.79:0/2667937944 wait complete. 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.704+0000 7fc03f77a740 1 -- start start 2024-06-10T00:17:26.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.704+0000 7fc03f77a740 1 Processor -- start 2024-06-10T00:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b84ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 0x56484b84f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b84f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56484b80ad80 con 0x56484b82a020 2024-06-10T00:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56484b6f7c30 con 0x56484b832d00 2024-06-10T00:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56484b80b060 con 0x56484b8330e0 2024-06-10T00:17:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 10 client.0 _ll_register_callbacks cb 0x56484b7297f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b84f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b84f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59498/0 (socket says 172.21.15.79:59498) 2024-06-10T00:17:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 -- 172.21.15.79:0/3185227775 learned_addr learned my addr 172.21.15.79:0/3185227775 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03659c640 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b84ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 0x56484b84f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 -- 172.21.15.79:0/3185227775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 msgr2=0x56484b84f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 0x56484b84f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 -- 172.21.15.79:0/3185227775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 msgr2=0x56484b84ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b84ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 -- 172.21.15.79:0/3185227775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484b4822d0 con 0x56484b82a020 2024-06-10T00:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b84f750 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc0380b51c0 tx=0x7fc030001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be4ef54f6a66e4e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc0157fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc0157fa640 1 -- 172.21.15.79:0/3185227775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03001a020 con 0x56484b82a020 2024-06-10T00:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc0157fa640 1 -- 172.21.15.79:0/3185227775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fc030016450 con 0x56484b82a020 2024-06-10T00:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 1 -- 172.21.15.79:0/3185227775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc028037040 con 0x56484b82a020 2024-06-10T00:17:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc0157fa640 1 -- 172.21.15.79:0/3185227775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc030024050 con 0x56484b82a020 2024-06-10T00:17:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 10 client.5940 fetch_fsmap learned FSMap version 29 2024-06-10T00:17:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.705+0000 7fc03f77a740 1 -- 172.21.15.79:0/3185227775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x56484b54c6b0 con 0x56484b82a020 2024-06-10T00:17:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc0157fa640 1 -- 172.21.15.79:0/3185227775 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc028037040 con 0x56484b82a020 2024-06-10T00:17:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc0157fa640 1 -- 172.21.15.79:0/3185227775 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 3494+0+0 (secure 0 0 0) 0x7fc030027020 con 0x56484b82a020 2024-06-10T00:17:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc03f77a740 10 client.5940 fetch_fsmap finished waiting for FSMap version 29 2024-06-10T00:17:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc03f77a740 10 client.5940 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:17:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc03f77a740 20 client.5940 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x56484b837ad0 0x56484b852ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc03f77a740 4 client.5940 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc03f77a740 1 -- 172.21.15.79:0/3185227775 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56484b77be70 con 0x56484b837ad0 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc03659c640 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x56484b837ad0 0x56484b852ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc03659c640 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x56484b837ad0 0x56484b852ff0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd3304a10c216e92 server_cookie=c8427b16683775e9 in_seq=0 out_seq=0 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.706+0000 7fc0157fa640 10 client.5940 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc0157fa640 1 -- 172.21.15.79:0/3185227775 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56484b77be70 con 0x56484b837ad0 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc0157fa640 10 client.5940 handle_command_reply: tid=0 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 client.5940 shutdown 2024-06-10T00:17:26.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 -- 172.21.15.79:0/3185227775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 msgr2=0x56484b84f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b84f750 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc0380b51c0 tx=0x7fc030001b20 comp rx=0 tx=0).stop 2024-06-10T00:17:26.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 -- 172.21.15.79:0/3185227775 shutdown_connections 2024-06-10T00:17:26.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b84f750 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x56484b837ad0 0x56484b852ff0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 0x56484b84f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3185227775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b84ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc0157fa640 0 client.5940 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:26.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 -- 172.21.15.79:0/3185227775 >> 172.21.15.79:0/3185227775 conn(0x56484b805960 msgr2=0x56484b835940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 -- 172.21.15.79:0/3185227775 shutdown_connections 2024-06-10T00:17:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 1 -- 172.21.15.79:0/3185227775 wait complete. 2024-06-10T00:17:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.707+0000 7fc03f77a740 20 client.5940 trim_cache size 0 max 16384 2024-06-10T00:17:26.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.726+0000 7fc03f77a740 1 Processor -- start 2024-06-10T00:17:26.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.726+0000 7fc03f77a740 1 -- start start 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b82a020 0x56484b806440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b806980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b8330e0 0x56484b873fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc03f77a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0381fc450 con 0x56484b8330e0 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc03f77a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc03809c600 con 0x56484b832d00 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc03f77a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0381fbe30 con 0x56484b82a020 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b8330e0 0x56484b873fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b8330e0 0x56484b873fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59504/0 (socket says 172.21.15.79:59504) 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 -- 172.21.15.79:0/3992953726 learned_addr learned my addr 172.21.15.79:0/3992953726 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b806980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc03659c640 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b82a020 0x56484b806440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 -- 172.21.15.79:0/3992953726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b82a020 msgr2=0x56484b806440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b82a020 0x56484b806440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 -- 172.21.15.79:0/3992953726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 msgr2=0x56484b806980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b806980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 -- 172.21.15.79:0/3992953726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484b8295d0 con 0x56484b8330e0 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b8330e0 0x56484b873fe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc030001280 tx=0x7fc030011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcaceaaf46171814 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc0177fe640 1 -- 172.21.15.79:0/3992953726 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03001a050 con 0x56484b8330e0 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc0177fe640 1 -- 172.21.15.79:0/3992953726 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc03002c020 con 0x56484b8330e0 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.727+0000 7fc0177fe640 1 -- 172.21.15.79:0/3992953726 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03001f770 con 0x56484b8330e0 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 -- 172.21.15.79:0/3992953726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b8330e0 msgr2=0x56484b873fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b8330e0 0x56484b873fe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc030001280 tx=0x7fc030011000 comp rx=0 tx=0).stop 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 -- 172.21.15.79:0/3992953726 shutdown_connections 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b8330e0 0x56484b873fe0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b806980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3992953726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b82a020 0x56484b806440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 -- 172.21.15.79:0/3992953726 >> 172.21.15.79:0/3992953726 conn(0x56484b805960 msgr2=0x56484b801090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 -- 172.21.15.79:0/3992953726 shutdown_connections 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 -- 172.21.15.79:0/3992953726 wait complete. 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 -- start start 2024-06-10T00:17:26.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.728+0000 7fc03f77a740 1 Processor -- start 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b8747e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b8354d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03f77a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 0x56484b835a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03f77a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56484b837950 con 0x56484b82a020 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03f77a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56484b838260 con 0x56484b832d00 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03f77a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56484b837f70 con 0x56484b8330e0 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03f77a740 10 client.0 _ll_register_callbacks cb 0x7fc030003e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b8747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.729+0000 7fc03659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b8747e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59512/0 (socket says 172.21.15.79:59512) 2024-06-10T00:17:26.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03659c640 1 -- 172.21.15.79:0/3121388516 learned_addr learned my addr 172.21.15.79:0/3121388516 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc036d9d640 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 0x56484b835a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b8354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03659c640 1 -- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 msgr2=0x56484b835a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03659c640 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 0x56484b835a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03659c640 1 -- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 msgr2=0x56484b8354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03659c640 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b8354d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03659c640 1 -- 172.21.15.79:0/3121388516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484b8299e0 con 0x56484b82a020 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b8354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03659c640 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b8747e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc028009be0 tx=0x7fc0280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c355df2f680ae970 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc0157fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc0157fa640 1 -- 172.21.15.79:0/3121388516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028036040 con 0x56484b82a020 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc0157fa640 1 -- 172.21.15.79:0/3121388516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fc028003cf0 con 0x56484b82a020 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03f77a740 1 -- 172.21.15.79:0/3121388516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc03002c020 con 0x56484b82a020 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc0157fa640 1 -- 172.21.15.79:0/3121388516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc028062050 con 0x56484b82a020 2024-06-10T00:17:26.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03f77a740 10 client.5946 fetch_fsmap learned FSMap version 29 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03f77a740 1 -- 172.21.15.79:0/3121388516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x56484b846b20 con 0x56484b82a020 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc0157fa640 1 -- 172.21.15.79:0/3121388516 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc03002c020 con 0x56484b82a020 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc0157fa640 1 -- 172.21.15.79:0/3121388516 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 3494+0+0 (secure 0 0 0) 0x7fc028065020 con 0x56484b82a020 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03f77a740 10 client.5946 fetch_fsmap finished waiting for FSMap version 29 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03f77a740 10 client.5946 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.730+0000 7fc03f77a740 20 client.5946 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x56484b873bd0 0x56484b808fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 4 client.5946 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 -- 172.21.15.79:0/3121388516 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "status"}) -- 0x56484b7761c0 con 0x56484b873bd0 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x56484b873bd0 0x56484b808fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc02ffff640 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x56484b873bd0 0x56484b808fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1108593d321455c1 server_cookie=530a8e1b67c6823a in_seq=0 out_seq=0 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc0157fa640 10 client.5946 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:26.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc0157fa640 1 -- 172.21.15.79:0/3121388516 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56484b7761c0 con 0x56484b873bd0 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc0157fa640 10 client.5946 handle_command_reply: tid=0 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 client.5946 shutdown 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 -- 172.21.15.79:0/3121388516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 msgr2=0x56484b8747e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b8747e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc028009be0 tx=0x7fc0280046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 -- 172.21.15.79:0/3121388516 shutdown_connections 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x56484b873bd0 0x56484b808fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484b8330e0 0x56484b835a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484b832d00 0x56484b8354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 --2- 172.21.15.79:0/3121388516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56484b82a020 0x56484b8747e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc0157fa640 0 client.5946 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 -- 172.21.15.79:0/3121388516 >> 172.21.15.79:0/3121388516 conn(0x56484b805960 msgr2=0x56484b858560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 -- 172.21.15.79:0/3121388516 shutdown_connections 2024-06-10T00:17:26.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 1 -- 172.21.15.79:0/3121388516 wait complete. 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.731+0000 7fc03f77a740 20 client.5946 trim_cache size 0 max 16384 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5784, 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 8.9718175080000009, 2024-06-10T00:17:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 29, 2024-06-10T00:17:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 63, 2024-06-10T00:17:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 61, 2024-06-10T00:17:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.329330377 2024-06-10T00:17:26.739 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc01806be30 msgr2=0x7fc01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc01806be30 0x7fc01806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc028033000 tx=0x7fc028008030 comp rx=0 tx=0).stop 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc03815beb0 msgr2=0x7fc038153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc03815beb0 0x7fc038153b00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc020007410 tx=0x7fc0200018f0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3081885479 shutdown_connections 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc01806be30 0x7fc01806e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038154340 0x7fc03815e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc03815beb0 0x7fc038153b00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 --2- 172.21.15.79:0/3081885479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0240039b0 0x7fc03815d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3081885479 >> 172.21.15.79:0/3081885479 conn(0x7fc0380b19f0 msgr2=0x7fc0380ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3081885479 shutdown_connections 2024-06-10T00:17:26.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.732+0000 7fc03ca6b640 1 -- 172.21.15.79:0/3081885479 wait complete. 2024-06-10T00:17:26.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:17:26.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.843+0000 7f29af761640 1 Processor -- start 2024-06-10T00:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.843+0000 7f29af761640 1 -- start start 2024-06-10T00:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29af761640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29a80b4c80 0x7f29a80ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29af761640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29af761640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a80b7d20 con 0x7f29a80b7940 2024-06-10T00:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29af761640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f29a80d1200 con 0x7f29a80b4c80 2024-06-10T00:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29af761640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29a80cc620 con 0x7f29a80cec10 2024-06-10T00:17:26.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29adcfe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29ad4fd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f29a80b7940 0x7f29a80d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:34090/0 (socket says 172.21.15.79:34090) 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29ad4fd640 1 -- 172.21.15.79:0/2344587512 learned_addr learned my addr 172.21.15.79:0/2344587512 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f29accfc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29a80b4c80 0x7f29a80ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.844+0000 7f299ffff640 1 -- 172.21.15.79:0/2344587512 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472484739 0 0) 0x7f29a80b7d20 con 0x7f29a80b7940 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.845+0000 7f299ffff640 1 -- 172.21.15.79:0/2344587512 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2994003520 con 0x7f29a80b7940 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.845+0000 7f29accfc640 1 -- 172.21.15.79:0/2344587512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 msgr2=0x7f29a80cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.845+0000 7f29accfc640 1 --2- 172.21.15.79:0/2344587512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a80cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.845+0000 7f29accfc640 1 -- 172.21.15.79:0/2344587512 >> v1:172.21.15.117:6789/0 conn(0x7f29a80b7940 legacy=0x7f29a80d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.845+0000 7f29accfc640 1 -- 172.21.15.79:0/2344587512 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a80cc900 con 0x7f29a80b4c80 2024-06-10T00:17:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.845+0000 7f29adcfe640 1 --2- 172.21.15.79:0/2344587512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a80cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:17:26.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.845+0000 7f29accfc640 1 --2- 172.21.15.79:0/2344587512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 0x7f29a80ce6d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f29980097a0 tx=0x7f299802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=905ec2efb927475c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.845+0000 7f299ffff640 1 -- 172.21.15.79:0/2344587512 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998037070 con 0x7f29a80b4c80 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f299ffff640 1 -- 172.21.15.79:0/2344587512 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2998032440 con 0x7f29a80b4c80 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f299ffff640 1 -- 172.21.15.79:0/2344587512 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998032810 con 0x7f29a80b4c80 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f29af761640 1 -- 172.21.15.79:0/2344587512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 msgr2=0x7f29a80ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f29af761640 1 --2- 172.21.15.79:0/2344587512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 0x7f29a80ce6d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f29980097a0 tx=0x7f299802a180 comp rx=0 tx=0).stop 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f29af761640 1 -- 172.21.15.79:0/2344587512 shutdown_connections 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f29af761640 1 --2- 172.21.15.79:0/2344587512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a80cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f29af761640 1 --2- 172.21.15.79:0/2344587512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 0x7f29a80ce6d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f29af761640 1 -- 172.21.15.79:0/2344587512 >> 172.21.15.79:0/2344587512 conn(0x7f29a80d1e50 msgr2=0x7f29a80d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f29af761640 1 -- 172.21.15.79:0/2344587512 shutdown_connections 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.846+0000 7f29af761640 1 -- 172.21.15.79:0/2344587512 wait complete. 2024-06-10T00:17:26.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.847+0000 7f29af761640 1 Processor -- start 2024-06-10T00:17:26.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.847+0000 7f29af761640 1 -- start start 2024-06-10T00:17:26.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29af761640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 0x7f29a80c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29af761640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80b7940 0x7f29a8151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29af761640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29af761640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80d2a90 con 0x7f29a80b7940 2024-06-10T00:17:26.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29af761640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80ccec0 con 0x7f29a80b4c80 2024-06-10T00:17:26.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29af761640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29a80d2c10 con 0x7f29a80cec10 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29accfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80b7940 0x7f29a8151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29accfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80b7940 0x7f29a8151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59514/0 (socket says 172.21.15.79:59514) 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29accfc640 1 -- 172.21.15.79:0/182818509 learned_addr learned my addr 172.21.15.79:0/182818509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29adcfe640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29ad4fd640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 0x7f29a80c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29accfc640 1 -- 172.21.15.79:0/182818509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 msgr2=0x7f29a814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29accfc640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29accfc640 1 -- 172.21.15.79:0/182818509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 msgr2=0x7f29a80c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29accfc640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 0x7f29a80c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.848+0000 7f29accfc640 1 -- 172.21.15.79:0/182818509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a8152470 con 0x7f29a80b7940 2024-06-10T00:17:26.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.849+0000 7f29accfc640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80b7940 0x7f29a8151f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2998035040 tx=0x7f29980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.849+0000 7f299dffb640 1 -- 172.21.15.79:0/182818509 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998041030 con 0x7f29a80b7940 2024-06-10T00:17:26.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.849+0000 7f299dffb640 1 -- 172.21.15.79:0/182818509 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299803d420 con 0x7f29a80b7940 2024-06-10T00:17:26.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.849+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a814f180 con 0x7f29a80b7940 2024-06-10T00:17:26.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.849+0000 7f299dffb640 1 -- 172.21.15.79:0/182818509 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998037040 con 0x7f29a80b7940 2024-06-10T00:17:26.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.849+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a814f910 con 0x7f29a80b7940 2024-06-10T00:17:26.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.850+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a8068430 con 0x7f29a80b7940 2024-06-10T00:17:26.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.850+0000 7f299dffb640 1 -- 172.21.15.79:0/182818509 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2998044070 con 0x7f29a80b7940 2024-06-10T00:17:26.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.851+0000 7f299dffb640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f298c06be30 0x7f298c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:26.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.851+0000 7f299dffb640 1 -- 172.21.15.79:0/182818509 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f29980ab5d0 con 0x7f29a80b7940 2024-06-10T00:17:26.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.851+0000 7f29ad4fd640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f298c06be30 0x7f298c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:26.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.851+0000 7f29ad4fd640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f298c06be30 0x7f298c06e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f29a4005880 tx=0x7f29a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:26.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:26.855+0000 7f299dffb640 1 -- 172.21.15.79:0/182818509 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f29a8152470 con 0x7f29a80b7940 2024-06-10T00:17:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.066+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f29a806fe90 con 0x7f29a80b7940 2024-06-10T00:17:27.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.066+0000 7f299dffb640 1 -- 172.21.15.79:0/182818509 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7f2998079eb0 con 0x7f29a80b7940 2024-06-10T00:17:27.066 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:17:27.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f298c06be30 msgr2=0x7f298c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:27.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f298c06be30 0x7f298c06e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f29a4005880 tx=0x7f29a4009040 comp rx=0 tx=0).stop 2024-06-10T00:17:27.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80b7940 msgr2=0x7f29a8151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80b7940 0x7f29a8151f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2998035040 tx=0x7f29980046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 shutdown_connections 2024-06-10T00:17:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f298c06be30 0x7f298c06e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29a80cec10 0x7f29a814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80b7940 0x7f29a8151f30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 --2- 172.21.15.79:0/182818509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80b4c80 0x7f29a80c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:27.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 >> 172.21.15.79:0/182818509 conn(0x7f29a80d1e50 msgr2=0x7f29a80b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:27.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 shutdown_connections 2024-06-10T00:17:27.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27.068+0000 7f29af761640 1 -- 172.21.15.79:0/182818509 wait complete. 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:17:27.079 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:17:27.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:27.080 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:17:27.095 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:17:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42597sec preferred_lft 42597sec 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:17:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:17:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:17:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:17:27.098 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:17:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:17:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:17:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:17:27.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:27.098 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:17:27.159 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:17:27.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:27.160 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:17:27.216 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:17:27.216 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:17:27.216 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:17:27.216 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:17:27.217 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:17:27.217 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:17:27.217 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:17:27.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:17:27.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:17:27.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:17:27.217 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:17:27.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:17:27.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:17:27.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:27.343 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:17:27.359 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:17:27.359 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:17:27.359 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:17:27.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:27.360 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:17:27.425 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:17:27.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:17:27.425 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:17:27.481 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:17:27.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:17:27.481 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:17:27.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:17:27.601 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:17:27.657 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:17:27.658 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:17:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:17:27.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:17:27.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:17:27.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:17:27.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:17:27.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:17:27.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:27.660 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:17:27.713 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:17:27.713 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:17:27.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:17:27.780 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:17:27.837 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:17:27.838 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:17:27.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:27.840 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:17:27.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:17:27.838+0000 7ff26b631480 -1 init, newargv = 0x5570ab867340 newargc=15 2024-06-10T00:17:27.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[56910]: starting ceph client 2024-06-10T00:17:27.842 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[56910]: starting fuse 2024-06-10T00:17:27.855 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:17:27.855 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:17:27.855 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:17:27.855 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:17:27.855 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:17:27.855 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:17:27.856 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:17:27.857 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:17:27.972 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.56910.asok 2024-06-10T00:17:27.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:17:27.982 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.56910.asok 2024-06-10T00:17:27.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:27.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.56910.asok status 2024-06-10T00:17:28.115 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:28.115 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "56910", 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5955, 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:17:28.116 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 5955 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1856104487 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1856104487 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.5955 192.168.0.1:0/1856104487", 2024-06-10T00:17:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/1856104487", 2024-06-10T00:17:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:17:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 29, 2024-06-10T00:17:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 63, 2024-06-10T00:17:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:17:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:17:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:17:28.118 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:28.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:28.124 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:17:28.124 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:17:28.142 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:17:28.142 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:17:28.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:28.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:17:28.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:28.208 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-06-10T00:17:28.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:28.268 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-06-10T00:17:28.326 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:17:28.326 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:17:28.326 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:17:28.326 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:17:28.327 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-06-10T00:17:28.327 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:17:28.432 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-06-10T00:17:28.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:17:28.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:28.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.580+0000 7f23f54ee640 1 Processor -- start 2024-06-10T00:17:28.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.580+0000 7f23f54ee640 1 -- start start 2024-06-10T00:17:28.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23f54ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f015c1d0 0x7f23f00d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23f54ee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f23f00cef50 0x7f23f00c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23f54ee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23f00c59a0 con 0x7f23f00d0430 2024-06-10T00:17:28.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23f54ee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f23f00c5fb0 con 0x7f23f00cef50 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23f54ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23f00d0910 con 0x7f23f015c1d0 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23ee7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f23f00d0430 0x7f23f00ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60234/0 (socket says 172.21.15.79:60234) 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23ee7fc640 1 -- 172.21.15.79:0/801469903 learned_addr learned my addr 172.21.15.79:0/801469903 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461920810 0 0) 0x7f23f00c59a0 con 0x7f23f00d0430 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23eeffd640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f015c1d0 0x7f23f00d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23ef7fe640 1 --2- 172.21.15.79:0/801469903 >> v2:172.21.15.117:3300/0 conn(0x7f23f00cef50 0x7f23f00c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.581+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23d8003520 con 0x7f23f00d0430 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1059889025 0 0) 0x7f23d8003520 con 0x7f23f00d0430 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f015c1d0 msgr2=0x7f23f00d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f015c1d0 0x7f23f00d2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 >> v2:172.21.15.117:3300/0 conn(0x7f23f00cef50 msgr2=0x7f23f00c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 --2- 172.21.15.79:0/801469903 >> v2:172.21.15.117:3300/0 conn(0x7f23f00cef50 0x7f23f00c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f00d0bf0 con 0x7f23f00d0430 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f23e4001690 con 0x7f23f00d0430 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 >> v1:172.21.15.79:6789/0 conn(0x7f23f00d0430 legacy=0x7f23f00ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d80039b0 0x7f23d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f015c1d0 0x7f23d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f23f00c5fb0 con 0x7f23d8004d40 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23f00d0910 con 0x7f23d80039b0 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23d800b9c0 con 0x7f23f015c1d0 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23ef7fe640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23eeffd640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d80039b0 0x7f23d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23ee7fc640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f015c1d0 0x7f23d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23ef7fe640 1 -- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f015c1d0 msgr2=0x7f23d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:28.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23ef7fe640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f015c1d0 0x7f23d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23ef7fe640 1 -- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d80039b0 msgr2=0x7f23d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:28.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23ef7fe640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d80039b0 0x7f23d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.582+0000 7f23ef7fe640 1 -- 172.21.15.79:0/801469903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d8003520 con 0x7f23d8004d40 2024-06-10T00:17:28.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.583+0000 7f23ef7fe640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23d80051c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f23f0072f60 tx=0x7f23d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9d26a966395b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:28.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.583+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8009c10 con 0x7f23d8004d40 2024-06-10T00:17:28.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.583+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e8036070 con 0x7f23d8004d40 2024-06-10T00:17:28.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.583+0000 7f23edffb640 1 -- 172.21.15.79:0/801469903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8031850 con 0x7f23d8004d40 2024-06-10T00:17:28.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.584+0000 7f23f54ee640 1 -- 172.21.15.79:0/801469903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 msgr2=0x7f23d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.584+0000 7f23f54ee640 1 --2- 172.21.15.79:0/801469903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23d80051c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f23f0072f60 tx=0x7f23d8005830 comp rx=0 tx=0).stop 2024-06-10T00:17:28.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.584+0000 7f23ef7fe640 1 -- 172.21.15.79:0/801469903 reap_dead start 2024-06-10T00:17:28.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.584+0000 7f23f54ee640 1 -- 172.21.15.79:0/801469903 shutdown_connections 2024-06-10T00:17:28.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.584+0000 7f23f54ee640 1 -- 172.21.15.79:0/801469903 >> 172.21.15.79:0/801469903 conn(0x7f23f00d1e50 msgr2=0x7f23f00d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:28.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.584+0000 7f23f54ee640 1 -- 172.21.15.79:0/801469903 shutdown_connections 2024-06-10T00:17:28.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.584+0000 7f23f54ee640 1 -- 172.21.15.79:0/801469903 wait complete. 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.585+0000 7f23f54ee640 1 Processor -- start 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.585+0000 7f23f54ee640 1 -- start start 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23f54ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23f00b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23f54ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23f00b17c0 0x7f23f00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23f54ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f0159920 0x7f23f00ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23f54ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f23f00cf520 con 0x7f23d8004d40 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23f54ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23f015c5b0 con 0x7f23f00b17c0 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23f54ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23f00cf6a0 con 0x7f23f0159920 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23f00b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23f00b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34168/0 (socket says 172.21.15.79:34168) 2024-06-10T00:17:28.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 -- 172.21.15.79:0/1615562903 learned_addr learned my addr 172.21.15.79:0/1615562903 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23ef7fe640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f0159920 0x7f23f00ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23ee7fc640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23f00b17c0 0x7f23f00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 -- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f0159920 msgr2=0x7f23f00ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f0159920 0x7f23f00ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 -- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23f00b17c0 msgr2=0x7f23f00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23f00b17c0 0x7f23f00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 -- 172.21.15.79:0/1615562903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f00b0780 con 0x7f23d8004d40 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23ef7fe640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f0159920 0x7f23f00ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23ee7fc640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23f00b17c0 0x7f23f00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23eeffd640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23f00b2650 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f23e00118e0 tx=0x7f23e0011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23d77fe640 1 -- 172.21.15.79:0/1615562903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e000faf0 con 0x7f23d8004d40 2024-06-10T00:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23d77fe640 1 -- 172.21.15.79:0/1615562903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e000fc90 con 0x7f23d8004d40 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23d77fe640 1 -- 172.21.15.79:0/1615562903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0014440 con 0x7f23d8004d40 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.586+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f00b0a00 con 0x7f23d8004d40 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.587+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f00b0fc0 con 0x7f23d8004d40 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.587+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f0068430 con 0x7f23d8004d40 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.588+0000 7f23d77fe640 1 -- 172.21.15.79:0/1615562903 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23e0012040 con 0x7f23d8004d40 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.588+0000 7f23d77fe640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f23dc06be60 0x7f23dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.588+0000 7f23d77fe640 1 -- 172.21.15.79:0/1615562903 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f23e008b780 con 0x7f23d8004d40 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.588+0000 7f23ee7fc640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f23dc06be60 0x7f23dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.589+0000 7f23ee7fc640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f23dc06be60 0x7f23dc06e320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f23f006c180 tx=0x7f23e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:28.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.593+0000 7f23d77fe640 1 -- 172.21.15.79:0/1615562903 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f23f00b0780 con 0x7f23d8004d40 2024-06-10T00:17:28.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.807+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23f0070570 con 0x7f23d8004d40 2024-06-10T00:17:28.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.807+0000 7f23d77fe640 1 -- 172.21.15.79:0/1615562903 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5185 (secure 0 0 0) 0x7f23e0019030 con 0x7f23d8004d40 2024-06-10T00:17:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:28.807 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:17:19.103976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:17:28.807 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 29 2024-06-10T00:17:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.809+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f23dc06be60 msgr2=0x7f23dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.809+0000 7f23f54ee640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f23dc06be60 0x7f23dc06e320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f23f006c180 tx=0x7f23e4009040 comp rx=0 tx=0).stop 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.809+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 msgr2=0x7f23f00b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.809+0000 7f23f54ee640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23f00b2650 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f23e00118e0 tx=0x7f23e0011da0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.810+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 shutdown_connections 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.810+0000 7f23f54ee640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f23dc06be60 0x7f23dc06e320 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.810+0000 7f23f54ee640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23f0159920 0x7f23f00ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.810+0000 7f23f54ee640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23f00b17c0 0x7f23f00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.810+0000 7f23f54ee640 1 --2- 172.21.15.79:0/1615562903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23d8004d40 0x7f23f00b2650 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.810+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 >> 172.21.15.79:0/1615562903 conn(0x7f23f00d1e50 msgr2=0x7f23f015ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.810+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 shutdown_connections 2024-06-10T00:17:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.810+0000 7f23f54ee640 1 -- 172.21.15.79:0/1615562903 wait complete. 2024-06-10T00:17:28.820 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-06-10T00:17:28.942 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0} 2024-06-10T00:17:28.943 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:17:28.943 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-06-10T00:17:28.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5e049f40 1 Processor -- start 2024-06-10T00:17:28.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5e049f40 1 -- start start 2024-06-10T00:17:28.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5e049f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb480030f0 0x5649d53e2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5e049f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649d548f330 0x5649d546ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5e049f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d53b7460 0x5649d546d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5e049f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649d535be30 con 0x5649d53b7460 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5e049f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5649d535fe70 con 0x7fbb480030f0 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5e049f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5649d546f510 con 0x5649d548f330 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5c34b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d53b7460 0x5649d546d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5c34b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d53b7460 0x5649d546d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34192/0 (socket says 172.21.15.79:34192) 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.987+0000 7fbb5c34b640 1 -- 172.21.15.79:0/530212136 learned_addr learned my addr 172.21.15.79:0/530212136 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5c34b640 1 -- 172.21.15.79:0/530212136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649d548f330 msgr2=0x5649d546ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5c34b640 1 --2- 172.21.15.79:0/530212136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649d548f330 0x5649d546ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5c34b640 1 -- 172.21.15.79:0/530212136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb480030f0 msgr2=0x5649d53e2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:28.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5c34b640 1 --2- 172.21.15.79:0/530212136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb480030f0 0x5649d53e2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5c34b640 1 -- 172.21.15.79:0/530212136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649d546bf80 con 0x5649d53b7460 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5c34b640 1 --2- 172.21.15.79:0/530212136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d53b7460 0x5649d546d930 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x5649d5475940 tx=0x7fbb5400d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f463abf7a5e622e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5a347640 1 -- 172.21.15.79:0/530212136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400de00 con 0x5649d53b7460 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5a347640 1 -- 172.21.15.79:0/530212136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb54003bb0 con 0x5649d53b7460 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5a347640 1 -- 172.21.15.79:0/530212136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54003da0 con 0x5649d53b7460 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 -- 172.21.15.79:0/530212136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d53b7460 msgr2=0x5649d546d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 --2- 172.21.15.79:0/530212136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d53b7460 0x5649d546d930 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x5649d5475940 tx=0x7fbb5400d630 comp rx=0 tx=0).stop 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 -- 172.21.15.79:0/530212136 shutdown_connections 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 --2- 172.21.15.79:0/530212136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d53b7460 0x5649d546d930 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 --2- 172.21.15.79:0/530212136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649d548f330 0x5649d546ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 --2- 172.21.15.79:0/530212136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb480030f0 0x5649d53e2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 -- 172.21.15.79:0/530212136 >> 172.21.15.79:0/530212136 conn(0x5649d53b5280 msgr2=0x5649d53e3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:28.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 -- 172.21.15.79:0/530212136 shutdown_connections 2024-06-10T00:17:28.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.988+0000 7fbb5e049f40 1 -- 172.21.15.79:0/530212136 wait complete. 2024-06-10T00:17:28.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.989+0000 7fbb5e049f40 1 Processor -- start 2024-06-10T00:17:28.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.989+0000 7fbb5e049f40 1 -- start start 2024-06-10T00:17:28.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5e049f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649d53b7460 0x5649d54862e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5e049f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d548f330 0x5649d546aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5e049f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb480030f0 0x5649d5489c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5e049f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649d546d270 con 0x5649d548f330 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5e049f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5649d53e0360 con 0x7fbb480030f0 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5e049f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5649d53e0640 con 0x5649d53b7460 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d548f330 0x5649d546aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d548f330 0x5649d546aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34208/0 (socket says 172.21.15.79:34208) 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 -- 172.21.15.79:0/1313085280 learned_addr learned my addr 172.21.15.79:0/1313085280 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5bb4a640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649d53b7460 0x5649d54862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5c34b640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb480030f0 0x5649d5489c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 -- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649d53b7460 msgr2=0x5649d54862e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5649d53b7460 0x5649d54862e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 -- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb480030f0 msgr2=0x5649d5489c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb480030f0 0x5649d5489c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 -- 172.21.15.79:0/1313085280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649d5484030 con 0x5649d548f330 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5b349640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d548f330 0x5649d546aa30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbb44025e30 tx=0x7fbb44005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb59345640 1 -- 172.21.15.79:0/1313085280 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4404f4b0 con 0x5649d548f330 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb59345640 1 -- 172.21.15.79:0/1313085280 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4404f860 con 0x5649d548f330 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649d53fbea0 con 0x5649d548f330 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.990+0000 7fbb59345640 1 -- 172.21.15.79:0/1313085280 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4404fc10 con 0x5649d548f330 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.991+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649d546af70 con 0x5649d548f330 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.992+0000 7fbb59345640 1 -- 172.21.15.79:0/1313085280 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb44062030 con 0x5649d548f330 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.992+0000 7fbb59345640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb3c06a840 0x7fbb3c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.992+0000 7fbb5bb4a640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb3c06a840 0x7fbb3c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.992+0000 7fbb59345640 1 -- 172.21.15.79:0/1313085280 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fbb440ccc80 con 0x5649d548f330 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.992+0000 7fbb5e049f40 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5649d548ed90 0x5649d5484310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:28.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.992+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x5649d5484850 con 0x5649d548ed90 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.993+0000 7fbb5bb4a640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb3c06a840 0x7fbb3c06cd00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c002250 tx=0x7fbb4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.993+0000 7fbb5c34b640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5649d548ed90 0x5649d5484310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.993+0000 7fbb5c34b640 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5649d548ed90 0x5649d5484310 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.993+0000 7fbb5c34b640 1 -- 172.21.15.79:0/1313085280 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) ==== 164+0+94 (crc 0 0 0) 0x7fbb5400e040 con 0x5649d548ed90 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.993+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5649d548ed90 msgr2=0x5649d5484310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.993+0000 7fbb5e049f40 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5649d548ed90 0x5649d5484310 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.993+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb3c06a840 msgr2=0x7fbb3c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.993+0000 7fbb5e049f40 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb3c06a840 0x7fbb3c06cd00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c002250 tx=0x7fbb4c008040 comp rx=0 tx=0).stop 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.994+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d548f330 msgr2=0x5649d546aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.994+0000 7fbb5e049f40 1 --2- 172.21.15.79:0/1313085280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649d548f330 0x5649d546aa30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbb44025e30 tx=0x7fbb44005310 comp rx=0 tx=0).stop 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.994+0000 7fbb5c34b640 1 -- 172.21.15.79:0/1313085280 reap_dead start 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.994+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 shutdown_connections 2024-06-10T00:17:28.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.994+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 >> 172.21.15.79:0/1313085280 conn(0x5649d53b5280 msgr2=0x5649d546d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:28.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.994+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 shutdown_connections 2024-06-10T00:17:28.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:28.994+0000 7fbb5e049f40 1 -- 172.21.15.79:0/1313085280 wait complete. 2024-06-10T00:17:28.998 INFO:teuthology.orchestra.run.smithi079.stdout:Xfiledir_test 2024-06-10T00:17:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:28.999 DEBUG:teuthology.orchestra.run.smithi079:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "ancestors": [ 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1099511627776, 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "file", 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 2 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "dirino": 1, 2024-06-10T00:17:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "dir_test", 2024-06-10T00:17:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 4 2024-06-10T00:17:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-06-10T00:17:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 10, 2024-06-10T00:17:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "old_pools": [] 2024-06-10T00:17:29.047 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:29.049 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-06-10T00:17:29.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.132+0000 7f1c049c7f40 1 Processor -- start 2024-06-10T00:17:29.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c049c7f40 1 -- start start 2024-06-10T00:17:29.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c049c7f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0e45d90 0x5625d0e45850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c049c7f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ebb180 0x5625d0e26ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c049c7f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0ed2b50 0x5625d0eb6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c049c7f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5625d0dfe6f0 con 0x5625d0e45d90 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c049c7f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5625d0dfe450 con 0x5625d0ed2b50 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c049c7f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5625d0dfe990 con 0x5625d0ebb180 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c024c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0e45d90 0x5625d0e45850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c024c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0e45d90 0x5625d0e45850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34224/0 (socket says 172.21.15.79:34224) 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c024c8640 1 -- 172.21.15.79:0/3279751227 learned_addr learned my addr 172.21.15.79:0/3279751227 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1bfbfff640 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ebb180 0x5625d0e26ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.133+0000 7f1c02cc9640 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0ed2b50 0x5625d0eb6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c024c8640 1 -- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ebb180 msgr2=0x5625d0e26ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c024c8640 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ebb180 0x5625d0e26ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c024c8640 1 -- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0ed2b50 msgr2=0x5625d0eb6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c024c8640 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0ed2b50 0x5625d0eb6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c024c8640 1 -- 172.21.15.79:0/3279751227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d0d4de20 con 0x5625d0e45d90 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1bfbfff640 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ebb180 0x5625d0e26ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c024c8640 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0e45d90 0x5625d0e45850 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400a7a0 tx=0x7f1bf400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373ea15804ab6767 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c014c6640 1 -- 172.21.15.79:0/3279751227 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4019070 con 0x5625d0e45d90 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c014c6640 1 -- 172.21.15.79:0/3279751227 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf4007600 con 0x5625d0e45d90 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c014c6640 1 -- 172.21.15.79:0/3279751227 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf40079d0 con 0x5625d0e45d90 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 -- 172.21.15.79:0/3279751227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0e45d90 msgr2=0x5625d0e45850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0e45d90 0x5625d0e45850 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400a7a0 tx=0x7f1bf400a890 comp rx=0 tx=0).stop 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 -- 172.21.15.79:0/3279751227 shutdown_connections 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0ed2b50 0x5625d0eb6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ebb180 0x5625d0e26ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 --2- 172.21.15.79:0/3279751227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0e45d90 0x5625d0e45850 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 -- 172.21.15.79:0/3279751227 >> 172.21.15.79:0/3279751227 conn(0x5625d0dfb1c0 msgr2=0x5625d0e26320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 -- 172.21.15.79:0/3279751227 shutdown_connections 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.134+0000 7f1c049c7f40 1 -- 172.21.15.79:0/3279751227 wait complete. 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.135+0000 7f1c049c7f40 1 Processor -- start 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.135+0000 7f1c049c7f40 1 -- start start 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c049c7f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0e45d90 0x5625d0eba660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c049c7f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0ebb180 0x5625d0f6e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c049c7f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ed2b50 0x5625d0e1d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c049c7f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5625d0e26a30 con 0x5625d0ebb180 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c049c7f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5625d0ed2170 con 0x5625d0e45d90 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c049c7f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5625d0eb6690 con 0x5625d0ed2b50 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0ebb180 0x5625d0f6e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0ebb180 0x5625d0f6e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34226/0 (socket says 172.21.15.79:34226) 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 -- 172.21.15.79:0/2808164098 learned_addr learned my addr 172.21.15.79:0/2808164098 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c024c8640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0e45d90 0x5625d0eba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c02cc9640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ed2b50 0x5625d0e1d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 -- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ed2b50 msgr2=0x5625d0e1d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5625d0ed2b50 0x5625d0e1d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 -- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0e45d90 msgr2=0x5625d0eba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625d0e45d90 0x5625d0eba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 -- 172.21.15.79:0/2808164098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d0d28cb0 con 0x5625d0ebb180 2024-06-10T00:17:29.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfbfff640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0ebb180 0x5625d0f6e620 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009e60 tx=0x7f1bec009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfb7fe640 1 -- 172.21.15.79:0/2808164098 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0143f0 con 0x5625d0ebb180 2024-06-10T00:17:29.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfb7fe640 1 -- 172.21.15.79:0/2808164098 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec019070 con 0x5625d0ebb180 2024-06-10T00:17:29.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625d0e27de0 con 0x5625d0ebb180 2024-06-10T00:17:29.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1bfb7fe640 1 -- 172.21.15.79:0/2808164098 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0147d0 con 0x5625d0ebb180 2024-06-10T00:17:29.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.136+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d0e27b00 con 0x5625d0ebb180 2024-06-10T00:17:29.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.138+0000 7f1bfb7fe640 1 -- 172.21.15.79:0/2808164098 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bec014970 con 0x5625d0ebb180 2024-06-10T00:17:29.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.138+0000 7f1bfb7fe640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1be406a810 0x7f1be406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.138+0000 7f1bfb7fe640 1 -- 172.21.15.79:0/2808164098 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f1bec089a00 con 0x5625d0ebb180 2024-06-10T00:17:29.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.138+0000 7f1c024c8640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1be406a810 0x7f1be406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.138+0000 7f1c049c7f40 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5625d0e1def0 0x5625d0eb4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.138+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x5625d0f76da0 con 0x5625d0e1def0 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.138+0000 7f1c024c8640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1be406a810 0x7f1be406ccd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4017040 tx=0x7f1bf400c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.139+0000 7f1c02cc9640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5625d0e1def0 0x5625d0eb4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.139+0000 7f1c02cc9640 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5625d0e1def0 0x5625d0eb4050 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c02cc9640 1 -- 172.21.15.79:0/2808164098 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v63'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1bfc051860 con 0x5625d0e1def0 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5625d0e1def0 msgr2=0x5625d0eb4050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5625d0e1def0 0x5625d0eb4050 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1be406a810 msgr2=0x7f1be406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1be406a810 0x7f1be406ccd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4017040 tx=0x7f1bf400c000 comp rx=0 tx=0).stop 2024-06-10T00:17:29.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0ebb180 msgr2=0x5625d0f6e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 --2- 172.21.15.79:0/2808164098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625d0ebb180 0x5625d0f6e620 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009e60 tx=0x7f1bec009f50 comp rx=0 tx=0).stop 2024-06-10T00:17:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c02cc9640 1 -- 172.21.15.79:0/2808164098 reap_dead start 2024-06-10T00:17:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 shutdown_connections 2024-06-10T00:17:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 >> 172.21.15.79:0/2808164098 conn(0x5625d0dfb1c0 msgr2=0x5625d0e26320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 shutdown_connections 2024-06-10T00:17:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.140+0000 7f1c049c7f40 1 -- 172.21.15.79:0/2808164098 wait complete. 2024-06-10T00:17:29.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:29.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-06-10T00:17:29.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.249+0000 7fa53b888640 1 Processor -- start 2024-06-10T00:17:29.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.249+0000 7fa53b888640 1 -- start start 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa53b888640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5340cf0e0 0x7fa5340adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa53b888640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5340acd40 con 0x7fa534155590 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa53b888640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5340cf570 con 0x7fa5340cec60 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa53b888640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa53415bfe0 con 0x7fa5340cf0e0 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa539624640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa534155590 0x7fa53415b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60248/0 (socket says 172.21.15.79:60248) 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa539624640 1 -- 172.21.15.79:0/1271259399 learned_addr learned my addr 172.21.15.79:0/1271259399 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa539e25640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5340cf0e0 0x7fa5340adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3624123371 0 0) 0x7fa5340acd40 con 0x7fa534155590 2024-06-10T00:17:29.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa520003520 con 0x7fa534155590 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1288215449 0 0) 0x7fa520003520 con 0x7fa534155590 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5340cf0e0 msgr2=0x7fa5340adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5340cf0e0 0x7fa5340adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 >> v1:172.21.15.117:6789/0 conn(0x7fa5340cec60 legacy=0x7fa5340ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53415c2c0 con 0x7fa534155590 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fa530001670 con 0x7fa534155590 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 >> v1:172.21.15.79:6789/0 conn(0x7fa534155590 legacy=0x7fa53415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5200039e0 0x7fa520003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa520004800 0x7fa520004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5340cf0e0 0x7fa5200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa53415bfe0 con 0x7fa520004800 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa52000ba70 con 0x7fa5200039e0 2024-06-10T00:17:29.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.250+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa52000bc70 con 0x7fa5340cf0e0 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa538e23640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa520004800 0x7fa520004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa539e25640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5340cf0e0 0x7fa5200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa539624640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5200039e0 0x7fa520003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa538e23640 1 -- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5340cf0e0 msgr2=0x7fa5200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa538e23640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5340cf0e0 0x7fa5200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa538e23640 1 -- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5200039e0 msgr2=0x7fa520003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa538e23640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5200039e0 0x7fa520003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa538e23640 1 -- 172.21.15.79:0/1271259399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa520003520 con 0x7fa520004800 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.251+0000 7fa539624640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5200039e0 0x7fa520003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa538e23640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa520004800 0x7fa520004c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa524001330 tx=0x7fa520005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd199cb604d0b58 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524001370 con 0x7fa520004800 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52402cd60 con 0x7fa520004800 2024-06-10T00:17:29.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa52bfff640 1 -- 172.21.15.79:0/1271259399 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524005310 con 0x7fa520004800 2024-06-10T00:17:29.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa53b888640 1 -- 172.21.15.79:0/1271259399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa520004800 msgr2=0x7fa520004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa53b888640 1 --2- 172.21.15.79:0/1271259399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa520004800 0x7fa520004c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa524001330 tx=0x7fa520005830 comp rx=0 tx=0).stop 2024-06-10T00:17:29.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa539e25640 1 -- 172.21.15.79:0/1271259399 reap_dead start 2024-06-10T00:17:29.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa53b888640 1 -- 172.21.15.79:0/1271259399 shutdown_connections 2024-06-10T00:17:29.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa53b888640 1 -- 172.21.15.79:0/1271259399 >> 172.21.15.79:0/1271259399 conn(0x7fa5340b1980 msgr2=0x7fa5340b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa53b888640 1 -- 172.21.15.79:0/1271259399 shutdown_connections 2024-06-10T00:17:29.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.252+0000 7fa53b888640 1 -- 172.21.15.79:0/1271259399 wait complete. 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.253+0000 7fa53b888640 1 Processor -- start 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.253+0000 7fa53b888640 1 -- start start 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa53b888640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa520004800 0x7fa5340ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa53b888640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53414f450 0x7fa53414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa53b888640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa53415d780 0x7fa53415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa53b888640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5340b26d0 con 0x7fa53415d780 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa53b888640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5340ad2e0 con 0x7fa520004800 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa53b888640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa53415bb70 con 0x7fa53414f450 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa539e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa53415d780 0x7fa53415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa539e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa53415d780 0x7fa53415dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34248/0 (socket says 172.21.15.79:34248) 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa539e25640 1 -- 172.21.15.79:0/469882478 learned_addr learned my addr 172.21.15.79:0/469882478 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa538e23640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53414f450 0x7fa53414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa539624640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa520004800 0x7fa5340ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa539e25640 1 -- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53414f450 msgr2=0x7fa53414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.254+0000 7fa539e25640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53414f450 0x7fa53414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa539e25640 1 -- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa520004800 msgr2=0x7fa5340ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa539e25640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa520004800 0x7fa5340ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa539e25640 1 -- 172.21.15.79:0/469882478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa534151200 con 0x7fa53415d780 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa539624640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa520004800 0x7fa5340ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa539e25640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa53415d780 0x7fa53415dc10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa53406fbc0 tx=0x7fa52c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa529ffb640 1 -- 172.21.15.79:0/469882478 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c015430 con 0x7fa53415d780 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa529ffb640 1 -- 172.21.15.79:0/469882478 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c0155f0 con 0x7fa53415d780 2024-06-10T00:17:29.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa53b888640 1 -- 172.21.15.79:0/469882478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5341514e0 con 0x7fa53415d780 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa529ffb640 1 -- 172.21.15.79:0/469882478 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0159e0 con 0x7fa53415d780 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.255+0000 7fa53b888640 1 -- 172.21.15.79:0/469882478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53409ab40 con 0x7fa53415d780 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.257+0000 7fa529ffb640 1 -- 172.21.15.79:0/469882478 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa52c015b80 con 0x7fa53415d780 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.257+0000 7fa529ffb640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa51806be60 0x7fa51806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.257+0000 7fa529ffb640 1 -- 172.21.15.79:0/469882478 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fa52c08bf30 con 0x7fa53415d780 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.257+0000 7fa539624640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa51806be60 0x7fa51806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.257+0000 7fa539624640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa51806be60 0x7fa51806e320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa530001200 tx=0x7fa530009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.258+0000 7fa53e594740 1 Processor -- start 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.258+0000 7fa53e594740 1 -- start start 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.258+0000 7fa53e594740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9b79330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa53e594740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9ba8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa53e594740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9ba9380 0x5555d9b7e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa53e594740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5555d9b45cd0 con 0x5555d9ba9380 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa53e594740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5555d9ae1ab0 con 0x5555d9ba9ac0 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa53e594740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5555d9a7fc30 con 0x5555d9bc69a0 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9ba9380 0x5555d9b7e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9ba9380 0x5555d9b7e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34250/0 (socket says 172.21.15.79:34250) 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 -- 172.21.15.79:0/1687975214 learned_addr learned my addr 172.21.15.79:0/1687975214 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa538e23640 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9ba8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539624640 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9b79330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 -- 172.21.15.79:0/1687975214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 msgr2=0x5555d9b79330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9b79330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 -- 172.21.15.79:0/1687975214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 msgr2=0x5555d9ba8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9ba8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 -- 172.21.15.79:0/1687975214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d9aa8970 con 0x5555d9ba9380 2024-06-10T00:17:29.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa539e25640 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9ba9380 0x5555d9b7e190 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa52c059c40 tx=0x7fa52c0599f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5336974cfd673f1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa51effd640 1 -- 172.21.15.79:0/1687975214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c05e380 con 0x5555d9ba9380 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa51effd640 1 -- 172.21.15.79:0/1687975214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c062bb0 con 0x5555d9ba9380 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.259+0000 7fa51effd640 1 -- 172.21.15.79:0/1687975214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0582d0 con 0x5555d9ba9380 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 -- 172.21.15.79:0/1687975214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9ba9380 msgr2=0x5555d9b7e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9ba9380 0x5555d9b7e190 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa52c059c40 tx=0x7fa52c0599f0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 -- 172.21.15.79:0/1687975214 shutdown_connections 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9ba9380 0x5555d9b7e190 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9ba8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 --2- 172.21.15.79:0/1687975214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9b79330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 -- 172.21.15.79:0/1687975214 >> 172.21.15.79:0/1687975214 conn(0x5555d9b7b5a0 msgr2=0x5555d9bc3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 -- 172.21.15.79:0/1687975214 shutdown_connections 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 -- 172.21.15.79:0/1687975214 wait complete. 2024-06-10T00:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.260+0000 7fa53e594740 1 -- start start 2024-06-10T00:17:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.261+0000 7fa53e594740 1 Processor -- start 2024-06-10T00:17:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.261+0000 7fa53e594740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9bd3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.261+0000 7fa53e594740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9babd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.261+0000 7fa53e594740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9bac250 0x5555d9ba9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.261+0000 7fa53e594740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5555d9a6add0 con 0x5555d9bac250 2024-06-10T00:17:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.261+0000 7fa53e594740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5555d9adda70 con 0x5555d9ba9ac0 2024-06-10T00:17:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.261+0000 7fa53e594740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5555d9b7d750 con 0x5555d9bc69a0 2024-06-10T00:17:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.261+0000 7fa53e594740 10 client.0 _ll_register_callbacks cb 0x5555d9a9ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9bac250 0x5555d9ba9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9bac250 0x5555d9ba9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34252/0 (socket says 172.21.15.79:34252) 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 -- 172.21.15.79:0/1928586844 learned_addr learned my addr 172.21.15.79:0/1928586844 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa538e23640 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9babd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539624640 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9bd3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 -- 172.21.15.79:0/1928586844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 msgr2=0x5555d9babd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9babd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 -- 172.21.15.79:0/1928586844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 msgr2=0x5555d9bd3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9bd3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 -- 172.21.15.79:0/1928586844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d98c17b0 con 0x5555d9bac250 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa539e25640 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9bac250 0x5555d9ba9fb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa52c056430 tx=0x7fa52c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602ac771b070737 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa513fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa513fff640 1 -- 172.21.15.79:0/1928586844 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c079020 con 0x5555d9bac250 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa513fff640 1 -- 172.21.15.79:0/1928586844 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fa52c05a430 con 0x5555d9bac250 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 1 -- 172.21.15.79:0/1928586844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa52c062bb0 con 0x5555d9bac250 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa513fff640 1 -- 172.21.15.79:0/1928586844 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa52c07f050 con 0x5555d9bac250 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 10 client.5991 fetch_fsmap learned FSMap version 29 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 1 -- 172.21.15.79:0/1928586844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5555d9921f40 con 0x5555d9bac250 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa513fff640 1 -- 172.21.15.79:0/1928586844 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c062bb0 con 0x5555d9bac250 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa513fff640 1 -- 172.21.15.79:0/1928586844 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 3494+0+0 (secure 0 0 0) 0x7fa52c082080 con 0x5555d9bac250 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 10 client.5991 fetch_fsmap finished waiting for FSMap version 29 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 10 client.5991 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 20 client.5991 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5555d9b99940 0x5555d9bd3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 4 client.5991 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.262+0000 7fa53e594740 1 -- 172.21.15.79:0/1928586844 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555d9aef1e0 con 0x5555d9b99940 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.263+0000 7fa539624640 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5555d9b99940 0x5555d9bd3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.263+0000 7fa513fff640 10 client.5991 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.263+0000 7fa539624640 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5555d9b99940 0x5555d9bd3fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46eb00aac146c020 server_cookie=7c8bc28084efc2a4 in_seq=0 out_seq=0 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.263+0000 7fa513fff640 1 -- 172.21.15.79:0/1928586844 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5555d9aef1e0 con 0x5555d9b99940 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.263+0000 7fa513fff640 10 client.5991 handle_command_reply: tid=0 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.263+0000 7fa53e594740 1 client.5991 shutdown 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 -- 172.21.15.79:0/1928586844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9bac250 msgr2=0x5555d9ba9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9bac250 0x5555d9ba9fb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa52c056430 tx=0x7fa52c007040 comp rx=0 tx=0).stop 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 -- 172.21.15.79:0/1928586844 shutdown_connections 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9bac250 0x5555d9ba9fb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5555d9b99940 0x5555d9bd3fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9babd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 --2- 172.21.15.79:0/1928586844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9bd3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 -- 172.21.15.79:0/1928586844 >> 172.21.15.79:0/1928586844 conn(0x5555d9ba9380 msgr2=0x5555d9b7db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa513fff640 0 client.5991 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 -- 172.21.15.79:0/1928586844 shutdown_connections 2024-06-10T00:17:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 1 -- 172.21.15.79:0/1928586844 wait complete. 2024-06-10T00:17:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.264+0000 7fa53e594740 20 client.5991 trim_cache size 0 max 16384 2024-06-10T00:17:29.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.282+0000 7fa53e594740 1 Processor -- start 2024-06-10T00:17:29.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.282+0000 7fa53e594740 1 -- start start 2024-06-10T00:17:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa53e594740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9ba9ac0 0x5555d9b803d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa53e594740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9bc69a0 0x5555d9bc7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa53e594740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9bc2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa53e594740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341fd3a0 con 0x5555d9b7c1e0 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa53e594740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341fc3c0 con 0x5555d9bc69a0 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa53e594740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5341fb750 con 0x5555d9ba9ac0 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9bc2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9bc2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34254/0 (socket says 172.21.15.79:34254) 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 -- 172.21.15.79:0/183972919 learned_addr learned my addr 172.21.15.79:0/183972919 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa538e23640 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9bc69a0 0x5555d9bc7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539624640 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9ba9ac0 0x5555d9b803d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 -- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9ba9ac0 msgr2=0x5555d9b803d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9ba9ac0 0x5555d9b803d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 -- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9bc69a0 msgr2=0x5555d9bc7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9bc69a0 0x5555d9bc7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 -- 172.21.15.79:0/183972919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d9baa320 con 0x5555d9b7c1e0 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa538e23640 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9bc69a0 0x5555d9bc7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa539e25640 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9bc2e90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa52c059cd0 tx=0x7fa52c017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82bede21771299d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa51e7fc640 1 -- 172.21.15.79:0/183972919 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c079040 con 0x5555d9b7c1e0 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa51e7fc640 1 -- 172.21.15.79:0/183972919 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c062bb0 con 0x5555d9b7c1e0 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.283+0000 7fa51e7fc640 1 -- 172.21.15.79:0/183972919 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c05a490 con 0x5555d9b7c1e0 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 -- 172.21.15.79:0/183972919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 msgr2=0x5555d9bc2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9bc2e90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa52c059cd0 tx=0x7fa52c017070 comp rx=0 tx=0).stop 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 -- 172.21.15.79:0/183972919 shutdown_connections 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9bc2e90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9bc69a0 0x5555d9bc7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 --2- 172.21.15.79:0/183972919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9ba9ac0 0x5555d9b803d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 -- 172.21.15.79:0/183972919 >> 172.21.15.79:0/183972919 conn(0x5555d9ba9380 msgr2=0x5555d9bd6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 -- 172.21.15.79:0/183972919 shutdown_connections 2024-06-10T00:17:29.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.284+0000 7fa53e594740 1 -- 172.21.15.79:0/183972919 wait complete. 2024-06-10T00:17:29.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.285+0000 7fa53e594740 1 -- start start 2024-06-10T00:17:29.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.285+0000 7fa53e594740 1 Processor -- start 2024-06-10T00:17:29.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9b7a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9ba5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9b790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5555d9a97fe0 con 0x5555d9b7c1e0 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341fbda0 con 0x5555d9ba9ac0 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5555d9ae3f50 con 0x5555d9bc69a0 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 10 client.0 _ll_register_callbacks cb 0x7fa52c004a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9b7a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9b7a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34266/0 (socket says 172.21.15.79:34266) 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 -- 172.21.15.79:0/2009417310 learned_addr learned my addr 172.21.15.79:0/2009417310 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539e25640 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9b790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa538e23640 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9ba5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 -- 172.21.15.79:0/2009417310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 msgr2=0x5555d9b790c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9b790c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 -- 172.21.15.79:0/2009417310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 msgr2=0x5555d9ba5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9ba5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 -- 172.21.15.79:0/2009417310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d97b50a0 con 0x5555d9b7c1e0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa539624640 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9b7a700 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa530001480 tx=0x7fa53415c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bda01f25c33145 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa513fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa513fff640 1 -- 172.21.15.79:0/2009417310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530032060 con 0x5555d9b7c1e0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa513fff640 1 -- 172.21.15.79:0/2009417310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fa530014810 con 0x5555d9b7c1e0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 1 -- 172.21.15.79:0/2009417310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa52c062bb0 con 0x5555d9b7c1e0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa513fff640 1 -- 172.21.15.79:0/2009417310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa530038050 con 0x5555d9b7c1e0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 10 client.5997 fetch_fsmap learned FSMap version 29 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.286+0000 7fa53e594740 1 -- 172.21.15.79:0/2009417310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5555d9bddbf0 con 0x5555d9b7c1e0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa513fff640 1 -- 172.21.15.79:0/2009417310 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c062bb0 con 0x5555d9b7c1e0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa513fff640 1 -- 172.21.15.79:0/2009417310 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 3494+0+0 (secure 0 0 0) 0x7fa53003b020 con 0x5555d9b7c1e0 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa53e594740 10 client.5997 fetch_fsmap finished waiting for FSMap version 29 2024-06-10T00:17:29.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa53e594740 10 client.5997 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa53e594740 20 client.5997 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa53e594740 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5555d9ba64a0 0x5555d9b79600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa53e594740 4 client.5997 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa53e594740 1 -- 172.21.15.79:0/2009417310 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x5555d9ae9530 con 0x5555d9ba64a0 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa538e23640 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5555d9ba64a0 0x5555d9b79600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa513fff640 10 client.5997 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.287+0000 7fa538e23640 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5555d9ba64a0 0x5555d9b79600 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb04a3456f21492 server_cookie=2e86eecc7f35a7f in_seq=0 out_seq=0 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa513fff640 1 -- 172.21.15.79:0/2009417310 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5555d9ae9530 con 0x5555d9ba64a0 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa513fff640 10 client.5997 handle_command_reply: tid=0 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 client.5997 shutdown 2024-06-10T00:17:29.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 -- 172.21.15.79:0/2009417310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 msgr2=0x5555d9b7a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9b7a700 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa530001480 tx=0x7fa53415c490 comp rx=0 tx=0).stop 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 -- 172.21.15.79:0/2009417310 shutdown_connections 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5555d9ba64a0 0x5555d9b79600 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5555d9bc69a0 0x5555d9b790c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5555d9ba9ac0 0x5555d9ba5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 --2- 172.21.15.79:0/2009417310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9b7c1e0 0x5555d9b7a700 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 -- 172.21.15.79:0/2009417310 >> 172.21.15.79:0/2009417310 conn(0x5555d9ba9380 msgr2=0x5555d9b803d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa513fff640 0 client.5997 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 -- 172.21.15.79:0/2009417310 shutdown_connections 2024-06-10T00:17:29.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 1 -- 172.21.15.79:0/2009417310 wait complete. 2024-06-10T00:17:29.296 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fd0a3c13640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5955=0-4194304@1} caps={5955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5955 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x561bcae90680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-10T00:17:29.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.288+0000 7fa53e594740 20 client.5997 trim_cache size 0 max 16384 2024-06-10T00:17:29.296 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:29.296 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:17:29.296 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "3a471ab3-d3bb-4af4-9098-5e41b9df1564", 2024-06-10T00:17:29.296 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:17:29.296 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:29.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 -- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa51806be60 msgr2=0x7fa51806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa51806be60 0x7fa51806e320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa530001200 tx=0x7fa530009040 comp rx=0 tx=0).stop 2024-06-10T00:17:29.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 -- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa53415d780 msgr2=0x7fa53415dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa53415d780 0x7fa53415dc10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa53406fbc0 tx=0x7fa52c00f580 comp rx=0 tx=0).stop 2024-06-10T00:17:29.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 -- 172.21.15.79:0/469882478 shutdown_connections 2024-06-10T00:17:29.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa51806be60 0x7fa51806e320 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa53415d780 0x7fa53415dc10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53414f450 0x7fa53414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 --2- 172.21.15.79:0/469882478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa520004800 0x7fa5340ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 -- 172.21.15.79:0/469882478 >> 172.21.15.79:0/469882478 conn(0x7fa5340b1980 msgr2=0x7fa534153a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 -- 172.21.15.79:0/469882478 shutdown_connections 2024-06-10T00:17:29.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.289+0000 7fa53b888640 1 -- 172.21.15.79:0/469882478 wait complete. 2024-06-10T00:17:29.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:29.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-06-10T00:17:29.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.400+0000 7f9e32a8c640 1 Processor -- start 2024-06-10T00:17:29.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.400+0000 7f9e32a8c640 1 -- start start 2024-06-10T00:17:29.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e32a8c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c155320 0x7f9e2c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e32a8c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e2c0b34e0 0x7f9e2c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e32a8c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e2c0d0560 0x7f9e2c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e32a8c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9e2c155700 con 0x7f9e2c0d0560 2024-06-10T00:17:29.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e32a8c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9e2c15b6b0 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e32a8c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c15b990 con 0x7f9e2c155320 2024-06-10T00:17:29.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e31029640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e2c0d0560 0x7f9e2c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e31029640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e2c0d0560 0x7f9e2c06e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34268/0 (socket says 172.21.15.79:34268) 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e31029640 1 -- 172.21.15.79:0/3662715301 learned_addr learned my addr 172.21.15.79:0/3662715301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/3662715301 >> v2:172.21.15.117:3300/0 conn(0x7f9e2c0b34e0 0x7f9e2c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e30828640 1 --2- 172.21.15.79:0/3662715301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c155320 0x7f9e2c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e31029640 1 -- 172.21.15.79:0/3662715301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c155320 msgr2=0x7f9e2c0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.401+0000 7f9e31029640 1 --2- 172.21.15.79:0/3662715301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c155320 0x7f9e2c0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.402+0000 7f9e31029640 1 -- 172.21.15.79:0/3662715301 >> v2:172.21.15.117:3300/0 conn(0x7f9e2c0b34e0 msgr2=0x7f9e2c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.402+0000 7f9e31029640 1 --2- 172.21.15.79:0/3662715301 >> v2:172.21.15.117:3300/0 conn(0x7f9e2c0b34e0 0x7f9e2c0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.402+0000 7f9e31029640 1 -- 172.21.15.79:0/3662715301 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c15bc70 con 0x7f9e2c0d0560 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.402+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/3662715301 >> v2:172.21.15.117:3300/0 conn(0x7f9e2c0b34e0 0x7f9e2c0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.402+0000 7f9e31029640 1 --2- 172.21.15.79:0/3662715301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0d0560 0x7f9e2c06e1f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0d0c90 tx=0x7f9e2402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd3fe924e8d4235 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.402+0000 7f9e2b7fe640 1 -- 172.21.15.79:0/3662715301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24036070 con 0x7f9e2c0d0560 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.402+0000 7f9e2b7fe640 1 -- 172.21.15.79:0/3662715301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e24031600 con 0x7f9e2c0d0560 2024-06-10T00:17:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.402+0000 7f9e2b7fe640 1 -- 172.21.15.79:0/3662715301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e240319d0 con 0x7f9e2c0d0560 2024-06-10T00:17:29.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3662715301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0d0560 msgr2=0x7f9e2c06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3662715301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0d0560 0x7f9e2c06e1f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0d0c90 tx=0x7f9e2402a6a0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3662715301 shutdown_connections 2024-06-10T00:17:29.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3662715301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0d0560 0x7f9e2c06e1f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3662715301 >> v2:172.21.15.117:3300/0 conn(0x7f9e2c0b34e0 0x7f9e2c0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3662715301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c155320 0x7f9e2c0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3662715301 >> 172.21.15.79:0/3662715301 conn(0x7f9e2c0b1d10 msgr2=0x7f9e2c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3662715301 shutdown_connections 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.403+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3662715301 wait complete. 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.404+0000 7f9e32a8c640 1 Processor -- start 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.404+0000 7f9e32a8c640 1 -- start start 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e32a8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0b34e0 0x7f9e2c14f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e32a8c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c0d0560 0x7f9e2c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e32a8c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e2c155320 0x7f9e2c0ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e32a8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c15b470 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e32a8c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c15b2f0 con 0x7f9e2c155320 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e32a8c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c06e730 con 0x7f9e2c0d0560 2024-06-10T00:17:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e30828640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0b34e0 0x7f9e2c14f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e30828640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0b34e0 0x7f9e2c14f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34274/0 (socket says 172.21.15.79:34274) 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e30828640 1 -- 172.21.15.79:0/3885065427 learned_addr learned my addr 172.21.15.79:0/3885065427 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e31029640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e2c155320 0x7f9e2c0ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c0d0560 0x7f9e2c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.405+0000 7f9e30828640 1 -- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c0d0560 msgr2=0x7f9e2c0ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e30828640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c0d0560 0x7f9e2c0ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e30828640 1 -- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e2c155320 msgr2=0x7f9e2c0ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e30828640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e2c155320 0x7f9e2c0ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e30828640 1 -- 172.21.15.79:0/3885065427 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c14fcc0 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e31029640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e2c155320 0x7f9e2c0ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e30828640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0b34e0 0x7f9e2c14f780 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00d5f0 tx=0x7f9e1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e297fa640 1 -- 172.21.15.79:0/3885065427 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0125f0 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e297fa640 1 -- 172.21.15.79:0/3885065427 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1c019070 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e297fa640 1 -- 172.21.15.79:0/3885065427 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0129d0 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3885065427 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2c09d670 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.406+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3885065427 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2c0cd670 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.407+0000 7f9e297fa640 1 -- 172.21.15.79:0/3885065427 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e1c012b70 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.408+0000 7f9e297fa640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e1806be30 0x7f9e1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.408+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e1806be30 0x7f9e1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.408+0000 7f9e297fa640 1 -- 172.21.15.79:0/3885065427 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f9e1c08b3e0 con 0x7f9e2c0b34e0 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.409+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e1806be30 0x7f9e1806e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006fd0 tx=0x7f9e20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.409+0000 7f9e35798740 1 Processor -- start 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.409+0000 7f9e35798740 1 -- start start 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e35798740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c41ff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e35798740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c41fa1a0 0x55b8c41ff660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e35798740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c42016d0 0x55b8c41ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e35798740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b8c41247e0 con 0x55b8c42016d0 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e35798740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b8c4162e80 con 0x55b8c41fa1a0 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e35798740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b8c4100700 con 0x55b8c4222af0 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c42016d0 0x55b8c41ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c42016d0 0x55b8c41ffba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34288/0 (socket says 172.21.15.79:34288) 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 -- 172.21.15.79:0/3110840883 learned_addr learned my addr 172.21.15.79:0/3110840883 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e30828640 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c41ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c41fa1a0 0x55b8c41ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 -- 172.21.15.79:0/3110840883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 msgr2=0x55b8c41ff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c41ff120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 -- 172.21.15.79:0/3110840883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c41fa1a0 msgr2=0x55b8c41ff660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c41fa1a0 0x55b8c41ff660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 -- 172.21.15.79:0/3110840883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8c411fdd0 con 0x55b8c42016d0 2024-06-10T00:17:29.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e31029640 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c42016d0 0x55b8c41ffba0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9e2402a6e0 tx=0x7f9e2402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48566d99a3128bab server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.410+0000 7f9e127fc640 1 -- 172.21.15.79:0/3110840883 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24036040 con 0x55b8c42016d0 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e127fc640 1 -- 172.21.15.79:0/3110840883 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2403c640 con 0x55b8c42016d0 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e127fc640 1 -- 172.21.15.79:0/3110840883 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2403c9f0 con 0x55b8c42016d0 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 -- 172.21.15.79:0/3110840883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c42016d0 msgr2=0x55b8c41ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c42016d0 0x55b8c41ffba0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9e2402a6e0 tx=0x7f9e2402e000 comp rx=0 tx=0).stop 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 -- 172.21.15.79:0/3110840883 shutdown_connections 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c42016d0 0x55b8c41ffba0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c41fa1a0 0x55b8c41ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 --2- 172.21.15.79:0/3110840883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c41ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 -- 172.21.15.79:0/3110840883 >> 172.21.15.79:0/3110840883 conn(0x55b8c41fc410 msgr2=0x55b8c4244f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 -- 172.21.15.79:0/3110840883 shutdown_connections 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.411+0000 7f9e35798740 1 -- 172.21.15.79:0/3110840883 wait complete. 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.412+0000 7f9e35798740 1 -- start start 2024-06-10T00:17:29.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.412+0000 7f9e35798740 1 Processor -- start 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e35798740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c4225e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e35798740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c421ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e35798740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 0x55b8c422ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e35798740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b8c40eb640 con 0x55b8c421f270 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e35798740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b8c415ee40 con 0x55b8c422c5f0 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e35798740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b8c41fdbe0 con 0x55b8c4222af0 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e35798740 10 client.0 _ll_register_callbacks cb 0x55b8c411d430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c421ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c421ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34290/0 (socket says 172.21.15.79:34290) 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 -- 172.21.15.79:0/1399845989 learned_addr learned my addr 172.21.15.79:0/1399845989 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e30828640 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c4225e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e31029640 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 0x55b8c422ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 -- 172.21.15.79:0/1399845989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 msgr2=0x55b8c4225e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c4225e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 -- 172.21.15.79:0/1399845989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 msgr2=0x55b8c422ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 0x55b8c422ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 -- 172.21.15.79:0/1399845989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8c3f407d0 con 0x55b8c421f270 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c421ebf0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0b2ed0 tx=0x7f9e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69374a59b5675e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/1399845989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20026070 con 0x55b8c421f270 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/1399845989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f9e20016ab0 con 0x55b8c421f270 2024-06-10T00:17:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.413+0000 7f9e35798740 1 -- 172.21.15.79:0/1399845989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e2403c640 con 0x55b8c421f270 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/1399845989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e20031050 con 0x55b8c421f270 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e35798740 10 client.6009 fetch_fsmap learned FSMap version 29 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e35798740 1 -- 172.21.15.79:0/1399845989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55b8c3e763f0 con 0x55b8c421f270 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/1399845989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2403c640 con 0x55b8c421f270 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/1399845989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 3494+0+0 (secure 0 0 0) 0x7f9e20034020 con 0x55b8c421f270 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e35798740 10 client.6009 fetch_fsmap finished waiting for FSMap version 29 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e35798740 10 client.6009 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e35798740 20 client.6009 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e35798740 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55b8c4228420 0x55b8c4228800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e35798740 4 client.6009 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e35798740 1 -- 172.21.15.79:0/1399845989 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8c41705b0 con 0x55b8c4228420 2024-06-10T00:17:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e30828640 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55b8c4228420 0x55b8c4228800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e0b7fe640 10 client.6009 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.414+0000 7f9e30828640 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55b8c4228420 0x55b8c4228800 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97faf9fd5ccae3 server_cookie=cf2ac24bc3cc72f6 in_seq=0 out_seq=0 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/1399845989 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b8c41705b0 con 0x55b8c4228420 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e0b7fe640 10 client.6009 handle_command_reply: tid=0 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 client.6009 shutdown 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 -- 172.21.15.79:0/1399845989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 msgr2=0x55b8c421ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c421ebf0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0b2ed0 tx=0x7f9e200046c0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 -- 172.21.15.79:0/1399845989 shutdown_connections 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 0x55b8c422ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c421ebf0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55b8c4228420 0x55b8c4228800 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 --2- 172.21.15.79:0/1399845989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c4225e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 -- 172.21.15.79:0/1399845989 >> 172.21.15.79:0/1399845989 conn(0x55b8c42016d0 msgr2=0x55b8c4248440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e0b7fe640 0 client.6009 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 -- 172.21.15.79:0/1399845989 shutdown_connections 2024-06-10T00:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 1 -- 172.21.15.79:0/1399845989 wait complete. 2024-06-10T00:17:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.415+0000 7f9e35798740 20 client.6009 trim_cache size 0 max 16384 2024-06-10T00:17:29.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.433+0000 7f9e35798740 1 Processor -- start 2024-06-10T00:17:29.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.433+0000 7f9e35798740 1 -- start start 2024-06-10T00:17:29.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e35798740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c4268cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e35798740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c41fdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e35798740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 0x55b8c41fe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e35798740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1fece0 con 0x55b8c421f270 2024-06-10T00:17:29.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e35798740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1fdd40 con 0x55b8c422c5f0 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e35798740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c156840 con 0x55b8c4222af0 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c4268cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c4268cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34304/0 (socket says 172.21.15.79:34304) 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 -- 172.21.15.79:0/1688275672 learned_addr learned my addr 172.21.15.79:0/1688275672 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 -- 172.21.15.79:0/1688275672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 msgr2=0x55b8c41fdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 --2- 172.21.15.79:0/1688275672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c41fdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 -- 172.21.15.79:0/1688275672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 msgr2=0x55b8c41fe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 --2- 172.21.15.79:0/1688275672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 0x55b8c41fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 -- 172.21.15.79:0/1688275672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8c3e360f0 con 0x55b8c421f270 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.434+0000 7f9e30828640 1 --2- 172.21.15.79:0/1688275672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c4268cc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c059220 tx=0x7f9e1c08b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd866ba551f4420f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e11ffb640 1 -- 172.21.15.79:0/1688275672 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c012e60 con 0x55b8c421f270 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e11ffb640 1 -- 172.21.15.79:0/1688275672 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1c085070 con 0x55b8c421f270 2024-06-10T00:17:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e11ffb640 1 -- 172.21.15.79:0/1688275672 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c089410 con 0x55b8c421f270 2024-06-10T00:17:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 -- 172.21.15.79:0/1688275672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 msgr2=0x55b8c4268cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 --2- 172.21.15.79:0/1688275672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c4268cc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c059220 tx=0x7f9e1c08b040 comp rx=0 tx=0).stop 2024-06-10T00:17:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 -- 172.21.15.79:0/1688275672 shutdown_connections 2024-06-10T00:17:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 --2- 172.21.15.79:0/1688275672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c422c5f0 0x55b8c41fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 --2- 172.21.15.79:0/1688275672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c41fdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 --2- 172.21.15.79:0/1688275672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c421f270 0x55b8c4268cc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 -- 172.21.15.79:0/1688275672 >> 172.21.15.79:0/1688275672 conn(0x55b8c42016d0 msgr2=0x55b8c4225ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 -- 172.21.15.79:0/1688275672 shutdown_connections 2024-06-10T00:17:29.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.435+0000 7f9e35798740 1 -- 172.21.15.79:0/1688275672 wait complete. 2024-06-10T00:17:29.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.436+0000 7f9e35798740 1 -- start start 2024-06-10T00:17:29.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.436+0000 7f9e35798740 1 Processor -- start 2024-06-10T00:17:29.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e35798740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c421f270 0x55b8c421df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e35798740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c42c2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e35798740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c422c5f0 0x55b8c425e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e35798740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b8c4168100 con 0x55b8c422c5f0 2024-06-10T00:17:29.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e35798740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1fd6f0 con 0x55b8c421f270 2024-06-10T00:17:29.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e35798740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b8c4220810 con 0x55b8c4222af0 2024-06-10T00:17:29.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e35798740 10 client.0 _ll_register_callbacks cb 0x7f9e20010f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:29.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c422c5f0 0x55b8c425e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c422c5f0 0x55b8c425e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34308/0 (socket says 172.21.15.79:34308) 2024-06-10T00:17:29.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 -- 172.21.15.79:0/3257994109 learned_addr learned my addr 172.21.15.79:0/3257994109 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e2bfff640 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c42c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e30828640 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c421f270 0x55b8c421df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 -- 172.21.15.79:0/3257994109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 msgr2=0x55b8c42c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c42c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 -- 172.21.15.79:0/3257994109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c421f270 msgr2=0x55b8c421df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c421f270 0x55b8c421df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 -- 172.21.15.79:0/3257994109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8c4129560 con 0x55b8c422c5f0 2024-06-10T00:17:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e31029640 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c422c5f0 0x55b8c425e520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9e2402ac90 tx=0x7f9e24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f00435c788e2c77 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/3257994109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24036070 con 0x55b8c422c5f0 2024-06-10T00:17:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/3257994109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f9e24004450 con 0x55b8c422c5f0 2024-06-10T00:17:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.437+0000 7f9e35798740 1 -- 172.21.15.79:0/3257994109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e1c085070 con 0x55b8c422c5f0 2024-06-10T00:17:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/3257994109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e24058050 con 0x55b8c422c5f0 2024-06-10T00:17:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e35798740 10 client.6015 fetch_fsmap learned FSMap version 29 2024-06-10T00:17:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e35798740 1 -- 172.21.15.79:0/3257994109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55b8c42c2ce0 con 0x55b8c422c5f0 2024-06-10T00:17:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/3257994109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1c085070 con 0x55b8c422c5f0 2024-06-10T00:17:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/3257994109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 3494+0+0 (secure 0 0 0) 0x7f9e2405b020 con 0x55b8c422c5f0 2024-06-10T00:17:29.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e35798740 10 client.6015 fetch_fsmap finished waiting for FSMap version 29 2024-06-10T00:17:29.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e35798740 10 client.6015 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:17:29.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e35798740 20 client.6015 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:29.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e35798740 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55b8c41fdbe0 0x55b8c41fdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:29.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e35798740 4 client.6015 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:17:29.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e35798740 1 -- 172.21.15.79:0/3257994109 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b8c416a900 con 0x55b8c41fdbe0 2024-06-10T00:17:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e30828640 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55b8c41fdbe0 0x55b8c41fdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e0b7fe640 10 client.6015 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.438+0000 7f9e30828640 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55b8c41fdbe0 0x55b8c41fdff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e53392aaa4f96206 server_cookie=7a3d7b45cbdc39de in_seq=0 out_seq=0 2024-06-10T00:17:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e0b7fe640 1 -- 172.21.15.79:0/3257994109 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+253 (crc 0 0 0) 0x55b8c416a900 con 0x55b8c41fdbe0 2024-06-10T00:17:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e0b7fe640 10 client.6015 handle_command_reply: tid=0 2024-06-10T00:17:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 client.6015 shutdown 2024-06-10T00:17:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 -- 172.21.15.79:0/3257994109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c422c5f0 msgr2=0x55b8c425e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c422c5f0 0x55b8c425e520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9e2402ac90 tx=0x7f9e24004a40 comp rx=0 tx=0).stop 2024-06-10T00:17:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 -- 172.21.15.79:0/3257994109 shutdown_connections 2024-06-10T00:17:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8c422c5f0 0x55b8c425e520 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55b8c41fdbe0 0x55b8c41fdff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b8c4222af0 0x55b8c42c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e0b7fe640 0 client.6015 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 --2- 172.21.15.79:0/3257994109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8c421f270 0x55b8c421df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 -- 172.21.15.79:0/3257994109 >> 172.21.15.79:0/3257994109 conn(0x55b8c42016d0 msgr2=0x55b8c4268770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 -- 172.21.15.79:0/3257994109 shutdown_connections 2024-06-10T00:17:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 1 -- 172.21.15.79:0/3257994109 wait complete. 2024-06-10T00:17:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e35798740 20 client.6015 trim_cache size 0 max 16384 2024-06-10T00:17:29.454 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:17:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:17:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "3a471ab3-d3bb-4af4-9098-5e41b9df1564": { 2024-06-10T00:17:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-06-10T00:17:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "3a471ab3-d3bb-4af4-9098-5e41b9df1564", 2024-06-10T00:17:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive" 2024-06-10T00:17:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:17:29.455 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:29.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e1806be30 msgr2=0x7f9e1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e1806be30 0x7f9e1806e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006fd0 tx=0x7f9e20008040 comp rx=0 tx=0).stop 2024-06-10T00:17:29.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0b34e0 msgr2=0x7f9e2c14f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:29.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.439+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0b34e0 0x7f9e2c14f780 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00d5f0 tx=0x7f9e1c00dab0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.440+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3885065427 shutdown_connections 2024-06-10T00:17:29.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.440+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e1806be30 0x7f9e1806e2f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.440+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e2c155320 0x7f9e2c0ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.440+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2c0d0560 0x7f9e2c0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.440+0000 7f9e32a8c640 1 --2- 172.21.15.79:0/3885065427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e2c0b34e0 0x7f9e2c14f780 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:29.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.440+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3885065427 >> 172.21.15.79:0/3885065427 conn(0x7f9e2c0b1d10 msgr2=0x7f9e2c0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:29.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.440+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3885065427 shutdown_connections 2024-06-10T00:17:29.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:29.440+0000 7f9e32a8c640 1 -- 172.21.15.79:0/3885065427 wait complete. 2024-06-10T00:17:29.460 INFO:tasks.cephfs.filesystem:scrub status for tag:3a471ab3-d3bb-4af4-9098-5e41b9df1564 - {'path': '/', 'tag': '3a471ab3-d3bb-4af4-9098-5e41b9df1564', 'options': 'recursive'} 2024-06-10T00:17:33.812 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:17:33.812+0000 7f522c39e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-10T00:17:43.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:17:43.724 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:17:59.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:17:59.462 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-06-10T00:17:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.575+0000 7f8374f09640 1 Processor -- start 2024-06-10T00:17:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.575+0000 7f8374f09640 1 -- start start 2024-06-10T00:17:59.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.576+0000 7f8374f09640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f83700d08f0 0x7f83700b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.576+0000 7f8374f09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700d0cd0 0x7f83700cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.576+0000 7f8374f09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700cf190 0x7f83700d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f8374f09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f83700d1c80 con 0x7f83700d0cd0 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f8374f09640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f83700cf620 con 0x7f83700d08f0 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f8374f09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83700cf8a0 con 0x7f83700cf190 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836dd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700d0cd0 0x7f83700cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836dd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700d0cd0 0x7f83700cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52284/0 (socket says 172.21.15.79:52284) 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836dd9b640 1 -- 172.21.15.79:0/993395457 learned_addr learned my addr 172.21.15.79:0/993395457 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836e59c640 1 --2- 172.21.15.79:0/993395457 >> v2:172.21.15.117:3300/0 conn(0x7f83700d08f0 0x7f83700b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836ed9d640 1 --2- 172.21.15.79:0/993395457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700cf190 0x7f83700d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836dd9b640 1 -- 172.21.15.79:0/993395457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700cf190 msgr2=0x7f83700d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836dd9b640 1 --2- 172.21.15.79:0/993395457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700cf190 0x7f83700d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836dd9b640 1 -- 172.21.15.79:0/993395457 >> v2:172.21.15.117:3300/0 conn(0x7f83700d08f0 msgr2=0x7f83700b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836dd9b640 1 --2- 172.21.15.79:0/993395457 >> v2:172.21.15.117:3300/0 conn(0x7f83700d08f0 0x7f83700b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836dd9b640 1 -- 172.21.15.79:0/993395457 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700cfb80 con 0x7f83700d0cd0 2024-06-10T00:17:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.577+0000 7f836ed9d640 1 --2- 172.21.15.79:0/993395457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700cf190 0x7f83700d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.578+0000 7f836dd9b640 1 --2- 172.21.15.79:0/993395457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83700cec50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8358009870 tx=0x7f835802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce54c9ad87b978c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.578+0000 7f836d59a640 1 -- 172.21.15.79:0/993395457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358037070 con 0x7f83700d0cd0 2024-06-10T00:17:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.578+0000 7f836d59a640 1 -- 172.21.15.79:0/993395457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8358032440 con 0x7f83700d0cd0 2024-06-10T00:17:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.578+0000 7f836d59a640 1 -- 172.21.15.79:0/993395457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358032810 con 0x7f83700d0cd0 2024-06-10T00:17:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.578+0000 7f8374f09640 1 -- 172.21.15.79:0/993395457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 msgr2=0x7f83700cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.578+0000 7f8374f09640 1 --2- 172.21.15.79:0/993395457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83700cec50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8358009870 tx=0x7f835802a210 comp rx=0 tx=0).stop 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.579+0000 7f8374f09640 1 -- 172.21.15.79:0/993395457 shutdown_connections 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.579+0000 7f8374f09640 1 --2- 172.21.15.79:0/993395457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700cf190 0x7f83700d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.579+0000 7f8374f09640 1 --2- 172.21.15.79:0/993395457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83700cec50 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.579+0000 7f8374f09640 1 --2- 172.21.15.79:0/993395457 >> v2:172.21.15.117:3300/0 conn(0x7f83700d08f0 0x7f83700b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.579+0000 7f8374f09640 1 -- 172.21.15.79:0/993395457 >> 172.21.15.79:0/993395457 conn(0x7f837009d3c0 msgr2=0x7f83700d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.579+0000 7f8374f09640 1 -- 172.21.15.79:0/993395457 shutdown_connections 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.579+0000 7f8374f09640 1 -- 172.21.15.79:0/993395457 wait complete. 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.580+0000 7f8374f09640 1 Processor -- start 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.580+0000 7f8374f09640 1 -- start start 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f8374f09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83700cf190 0x7f83700cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f8374f09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700d08f0 0x7f83700cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f8374f09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83701f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f8374f09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83700b50c0 con 0x7f83700d0cd0 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f8374f09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83700d1ed0 con 0x7f83700cf190 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f8374f09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83700d1180 con 0x7f83700d08f0 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83701f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83701f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52288/0 (socket says 172.21.15.79:52288) 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 -- 172.21.15.79:0/2053030812 learned_addr learned my addr 172.21.15.79:0/2053030812 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836dd9b640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700d08f0 0x7f83700cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836e59c640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83700cf190 0x7f83700cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 -- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700d08f0 msgr2=0x7f83700cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700d08f0 0x7f83700cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 -- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83700cf190 msgr2=0x7f83700cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83700cf190 0x7f83700cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 -- 172.21.15.79:0/2053030812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700ce050 con 0x7f83700d0cd0 2024-06-10T00:17:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836dd9b640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700d08f0 0x7f83700cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:17:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f836ed9d640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83701f3b90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f836800d5d0 tx=0x7f836800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f8366ffd640 1 -- 172.21.15.79:0/2053030812 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368004030 con 0x7f83700d0cd0 2024-06-10T00:17:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.581+0000 7f8366ffd640 1 -- 172.21.15.79:0/2053030812 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83680041d0 con 0x7f83700d0cd0 2024-06-10T00:17:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.582+0000 7f8374f09640 1 -- 172.21.15.79:0/2053030812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83700ce330 con 0x7f83700d0cd0 2024-06-10T00:17:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.582+0000 7f8366ffd640 1 -- 172.21.15.79:0/2053030812 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368014620 con 0x7f83700d0cd0 2024-06-10T00:17:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.582+0000 7f8374f09640 1 -- 172.21.15.79:0/2053030812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83700c8f10 con 0x7f83700d0cd0 2024-06-10T00:17:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.583+0000 7f8366ffd640 1 -- 172.21.15.79:0/2053030812 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83680147c0 con 0x7f83700d0cd0 2024-06-10T00:17:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.584+0000 7f8366ffd640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835006be60 0x7f835006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.584+0000 7f836e59c640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835006be60 0x7f835006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.584+0000 7f8366ffd640 1 -- 172.21.15.79:0/2053030812 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f836808b6d0 con 0x7f83700d0cd0 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.584+0000 7f836e59c640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835006be60 0x7f835006e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8360007380 tx=0x7f836000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.585+0000 7f8377c0c740 1 Processor -- start 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.585+0000 7f8377c0c740 1 -- start start 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.585+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x563923788120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.585+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237831a0 0x563923788660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.585+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56392378a6d0 0x563923788ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.585+0000 7f8377c0c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5639236ad7e0 con 0x56392378a6d0 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f8377c0c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5639236ebe80 con 0x5639237abaf0 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f8377c0c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563923689700 con 0x5639237831a0 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56392378a6d0 0x563923788ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56392378a6d0 0x563923788ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52290/0 (socket says 172.21.15.79:52290) 2024-06-10T00:17:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 -- 172.21.15.79:0/419676975 learned_addr learned my addr 172.21.15.79:0/419676975 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836dd9b640 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237831a0 0x563923788660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836e59c640 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x563923788120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 -- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237831a0 msgr2=0x563923788660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237831a0 0x563923788660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 -- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 msgr2=0x563923788120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x563923788120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 -- 172.21.15.79:0/419676975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639236a8dd0 con 0x56392378a6d0 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836dd9b640 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237831a0 0x563923788660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836e59c640 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x563923788120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f836ed9d640 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56392378a6d0 0x563923788ba0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8368055c70 tx=0x7f83680598d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5d7bd65365f5df server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f834ffff640 1 -- 172.21.15.79:0/419676975 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83680623f0 con 0x56392378a6d0 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f834ffff640 1 -- 172.21.15.79:0/419676975 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368060070 con 0x56392378a6d0 2024-06-10T00:17:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.586+0000 7f834ffff640 1 -- 172.21.15.79:0/419676975 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368055e80 con 0x56392378a6d0 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 -- 172.21.15.79:0/419676975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56392378a6d0 msgr2=0x563923788ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56392378a6d0 0x563923788ba0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8368055c70 tx=0x7f83680598d0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 -- 172.21.15.79:0/419676975 shutdown_connections 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56392378a6d0 0x563923788ba0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237831a0 0x563923788660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 --2- 172.21.15.79:0/419676975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x563923788120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 -- 172.21.15.79:0/419676975 >> 172.21.15.79:0/419676975 conn(0x563923785410 msgr2=0x5639237cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 -- 172.21.15.79:0/419676975 shutdown_connections 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.587+0000 7f8377c0c740 1 -- 172.21.15.79:0/419676975 wait complete. 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.588+0000 7f8377c0c740 1 -- start start 2024-06-10T00:17:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.588+0000 7f8377c0c740 1 Processor -- start 2024-06-10T00:17:59.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237abaf0 0x5639237ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 0x5639237d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237d0bc0 0x563923787b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563923674640 con 0x5639237abaf0 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5639236e7e40 con 0x5639237b0200 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563923786be0 con 0x5639237d0bc0 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 10 client.0 _ll_register_callbacks cb 0x5639236a6430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237abaf0 0x5639237ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237abaf0 0x5639237ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52302/0 (socket says 172.21.15.79:52302) 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 -- 172.21.15.79:0/3438235926 learned_addr learned my addr 172.21.15.79:0/3438235926 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 -- 172.21.15.79:0/3438235926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237d0bc0 msgr2=0x563923787b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237d0bc0 0x563923787b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 -- 172.21.15.79:0/3438235926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 msgr2=0x5639237d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 0x5639237d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 -- 172.21.15.79:0/3438235926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639234c97d0 con 0x5639237abaf0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f836e59c640 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237abaf0 0x5639237ace10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8360016b70 tx=0x7f8360004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3786c4fe062dad server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f834d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f834d7fa640 1 -- 172.21.15.79:0/3438235926 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360014ce0 con 0x5639237abaf0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f834d7fa640 1 -- 172.21.15.79:0/3438235926 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f8360022420 con 0x5639237abaf0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 1 -- 172.21.15.79:0/3438235926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8368060070 con 0x5639237abaf0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f834d7fa640 1 -- 172.21.15.79:0/3438235926 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f836002f050 con 0x5639237abaf0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 10 client.6027 fetch_fsmap learned FSMap version 30 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.589+0000 7f8377c0c740 1 -- 172.21.15.79:0/3438235926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5639233ff3f0 con 0x5639237abaf0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f834d7fa640 1 -- 172.21.15.79:0/3438235926 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368060070 con 0x5639237abaf0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f834d7fa640 1 -- 172.21.15.79:0/3438235926 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7f8360032020 con 0x5639237abaf0 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f8377c0c740 10 client.6027 fetch_fsmap finished waiting for FSMap version 30 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f8377c0c740 10 client.6027 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f8377c0c740 20 client.6027 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f8377c0c740 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x563923794140 0x563923794590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f8377c0c740 4 client.6027 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f8377c0c740 1 -- 172.21.15.79:0/3438235926 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639236f95b0 con 0x563923794140 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f836dd9b640 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x563923794140 0x563923794590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f836dd9b640 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x563923794140 0x563923794590 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57e4116b1cd82aae server_cookie=da233bdd15d4d520 in_seq=0 out_seq=0 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.590+0000 7f834d7fa640 10 client.6027 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f834d7fa640 1 -- 172.21.15.79:0/3438235926 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5639236f95b0 con 0x563923794140 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f834d7fa640 10 client.6027 handle_command_reply: tid=0 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 client.6027 shutdown 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 -- 172.21.15.79:0/3438235926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237abaf0 msgr2=0x5639237ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237abaf0 0x5639237ace10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8360016b70 tx=0x7f8360004ab0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 -- 172.21.15.79:0/3438235926 shutdown_connections 2024-06-10T00:17:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x563923794140 0x563923794590 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237d0bc0 0x563923787b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 0x5639237d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f834d7fa640 0 client.6027 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 --2- 172.21.15.79:0/3438235926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237abaf0 0x5639237ace10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 -- 172.21.15.79:0/3438235926 >> 172.21.15.79:0/3438235926 conn(0x56392378a6d0 msgr2=0x5639237a9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 -- 172.21.15.79:0/3438235926 shutdown_connections 2024-06-10T00:17:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 1 -- 172.21.15.79:0/3438235926 wait complete. 2024-06-10T00:17:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.591+0000 7f8377c0c740 20 client.6027 trim_cache size 0 max 16384 2024-06-10T00:17:59.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.609+0000 7f8377c0c740 1 Processor -- start 2024-06-10T00:17:59.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.609+0000 7f8377c0c740 1 -- start start 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237abaf0 0x563923795160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 0x5639237aa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x5639237a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f8377c0c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8370201100 con 0x5639237d0bc0 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f8377c0c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8370200140 con 0x5639237b0200 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f8377c0c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f837014a960 con 0x5639237abaf0 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x5639237a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x5639237a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52308/0 (socket says 172.21.15.79:52308) 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 -- 172.21.15.79:0/2881956744 learned_addr learned my addr 172.21.15.79:0/2881956744 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836e59c640 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237abaf0 0x563923795160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836dd9b640 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 0x5639237aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 -- 172.21.15.79:0/2881956744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237abaf0 msgr2=0x563923795160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237abaf0 0x563923795160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 -- 172.21.15.79:0/2881956744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 msgr2=0x5639237aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 0x5639237aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 -- 172.21.15.79:0/2881956744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639233bf0f0 con 0x5639237d0bc0 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.610+0000 7f836ed9d640 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x5639237a8fb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8368004770 tx=0x7f836808b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b603912cf054c5e6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f834f7fe640 1 -- 172.21.15.79:0/2881956744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368087070 con 0x5639237d0bc0 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f834f7fe640 1 -- 172.21.15.79:0/2881956744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83680623f0 con 0x5639237d0bc0 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f834f7fe640 1 -- 172.21.15.79:0/2881956744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368057b10 con 0x5639237d0bc0 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 -- 172.21.15.79:0/2881956744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 msgr2=0x5639237a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x5639237a8fb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8368004770 tx=0x7f836808b040 comp rx=0 tx=0).stop 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 -- 172.21.15.79:0/2881956744 shutdown_connections 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x5639237a8fb0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237b0200 0x5639237aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 --2- 172.21.15.79:0/2881956744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237abaf0 0x563923795160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 -- 172.21.15.79:0/2881956744 >> 172.21.15.79:0/2881956744 conn(0x56392378a6d0 msgr2=0x5639237dd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:59.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 -- 172.21.15.79:0/2881956744 shutdown_connections 2024-06-10T00:17:59.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.611+0000 7f8377c0c740 1 -- 172.21.15.79:0/2881956744 wait complete. 2024-06-10T00:17:59.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.612+0000 7f8377c0c740 1 -- start start 2024-06-10T00:17:59.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.612+0000 7f8377c0c740 1 Processor -- start 2024-06-10T00:17:59.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x56392384f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237b0200 0x5639237cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x563923831520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5639237a3d80 con 0x5639237d0bc0 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f837014afb0 con 0x5639237abaf0 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5639237afa00 con 0x5639237b0200 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 10 client.0 _ll_register_callbacks cb 0x7f8360016740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x563923831520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x563923831520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52314/0 (socket says 172.21.15.79:52314) 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 -- 172.21.15.79:0/1221138582 learned_addr learned my addr 172.21.15.79:0/1221138582 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836e59c640 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x56392384f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836dd9b640 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237b0200 0x5639237cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 -- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237b0200 msgr2=0x5639237cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237b0200 0x5639237cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 -- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 msgr2=0x56392384f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x56392384f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 -- 172.21.15.79:0/1221138582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639236b2560 con 0x5639237d0bc0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836dd9b640 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237b0200 0x5639237cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f836ed9d640 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x563923831520 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8368004770 tx=0x7f836805c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76daf49066ac5a0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f834d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f834d7fa640 1 -- 172.21.15.79:0/1221138582 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368087040 con 0x5639237d0bc0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f834d7fa640 1 -- 172.21.15.79:0/1221138582 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f8368057b10 con 0x5639237d0bc0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 1 -- 172.21.15.79:0/1221138582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83680623f0 con 0x5639237d0bc0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f834d7fa640 1 -- 172.21.15.79:0/1221138582 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8368055e80 con 0x5639237d0bc0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 10 client.6033 fetch_fsmap learned FSMap version 30 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.613+0000 7f8377c0c740 1 -- 172.21.15.79:0/1221138582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5639237a3180 con 0x5639237d0bc0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f834d7fa640 1 -- 172.21.15.79:0/1221138582 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83680623f0 con 0x5639237d0bc0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f834d7fa640 1 -- 172.21.15.79:0/1221138582 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7f8368025060 con 0x5639237d0bc0 2024-06-10T00:17:59.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 10 client.6033 fetch_fsmap finished waiting for FSMap version 30 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 10 client.6033 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 20 client.6033 populate_metadata read hostname 'smithi079' 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5639237cfe10 0x563923831a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 4 client.6033 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 1 -- 172.21.15.79:0/1221138582 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5639236f3900 con 0x5639237cfe10 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f836e59c640 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5639237cfe10 0x563923831a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f834d7fa640 10 client.6033 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f836e59c640 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5639237cfe10 0x563923831a60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57a66ae37ecff91 server_cookie=877b0c6920eda7dd in_seq=0 out_seq=0 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f834d7fa640 1 -- 172.21.15.79:0/1221138582 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5639236f3900 con 0x5639237cfe10 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f834d7fa640 10 client.6033 handle_command_reply: tid=0 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 1 client.6033 shutdown 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 1 -- 172.21.15.79:0/1221138582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 msgr2=0x563923831520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.614+0000 7f8377c0c740 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x563923831520 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8368004770 tx=0x7f836805c000 comp rx=0 tx=0).stop 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 1 -- 172.21.15.79:0/1221138582 shutdown_connections 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639237d0bc0 0x563923831520 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5639237cfe10 0x563923831a60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5639237b0200 0x5639237cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 1 --2- 172.21.15.79:0/1221138582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639237abaf0 0x56392384f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f834d7fa640 0 client.6033 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 1 -- 172.21.15.79:0/1221138582 >> 172.21.15.79:0/1221138582 conn(0x56392378a6d0 msgr2=0x5639237b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 1 -- 172.21.15.79:0/1221138582 shutdown_connections 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 1 -- 172.21.15.79:0/1221138582 wait complete. 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8377c0c740 20 client.6033 trim_cache size 0 max 16384 2024-06-10T00:17:59.620 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:17:59.621 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:17:59.621 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:17:59.621 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:17:59.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 -- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835006be60 msgr2=0x7f835006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835006be60 0x7f835006e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8360007380 tx=0x7f836000b040 comp rx=0 tx=0).stop 2024-06-10T00:17:59.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 -- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 msgr2=0x7f83701f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83701f3b90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f836800d5d0 tx=0x7f836800da90 comp rx=0 tx=0).stop 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 -- 172.21.15.79:0/2053030812 shutdown_connections 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835006be60 0x7f835006e320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700d0cd0 0x7f83701f3b90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700d08f0 0x7f83700cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 --2- 172.21.15.79:0/2053030812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83700cf190 0x7f83700cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 -- 172.21.15.79:0/2053030812 >> 172.21.15.79:0/2053030812 conn(0x7f837009d3c0 msgr2=0x7f837006d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 -- 172.21.15.79:0/2053030812 shutdown_connections 2024-06-10T00:17:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.615+0000 7f8374f09640 1 -- 172.21.15.79:0/2053030812 wait complete. 2024-06-10T00:17:59.626 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:17:59.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:17:59.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.726+0000 7f25ce99e640 1 Processor -- start 2024-06-10T00:17:59.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.726+0000 7f25ce99e640 1 -- start start 2024-06-10T00:17:59.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ce99e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c80cd230 0x7f25c80b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ce99e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25c80cec50 0x7f25c80cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ce99e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c80b3420 con 0x7f25c81553c0 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ce99e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f25c80cc750 con 0x7f25c80cec50 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ce99e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25c80cca30 con 0x7f25c80cd230 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ccf3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25c80cec50 0x7f25c80cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ccf3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25c80cec50 0x7f25c80cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52330/0 (socket says 172.21.15.79:52330) 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ccf3b640 1 -- 172.21.15.79:0/2535679064 learned_addr learned my addr 172.21.15.79:0/2535679064 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25c7fff640 1 --1- 172.21.15.79:0/2535679064 >> v1:172.21.15.79:6789/0 conn(0x7f25c81553c0 0x7f25c815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54392/0 (socket says 172.21.15.79:54392) 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25c77fe640 1 --2- 172.21.15.79:0/2535679064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c80cd230 0x7f25c80b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ccf3b640 1 -- 172.21.15.79:0/2535679064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c80cd230 msgr2=0x7f25c80b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ccf3b640 1 --2- 172.21.15.79:0/2535679064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c80cd230 0x7f25c80b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25c6ffd640 1 -- 172.21.15.79:0/2535679064 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3118261554 0 0) 0x7f25c80b3420 con 0x7f25c81553c0 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ccf3b640 1 -- 172.21.15.79:0/2535679064 >> v1:172.21.15.79:6789/0 conn(0x7f25c81553c0 legacy=0x7f25c815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.727+0000 7f25ccf3b640 1 -- 172.21.15.79:0/2535679064 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c80ccd10 con 0x7f25c80cec50 2024-06-10T00:17:59.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.728+0000 7f25ccf3b640 1 --2- 172.21.15.79:0/2535679064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c80cf0e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009e50 tx=0x7f25c002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcb13551399cc62 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.728+0000 7f25c6ffd640 1 -- 172.21.15.79:0/2535679064 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0036070 con 0x7f25c80cec50 2024-06-10T00:17:59.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.728+0000 7f25c6ffd640 1 -- 172.21.15.79:0/2535679064 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c0031600 con 0x7f25c80cec50 2024-06-10T00:17:59.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.728+0000 7f25c6ffd640 1 -- 172.21.15.79:0/2535679064 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c00319d0 con 0x7f25c80cec50 2024-06-10T00:17:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.729+0000 7f25ce99e640 1 -- 172.21.15.79:0/2535679064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 msgr2=0x7f25c80cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.729+0000 7f25ce99e640 1 --2- 172.21.15.79:0/2535679064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c80cf0e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009e50 tx=0x7f25c002a710 comp rx=0 tx=0).stop 2024-06-10T00:17:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.729+0000 7f25ce99e640 1 -- 172.21.15.79:0/2535679064 shutdown_connections 2024-06-10T00:17:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.729+0000 7f25ce99e640 1 --2- 172.21.15.79:0/2535679064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c80cf0e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.729+0000 7f25ce99e640 1 --2- 172.21.15.79:0/2535679064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c80cd230 0x7f25c80b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.729+0000 7f25ce99e640 1 -- 172.21.15.79:0/2535679064 >> 172.21.15.79:0/2535679064 conn(0x7f25c80b19f0 msgr2=0x7f25c80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.729+0000 7f25ce99e640 1 -- 172.21.15.79:0/2535679064 shutdown_connections 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.729+0000 7f25ce99e640 1 -- 172.21.15.79:0/2535679064 wait complete. 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.730+0000 7f25ce99e640 1 Processor -- start 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.730+0000 7f25ce99e640 1 -- start start 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ce99e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25c80cd230 0x7f25c8153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ce99e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ce99e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c81553c0 0x7f25c815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ce99e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8155920 con 0x7f25c80cec50 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ce99e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25c81557a0 con 0x7f25c80cd230 2024-06-10T00:17:59.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ce99e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25c8071030 con 0x7f25c81553c0 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52338/0 (socket says 172.21.15.79:52338) 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 -- 172.21.15.79:0/3967869090 learned_addr learned my addr 172.21.15.79:0/3967869090 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ccf3b640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c81553c0 0x7f25c815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c7fff640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25c80cd230 0x7f25c8153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 -- 172.21.15.79:0/3967869090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c81553c0 msgr2=0x7f25c815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c81553c0 0x7f25c815e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 -- 172.21.15.79:0/3967869090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25c80cd230 msgr2=0x7f25c8153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25c80cd230 0x7f25c8153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 -- 172.21.15.79:0/3967869090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c815d2a0 con 0x7f25c80cec50 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c77fe640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c815c8c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f25b000e9b0 tx=0x7f25b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c4ff9640 1 -- 172.21.15.79:0/3967869090 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0017070 con 0x7f25c80cec50 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c4ff9640 1 -- 172.21.15.79:0/3967869090 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b000c9a0 con 0x7f25c80cec50 2024-06-10T00:17:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c815d580 con 0x7f25c80cec50 2024-06-10T00:17:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25c4ff9640 1 -- 172.21.15.79:0/3967869090 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b000cd90 con 0x7f25c80cec50 2024-06-10T00:17:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.731+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c8154ba0 con 0x7f25c80cec50 2024-06-10T00:17:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.732+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c8068430 con 0x7f25c80cec50 2024-06-10T00:17:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.733+0000 7f25c4ff9640 1 -- 172.21.15.79:0/3967869090 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f25b001a070 con 0x7f25c80cec50 2024-06-10T00:17:59.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.733+0000 7f25c4ff9640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f25a806be30 0x7f25a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:17:59.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.733+0000 7f25c4ff9640 1 -- 172.21.15.79:0/3967869090 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f25b008b440 con 0x7f25c80cec50 2024-06-10T00:17:59.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.733+0000 7f25c7fff640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f25a806be30 0x7f25a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:17:59.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.734+0000 7f25c7fff640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f25a806be30 0x7f25a806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f25b8000f60 tx=0x7f25b8007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:17:59.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.738+0000 7f25c4ff9640 1 -- 172.21.15.79:0/3967869090 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f25b0059bf0 con 0x7f25c80cec50 2024-06-10T00:17:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.948+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25c80cd6b0 con 0x7f25c80cec50 2024-06-10T00:17:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.949+0000 7f25c4ff9640 1 -- 172.21.15.79:0/3967869090 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5185 (secure 0 0 0) 0x7f25b00594f0 con 0x7f25c80cec50 2024-06-10T00:17:59.948 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:17:59.949 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:17:33.789392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":7,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:17:59.949 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 30 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f25a806be30 msgr2=0x7f25a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f25a806be30 0x7f25a806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f25b8000f60 tx=0x7f25b8007c00 comp rx=0 tx=0).stop 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 msgr2=0x7f25c815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c815c8c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f25b000e9b0 tx=0x7f25b000ee70 comp rx=0 tx=0).stop 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 shutdown_connections 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f25a806be30 0x7f25a806e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25c81553c0 0x7f25c815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25c80cec50 0x7f25c815c8c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 --2- 172.21.15.79:0/3967869090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25c80cd230 0x7f25c8153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 >> 172.21.15.79:0/3967869090 conn(0x7f25c80b19f0 msgr2=0x7f25c815ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:17:59.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 shutdown_connections 2024-06-10T00:17:59.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:17:59.951+0000 7f25ce99e640 1 -- 172.21.15.79:0/3967869090 wait complete. 2024-06-10T00:17:59.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-06-10T00:18:00.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.063+0000 7facd2b29640 1 Processor -- start 2024-06-10T00:18:00.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.063+0000 7facd2b29640 1 -- start start 2024-06-10T00:18:00.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facd2b29640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faccc0b3bf0 0x7faccc06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facd2b29640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faccc06d500 0x7faccc071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facd2b29640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faccc155000 con 0x7faccc154c20 2024-06-10T00:18:00.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facd2b29640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7faccc06dd30 con 0x7faccc0b3bf0 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facd2b29640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faccc06e010 con 0x7faccc06d500 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facc3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faccc0b3bf0 0x7faccc06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facc3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faccc0b3bf0 0x7faccc06cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52340/0 (socket says 172.21.15.79:52340) 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facc3fff640 1 -- 172.21.15.79:0/3320075552 learned_addr learned my addr 172.21.15.79:0/3320075552 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facd10c6640 1 --2- 172.21.15.79:0/3320075552 >> v2:172.21.15.117:3300/0 conn(0x7faccc06d500 0x7faccc071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facc3fff640 1 -- 172.21.15.79:0/3320075552 >> v2:172.21.15.117:3300/0 conn(0x7faccc06d500 msgr2=0x7faccc071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facc3fff640 1 --2- 172.21.15.79:0/3320075552 >> v2:172.21.15.117:3300/0 conn(0x7faccc06d500 0x7faccc071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facc3fff640 1 -- 172.21.15.79:0/3320075552 >> v1:172.21.15.117:6789/0 conn(0x7faccc154c20 legacy=0x7faccc0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.064+0000 7facc3fff640 1 -- 172.21.15.79:0/3320075552 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faccc06e2f0 con 0x7faccc0b3bf0 2024-06-10T00:18:00.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.065+0000 7facc3fff640 1 --2- 172.21.15.79:0/3320075552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc06cfc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faccc06f270 tx=0x7facbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc9cc091fbfa085 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.065+0000 7facc37fe640 1 -- 172.21.15.79:0/3320075552 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc037070 con 0x7faccc0b3bf0 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.065+0000 7facc37fe640 1 -- 172.21.15.79:0/3320075552 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facbc032440 con 0x7faccc0b3bf0 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.065+0000 7facc37fe640 1 -- 172.21.15.79:0/3320075552 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc032810 con 0x7faccc0b3bf0 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.066+0000 7facd2b29640 1 -- 172.21.15.79:0/3320075552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 msgr2=0x7faccc06cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.066+0000 7facd2b29640 1 --2- 172.21.15.79:0/3320075552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc06cfc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faccc06f270 tx=0x7facbc02a270 comp rx=0 tx=0).stop 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.066+0000 7facd2b29640 1 -- 172.21.15.79:0/3320075552 shutdown_connections 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.066+0000 7facd2b29640 1 --2- 172.21.15.79:0/3320075552 >> v2:172.21.15.117:3300/0 conn(0x7faccc06d500 0x7faccc071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.066+0000 7facd2b29640 1 --2- 172.21.15.79:0/3320075552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc06cfc0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.066+0000 7facd2b29640 1 -- 172.21.15.79:0/3320075552 >> 172.21.15.79:0/3320075552 conn(0x7faccc0b1d10 msgr2=0x7faccc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.066+0000 7facd2b29640 1 -- 172.21.15.79:0/3320075552 shutdown_connections 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.066+0000 7facd2b29640 1 -- 172.21.15.79:0/3320075552 wait complete. 2024-06-10T00:18:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.067+0000 7facd2b29640 1 Processor -- start 2024-06-10T00:18:00.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.067+0000 7facd2b29640 1 -- start start 2024-06-10T00:18:00.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd2b29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc06d500 0x7faccc153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd2b29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc14b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd2b29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc154c20 0x7faccc152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd2b29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faccc06daf0 con 0x7faccc0b3bf0 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd2b29640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faccc06d970 con 0x7faccc154c20 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd2b29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faccc0d0020 con 0x7faccc06d500 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc14b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc14b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52354/0 (socket says 172.21.15.79:52354) 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 -- 172.21.15.79:0/2963487609 learned_addr learned my addr 172.21.15.79:0/2963487609 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd08c5640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc06d500 0x7faccc153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd10c6640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc154c20 0x7faccc152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 -- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc06d500 msgr2=0x7faccc153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc06d500 0x7faccc153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 -- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc154c20 msgr2=0x7faccc152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc154c20 0x7faccc152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 -- 172.21.15.79:0/2963487609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faccc154080 con 0x7faccc0b3bf0 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd10c6640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc154c20 0x7faccc152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facd08c5640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc06d500 0x7faccc153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.068+0000 7facc3fff640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc14b3a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7facbc02a2b0 tx=0x7facbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.069+0000 7facc17fa640 1 -- 172.21.15.79:0/2963487609 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc041020 con 0x7faccc0b3bf0 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.069+0000 7facc17fa640 1 -- 172.21.15.79:0/2963487609 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facbc0306c0 con 0x7faccc0b3bf0 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.069+0000 7facc17fa640 1 -- 172.21.15.79:0/2963487609 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc037040 con 0x7faccc0b3bf0 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.069+0000 7facd2b29640 1 -- 172.21.15.79:0/2963487609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faccc0ad160 con 0x7faccc0b3bf0 2024-06-10T00:18:00.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.069+0000 7facd2b29640 1 -- 172.21.15.79:0/2963487609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faccc0ad720 con 0x7faccc0b3bf0 2024-06-10T00:18:00.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.070+0000 7facc17fa640 1 -- 172.21.15.79:0/2963487609 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facbc044020 con 0x7faccc0b3bf0 2024-06-10T00:18:00.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.071+0000 7facc17fa640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7facb806be30 0x7facb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.071+0000 7facc17fa640 1 -- 172.21.15.79:0/2963487609 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7facbc0ab840 con 0x7faccc0b3bf0 2024-06-10T00:18:00.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.071+0000 7facd08c5640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7facb806be30 0x7facb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.071+0000 7facd08c5640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7facb806be30 0x7facb806e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7facc8001cd0 tx=0x7facc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd5839740 1 Processor -- start 2024-06-10T00:18:00.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd5839740 1 -- start start 2024-06-10T00:18:00.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd5839740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf3e020 0x562d0bef09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd5839740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf21140 0x562d0bf204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd5839740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf20a00 0x562d0bef5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd5839740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d0be59d80 con 0x562d0bf20a00 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd5839740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562d0bdf72f0 con 0x562d0bf3e020 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd5839740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562d0be55d40 con 0x562d0bf21140 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd10c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf20a00 0x562d0bef5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd10c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf20a00 0x562d0bef5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52362/0 (socket says 172.21.15.79:52362) 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.072+0000 7facd10c6640 1 -- 172.21.15.79:0/2492891802 learned_addr learned my addr 172.21.15.79:0/2492891802 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facc3fff640 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf21140 0x562d0bf204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facd08c5640 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf3e020 0x562d0bef09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facd10c6640 1 -- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf21140 msgr2=0x562d0bf204c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facd10c6640 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf21140 0x562d0bf204c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facd10c6640 1 -- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf3e020 msgr2=0x562d0bef09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facd10c6640 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf3e020 0x562d0bef09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facd10c6640 1 -- 172.21.15.79:0/2492891802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0bc397c0 con 0x562d0bf20a00 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facc3fff640 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf21140 0x562d0bf204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facd10c6640 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf20a00 0x562d0bef5810 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7facc4009a00 tx=0x7facc4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773abdd70621a7b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facb2ffd640 1 -- 172.21.15.79:0/2492891802 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc400c070 con 0x562d0bf20a00 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facb2ffd640 1 -- 172.21.15.79:0/2492891802 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4018070 con 0x562d0bf20a00 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.073+0000 7facb2ffd640 1 -- 172.21.15.79:0/2492891802 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc400f040 con 0x562d0bf20a00 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 -- 172.21.15.79:0/2492891802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf20a00 msgr2=0x562d0bef5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf20a00 0x562d0bef5810 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7facc4009a00 tx=0x7facc4009ec0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 -- 172.21.15.79:0/2492891802 shutdown_connections 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf20a00 0x562d0bef5810 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf21140 0x562d0bf204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 --2- 172.21.15.79:0/2492891802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf3e020 0x562d0bef09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 -- 172.21.15.79:0/2492891802 >> 172.21.15.79:0/2492891802 conn(0x562d0bef2c20 msgr2=0x562d0bf3b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 -- 172.21.15.79:0/2492891802 shutdown_connections 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 -- 172.21.15.79:0/2492891802 wait complete. 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 -- start start 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.074+0000 7facd5839740 1 Processor -- start 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd5839740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf4b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd5839740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf4f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd5839740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf22b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd5839740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d0bef4dd0 con 0x562d0bf3e020 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd5839740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562d0bdf4da0 con 0x562d0bf21140 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd5839740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562d0bef41c0 con 0x562d0bf32390 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd5839740 10 client.0 _ll_register_callbacks cb 0x562d0bb6cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:00.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf4f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf4f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52372/0 (socket says 172.21.15.79:52372) 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facc3fff640 1 -- 172.21.15.79:0/4109182358 learned_addr learned my addr 172.21.15.79:0/4109182358 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd08c5640 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf4b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facd10c6640 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf22b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facc3fff640 1 -- 172.21.15.79:0/4109182358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 msgr2=0x562d0bf22b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facc3fff640 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf22b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facc3fff640 1 -- 172.21.15.79:0/4109182358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 msgr2=0x562d0bf4b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facc3fff640 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf4b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.075+0000 7facc3fff640 1 -- 172.21.15.79:0/4109182358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d0bc99f50 con 0x562d0bf3e020 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facc3fff640 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf4f530 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7facbc075d60 tx=0x7facbc07a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d2bc7e7d60510 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:00.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facab7fe640 1 -- 172.21.15.79:0/4109182358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc07dcb0 con 0x562d0bf3e020 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facab7fe640 1 -- 172.21.15.79:0/4109182358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7facbc079b60 con 0x562d0bf3e020 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 1 -- 172.21.15.79:0/4109182358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc4018070 con 0x562d0bf3e020 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facab7fe640 1 -- 172.21.15.79:0/4109182358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7facbc0824e0 con 0x562d0bf3e020 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 10 client.6054 fetch_fsmap learned FSMap version 30 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 1 -- 172.21.15.79:0/4109182358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x562d0bb2d0b0 con 0x562d0bf3e020 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facab7fe640 1 -- 172.21.15.79:0/4109182358 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4018070 con 0x562d0bf3e020 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facab7fe640 1 -- 172.21.15.79:0/4109182358 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7facbc03a030 con 0x562d0bf3e020 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 10 client.6054 fetch_fsmap finished waiting for FSMap version 30 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 10 client.6054 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 20 client.6054 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x562d0bf21a90 0x562d0bf21e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 4 client.6054 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd5839740 1 -- 172.21.15.79:0/4109182358 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d0be674b0 con 0x562d0bf21a90 2024-06-10T00:18:00.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.076+0000 7facd08c5640 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x562d0bf21a90 0x562d0bf21e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facab7fe640 10 client.6054 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd08c5640 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x562d0bf21a90 0x562d0bf21e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e1cea00201b5d31 server_cookie=fb94a021c6eb8406 in_seq=0 out_seq=0 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facab7fe640 1 -- 172.21.15.79:0/4109182358 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562d0be674b0 con 0x562d0bf21a90 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facab7fe640 10 client.6054 handle_command_reply: tid=0 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 client.6054 shutdown 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 -- 172.21.15.79:0/4109182358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 msgr2=0x562d0bf4f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf4f530 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7facbc075d60 tx=0x7facbc07a000 comp rx=0 tx=0).stop 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 -- 172.21.15.79:0/4109182358 shutdown_connections 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x562d0bf21a90 0x562d0bf21e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf22b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf4f530 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facab7fe640 0 client.6054 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 --2- 172.21.15.79:0/4109182358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf4b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 -- 172.21.15.79:0/4109182358 >> 172.21.15.79:0/4109182358 conn(0x562d0bf20a00 msgr2=0x562d0bf3c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 -- 172.21.15.79:0/4109182358 shutdown_connections 2024-06-10T00:18:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.077+0000 7facd5839740 1 -- 172.21.15.79:0/4109182358 wait complete. 2024-06-10T00:18:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.078+0000 7facd5839740 20 client.6054 trim_cache size 0 max 16384 2024-06-10T00:18:00.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.091+0000 7facd5839740 1 Processor -- start 2024-06-10T00:18:00.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.091+0000 7facd5839740 1 -- start start 2024-06-10T00:18:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd5839740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf5f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd5839740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf39220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd5839740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bef43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd5839740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faccc1fdf00 con 0x562d0bf3e020 2024-06-10T00:18:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd5839740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faccc1f67b0 con 0x562d0bf21140 2024-06-10T00:18:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd5839740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faccc140280 con 0x562d0bf32390 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bef43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bef43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52378/0 (socket says 172.21.15.79:52378) 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 -- 172.21.15.79:0/2760588347 learned_addr learned my addr 172.21.15.79:0/2760588347 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facc3fff640 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf39220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd08c5640 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf5f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 -- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 msgr2=0x562d0bf39220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf39220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 -- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 msgr2=0x562d0bf5f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf5f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 -- 172.21.15.79:0/2760588347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0bf20800 con 0x562d0bf3e020 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facc3fff640 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf39220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facd10c6640 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bef43b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7facc4009f00 tx=0x7facc4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ad1b830f1f5a52 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facb27fc640 1 -- 172.21.15.79:0/2760588347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4004380 con 0x562d0bf3e020 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facb27fc640 1 -- 172.21.15.79:0/2760588347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4018040 con 0x562d0bf3e020 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.092+0000 7facb27fc640 1 -- 172.21.15.79:0/2760588347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4004520 con 0x562d0bf3e020 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 -- 172.21.15.79:0/2760588347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 msgr2=0x562d0bef43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bef43b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7facc4009f00 tx=0x7facc4013000 comp rx=0 tx=0).stop 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 -- 172.21.15.79:0/2760588347 shutdown_connections 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bef43b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf39220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 --2- 172.21.15.79:0/2760588347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf5f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 -- 172.21.15.79:0/2760588347 >> 172.21.15.79:0/2760588347 conn(0x562d0bf20a00 msgr2=0x562d0bf21e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 -- 172.21.15.79:0/2760588347 shutdown_connections 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 -- 172.21.15.79:0/2760588347 wait complete. 2024-06-10T00:18:00.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.093+0000 7facd5839740 1 -- start start 2024-06-10T00:18:00.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd5839740 1 Processor -- start 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd5839740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf5ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd5839740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf3b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd5839740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf1d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd5839740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562d0bf234b0 con 0x562d0bf3e020 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd5839740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562d0bf4c350 con 0x562d0bf21140 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd5839740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562d0bf231b0 con 0x562d0bf32390 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd5839740 10 client.0 _ll_register_callbacks cb 0x7facbc0095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd10c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf1d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd10c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf1d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52382/0 (socket says 172.21.15.79:52382) 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.094+0000 7facd10c6640 1 -- 172.21.15.79:0/104602545 learned_addr learned my addr 172.21.15.79:0/104602545 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd10c6640 1 -- 172.21.15.79:0/104602545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 msgr2=0x562d0bf3b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd10c6640 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf3b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd10c6640 1 -- 172.21.15.79:0/104602545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 msgr2=0x562d0bf5ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd08c5640 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf5ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd10c6640 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf5ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd10c6640 1 -- 172.21.15.79:0/104602545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d0bf1dbf0 con 0x562d0bf3e020 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd10c6640 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf1d3a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7facc4014000 tx=0x7facc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145528c4f47aee74 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facab7fe640 1 -- 172.21.15.79:0/104602545 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc400e870 con 0x562d0bf3e020 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facab7fe640 1 -- 172.21.15.79:0/104602545 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7facc400ea10 con 0x562d0bf3e020 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 1 -- 172.21.15.79:0/104602545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc4018040 con 0x562d0bf3e020 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facab7fe640 1 -- 172.21.15.79:0/104602545 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7facc4003610 con 0x562d0bf3e020 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 10 client.6060 fetch_fsmap learned FSMap version 30 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 1 -- 172.21.15.79:0/104602545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x562d0bf33430 con 0x562d0bf3e020 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facab7fe640 1 -- 172.21.15.79:0/104602545 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4018040 con 0x562d0bf3e020 2024-06-10T00:18:00.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facab7fe640 1 -- 172.21.15.79:0/104602545 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7facc403b080 con 0x562d0bf3e020 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 10 client.6060 fetch_fsmap finished waiting for FSMap version 30 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 10 client.6060 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 20 client.6060 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x562d0bf0cd70 0x562d0bf30e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 4 client.6060 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd5839740 1 -- 172.21.15.79:0/104602545 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x562d0be61800 con 0x562d0bf0cd70 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.095+0000 7facd08c5640 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x562d0bf0cd70 0x562d0bf30e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd08c5640 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x562d0bf0cd70 0x562d0bf30e50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb93ba88b12c8f6 server_cookie=ab8dbd331ecc86e7 in_seq=0 out_seq=0 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facab7fe640 10 client.6060 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facab7fe640 1 -- 172.21.15.79:0/104602545 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+141 (crc 0 0 0) 0x562d0be61800 con 0x562d0bf0cd70 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facab7fe640 10 client.6060 handle_command_reply: tid=0 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 client.6060 shutdown 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 -- 172.21.15.79:0/104602545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 msgr2=0x562d0bf1d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf1d3a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7facc4014000 tx=0x7facc4004730 comp rx=0 tx=0).stop 2024-06-10T00:18:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 -- 172.21.15.79:0/104602545 shutdown_connections 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562d0bf3e020 0x562d0bf1d3a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x562d0bf0cd70 0x562d0bf30e50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562d0bf32390 0x562d0bf3b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 --2- 172.21.15.79:0/104602545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562d0bf21140 0x562d0bf5ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facab7fe640 0 client.6060 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 -- 172.21.15.79:0/104602545 >> 172.21.15.79:0/104602545 conn(0x562d0bf20a00 msgr2=0x562d0bef44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 -- 172.21.15.79:0/104602545 shutdown_connections 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 1 -- 172.21.15.79:0/104602545 wait complete. 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.096+0000 7facd5839740 20 client.6060 trim_cache size 0 max 16384 2024-06-10T00:18:00.102 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:00.103 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:18:00.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:00.103 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "backtrace", 2024-06-10T00:18:00.103 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 1814793350, 2024-06-10T00:18:00.103 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-06-10T00:18:00.103 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir_test/file" 2024-06-10T00:18:00.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:00.103 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 -- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7facb806be30 msgr2=0x7facb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7facb806be30 0x7facb806e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7facc8001cd0 tx=0x7facc8009040 comp rx=0 tx=0).stop 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 -- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 msgr2=0x7faccc14b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc14b3a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7facbc02a2b0 tx=0x7facbc0046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 -- 172.21.15.79:0/2963487609 shutdown_connections 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7facb806be30 0x7facb806e2f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc154c20 0x7faccc152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0b3bf0 0x7faccc14b3a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 --2- 172.21.15.79:0/2963487609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc06d500 0x7faccc153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 -- 172.21.15.79:0/2963487609 >> 172.21.15.79:0/2963487609 conn(0x7faccc0b1d10 msgr2=0x7faccc072450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 -- 172.21.15.79:0/2963487609 shutdown_connections 2024-06-10T00:18:00.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.097+0000 7facd2b29640 1 -- 172.21.15.79:0/2963487609 wait complete. 2024-06-10T00:18:00.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-10T00:18:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.205+0000 7f5b1f570640 1 Processor -- start 2024-06-10T00:18:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.205+0000 7f5b1f570640 1 -- start start 2024-06-10T00:18:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.206+0000 7f5b1f570640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b180cd230 0x7f5b180b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.206+0000 7f5b1f570640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b180cec50 0x7f5b180cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.206+0000 7f5b1f570640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b180b3420 con 0x7f5b181553c0 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.206+0000 7f5b1f570640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5b180cc750 con 0x7f5b180cd230 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.206+0000 7f5b1f570640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5b180cca30 con 0x7f5b180cec50 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.206+0000 7f5b1d30c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5b181553c0 0x7f5b1815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54394/0 (socket says 172.21.15.79:54394) 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.206+0000 7f5b1d30c640 1 -- 172.21.15.79:0/1351089869 learned_addr learned my addr 172.21.15.79:0/1351089869 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b1db0d640 1 --2- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b180cec50 0x7f5b180cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b1cb0b640 1 --2- 172.21.15.79:0/1351089869 >> v2:172.21.15.117:3300/0 conn(0x7f5b180cd230 0x7f5b180b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b0ffff640 1 -- 172.21.15.79:0/1351089869 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561674674 0 0) 0x7f5b180b3420 con 0x7f5b181553c0 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b0ffff640 1 -- 172.21.15.79:0/1351089869 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b04003520 con 0x7f5b181553c0 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b1cb0b640 1 -- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b180cec50 msgr2=0x7f5b180cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b0ffff640 1 -- 172.21.15.79:0/1351089869 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3962572465 0 0) 0x7f5b04003520 con 0x7f5b181553c0 2024-06-10T00:18:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b1cb0b640 1 --2- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b180cec50 0x7f5b180cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b1cb0b640 1 -- 172.21.15.79:0/1351089869 >> v1:172.21.15.79:6789/0 conn(0x7f5b181553c0 legacy=0x7f5b1815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b1cb0b640 1 -- 172.21.15.79:0/1351089869 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b180ccd10 con 0x7f5b180cd230 2024-06-10T00:18:00.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.207+0000 7f5b1db0d640 1 --2- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b180cec50 0x7f5b180cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:00.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b1cb0b640 1 --2- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 0x7f5b180b2cf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b080097a0 tx=0x7f5b0802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61349a52842e7f4d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b0ffff640 1 -- 172.21.15.79:0/1351089869 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08037070 con 0x7f5b180cd230 2024-06-10T00:18:00.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b0ffff640 1 -- 172.21.15.79:0/1351089869 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0802aba0 con 0x7f5b180cd230 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b0ffff640 1 -- 172.21.15.79:0/1351089869 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b140019f0 con 0x7f5b180cd230 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b1f570640 1 -- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 msgr2=0x7f5b180b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 0x7f5b180b2cf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b080097a0 tx=0x7f5b0802a110 comp rx=0 tx=0).stop 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b1f570640 1 -- 172.21.15.79:0/1351089869 shutdown_connections 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b180cec50 0x7f5b180cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1351089869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 0x7f5b180b2cf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b1f570640 1 -- 172.21.15.79:0/1351089869 >> 172.21.15.79:0/1351089869 conn(0x7f5b180b19f0 msgr2=0x7f5b180b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.208+0000 7f5b1f570640 1 -- 172.21.15.79:0/1351089869 shutdown_connections 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.209+0000 7f5b1f570640 1 -- 172.21.15.79:0/1351089869 wait complete. 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1f570640 1 Processor -- start 2024-06-10T00:18:00.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1f570640 1 -- start start 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1f570640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 0x7f5b181f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1f570640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b180cec50 0x7f5b18153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1f570640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b181553c0 0x7f5b1806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1f570640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18155920 con 0x7f5b180cec50 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1f570640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181557a0 con 0x7f5b180cd230 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1f570640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5b18071030 con 0x7f5b181553c0 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1cb0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b180cec50 0x7f5b18153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1cb0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b180cec50 0x7f5b18153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52396/0 (socket says 172.21.15.79:52396) 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.210+0000 7f5b1cb0b640 1 -- 172.21.15.79:0/1054313502 learned_addr learned my addr 172.21.15.79:0/1054313502 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1d30c640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 0x7f5b181f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1cb0b640 1 -- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b181553c0 msgr2=0x7f5b1806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1db0d640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b181553c0 0x7f5b1806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1cb0b640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b181553c0 0x7f5b1806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1cb0b640 1 -- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 msgr2=0x7f5b181f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1cb0b640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 0x7f5b181f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1cb0b640 1 -- 172.21.15.79:0/1054313502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b181f24a0 con 0x7f5b180cec50 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1d30c640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 0x7f5b181f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1db0d640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b181553c0 0x7f5b1806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1cb0b640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b180cec50 0x7f5b18153eb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5b08035040 tx=0x7f5b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b0dffb640 1 -- 172.21.15.79:0/1054313502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08037050 con 0x7f5b180cec50 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b0dffb640 1 -- 172.21.15.79:0/1054313502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b08043070 con 0x7f5b180cec50 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b181f2770 con 0x7f5b180cec50 2024-06-10T00:18:00.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b0dffb640 1 -- 172.21.15.79:0/1054313502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08006e10 con 0x7f5b180cec50 2024-06-10T00:18:00.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.211+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b181f2d30 con 0x7f5b180cec50 2024-06-10T00:18:00.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.212+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b180b4540 con 0x7f5b180cec50 2024-06-10T00:18:00.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.213+0000 7f5b0dffb640 1 -- 172.21.15.79:0/1054313502 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b0803ca30 con 0x7f5b180cec50 2024-06-10T00:18:00.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.213+0000 7f5b0dffb640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5afc06be30 0x7f5afc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.213+0000 7f5b1d30c640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5afc06be30 0x7f5afc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.213+0000 7f5b0dffb640 1 -- 172.21.15.79:0/1054313502 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f5b080abb50 con 0x7f5b180cec50 2024-06-10T00:18:00.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.214+0000 7f5b1d30c640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5afc06be30 0x7f5afc06e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5b14002230 tx=0x7f5b14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.218+0000 7f5b0dffb640 1 -- 172.21.15.79:0/1054313502 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5b180b4540 con 0x7f5b180cec50 2024-06-10T00:18:00.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.429+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5b1815eed0 con 0x7f5b180cec50 2024-06-10T00:18:00.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.429+0000 7f5b0dffb640 1 -- 172.21.15.79:0/1054313502 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f5b0807a420 con 0x7f5b180cec50 2024-06-10T00:18:00.429 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:00.429 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5afc06be30 msgr2=0x7f5afc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5afc06be30 0x7f5afc06e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5b14002230 tx=0x7f5b14009040 comp rx=0 tx=0).stop 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b180cec50 msgr2=0x7f5b18153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b180cec50 0x7f5b18153eb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5b08035040 tx=0x7f5b080046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 shutdown_connections 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5afc06be30 0x7f5afc06e2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b181553c0 0x7f5b1806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b180cec50 0x7f5b18153eb0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 --2- 172.21.15.79:0/1054313502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b180cd230 0x7f5b181f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 >> 172.21.15.79:0/1054313502 conn(0x7f5b180b19f0 msgr2=0x7f5b18072cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 shutdown_connections 2024-06-10T00:18:00.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.431+0000 7f5b1f570640 1 -- 172.21.15.79:0/1054313502 wait complete. 2024-06-10T00:18:00.441 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-06-10T00:18:00.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:00.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-06-10T00:18:00.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.545+0000 7fab2fc31640 1 Processor -- start 2024-06-10T00:18:00.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.546+0000 7fab2fc31640 1 -- start start 2024-06-10T00:18:00.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.546+0000 7fab2fc31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab2815e670 0x7fab280d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.546+0000 7fab2fc31640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2815ec90 con 0x7fab280d1f30 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.546+0000 7fab2fc31640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2815ef70 con 0x7fab280d0e00 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.546+0000 7fab2fc31640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fab2815fa50 con 0x7fab2815e670 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2d1cc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fab280d1f30 0x7fab280d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54404/0 (socket says 172.21.15.79:54404) 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2d1cc640 1 -- 172.21.15.79:0/2968208490 learned_addr learned my addr 172.21.15.79:0/2968208490 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/2968208490 >> v2:172.21.15.117:3300/0 conn(0x7fab2815e670 0x7fab280d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2c9cb640 1 -- 172.21.15.79:0/2968208490 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 30781048 0 0) 0x7fab2815ec90 con 0x7fab280d1f30 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2c9cb640 1 -- 172.21.15.79:0/2968208490 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab14003520 con 0x7fab280d1f30 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2d9cd640 1 -- 172.21.15.79:0/2968208490 >> v1:172.21.15.117:6789/0 conn(0x7fab280d0e00 legacy=0x7fab280cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2d9cd640 1 -- 172.21.15.79:0/2968208490 >> v1:172.21.15.79:6789/0 conn(0x7fab280d1f30 legacy=0x7fab280d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2c9cb640 1 -- 172.21.15.79:0/2968208490 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625848234 0 0) 0x7fab2815ef70 con 0x7fab280d0e00 2024-06-10T00:18:00.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.547+0000 7fab2d9cd640 1 -- 172.21.15.79:0/2968208490 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2815f250 con 0x7fab2815e670 2024-06-10T00:18:00.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.548+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/2968208490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2815e670 0x7fab280d49f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab240097a0 tx=0x7fab2402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b47ecc088f121a4a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.548+0000 7fab2c9cb640 1 -- 172.21.15.79:0/2968208490 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24037070 con 0x7fab2815e670 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.548+0000 7fab2c9cb640 1 -- 172.21.15.79:0/2968208490 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab24032640 con 0x7fab2815e670 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.548+0000 7fab2c9cb640 1 -- 172.21.15.79:0/2968208490 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24032a10 con 0x7fab2815e670 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.548+0000 7fab2fc31640 1 -- 172.21.15.79:0/2968208490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2815e670 msgr2=0x7fab280d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.548+0000 7fab2fc31640 1 --2- 172.21.15.79:0/2968208490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2815e670 0x7fab280d49f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab240097a0 tx=0x7fab2402a2c0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.549+0000 7fab2fc31640 1 -- 172.21.15.79:0/2968208490 shutdown_connections 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.549+0000 7fab2fc31640 1 --2- 172.21.15.79:0/2968208490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2815e670 0x7fab280d49f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.549+0000 7fab2fc31640 1 -- 172.21.15.79:0/2968208490 >> 172.21.15.79:0/2968208490 conn(0x7fab2809d400 msgr2=0x7fab280d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.549+0000 7fab2fc31640 1 -- 172.21.15.79:0/2968208490 shutdown_connections 2024-06-10T00:18:00.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.549+0000 7fab2fc31640 1 -- 172.21.15.79:0/2968208490 wait complete. 2024-06-10T00:18:00.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.550+0000 7fab2fc31640 1 Processor -- start 2024-06-10T00:18:00.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.550+0000 7fab2fc31640 1 -- start start 2024-06-10T00:18:00.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.550+0000 7fab2fc31640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280d0e00 0x7fab280cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.550+0000 7fab2fc31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280d1f30 0x7fab28160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.550+0000 7fab2fc31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab2815e670 0x7fab280b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.550+0000 7fab2fc31640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab280d2370 con 0x7fab2815e670 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.550+0000 7fab2fc31640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab2815ea50 con 0x7fab280d1f30 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.550+0000 7fab2fc31640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fab280cf2e0 con 0x7fab280d0e00 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab2815e670 0x7fab280b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab2815e670 0x7fab280b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52406/0 (socket says 172.21.15.79:52406) 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 -- 172.21.15.79:0/727562972 learned_addr learned my addr 172.21.15.79:0/727562972 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2d1cc640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280d1f30 0x7fab28160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280d0e00 0x7fab280cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 -- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280d0e00 msgr2=0x7fab280cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280d0e00 0x7fab280cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 -- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280d1f30 msgr2=0x7fab28160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280d1f30 0x7fab28160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 -- 172.21.15.79:0/727562972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab280cc230 con 0x7fab2815e670 2024-06-10T00:18:00.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2d1cc640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280d1f30 0x7fab28160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:00.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280d0e00 0x7fab280cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:00.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab2815e670 0x7fab280b9260 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fab2000c780 tx=0x7fab2000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab1e7fc640 1 -- 172.21.15.79:0/727562972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20017070 con 0x7fab2815e670 2024-06-10T00:18:00.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab1e7fc640 1 -- 172.21.15.79:0/727562972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab20003dc0 con 0x7fab2815e670 2024-06-10T00:18:00.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab1e7fc640 1 -- 172.21.15.79:0/727562972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab200052b0 con 0x7fab2815e670 2024-06-10T00:18:00.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2fc31640 1 -- 172.21.15.79:0/727562972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab280b6dd0 con 0x7fab2815e670 2024-06-10T00:18:00.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.551+0000 7fab2fc31640 1 -- 172.21.15.79:0/727562972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab280b7390 con 0x7fab2815e670 2024-06-10T00:18:00.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.553+0000 7fab1e7fc640 1 -- 172.21.15.79:0/727562972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab2001a070 con 0x7fab2815e670 2024-06-10T00:18:00.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.553+0000 7fab1e7fc640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab0c06be30 0x7fab0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.553+0000 7fab1e7fc640 1 -- 172.21.15.79:0/727562972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fab2008a6f0 con 0x7fab2815e670 2024-06-10T00:18:00.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.553+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab0c06be30 0x7fab0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.554+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab0c06be30 0x7fab0c06e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fab24034000 tx=0x7fab2402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.554+0000 7fab32a1b740 1 Processor -- start 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.554+0000 7fab32a1b740 1 -- start start 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a124882320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 0x55a1248b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b23c0 0x55a1248871d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab32a1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a1247eabb0 con 0x55a1248cf9e0 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab32a1b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a124788d30 con 0x55a1248b2b00 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab32a1b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a1247e6b70 con 0x55a1248b23c0 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a124882320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a124882320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52410/0 (socket says 172.21.15.79:52410) 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 -- 172.21.15.79:0/425139633 learned_addr learned my addr 172.21.15.79:0/425139633 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 -- 172.21.15.79:0/425139633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b23c0 msgr2=0x55a1248871d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/425139633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b23c0 0x55a1248871d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 -- 172.21.15.79:0/425139633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 msgr2=0x55a1248b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/425139633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 0x55a1248b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 -- 172.21.15.79:0/425139633 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1247b1a70 con 0x55a1248cf9e0 2024-06-10T00:18:00.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/425139633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a124882320 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fab24032830 tx=0x7fab2402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa275d83544eb97 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.555+0000 7fab0b7fe640 1 -- 172.21.15.79:0/425139633 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24037040 con 0x55a1248cf9e0 2024-06-10T00:18:00.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab0b7fe640 1 -- 172.21.15.79:0/425139633 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2404c070 con 0x55a1248cf9e0 2024-06-10T00:18:00.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab0b7fe640 1 -- 172.21.15.79:0/425139633 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2403c440 con 0x55a1248cf9e0 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 -- 172.21.15.79:0/425139633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 msgr2=0x55a124882320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 --2- 172.21.15.79:0/425139633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a124882320 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fab24032830 tx=0x7fab2402c000 comp rx=0 tx=0).stop 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 -- 172.21.15.79:0/425139633 shutdown_connections 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 --2- 172.21.15.79:0/425139633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b23c0 0x55a1248871d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 --2- 172.21.15.79:0/425139633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 0x55a1248b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 --2- 172.21.15.79:0/425139633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a124882320 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 -- 172.21.15.79:0/425139633 >> 172.21.15.79:0/425139633 conn(0x55a1248845e0 msgr2=0x55a1248cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 -- 172.21.15.79:0/425139633 shutdown_connections 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.556+0000 7fab32a1b740 1 -- 172.21.15.79:0/425139633 wait complete. 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.557+0000 7fab32a1b740 1 -- start start 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.557+0000 7fab32a1b740 1 Processor -- start 2024-06-10T00:18:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 0x55a1248e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248adbd0 0x55a1248cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab32a1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a124886790 con 0x55a1248cf9e0 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab32a1b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a124773ed0 con 0x55a1248b2b00 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab32a1b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a124885b80 con 0x55a1248adbd0 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab32a1b740 10 client.0 _ll_register_callbacks cb 0x55a1244fdd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52412/0 (socket says 172.21.15.79:52412) 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 -- 172.21.15.79:0/1850828991 learned_addr learned my addr 172.21.15.79:0/1850828991 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 0x55a1248e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248adbd0 0x55a1248cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 -- 172.21.15.79:0/1850828991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248adbd0 msgr2=0x55a1248cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248adbd0 0x55a1248cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 -- 172.21.15.79:0/1850828991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 msgr2=0x55a1248e03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 0x55a1248e03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 -- 172.21.15.79:0/1850828991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1245ca940 con 0x55a1248cf9e0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab2d1cc640 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248b5590 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fab1800e160 tx=0x7fab1800e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5ba4742da8469d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.558+0000 7fab08ff9640 1 -- 172.21.15.79:0/1850828991 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab18019060 con 0x55a1248cf9e0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab08ff9640 1 -- 172.21.15.79:0/1850828991 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fab18005ac0 con 0x55a1248cf9e0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 1 -- 172.21.15.79:0/1850828991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab2404c070 con 0x55a1248cf9e0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab08ff9640 1 -- 172.21.15.79:0/1850828991 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab1801f050 con 0x55a1248cf9e0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 10 client.6078 fetch_fsmap learned FSMap version 30 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 1 -- 172.21.15.79:0/1850828991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55a12462b0d0 con 0x55a1248cf9e0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab08ff9640 1 -- 172.21.15.79:0/1850828991 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2404c070 con 0x55a1248cf9e0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab08ff9640 1 -- 172.21.15.79:0/1850828991 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7fab18022020 con 0x55a1248cf9e0 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 10 client.6078 fetch_fsmap finished waiting for FSMap version 30 2024-06-10T00:18:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 10 client.6078 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 20 client.6078 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55a1248aeab0 0x55a1248aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 4 client.6078 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab32a1b740 1 -- 172.21.15.79:0/1850828991 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1247f82e0 con 0x55a1248aeab0 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55a1248aeab0 0x55a1248aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab08ff9640 10 client.6078 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.559+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55a1248aeab0 0x55a1248aee90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d81f86c59b1773c4 server_cookie=4a37d1d48483b7a7 in_seq=0 out_seq=0 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab08ff9640 1 -- 172.21.15.79:0/1850828991 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a1247f82e0 con 0x55a1248aeab0 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab08ff9640 10 client.6078 handle_command_reply: tid=0 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 client.6078 shutdown 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 -- 172.21.15.79:0/1850828991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 msgr2=0x55a1248b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248b5590 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fab1800e160 tx=0x7fab1800e620 comp rx=0 tx=0).stop 2024-06-10T00:18:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 -- 172.21.15.79:0/1850828991 shutdown_connections 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55a1248aeab0 0x55a1248aee90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248adbd0 0x55a1248cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248b5590 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab08ff9640 0 client.6078 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1850828991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248b2b00 0x55a1248e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 -- 172.21.15.79:0/1850828991 >> 172.21.15.79:0/1850828991 conn(0x55a1248b23c0 msgr2=0x55a1248cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 -- 172.21.15.79:0/1850828991 shutdown_connections 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 1 -- 172.21.15.79:0/1850828991 wait complete. 2024-06-10T00:18:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.560+0000 7fab32a1b740 20 client.6078 trim_cache size 0 max 16384 2024-06-10T00:18:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab32a1b740 1 Processor -- start 2024-06-10T00:18:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab32a1b740 1 -- start start 2024-06-10T00:18:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248adbd0 0x55a1248b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a1248b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248cf9e0 0x55a1248b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab32a1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab28200ad0 con 0x55a1248adbd0 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab32a1b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab281ffb10 con 0x55a1248cf9e0 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab32a1b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fab281f82c0 con 0x55a1248b2b00 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab2d9cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248adbd0 0x55a1248b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab2d9cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248adbd0 0x55a1248b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52414/0 (socket says 172.21.15.79:52414) 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.579+0000 7fab2d9cd640 1 -- 172.21.15.79:0/1282011229 learned_addr learned my addr 172.21.15.79:0/1282011229 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2d9cd640 1 -- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 msgr2=0x55a1248b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2d1cc640 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a1248b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248cf9e0 0x55a1248b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a1248b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2d9cd640 1 -- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248cf9e0 msgr2=0x55a1248b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248cf9e0 0x55a1248b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2d9cd640 1 -- 172.21.15.79:0/1282011229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1244be230 con 0x55a1248adbd0 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2d1cc640 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a1248b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248cf9e0 0x55a1248b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248adbd0 0x55a1248b2ff0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fab2402a300 tx=0x7fab24009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7b378ec70df6ef server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab0affd640 1 -- 172.21.15.79:0/1282011229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24004480 con 0x55a1248adbd0 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab0affd640 1 -- 172.21.15.79:0/1282011229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2404c040 con 0x55a1248adbd0 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab0affd640 1 -- 172.21.15.79:0/1282011229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24003810 con 0x55a1248adbd0 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab32a1b740 1 -- 172.21.15.79:0/1282011229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248adbd0 msgr2=0x55a1248b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.580+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248adbd0 0x55a1248b2ff0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fab2402a300 tx=0x7fab24009190 comp rx=0 tx=0).stop 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 -- 172.21.15.79:0/1282011229 shutdown_connections 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248cf9e0 0x55a1248b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a1248b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 --2- 172.21.15.79:0/1282011229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248adbd0 0x55a1248b2ff0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 -- 172.21.15.79:0/1282011229 >> 172.21.15.79:0/1282011229 conn(0x55a1248b23c0 msgr2=0x55a1248a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 -- 172.21.15.79:0/1282011229 shutdown_connections 2024-06-10T00:18:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 -- 172.21.15.79:0/1282011229 wait complete. 2024-06-10T00:18:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 -- start start 2024-06-10T00:18:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.581+0000 7fab32a1b740 1 Processor -- start 2024-06-10T00:18:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248adbd0 0x55a12494c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a124881210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab32a1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab32a1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a1248f14d0 con 0x55a1248cf9e0 2024-06-10T00:18:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab32a1b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab280b83e0 con 0x55a1248adbd0 2024-06-10T00:18:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab32a1b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a124888c70 con 0x55a1248b2b00 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab32a1b740 10 client.0 _ll_register_callbacks cb 0x7fab18007d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2e1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2e1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52424/0 (socket says 172.21.15.79:52424) 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2e1ce640 1 -- 172.21.15.79:0/3176943413 learned_addr learned my addr 172.21.15.79:0/3176943413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2d1cc640 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a124881210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248adbd0 0x55a12494c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2e1ce640 1 -- 172.21.15.79:0/3176943413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 msgr2=0x55a124881210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a124881210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2e1ce640 1 -- 172.21.15.79:0/3176943413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248adbd0 msgr2=0x55a12494c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248adbd0 0x55a12494c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.582+0000 7fab2e1ce640 1 -- 172.21.15.79:0/3176943413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12494ba40 con 0x55a1248cf9e0 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab2e1ce640 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248a1d10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fab20060e40 tx=0x7fab200581b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716456089f08f483 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab08ff9640 1 -- 172.21.15.79:0/3176943413 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20070070 con 0x55a1248cf9e0 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab08ff9640 1 -- 172.21.15.79:0/3176943413 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fab200610e0 con 0x55a1248cf9e0 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 1 -- 172.21.15.79:0/3176943413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab2404c040 con 0x55a1248cf9e0 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab08ff9640 1 -- 172.21.15.79:0/3176943413 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab2005cb40 con 0x55a1248cf9e0 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 10 client.6084 fetch_fsmap learned FSMap version 30 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 1 -- 172.21.15.79:0/3176943413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55a12494c760 con 0x55a1248cf9e0 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab08ff9640 1 -- 172.21.15.79:0/3176943413 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2404c040 con 0x55a1248cf9e0 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab08ff9640 1 -- 172.21.15.79:0/3176943413 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7fab20057be0 con 0x55a1248cf9e0 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 10 client.6084 fetch_fsmap finished waiting for FSMap version 30 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 10 client.6084 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 20 client.6084 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55a1248c5010 0x55a1248a2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 4 client.6084 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab32a1b740 1 -- 172.21.15.79:0/3176943413 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) -- 0x55a1248839e0 con 0x55a1248c5010 2024-06-10T00:18:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55a1248c5010 0x55a1248a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.583+0000 7fab08ff9640 10 client.6084 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab2d9cd640 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55a1248c5010 0x55a1248a2250 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35897ce5d4a886b3 server_cookie=92b6da35fa8717a5 in_seq=0 out_seq=0 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab08ff9640 1 -- 172.21.15.79:0/3176943413 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a1248839e0 con 0x55a1248c5010 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab08ff9640 10 client.6084 handle_command_reply: tid=0 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 client.6084 shutdown 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 -- 172.21.15.79:0/3176943413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 msgr2=0x55a1248a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248a1d10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fab20060e40 tx=0x7fab200581b0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 -- 172.21.15.79:0/3176943413 shutdown_connections 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1248cf9e0 0x55a1248a1d10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x55a1248c5010 0x55a1248a2250 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a1248b2b00 0x55a124881210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 --2- 172.21.15.79:0/3176943413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1248adbd0 0x55a12494c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab08ff9640 0 client.6084 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.584+0000 7fab32a1b740 1 -- 172.21.15.79:0/3176943413 >> 172.21.15.79:0/3176943413 conn(0x55a1248b23c0 msgr2=0x55a1248cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.590 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fd0a3c13640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2024-06-10T00:17:28.327269+0000 1=1+0) caps={5955=pAsLsXsFs/-@2},l=5955(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x561bcae90680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-10T00:18:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab32a1b740 1 -- 172.21.15.79:0/3176943413 shutdown_connections 2024-06-10T00:18:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab32a1b740 1 -- 172.21.15.79:0/3176943413 wait complete. 2024-06-10T00:18:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab32a1b740 20 client.6084 trim_cache size 0 max 16384 2024-06-10T00:18:00.591 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:18:00.591 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:18:00.591 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "9bb01683-3cdf-42ad-8c3d-2d0b5c8613a9", 2024-06-10T00:18:00.591 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:18:00.591 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 -- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab0c06be30 msgr2=0x7fab0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab0c06be30 0x7fab0c06e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fab24034000 tx=0x7fab2402e000 comp rx=0 tx=0).stop 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 -- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab2815e670 msgr2=0x7fab280b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab2815e670 0x7fab280b9260 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fab2000c780 tx=0x7fab2000cc40 comp rx=0 tx=0).stop 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 -- 172.21.15.79:0/727562972 shutdown_connections 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab0c06be30 0x7fab0c06e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab2815e670 0x7fab280b9260 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280d1f30 0x7fab28160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 --2- 172.21.15.79:0/727562972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280d0e00 0x7fab280cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.585+0000 7fab2fc31640 1 -- 172.21.15.79:0/727562972 >> 172.21.15.79:0/727562972 conn(0x7fab2809d400 msgr2=0x7fab2806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.586+0000 7fab2fc31640 1 -- 172.21.15.79:0/727562972 shutdown_connections 2024-06-10T00:18:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.586+0000 7fab2fc31640 1 -- 172.21.15.79:0/727562972 wait complete. 2024-06-10T00:18:00.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:00.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-06-10T00:18:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.697+0000 7f1aeda6b640 1 Processor -- start 2024-06-10T00:18:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.697+0000 7f1aeda6b640 1 -- start start 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1aeda6b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ae80d0020 0x7f1ae80d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1aeda6b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ae8155700 con 0x7f1ae806e1f0 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1aeda6b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ae815b6b0 con 0x7f1ae8155320 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1aeda6b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1ae80d09c0 con 0x7f1ae80d0020 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1ae6ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ae80d0020 0x7f1ae80d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1ae7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1ae806e1f0 0x7f1ae806e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54414/0 (socket says 172.21.15.79:54414) 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1ae7fff640 1 -- 172.21.15.79:0/2686040417 learned_addr learned my addr 172.21.15.79:0/2686040417 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1ae6ffd640 1 -- 172.21.15.79:0/2686040417 >> v1:172.21.15.117:6789/0 conn(0x7f1ae8155320 legacy=0x7f1ae80b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1ae6ffd640 1 -- 172.21.15.79:0/2686040417 >> v1:172.21.15.79:6789/0 conn(0x7f1ae806e1f0 legacy=0x7f1ae806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1ae6ffd640 1 -- 172.21.15.79:0/2686040417 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae815b990 con 0x7f1ae80d0020 2024-06-10T00:18:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.698+0000 7f1ae67fc640 1 -- 172.21.15.79:0/2686040417 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538664614 0 0) 0x7f1ae8155700 con 0x7f1ae806e1f0 2024-06-10T00:18:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.699+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/2686040417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae80d0020 0x7f1ae80d0480 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0097a0 tx=0x7f1adc02c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caad918567c024b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.699+0000 7f1ae67fc640 1 -- 172.21.15.79:0/2686040417 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc039070 con 0x7f1ae80d0020 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.699+0000 7f1ae67fc640 1 -- 172.21.15.79:0/2686040417 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1adc034640 con 0x7f1ae80d0020 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.699+0000 7f1ae67fc640 1 -- 172.21.15.79:0/2686040417 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc034a10 con 0x7f1ae80d0020 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.700+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2686040417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae80d0020 msgr2=0x7f1ae80d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.700+0000 7f1aeda6b640 1 --2- 172.21.15.79:0/2686040417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae80d0020 0x7f1ae80d0480 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0097a0 tx=0x7f1adc02c3f0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.700+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2686040417 shutdown_connections 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.700+0000 7f1aeda6b640 1 --2- 172.21.15.79:0/2686040417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae80d0020 0x7f1ae80d0480 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.700+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2686040417 >> 172.21.15.79:0/2686040417 conn(0x7f1ae80b1d10 msgr2=0x7f1ae80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.700+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2686040417 shutdown_connections 2024-06-10T00:18:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.700+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2686040417 wait complete. 2024-06-10T00:18:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.701+0000 7f1aeda6b640 1 Processor -- start 2024-06-10T00:18:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.701+0000 7f1aeda6b640 1 -- start start 2024-06-10T00:18:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1aeda6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae806e1f0 0x7f1ae81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1aeda6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ae80d0020 0x7f1ae8152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1aeda6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ae8155320 0x7f1ae8072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1aeda6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae815bf50 con 0x7f1ae806e1f0 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1aeda6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae815b2f0 con 0x7f1ae8155320 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1aeda6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae815b470 con 0x7f1ae80d0020 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae806e1f0 0x7f1ae81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae806e1f0 0x7f1ae81525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52450/0 (socket says 172.21.15.79:52450) 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 -- 172.21.15.79:0/2027695525 learned_addr learned my addr 172.21.15.79:0/2027695525 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae7fff640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ae8155320 0x7f1ae8072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ae80d0020 0x7f1ae8152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 -- 172.21.15.79:0/2027695525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ae80d0020 msgr2=0x7f1ae8152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ae80d0020 0x7f1ae8152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 -- 172.21.15.79:0/2027695525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ae8155320 msgr2=0x7f1ae8072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ae8155320 0x7f1ae8072010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 -- 172.21.15.79:0/2027695525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae80cc960 con 0x7f1ae806e1f0 2024-06-10T00:18:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae806e1f0 0x7f1ae81525f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c430 tx=0x7f1ad800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1acffff640 1 -- 172.21.15.79:0/2027695525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011790 con 0x7f1ae806e1f0 2024-06-10T00:18:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1acffff640 1 -- 172.21.15.79:0/2027695525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad8017070 con 0x7f1ae806e1f0 2024-06-10T00:18:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2027695525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae81533c0 con 0x7f1ae806e1f0 2024-06-10T00:18:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.702+0000 7f1acffff640 1 -- 172.21.15.79:0/2027695525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011bb0 con 0x7f1ae806e1f0 2024-06-10T00:18:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.703+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2027695525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae8155da0 con 0x7f1ae806e1f0 2024-06-10T00:18:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.704+0000 7f1acffff640 1 -- 172.21.15.79:0/2027695525 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ad801c460 con 0x7f1ae806e1f0 2024-06-10T00:18:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.704+0000 7f1acffff640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.705+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.705+0000 7f1acffff640 1 -- 172.21.15.79:0/2027695525 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f1ad808afe0 con 0x7f1ae806e1f0 2024-06-10T00:18:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.705+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1adc036000 tx=0x7f1adc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.705+0000 7f1af077a740 1 Processor -- start 2024-06-10T00:18:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.705+0000 7f1af077a740 1 -- start start 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1af077a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd6726af0 0x560dd6703120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1af077a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd66fe1a0 0x560dd6703660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1af077a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd67056d0 0x560dd6703ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1af077a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560dd66287e0 con 0x560dd6726af0 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1af077a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560dd6666e80 con 0x560dd66fe1a0 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1af077a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560dd6604700 con 0x560dd67056d0 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1ae77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd6726af0 0x560dd6703120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1ae77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd6726af0 0x560dd6703120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52452/0 (socket says 172.21.15.79:52452) 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1ae77fe640 1 -- 172.21.15.79:0/882629166 learned_addr learned my addr 172.21.15.79:0/882629166 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1ae7fff640 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd67056d0 0x560dd6703ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.706+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd66fe1a0 0x560dd6703660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1ae77fe640 1 -- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd67056d0 msgr2=0x560dd6703ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd67056d0 0x560dd6703ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1ae77fe640 1 -- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd66fe1a0 msgr2=0x560dd6703660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd66fe1a0 0x560dd6703660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1ae77fe640 1 -- 172.21.15.79:0/882629166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd6623dd0 con 0x560dd6726af0 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1ae7fff640 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd67056d0 0x560dd6703ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd6726af0 0x560dd6703120 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8055450 tx=0x7f1ad80590b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fb31544cdd4be3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1acd7fa640 1 -- 172.21.15.79:0/882629166 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8071020 con 0x560dd6726af0 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1acd7fa640 1 -- 172.21.15.79:0/882629166 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad80572f0 con 0x560dd6726af0 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1acd7fa640 1 -- 172.21.15.79:0/882629166 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8055660 con 0x560dd6726af0 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1af077a740 1 -- 172.21.15.79:0/882629166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd6726af0 msgr2=0x560dd6703120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.707+0000 7f1af077a740 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd6726af0 0x560dd6703120 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8055450 tx=0x7f1ad80590b0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 -- 172.21.15.79:0/882629166 shutdown_connections 2024-06-10T00:18:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd67056d0 0x560dd6703ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd66fe1a0 0x560dd6703660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 --2- 172.21.15.79:0/882629166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd6726af0 0x560dd6703120 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 -- 172.21.15.79:0/882629166 >> 172.21.15.79:0/882629166 conn(0x560dd6700410 msgr2=0x560dd6748f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 -- 172.21.15.79:0/882629166 shutdown_connections 2024-06-10T00:18:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 -- 172.21.15.79:0/882629166 wait complete. 2024-06-10T00:18:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 -- start start 2024-06-10T00:18:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.708+0000 7f1af077a740 1 Processor -- start 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1af077a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd6726af0 0x560dd6729af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1af077a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd674e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1af077a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd672a030 0x560dd674ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1af077a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560dd65ef640 con 0x560dd671edc0 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1af077a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560dd6662e40 con 0x560dd6726af0 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1af077a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560dd6701be0 con 0x560dd672a030 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1af077a740 10 client.0 _ll_register_callbacks cb 0x560dd6621430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd674e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd674e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52466/0 (socket says 172.21.15.79:52466) 2024-06-10T00:18:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae6ffd640 1 -- 172.21.15.79:0/1140945777 learned_addr learned my addr 172.21.15.79:0/1140945777 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae7fff640 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd672a030 0x560dd674ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd6726af0 0x560dd6729af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae6ffd640 1 -- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd672a030 msgr2=0x560dd674ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd672a030 0x560dd674ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae6ffd640 1 -- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd6726af0 msgr2=0x560dd6729af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd6726af0 0x560dd6729af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae6ffd640 1 -- 172.21.15.79:0/1140945777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd64447d0 con 0x560dd671edc0 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.709+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd6726af0 0x560dd6729af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd674e810 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1adc02c430 tx=0x7f1adc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641197c9edc3aba2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1ac67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1ac67fc640 1 -- 172.21.15.79:0/1140945777 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc04f030 con 0x560dd671edc0 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1ac67fc640 1 -- 172.21.15.79:0/1140945777 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f1adc003ce0 con 0x560dd671edc0 2024-06-10T00:18:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 1 -- 172.21.15.79:0/1140945777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ad80572f0 con 0x560dd671edc0 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1ac67fc640 1 -- 172.21.15.79:0/1140945777 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1adc05b050 con 0x560dd671edc0 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 10 client.6099 fetch_fsmap learned FSMap version 30 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 1 -- 172.21.15.79:0/1140945777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x560dd637a3f0 con 0x560dd671edc0 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1ac67fc640 1 -- 172.21.15.79:0/1140945777 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad80572f0 con 0x560dd671edc0 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1ac67fc640 1 -- 172.21.15.79:0/1140945777 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7f1adc05e020 con 0x560dd671edc0 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 10 client.6099 fetch_fsmap finished waiting for FSMap version 30 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 10 client.6099 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 20 client.6099 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x560dd67279f0 0x560dd6727e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 4 client.6099 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1af077a740 1 -- 172.21.15.79:0/1140945777 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dd66745b0 con 0x560dd67279f0 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.710+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x560dd67279f0 0x560dd6727e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x560dd67279f0 0x560dd6727e10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=addf0f47e74f025a server_cookie=b593c7ee9c099de2 in_seq=0 out_seq=0 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1ac67fc640 10 client.6099 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1ac67fc640 1 -- 172.21.15.79:0/1140945777 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560dd66745b0 con 0x560dd67279f0 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1ac67fc640 10 client.6099 handle_command_reply: tid=0 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 client.6099 shutdown 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 -- 172.21.15.79:0/1140945777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 msgr2=0x560dd674e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd674e810 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1adc02c430 tx=0x7f1adc004730 comp rx=0 tx=0).stop 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 -- 172.21.15.79:0/1140945777 shutdown_connections 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x560dd67279f0 0x560dd6727e10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd672a030 0x560dd674ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd674e810 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1ac67fc640 0 client.6099 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 --2- 172.21.15.79:0/1140945777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd6726af0 0x560dd6729af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 -- 172.21.15.79:0/1140945777 >> 172.21.15.79:0/1140945777 conn(0x560dd67056d0 msgr2=0x560dd6702070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 -- 172.21.15.79:0/1140945777 shutdown_connections 2024-06-10T00:18:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 1 -- 172.21.15.79:0/1140945777 wait complete. 2024-06-10T00:18:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.711+0000 7f1af077a740 20 client.6099 trim_cache size 0 max 16384 2024-06-10T00:18:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.729+0000 7f1af077a740 1 Processor -- start 2024-06-10T00:18:00.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.729+0000 7f1af077a740 1 -- start start 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1af077a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd66fd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1af077a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 0x560dd671dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1af077a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd671e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1af077a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae81fc920 con 0x560dd671edc0 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1af077a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae81fb980 con 0x560dd672a030 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1af077a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae81fad60 con 0x560dd6726af0 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd66fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd66fd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52476/0 (socket says 172.21.15.79:52476) 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 -- 172.21.15.79:0/365784262 learned_addr learned my addr 172.21.15.79:0/365784262 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 -- 172.21.15.79:0/365784262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 msgr2=0x560dd671dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 0x560dd671dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 -- 172.21.15.79:0/365784262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 msgr2=0x560dd671e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae7fff640 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd671e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd671e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 -- 172.21.15.79:0/365784262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd633a0f0 con 0x560dd671edc0 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae7fff640 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd671e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.730+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd66fd300 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800cdf0 tx=0x7f1ad8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfd653d160f85d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1accff9640 1 -- 172.21.15.79:0/365784262 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80572f0 con 0x560dd671edc0 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1accff9640 1 -- 172.21.15.79:0/365784262 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad8071040 con 0x560dd671edc0 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1accff9640 1 -- 172.21.15.79:0/365784262 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8082bd0 con 0x560dd671edc0 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 -- 172.21.15.79:0/365784262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 msgr2=0x560dd66fd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd66fd300 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800cdf0 tx=0x7f1ad8013000 comp rx=0 tx=0).stop 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 -- 172.21.15.79:0/365784262 shutdown_connections 2024-06-10T00:18:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd671e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 0x560dd671dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 --2- 172.21.15.79:0/365784262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd66fd300 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 -- 172.21.15.79:0/365784262 >> 172.21.15.79:0/365784262 conn(0x560dd67056d0 msgr2=0x560dd66f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 -- 172.21.15.79:0/365784262 shutdown_connections 2024-06-10T00:18:00.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.731+0000 7f1af077a740 1 -- 172.21.15.79:0/365784262 wait complete. 2024-06-10T00:18:00.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.732+0000 7f1af077a740 1 -- start start 2024-06-10T00:18:00.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.732+0000 7f1af077a740 1 Processor -- start 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd67c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 0x560dd676b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd66fd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560dd6700120 con 0x560dd671edc0 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae81fb330 con 0x560dd672a030 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560dd6674ce0 con 0x560dd6726af0 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 10 client.0 _ll_register_callbacks cb 0x7f1adc004450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd67c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd67c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52482/0 (socket says 172.21.15.79:52482) 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 -- 172.21.15.79:0/686149504 learned_addr learned my addr 172.21.15.79:0/686149504 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 0x560dd676b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae7fff640 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd66fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 -- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 msgr2=0x560dd676b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 0x560dd676b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 -- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 msgr2=0x560dd66fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd66fd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 -- 172.21.15.79:0/686149504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd662d560 con 0x560dd671edc0 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 0x560dd676b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ae77fe640 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd67c9c60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800cdf0 tx=0x7f1ad8003940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb145c707f33171b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ac67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ac67fc640 1 -- 172.21.15.79:0/686149504 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8081060 con 0x560dd671edc0 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ac67fc640 1 -- 172.21.15.79:0/686149504 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f1ad8055660 con 0x560dd671edc0 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 1 -- 172.21.15.79:0/686149504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ad8071040 con 0x560dd671edc0 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1ac67fc640 1 -- 172.21.15.79:0/686149504 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1ad8082bd0 con 0x560dd671edc0 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 10 client.6105 fetch_fsmap learned FSMap version 30 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.733+0000 7f1af077a740 1 -- 172.21.15.79:0/686149504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x560dd67281b0 con 0x560dd671edc0 2024-06-10T00:18:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1ac67fc640 1 -- 172.21.15.79:0/686149504 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad8071040 con 0x560dd671edc0 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1ac67fc640 1 -- 172.21.15.79:0/686149504 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 3494+0+0 (secure 0 0 0) 0x7f1ad8073070 con 0x560dd671edc0 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 10 client.6105 fetch_fsmap finished waiting for FSMap version 30 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 10 client.6105 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 20 client.6105 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x560dd66fd840 0x560dd674c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 4 client.6105 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 -- 172.21.15.79:0/686149504 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560dd666e900 con 0x560dd66fd840 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x560dd66fd840 0x560dd674c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1ac67fc640 10 client.6105 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1ae6ffd640 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x560dd66fd840 0x560dd674c230 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3578608a0e5dd1b server_cookie=5c284efcc413b143 in_seq=0 out_seq=0 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1ac67fc640 1 -- 172.21.15.79:0/686149504 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x560dd666e900 con 0x560dd66fd840 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1ac67fc640 10 client.6105 handle_command_reply: tid=0 2024-06-10T00:18:00.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 client.6105 shutdown 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 -- 172.21.15.79:0/686149504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 msgr2=0x560dd67c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd67c9c60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800cdf0 tx=0x7f1ad8003940 comp rx=0 tx=0).stop 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 -- 172.21.15.79:0/686149504 shutdown_connections 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560dd672a030 0x560dd66fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x560dd66fd840 0x560dd674c230 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560dd6726af0 0x560dd676b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 --2- 172.21.15.79:0/686149504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560dd671edc0 0x560dd67c9c60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1ac67fc640 0 client.6105 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 -- 172.21.15.79:0/686149504 >> 172.21.15.79:0/686149504 conn(0x560dd67056d0 msgr2=0x560dd6761870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 -- 172.21.15.79:0/686149504 shutdown_connections 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.734+0000 7f1af077a740 1 -- 172.21.15.79:0/686149504 wait complete. 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1af077a740 20 client.6105 trim_cache size 0 max 16384 2024-06-10T00:18:00.740 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout: "9bb01683-3cdf-42ad-8c3d-2d0b5c8613a9": { 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "9bb01683-3cdf-42ad-8c3d-2d0b5c8613a9", 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair,force" 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:00.741 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 msgr2=0x7f1ad406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1adc036000 tx=0x7f1adc030000 comp rx=0 tx=0).stop 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae806e1f0 msgr2=0x7f1ae81525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae806e1f0 0x7f1ae81525f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c430 tx=0x7f1ad800c8f0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2027695525 shutdown_connections 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ae8155320 0x7f1ae8072010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ae80d0020 0x7f1ae8152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 --2- 172.21.15.79:0/2027695525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ae806e1f0 0x7f1ae81525f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2027695525 >> 172.21.15.79:0/2027695525 conn(0x7f1ae80b1d10 msgr2=0x7f1ae80b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2027695525 shutdown_connections 2024-06-10T00:18:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:00.735+0000 7f1aeda6b640 1 -- 172.21.15.79:0/2027695525 wait complete. 2024-06-10T00:18:00.745 INFO:tasks.cephfs.filesystem:scrub status for tag:9bb01683-3cdf-42ad-8c3d-2d0b5c8613a9 - {'path': '/', 'tag': '9bb01683-3cdf-42ad-8c3d-2d0b5c8613a9', 'options': 'recursive,repair,force'} 2024-06-10T00:18:13.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:18:13.859 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:18:30.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:30.746 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-06-10T00:18:30.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.859+0000 7f43116d2640 1 Processor -- start 2024-06-10T00:18:30.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.859+0000 7f43116d2640 1 -- start start 2024-06-10T00:18:30.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.860+0000 7f43116d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f430c0b3800 0x7f430c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.860+0000 7f43116d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0cf190 0x7f430c0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.860+0000 7f43116d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430c0cf620 con 0x7f430c0d08f0 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.860+0000 7f43116d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f430c0d1c80 con 0x7f430c0b3800 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.860+0000 7f43116d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f430c0b3cb0 con 0x7f430c0cf190 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0cf190 0x7f430c0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f430c0b3800 0x7f430c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0cf190 0x7f430c0d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:51250/0 (socket says 172.21.15.79:51250) 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430b7fe640 1 -- 172.21.15.79:0/2705613517 learned_addr learned my addr 172.21.15.79:0/2705613517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430affd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f430c0d08f0 0x7f430c0d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:53934/0 (socket says 172.21.15.79:53934) 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430a7fc640 1 -- 172.21.15.79:0/2705613517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0cf190 msgr2=0x7f430c0d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430a7fc640 1 --2- 172.21.15.79:0/2705613517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0cf190 0x7f430c0d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430a7fc640 1 -- 172.21.15.79:0/2705613517 >> v1:172.21.15.117:6789/0 conn(0x7f430c0d08f0 legacy=0x7f430c0d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430a7fc640 1 -- 172.21.15.79:0/2705613517 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c0cf8a0 con 0x7f430c0b3800 2024-06-10T00:18:30.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.861+0000 7f430b7fe640 1 --2- 172.21.15.79:0/2705613517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0cf190 0x7f430c0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.862+0000 7f430a7fc640 1 --2- 172.21.15.79:0/2705613517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0b3800 0x7f430c0cec50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f43000097d0 tx=0x7f430002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd8cdf796116953e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.862+0000 7f4309ffb640 1 -- 172.21.15.79:0/2705613517 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300037070 con 0x7f430c0b3800 2024-06-10T00:18:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.862+0000 7f4309ffb640 1 -- 172.21.15.79:0/2705613517 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4300032440 con 0x7f430c0b3800 2024-06-10T00:18:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.862+0000 7f4309ffb640 1 -- 172.21.15.79:0/2705613517 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300032810 con 0x7f430c0b3800 2024-06-10T00:18:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.862+0000 7f43116d2640 1 -- 172.21.15.79:0/2705613517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0b3800 msgr2=0x7f430c0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.862+0000 7f43116d2640 1 --2- 172.21.15.79:0/2705613517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0b3800 0x7f430c0cec50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f43000097d0 tx=0x7f430002a1c0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.863+0000 7f43116d2640 1 -- 172.21.15.79:0/2705613517 shutdown_connections 2024-06-10T00:18:30.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.863+0000 7f43116d2640 1 --2- 172.21.15.79:0/2705613517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0cf190 0x7f430c0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.863+0000 7f43116d2640 1 --2- 172.21.15.79:0/2705613517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0b3800 0x7f430c0cec50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.863+0000 7f43116d2640 1 -- 172.21.15.79:0/2705613517 >> 172.21.15.79:0/2705613517 conn(0x7f430c09d3c0 msgr2=0x7f430c0d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:30.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.863+0000 7f43116d2640 1 -- 172.21.15.79:0/2705613517 shutdown_connections 2024-06-10T00:18:30.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.863+0000 7f43116d2640 1 -- 172.21.15.79:0/2705613517 wait complete. 2024-06-10T00:18:30.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.864+0000 7f43116d2640 1 Processor -- start 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.864+0000 7f43116d2640 1 -- start start 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f43116d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f430c0b3800 0x7f430c157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f43116d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0cf190 0x7f430c1f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f43116d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0d08f0 0x7f430c0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f43116d2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f430c0d1ed0 con 0x7f430c0b3800 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f43116d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f430c0cfe60 con 0x7f430c0cf190 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f43116d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f430c0b50c0 con 0x7f430c0d08f0 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f430c0b3800 0x7f430c157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f430c0b3800 0x7f430c157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58360/0 (socket says 172.21.15.79:58360) 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 -- 172.21.15.79:0/3633475306 learned_addr learned my addr 172.21.15.79:0/3633475306 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:30.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430b7fe640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0d08f0 0x7f430c0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430a7fc640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0cf190 0x7f430c1f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 -- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0d08f0 msgr2=0x7f430c0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0d08f0 0x7f430c0c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 -- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0cf190 msgr2=0x7f430c1f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0cf190 0x7f430c1f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 -- 172.21.15.79:0/3633475306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c0cdce0 con 0x7f430c0b3800 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430a7fc640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0cf190 0x7f430c1f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.865+0000 7f430affd640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f430c0b3800 0x7f430c157350 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c3c0 tx=0x7f42fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.866+0000 7f42f37fe640 1 -- 172.21.15.79:0/3633475306 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc0074e0 con 0x7f430c0b3800 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.866+0000 7f42f37fe640 1 -- 172.21.15.79:0/3633475306 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42fc007680 con 0x7f430c0b3800 2024-06-10T00:18:30.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.866+0000 7f43116d2640 1 -- 172.21.15.79:0/3633475306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430c0cdfc0 con 0x7f430c0b3800 2024-06-10T00:18:30.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.866+0000 7f42f37fe640 1 -- 172.21.15.79:0/3633475306 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc004a00 con 0x7f430c0b3800 2024-06-10T00:18:30.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.866+0000 7f43116d2640 1 -- 172.21.15.79:0/3633475306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430c1f7de0 con 0x7f430c0b3800 2024-06-10T00:18:30.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.867+0000 7f42f37fe640 1 -- 172.21.15.79:0/3633475306 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42fc01a020 con 0x7f430c0b3800 2024-06-10T00:18:30.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.867+0000 7f42f37fe640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42f806be30 0x7f42f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.868+0000 7f42f37fe640 1 -- 172.21.15.79:0/3633475306 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f42fc08a880 con 0x7f430c0b3800 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.868+0000 7f430a7fc640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42f806be30 0x7f42f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.868+0000 7f430a7fc640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42f806be30 0x7f42f806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4300034000 tx=0x7f430002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.868+0000 7f43143de740 1 Processor -- start 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.869+0000 7f43143de740 1 -- start start 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.869+0000 7f43143de740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cb0af0 0x5564d0c8d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.869+0000 7f43143de740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0c881a0 0x5564d0c8d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.869+0000 7f43143de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0c8f6d0 0x5564d0c8dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.869+0000 7f43143de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564d0bb27e0 con 0x5564d0c8f6d0 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.869+0000 7f43143de740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564d0bf0e80 con 0x5564d0cb0af0 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.869+0000 7f43143de740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5564d0b8e700 con 0x5564d0c881a0 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0c8f6d0 0x5564d0c8dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0c8f6d0 0x5564d0c8dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58376/0 (socket says 172.21.15.79:58376) 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 -- 172.21.15.79:0/2281379370 learned_addr learned my addr 172.21.15.79:0/2281379370 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430affd640 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cb0af0 0x5564d0c8d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430a7fc640 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0c881a0 0x5564d0c8d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 -- 172.21.15.79:0/2281379370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0c881a0 msgr2=0x5564d0c8d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0c881a0 0x5564d0c8d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 -- 172.21.15.79:0/2281379370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cb0af0 msgr2=0x5564d0c8d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cb0af0 0x5564d0c8d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 -- 172.21.15.79:0/2281379370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d0baddd0 con 0x5564d0c8f6d0 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f430b7fe640 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0c8f6d0 0x5564d0c8dba0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4304009370 tx=0x7f4304009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c0b7f1f5d968a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f42f0ff9640 1 -- 172.21.15.79:0/2281379370 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43040147f0 con 0x5564d0c8f6d0 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f42f0ff9640 1 -- 172.21.15.79:0/2281379370 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430401a070 con 0x5564d0c8f6d0 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.870+0000 7f42f0ff9640 1 -- 172.21.15.79:0/2281379370 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304014bb0 con 0x5564d0c8f6d0 2024-06-10T00:18:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 -- 172.21.15.79:0/2281379370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0c8f6d0 msgr2=0x5564d0c8dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0c8f6d0 0x5564d0c8dba0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4304009370 tx=0x7f4304009810 comp rx=0 tx=0).stop 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 -- 172.21.15.79:0/2281379370 shutdown_connections 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0c8f6d0 0x5564d0c8dba0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0c881a0 0x5564d0c8d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 --2- 172.21.15.79:0/2281379370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cb0af0 0x5564d0c8d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 -- 172.21.15.79:0/2281379370 >> 172.21.15.79:0/2281379370 conn(0x5564d0c8a410 msgr2=0x5564d0cd2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 -- 172.21.15.79:0/2281379370 shutdown_connections 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.871+0000 7f43143de740 1 -- 172.21.15.79:0/2281379370 wait complete. 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 1 -- start start 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 1 Processor -- start 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0cacc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cb46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 0x5564d0cb9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564d0b79640 con 0x5564d0cb0af0 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564d0bece40 con 0x5564d0cad8c0 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5564d0c8bbe0 con 0x5564d0cb7c00 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f430affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0cacc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f43143de740 10 client.0 _ll_register_callbacks cb 0x5564d0bab430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.872+0000 7f430affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0cacc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58384/0 (socket says 172.21.15.79:58384) 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430affd640 1 -- 172.21.15.79:0/3401339411 learned_addr learned my addr 172.21.15.79:0/3401339411 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430b7fe640 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 0x5564d0cb9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430a7fc640 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cb46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430affd640 1 -- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 msgr2=0x5564d0cb9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430affd640 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 0x5564d0cb9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430affd640 1 -- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 msgr2=0x5564d0cb46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430affd640 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cb46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430affd640 1 -- 172.21.15.79:0/3401339411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d09ce7d0 con 0x5564d0cb0af0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430b7fe640 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 0x5564d0cb9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f430affd640 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0cacc20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f42fc088b10 tx=0x7f42fc05cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ed915e2a10cce4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f42e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f42e9ffb640 1 -- 172.21.15.79:0/3401339411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc058af0 con 0x5564d0cb0af0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f42e9ffb640 1 -- 172.21.15.79:0/3401339411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f42fc058c90 con 0x5564d0cb0af0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f43143de740 1 -- 172.21.15.79:0/3401339411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f430401a070 con 0x5564d0cb0af0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f42e9ffb640 1 -- 172.21.15.79:0/3401339411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f42fc060fe0 con 0x5564d0cb0af0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f43143de740 10 client.6114 fetch_fsmap learned FSMap version 31 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f43143de740 1 -- 172.21.15.79:0/3401339411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5564d09043f0 con 0x5564d0cb0af0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f42e9ffb640 1 -- 172.21.15.79:0/3401339411 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430401a070 con 0x5564d0cb0af0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.873+0000 7f42e9ffb640 1 -- 172.21.15.79:0/3401339411 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) ==== 3494+0+0 (secure 0 0 0) 0x7f42fc059bc0 con 0x5564d0cb0af0 2024-06-10T00:18:30.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f43143de740 10 client.6114 fetch_fsmap finished waiting for FSMap version 31 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f43143de740 10 client.6114 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f43143de740 20 client.6114 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f43143de740 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5564d0cb3640 0x5564d0ceff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f43143de740 4 client.6114 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f43143de740 1 -- 172.21.15.79:0/3401339411 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564d0bfe5b0 con 0x5564d0cb3640 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f430a7fc640 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5564d0cb3640 0x5564d0ceff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f430a7fc640 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5564d0cb3640 0x5564d0ceff30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b481ea59a87c50b7 server_cookie=d129c373551a00ed in_seq=0 out_seq=0 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.874+0000 7f42e9ffb640 10 client.6114 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f42e9ffb640 1 -- 172.21.15.79:0/3401339411 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5564d0bfe5b0 con 0x5564d0cb3640 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f42e9ffb640 10 client.6114 handle_command_reply: tid=0 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 client.6114 shutdown 2024-06-10T00:18:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 -- 172.21.15.79:0/3401339411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 msgr2=0x5564d0cacc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0cacc20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f42fc088b10 tx=0x7f42fc05cd00 comp rx=0 tx=0).stop 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 -- 172.21.15.79:0/3401339411 shutdown_connections 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5564d0cb3640 0x5564d0ceff30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 0x5564d0cb9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cb46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f42e9ffb640 0 client.6114 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 --2- 172.21.15.79:0/3401339411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0cacc20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 -- 172.21.15.79:0/3401339411 >> 172.21.15.79:0/3401339411 conn(0x5564d0c8f6d0 msgr2=0x5564d0cafe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 -- 172.21.15.79:0/3401339411 shutdown_connections 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 1 -- 172.21.15.79:0/3401339411 wait complete. 2024-06-10T00:18:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.875+0000 7f43143de740 20 client.6114 trim_cache size 0 max 16384 2024-06-10T00:18:30.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.893+0000 7f43143de740 1 Processor -- start 2024-06-10T00:18:30.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.893+0000 7f43143de740 1 -- start start 2024-06-10T00:18:30.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f43143de740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cb4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f43143de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0c8e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f43143de740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 0x5564d0cb4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f43143de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f430c201190 con 0x5564d0cb0af0 2024-06-10T00:18:30.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f43143de740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f430c200170 con 0x5564d0cad8c0 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f43143de740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f430c0c8590 con 0x5564d0cb7c00 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0c8e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0c8e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58392/0 (socket says 172.21.15.79:58392) 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 -- 172.21.15.79:0/2741270572 learned_addr learned my addr 172.21.15.79:0/2741270572 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 -- 172.21.15.79:0/2741270572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 msgr2=0x5564d0cb4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 --2- 172.21.15.79:0/2741270572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 0x5564d0cb4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 -- 172.21.15.79:0/2741270572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 msgr2=0x5564d0cb4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 --2- 172.21.15.79:0/2741270572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cb4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 -- 172.21.15.79:0/2741270572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d08c40f0 con 0x5564d0cb0af0 2024-06-10T00:18:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f430a7fc640 1 --2- 172.21.15.79:0/2741270572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0c8e100 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4300000c00 tx=0x7f430002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3519a3a17860e7c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f42ebfff640 1 -- 172.21.15.79:0/2741270572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300037040 con 0x5564d0cb0af0 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.894+0000 7f42ebfff640 1 -- 172.21.15.79:0/2741270572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4300004030 con 0x5564d0cb0af0 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f42ebfff640 1 -- 172.21.15.79:0/2741270572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000043e0 con 0x5564d0cb0af0 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 -- 172.21.15.79:0/2741270572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 msgr2=0x5564d0c8e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 --2- 172.21.15.79:0/2741270572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0c8e100 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4300000c00 tx=0x7f430002c000 comp rx=0 tx=0).stop 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 -- 172.21.15.79:0/2741270572 shutdown_connections 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 --2- 172.21.15.79:0/2741270572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb7c00 0x5564d0cb4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 --2- 172.21.15.79:0/2741270572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb0af0 0x5564d0c8e100 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 --2- 172.21.15.79:0/2741270572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cb4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 -- 172.21.15.79:0/2741270572 >> 172.21.15.79:0/2741270572 conn(0x5564d0c8f6d0 msgr2=0x5564d0c83830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 -- 172.21.15.79:0/2741270572 shutdown_connections 2024-06-10T00:18:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.895+0000 7f43143de740 1 -- 172.21.15.79:0/2741270572 wait complete. 2024-06-10T00:18:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 1 -- start start 2024-06-10T00:18:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 1 Processor -- start 2024-06-10T00:18:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb0af0 0x5564d0cec540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb7c00 0x5564d0ca9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564d0cacff0 con 0x5564d0cb7c00 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f430c0b8ed0 con 0x5564d0cad8c0 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5564d0d47ea0 con 0x5564d0cb0af0 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.896+0000 7f43143de740 10 client.0 _ll_register_callbacks cb 0x7f42fc058f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb7c00 0x5564d0ca9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb7c00 0x5564d0ca9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58402/0 (socket says 172.21.15.79:58402) 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 -- 172.21.15.79:0/2544715723 learned_addr learned my addr 172.21.15.79:0/2544715723 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430affd640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430a7fc640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb0af0 0x5564d0cec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 -- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb0af0 msgr2=0x5564d0cec540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb0af0 0x5564d0cec540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 -- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 msgr2=0x5564d0cec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 -- 172.21.15.79:0/2544715723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d0bb7560 con 0x5564d0cb7c00 2024-06-10T00:18:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430affd640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430a7fc640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb0af0 0x5564d0cec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f430b7fe640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb7c00 0x5564d0ca9bf0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f430400b010 tx=0x7f4304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4b764fa15b9130 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f42e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f42e9ffb640 1 -- 172.21.15.79:0/2544715723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304015680 con 0x5564d0cb7c00 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f42e9ffb640 1 -- 172.21.15.79:0/2544715723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f4304015820 con 0x5564d0cb7c00 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f43143de740 1 -- 172.21.15.79:0/2544715723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4300004030 con 0x5564d0cb7c00 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f42e9ffb640 1 -- 172.21.15.79:0/2544715723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4304031050 con 0x5564d0cb7c00 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f43143de740 10 client.6120 fetch_fsmap learned FSMap version 31 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f43143de740 1 -- 172.21.15.79:0/2544715723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5564d0caedb0 con 0x5564d0cb7c00 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.897+0000 7f42e9ffb640 1 -- 172.21.15.79:0/2544715723 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4300004030 con 0x5564d0cb7c00 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f42e9ffb640 1 -- 172.21.15.79:0/2544715723 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) ==== 3494+0+0 (secure 0 0 0) 0x7f4304034020 con 0x5564d0cb7c00 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 10 client.6120 fetch_fsmap finished waiting for FSMap version 31 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 10 client.6120 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-06-10T00:18:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 20 client.6120 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5564d0cb04c0 0x5564d0caa130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 4 client.6120 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 -- 172.21.15.79:0/2544715723 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5564d0cb92b0 con 0x5564d0cb04c0 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f430affd640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5564d0cb04c0 0x5564d0caa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f430affd640 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5564d0cb04c0 0x5564d0caa130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fc8b30f63a619d4 server_cookie=e4ea9de13a9f82fc in_seq=0 out_seq=0 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f42e9ffb640 10 client.6120 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f42e9ffb640 1 -- 172.21.15.79:0/2544715723 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5564d0cb92b0 con 0x5564d0cb04c0 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f42e9ffb640 10 client.6120 handle_command_reply: tid=0 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 client.6120 shutdown 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 -- 172.21.15.79:0/2544715723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb7c00 msgr2=0x5564d0ca9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb7c00 0x5564d0ca9bf0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f430400b010 tx=0x7f4304004a40 comp rx=0 tx=0).stop 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 -- 172.21.15.79:0/2544715723 shutdown_connections 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d0cb7c00 0x5564d0ca9bf0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x5564d0cb04c0 0x5564d0caa130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d0cb0af0 0x5564d0cec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 --2- 172.21.15.79:0/2544715723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d0cad8c0 0x5564d0cec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f42e9ffb640 0 client.6120 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 -- 172.21.15.79:0/2544715723 >> 172.21.15.79:0/2544715723 conn(0x5564d0c8f6d0 msgr2=0x5564d0c87150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 -- 172.21.15.79:0/2544715723 shutdown_connections 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 1 -- 172.21.15.79:0/2544715723 wait complete. 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.898+0000 7f43143de740 20 client.6120 trim_cache size 0 max 16384 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:18:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:18:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:18:30.907 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:18:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 -- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42f806be30 msgr2=0x7f42f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42f806be30 0x7f42f806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4300034000 tx=0x7f430002e000 comp rx=0 tx=0).stop 2024-06-10T00:18:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 -- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f430c0b3800 msgr2=0x7f430c157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f430c0b3800 0x7f430c157350 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c3c0 tx=0x7f42fc00c880 comp rx=0 tx=0).stop 2024-06-10T00:18:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 -- 172.21.15.79:0/3633475306 shutdown_connections 2024-06-10T00:18:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f42f806be30 0x7f42f806e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f430c0d08f0 0x7f430c0c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430c0cf190 0x7f430c1f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 --2- 172.21.15.79:0/3633475306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f430c0b3800 0x7f430c157350 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 -- 172.21.15.79:0/3633475306 >> 172.21.15.79:0/3633475306 conn(0x7f430c09d3c0 msgr2=0x7f430c06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 -- 172.21.15.79:0/3633475306 shutdown_connections 2024-06-10T00:18:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:30.899+0000 7f43116d2640 1 -- 172.21.15.79:0/3633475306 wait complete. 2024-06-10T00:18:30.910 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:18:30.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:31.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.010+0000 7fa1e745d640 1 Processor -- start 2024-06-10T00:18:31.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.010+0000 7fa1e745d640 1 -- start start 2024-06-10T00:18:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e745d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1e00cd230 0x7fa1e00b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e745d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1e00cec50 0x7fa1e00cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e745d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e00b3420 con 0x7fa1e01553c0 2024-06-10T00:18:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e745d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e00cc750 con 0x7fa1e00cd230 2024-06-10T00:18:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e745d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e00cca30 con 0x7fa1e00cec50 2024-06-10T00:18:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e49f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1e00cd230 0x7fa1e00b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e51f9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa1e01553c0 0x7fa1e015beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60956/0 (socket says 172.21.15.79:60956) 2024-06-10T00:18:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e51f9640 1 -- 172.21.15.79:0/924862974 learned_addr learned my addr 172.21.15.79:0/924862974 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.011+0000 7fa1e49f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1e00cd230 0x7fa1e00b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58418/0 (socket says 172.21.15.79:58418) 2024-06-10T00:18:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1e49f8640 1 -- 172.21.15.79:0/924862974 >> v2:172.21.15.117:3300/0 conn(0x7fa1e00cec50 msgr2=0x7fa1e00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1e49f8640 1 --2- 172.21.15.79:0/924862974 >> v2:172.21.15.117:3300/0 conn(0x7fa1e00cec50 0x7fa1e00cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1e49f8640 1 -- 172.21.15.79:0/924862974 >> v1:172.21.15.79:6789/0 conn(0x7fa1e01553c0 legacy=0x7fa1e015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1d7fff640 1 -- 172.21.15.79:0/924862974 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131381050 0 0) 0x7fa1e00b3420 con 0x7fa1e01553c0 2024-06-10T00:18:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1e49f8640 1 -- 172.21.15.79:0/924862974 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e00ccd10 con 0x7fa1e00cd230 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1e49f8640 1 --2- 172.21.15.79:0/924862974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cd230 0x7fa1e00b2cf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00b41f0 tx=0x7fa1d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1929387f5e052b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1d7fff640 1 -- 172.21.15.79:0/924862974 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0037070 con 0x7fa1e00cd230 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1d7fff640 1 -- 172.21.15.79:0/924862974 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d0032440 con 0x7fa1e00cd230 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.012+0000 7fa1d7fff640 1 -- 172.21.15.79:0/924862974 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0032810 con 0x7fa1e00cd230 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.013+0000 7fa1e745d640 1 -- 172.21.15.79:0/924862974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cd230 msgr2=0x7fa1e00b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.013+0000 7fa1e745d640 1 --2- 172.21.15.79:0/924862974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cd230 0x7fa1e00b2cf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00b41f0 tx=0x7fa1d002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.013+0000 7fa1e745d640 1 -- 172.21.15.79:0/924862974 shutdown_connections 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.013+0000 7fa1e745d640 1 --2- 172.21.15.79:0/924862974 >> v2:172.21.15.117:3300/0 conn(0x7fa1e00cec50 0x7fa1e00cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.013+0000 7fa1e745d640 1 --2- 172.21.15.79:0/924862974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cd230 0x7fa1e00b2cf0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.013+0000 7fa1e745d640 1 -- 172.21.15.79:0/924862974 >> 172.21.15.79:0/924862974 conn(0x7fa1e00b19f0 msgr2=0x7fa1e00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.013+0000 7fa1e745d640 1 -- 172.21.15.79:0/924862974 shutdown_connections 2024-06-10T00:18:31.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.013+0000 7fa1e745d640 1 -- 172.21.15.79:0/924862974 wait complete. 2024-06-10T00:18:31.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.014+0000 7fa1e745d640 1 Processor -- start 2024-06-10T00:18:31.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.014+0000 7fa1e745d640 1 -- start start 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e745d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e00cd230 0x7fa1e0142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e745d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cec50 0x7fa1e009b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e745d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e01553c0 0x7fa1e01545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e745d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e0155920 con 0x7fa1e00cec50 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e745d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01557a0 con 0x7fa1e01553c0 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e745d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e0071030 con 0x7fa1e00cd230 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e49f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cec50 0x7fa1e009b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e49f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cec50 0x7fa1e009b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58432/0 (socket says 172.21.15.79:58432) 2024-06-10T00:18:31.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e49f8640 1 -- 172.21.15.79:0/260805040 learned_addr learned my addr 172.21.15.79:0/260805040 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e59fa640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e01553c0 0x7fa1e01545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e51f9640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e00cd230 0x7fa1e0142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e49f8640 1 -- 172.21.15.79:0/260805040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e00cd230 msgr2=0x7fa1e0142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e49f8640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e00cd230 0x7fa1e0142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e49f8640 1 -- 172.21.15.79:0/260805040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e01553c0 msgr2=0x7fa1e01545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e49f8640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e01553c0 0x7fa1e01545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.015+0000 7fa1e49f8640 1 -- 172.21.15.79:0/260805040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e0165c90 con 0x7fa1e00cec50 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.016+0000 7fa1e49f8640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cec50 0x7fa1e009b9b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0000c00 tx=0x7fa1d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.016+0000 7fa1d5ffb640 1 -- 172.21.15.79:0/260805040 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0041070 con 0x7fa1e00cec50 2024-06-10T00:18:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.016+0000 7fa1d5ffb640 1 -- 172.21.15.79:0/260805040 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d003c950 con 0x7fa1e00cec50 2024-06-10T00:18:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.016+0000 7fa1d5ffb640 1 -- 172.21.15.79:0/260805040 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0037040 con 0x7fa1e00cec50 2024-06-10T00:18:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.016+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e0166210 con 0x7fa1e00cec50 2024-06-10T00:18:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.016+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e01667d0 con 0x7fa1e00cec50 2024-06-10T00:18:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.017+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e0068430 con 0x7fa1e00cec50 2024-06-10T00:18:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.017+0000 7fa1d5ffb640 1 -- 172.21.15.79:0/260805040 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1d0044070 con 0x7fa1e00cec50 2024-06-10T00:18:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.018+0000 7fa1d5ffb640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c406be30 0x7fa1c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.018+0000 7fa1d5ffb640 1 -- 172.21.15.79:0/260805040 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fa1d00abea0 con 0x7fa1e00cec50 2024-06-10T00:18:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.018+0000 7fa1e51f9640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c406be30 0x7fa1c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.018+0000 7fa1e51f9640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c406be30 0x7fa1c406e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc000f60 tx=0x7fa1dc007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.022+0000 7fa1d5ffb640 1 -- 172.21.15.79:0/260805040 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa1d007a770 con 0x7fa1e00cec50 2024-06-10T00:18:31.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.232+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1e0165670 con 0x7fa1e00cec50 2024-06-10T00:18:31.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.233+0000 7fa1d5ffb640 1 -- 172.21.15.79:0/260805040 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5186 (secure 0 0 0) 0x7fa1d007a070 con 0x7fa1e00cec50 2024-06-10T00:18:31.232 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:31.232 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:18:05.792812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:18:31.233 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 31 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c406be30 msgr2=0x7fa1c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c406be30 0x7fa1c406e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc000f60 tx=0x7fa1dc007c00 comp rx=0 tx=0).stop 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cec50 msgr2=0x7fa1e009b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cec50 0x7fa1e009b9b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0000c00 tx=0x7fa1d00046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 shutdown_connections 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c406be30 0x7fa1c406e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e01553c0 0x7fa1e01545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e00cec50 0x7fa1e009b9b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 --2- 172.21.15.79:0/260805040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e00cd230 0x7fa1e0142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 >> 172.21.15.79:0/260805040 conn(0x7fa1e00b19f0 msgr2=0x7fa1e00ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 shutdown_connections 2024-06-10T00:18:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.235+0000 7fa1e745d640 1 -- 172.21.15.79:0/260805040 wait complete. 2024-06-10T00:18:31.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-06-10T00:18:31.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.346+0000 7f291cfa2640 1 Processor -- start 2024-06-10T00:18:31.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.346+0000 7f291cfa2640 1 -- start start 2024-06-10T00:18:31.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.347+0000 7f291cfa2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29180d08f0 0x7f29180b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.347+0000 7f291cfa2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29180cf8a0 con 0x7f29180d0cd0 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.347+0000 7f291cfa2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29180cfb80 con 0x7f29180cf360 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.347+0000 7f291cfa2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f29180d1c80 con 0x7f29180d08f0 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.347+0000 7f2915d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f29180d0cd0 0x7f29180cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60958/0 (socket says 172.21.15.79:60958) 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.347+0000 7f2915d9b640 1 -- 172.21.15.79:0/918572462 learned_addr learned my addr 172.21.15.79:0/918572462 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190429006 0 0) 0x7f29180cf8a0 con 0x7f29180d0cd0 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2904003520 con 0x7f29180d0cd0 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291659c640 1 --2- 172.21.15.79:0/918572462 >> v2:172.21.15.117:3300/0 conn(0x7f29180d08f0 0x7f29180b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2770812458 0 0) 0x7f2904003520 con 0x7f29180d0cd0 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 >> v2:172.21.15.117:3300/0 conn(0x7f29180d08f0 msgr2=0x7f29180b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 --2- 172.21.15.79:0/918572462 >> v2:172.21.15.117:3300/0 conn(0x7f29180d08f0 0x7f29180b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 >> v1:172.21.15.117:6789/0 conn(0x7f29180cf360 legacy=0x7f29180d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29180cfe60 con 0x7f29180d0cd0 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f2900001670 con 0x7f29180d0cd0 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 >> v1:172.21.15.79:6789/0 conn(0x7f29180d0cd0 legacy=0x7f29180cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29040039b0 0x7f2904003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2904004800 0x7f2904004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29040051c0 0x7f290400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29180d1c80 con 0x7f29040051c0 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f290400c060 con 0x7f2904004800 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f290400c260 con 0x7f29040039b0 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f2916d9d640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29040051c0 0x7f290400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f291659c640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29040039b0 0x7f2904003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f2915d9b640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2904004800 0x7f2904004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f2916d9d640 1 -- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29040039b0 msgr2=0x7f2904003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f2916d9d640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29040039b0 0x7f2904003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f2916d9d640 1 -- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2904004800 msgr2=0x7f2904004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f2916d9d640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2904004800 0x7f2904004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f2916d9d640 1 -- 172.21.15.79:0/918572462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2904003520 con 0x7f29040051c0 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.348+0000 7f2915d9b640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2904004800 0x7f2904004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.349+0000 7f2916d9d640 1 -- 172.21.15.79:0/918572462 reap_dead start 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.349+0000 7f2916d9d640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29040051c0 0x7f290400b9c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2910001750 tx=0x7f2904005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0008a0c66df579 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.349+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910001370 con 0x7f29040051c0 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.349+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2910005310 con 0x7f29040051c0 2024-06-10T00:18:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.349+0000 7f291559a640 1 -- 172.21.15.79:0/918572462 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291002abe0 con 0x7f29040051c0 2024-06-10T00:18:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.350+0000 7f291cfa2640 1 -- 172.21.15.79:0/918572462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29040051c0 msgr2=0x7f290400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.350+0000 7f291cfa2640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29040051c0 0x7f290400b9c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2910001750 tx=0x7f2904005830 comp rx=0 tx=0).stop 2024-06-10T00:18:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.350+0000 7f291cfa2640 1 -- 172.21.15.79:0/918572462 shutdown_connections 2024-06-10T00:18:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.350+0000 7f291cfa2640 1 --2- 172.21.15.79:0/918572462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29040051c0 0x7f290400b9c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.350+0000 7f291cfa2640 1 -- 172.21.15.79:0/918572462 >> 172.21.15.79:0/918572462 conn(0x7f291809d3c0 msgr2=0x7f29180d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.350+0000 7f291cfa2640 1 -- 172.21.15.79:0/918572462 shutdown_connections 2024-06-10T00:18:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.350+0000 7f291cfa2640 1 -- 172.21.15.79:0/918572462 wait complete. 2024-06-10T00:18:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.351+0000 7f291cfa2640 1 Processor -- start 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.351+0000 7f291cfa2640 1 -- start start 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f291cfa2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29040051c0 0x7f2918152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f291cfa2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2918155a20 0x7f291809ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f291cfa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29180a0520 0x7f29180c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f291cfa2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29180d1180 con 0x7f29180a0520 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f291cfa2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29180b50c0 con 0x7f29040051c0 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f291cfa2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29180b4a60 con 0x7f2918155a20 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29180a0520 0x7f29180c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29180a0520 0x7f29180c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58440/0 (socket says 172.21.15.79:58440) 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 -- 172.21.15.79:0/1283731953 learned_addr learned my addr 172.21.15.79:0/1283731953 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2915d9b640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2918155a20 0x7f291809ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f291659c640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29040051c0 0x7f2918152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 -- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2918155a20 msgr2=0x7f291809ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2918155a20 0x7f291809ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 -- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29040051c0 msgr2=0x7f2918152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29040051c0 0x7f2918152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 -- 172.21.15.79:0/1283731953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29180a0a30 con 0x7f29180a0520 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2915d9b640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2918155a20 0x7f291809ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f291659c640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29040051c0 0x7f2918152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.352+0000 7f2916d9d640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29180a0520 0x7f29180c94d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f291002a590 tx=0x7f2910001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.353+0000 7f290effd640 1 -- 172.21.15.79:0/1283731953 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910001370 con 0x7f29180a0520 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.353+0000 7f290effd640 1 -- 172.21.15.79:0/1283731953 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291002ae20 con 0x7f29180a0520 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.353+0000 7f291cfa2640 1 -- 172.21.15.79:0/1283731953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29180a0d10 con 0x7f29180a0520 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.353+0000 7f290effd640 1 -- 172.21.15.79:0/1283731953 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910007a30 con 0x7f29180a0520 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.353+0000 7f291cfa2640 1 -- 172.21.15.79:0/1283731953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29180a12d0 con 0x7f29180a0520 2024-06-10T00:18:31.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.355+0000 7f290effd640 1 -- 172.21.15.79:0/1283731953 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2910007030 con 0x7f29180a0520 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.355+0000 7f290effd640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28f806be30 0x7f28f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.355+0000 7f290effd640 1 -- 172.21.15.79:0/1283731953 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f29100aa300 con 0x7f29180a0520 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.355+0000 7f291659c640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28f806be30 0x7f28f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.355+0000 7f291659c640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28f806be30 0x7f28f806e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2908007440 tx=0x7f290800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.356+0000 7f291fd90740 1 Processor -- start 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.356+0000 7f291fd90740 1 -- start start 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291fd90740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a265c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291fd90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a265f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291fd90740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265f6a00 0x559a265cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291fd90740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559a2652fd80 con 0x559a26614020 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291fd90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559a264cd2f0 con 0x559a265f7140 2024-06-10T00:18:31.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291fd90740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559a2652bd40 con 0x559a265f6a00 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a265c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a265c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58446/0 (socket says 172.21.15.79:58446) 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 -- 172.21.15.79:0/4249485565 learned_addr learned my addr 172.21.15.79:0/4249485565 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f2916d9d640 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265f6a00 0x559a265cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f2915d9b640 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a265f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 -- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265f6a00 msgr2=0x559a265cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265f6a00 0x559a265cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 -- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 msgr2=0x559a265f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a265f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 -- 172.21.15.79:0/4249485565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a2630f7c0 con 0x559a26614020 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f2916d9d640 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265f6a00 0x559a265cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f2915d9b640 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a265f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f291659c640 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a265c69b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2908003d50 tx=0x7f2908015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4cc8d138f60236 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f28f7fff640 1 -- 172.21.15.79:0/4249485565 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908018880 con 0x559a26614020 2024-06-10T00:18:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f28f7fff640 1 -- 172.21.15.79:0/4249485565 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908018a20 con 0x559a26614020 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.357+0000 7f28f7fff640 1 -- 172.21.15.79:0/4249485565 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908018df0 con 0x559a26614020 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 -- 172.21.15.79:0/4249485565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 msgr2=0x559a265c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a265c69b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2908003d50 tx=0x7f2908015000 comp rx=0 tx=0).stop 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 -- 172.21.15.79:0/4249485565 shutdown_connections 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265f6a00 0x559a265cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a265f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 --2- 172.21.15.79:0/4249485565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a265c69b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 -- 172.21.15.79:0/4249485565 >> 172.21.15.79:0/4249485565 conn(0x559a265c8c20 msgr2=0x559a266114c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 -- 172.21.15.79:0/4249485565 shutdown_connections 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.358+0000 7f291fd90740 1 -- 172.21.15.79:0/4249485565 wait complete. 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.359+0000 7f291fd90740 1 -- start start 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.359+0000 7f291fd90740 1 Processor -- start 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.359+0000 7f291fd90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a26624b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.359+0000 7f291fd90740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a266114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291fd90740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26611a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291fd90740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559a265cadd0 con 0x559a26614020 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291fd90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559a264cada0 con 0x559a265f7140 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291fd90740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559a265ca1c0 con 0x559a265e3f60 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291fd90740 10 client.0 _ll_register_callbacks cb 0x559a26242ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a266114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a266114c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58460/0 (socket says 172.21.15.79:58460) 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 -- 172.21.15.79:0/3135595082 learned_addr learned my addr 172.21.15.79:0/3135595082 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2916d9d640 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26611a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291659c640 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a26624b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 -- 172.21.15.79:0/3135595082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 msgr2=0x559a26611a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26611a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 -- 172.21.15.79:0/3135595082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 msgr2=0x559a26624b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a26624b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 -- 172.21.15.79:0/3135595082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a2636ff50 con 0x559a26614020 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f2915d9b640 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a266114c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f29180caa80 tx=0x7f2900010920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5700e4ca9b5721e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f28f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f28f57fa640 1 -- 172.21.15.79:0/3135595082 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900013770 con 0x559a26614020 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f28f57fa640 1 -- 172.21.15.79:0/3135595082 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f2900013910 con 0x559a26614020 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291fd90740 1 -- 172.21.15.79:0/3135595082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2908018a20 con 0x559a26614020 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f28f57fa640 1 -- 172.21.15.79:0/3135595082 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2900005e10 con 0x559a26614020 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291fd90740 10 client.6141 fetch_fsmap learned FSMap version 31 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f291fd90740 1 -- 172.21.15.79:0/3135595082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x559a262030b0 con 0x559a26614020 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.360+0000 7f28f57fa640 1 -- 172.21.15.79:0/3135595082 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908018a20 con 0x559a26614020 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f28f57fa640 1 -- 172.21.15.79:0/3135595082 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) ==== 3494+0+0 (secure 0 0 0) 0x7f2900024080 con 0x559a26614020 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f291fd90740 10 client.6141 fetch_fsmap finished waiting for FSMap version 31 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f291fd90740 10 client.6141 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f291fd90740 20 client.6141 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f291fd90740 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x559a265f7c20 0x559a265f8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f291fd90740 4 client.6141 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f291fd90740 1 -- 172.21.15.79:0/3135595082 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a2653d4b0 con 0x559a265f7c20 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f291659c640 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x559a265f7c20 0x559a265f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f28f57fa640 10 client.6141 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.361+0000 7f291659c640 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x559a265f7c20 0x559a265f8000 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf72aeb1a69ac69 server_cookie=e9b4a95680e3f85d in_seq=0 out_seq=0 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f28f57fa640 1 -- 172.21.15.79:0/3135595082 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559a2653d4b0 con 0x559a265f7c20 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f28f57fa640 10 client.6141 handle_command_reply: tid=0 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 client.6141 shutdown 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 -- 172.21.15.79:0/3135595082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 msgr2=0x559a266114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a266114c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f29180caa80 tx=0x7f2900010920 comp rx=0 tx=0).stop 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 -- 172.21.15.79:0/3135595082 shutdown_connections 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x559a265f7c20 0x559a265f8000 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26611a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a266114c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 --2- 172.21.15.79:0/3135595082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a26624b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f28f57fa640 0 client.6141 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 -- 172.21.15.79:0/3135595082 >> 172.21.15.79:0/3135595082 conn(0x559a265f6a00 msgr2=0x559a265c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 -- 172.21.15.79:0/3135595082 shutdown_connections 2024-06-10T00:18:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 1 -- 172.21.15.79:0/3135595082 wait complete. 2024-06-10T00:18:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.362+0000 7f291fd90740 20 client.6141 trim_cache size 0 max 16384 2024-06-10T00:18:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f291fd90740 1 Processor -- start 2024-06-10T00:18:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f291fd90740 1 -- start start 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f291fd90740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26611420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f291fd90740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a265f7140 0x559a26611960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f291fd90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a26614020 0x559a265f1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f291fd90740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2918201670 con 0x559a265f7140 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f291fd90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2918200650 con 0x559a26614020 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f291fd90740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2918153a70 con 0x559a265e3f60 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f2915d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a265f7140 0x559a26611960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.376+0000 7f2915d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a265f7140 0x559a26611960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58464/0 (socket says 172.21.15.79:58464) 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f2915d9b640 1 -- 172.21.15.79:0/1049723624 learned_addr learned my addr 172.21.15.79:0/1049723624 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f291659c640 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26611420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f2916d9d640 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a26614020 0x559a265f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f2915d9b640 1 -- 172.21.15.79:0/1049723624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 msgr2=0x559a26611420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f2915d9b640 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26611420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f2915d9b640 1 -- 172.21.15.79:0/1049723624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a26614020 msgr2=0x559a265f1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f2915d9b640 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a26614020 0x559a265f1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f2915d9b640 1 -- 172.21.15.79:0/1049723624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a265c1440 con 0x559a265f7140 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f2915d9b640 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a265f7140 0x559a26611960 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2900014040 tx=0x7f2900009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8960bf8cb7fe9c92 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f28f77fe640 1 -- 172.21.15.79:0/1049723624 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900028070 con 0x559a265f7140 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f28f77fe640 1 -- 172.21.15.79:0/1049723624 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900019070 con 0x559a265f7140 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.377+0000 7f28f77fe640 1 -- 172.21.15.79:0/1049723624 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900013770 con 0x559a265f7140 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 -- 172.21.15.79:0/1049723624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a265f7140 msgr2=0x559a26611960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a265f7140 0x559a26611960 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2900014040 tx=0x7f2900009070 comp rx=0 tx=0).stop 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 -- 172.21.15.79:0/1049723624 shutdown_connections 2024-06-10T00:18:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a26614020 0x559a265f1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a265f7140 0x559a26611960 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 --2- 172.21.15.79:0/1049723624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26611420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 -- 172.21.15.79:0/1049723624 >> 172.21.15.79:0/1049723624 conn(0x559a265f6a00 msgr2=0x559a26624630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 -- 172.21.15.79:0/1049723624 shutdown_connections 2024-06-10T00:18:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 -- 172.21.15.79:0/1049723624 wait complete. 2024-06-10T00:18:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 -- start start 2024-06-10T00:18:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.378+0000 7f291fd90740 1 Processor -- start 2024-06-10T00:18:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f291fd90740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26690290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f291fd90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a26612560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f291fd90740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a26606e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f291fd90740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559a26608f60 con 0x559a26614020 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f291fd90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2918200090 con 0x559a265f7140 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f291fd90740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559a266088c0 con 0x559a265e3f60 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f291fd90740 10 client.0 _ll_register_callbacks cb 0x7f2900001de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f2916d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a26606e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f2916d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a26606e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58476/0 (socket says 172.21.15.79:58476) 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f2916d9d640 1 -- 172.21.15.79:0/800265352 learned_addr learned my addr 172.21.15.79:0/800265352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f2915d9b640 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a26612560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f291659c640 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26690290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f2916d9d640 1 -- 172.21.15.79:0/800265352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 msgr2=0x559a26690290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f2916d9d640 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26690290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f2916d9d640 1 -- 172.21.15.79:0/800265352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 msgr2=0x559a26612560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.379+0000 7f2916d9d640 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a26612560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f2916d9d640 1 -- 172.21.15.79:0/800265352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a265c6210 con 0x559a26614020 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f2916d9d640 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a26606e50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2910078340 tx=0x7f29100053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebdb4b556528185 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f28f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f28f57fa640 1 -- 172.21.15.79:0/800265352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291007c760 con 0x559a26614020 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f28f57fa640 1 -- 172.21.15.79:0/800265352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f2910004d90 con 0x559a26614020 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 1 -- 172.21.15.79:0/800265352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2900019070 con 0x559a26614020 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f28f57fa640 1 -- 172.21.15.79:0/800265352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2910080f90 con 0x559a26614020 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 10 client.6147 fetch_fsmap learned FSMap version 31 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 1 -- 172.21.15.79:0/800265352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x559a265cb3d0 con 0x559a26614020 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f28f57fa640 1 -- 172.21.15.79:0/800265352 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900019070 con 0x559a26614020 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f28f57fa640 1 -- 172.21.15.79:0/800265352 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) ==== 3494+0+0 (secure 0 0 0) 0x7f2910045030 con 0x559a26614020 2024-06-10T00:18:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 10 client.6147 fetch_fsmap finished waiting for FSMap version 31 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 10 client.6147 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 20 client.6147 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x559a26614740 0x559a26614b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 4 client.6147 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291fd90740 1 -- 172.21.15.79:0/800265352 --> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x559a26537800 con 0x559a26614740 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.380+0000 7f291659c640 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x559a26614740 0x559a26614b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f28f57fa640 10 client.6147 ms_handle_connect on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291659c640 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x559a26614740 0x559a26614b20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488b42efbb8338bd server_cookie=bd4839ddac802385 in_seq=0 out_seq=0 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f28f57fa640 1 -- 172.21.15.79:0/800265352 <== mds.0 v2:172.21.15.79:6835/3634814301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a26537800 con 0x559a26614740 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f28f57fa640 10 client.6147 handle_command_reply: tid=0 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 client.6147 shutdown 2024-06-10T00:18:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 -- 172.21.15.79:0/800265352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 msgr2=0x559a26606e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a26606e50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2910078340 tx=0x7f29100053d0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 -- 172.21.15.79:0/800265352 shutdown_connections 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559a26614020 0x559a26606e50 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559a265f7140 0x559a26612560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.79:6835/3634814301,v1:172.21.15.79:6837/3634814301] conn(0x559a26614740 0x559a26614b20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 --2- 172.21.15.79:0/800265352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559a265e3f60 0x559a26690290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 -- 172.21.15.79:0/800265352 >> 172.21.15.79:0/800265352 conn(0x559a265f6a00 msgr2=0x559a265cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f28f57fa640 0 client.6147 ms_handle_reset on v2:172.21.15.79:6835/3634814301 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 -- 172.21.15.79:0/800265352 shutdown_connections 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 1 -- 172.21.15.79:0/800265352 wait complete. 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.381+0000 7f291fd90740 20 client.6147 trim_cache size 0 max 16384 2024-06-10T00:18:31.387 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:31.388 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-06-10T00:18:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 -- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28f806be30 msgr2=0x7f28f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28f806be30 0x7f28f806e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2908007440 tx=0x7f290800b040 comp rx=0 tx=0).stop 2024-06-10T00:18:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 -- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29180a0520 msgr2=0x7f29180c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29180a0520 0x7f29180c94d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f291002a590 tx=0x7f2910001120 comp rx=0 tx=0).stop 2024-06-10T00:18:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 -- 172.21.15.79:0/1283731953 shutdown_connections 2024-06-10T00:18:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28f806be30 0x7f28f806e2f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29180a0520 0x7f29180c94d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2918155a20 0x7f291809ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 --2- 172.21.15.79:0/1283731953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29040051c0 0x7f2918152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 -- 172.21.15.79:0/1283731953 >> 172.21.15.79:0/1283731953 conn(0x7f291809d3c0 msgr2=0x7f291806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 -- 172.21.15.79:0/1283731953 shutdown_connections 2024-06-10T00:18:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.382+0000 7f291cfa2640 1 -- 172.21.15.79:0/1283731953 wait complete. 2024-06-10T00:18:31.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-10T00:18:31.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.490+0000 7fa4e7748640 1 Processor -- start 2024-06-10T00:18:31.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.490+0000 7fa4e7748640 1 -- start start 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e7748640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4e01553c0 0x7fa4e00cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e7748640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e00cec50 0x7fa4e00cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e7748640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4e00b31a0 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e7748640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e00b3420 con 0x7fa4e01553c0 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e7748640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00cc750 con 0x7fa4e00cec50 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e54e4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4e01553c0 0x7fa4e00cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e54e4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4e01553c0 0x7fa4e00cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58484/0 (socket says 172.21.15.79:58484) 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e54e4640 1 -- 172.21.15.79:0/2215296009 learned_addr learned my addr 172.21.15.79:0/2215296009 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e54e4640 1 -- 172.21.15.79:0/2215296009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e00cec50 msgr2=0x7fa4e00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e5ce5640 1 --2- 172.21.15.79:0/2215296009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e00cec50 0x7fa4e00cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e54e4640 1 --2- 172.21.15.79:0/2215296009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e00cec50 0x7fa4e00cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e54e4640 1 -- 172.21.15.79:0/2215296009 >> v1:172.21.15.117:6789/0 conn(0x7fa4e00b2cf0 legacy=0x7fa4e015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.491+0000 7fa4e54e4640 1 -- 172.21.15.79:0/2215296009 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e00cca30 con 0x7fa4e01553c0 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.492+0000 7fa4e54e4640 1 --2- 172.21.15.79:0/2215296009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e01553c0 0x7fa4e00cd230 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009870 tx=0x7fa4d802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632e2fb64dc59a96 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.492+0000 7fa4dffff640 1 -- 172.21.15.79:0/2215296009 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8037070 con 0x7fa4e01553c0 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.492+0000 7fa4dffff640 1 -- 172.21.15.79:0/2215296009 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d8032440 con 0x7fa4e01553c0 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.492+0000 7fa4dffff640 1 -- 172.21.15.79:0/2215296009 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8032810 con 0x7fa4e01553c0 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.493+0000 7fa4e7748640 1 -- 172.21.15.79:0/2215296009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e01553c0 msgr2=0x7fa4e00cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.493+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2215296009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e01553c0 0x7fa4e00cd230 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009870 tx=0x7fa4d802a210 comp rx=0 tx=0).stop 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.493+0000 7fa4e7748640 1 -- 172.21.15.79:0/2215296009 shutdown_connections 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.493+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2215296009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e00cec50 0x7fa4e00cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.493+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2215296009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e01553c0 0x7fa4e00cd230 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.493+0000 7fa4e7748640 1 -- 172.21.15.79:0/2215296009 >> 172.21.15.79:0/2215296009 conn(0x7fa4e00b19f0 msgr2=0x7fa4e00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.493+0000 7fa4e7748640 1 -- 172.21.15.79:0/2215296009 shutdown_connections 2024-06-10T00:18:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.493+0000 7fa4e7748640 1 -- 172.21.15.79:0/2215296009 wait complete. 2024-06-10T00:18:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.494+0000 7fa4e7748640 1 Processor -- start 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.494+0000 7fa4e7748640 1 -- start start 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e7748640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00b2cf0 0x7fa4e0143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e7748640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4e00cec50 0x7fa4e0143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e7748640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e01553c0 0x7fa4e01453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e7748640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e01557a0 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e7748640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00b3700 con 0x7fa4e00cec50 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e7748640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e0155920 con 0x7fa4e01553c0 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00b2cf0 0x7fa4e0143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00b2cf0 0x7fa4e0143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58494/0 (socket says 172.21.15.79:58494) 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 -- 172.21.15.79:0/2371217722 learned_addr learned my addr 172.21.15.79:0/2371217722 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e5ce5640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e01553c0 0x7fa4e01453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 -- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e01553c0 msgr2=0x7fa4e01453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e01553c0 0x7fa4e01453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 -- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4e00cec50 msgr2=0x7fa4e0143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e4ce3640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4e00cec50 0x7fa4e0143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4e00cec50 0x7fa4e0143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 -- 172.21.15.79:0/2371217722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e0144320 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e5ce5640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e01553c0 0x7fa4e01453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e4ce3640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4e00cec50 0x7fa4e0143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e54e4640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00b2cf0 0x7fa4e0143c20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009870 tx=0x7fa4d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4ddffb640 1 -- 172.21.15.79:0/2371217722 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8041020 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4ddffb640 1 -- 172.21.15.79:0/2371217722 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d8030970 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e0144600 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.495+0000 7fa4ddffb640 1 -- 172.21.15.79:0/2371217722 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8037040 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.496+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e0144bc0 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.497+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e006c750 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.497+0000 7fa4ddffb640 1 -- 172.21.15.79:0/2371217722 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4d8044020 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.498+0000 7fa4ddffb640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4cc06be30 0x7fa4cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.498+0000 7fa4e4ce3640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4cc06be30 0x7fa4cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.498+0000 7fa4ddffb640 1 -- 172.21.15.79:0/2371217722 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fa4d80abab0 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.498+0000 7fa4e4ce3640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4cc06be30 0x7fa4cc06e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0152c90 tx=0x7fa4d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.502+0000 7fa4ddffb640 1 -- 172.21.15.79:0/2371217722 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa4e006c750 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.711+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa4e0068430 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.711+0000 7fa4ddffb640 1 -- 172.21.15.79:0/2371217722 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa4d804b030 con 0x7fa4e00b2cf0 2024-06-10T00:18:31.711 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:31.711 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4cc06be30 msgr2=0x7fa4cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4cc06be30 0x7fa4cc06e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0152c90 tx=0x7fa4d4008040 comp rx=0 tx=0).stop 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00b2cf0 msgr2=0x7fa4e0143c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00b2cf0 0x7fa4e0143c20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009870 tx=0x7fa4d80046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 shutdown_connections 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa4cc06be30 0x7fa4cc06e2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4e01553c0 0x7fa4e01453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4e00cec50 0x7fa4e0143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 --2- 172.21.15.79:0/2371217722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4e00b2cf0 0x7fa4e0143c20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 >> 172.21.15.79:0/2371217722 conn(0x7fa4e00b19f0 msgr2=0x7fa4e0072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 shutdown_connections 2024-06-10T00:18:31.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.713+0000 7fa4e7748640 1 -- 172.21.15.79:0/2371217722 wait complete. 2024-06-10T00:18:31.723 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-06-10T00:18:31.723 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:18:31.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:18:31.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:18:31.805 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:18:31.806 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:18:31.806 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:18:31.806 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:31.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:18:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.963+0000 7f95cdfa9640 1 Processor -- start 2024-06-10T00:18:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.963+0000 7f95cdfa9640 1 -- start start 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95cdfa9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c809aa10 0x7f95c809ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95cdfa9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95c815c550 0x7f95c815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95cdfa9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c815cf20 con 0x7f95c8159d80 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95cdfa9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f95c80b50c0 con 0x7f95c815c550 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95cdfa9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95c815d1a0 con 0x7f95c809aa10 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95c815c550 0x7f95c815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f95c8159d80 0x7f95c80d2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60970/0 (socket says 172.21.15.79:60970) 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95c815c550 0x7f95c815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58506/0 (socket says 172.21.15.79:58506) 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c77fe640 1 -- 172.21.15.79:0/4116111308 learned_addr learned my addr 172.21.15.79:0/4116111308 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c7fff640 1 -- 172.21.15.79:0/4116111308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c809aa10 msgr2=0x7f95c809ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c6ffd640 1 --2- 172.21.15.79:0/4116111308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c809aa10 0x7f95c809ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c7fff640 1 --2- 172.21.15.79:0/4116111308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c809aa10 0x7f95c809ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c67fc640 1 -- 172.21.15.79:0/4116111308 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725834832 0 0) 0x7f95b8001110 con 0x7f95c8159d80 2024-06-10T00:18:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c7fff640 1 -- 172.21.15.79:0/4116111308 >> v1:172.21.15.79:6789/0 conn(0x7f95c8159d80 legacy=0x7f95c80d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.964+0000 7f95c7fff640 1 -- 172.21.15.79:0/4116111308 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c815d480 con 0x7f95c815c550 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95c7fff640 1 --2- 172.21.15.79:0/4116111308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c815c9e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009d90 tx=0x7f95c002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135dbb7d9009c04b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95c67fc640 1 -- 172.21.15.79:0/4116111308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0031600 con 0x7f95c815c550 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95c67fc640 1 -- 172.21.15.79:0/4116111308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c00317a0 con 0x7f95c815c550 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95c67fc640 1 -- 172.21.15.79:0/4116111308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0031b70 con 0x7f95c815c550 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95cdfa9640 1 -- 172.21.15.79:0/4116111308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 msgr2=0x7f95c815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/4116111308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c815c9e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009d90 tx=0x7f95c002a5d0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95cdfa9640 1 -- 172.21.15.79:0/4116111308 shutdown_connections 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/4116111308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c815c9e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/4116111308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c809aa10 0x7f95c809ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95cdfa9640 1 -- 172.21.15.79:0/4116111308 >> 172.21.15.79:0/4116111308 conn(0x7f95c80b7270 msgr2=0x7f95c80b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95cdfa9640 1 -- 172.21.15.79:0/4116111308 shutdown_connections 2024-06-10T00:18:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.965+0000 7f95cdfa9640 1 -- 172.21.15.79:0/4116111308 wait complete. 2024-06-10T00:18:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.967+0000 7f95cdfa9640 1 Processor -- start 2024-06-10T00:18:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.967+0000 7f95cdfa9640 1 -- start start 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.967+0000 7f95cdfa9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c809aa10 0x7f95c80b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.967+0000 7f95cdfa9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c81f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.967+0000 7f95cdfa9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c81f2870 0x7f95c8146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.967+0000 7f95cdfa9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80d2160 con 0x7f95c815c550 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.967+0000 7f95cdfa9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80d1e80 con 0x7f95c809aa10 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.967+0000 7f95cdfa9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95c80b1d20 con 0x7f95c81f2870 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c81f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c81f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58510/0 (socket says 172.21.15.79:58510) 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 -- 172.21.15.79:0/3963929857 learned_addr learned my addr 172.21.15.79:0/3963929857 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c7fff640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c81f2870 0x7f95c8146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c77fe640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c809aa10 0x7f95c80b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 -- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c81f2870 msgr2=0x7f95c8146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c81f2870 0x7f95c8146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 -- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c809aa10 msgr2=0x7f95c80b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c809aa10 0x7f95c80b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 -- 172.21.15.79:0/3963929857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81f2d00 con 0x7f95c815c550 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c7fff640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c81f2870 0x7f95c8146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95c6ffd640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c81f2330 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c7f0 tx=0x7f95bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95affff640 1 -- 172.21.15.79:0/3963929857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc015070 con 0x7f95c815c550 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95affff640 1 -- 172.21.15.79:0/3963929857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc004240 con 0x7f95c815c550 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95affff640 1 -- 172.21.15.79:0/3963929857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc003610 con 0x7f95c815c550 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c80b0890 con 0x7f95c815c550 2024-06-10T00:18:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.968+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c80b0e50 con 0x7f95c815c550 2024-06-10T00:18:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.970+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c8068ad0 con 0x7f95c815c550 2024-06-10T00:18:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.970+0000 7f95affff640 1 -- 172.21.15.79:0/3963929857 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95bc0039c0 con 0x7f95c815c550 2024-06-10T00:18:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.970+0000 7f95affff640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95b406be30 0x7f95b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.970+0000 7f95affff640 1 -- 172.21.15.79:0/3963929857 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f95bc08b4b0 con 0x7f95c815c550 2024-06-10T00:18:31.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.970+0000 7f95c77fe640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95b406be30 0x7f95b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:31.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.971+0000 7f95c77fe640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95b406be30 0x7f95b406e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000f60 tx=0x7f95b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:31.975+0000 7f95affff640 1 -- 172.21.15.79:0/3963929857 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f95bc059c60 con 0x7f95c815c550 2024-06-10T00:18:32.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.161+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95c80b1b00 con 0x7f95c815c550 2024-06-10T00:18:32.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.162+0000 7f95affff640 1 -- 172.21.15.79:0/3963929857 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) ==== 80+0+0 (secure 0 0 0) 0x7f95bc059560 con 0x7f95c815c550 2024-06-10T00:18:32.162 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:18:32.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95b406be30 msgr2=0x7f95b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95b406be30 0x7f95b406e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000f60 tx=0x7f95b8009040 comp rx=0 tx=0).stop 2024-06-10T00:18:32.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 msgr2=0x7f95c81f2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c81f2330 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c7f0 tx=0x7f95bc00ccb0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 shutdown_connections 2024-06-10T00:18:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f95b406be30 0x7f95b406e2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95c81f2870 0x7f95c8146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c815c550 0x7f95c81f2330 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 --2- 172.21.15.79:0/3963929857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c809aa10 0x7f95c80b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 >> 172.21.15.79:0/3963929857 conn(0x7f95c80b7270 msgr2=0x7f95c8155dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 shutdown_connections 2024-06-10T00:18:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.164+0000 7f95cdfa9640 1 -- 172.21.15.79:0/3963929857 wait complete. 2024-06-10T00:18:32.174 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:18:32.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:32.175 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:32.198 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[56910]: fuse finished with error 0 and tester_r 0 2024-06-10T00:18:32.200 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:18:32.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:32.200 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:18:32.314 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:18:32.314 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:18:32.314 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:32.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:18:32.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:18:32.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:32.332 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-10T00:18:32.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:18:32.388 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-10T00:18:32.389 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:18:32.389 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:18:32.389 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:32.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:18:32.405 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:18:32.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:32.405 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-10T00:18:32.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:18:32.461 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-10T00:18:32.461 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:18:32.461 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:18:32.461 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:32.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:18:32.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:18:32.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:32.479 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-10T00:18:32.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:18:32.535 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-10T00:18:32.535 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:32.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.634+0000 7f5dd3cd4640 1 Processor -- start 2024-06-10T00:18:32.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.635+0000 7f5dd3cd4640 1 -- start start 2024-06-10T00:18:32.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.635+0000 7f5dd3cd4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5dcc15f1a0 0x7f5dcc0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.635+0000 7f5dd3cd4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0cef70 0x7f5dcc0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.635+0000 7f5dd3cd4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dcc15f5e0 con 0x7f5dcc0d2680 2024-06-10T00:18:32.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.635+0000 7f5dd3cd4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5dcc0d13e0 con 0x7f5dcc15f1a0 2024-06-10T00:18:32.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.635+0000 7f5dd3cd4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc0d0ad0 con 0x7f5dcc0cef70 2024-06-10T00:18:32.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd126f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5dcc15f1a0 0x7f5dcc0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd2271640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0cef70 0x7f5dcc0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd1a70640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5dcc0d2680 0x7f5dcc0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:53962/0 (socket says 172.21.15.79:53962) 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd126f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5dcc15f1a0 0x7f5dcc0d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:46454/0 (socket says 172.21.15.79:46454) 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd2271640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0cef70 0x7f5dcc0cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:51398/0 (socket says 172.21.15.79:51398) 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd1a70640 1 -- 172.21.15.79:0/2058831944 learned_addr learned my addr 172.21.15.79:0/2058831944 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd126f640 1 -- 172.21.15.79:0/2058831944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0cef70 msgr2=0x7f5dcc0cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd126f640 1 --2- 172.21.15.79:0/2058831944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0cef70 0x7f5dcc0cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd126f640 1 -- 172.21.15.79:0/2058831944 >> v1:172.21.15.117:6789/0 conn(0x7f5dcc0d2680 legacy=0x7f5dcc0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd126f640 1 -- 172.21.15.79:0/2058831944 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc15f890 con 0x7f5dcc15f1a0 2024-06-10T00:18:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.636+0000 7f5dd2271640 1 --2- 172.21.15.79:0/2058831944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0cef70 0x7f5dcc0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:32.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.637+0000 7f5dd126f640 1 --2- 172.21.15.79:0/2058831944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 0x7f5dcc0d1fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00097a0 tx=0x7f5dc002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5422d4a2a4e1fb5f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:32.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.637+0000 7f5dd0a6e640 1 -- 172.21.15.79:0/2058831944 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0037070 con 0x7f5dcc15f1a0 2024-06-10T00:18:32.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.637+0000 7f5dd0a6e640 1 -- 172.21.15.79:0/2058831944 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc0032440 con 0x7f5dcc15f1a0 2024-06-10T00:18:32.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.637+0000 7f5dd0a6e640 1 -- 172.21.15.79:0/2058831944 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0032810 con 0x7f5dcc15f1a0 2024-06-10T00:18:32.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.638+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/2058831944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 msgr2=0x7f5dcc0d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.638+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/2058831944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 0x7f5dcc0d1fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00097a0 tx=0x7f5dc002a180 comp rx=0 tx=0).stop 2024-06-10T00:18:32.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.638+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/2058831944 shutdown_connections 2024-06-10T00:18:32.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.638+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/2058831944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0cef70 0x7f5dcc0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.638+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/2058831944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 0x7f5dcc0d1fc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.638+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/2058831944 >> 172.21.15.79:0/2058831944 conn(0x7f5dcc09d3f0 msgr2=0x7f5dcc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.638+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/2058831944 shutdown_connections 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.638+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/2058831944 wait complete. 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.639+0000 7f5dd3cd4640 1 Processor -- start 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.639+0000 7f5dd3cd4640 1 -- start start 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd3cd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dcc0cef70 0x7f5dcc1f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd3cd4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0d2680 0x7f5dcc0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd3cd4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 0x7f5dcc15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd3cd4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0d4f00 con 0x7f5dcc0cef70 2024-06-10T00:18:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd3cd4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0d1070 con 0x7f5dcc15f1a0 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd3cd4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc0d1870 con 0x7f5dcc0d2680 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dcc0cef70 0x7f5dcc1f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dcc0cef70 0x7f5dcc1f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58522/0 (socket says 172.21.15.79:58522) 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 -- 172.21.15.79:0/123408957 learned_addr learned my addr 172.21.15.79:0/123408957 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd126f640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0d2680 0x7f5dcc0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd2271640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 0x7f5dcc15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 -- 172.21.15.79:0/123408957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0d2680 msgr2=0x7f5dcc0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0d2680 0x7f5dcc0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 -- 172.21.15.79:0/123408957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 msgr2=0x7f5dcc15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 0x7f5dcc15d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 -- 172.21.15.79:0/123408957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc1f8410 con 0x7f5dcc0cef70 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd1a70640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dcc0cef70 0x7f5dcc1f7e30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00cb40 tx=0x7f5dbc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:32.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dca7fc640 1 -- 172.21.15.79:0/123408957 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc017070 con 0x7f5dcc0cef70 2024-06-10T00:18:32.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dca7fc640 1 -- 172.21.15.79:0/123408957 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00ac30 con 0x7f5dcc0cef70 2024-06-10T00:18:32.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc1f86f0 con 0x7f5dcc0cef70 2024-06-10T00:18:32.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dca7fc640 1 -- 172.21.15.79:0/123408957 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc012620 con 0x7f5dcc0cef70 2024-06-10T00:18:32.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.640+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc1f8cb0 con 0x7f5dcc0cef70 2024-06-10T00:18:32.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.641+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc068430 con 0x7f5dcc0cef70 2024-06-10T00:18:32.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.642+0000 7f5dca7fc640 1 -- 172.21.15.79:0/123408957 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dbc01a070 con 0x7f5dcc0cef70 2024-06-10T00:18:32.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.642+0000 7f5dca7fc640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.643+0000 7f5dca7fc640 1 -- 172.21.15.79:0/123408957 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f5dbc08ac10 con 0x7f5dcc0cef70 2024-06-10T00:18:32.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.643+0000 7f5dd126f640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.643+0000 7f5dd126f640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5db806be30 0x7f5db806e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0034000 tx=0x7f5dc002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:32.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.647+0000 7f5dca7fc640 1 -- 172.21.15.79:0/123408957 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5dbc00ae20 con 0x7f5dcc0cef70 2024-06-10T00:18:32.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.854+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dcc0d04e0 con 0x7f5dcc0cef70 2024-06-10T00:18:32.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.855+0000 7f5dca7fc640 1 -- 172.21.15.79:0/123408957 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5186 (secure 0 0 0) 0x7f5dbc058e00 con 0x7f5dcc0cef70 2024-06-10T00:18:32.855 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:32.855 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:18:05.792812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:18:32.855 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 31 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5db806be30 msgr2=0x7f5db806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5db806be30 0x7f5db806e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0034000 tx=0x7f5dc002e000 comp rx=0 tx=0).stop 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dcc0cef70 msgr2=0x7f5dcc1f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dcc0cef70 0x7f5dcc1f7e30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00cb40 tx=0x7f5dbc00cf40 comp rx=0 tx=0).stop 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 shutdown_connections 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dcc15f1a0 0x7f5dcc15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dcc0d2680 0x7f5dcc0cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 --2- 172.21.15.79:0/123408957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dcc0cef70 0x7f5dcc1f7e30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 >> 172.21.15.79:0/123408957 conn(0x7f5dcc09d3f0 msgr2=0x7f5dcc0c83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:32.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 shutdown_connections 2024-06-10T00:18:32.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.857+0000 7f5dd3cd4640 1 -- 172.21.15.79:0/123408957 wait complete. 2024-06-10T00:18:32.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:32.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.967+0000 7fdbaa577640 1 Processor -- start 2024-06-10T00:18:32.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.967+0000 7fdbaa577640 1 -- start start 2024-06-10T00:18:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.968+0000 7fdbaa577640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdba415f970 0x7fdba409aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.968+0000 7fdbaa577640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdba40703f0 0x7fdba409af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.968+0000 7fdbaa577640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba415fd50 con 0x7fdba40711b0 2024-06-10T00:18:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.968+0000 7fdbaa577640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdba409b9c0 con 0x7fdba415f970 2024-06-10T00:18:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.968+0000 7fdbaa577640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdba40d06c0 con 0x7fdba40703f0 2024-06-10T00:18:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.968+0000 7fdba3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdba415f970 0x7fdba409aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.968+0000 7fdba3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdba415f970 0x7fdba409aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58530/0 (socket says 172.21.15.79:58530) 2024-06-10T00:18:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.968+0000 7fdba3fff640 1 -- 172.21.15.79:0/4188806455 learned_addr learned my addr 172.21.15.79:0/4188806455 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.969+0000 7fdba3fff640 1 -- 172.21.15.79:0/4188806455 >> v2:172.21.15.117:3300/0 conn(0x7fdba40703f0 msgr2=0x7fdba409af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.969+0000 7fdba3fff640 1 --2- 172.21.15.79:0/4188806455 >> v2:172.21.15.117:3300/0 conn(0x7fdba40703f0 0x7fdba409af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.969+0000 7fdba3fff640 1 -- 172.21.15.79:0/4188806455 >> v1:172.21.15.117:6789/0 conn(0x7fdba40711b0 legacy=0x7fdba40cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.969+0000 7fdba3fff640 1 -- 172.21.15.79:0/4188806455 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba40708e0 con 0x7fdba415f970 2024-06-10T00:18:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.969+0000 7fdba3fff640 1 --2- 172.21.15.79:0/4188806455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba415f970 0x7fdba409aa10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdba4072580 tx=0x7fdb9402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352f69eca2e95db7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdba2ffd640 1 -- 172.21.15.79:0/4188806455 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94037070 con 0x7fdba415f970 2024-06-10T00:18:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdba2ffd640 1 -- 172.21.15.79:0/4188806455 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb94032440 con 0x7fdba415f970 2024-06-10T00:18:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdba2ffd640 1 -- 172.21.15.79:0/4188806455 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94032810 con 0x7fdba415f970 2024-06-10T00:18:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdbaa577640 1 -- 172.21.15.79:0/4188806455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba415f970 msgr2=0x7fdba409aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdbaa577640 1 --2- 172.21.15.79:0/4188806455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba415f970 0x7fdba409aa10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdba4072580 tx=0x7fdb9402a230 comp rx=0 tx=0).stop 2024-06-10T00:18:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdbaa577640 1 -- 172.21.15.79:0/4188806455 shutdown_connections 2024-06-10T00:18:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdbaa577640 1 --2- 172.21.15.79:0/4188806455 >> v2:172.21.15.117:3300/0 conn(0x7fdba40703f0 0x7fdba409af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdbaa577640 1 --2- 172.21.15.79:0/4188806455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba415f970 0x7fdba409aa10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdbaa577640 1 -- 172.21.15.79:0/4188806455 >> 172.21.15.79:0/4188806455 conn(0x7fdba40d1eb0 msgr2=0x7fdba40d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdbaa577640 1 -- 172.21.15.79:0/4188806455 shutdown_connections 2024-06-10T00:18:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.970+0000 7fdbaa577640 1 -- 172.21.15.79:0/4188806455 wait complete. 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.971+0000 7fdbaa577640 1 Processor -- start 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.971+0000 7fdbaa577640 1 -- start start 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdbaa577640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba40703f0 0x7fdba41e6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdbaa577640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba40711b0 0x7fdba4159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdbaa577640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba415f970 0x7fdba40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdbaa577640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4070d00 con 0x7fdba40703f0 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdbaa577640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdba409b490 con 0x7fdba40711b0 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdbaa577640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdba4070e80 con 0x7fdba415f970 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba40703f0 0x7fdba41e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba40703f0 0x7fdba41e6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58538/0 (socket says 172.21.15.79:58538) 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdba3fff640 1 -- 172.21.15.79:0/1618499796 learned_addr learned my addr 172.21.15.79:0/1618499796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdba37fe640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba40711b0 0x7fdba4159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.972+0000 7fdba8b14640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba415f970 0x7fdba40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba3fff640 1 -- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba415f970 msgr2=0x7fdba40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba3fff640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba415f970 0x7fdba40cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba3fff640 1 -- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba40711b0 msgr2=0x7fdba4159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba3fff640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba40711b0 0x7fdba4159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba3fff640 1 -- 172.21.15.79:0/1618499796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba40cade0 con 0x7fdba40703f0 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba8b14640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba415f970 0x7fdba40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba3fff640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba40703f0 0x7fdba41e6950 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdb94000c00 tx=0x7fdb940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba0ff9640 1 -- 172.21.15.79:0/1618499796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94041070 con 0x7fdba40703f0 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba0ff9640 1 -- 172.21.15.79:0/1618499796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb9403c870 con 0x7fdba40703f0 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdba0ff9640 1 -- 172.21.15.79:0/1618499796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94037040 con 0x7fdba40703f0 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba40c9120 con 0x7fdba40703f0 2024-06-10T00:18:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.973+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba40c96e0 con 0x7fdba40703f0 2024-06-10T00:18:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.974+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba4068430 con 0x7fdba40703f0 2024-06-10T00:18:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.974+0000 7fdba0ff9640 1 -- 172.21.15.79:0/1618499796 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb94044070 con 0x7fdba40703f0 2024-06-10T00:18:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.975+0000 7fdba0ff9640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb9006be30 0x7fdb9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.975+0000 7fdba0ff9640 1 -- 172.21.15.79:0/1618499796 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7fdb940abd40 con 0x7fdba40703f0 2024-06-10T00:18:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.975+0000 7fdba37fe640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb9006be30 0x7fdb9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.975+0000 7fdba37fe640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb9006be30 0x7fdb9006e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdba40a0040 tx=0x7fdb98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:32.979+0000 7fdba0ff9640 1 -- 172.21.15.79:0/1618499796 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdba415fd50 con 0x7fdba40703f0 2024-06-10T00:18:33.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.187+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdba40cf5e0 con 0x7fdba40703f0 2024-06-10T00:18:33.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.187+0000 7fdba0ff9640 1 -- 172.21.15.79:0/1618499796 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5186 (secure 0 0 0) 0x7fdb9407a050 con 0x7fdba40703f0 2024-06-10T00:18:33.187 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:33.187 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:18:05.792812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:18:33.188 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 31 2024-06-10T00:18:33.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb9006be30 msgr2=0x7fdb9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb9006be30 0x7fdb9006e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdba40a0040 tx=0x7fdb98009040 comp rx=0 tx=0).stop 2024-06-10T00:18:33.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba40703f0 msgr2=0x7fdba41e6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba40703f0 0x7fdba41e6950 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdb94000c00 tx=0x7fdb940046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 shutdown_connections 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb9006be30 0x7fdb9006e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba415f970 0x7fdba40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba40711b0 0x7fdba4159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 --2- 172.21.15.79:0/1618499796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba40703f0 0x7fdba41e6950 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.189+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 >> 172.21.15.79:0/1618499796 conn(0x7fdba40d1eb0 msgr2=0x7fdba415c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.190+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 shutdown_connections 2024-06-10T00:18:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.190+0000 7fdbaa577640 1 -- 172.21.15.79:0/1618499796 wait complete. 2024-06-10T00:18:33.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:18:33.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f07953b7640 1 Processor -- start 2024-06-10T00:18:33.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f07953b7640 1 -- start start 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f07953b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f079015f1a0 0x7f07900d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f07953b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07900cef70 0x7f07900cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f07953b7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f079015f5e0 con 0x7f07900d2680 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f07953b7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f07900d13e0 con 0x7f079015f1a0 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f07953b7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f07900d0ad0 con 0x7f07900cef70 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f078e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f079015f1a0 0x7f07900d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.300+0000 7f078e7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f079015f1a0 0x7f07900d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58544/0 (socket says 172.21.15.79:58544) 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.301+0000 7f078e7fc640 1 -- 172.21.15.79:0/4178464184 learned_addr learned my addr 172.21.15.79:0/4178464184 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.301+0000 7f078e7fc640 1 -- 172.21.15.79:0/4178464184 >> v2:172.21.15.117:3300/0 conn(0x7f07900cef70 msgr2=0x7f07900cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.301+0000 7f078f7fe640 1 --2- 172.21.15.79:0/4178464184 >> v2:172.21.15.117:3300/0 conn(0x7f07900cef70 0x7f07900cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.301+0000 7f078e7fc640 1 --2- 172.21.15.79:0/4178464184 >> v2:172.21.15.117:3300/0 conn(0x7f07900cef70 0x7f07900cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.301+0000 7f078e7fc640 1 -- 172.21.15.79:0/4178464184 >> v1:172.21.15.117:6789/0 conn(0x7f07900d2680 legacy=0x7f07900d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:33.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.301+0000 7f078e7fc640 1 -- 172.21.15.79:0/4178464184 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079015f890 con 0x7f079015f1a0 2024-06-10T00:18:33.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.301+0000 7f078f7fe640 1 --2- 172.21.15.79:0/4178464184 >> v2:172.21.15.117:3300/0 conn(0x7f07900cef70 0x7f07900cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:33.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.301+0000 7f078e7fc640 1 --2- 172.21.15.79:0/4178464184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f079015f1a0 0x7f07900d1fc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f07900d1560 tx=0x7f078402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1588a32424faec25 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f078dffb640 1 -- 172.21.15.79:0/4178464184 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784037070 con 0x7f079015f1a0 2024-06-10T00:18:33.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f078dffb640 1 -- 172.21.15.79:0/4178464184 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0784032440 con 0x7f079015f1a0 2024-06-10T00:18:33.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f078dffb640 1 -- 172.21.15.79:0/4178464184 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784032810 con 0x7f079015f1a0 2024-06-10T00:18:33.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f07953b7640 1 -- 172.21.15.79:0/4178464184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f079015f1a0 msgr2=0x7f07900d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f07953b7640 1 --2- 172.21.15.79:0/4178464184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f079015f1a0 0x7f07900d1fc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f07900d1560 tx=0x7f078402a210 comp rx=0 tx=0).stop 2024-06-10T00:18:33.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f07953b7640 1 -- 172.21.15.79:0/4178464184 shutdown_connections 2024-06-10T00:18:33.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f07953b7640 1 --2- 172.21.15.79:0/4178464184 >> v2:172.21.15.117:3300/0 conn(0x7f07900cef70 0x7f07900cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f07953b7640 1 --2- 172.21.15.79:0/4178464184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f079015f1a0 0x7f07900d1fc0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f07953b7640 1 -- 172.21.15.79:0/4178464184 >> 172.21.15.79:0/4178464184 conn(0x7f079009d3f0 msgr2=0x7f07900d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:33.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f07953b7640 1 -- 172.21.15.79:0/4178464184 shutdown_connections 2024-06-10T00:18:33.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.302+0000 7f07953b7640 1 -- 172.21.15.79:0/4178464184 wait complete. 2024-06-10T00:18:33.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f07953b7640 1 Processor -- start 2024-06-10T00:18:33.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f07953b7640 1 -- start start 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f07953b7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07900cef70 0x7f07900b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f07953b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07900d2680 0x7f07900cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f07953b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f079015f1a0 0x7f07901527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f07953b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07900d4f00 con 0x7f07900d2680 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f07953b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07900d1070 con 0x7f079015f1a0 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f07953b7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07900d1870 con 0x7f07900cef70 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f078e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07900d2680 0x7f07900cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f078e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07900d2680 0x7f07900cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58550/0 (socket says 172.21.15.79:58550) 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.304+0000 7f078e7fc640 1 -- 172.21.15.79:0/4170502257 learned_addr learned my addr 172.21.15.79:0/4170502257 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f078f7fe640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f079015f1a0 0x7f07901527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f078effd640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07900cef70 0x7f07900b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f078e7fc640 1 -- 172.21.15.79:0/4170502257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07900cef70 msgr2=0x7f07900b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f078e7fc640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07900cef70 0x7f07900b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f078e7fc640 1 -- 172.21.15.79:0/4170502257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f079015f1a0 msgr2=0x7f07901527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f078e7fc640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f079015f1a0 0x7f07901527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f078e7fc640 1 -- 172.21.15.79:0/4170502257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07900c9090 con 0x7f07900d2680 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f078e7fc640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07900d2680 0x7f07900cd930 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0784000c00 tx=0x7f07840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f07777fe640 1 -- 172.21.15.79:0/4170502257 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784041020 con 0x7f07900d2680 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f07777fe640 1 -- 172.21.15.79:0/4170502257 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0784030970 con 0x7f07900d2680 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f07777fe640 1 -- 172.21.15.79:0/4170502257 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784037040 con 0x7f07900d2680 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07900c9370 con 0x7f07900d2680 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.305+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07900c9c10 con 0x7f07900d2680 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.306+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07900c9760 con 0x7f07900d2680 2024-06-10T00:18:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.306+0000 7f07777fe640 1 -- 172.21.15.79:0/4170502257 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0784044020 con 0x7f07900d2680 2024-06-10T00:18:33.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.307+0000 7f07777fe640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f077c06be30 0x7f077c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.307+0000 7f07777fe640 1 -- 172.21.15.79:0/4170502257 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f07840aba90 con 0x7f07900d2680 2024-06-10T00:18:33.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.307+0000 7f078effd640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f077c06be30 0x7f077c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.307+0000 7f078effd640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f077c06be30 0x7f077c06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0780005520 tx=0x7f0780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.311+0000 7f07777fe640 1 -- 172.21.15.79:0/4170502257 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f078404b030 con 0x7f07900d2680 2024-06-10T00:18:33.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.485+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07900c9540 con 0x7f07900d2680 2024-06-10T00:18:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.486+0000 7f07777fe640 1 -- 172.21.15.79:0/4170502257 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+17028 (secure 0 0 0) 0x7f078407a240 con 0x7f07900d2680 2024-06-10T00:18:33.486 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:33.486 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":63,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:17:25.790793+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:17:14.757444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-06-10T00:17:16.061305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.22","mappings":[{"from":7,"to":3}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:18:33.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f077c06be30 msgr2=0x7f077c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f077c06be30 0x7f077c06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0780005520 tx=0x7f0780009040 comp rx=0 tx=0).stop 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07900d2680 msgr2=0x7f07900cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07900d2680 0x7f07900cd930 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0784000c00 tx=0x7f07840046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 shutdown_connections 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f077c06be30 0x7f077c06e2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f079015f1a0 0x7f07901527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07900d2680 0x7f07900cd930 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 --2- 172.21.15.79:0/4170502257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07900cef70 0x7f07900b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 >> 172.21.15.79:0/4170502257 conn(0x7f079009d3f0 msgr2=0x7f07900cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 shutdown_connections 2024-06-10T00:18:33.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.488+0000 7f07953b7640 1 -- 172.21.15.79:0/4170502257 wait complete. 2024-06-10T00:18:33.499 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:18:33.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:33.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.597+0000 7f5ed9095640 1 Processor -- start 2024-06-10T00:18:33.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.597+0000 7f5ed9095640 1 -- start start 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.598+0000 7f5ed9095640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ed415f1a0 0x7f5ed40d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.598+0000 7f5ed9095640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed415f5e0 con 0x7f5ed40cef70 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.598+0000 7f5ed9095640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed40d0ad0 con 0x7f5ed40d2680 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.598+0000 7f5ed9095640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed40d13e0 con 0x7f5ed415f1a0 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.598+0000 7f5ed259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ed415f1a0 0x7f5ed40d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.598+0000 7f5ed359e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5ed40cef70 0x7f5ed40cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60974/0 (socket says 172.21.15.79:60974) 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.598+0000 7f5ed359e640 1 -- 172.21.15.79:0/3599364251 learned_addr learned my addr 172.21.15.79:0/3599364251 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.599+0000 7f5ed259c640 1 -- 172.21.15.79:0/3599364251 >> v1:172.21.15.117:6789/0 conn(0x7f5ed40d2680 legacy=0x7f5ed40d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.599+0000 7f5ed259c640 1 -- 172.21.15.79:0/3599364251 >> v1:172.21.15.79:6789/0 conn(0x7f5ed40cef70 legacy=0x7f5ed40cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.599+0000 7f5ed1d9b640 1 -- 172.21.15.79:0/3599364251 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3384029467 0 0) 0x7f5ed415f5e0 con 0x7f5ed40cef70 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.599+0000 7f5ed259c640 1 -- 172.21.15.79:0/3599364251 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed415f890 con 0x7f5ed415f1a0 2024-06-10T00:18:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.599+0000 7f5ed259c640 1 --2- 172.21.15.79:0/3599364251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed415f1a0 0x7f5ed40d1fc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0097a0 tx=0x7f5ebc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd4d2fcd37fd5b4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.599+0000 7f5ed1d9b640 1 -- 172.21.15.79:0/3599364251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc037070 con 0x7f5ed415f1a0 2024-06-10T00:18:33.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.599+0000 7f5ed1d9b640 1 -- 172.21.15.79:0/3599364251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc032440 con 0x7f5ed415f1a0 2024-06-10T00:18:33.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.599+0000 7f5ed1d9b640 1 -- 172.21.15.79:0/3599364251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc032810 con 0x7f5ed415f1a0 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.600+0000 7f5ed9095640 1 -- 172.21.15.79:0/3599364251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed415f1a0 msgr2=0x7f5ed40d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.600+0000 7f5ed9095640 1 --2- 172.21.15.79:0/3599364251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed415f1a0 0x7f5ed40d1fc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0097a0 tx=0x7f5ebc02a230 comp rx=0 tx=0).stop 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.600+0000 7f5ed9095640 1 -- 172.21.15.79:0/3599364251 shutdown_connections 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.600+0000 7f5ed9095640 1 --2- 172.21.15.79:0/3599364251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed415f1a0 0x7f5ed40d1fc0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.600+0000 7f5ed9095640 1 -- 172.21.15.79:0/3599364251 >> 172.21.15.79:0/3599364251 conn(0x7f5ed409d3f0 msgr2=0x7f5ed40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.600+0000 7f5ed9095640 1 -- 172.21.15.79:0/3599364251 shutdown_connections 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.600+0000 7f5ed9095640 1 -- 172.21.15.79:0/3599364251 wait complete. 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.601+0000 7f5ed9095640 1 Processor -- start 2024-06-10T00:18:33.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.601+0000 7f5ed9095640 1 -- start start 2024-06-10T00:18:33.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed9095640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed40cef70 0x7f5ed4151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed9095640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40d2680 0x7f5ed40b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed9095640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed415f1a0 0x7f5ed415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed9095640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed40d4f00 con 0x7f5ed40cef70 2024-06-10T00:18:33.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed9095640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed40d1070 con 0x7f5ed40d2680 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed9095640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed40d1870 con 0x7f5ed415f1a0 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed40cef70 0x7f5ed4151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed40cef70 0x7f5ed4151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58562/0 (socket says 172.21.15.79:58562) 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed2d9d640 1 -- 172.21.15.79:0/2711157102 learned_addr learned my addr 172.21.15.79:0/2711157102 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed259c640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40d2680 0x7f5ed40b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.602+0000 7f5ed359e640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed415f1a0 0x7f5ed415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ed2d9d640 1 -- 172.21.15.79:0/2711157102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed415f1a0 msgr2=0x7f5ed415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ed2d9d640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed415f1a0 0x7f5ed415b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ed2d9d640 1 -- 172.21.15.79:0/2711157102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40d2680 msgr2=0x7f5ed40b9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ed2d9d640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40d2680 0x7f5ed40b9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ed2d9d640 1 -- 172.21.15.79:0/2711157102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed415ba00 con 0x7f5ed40cef70 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ed2d9d640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed40cef70 0x7f5ed4151750 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c870 tx=0x7f5ec400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ecb7fe640 1 -- 172.21.15.79:0/2711157102 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4003b70 con 0x7f5ed40cef70 2024-06-10T00:18:33.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ecb7fe640 1 -- 172.21.15.79:0/2711157102 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec4003d30 con 0x7f5ed40cef70 2024-06-10T00:18:33.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed40b8a10 con 0x7f5ed40cef70 2024-06-10T00:18:33.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ecb7fe640 1 -- 172.21.15.79:0/2711157102 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400aa90 con 0x7f5ed40cef70 2024-06-10T00:18:33.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.603+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed40b8fd0 con 0x7f5ed40cef70 2024-06-10T00:18:33.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.604+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed4068430 con 0x7f5ed40cef70 2024-06-10T00:18:33.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.604+0000 7f5ecb7fe640 1 -- 172.21.15.79:0/2711157102 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ec400ac30 con 0x7f5ed40cef70 2024-06-10T00:18:33.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.605+0000 7f5ecb7fe640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5eb406be30 0x7f5eb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.605+0000 7f5ecb7fe640 1 -- 172.21.15.79:0/2711157102 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f5ec408af00 con 0x7f5ed40cef70 2024-06-10T00:18:33.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.605+0000 7f5ed259c640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5eb406be30 0x7f5eb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.605+0000 7f5ed259c640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5eb406be30 0x7f5eb406e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc034000 tx=0x7f5ebc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.609+0000 7f5ecb7fe640 1 -- 172.21.15.79:0/2711157102 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5ec4059740 con 0x7f5ed40cef70 2024-06-10T00:18:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.817+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ed40d04e0 con 0x7f5ed40cef70 2024-06-10T00:18:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.818+0000 7f5ecb7fe640 1 -- 172.21.15.79:0/2711157102 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5186 (secure 0 0 0) 0x7f5ec4059040 con 0x7f5ed40cef70 2024-06-10T00:18:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:33.817 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:18:05.792812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:18:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 31 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5eb406be30 msgr2=0x7f5eb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5eb406be30 0x7f5eb406e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc034000 tx=0x7f5ebc02e000 comp rx=0 tx=0).stop 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed40cef70 msgr2=0x7f5ed4151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed40cef70 0x7f5ed4151750 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c870 tx=0x7f5ec400cd30 comp rx=0 tx=0).stop 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 shutdown_connections 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5eb406be30 0x7f5eb406e2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed415f1a0 0x7f5ed415b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40d2680 0x7f5ed40b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.819+0000 7f5ed9095640 1 --2- 172.21.15.79:0/2711157102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ed40cef70 0x7f5ed4151750 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.820+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 >> 172.21.15.79:0/2711157102 conn(0x7f5ed409d3f0 msgr2=0x7f5ed41615a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.820+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 shutdown_connections 2024-06-10T00:18:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.820+0000 7f5ed9095640 1 -- 172.21.15.79:0/2711157102 wait complete. 2024-06-10T00:18:33.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:33.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.929+0000 7f26dacca640 1 Processor -- start 2024-06-10T00:18:33.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.929+0000 7f26dacca640 1 -- start start 2024-06-10T00:18:33.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26dacca640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f26d40d2680 0x7f26d415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26dacca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f26d40cef70 0x7f26d40cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26dacca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d40d0ad0 con 0x7f26d40d1fc0 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26dacca640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f26d40d13e0 con 0x7f26d40d2680 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26dacca640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f26d415f890 con 0x7f26d40cef70 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d8a66640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f26d40d2680 0x7f26d415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f26d40d1fc0 0x7f26d40d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60980/0 (socket says 172.21.15.79:60980) 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d3fff640 1 -- 172.21.15.79:0/4015445858 learned_addr learned my addr 172.21.15.79:0/4015445858 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d9267640 1 --2- 172.21.15.79:0/4015445858 >> v2:172.21.15.117:3300/0 conn(0x7f26d40cef70 0x7f26d40cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d8a66640 1 -- 172.21.15.79:0/4015445858 >> v2:172.21.15.117:3300/0 conn(0x7f26d40cef70 msgr2=0x7f26d40cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d8a66640 1 --2- 172.21.15.79:0/4015445858 >> v2:172.21.15.117:3300/0 conn(0x7f26d40cef70 0x7f26d40cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d8a66640 1 -- 172.21.15.79:0/4015445858 >> v1:172.21.15.79:6789/0 conn(0x7f26d40d1fc0 legacy=0x7f26d40d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d8a66640 1 -- 172.21.15.79:0/4015445858 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d40d0d90 con 0x7f26d40d2680 2024-06-10T00:18:33.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d37fe640 1 -- 172.21.15.79:0/4015445858 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666066424 0 0) 0x7f26d40d0ad0 con 0x7f26d40d1fc0 2024-06-10T00:18:33.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.930+0000 7f26d9267640 1 --2- 172.21.15.79:0/4015445858 >> v2:172.21.15.117:3300/0 conn(0x7f26d40cef70 0x7f26d40cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:33.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.931+0000 7f26d8a66640 1 --2- 172.21.15.79:0/4015445858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40d2680 0x7f26d415f1a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f26d40d1560 tx=0x7f26c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f88d20ea130381 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.931+0000 7f26d37fe640 1 -- 172.21.15.79:0/4015445858 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8037070 con 0x7f26d40d2680 2024-06-10T00:18:33.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.931+0000 7f26d37fe640 1 -- 172.21.15.79:0/4015445858 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c8032440 con 0x7f26d40d2680 2024-06-10T00:18:33.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.931+0000 7f26d37fe640 1 -- 172.21.15.79:0/4015445858 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8032810 con 0x7f26d40d2680 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.932+0000 7f26dacca640 1 -- 172.21.15.79:0/4015445858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40d2680 msgr2=0x7f26d415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.932+0000 7f26dacca640 1 --2- 172.21.15.79:0/4015445858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40d2680 0x7f26d415f1a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f26d40d1560 tx=0x7f26c802a1a0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.932+0000 7f26dacca640 1 -- 172.21.15.79:0/4015445858 shutdown_connections 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.932+0000 7f26dacca640 1 --2- 172.21.15.79:0/4015445858 >> v2:172.21.15.117:3300/0 conn(0x7f26d40cef70 0x7f26d40cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.932+0000 7f26dacca640 1 --2- 172.21.15.79:0/4015445858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40d2680 0x7f26d415f1a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.932+0000 7f26dacca640 1 -- 172.21.15.79:0/4015445858 >> 172.21.15.79:0/4015445858 conn(0x7f26d409d3f0 msgr2=0x7f26d40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.932+0000 7f26dacca640 1 -- 172.21.15.79:0/4015445858 shutdown_connections 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.932+0000 7f26dacca640 1 -- 172.21.15.79:0/4015445858 wait complete. 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.933+0000 7f26dacca640 1 Processor -- start 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.933+0000 7f26dacca640 1 -- start start 2024-06-10T00:18:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26dacca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40cef70 0x7f26d4159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26dacca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26d40d1fc0 0x7f26d415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26dacca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d40d2680 0x7f26d40cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26dacca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26d40d4f00 con 0x7f26d40cef70 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26dacca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26d40d2400 con 0x7f26d40d2680 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26dacca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f26d40d1870 con 0x7f26d40d1fc0 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40cef70 0x7f26d4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40cef70 0x7f26d4159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58576/0 (socket says 172.21.15.79:58576) 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 -- 172.21.15.79:0/4202028095 learned_addr learned my addr 172.21.15.79:0/4202028095 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 -- 172.21.15.79:0/4202028095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26d40d1fc0 msgr2=0x7f26d415e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26d40d1fc0 0x7f26d415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 -- 172.21.15.79:0/4202028095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d40d2680 msgr2=0x7f26d40cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d40d2680 0x7f26d40cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 -- 172.21.15.79:0/4202028095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d40b7ed0 con 0x7f26d40cef70 2024-06-10T00:18:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d8a66640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40cef70 0x7f26d4159540 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009860 tx=0x7f26c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d17fa640 1 -- 172.21.15.79:0/4202028095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8037040 con 0x7f26d40cef70 2024-06-10T00:18:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d17fa640 1 -- 172.21.15.79:0/4202028095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c8042070 con 0x7f26d40cef70 2024-06-10T00:18:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d40b81b0 con 0x7f26d40cef70 2024-06-10T00:18:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26d17fa640 1 -- 172.21.15.79:0/4202028095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8030a70 con 0x7f26d40cef70 2024-06-10T00:18:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.934+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d40cc2b0 con 0x7f26d40cef70 2024-06-10T00:18:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.935+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d40c7780 con 0x7f26d40cef70 2024-06-10T00:18:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.936+0000 7f26d17fa640 1 -- 172.21.15.79:0/4202028095 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26c8030c10 con 0x7f26d40cef70 2024-06-10T00:18:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.936+0000 7f26d17fa640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f26b806be30 0x7f26b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.936+0000 7f26d17fa640 1 -- 172.21.15.79:0/4202028095 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f26c80abb60 con 0x7f26d40cef70 2024-06-10T00:18:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.936+0000 7f26d3fff640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f26b806be30 0x7f26b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.937+0000 7f26d3fff640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f26b806be30 0x7f26b806e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007fd0 tx=0x7f26c0007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:33.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:33.940+0000 7f26d17fa640 1 -- 172.21.15.79:0/4202028095 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f26d40c7780 con 0x7f26d40cef70 2024-06-10T00:18:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.150+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26d4068430 con 0x7f26d40cef70 2024-06-10T00:18:34.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.150+0000 7f26d17fa640 1 -- 172.21.15.79:0/4202028095 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5186 (secure 0 0 0) 0x7f26c807a310 con 0x7f26d40cef70 2024-06-10T00:18:34.150 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:34.151 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:17:17.083403+0000","modified":"2024-06-10T00:18:05.792812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":15,"addr":"172.21.15.79:6837/3634814301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3634814301},{"type":"v1","addr":"172.21.15.79:6837","nonce":3634814301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5784,"qdb_cluster":[5784]},"id":4}]} 2024-06-10T00:18:34.151 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 31 2024-06-10T00:18:34.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.152+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f26b806be30 msgr2=0x7f26b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.152+0000 7f26dacca640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f26b806be30 0x7f26b806e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007fd0 tx=0x7f26c0007920 comp rx=0 tx=0).stop 2024-06-10T00:18:34.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.152+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40cef70 msgr2=0x7f26d4159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.152+0000 7f26dacca640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40cef70 0x7f26d4159540 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009860 tx=0x7f26c80046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.153+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 shutdown_connections 2024-06-10T00:18:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.153+0000 7f26dacca640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f26b806be30 0x7f26b806e2f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.153+0000 7f26dacca640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d40d2680 0x7f26d40cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.153+0000 7f26dacca640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26d40d1fc0 0x7f26d415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.153+0000 7f26dacca640 1 --2- 172.21.15.79:0/4202028095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26d40cef70 0x7f26d4159540 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.153+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 >> 172.21.15.79:0/4202028095 conn(0x7f26d409d3f0 msgr2=0x7f26d415fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.153+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 shutdown_connections 2024-06-10T00:18:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.153+0000 7f26dacca640 1 -- 172.21.15.79:0/4202028095 wait complete. 2024-06-10T00:18:34.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:18:34.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.262+0000 7f2b010fc640 1 Processor -- start 2024-06-10T00:18:34.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.262+0000 7f2b010fc640 1 -- start start 2024-06-10T00:18:34.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2b010fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0d2680 0x7f2afc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2b010fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2afc0cef70 0x7f2afc0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2b010fc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2afc0d0ad0 con 0x7f2afc0d1fc0 2024-06-10T00:18:34.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2b010fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2afc0d13e0 con 0x7f2afc0cef70 2024-06-10T00:18:34.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2b010fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc15f890 con 0x7f2afc0d2680 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2afad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0d2680 0x7f2afc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2afb59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2afc0cef70 0x7f2afc0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2afad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0d2680 0x7f2afc15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:51436/0 (socket says 172.21.15.79:51436) 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.263+0000 7f2afad9d640 1 -- 172.21.15.79:0/308546190 learned_addr learned my addr 172.21.15.79:0/308546190 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.264+0000 7f2afad9d640 1 -- 172.21.15.79:0/308546190 >> v2:172.21.15.117:3300/0 conn(0x7f2afc0cef70 msgr2=0x7f2afc0cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.264+0000 7f2afad9d640 1 --2- 172.21.15.79:0/308546190 >> v2:172.21.15.117:3300/0 conn(0x7f2afc0cef70 0x7f2afc0cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.264+0000 7f2afad9d640 1 -- 172.21.15.79:0/308546190 >> v1:172.21.15.117:6789/0 conn(0x7f2afc0d1fc0 legacy=0x7f2afc0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.264+0000 7f2afad9d640 1 -- 172.21.15.79:0/308546190 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc0d0d90 con 0x7f2afc0d2680 2024-06-10T00:18:34.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.264+0000 7f2afb59e640 1 --2- 172.21.15.79:0/308546190 >> v2:172.21.15.117:3300/0 conn(0x7f2afc0cef70 0x7f2afc0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:34.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2afad9d640 1 --2- 172.21.15.79:0/308546190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0d2680 0x7f2afc15f1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009870 tx=0x7f2aec02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633f70bb2707f51a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2afa59c640 1 -- 172.21.15.79:0/308546190 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec037070 con 0x7f2afc0d2680 2024-06-10T00:18:34.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2afa59c640 1 -- 172.21.15.79:0/308546190 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aec032440 con 0x7f2afc0d2680 2024-06-10T00:18:34.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2afa59c640 1 -- 172.21.15.79:0/308546190 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec032810 con 0x7f2afc0d2680 2024-06-10T00:18:34.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2b010fc640 1 -- 172.21.15.79:0/308546190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0d2680 msgr2=0x7f2afc15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2b010fc640 1 --2- 172.21.15.79:0/308546190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0d2680 0x7f2afc15f1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009870 tx=0x7f2aec02a270 comp rx=0 tx=0).stop 2024-06-10T00:18:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2b010fc640 1 -- 172.21.15.79:0/308546190 shutdown_connections 2024-06-10T00:18:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2b010fc640 1 --2- 172.21.15.79:0/308546190 >> v2:172.21.15.117:3300/0 conn(0x7f2afc0cef70 0x7f2afc0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2b010fc640 1 --2- 172.21.15.79:0/308546190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0d2680 0x7f2afc15f1a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2b010fc640 1 -- 172.21.15.79:0/308546190 >> 172.21.15.79:0/308546190 conn(0x7f2afc09d3f0 msgr2=0x7f2afc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2b010fc640 1 -- 172.21.15.79:0/308546190 shutdown_connections 2024-06-10T00:18:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.265+0000 7f2b010fc640 1 -- 172.21.15.79:0/308546190 wait complete. 2024-06-10T00:18:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.267+0000 7f2b010fc640 1 Processor -- start 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.267+0000 7f2b010fc640 1 -- start start 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2b010fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cef70 0x7f2afc15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2b010fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0d1fc0 0x7f2afc15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2b010fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2afc0d2680 0x7f2afc1f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2b010fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc0d4f00 con 0x7f2afc0d2680 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2b010fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc0d2400 con 0x7f2afc0d1fc0 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2b010fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc0d1870 con 0x7f2afc0cef70 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2afc0d2680 0x7f2afc1f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2afc0d2680 0x7f2afc1f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58580/0 (socket says 172.21.15.79:58580) 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 -- 172.21.15.79:0/3868925767 learned_addr learned my addr 172.21.15.79:0/3868925767 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afad9d640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cef70 0x7f2afc15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2af259c640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0d1fc0 0x7f2afc15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 -- 172.21.15.79:0/3868925767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cef70 msgr2=0x7f2afc15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cef70 0x7f2afc15a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 -- 172.21.15.79:0/3868925767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0d1fc0 msgr2=0x7f2afc15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0d1fc0 0x7f2afc15dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 -- 172.21.15.79:0/3868925767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc09ed30 con 0x7f2afc0d2680 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2afb59e640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2afc0d2680 0x7f2afc1f7d90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2af400efc0 tx=0x7f2af4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2af3fff640 1 -- 172.21.15.79:0/3868925767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4018030 con 0x7f2afc0d2680 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2af3fff640 1 -- 172.21.15.79:0/3868925767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af400cde0 con 0x7f2afc0d2680 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2afc09f010 con 0x7f2afc0d2680 2024-06-10T00:18:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2af3fff640 1 -- 172.21.15.79:0/3868925767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4003bb0 con 0x7f2afc0d2680 2024-06-10T00:18:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.268+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2afc15b460 con 0x7f2afc0d2680 2024-06-10T00:18:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.269+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2afc068430 con 0x7f2afc0d2680 2024-06-10T00:18:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.270+0000 7f2af3fff640 1 -- 172.21.15.79:0/3868925767 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2af4005d10 con 0x7f2afc0d2680 2024-06-10T00:18:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.270+0000 7f2af3fff640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2adc06be30 0x7f2adc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.270+0000 7f2af3fff640 1 -- 172.21.15.79:0/3868925767 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7f2af408bb70 con 0x7f2afc0d2680 2024-06-10T00:18:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.270+0000 7f2afad9d640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2adc06be30 0x7f2adc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.271+0000 7f2afad9d640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2adc06be30 0x7f2adc06e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2aec034000 tx=0x7f2aec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.275+0000 7f2af3fff640 1 -- 172.21.15.79:0/3868925767 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2af4022070 con 0x7f2afc0d2680 2024-06-10T00:18:34.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.453+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2afc08de90 con 0x7f2afc0d2680 2024-06-10T00:18:34.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.454+0000 7f2af3fff640 1 -- 172.21.15.79:0/3868925767 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+17028 (secure 0 0 0) 0x7f2af4010040 con 0x7f2afc0d2680 2024-06-10T00:18:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:34.454 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":63,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:17:25.790793+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:17:14.757444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-06-10T00:17:16.061305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.22","mappings":[{"from":7,"to":3}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2adc06be30 msgr2=0x7f2adc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2adc06be30 0x7f2adc06e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2aec034000 tx=0x7f2aec02e000 comp rx=0 tx=0).stop 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2afc0d2680 msgr2=0x7f2afc1f7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2afc0d2680 0x7f2afc1f7d90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2af400efc0 tx=0x7f2af4009f90 comp rx=0 tx=0).stop 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 shutdown_connections 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2adc06be30 0x7f2adc06e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2afc0d2680 0x7f2afc1f7d90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0d1fc0 0x7f2afc15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 --2- 172.21.15.79:0/3868925767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cef70 0x7f2afc15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 >> 172.21.15.79:0/3868925767 conn(0x7f2afc09d3f0 msgr2=0x7f2afc0c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:34.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 shutdown_connections 2024-06-10T00:18:34.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.456+0000 7f2b010fc640 1 -- 172.21.15.79:0/3868925767 wait complete. 2024-06-10T00:18:34.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:18:34.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.567+0000 7ffa7cf61640 1 Processor -- start 2024-06-10T00:18:34.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.567+0000 7ffa7cf61640 1 -- start start 2024-06-10T00:18:34.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.568+0000 7ffa7cf61640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.568+0000 7ffa7cf61640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa780d4cd0 0x7ffa780d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.568+0000 7ffa7cf61640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa780d03e0 con 0x7ffa781618e0 2024-06-10T00:18:34.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.568+0000 7ffa7cf61640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ffa780b4130 con 0x7ffa780d4cd0 2024-06-10T00:18:34.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.568+0000 7ffa7cf61640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffa780d0100 con 0x7ffa78161cc0 2024-06-10T00:18:34.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.569+0000 7ffa75d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.569+0000 7ffa76d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa780d4cd0 0x7ffa780d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.569+0000 7ffa75d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780d2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:51456/0 (socket says 172.21.15.79:51456) 2024-06-10T00:18:34.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.569+0000 7ffa75d9b640 1 -- 172.21.15.79:0/43315204 learned_addr learned my addr 172.21.15.79:0/43315204 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:34.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.569+0000 7ffa75d9b640 1 -- 172.21.15.79:0/43315204 >> v2:172.21.15.117:3300/0 conn(0x7ffa780d4cd0 msgr2=0x7ffa780d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:34.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.569+0000 7ffa75d9b640 1 --2- 172.21.15.79:0/43315204 >> v2:172.21.15.117:3300/0 conn(0x7ffa780d4cd0 0x7ffa780d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.569+0000 7ffa75d9b640 1 -- 172.21.15.79:0/43315204 >> v1:172.21.15.117:6789/0 conn(0x7ffa781618e0 legacy=0x7ffa780cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.569+0000 7ffa75d9b640 1 -- 172.21.15.79:0/43315204 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa780b3ae0 con 0x7ffa78161cc0 2024-06-10T00:18:34.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.570+0000 7ffa75d9b640 1 --2- 172.21.15.79:0/43315204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780d2510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009870 tx=0x7ffa6802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa90b35af99f3c75 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.570+0000 7ffa7559a640 1 -- 172.21.15.79:0/43315204 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68037070 con 0x7ffa78161cc0 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.570+0000 7ffa7559a640 1 -- 172.21.15.79:0/43315204 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa68032440 con 0x7ffa78161cc0 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.570+0000 7ffa7559a640 1 -- 172.21.15.79:0/43315204 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68032810 con 0x7ffa78161cc0 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.570+0000 7ffa7cf61640 1 -- 172.21.15.79:0/43315204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 msgr2=0x7ffa780d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.570+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/43315204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780d2510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009870 tx=0x7ffa6802a270 comp rx=0 tx=0).stop 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.571+0000 7ffa7cf61640 1 -- 172.21.15.79:0/43315204 shutdown_connections 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.571+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/43315204 >> v2:172.21.15.117:3300/0 conn(0x7ffa780d4cd0 0x7ffa780d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.571+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/43315204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780d2510 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.571+0000 7ffa7cf61640 1 -- 172.21.15.79:0/43315204 >> 172.21.15.79:0/43315204 conn(0x7ffa7809d410 msgr2=0x7ffa780d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.571+0000 7ffa7cf61640 1 -- 172.21.15.79:0/43315204 shutdown_connections 2024-06-10T00:18:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.571+0000 7ffa7cf61640 1 -- 172.21.15.79:0/43315204 wait complete. 2024-06-10T00:18:34.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.572+0000 7ffa7cf61640 1 Processor -- start 2024-06-10T00:18:34.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.572+0000 7ffa7cf61640 1 -- start start 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7cf61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa780d4cd0 0x7ffa7815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7cf61640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa781618e0 0x7ffa780c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7cf61640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7cf61640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa780b4740 con 0x7ffa780d4cd0 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7cf61640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa780b45c0 con 0x7ffa781618e0 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7cf61640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffa780b48c0 con 0x7ffa78161cc0 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa780d4cd0 0x7ffa7815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa780d4cd0 0x7ffa7815cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58584/0 (socket says 172.21.15.79:58584) 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 -- 172.21.15.79:0/302218950 learned_addr learned my addr 172.21.15.79:0/302218950 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa75d9b640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa781618e0 0x7ffa780c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa76d9d640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 -- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 msgr2=0x7ffa780cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 -- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa781618e0 msgr2=0x7ffa780c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa781618e0 0x7ffa780c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 -- 172.21.15.79:0/302218950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa781f5040 con 0x7ffa780d4cd0 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa75d9b640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa781618e0 0x7ffa780c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa76d9d640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7659c640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa780d4cd0 0x7ffa7815cf90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c400 tx=0x7ffa6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa6effd640 1 -- 172.21.15.79:0/302218950 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa600052d0 con 0x7ffa780d4cd0 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa6effd640 1 -- 172.21.15.79:0/302218950 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60005490 con 0x7ffa780d4cd0 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa781f4d60 con 0x7ffa780d4cd0 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa6effd640 1 -- 172.21.15.79:0/302218950 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007260 con 0x7ffa780d4cd0 2024-06-10T00:18:34.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.573+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa780c8c60 con 0x7ffa780d4cd0 2024-06-10T00:18:34.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.574+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa78068430 con 0x7ffa780d4cd0 2024-06-10T00:18:34.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.575+0000 7ffa6effd640 1 -- 172.21.15.79:0/302218950 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa60007400 con 0x7ffa780d4cd0 2024-06-10T00:18:34.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.575+0000 7ffa6effd640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffa5806be60 0x7ffa5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.575+0000 7ffa6effd640 1 -- 172.21.15.79:0/302218950 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6217+0+0 (secure 0 0 0) 0x7ffa6008a510 con 0x7ffa780d4cd0 2024-06-10T00:18:34.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.575+0000 7ffa75d9b640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffa5806be60 0x7ffa5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.576+0000 7ffa75d9b640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffa5806be60 0x7ffa5806e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa68034000 tx=0x7ffa6802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.579+0000 7ffa6effd640 1 -- 172.21.15.79:0/302218950 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffa60058d50 con 0x7ffa780d4cd0 2024-06-10T00:18:34.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.788+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ffa780d2ac0 con 0x7ffa780d4cd0 2024-06-10T00:18:34.788 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:18:34.789+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:18:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.790+0000 7ffa6effd640 1 -- 172.21.15.79:0/302218950 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7ffa60058650 con 0x7ffa780d4cd0 2024-06-10T00:18:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:18:34.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffa5806be60 msgr2=0x7ffa5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffa5806be60 0x7ffa5806e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa68034000 tx=0x7ffa6802e000 comp rx=0 tx=0).stop 2024-06-10T00:18:34.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa780d4cd0 msgr2=0x7ffa7815cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa780d4cd0 0x7ffa7815cf90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c400 tx=0x7ffa6000c8c0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 shutdown_connections 2024-06-10T00:18:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffa5806be60 0x7ffa5806e320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa78161cc0 0x7ffa780cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa781618e0 0x7ffa780c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 --2- 172.21.15.79:0/302218950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa780d4cd0 0x7ffa7815cf90 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 >> 172.21.15.79:0/302218950 conn(0x7ffa7809d410 msgr2=0x7ffa780cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 shutdown_connections 2024-06-10T00:18:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.792+0000 7ffa7cf61640 1 -- 172.21.15.79:0/302218950 wait complete. 2024-06-10T00:18:34.797 INFO:tasks.ceph.mds.a.smithi079.stderr: -6457> 2024-06-10T00:17:23.724+0000 7fd0a7c1b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:18:34.800 INFO:tasks.ceph.mds.a.smithi079.stderr: -4717> 2024-06-10T00:17:29.288+0000 7fd0a3c13640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5955=0-4194304@1} caps={5955=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5955 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x561bcae90680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-10T00:18:34.803 INFO:tasks.ceph.mds.a.smithi079.stderr: -2797> 2024-06-10T00:18:00.585+0000 7fd0a3c13640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2024-06-10T00:17:28.327269+0000 1=1+0) caps={5955=pAsLsXsFs/-@2},l=5955(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x561bcae90680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-10T00:18:34.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-10T00:18:34.831 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:18:34.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.909+0000 7f9984b09640 1 Processor -- start 2024-06-10T00:18:34.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.910+0000 7f9984b09640 1 -- start start 2024-06-10T00:18:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.910+0000 7f9984b09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9980155320 0x7f99800b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.910+0000 7f9984b09640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f99800b34e0 0x7f99800d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.910+0000 7f9984b09640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980155700 con 0x7f99800d0560 2024-06-10T00:18:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.910+0000 7f9984b09640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f998015b6b0 con 0x7f99800b34e0 2024-06-10T00:18:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.910+0000 7f9984b09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f998015b990 con 0x7f9980155320 2024-06-10T00:18:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.911+0000 7f997e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9980155320 0x7f99800b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.911+0000 7f997e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9980155320 0x7f99800b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:51498/0 (socket says 172.21.15.79:51498) 2024-06-10T00:18:34.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.911+0000 7f997e59c640 1 -- 172.21.15.79:0/3420925014 learned_addr learned my addr 172.21.15.79:0/3420925014 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:34.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.911+0000 7f997dd9b640 1 --2- 172.21.15.79:0/3420925014 >> v2:172.21.15.117:3300/0 conn(0x7f99800b34e0 0x7f99800d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.911+0000 7f997e59c640 1 -- 172.21.15.79:0/3420925014 >> v2:172.21.15.117:3300/0 conn(0x7f99800b34e0 msgr2=0x7f99800d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:34.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.911+0000 7f997e59c640 1 --2- 172.21.15.79:0/3420925014 >> v2:172.21.15.117:3300/0 conn(0x7f99800b34e0 0x7f99800d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.911+0000 7f997e59c640 1 -- 172.21.15.79:0/3420925014 >> v1:172.21.15.117:6789/0 conn(0x7f99800d0560 legacy=0x7f998006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.911+0000 7f997e59c640 1 -- 172.21.15.79:0/3420925014 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998015bc70 con 0x7f9980155320 2024-06-10T00:18:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.912+0000 7f997e59c640 1 --2- 172.21.15.79:0/3420925014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9980155320 0x7f99800b2fa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9978009870 tx=0x7f997802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b44f6140c03ac3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.912+0000 7f997d59a640 1 -- 172.21.15.79:0/3420925014 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978037070 con 0x7f9980155320 2024-06-10T00:18:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.912+0000 7f997d59a640 1 -- 172.21.15.79:0/3420925014 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9978032440 con 0x7f9980155320 2024-06-10T00:18:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.912+0000 7f997d59a640 1 -- 172.21.15.79:0/3420925014 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978032810 con 0x7f9980155320 2024-06-10T00:18:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.913+0000 7f9984b09640 1 -- 172.21.15.79:0/3420925014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9980155320 msgr2=0x7f99800b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.913+0000 7f9984b09640 1 --2- 172.21.15.79:0/3420925014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9980155320 0x7f99800b2fa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9978009870 tx=0x7f997802a270 comp rx=0 tx=0).stop 2024-06-10T00:18:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.913+0000 7f9984b09640 1 -- 172.21.15.79:0/3420925014 shutdown_connections 2024-06-10T00:18:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.913+0000 7f9984b09640 1 --2- 172.21.15.79:0/3420925014 >> v2:172.21.15.117:3300/0 conn(0x7f99800b34e0 0x7f99800d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.913+0000 7f9984b09640 1 --2- 172.21.15.79:0/3420925014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9980155320 0x7f99800b2fa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.913+0000 7f9984b09640 1 -- 172.21.15.79:0/3420925014 >> 172.21.15.79:0/3420925014 conn(0x7f99800b1d10 msgr2=0x7f99800b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.913+0000 7f9984b09640 1 -- 172.21.15.79:0/3420925014 shutdown_connections 2024-06-10T00:18:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.913+0000 7f9984b09640 1 -- 172.21.15.79:0/3420925014 wait complete. 2024-06-10T00:18:34.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.914+0000 7f9984b09640 1 Processor -- start 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.914+0000 7f9984b09640 1 -- start start 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f9984b09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99800b34e0 0x7f99800ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f9984b09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99800d0560 0x7f998015f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f9984b09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9980155320 0x7f99800cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f9984b09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f998015b470 con 0x7f9980155320 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f9984b09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f998015b2f0 con 0x7f99800d0560 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f9984b09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f998006e900 con 0x7f99800b34e0 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f997ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9980155320 0x7f99800cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f997ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9980155320 0x7f99800cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58596/0 (socket says 172.21.15.79:58596) 2024-06-10T00:18:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f997ed9d640 1 -- 172.21.15.79:0/4026288360 learned_addr learned my addr 172.21.15.79:0/4026288360 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f997e59c640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99800b34e0 0x7f99800ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f997dd9b640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99800d0560 0x7f998015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f997ed9d640 1 -- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99800b34e0 msgr2=0x7f99800ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.915+0000 7f997ed9d640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99800b34e0 0x7f99800ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f997ed9d640 1 -- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99800d0560 msgr2=0x7f998015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f997ed9d640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99800d0560 0x7f998015f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f997ed9d640 1 -- 172.21.15.79:0/4026288360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99800ce870 con 0x7f9980155320 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f997dd9b640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99800d0560 0x7f998015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f997ed9d640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9980155320 0x7f99800cd4f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f997000c7a0 tx=0x7f997000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f9976ffd640 1 -- 172.21.15.79:0/4026288360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970003b70 con 0x7f9980155320 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f9976ffd640 1 -- 172.21.15.79:0/4026288360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9970003d30 con 0x7f9980155320 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99800ceb50 con 0x7f9980155320 2024-06-10T00:18:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f9976ffd640 1 -- 172.21.15.79:0/4026288360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997000aa90 con 0x7f9980155320 2024-06-10T00:18:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.916+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99800cf110 con 0x7f9980155320 2024-06-10T00:18:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.917+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99800683c0 con 0x7f9980155320 2024-06-10T00:18:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.917+0000 7f9976ffd640 1 -- 172.21.15.79:0/4026288360 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f997000ac30 con 0x7f9980155320 2024-06-10T00:18:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.918+0000 7f9976ffd640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f996006be30 0x7f996006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.918+0000 7f9976ffd640 1 -- 172.21.15.79:0/4026288360 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6303+0+0 (secure 0 0 0) 0x7f997008af40 con 0x7f9980155320 2024-06-10T00:18:34.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.918+0000 7f997e59c640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f996006be30 0x7f996006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:34.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.918+0000 7f997e59c640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f996006be30 0x7f996006e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9978034000 tx=0x7f997802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:34.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:34.922+0000 7f9976ffd640 1 -- 172.21.15.79:0/4026288360 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f99700596b0 con 0x7f9980155320 2024-06-10T00:18:35.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.133+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f99800cc8c0 con 0x7f9980155320 2024-06-10T00:18:35.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.792+0000 7f9976ffd640 1 -- 172.21.15.79:0/4026288360 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f9970058fb0 con 0x7f9980155320 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f996006be30 msgr2=0x7f996006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f996006be30 0x7f996006e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9978034000 tx=0x7f997802e000 comp rx=0 tx=0).stop 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9980155320 msgr2=0x7f99800cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9980155320 0x7f99800cd4f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f997000c7a0 tx=0x7f997000cc60 comp rx=0 tx=0).stop 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 shutdown_connections 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f996006be30 0x7f996006e2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9980155320 0x7f99800cd4f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99800d0560 0x7f998015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 --2- 172.21.15.79:0/4026288360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99800b34e0 0x7f99800ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 >> 172.21.15.79:0/4026288360 conn(0x7f99800b1d10 msgr2=0x7f99800ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:35.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 shutdown_connections 2024-06-10T00:18:35.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.795+0000 7f9984b09640 1 -- 172.21.15.79:0/4026288360 wait complete. 2024-06-10T00:18:35.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-10T00:18:35.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.955+0000 7f7ce8093640 1 Processor -- start 2024-06-10T00:18:35.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.955+0000 7f7ce8093640 1 -- start start 2024-06-10T00:18:35.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.956+0000 7f7ce8093640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ce015cad0 0x7f7ce006de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:35.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.956+0000 7f7ce8093640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00acfc0 con 0x7f7ce00af5b0 2024-06-10T00:18:35.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.956+0000 7f7ce8093640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00ad2a0 con 0x7f7ce00ae910 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.956+0000 7f7ce8093640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7ce015d5c0 con 0x7f7ce015cad0 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.956+0000 7f7ce562e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7ce00af5b0 0x7f7ce015ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60986/0 (socket says 172.21.15.79:60986) 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.956+0000 7f7ce562e640 1 -- 172.21.15.79:0/3971099500 learned_addr learned my addr 172.21.15.79:0/3971099500 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce5e2f640 1 --2- 172.21.15.79:0/3971099500 >> v2:172.21.15.117:3300/0 conn(0x7f7ce015cad0 0x7f7ce006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993797291 0 0) 0x7f7ce00acfc0 con 0x7f7ce00af5b0 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc8003520 con 0x7f7ce00af5b0 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2799044415 0 0) 0x7f7cc8003520 con 0x7f7ce00af5b0 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 >> v2:172.21.15.117:3300/0 conn(0x7f7ce015cad0 msgr2=0x7f7ce006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 --2- 172.21.15.79:0/3971099500 >> v2:172.21.15.117:3300/0 conn(0x7f7ce015cad0 0x7f7ce006de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 >> v1:172.21.15.117:6789/0 conn(0x7f7ce00ae910 legacy=0x7f7ce00aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:35.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce006d600 con 0x7f7ce00af5b0 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f7cd4001670 con 0x7f7ce00af5b0 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 >> v1:172.21.15.79:6789/0 conn(0x7f7ce00af5b0 legacy=0x7f7ce015ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce015d5c0 con 0x7f7cc80051c0 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc800c160 con 0x7f7cc8004800 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc800c360 con 0x7f7cc80039b0 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce6630640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce562e640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce5e2f640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:35.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce6630640 1 -- 172.21.15.79:0/3971099500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc80039b0 msgr2=0x7f7cc8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce6630640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce6630640 1 -- 172.21.15.79:0/3971099500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc8004800 msgr2=0x7f7cc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce6630640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.957+0000 7f7ce6630640 1 -- 172.21.15.79:0/3971099500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8003520 con 0x7f7cc80051c0 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.958+0000 7f7ce6630640 1 -- 172.21.15.79:0/3971099500 reap_dead start 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.958+0000 7f7ce6630640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8001e50 tx=0x7f7cc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd368c2c9b825b49 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.958+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8001a70 con 0x7f7cc80051c0 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.958+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd8003970 con 0x7f7cc80051c0 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.958+0000 7f7ce4e2d640 1 -- 172.21.15.79:0/3971099500 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8003d60 con 0x7f7cc80051c0 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.959+0000 7f7ce8093640 1 -- 172.21.15.79:0/3971099500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 msgr2=0x7f7cc800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.959+0000 7f7ce8093640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8001e50 tx=0x7f7cc8005830 comp rx=0 tx=0).stop 2024-06-10T00:18:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.959+0000 7f7ce8093640 1 -- 172.21.15.79:0/3971099500 shutdown_connections 2024-06-10T00:18:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.959+0000 7f7ce8093640 1 --2- 172.21.15.79:0/3971099500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.959+0000 7f7ce8093640 1 -- 172.21.15.79:0/3971099500 >> 172.21.15.79:0/3971099500 conn(0x7f7ce00b1bb0 msgr2=0x7f7ce00b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.959+0000 7f7ce8093640 1 -- 172.21.15.79:0/3971099500 shutdown_connections 2024-06-10T00:18:35.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.959+0000 7f7ce8093640 1 -- 172.21.15.79:0/3971099500 wait complete. 2024-06-10T00:18:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.960+0000 7f7ce8093640 1 Processor -- start 2024-06-10T00:18:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.960+0000 7f7ce8093640 1 -- start start 2024-06-10T00:18:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce8093640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7ce0153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce8093640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ce013e610 0x7f7ce013ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce8093640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ce009bdb0 0x7f7ce009c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce8093640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce015d240 con 0x7f7cc80051c0 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce8093640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce015d0c0 con 0x7f7ce009bdb0 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce8093640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce015d3c0 con 0x7f7ce013e610 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7ce0153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7ce0153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58602/0 (socket says 172.21.15.79:58602) 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 -- 172.21.15.79:0/3955039087 learned_addr learned my addr 172.21.15.79:0/3955039087 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce562e640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ce013e610 0x7f7ce013ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce6630640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ce009bdb0 0x7f7ce009c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:35.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 -- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ce013e610 msgr2=0x7f7ce013ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ce013e610 0x7f7ce013ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 -- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ce009bdb0 msgr2=0x7f7ce009c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ce009bdb0 0x7f7ce009c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 -- 172.21.15.79:0/3955039087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce009cb00 con 0x7f7cc80051c0 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce562e640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ce013e610 0x7f7ce013ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce5e2f640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7ce0153950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0011910 tx=0x7f7cd0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7cde7fc640 1 -- 172.21.15.79:0/3955039087 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd000faf0 con 0x7f7cc80051c0 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7cde7fc640 1 -- 172.21.15.79:0/3955039087 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd000fc90 con 0x7f7cc80051c0 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce009cde0 con 0x7f7cc80051c0 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7cde7fc640 1 -- 172.21.15.79:0/3955039087 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0014440 con 0x7f7cc80051c0 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.961+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce014d6c0 con 0x7f7cc80051c0 2024-06-10T00:18:35.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.962+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce00ad4c0 con 0x7f7cc80051c0 2024-06-10T00:18:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.963+0000 7f7cde7fc640 1 -- 172.21.15.79:0/3955039087 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cd0012040 con 0x7f7cc80051c0 2024-06-10T00:18:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.963+0000 7f7cde7fc640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.963+0000 7f7cde7fc640 1 -- 172.21.15.79:0/3955039087 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6303+0+0 (secure 0 0 0) 0x7f7cd008b670 con 0x7f7cc80051c0 2024-06-10T00:18:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.963+0000 7f7ce562e640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.964+0000 7f7ce562e640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00b1830 tx=0x7f7cd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:35.968+0000 7f7cde7fc640 1 -- 172.21.15.79:0/3955039087 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7ce00ad4c0 con 0x7f7cc80051c0 2024-06-10T00:18:36.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.143+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7ce0068540 con 0x7f7cc80051c0 2024-06-10T00:18:36.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.980+0000 7f7cde7fc640 1 -- 172.21.15.79:0/3955039087 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) ==== 181+0+0 (secure 0 0 0) 0x7f7cd0019030 con 0x7f7cc80051c0 2024-06-10T00:18:36.980 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-06-10T00:18:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ccc06be30 msgr2=0x7f7ccc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00b1830 tx=0x7f7cd4009040 comp rx=0 tx=0).stop 2024-06-10T00:18:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 msgr2=0x7f7ce0153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7ce0153950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0011910 tx=0x7f7cd0011dd0 comp rx=0 tx=0).stop 2024-06-10T00:18:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 shutdown_connections 2024-06-10T00:18:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ce009bdb0 0x7f7ce009c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ce013e610 0x7f7ce013ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 --2- 172.21.15.79:0/3955039087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cc80051c0 0x7f7ce0153950 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 >> 172.21.15.79:0/3955039087 conn(0x7f7ce00b1bb0 msgr2=0x7f7ce00b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.984+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 shutdown_connections 2024-06-10T00:18:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:36.985+0000 7f7ce8093640 1 -- 172.21.15.79:0/3955039087 wait complete. 2024-06-10T00:18:37.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-10T00:18:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.109+0000 7f595b55c640 1 Processor -- start 2024-06-10T00:18:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.109+0000 7f595b55c640 1 -- start start 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f595b55c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59540af420 0x7f5954071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f595b55c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5954073270 con 0x7f59540cd170 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f595b55c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595415abf0 con 0x7f595415a810 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f595b55c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f59540ce560 con 0x7f59540af420 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f5959af9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f59540cd170 0x7f5954071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:32770/0 (socket says 172.21.15.79:32770) 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f5959af9640 1 -- 172.21.15.79:0/2762133247 learned_addr learned my addr 172.21.15.79:0/2762133247 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f5958af7640 1 --2- 172.21.15.79:0/2762133247 >> v2:172.21.15.117:3300/0 conn(0x7f59540af420 0x7f5954071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612440735 0 0) 0x7f5954073270 con 0x7f59540cd170 2024-06-10T00:18:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5940003520 con 0x7f59540cd170 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1325683092 0 0) 0x7f5940003520 con 0x7f59540cd170 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 >> v2:172.21.15.117:3300/0 conn(0x7f59540af420 msgr2=0x7f5954071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 --2- 172.21.15.79:0/2762133247 >> v2:172.21.15.117:3300/0 conn(0x7f59540af420 0x7f5954071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 >> v1:172.21.15.117:6789/0 conn(0x7f595415a810 legacy=0x7f59540b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59540ce7b0 con 0x7f59540cd170 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f594c0019f0 con 0x7f59540cd170 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 >> v1:172.21.15.79:6789/0 conn(0x7f59540cd170 legacy=0x7f5954071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5940003b80 0x7f5940003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5940008830 0x7f594000acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594000b4c0 0x7f594000d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f59540ce560 con 0x7f594000b4c0 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f594000e260 con 0x7f5940003b80 2024-06-10T00:18:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.110+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f594000e460 con 0x7f5940008830 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f5959af9640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594000b4c0 0x7f594000d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f59592f8640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5940003b80 0x7f5940003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f5958af7640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5940008830 0x7f594000acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f5959af9640 1 -- 172.21.15.79:0/2762133247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5940008830 msgr2=0x7f594000acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f5959af9640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5940008830 0x7f594000acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f5959af9640 1 -- 172.21.15.79:0/2762133247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5940003b80 msgr2=0x7f5940003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f5959af9640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5940003b80 0x7f5940003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f5959af9640 1 -- 172.21.15.79:0/2762133247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5940003520 con 0x7f594000b4c0 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.111+0000 7f5959af9640 1 -- 172.21.15.79:0/2762133247 reap_dead start 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f5959af9640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594000b4c0 0x7f594000d980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f594c00a860 tx=0x7f5940003810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f049d151bb76feab server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c00a480 con 0x7f594000b4c0 2024-06-10T00:18:37.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594c02f070 con 0x7f594000b4c0 2024-06-10T00:18:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f594bfff640 1 -- 172.21.15.79:0/2762133247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c02bcc0 con 0x7f594000b4c0 2024-06-10T00:18:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f595b55c640 1 -- 172.21.15.79:0/2762133247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594000b4c0 msgr2=0x7f594000d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f595b55c640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594000b4c0 0x7f594000d980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f594c00a860 tx=0x7f5940003810 comp rx=0 tx=0).stop 2024-06-10T00:18:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f595b55c640 1 -- 172.21.15.79:0/2762133247 shutdown_connections 2024-06-10T00:18:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f595b55c640 1 --2- 172.21.15.79:0/2762133247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594000b4c0 0x7f594000d980 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f595b55c640 1 -- 172.21.15.79:0/2762133247 >> 172.21.15.79:0/2762133247 conn(0x7f59540b1980 msgr2=0x7f59540b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f595b55c640 1 -- 172.21.15.79:0/2762133247 shutdown_connections 2024-06-10T00:18:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.112+0000 7f595b55c640 1 -- 172.21.15.79:0/2762133247 wait complete. 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.113+0000 7f595b55c640 1 Processor -- start 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.113+0000 7f595b55c640 1 -- start start 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f595b55c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f594000b4c0 0x7f595414f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f595b55c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595414f5e0 0x7f595409b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f595b55c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f595409bc70 0x7f5954154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f595b55c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f59540cf050 con 0x7f595414f5e0 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f595b55c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f59540ced70 con 0x7f595409bc70 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f595b55c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59540cc6d0 con 0x7f594000b4c0 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f5958af7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595414f5e0 0x7f595409b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f5958af7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595414f5e0 0x7f595409b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58618/0 (socket says 172.21.15.79:58618) 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f5958af7640 1 -- 172.21.15.79:0/1671241206 learned_addr learned my addr 172.21.15.79:0/1671241206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f5959af9640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f595409bc70 0x7f5954154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.114+0000 7f59592f8640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f594000b4c0 0x7f595414f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5958af7640 1 -- 172.21.15.79:0/1671241206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f594000b4c0 msgr2=0x7f595414f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5958af7640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f594000b4c0 0x7f595414f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5958af7640 1 -- 172.21.15.79:0/1671241206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f595409bc70 msgr2=0x7f5954154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5958af7640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f595409bc70 0x7f5954154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5958af7640 1 -- 172.21.15.79:0/1671241206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595409c480 con 0x7f595414f5e0 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5958af7640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595414f5e0 0x7f595409b730 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f59440118e0 tx=0x7f5944011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5949ffb640 1 -- 172.21.15.79:0/1671241206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594400faf0 con 0x7f595414f5e0 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5949ffb640 1 -- 172.21.15.79:0/1671241206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594400fc90 con 0x7f595414f5e0 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595409c760 con 0x7f595414f5e0 2024-06-10T00:18:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f5949ffb640 1 -- 172.21.15.79:0/1671241206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944014440 con 0x7f595414f5e0 2024-06-10T00:18:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.115+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595409c0f0 con 0x7f595414f5e0 2024-06-10T00:18:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.116+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5954068540 con 0x7f595414f5e0 2024-06-10T00:18:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.117+0000 7f5949ffb640 1 -- 172.21.15.79:0/1671241206 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5944012040 con 0x7f595414f5e0 2024-06-10T00:18:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.117+0000 7f5949ffb640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f593806be30 0x7f593806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.117+0000 7f5949ffb640 1 -- 172.21.15.79:0/1671241206 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5836+0+0 (secure 0 0 0) 0x7f594408b4e0 con 0x7f595414f5e0 2024-06-10T00:18:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.117+0000 7f59592f8640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f593806be30 0x7f593806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.117+0000 7f59592f8640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f593806be30 0x7f593806e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5950000c00 tx=0x7f5950009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.121+0000 7f5949ffb640 1 -- 172.21.15.79:0/1671241206 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5944019030 con 0x7f595414f5e0 2024-06-10T00:18:37.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.298+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f595409c930 con 0x7f595414f5e0 2024-06-10T00:18:37.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.993+0000 7f5949ffb640 1 -- 172.21.15.79:0/1671241206 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) ==== 169+0+0 (secure 0 0 0) 0x7f59440597c0 con 0x7f595414f5e0 2024-06-10T00:18:37.993 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-06-10T00:18:37.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f593806be30 msgr2=0x7f593806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:37.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f593806be30 0x7f593806e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5950000c00 tx=0x7f5950009040 comp rx=0 tx=0).stop 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595414f5e0 msgr2=0x7f595409b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595414f5e0 0x7f595409b730 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f59440118e0 tx=0x7f5944011da0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 shutdown_connections 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f593806be30 0x7f593806e2f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f595409bc70 0x7f5954154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595414f5e0 0x7f595409b730 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 --2- 172.21.15.79:0/1671241206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f594000b4c0 0x7f595414f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.997+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 >> 172.21.15.79:0/1671241206 conn(0x7f59540b1980 msgr2=0x7f59540b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.998+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 shutdown_connections 2024-06-10T00:18:37.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:37.998+0000 7f595b55c640 1 -- 172.21.15.79:0/1671241206 wait complete. 2024-06-10T00:18:38.012 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-10T00:18:38.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.118+0000 7f776d970640 1 Processor -- start 2024-06-10T00:18:38.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.118+0000 7f776d970640 1 -- start start 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.119+0000 7f776d970640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77680b3800 0x7f77680cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.119+0000 7f776d970640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77680b3c80 con 0x7f77680d08f0 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.119+0000 7f776d970640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77680cf620 con 0x7f77680cf190 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.119+0000 7f776d970640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77680d1c80 con 0x7f77680b3800 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.119+0000 7f7766ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f77680d08f0 0x7f77680d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52082/0 (socket says 172.21.15.79:52082) 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.119+0000 7f7766ffd640 1 -- 172.21.15.79:0/1235472276 learned_addr learned my addr 172.21.15.79:0/1235472276 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f77667fc640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77680b3800 0x7f77680cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255015728 0 0) 0x7f7758001490 con 0x7f77680d08f0 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7754003520 con 0x7f77680d08f0 2024-06-10T00:18:38.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2814959571 0 0) 0x7f7754003520 con 0x7f77680d08f0 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77680b3800 msgr2=0x7f77680cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77680b3800 0x7f77680cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 >> v1:172.21.15.117:6789/0 conn(0x7f77680cf190 legacy=0x7f77680d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77680cf8a0 con 0x7f77680d08f0 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f7758001bc0 con 0x7f77680d08f0 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 >> v1:172.21.15.79:6789/0 conn(0x7f77680d08f0 legacy=0x7f77680d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77540039e0 0x7f7754003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77680b3800 0x7f7754004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7754004d40 0x7f77540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f77680d1c80 con 0x7f7754004d40 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f775400b9f0 con 0x7f77540039e0 2024-06-10T00:18:38.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f775400bbf0 con 0x7f77680b3800 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f77677fe640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7754004d40 0x7f77540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f7766ffd640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77540039e0 0x7f7754003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f77667fc640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77680b3800 0x7f7754004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f77677fe640 1 -- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77680b3800 msgr2=0x7f7754004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f77677fe640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77680b3800 0x7f7754004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f77677fe640 1 -- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77540039e0 msgr2=0x7f7754003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f77677fe640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77540039e0 0x7f7754003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.120+0000 7f77677fe640 1 -- 172.21.15.79:0/1235472276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7754003520 con 0x7f7754004d40 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.121+0000 7f77677fe640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7754004d40 0x7f77540051c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7760001a30 tx=0x7f7754005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1444bbd9083967b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.121+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760037070 con 0x7f7754004d40 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.121+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776002ade0 con 0x7f7754004d40 2024-06-10T00:18:38.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.121+0000 7f7765ffb640 1 -- 172.21.15.79:0/1235472276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760001600 con 0x7f7754004d40 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.122+0000 7f776d970640 1 -- 172.21.15.79:0/1235472276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7754004d40 msgr2=0x7f77540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.122+0000 7f776d970640 1 --2- 172.21.15.79:0/1235472276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7754004d40 0x7f77540051c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7760001a30 tx=0x7f7754005830 comp rx=0 tx=0).stop 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.122+0000 7f77677fe640 1 -- 172.21.15.79:0/1235472276 reap_dead start 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.122+0000 7f776d970640 1 -- 172.21.15.79:0/1235472276 shutdown_connections 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.122+0000 7f776d970640 1 -- 172.21.15.79:0/1235472276 >> 172.21.15.79:0/1235472276 conn(0x7f776809d3c0 msgr2=0x7f77680d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.122+0000 7f776d970640 1 -- 172.21.15.79:0/1235472276 shutdown_connections 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.122+0000 7f776d970640 1 -- 172.21.15.79:0/1235472276 wait complete. 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.123+0000 7f776d970640 1 Processor -- start 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.123+0000 7f776d970640 1 -- start start 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f776d970640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7754004d40 0x7f7768159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f776d970640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f776815a760 0x7f7768156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f776d970640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f776815cd00 0x7f776815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f776d970640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f77680d1ed0 con 0x7f776815a760 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f776d970640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f77680cfe60 con 0x7f7754004d40 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f776d970640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77680b50c0 con 0x7f776815cd00 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f776815a760 0x7f7768156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f776815a760 0x7f7768156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55018/0 (socket says 172.21.15.79:55018) 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 -- 172.21.15.79:0/1795148555 learned_addr learned my addr 172.21.15.79:0/1795148555 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f7766ffd640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7754004d40 0x7f7768159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77677fe640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f776815cd00 0x7f776815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 -- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f776815cd00 msgr2=0x7f776815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f776815cd00 0x7f776815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 -- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7754004d40 msgr2=0x7f7768159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7754004d40 0x7f7768159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 -- 172.21.15.79:0/1795148555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776815abe0 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77677fe640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f776815cd00 0x7f776815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f77667fc640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f776815a760 0x7f7768156990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f77500119a0 tx=0x7f7750011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f775ffff640 1 -- 172.21.15.79:0/1795148555 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775000faf0 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f775ffff640 1 -- 172.21.15.79:0/1795148555 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775000fc90 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f775ffff640 1 -- 172.21.15.79:0/1795148555 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750014440 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.124+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776815b110 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.125+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776815b6d0 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.126+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77680683c0 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.126+0000 7f775ffff640 1 -- 172.21.15.79:0/1795148555 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7750012040 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.126+0000 7f775ffff640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f774806be30 0x7f774806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.127+0000 7f775ffff640 1 -- 172.21.15.79:0/1795148555 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f775008b2f0 con 0x7f776815a760 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.127+0000 7f7766ffd640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f774806be30 0x7f774806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.127+0000 7f7766ffd640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f774806be30 0x7f774806e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f77680ce660 tx=0x7f7758006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:38.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.131+0000 7f775ffff640 1 -- 172.21.15.79:0/1795148555 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7750019030 con 0x7f776815a760 2024-06-10T00:18:38.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.314+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f776808e170 con 0x7f776815a760 2024-06-10T00:18:38.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.317+0000 7f775ffff640 1 -- 172.21.15.79:0/1795148555 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f7750059ea0 con 0x7f776815a760 2024-06-10T00:18:38.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f774806be30 msgr2=0x7f774806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f774806be30 0x7f774806e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f77680ce660 tx=0x7f7758006040 comp rx=0 tx=0).stop 2024-06-10T00:18:38.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f776815a760 msgr2=0x7f7768156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f776815a760 0x7f7768156990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f77500119a0 tx=0x7f7750011e60 comp rx=0 tx=0).stop 2024-06-10T00:18:38.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 shutdown_connections 2024-06-10T00:18:38.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f774806be30 0x7f774806e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f776815cd00 0x7f776815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f776815a760 0x7f7768156990 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 --2- 172.21.15.79:0/1795148555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7754004d40 0x7f7768159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 >> 172.21.15.79:0/1795148555 conn(0x7f776809d3c0 msgr2=0x7f77680caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:38.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 shutdown_connections 2024-06-10T00:18:38.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.319+0000 7f776d970640 1 -- 172.21.15.79:0/1795148555 wait complete. 2024-06-10T00:18:38.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-06-10T00:18:38.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38df177640 1 Processor -- start 2024-06-10T00:18:38.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38df177640 1 -- start start 2024-06-10T00:18:38.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38df177640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38d80ae910 0x7f38d806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38df177640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38df177640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38d80cf190 0x7f38d815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38df177640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f38d806ee60 con 0x7f38d80cf190 2024-06-10T00:18:38.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38df177640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f38d80cf620 con 0x7f38d80ae910 2024-06-10T00:18:38.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38df177640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f38d806d130 con 0x7f38d806ea20 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.431+0000 7f38dd714640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38d80cf190 0x7f38d815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dd714640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38d80cf190 0x7f38d815ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55032/0 (socket says 172.21.15.79:55032) 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dd714640 1 -- 172.21.15.79:0/881350088 learned_addr learned my addr 172.21.15.79:0/881350088 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dcf13640 1 --2- 172.21.15.79:0/881350088 >> v2:172.21.15.117:3300/0 conn(0x7f38d80ae910 0x7f38d806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38d7fff640 1 --2- 172.21.15.79:0/881350088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dd714640 1 -- 172.21.15.79:0/881350088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 msgr2=0x7f38d80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dd714640 1 --2- 172.21.15.79:0/881350088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d80cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dd714640 1 -- 172.21.15.79:0/881350088 >> v2:172.21.15.117:3300/0 conn(0x7f38d80ae910 msgr2=0x7f38d806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dd714640 1 --2- 172.21.15.79:0/881350088 >> v2:172.21.15.117:3300/0 conn(0x7f38d80ae910 0x7f38d806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dd714640 1 -- 172.21.15.79:0/881350088 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d806d410 con 0x7f38d80cf190 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38d7fff640 1 --2- 172.21.15.79:0/881350088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.432+0000 7f38dd714640 1 --2- 172.21.15.79:0/881350088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d815ead0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f38d0009870 tx=0x7f38d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e071420ed847c0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38d77fe640 1 -- 172.21.15.79:0/881350088 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0037070 con 0x7f38d80cf190 2024-06-10T00:18:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38d77fe640 1 -- 172.21.15.79:0/881350088 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d0032440 con 0x7f38d80cf190 2024-06-10T00:18:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38d77fe640 1 -- 172.21.15.79:0/881350088 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0032810 con 0x7f38d80cf190 2024-06-10T00:18:38.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 -- 172.21.15.79:0/881350088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 msgr2=0x7f38d815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 --2- 172.21.15.79:0/881350088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d815ead0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f38d0009870 tx=0x7f38d002a180 comp rx=0 tx=0).stop 2024-06-10T00:18:38.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 -- 172.21.15.79:0/881350088 shutdown_connections 2024-06-10T00:18:38.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 --2- 172.21.15.79:0/881350088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d815ead0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 --2- 172.21.15.79:0/881350088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 --2- 172.21.15.79:0/881350088 >> v2:172.21.15.117:3300/0 conn(0x7f38d80ae910 0x7f38d806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 -- 172.21.15.79:0/881350088 >> 172.21.15.79:0/881350088 conn(0x7f38d80b19f0 msgr2=0x7f38d80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 -- 172.21.15.79:0/881350088 shutdown_connections 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.433+0000 7f38df177640 1 -- 172.21.15.79:0/881350088 wait complete. 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.434+0000 7f38df177640 1 Processor -- start 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.434+0000 7f38df177640 1 -- start start 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38df177640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d81e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38df177640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d80ae910 0x7f38d8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38df177640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d80cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38df177640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38d80aecf0 con 0x7f38d80cf190 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38df177640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38d806d9d0 con 0x7f38d80ae910 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38df177640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f38d815f010 con 0x7f38d806ea20 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38dd714640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d80cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38dd714640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d80cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55042/0 (socket says 172.21.15.79:55042) 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.435+0000 7f38dd714640 1 -- 172.21.15.79:0/1097788837 learned_addr learned my addr 172.21.15.79:0/1097788837 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38dcf13640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d81e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38d7fff640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d80ae910 0x7f38d8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38dd714640 1 -- 172.21.15.79:0/1097788837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 msgr2=0x7f38d81e5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38dd714640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d81e5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38dd714640 1 -- 172.21.15.79:0/1097788837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d80ae910 msgr2=0x7f38d8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38dd714640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d80ae910 0x7f38d8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38dd714640 1 -- 172.21.15.79:0/1097788837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d81e7000 con 0x7f38d80cf190 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38dd714640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d80cdb40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f38d0009870 tx=0x7f38d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38d57fa640 1 -- 172.21.15.79:0/1097788837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0037040 con 0x7f38d80cf190 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38d57fa640 1 -- 172.21.15.79:0/1097788837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d0042070 con 0x7f38d80cf190 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d81e63f0 con 0x7f38d80cf190 2024-06-10T00:18:38.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38d57fa640 1 -- 172.21.15.79:0/1097788837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0030920 con 0x7f38d80cf190 2024-06-10T00:18:38.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.436+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d81e69b0 con 0x7f38d80cf190 2024-06-10T00:18:38.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.437+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d8068430 con 0x7f38d80cf190 2024-06-10T00:18:38.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.437+0000 7f38d57fa640 1 -- 172.21.15.79:0/1097788837 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38d0030ac0 con 0x7f38d80cf190 2024-06-10T00:18:38.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.438+0000 7f38d57fa640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f38b806be30 0x7f38b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:38.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.438+0000 7f38d57fa640 1 -- 172.21.15.79:0/1097788837 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f38d00ab630 con 0x7f38d80cf190 2024-06-10T00:18:38.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.438+0000 7f38dcf13640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f38b806be30 0x7f38b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:38.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.438+0000 7f38dcf13640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f38b806be30 0x7f38b806e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009a60 tx=0x7f38c8003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:38.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.442+0000 7f38d57fa640 1 -- 172.21.15.79:0/1097788837 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f38d0079b00 con 0x7f38d80cf190 2024-06-10T00:18:38.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.684+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7f38d80b09d0 con 0x7f38d80cf190 2024-06-10T00:18:38.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.994+0000 7f38d57fa640 1 -- 172.21.15.79:0/1097788837 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v201) ==== 169+0+0 (secure 0 0 0) 0x7f38d007de00 con 0x7f38d80cf190 2024-06-10T00:18:38.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f38b806be30 msgr2=0x7f38b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f38b806be30 0x7f38b806e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009a60 tx=0x7f38c8003990 comp rx=0 tx=0).stop 2024-06-10T00:18:38.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 msgr2=0x7f38d80cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:38.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d80cdb40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f38d0009870 tx=0x7f38d00046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 shutdown_connections 2024-06-10T00:18:38.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f38b806be30 0x7f38b806e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38d80cf190 0x7f38d80cdb40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d80ae910 0x7f38d8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.996+0000 7f38df177640 1 --2- 172.21.15.79:0/1097788837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d806ea20 0x7f38d81e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:38.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.997+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 >> 172.21.15.79:0/1097788837 conn(0x7f38d80b19f0 msgr2=0x7f38d80acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:38.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.997+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 shutdown_connections 2024-06-10T00:18:38.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:38.997+0000 7f38df177640 1 -- 172.21.15.79:0/1097788837 wait complete. 2024-06-10T00:18:39.008 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-06-10T00:18:39.008 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-06-10T00:18:39.008 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-06-10T00:18:39.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:18:39.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.108+0000 7fc78ba9e640 1 Processor -- start 2024-06-10T00:18:39.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.108+0000 7fc78ba9e640 1 -- start start 2024-06-10T00:18:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78ba9e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7840ae910 0x7fc78406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78ba9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc78406ea20 0x7fc7840cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78ba9e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7840cf190 0x7fc78415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78ba9e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc78406ee60 con 0x7fc7840ae910 2024-06-10T00:18:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78ba9e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc7840cf620 con 0x7fc7840cf190 2024-06-10T00:18:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78ba9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc78406d130 con 0x7fc78406ea20 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78983a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7840ae910 0x7fc78406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78983a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7840ae910 0x7fc78406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55046/0 (socket says 172.21.15.79:55046) 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.109+0000 7fc78983a640 1 -- 172.21.15.79:0/3181619842 learned_addr learned my addr 172.21.15.79:0/3181619842 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc789039640 1 --2- 172.21.15.79:0/3181619842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc78406ea20 0x7fc7840cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc78a03b640 1 --2- 172.21.15.79:0/3181619842 >> v2:172.21.15.117:3300/0 conn(0x7fc7840cf190 0x7fc78415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc78983a640 1 -- 172.21.15.79:0/3181619842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc78406ea20 msgr2=0x7fc7840cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc78983a640 1 --2- 172.21.15.79:0/3181619842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc78406ea20 0x7fc7840cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc78983a640 1 -- 172.21.15.79:0/3181619842 >> v2:172.21.15.117:3300/0 conn(0x7fc7840cf190 msgr2=0x7fc78415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc78983a640 1 --2- 172.21.15.79:0/3181619842 >> v2:172.21.15.117:3300/0 conn(0x7fc7840cf190 0x7fc78415ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc78983a640 1 -- 172.21.15.79:0/3181619842 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78406d410 con 0x7fc7840ae910 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc78983a640 1 --2- 172.21.15.79:0/3181619842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840ae910 0x7fc78406e4e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc78000d150 tx=0x7fc78002c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d2e5719262cf06 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.110+0000 7fc788838640 1 -- 172.21.15.79:0/3181619842 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780039070 con 0x7fc7840ae910 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc788838640 1 -- 172.21.15.79:0/3181619842 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc780009600 con 0x7fc7840ae910 2024-06-10T00:18:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc788838640 1 -- 172.21.15.79:0/3181619842 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7800099d0 con 0x7fc7840ae910 2024-06-10T00:18:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 -- 172.21.15.79:0/3181619842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840ae910 msgr2=0x7fc78406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/3181619842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840ae910 0x7fc78406e4e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc78000d150 tx=0x7fc78002c840 comp rx=0 tx=0).stop 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 -- 172.21.15.79:0/3181619842 shutdown_connections 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/3181619842 >> v2:172.21.15.117:3300/0 conn(0x7fc7840cf190 0x7fc78415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/3181619842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc78406ea20 0x7fc7840cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/3181619842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840ae910 0x7fc78406e4e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 -- 172.21.15.79:0/3181619842 >> 172.21.15.79:0/3181619842 conn(0x7fc7840b19f0 msgr2=0x7fc7840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 -- 172.21.15.79:0/3181619842 shutdown_connections 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.111+0000 7fc78ba9e640 1 -- 172.21.15.79:0/3181619842 wait complete. 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.112+0000 7fc78ba9e640 1 Processor -- start 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.112+0000 7fc78ba9e640 1 -- start start 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78ba9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc78406ea20 0x7fc7840ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78ba9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7840ae910 0x7fc784152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78ba9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840cf190 0x7fc7841f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78ba9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7840aecf0 con 0x7fc7840cf190 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78ba9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc78406d9d0 con 0x7fc78406ea20 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78ba9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc78415f010 con 0x7fc7840ae910 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78a03b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840cf190 0x7fc7841f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78a03b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840cf190 0x7fc7841f3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55056/0 (socket says 172.21.15.79:55056) 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78a03b640 1 -- 172.21.15.79:0/2404710564 learned_addr learned my addr 172.21.15.79:0/2404710564 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78983a640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc78406ea20 0x7fc7840ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc789039640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7840ae910 0x7fc784152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78a03b640 1 -- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7840ae910 msgr2=0x7fc784152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78a03b640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7840ae910 0x7fc784152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78a03b640 1 -- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc78406ea20 msgr2=0x7fc7840ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78a03b640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc78406ea20 0x7fc7840ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78a03b640 1 -- 172.21.15.79:0/2404710564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc784153170 con 0x7fc7840cf190 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.113+0000 7fc78983a640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc78406ea20 0x7fc7840ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.114+0000 7fc78a03b640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840cf190 0x7fc7841f3900 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00d800 tx=0x7fc77c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.114+0000 7fc77a7fc640 1 -- 172.21.15.79:0/2404710564 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00b6c0 con 0x7fc7840cf190 2024-06-10T00:18:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.114+0000 7fc77a7fc640 1 -- 172.21.15.79:0/2404710564 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77c019070 con 0x7fc7840cf190 2024-06-10T00:18:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.114+0000 7fc77a7fc640 1 -- 172.21.15.79:0/2404710564 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00bac0 con 0x7fc7840cf190 2024-06-10T00:18:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.114+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7840cd2e0 con 0x7fc7840cf190 2024-06-10T00:18:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.114+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7840c9480 con 0x7fc7840cf190 2024-06-10T00:18:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.115+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc784068430 con 0x7fc7840cf190 2024-06-10T00:18:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.115+0000 7fc77a7fc640 1 -- 172.21.15.79:0/2404710564 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc77c00bc60 con 0x7fc7840cf190 2024-06-10T00:18:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.116+0000 7fc77a7fc640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc76806be30 0x7fc76806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.116+0000 7fc77a7fc640 1 -- 172.21.15.79:0/2404710564 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7fc77c08b100 con 0x7fc7840cf190 2024-06-10T00:18:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.116+0000 7fc78983a640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc76806be30 0x7fc76806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.116+0000 7fc78983a640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc76806be30 0x7fc76806e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc780036000 tx=0x7fc78000b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.120+0000 7fc77a7fc640 1 -- 172.21.15.79:0/2404710564 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc77c059cb0 con 0x7fc7840cf190 2024-06-10T00:18:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.295+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc78409ba60 con 0x7fc7840cf190 2024-06-10T00:18:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.295+0000 7fc77a7fc640 1 -- 172.21.15.79:0/2404710564 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+13246 (secure 0 0 0) 0x7fc77c0595b0 con 0x7fc7840cf190 2024-06-10T00:18:39.295 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:39.295 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":66,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:18:37.990153+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/3634814301":"2024-06-11T00:18:34.789673+0000","172.21.15.79:6835/3634814301":"2024-06-11T00:18:34.789673+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:18:39.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.297+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc76806be30 msgr2=0x7fc76806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.297+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc76806be30 0x7fc76806e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc780036000 tx=0x7fc78000b000 comp rx=0 tx=0).stop 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.297+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840cf190 msgr2=0x7fc7841f3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.297+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840cf190 0x7fc7841f3900 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00d800 tx=0x7fc77c00dcc0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.298+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 shutdown_connections 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.298+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc76806be30 0x7fc76806e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.298+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7840cf190 0x7fc7841f3900 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.298+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7840ae910 0x7fc784152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.298+0000 7fc78ba9e640 1 --2- 172.21.15.79:0/2404710564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc78406ea20 0x7fc7840ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.298+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 >> 172.21.15.79:0/2404710564 conn(0x7fc7840b19f0 msgr2=0x7fc784071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.298+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 shutdown_connections 2024-06-10T00:18:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.298+0000 7fc78ba9e640 1 -- 172.21.15.79:0/2404710564 wait complete. 2024-06-10T00:18:39.308 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-10T00:14:31.177808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-10T00:18:39.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-10T00:18:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.411+0000 7f1a5d3f9640 1 Processor -- start 2024-06-10T00:18:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.411+0000 7f1a5d3f9640 1 -- start start 2024-06-10T00:18:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.412+0000 7f1a5d3f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a580cf360 0x7f1a580d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.412+0000 7f1a5d3f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a580cf8a0 con 0x7f1a580d08f0 2024-06-10T00:18:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.412+0000 7f1a5d3f9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a580cfb80 con 0x7f1a580b3800 2024-06-10T00:18:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.412+0000 7f1a5d3f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1a580d1c80 con 0x7f1a580cf360 2024-06-10T00:18:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.412+0000 7f1a577fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a580cf360 0x7f1a580d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.412+0000 7f1a56ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1a580d08f0 0x7f1a580d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52084/0 (socket says 172.21.15.79:52084) 2024-06-10T00:18:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.412+0000 7f1a56ffd640 1 -- 172.21.15.79:0/573404194 learned_addr learned my addr 172.21.15.79:0/573404194 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.412+0000 7f1a577fe640 1 --2- 172.21.15.79:0/573404194 >> v2:172.21.15.79:3300/0 conn(0x7f1a580cf360 0x7f1a580d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55068/0 (socket says 172.21.15.79:55068) 2024-06-10T00:18:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.413+0000 7f1a577fe640 1 -- 172.21.15.79:0/573404194 >> v1:172.21.15.117:6789/0 conn(0x7f1a580b3800 legacy=0x7f1a580cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.413+0000 7f1a577fe640 1 -- 172.21.15.79:0/573404194 >> v1:172.21.15.79:6789/0 conn(0x7f1a580d08f0 legacy=0x7f1a580d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.413+0000 7f1a577fe640 1 -- 172.21.15.79:0/573404194 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a580cfe60 con 0x7f1a580cf360 2024-06-10T00:18:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.413+0000 7f1a577fe640 1 --2- 172.21.15.79:0/573404194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580d23f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1a500097d0 tx=0x7f1a5002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f99783deb0696d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.413+0000 7f1a55ffb640 1 -- 172.21.15.79:0/573404194 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50037070 con 0x7f1a580cf360 2024-06-10T00:18:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.413+0000 7f1a55ffb640 1 -- 172.21.15.79:0/573404194 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a50032440 con 0x7f1a580cf360 2024-06-10T00:18:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.414+0000 7f1a55ffb640 1 -- 172.21.15.79:0/573404194 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50032810 con 0x7f1a580cf360 2024-06-10T00:18:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.414+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/573404194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 msgr2=0x7f1a580d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.414+0000 7f1a5d3f9640 1 --2- 172.21.15.79:0/573404194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580d23f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1a500097d0 tx=0x7f1a5002a210 comp rx=0 tx=0).stop 2024-06-10T00:18:39.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.414+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/573404194 shutdown_connections 2024-06-10T00:18:39.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.414+0000 7f1a5d3f9640 1 --2- 172.21.15.79:0/573404194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580d23f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.414+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/573404194 >> 172.21.15.79:0/573404194 conn(0x7f1a5809d3c0 msgr2=0x7f1a580d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:39.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.414+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/573404194 shutdown_connections 2024-06-10T00:18:39.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.414+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/573404194 wait complete. 2024-06-10T00:18:39.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.415+0000 7f1a5d3f9640 1 Processor -- start 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.415+0000 7f1a5d3f9640 1 -- start start 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a5d3f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a580b3800 0x7f1a58152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a5d3f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a5d3f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a580d08f0 0x7f1a580c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a5d3f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a580b50c0 con 0x7f1a580cf360 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a5d3f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a580b3cb0 con 0x7f1a580d08f0 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a5d3f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1a580b4a60 con 0x7f1a580b3800 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a567fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a567fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55076/0 (socket says 172.21.15.79:55076) 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a567fc640 1 -- 172.21.15.79:0/2365180302 learned_addr learned my addr 172.21.15.79:0/2365180302 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a567fc640 1 -- 172.21.15.79:0/2365180302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a580b3800 msgr2=0x7f1a58152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a567fc640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a580b3800 0x7f1a58152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a567fc640 1 -- 172.21.15.79:0/2365180302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a580d08f0 msgr2=0x7f1a580c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a577fe640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a580d08f0 0x7f1a580c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a567fc640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a580d08f0 0x7f1a580c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.416+0000 7f1a567fc640 1 -- 172.21.15.79:0/2365180302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a58152a70 con 0x7f1a580cf360 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.417+0000 7f1a567fc640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580c9070 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c460 tx=0x7f1a4000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.417+0000 7f1a4f7fe640 1 -- 172.21.15.79:0/2365180302 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40016020 con 0x7f1a580cf360 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.417+0000 7f1a4f7fe640 1 -- 172.21.15.79:0/2365180302 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a40012870 con 0x7f1a580cf360 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.417+0000 7f1a4f7fe640 1 -- 172.21.15.79:0/2365180302 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40012c60 con 0x7f1a580cf360 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.417+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a580b91d0 con 0x7f1a580cf360 2024-06-10T00:18:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.417+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a580b9790 con 0x7f1a580cf360 2024-06-10T00:18:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.418+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a581612f0 con 0x7f1a580cf360 2024-06-10T00:18:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.418+0000 7f1a4f7fe640 1 -- 172.21.15.79:0/2365180302 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a40019020 con 0x7f1a580cf360 2024-06-10T00:18:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.419+0000 7f1a4f7fe640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1a3806be30 0x7f1a3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.419+0000 7f1a4f7fe640 1 -- 172.21.15.79:0/2365180302 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f1a4008a9e0 con 0x7f1a580cf360 2024-06-10T00:18:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.419+0000 7f1a56ffd640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1a3806be30 0x7f1a3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.419+0000 7f1a56ffd640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1a3806be30 0x7f1a3806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1a480012e0 tx=0x7f1a48001590 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.423+0000 7f1a4f7fe640 1 -- 172.21.15.79:0/2365180302 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1a581612f0 con 0x7f1a580cf360 2024-06-10T00:18:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.594+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a580683c0 con 0x7f1a580cf360 2024-06-10T00:18:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.594+0000 7f1a4f7fe640 1 -- 172.21.15.79:0/2365180302 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7f1a40020030 con 0x7f1a580cf360 2024-06-10T00:18:39.594 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-06-10T00:18:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1a3806be30 msgr2=0x7f1a3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1a3806be30 0x7f1a3806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1a480012e0 tx=0x7f1a48001590 comp rx=0 tx=0).stop 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 msgr2=0x7f1a580c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580c9070 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c460 tx=0x7f1a4000c920 comp rx=0 tx=0).stop 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 shutdown_connections 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1a3806be30 0x7f1a3806e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a580d08f0 0x7f1a580c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a580cf360 0x7f1a580c9070 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 --2- 172.21.15.79:0/2365180302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a580b3800 0x7f1a58152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.596+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 >> 172.21.15.79:0/2365180302 conn(0x7f1a5809d3c0 msgr2=0x7f1a580b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.597+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 shutdown_connections 2024-06-10T00:18:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.597+0000 7f1a5d3f9640 1 -- 172.21.15.79:0/2365180302 wait complete. 2024-06-10T00:18:39.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-06-10T00:18:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.706+0000 7f4630072640 1 Processor -- start 2024-06-10T00:18:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f4630072640 1 -- start start 2024-06-10T00:18:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f4630072640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f462815f1a0 0x7f46280d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f4630072640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462815f5e0 con 0x7f46280cef70 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f4630072640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46280d0ad0 con 0x7f46280d2680 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f4630072640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f46280d13e0 con 0x7f462815f1a0 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f462d60d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f462815f1a0 0x7f46280d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f462e60f640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f46280cef70 0x7f46280cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52094/0 (socket says 172.21.15.79:52094) 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f462d60d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f462815f1a0 0x7f46280d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55090/0 (socket says 172.21.15.79:55090) 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.707+0000 7f462e60f640 1 -- 172.21.15.79:0/4211730611 learned_addr learned my addr 172.21.15.79:0/4211730611 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.708+0000 7f462d60d640 1 -- 172.21.15.79:0/4211730611 >> v1:172.21.15.117:6789/0 conn(0x7f46280d2680 legacy=0x7f46280d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.708+0000 7f462d60d640 1 -- 172.21.15.79:0/4211730611 >> v1:172.21.15.79:6789/0 conn(0x7f46280cef70 legacy=0x7f46280cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.708+0000 7f462d60d640 1 -- 172.21.15.79:0/4211730611 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462815f890 con 0x7f462815f1a0 2024-06-10T00:18:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.708+0000 7f462d60d640 1 --2- 172.21.15.79:0/4211730611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280d1fc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f461c0097a0 tx=0x7f461c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752d1392700d6049 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f462ce0c640 1 -- 172.21.15.79:0/4211730611 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c037070 con 0x7f462815f1a0 2024-06-10T00:18:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f462ce0c640 1 -- 172.21.15.79:0/4211730611 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f461c032440 con 0x7f462815f1a0 2024-06-10T00:18:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f462ce0c640 1 -- 172.21.15.79:0/4211730611 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c032810 con 0x7f462815f1a0 2024-06-10T00:18:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f4630072640 1 -- 172.21.15.79:0/4211730611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 msgr2=0x7f46280d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f4630072640 1 --2- 172.21.15.79:0/4211730611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280d1fc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f461c0097a0 tx=0x7f461c02a230 comp rx=0 tx=0).stop 2024-06-10T00:18:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f4630072640 1 -- 172.21.15.79:0/4211730611 shutdown_connections 2024-06-10T00:18:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f4630072640 1 --2- 172.21.15.79:0/4211730611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280d1fc0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f4630072640 1 -- 172.21.15.79:0/4211730611 >> 172.21.15.79:0/4211730611 conn(0x7f462809d3f0 msgr2=0x7f46280d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f4630072640 1 -- 172.21.15.79:0/4211730611 shutdown_connections 2024-06-10T00:18:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.709+0000 7f4630072640 1 -- 172.21.15.79:0/4211730611 wait complete. 2024-06-10T00:18:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.710+0000 7f4630072640 1 Processor -- start 2024-06-10T00:18:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.710+0000 7f4630072640 1 -- start start 2024-06-10T00:18:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f4630072640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46280cef70 0x7f462815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f4630072640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46280d2680 0x7f46280b9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f4630072640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f4630072640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46280d4f00 con 0x7f462815f1a0 2024-06-10T00:18:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f4630072640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46280d1070 con 0x7f46280d2680 2024-06-10T00:18:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f4630072640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f46280d1870 con 0x7f46280cef70 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f462e60f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f462e60f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55106/0 (socket says 172.21.15.79:55106) 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f462e60f640 1 -- 172.21.15.79:0/2124418231 learned_addr learned my addr 172.21.15.79:0/2124418231 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f462d60d640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46280d2680 0x7f46280b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.711+0000 7f462de0e640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46280cef70 0x7f462815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f462e60f640 1 -- 172.21.15.79:0/2124418231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46280cef70 msgr2=0x7f462815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f462e60f640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46280cef70 0x7f462815be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f462e60f640 1 -- 172.21.15.79:0/2124418231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46280d2680 msgr2=0x7f46280b9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f462e60f640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46280d2680 0x7f46280b9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f462e60f640 1 -- 172.21.15.79:0/2124418231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462815ce70 con 0x7f462815f1a0 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f462e60f640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280b8610 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f462000c450 tx=0x7f462000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f46267fc640 1 -- 172.21.15.79:0/2124418231 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620017070 con 0x7f462815f1a0 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f46267fc640 1 -- 172.21.15.79:0/2124418231 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620005ce0 con 0x7f462815f1a0 2024-06-10T00:18:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f46267fc640 1 -- 172.21.15.79:0/2124418231 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620007270 con 0x7f462815f1a0 2024-06-10T00:18:39.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462815d150 con 0x7f462815f1a0 2024-06-10T00:18:39.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.712+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462815dc30 con 0x7f462815f1a0 2024-06-10T00:18:39.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.713+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4628068430 con 0x7f462815f1a0 2024-06-10T00:18:39.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.713+0000 7f46267fc640 1 -- 172.21.15.79:0/2124418231 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f462001a070 con 0x7f462815f1a0 2024-06-10T00:18:39.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.714+0000 7f46267fc640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461406be30 0x7f461406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:39.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.714+0000 7f46267fc640 1 -- 172.21.15.79:0/2124418231 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f4620089dd0 con 0x7f462815f1a0 2024-06-10T00:18:39.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.714+0000 7f462de0e640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461406be30 0x7f461406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:39.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.714+0000 7f462de0e640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461406be30 0x7f461406e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f46180012e0 tx=0x7f4618009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.718+0000 7f46267fc640 1 -- 172.21.15.79:0/2124418231 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4620058330 con 0x7f462815f1a0 2024-06-10T00:18:39.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:39.957+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f462815e950 con 0x7f462815f1a0 2024-06-10T00:18:40.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.001+0000 7f46267fc640 1 -- 172.21.15.79:0/2124418231 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v202) ==== 169+0+0 (secure 0 0 0) 0x7f462008b0f0 con 0x7f462815f1a0 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461406be30 msgr2=0x7f461406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461406be30 0x7f461406e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f46180012e0 tx=0x7f4618009040 comp rx=0 tx=0).stop 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 msgr2=0x7f46280b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280b8610 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f462000c450 tx=0x7f462000c910 comp rx=0 tx=0).stop 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 shutdown_connections 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461406be30 0x7f461406e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f462815f1a0 0x7f46280b8610 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46280d2680 0x7f46280b9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 --2- 172.21.15.79:0/2124418231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46280cef70 0x7f462815be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 >> 172.21.15.79:0/2124418231 conn(0x7f462809d3f0 msgr2=0x7f462815a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:40.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 shutdown_connections 2024-06-10T00:18:40.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.003+0000 7f4630072640 1 -- 172.21.15.79:0/2124418231 wait complete. 2024-06-10T00:18:40.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-10T00:18:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.116+0000 7f8d7fbb7640 1 Processor -- start 2024-06-10T00:18:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.117+0000 7f8d7fbb7640 1 -- start start 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.117+0000 7f8d7fbb7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d780d08f0 0x7f8d780b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.117+0000 7f8d7fbb7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d780d0cd0 0x7f8d780cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.117+0000 7f8d7fbb7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d780cf5e0 con 0x7f8d780cf190 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7fbb7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8d780d1c80 con 0x7f8d780d0cd0 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7fbb7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8d780cf8a0 con 0x7f8d780d08f0 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7d152640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d780d0cd0 0x7f8d780cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7e154640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8d780cf190 0x7f8d780d23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52098/0 (socket says 172.21.15.79:52098) 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7e154640 1 -- 172.21.15.79:0/764007828 learned_addr learned my addr 172.21.15.79:0/764007828 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7d152640 1 -- 172.21.15.79:0/764007828 >> v2:172.21.15.117:3300/0 conn(0x7f8d780d08f0 msgr2=0x7f8d780b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7d953640 1 --2- 172.21.15.79:0/764007828 >> v2:172.21.15.117:3300/0 conn(0x7f8d780d08f0 0x7f8d780b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7c951640 1 -- 172.21.15.79:0/764007828 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830506704 0 0) 0x7f8d780cf5e0 con 0x7f8d780cf190 2024-06-10T00:18:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7d152640 1 --2- 172.21.15.79:0/764007828 >> v2:172.21.15.117:3300/0 conn(0x7f8d780d08f0 0x7f8d780b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7d152640 1 -- 172.21.15.79:0/764007828 >> v1:172.21.15.79:6789/0 conn(0x7f8d780cf190 legacy=0x7f8d780d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7d152640 1 -- 172.21.15.79:0/764007828 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d780cfb80 con 0x7f8d780d0cd0 2024-06-10T00:18:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.118+0000 7f8d7d953640 1 --2- 172.21.15.79:0/764007828 >> v2:172.21.15.117:3300/0 conn(0x7f8d780d08f0 0x7f8d780b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7d152640 1 --2- 172.21.15.79:0/764007828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780d0cd0 0x7f8d780cec50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097a0 tx=0x7f8d7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6cb236409ede18 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7c951640 1 -- 172.21.15.79:0/764007828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74037070 con 0x7f8d780d0cd0 2024-06-10T00:18:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7c951640 1 -- 172.21.15.79:0/764007828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74032440 con 0x7f8d780d0cd0 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7c951640 1 -- 172.21.15.79:0/764007828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74032810 con 0x7f8d780d0cd0 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/764007828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780d0cd0 msgr2=0x7f8d780cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/764007828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780d0cd0 0x7f8d780cec50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097a0 tx=0x7f8d7402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/764007828 shutdown_connections 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/764007828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780d0cd0 0x7f8d780cec50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/764007828 >> v2:172.21.15.117:3300/0 conn(0x7f8d780d08f0 0x7f8d780b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/764007828 >> 172.21.15.79:0/764007828 conn(0x7f8d7809d3c0 msgr2=0x7f8d780d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.119+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/764007828 shutdown_connections 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.120+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/764007828 wait complete. 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7fbb7640 1 Processor -- start 2024-06-10T00:18:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7fbb7640 1 -- start start 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7fbb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780cf190 0x7f8d780b9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7fbb7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d780d08f0 0x7f8d7814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7fbb7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d780d0cd0 0x7f8d780b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7fbb7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8d780b50c0 con 0x7f8d780cf190 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7fbb7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8d780d1ed0 con 0x7f8d780d08f0 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7fbb7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8d780d1180 con 0x7f8d780d0cd0 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7d953640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780cf190 0x7f8d780b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7d953640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780cf190 0x7f8d780b9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55124/0 (socket says 172.21.15.79:55124) 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.121+0000 7f8d7d953640 1 -- 172.21.15.79:0/2652184458 learned_addr learned my addr 172.21.15.79:0/2652184458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:40.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7d152640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d780d08f0 0x7f8d7814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7e154640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d780d0cd0 0x7f8d780b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7d953640 1 -- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d780d0cd0 msgr2=0x7f8d780b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7d953640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d780d0cd0 0x7f8d780b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7d953640 1 -- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d780d08f0 msgr2=0x7f8d7814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7d953640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d780d08f0 0x7f8d7814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7d953640 1 -- 172.21.15.79:0/2652184458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d780b87c0 con 0x7f8d780cf190 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7d152640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d780d08f0 0x7f8d7814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7d953640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780cf190 0x7f8d780b9860 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c7f0 tx=0x7f8d6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d6a7fc640 1 -- 172.21.15.79:0/2652184458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c015070 con 0x7f8d780cf190 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d6a7fc640 1 -- 172.21.15.79:0/2652184458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c007a30 con 0x7f8d780cf190 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d780b8aa0 con 0x7f8d780cf190 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d6a7fc640 1 -- 172.21.15.79:0/2652184458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c007e00 con 0x7f8d780cf190 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.122+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d780b9060 con 0x7f8d780cf190 2024-06-10T00:18:40.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.123+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d780b1470 con 0x7f8d780cf190 2024-06-10T00:18:40.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.124+0000 7f8d6a7fc640 1 -- 172.21.15.79:0/2652184458 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d6c018070 con 0x7f8d780cf190 2024-06-10T00:18:40.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.124+0000 7f8d6a7fc640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8d5c06be30 0x7f8d5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.124+0000 7f8d6a7fc640 1 -- 172.21.15.79:0/2652184458 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f8d6c08ace0 con 0x7f8d780cf190 2024-06-10T00:18:40.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.124+0000 7f8d7d152640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8d5c06be30 0x7f8d5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.125+0000 7f8d7d152640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8d5c06be30 0x7f8d5c06e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8d74034000 tx=0x7f8d7402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:40.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.128+0000 7f8d6a7fc640 1 -- 172.21.15.79:0/2652184458 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8d780b1470 con 0x7f8d780cf190 2024-06-10T00:18:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.300+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8d780683c0 con 0x7f8d780cf190 2024-06-10T00:18:40.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.303+0000 7f8d6a7fc640 1 -- 172.21.15.79:0/2652184458 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f8d6c059800 con 0x7f8d780cf190 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8d5c06be30 msgr2=0x7f8d5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8d5c06be30 0x7f8d5c06e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8d74034000 tx=0x7f8d7402e000 comp rx=0 tx=0).stop 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780cf190 msgr2=0x7f8d780b9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780cf190 0x7f8d780b9860 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c7f0 tx=0x7f8d6c00cbf0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 shutdown_connections 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8d5c06be30 0x7f8d5c06e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d780d0cd0 0x7f8d780b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d780d08f0 0x7f8d7814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 --2- 172.21.15.79:0/2652184458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d780cf190 0x7f8d780b9860 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 >> 172.21.15.79:0/2652184458 conn(0x7f8d7809d3c0 msgr2=0x7f8d7806d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:40.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 shutdown_connections 2024-06-10T00:18:40.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.305+0000 7f8d7fbb7640 1 -- 172.21.15.79:0/2652184458 wait complete. 2024-06-10T00:18:40.316 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:18:40.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:18:40.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:18:40.404 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:18:40.404 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:18:40.404 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:40.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:18:40.420 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:18:40.420 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:40.463 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:18:40.463 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:18:40.463 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:40.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:18:40.478 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:18:40.479 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:40.520 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:18:40.520 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-10T00:18:40.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:40.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.619+0000 7fb965a12640 1 Processor -- start 2024-06-10T00:18:40.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.619+0000 7fb965a12640 1 -- start start 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb965a12640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9600b7940 0x7fb9600d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb965a12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9600b4c80 0x7fb9600ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb965a12640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9600b7d20 con 0x7fb9600cec10 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb965a12640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb9600cc620 con 0x7fb9600b7940 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb965a12640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb9600cc900 con 0x7fb9600b4c80 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb95effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9600b7940 0x7fb9600d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb95f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb9600cec10 0x7fb96006c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52106/0 (socket says 172.21.15.79:52106) 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb95f7fe640 1 -- 172.21.15.79:0/441142185 learned_addr learned my addr 172.21.15.79:0/441142185 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb9567fc640 1 --2- 172.21.15.79:0/441142185 >> v2:172.21.15.117:3300/0 conn(0x7fb9600b4c80 0x7fb9600ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb95effd640 1 -- 172.21.15.79:0/441142185 >> v2:172.21.15.117:3300/0 conn(0x7fb9600b4c80 msgr2=0x7fb9600ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb95effd640 1 --2- 172.21.15.79:0/441142185 >> v2:172.21.15.117:3300/0 conn(0x7fb9600b4c80 0x7fb9600ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb95effd640 1 -- 172.21.15.79:0/441142185 >> v1:172.21.15.79:6789/0 conn(0x7fb9600cec10 legacy=0x7fb96006c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb95effd640 1 -- 172.21.15.79:0/441142185 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9600ccbe0 con 0x7fb9600b7940 2024-06-10T00:18:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.620+0000 7fb9567fc640 1 --2- 172.21.15.79:0/441142185 >> v2:172.21.15.117:3300/0 conn(0x7fb9600b4c80 0x7fb9600ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.621+0000 7fb95effd640 1 --2- 172.21.15.79:0/441142185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b7940 0x7fb9600d0af0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb9600d1e20 tx=0x7fb95002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f437f86ebc5269bb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.621+0000 7fb95e7fc640 1 -- 172.21.15.79:0/441142185 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950037070 con 0x7fb9600b7940 2024-06-10T00:18:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.621+0000 7fb95e7fc640 1 -- 172.21.15.79:0/441142185 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb950032440 con 0x7fb9600b7940 2024-06-10T00:18:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.621+0000 7fb95e7fc640 1 -- 172.21.15.79:0/441142185 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950032810 con 0x7fb9600b7940 2024-06-10T00:18:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.622+0000 7fb965a12640 1 -- 172.21.15.79:0/441142185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b7940 msgr2=0x7fb9600d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.622+0000 7fb965a12640 1 --2- 172.21.15.79:0/441142185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b7940 0x7fb9600d0af0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb9600d1e20 tx=0x7fb95002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.622+0000 7fb965a12640 1 -- 172.21.15.79:0/441142185 shutdown_connections 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.622+0000 7fb965a12640 1 --2- 172.21.15.79:0/441142185 >> v2:172.21.15.117:3300/0 conn(0x7fb9600b4c80 0x7fb9600ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.622+0000 7fb965a12640 1 --2- 172.21.15.79:0/441142185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b7940 0x7fb9600d0af0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.622+0000 7fb965a12640 1 -- 172.21.15.79:0/441142185 >> 172.21.15.79:0/441142185 conn(0x7fb9600d1e50 msgr2=0x7fb9600d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.622+0000 7fb965a12640 1 -- 172.21.15.79:0/441142185 shutdown_connections 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.622+0000 7fb965a12640 1 -- 172.21.15.79:0/441142185 wait complete. 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.623+0000 7fb965a12640 1 Processor -- start 2024-06-10T00:18:40.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.623+0000 7fb965a12640 1 -- start start 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb965a12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b4c80 0x7fb9601f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb965a12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9600b7940 0x7fb96006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb965a12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9600cec10 0x7fb96014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb965a12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9600d2c10 con 0x7fb9600b4c80 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb965a12640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb9600d2a90 con 0x7fb9600b7940 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb965a12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb9600d1030 con 0x7fb9600cec10 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b4c80 0x7fb9601f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b4c80 0x7fb9601f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55132/0 (socket says 172.21.15.79:55132) 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 -- 172.21.15.79:0/747278070 learned_addr learned my addr 172.21.15.79:0/747278070 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb9567fc640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9600b7940 0x7fb96006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 -- 172.21.15.79:0/747278070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9600cec10 msgr2=0x7fb96014b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9600cec10 0x7fb96014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 -- 172.21.15.79:0/747278070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9600b7940 msgr2=0x7fb96006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9600b7940 0x7fb96006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 -- 172.21.15.79:0/747278070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96006c720 con 0x7fb9600b4c80 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95effd640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b4c80 0x7fb9601f7020 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb950000c00 tx=0x7fb9500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95cff9640 1 -- 172.21.15.79:0/747278070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950037040 con 0x7fb9600b4c80 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95cff9640 1 -- 172.21.15.79:0/747278070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb950042070 con 0x7fb9600b4c80 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96006ca00 con 0x7fb9600b4c80 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb95cff9640 1 -- 172.21.15.79:0/747278070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950030a50 con 0x7fb9600b4c80 2024-06-10T00:18:40.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.624+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96006cfc0 con 0x7fb9600b4c80 2024-06-10T00:18:40.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.626+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb960068430 con 0x7fb9600b4c80 2024-06-10T00:18:40.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.626+0000 7fb95cff9640 1 -- 172.21.15.79:0/747278070 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb950030bf0 con 0x7fb9600b4c80 2024-06-10T00:18:40.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.626+0000 7fb95cff9640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb94006be30 0x7fb94006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:40.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.626+0000 7fb95cff9640 1 -- 172.21.15.79:0/747278070 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7fb9500ab710 con 0x7fb9600b4c80 2024-06-10T00:18:40.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.626+0000 7fb9567fc640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb94006be30 0x7fb94006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:40.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.627+0000 7fb9567fc640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb94006be30 0x7fb94006e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb9600c5a30 tx=0x7fb948008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:40.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.630+0000 7fb95cff9640 1 -- 172.21.15.79:0/747278070 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb95007a2c0 con 0x7fb9600b4c80 2024-06-10T00:18:40.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.843+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9600710e0 con 0x7fb9600b4c80 2024-06-10T00:18:40.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.843+0000 7fb95cff9640 1 -- 172.21.15.79:0/747278070 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+3872 (secure 0 0 0) 0x7fb950079bc0 con 0x7fb9600b4c80 2024-06-10T00:18:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:40.843 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3652733123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3652733123},{"type":"v1","addr":"172.21.15.117:6833","nonce":3652733123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3961097225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3961097225},{"type":"v1","addr":"172.21.15.117:6835","nonce":3961097225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/414653780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":414653780},{"type":"v1","addr":"172.21.15.79:6836","nonce":414653780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2380896993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2380896993},{"type":"v1","addr":"172.21.15.79:6837","nonce":2380896993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[]} 2024-06-10T00:18:40.843 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 33 2024-06-10T00:18:40.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb94006be30 msgr2=0x7fb94006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb94006be30 0x7fb94006e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb9600c5a30 tx=0x7fb948008040 comp rx=0 tx=0).stop 2024-06-10T00:18:40.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b4c80 msgr2=0x7fb9601f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:40.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b4c80 0x7fb9601f7020 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb950000c00 tx=0x7fb9500046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 shutdown_connections 2024-06-10T00:18:40.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb94006be30 0x7fb94006e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9600cec10 0x7fb96014b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9600b7940 0x7fb96006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 --2- 172.21.15.79:0/747278070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9600b4c80 0x7fb9601f7020 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:40.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 >> 172.21.15.79:0/747278070 conn(0x7fb9600d1e50 msgr2=0x7fb9601614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:40.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 shutdown_connections 2024-06-10T00:18:40.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:40.845+0000 7fb965a12640 1 -- 172.21.15.79:0/747278070 wait complete. 2024-06-10T00:18:40.856 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-10T00:18:40.856 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-10T00:18:40.856 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-10T00:18:40.856 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:18:40.857 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-10T00:18:40.857 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-10T00:18:40.857 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-10T00:18:40.857 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:18:40.857 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-10T00:18:40.857 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-10T00:18:40.857 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-10T00:18:40.857 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:18:40.857 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-10T00:18:40.858 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-10T00:18:40.858 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-10T00:18:40.858 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:18:40.866 INFO:tasks.ceph.mds.a:Stopped 2024-06-10T00:18:40.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-10T00:18:40.867 INFO:tasks.ceph.mds.c:Stopped 2024-06-10T00:18:40.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-10T00:18:40.868 INFO:tasks.ceph.mds.b:Stopped 2024-06-10T00:18:40.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-10T00:18:40.869 INFO:tasks.ceph.mds.d:Stopped 2024-06-10T00:18:40.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-10T00:18:40.909 INFO:tasks.ceph.mds.a:Started 2024-06-10T00:18:40.909 DEBUG:teuthology.parallel:result is None 2024-06-10T00:18:40.910 INFO:tasks.ceph.mds.c:Started 2024-06-10T00:18:40.910 DEBUG:teuthology.parallel:result is None 2024-06-10T00:18:40.911 INFO:tasks.ceph.mds.b:Started 2024-06-10T00:18:40.911 DEBUG:teuthology.parallel:result is None 2024-06-10T00:18:40.912 INFO:tasks.ceph.mds.d:Started 2024-06-10T00:18:40.912 DEBUG:teuthology.parallel:result is None 2024-06-10T00:18:40.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-10T00:18:40.984 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:18:40.984 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:18:40.993 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:18:40.993 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:18:40.993 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-06-10T00:18:40.994+0000 7f21940a6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-06-10T00:18:41.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.020+0000 7f837791d640 1 Processor -- start 2024-06-10T00:18:41.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.020+0000 7f837791d640 1 -- start start 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f837791d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f837006ebf0 0x7f83700cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f837791d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700cf190 0x7f83700acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f837791d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83700cf600 con 0x7f83700ae910 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f837791d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f837006d130 con 0x7f83700cf190 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f837791d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f837006d410 con 0x7f837006ebf0 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f8375eba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700cf190 0x7f83700acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f8374eb8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f837006ebf0 0x7f83700cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f8375eba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700cf190 0x7f83700acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55168/0 (socket says 172.21.15.79:55168) 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f83756b9640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f83700ae910 0x7f837006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:34410/0 (socket says 172.21.15.79:34410) 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f8375eba640 1 -- 172.21.15.79:0/2458865244 learned_addr learned my addr 172.21.15.79:0/2458865244 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:41.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.021+0000 7f8374eb8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f837006ebf0 0x7f83700cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48282/0 (socket says 172.21.15.79:48282) 2024-06-10T00:18:41.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.022+0000 7f8374eb8640 1 -- 172.21.15.79:0/2458865244 >> v2:172.21.15.79:3300/0 conn(0x7f83700cf190 msgr2=0x7f83700acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:41.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.022+0000 7f8374eb8640 1 --2- 172.21.15.79:0/2458865244 >> v2:172.21.15.79:3300/0 conn(0x7f83700cf190 0x7f83700acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:41.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.022+0000 7f8374eb8640 1 -- 172.21.15.79:0/2458865244 >> v1:172.21.15.117:6789/0 conn(0x7f83700ae910 legacy=0x7f837006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:41.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.022+0000 7f8374eb8640 1 -- 172.21.15.79:0/2458865244 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837006d6f0 con 0x7f837006ebf0 2024-06-10T00:18:41.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.022+0000 7f8374eb8640 1 --2- 172.21.15.79:0/2458865244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 0x7f83700cec50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8370070c80 tx=0x7f836002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44dcb3a3d7b9e4fe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:41.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f8367fff640 1 -- 172.21.15.79:0/2458865244 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360037070 con 0x7f837006ebf0 2024-06-10T00:18:41.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f8367fff640 1 -- 172.21.15.79:0/2458865244 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8360032440 con 0x7f837006ebf0 2024-06-10T00:18:41.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f8367fff640 1 -- 172.21.15.79:0/2458865244 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836002ae60 con 0x7f837006ebf0 2024-06-10T00:18:41.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f837791d640 1 -- 172.21.15.79:0/2458865244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 msgr2=0x7f83700cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:41.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f837791d640 1 --2- 172.21.15.79:0/2458865244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 0x7f83700cec50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8370070c80 tx=0x7f836002a110 comp rx=0 tx=0).stop 2024-06-10T00:18:41.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f837791d640 1 -- 172.21.15.79:0/2458865244 shutdown_connections 2024-06-10T00:18:41.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f837791d640 1 --2- 172.21.15.79:0/2458865244 >> v2:172.21.15.79:3300/0 conn(0x7f83700cf190 0x7f83700acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:41.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f837791d640 1 --2- 172.21.15.79:0/2458865244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 0x7f83700cec50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:41.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.023+0000 7f837791d640 1 -- 172.21.15.79:0/2458865244 >> 172.21.15.79:0/2458865244 conn(0x7f83700b19f0 msgr2=0x7f83700b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:41.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.024+0000 7f837791d640 1 -- 172.21.15.79:0/2458865244 shutdown_connections 2024-06-10T00:18:41.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.024+0000 7f837791d640 1 -- 172.21.15.79:0/2458865244 wait complete. 2024-06-10T00:18:41.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.025+0000 7f837791d640 1 Processor -- start 2024-06-10T00:18:41.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.025+0000 7f837791d640 1 -- start start 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.025+0000 7f837791d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 0x7f83700c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.025+0000 7f837791d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700ae910 0x7f83700c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.025+0000 7f837791d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700cf190 0x7f83701541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.025+0000 7f837791d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83700ad280 con 0x7f83700cf190 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.025+0000 7f837791d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83700aecf0 con 0x7f837006ebf0 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.025+0000 7f837791d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83700ad400 con 0x7f83700ae910 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700cf190 0x7f83701541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f83756b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 0x7f83700c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8374eb8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700ae910 0x7f83700c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700cf190 0x7f83701541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55176/0 (socket says 172.21.15.79:55176) 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f83756b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 0x7f83700c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:48284/0 (socket says 172.21.15.79:48284) 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 -- 172.21.15.79:0/796149005 learned_addr learned my addr 172.21.15.79:0/796149005 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:41.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 -- 172.21.15.79:0/796149005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700ae910 msgr2=0x7f83700c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:41.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700ae910 0x7f83700c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:41.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 -- 172.21.15.79:0/796149005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 msgr2=0x7f83700c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:41.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 0x7f83700c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:41.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 -- 172.21.15.79:0/796149005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837009c4d0 con 0x7f83700cf190 2024-06-10T00:18:41.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.026+0000 7f8375eba640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700cf190 0x7f83701541c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f836800efc0 tx=0x7f836800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.029+0000 7f8365ffb640 1 -- 172.21.15.79:0/796149005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836800cd20 con 0x7f83700cf190 2024-06-10T00:18:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.029+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837009c7b0 con 0x7f83700cf190 2024-06-10T00:18:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.029+0000 7f8365ffb640 1 -- 172.21.15.79:0/796149005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368003990 con 0x7f83700cf190 2024-06-10T00:18:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.029+0000 7f8365ffb640 1 -- 172.21.15.79:0/796149005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368003d80 con 0x7f83700cf190 2024-06-10T00:18:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.029+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83700c5240 con 0x7f83700cf190 2024-06-10T00:18:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.031+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8370068430 con 0x7f83700cf190 2024-06-10T00:18:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.031+0000 7f8365ffb640 1 -- 172.21.15.79:0/796149005 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8368012050 con 0x7f83700cf190 2024-06-10T00:18:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.031+0000 7f8365ffb640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835406be60 0x7f835406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.032+0000 7f8365ffb640 1 -- 172.21.15.79:0/796149005 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5335+0+0 (secure 0 0 0) 0x7f836808b270 con 0x7f83700cf190 2024-06-10T00:18:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.032+0000 7f83756b9640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835406be60 0x7f835406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.032+0000 7f83756b9640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835406be60 0x7f835406e320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f836c000f60 tx=0x7f836c007c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:41.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.036+0000 7f8365ffb640 1 -- 172.21.15.79:0/796149005 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8368010040 con 0x7f83700cf190 2024-06-10T00:18:41.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:41.222+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8370154d50 con 0x7f83700cf190 2024-06-10T00:18:42.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.028+0000 7f8365ffb640 1 -- 172.21.15.79:0/796149005 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v71) ==== 97+0+0 (secure 0 0 0) 0x7f8368059c80 con 0x7f83700cf190 2024-06-10T00:18:42.028 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-06-10T00:18:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835406be60 msgr2=0x7f835406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835406be60 0x7f835406e320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f836c000f60 tx=0x7f836c007c80 comp rx=0 tx=0).stop 2024-06-10T00:18:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700cf190 msgr2=0x7f83701541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700cf190 0x7f83701541c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f836800efc0 tx=0x7f836800c490 comp rx=0 tx=0).stop 2024-06-10T00:18:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 shutdown_connections 2024-06-10T00:18:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f835406be60 0x7f835406e320 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700cf190 0x7f83701541c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83700ae910 0x7f83700c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 --2- 172.21.15.79:0/796149005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837006ebf0 0x7f83700c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 >> 172.21.15.79:0/796149005 conn(0x7f83700b19f0 msgr2=0x7f8370072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 shutdown_connections 2024-06-10T00:18:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.031+0000 7f837791d640 1 -- 172.21.15.79:0/796149005 wait complete. 2024-06-10T00:18:42.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-10T00:18:42.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.144+0000 7f754547b640 1 Processor -- start 2024-06-10T00:18:42.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.144+0000 7f754547b640 1 -- start start 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f754547b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 0x7f75400cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f754547b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75400cec50 0x7f75400cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f754547b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75400b3170 con 0x7f75400b2cf0 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f754547b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f75400b3420 con 0x7f75400cec50 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f754547b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75400cc750 con 0x7f75401553c0 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75400cec50 0x7f75400cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75400cec50 0x7f75400cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55178/0 (socket says 172.21.15.79:55178) 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753f7fe640 1 -- 172.21.15.79:0/647814442 learned_addr learned my addr 172.21.15.79:0/647814442 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753effd640 1 --2- 172.21.15.79:0/647814442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 0x7f75400cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753f7fe640 1 -- 172.21.15.79:0/647814442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 msgr2=0x7f75400cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753f7fe640 1 --2- 172.21.15.79:0/647814442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 0x7f75400cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753f7fe640 1 -- 172.21.15.79:0/647814442 >> v1:172.21.15.117:6789/0 conn(0x7f75400b2cf0 legacy=0x7f754015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753f7fe640 1 -- 172.21.15.79:0/647814442 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75400cca30 con 0x7f75400cec50 2024-06-10T00:18:42.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.145+0000 7f753effd640 1 --2- 172.21.15.79:0/647814442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 0x7f75400cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:42.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.146+0000 7f753f7fe640 1 --2- 172.21.15.79:0/647814442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400cec50 0x7f75400cf0e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f753800d150 tx=0x7f753802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696f3990649d49aa server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.146+0000 7f753dffb640 1 -- 172.21.15.79:0/647814442 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753800b2e0 con 0x7f75400cec50 2024-06-10T00:18:42.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.146+0000 7f753dffb640 1 -- 172.21.15.79:0/647814442 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7538009600 con 0x7f75400cec50 2024-06-10T00:18:42.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.146+0000 7f753dffb640 1 -- 172.21.15.79:0/647814442 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753800b480 con 0x7f75400cec50 2024-06-10T00:18:42.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.147+0000 7f754547b640 1 -- 172.21.15.79:0/647814442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400cec50 msgr2=0x7f75400cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.147+0000 7f754547b640 1 --2- 172.21.15.79:0/647814442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400cec50 0x7f75400cf0e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f753800d150 tx=0x7f753802c8e0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.147+0000 7f754547b640 1 -- 172.21.15.79:0/647814442 shutdown_connections 2024-06-10T00:18:42.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.147+0000 7f754547b640 1 --2- 172.21.15.79:0/647814442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400cec50 0x7f75400cf0e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.147+0000 7f754547b640 1 --2- 172.21.15.79:0/647814442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 0x7f75400cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.147+0000 7f754547b640 1 -- 172.21.15.79:0/647814442 >> 172.21.15.79:0/647814442 conn(0x7f75400b19f0 msgr2=0x7f75400b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:42.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.147+0000 7f754547b640 1 -- 172.21.15.79:0/647814442 shutdown_connections 2024-06-10T00:18:42.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.147+0000 7f754547b640 1 -- 172.21.15.79:0/647814442 wait complete. 2024-06-10T00:18:42.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.148+0000 7f754547b640 1 Processor -- start 2024-06-10T00:18:42.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.148+0000 7f754547b640 1 -- start start 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f754547b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400b2cf0 0x7f75401446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f754547b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75400cec50 0x7f754006df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f754547b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 0x7f75401513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f754547b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75401557a0 con 0x7f75400b2cf0 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f754547b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75400b3700 con 0x7f75400cec50 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f754547b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7540155920 con 0x7f75401553c0 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400b2cf0 0x7f75401446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400b2cf0 0x7f75401446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55184/0 (socket says 172.21.15.79:55184) 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 -- 172.21.15.79:0/3514085845 learned_addr learned my addr 172.21.15.79:0/3514085845 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:42.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 -- 172.21.15.79:0/3514085845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 msgr2=0x7f75401513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 0x7f75401513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 -- 172.21.15.79:0/3514085845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75400cec50 msgr2=0x7f754006df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75400cec50 0x7f754006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 -- 172.21.15.79:0/3514085845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754015ab60 con 0x7f75400b2cf0 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.149+0000 7f753effd640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400b2cf0 0x7f75401446a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f753000c7f0 tx=0x7f753000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.150+0000 7f75277fe640 1 -- 172.21.15.79:0/3514085845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530015070 con 0x7f75400b2cf0 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.150+0000 7f75277fe640 1 -- 172.21.15.79:0/3514085845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7530007820 con 0x7f75400b2cf0 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.150+0000 7f75277fe640 1 -- 172.21.15.79:0/3514085845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530007bf0 con 0x7f75400b2cf0 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.150+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754006d450 con 0x7f75400b2cf0 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.150+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7540144be0 con 0x7f75400b2cf0 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.151+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7540068430 con 0x7f75400b2cf0 2024-06-10T00:18:42.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.151+0000 7f75277fe640 1 -- 172.21.15.79:0/3514085845 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7530018070 con 0x7f75400b2cf0 2024-06-10T00:18:42.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.151+0000 7f75277fe640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f752c06be30 0x7f752c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.152+0000 7f75277fe640 1 -- 172.21.15.79:0/3514085845 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f753008ade0 con 0x7f75400b2cf0 2024-06-10T00:18:42.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.152+0000 7f753e7fc640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f752c06be30 0x7f752c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.152+0000 7f753e7fc640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f752c06be30 0x7f752c06e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f754014fb70 tx=0x7f75340079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.156+0000 7f75277fe640 1 -- 172.21.15.79:0/3514085845 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7530059950 con 0x7f75400b2cf0 2024-06-10T00:18:42.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.394+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f75400cd2d0 con 0x7f75400b2cf0 2024-06-10T00:18:42.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.395+0000 7f75277fe640 1 -- 172.21.15.79:0/3514085845 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f7530059250 con 0x7f75400b2cf0 2024-06-10T00:18:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA==", 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow==", 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ==", 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw==", 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw==", 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg==", 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:18:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg==", 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-06-10T00:18:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g==", 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw==", 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw==", 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ==", 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:18:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA==", 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-06-10T00:18:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw==", 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA==", 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:18:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A==", 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw==", 2024-06-10T00:18:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmQYVlARAAk+Jo8bykvpKKZY5XAPe2ZA==", 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA==", 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw==", 2024-06-10T00:18:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:18:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:18:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:18:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:18:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-10T00:18:42.407 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f752c06be30 msgr2=0x7f752c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f752c06be30 0x7f752c06e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f754014fb70 tx=0x7f75340079b0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400b2cf0 msgr2=0x7f75401446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400b2cf0 0x7f75401446a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f753000c7f0 tx=0x7f753000ccb0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 shutdown_connections 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f752c06be30 0x7f752c06e2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75401553c0 0x7f75401513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75400cec50 0x7f754006df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 --2- 172.21.15.79:0/3514085845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75400b2cf0 0x7f75401446a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 >> 172.21.15.79:0/3514085845 conn(0x7f75400b19f0 msgr2=0x7f75400cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 shutdown_connections 2024-06-10T00:18:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.397+0000 7f754547b640 1 -- 172.21.15.79:0/3514085845 wait complete. 2024-06-10T00:18:42.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-10T00:18:42.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.509+0000 7f89535d5640 1 Processor -- start 2024-06-10T00:18:42.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.509+0000 7f89535d5640 1 -- start start 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.510+0000 7f89535d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f894c0cd230 0x7f894c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.510+0000 7f89535d5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f894c0b3420 con 0x7f894c1553c0 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.510+0000 7f89535d5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f894c0cc750 con 0x7f894c0cec50 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.510+0000 7f89535d5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f894c0cca30 con 0x7f894c0cd230 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.510+0000 7f8951371640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f894c1553c0 0x7f894c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52132/0 (socket says 172.21.15.79:52132) 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.510+0000 7f8951371640 1 -- 172.21.15.79:0/2515648086 learned_addr learned my addr 172.21.15.79:0/2515648086 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8950b70640 1 --2- 172.21.15.79:0/2515648086 >> v2:172.21.15.117:3300/0 conn(0x7f894c0cd230 0x7f894c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690659223 0 0) 0x7f894c0b3420 con 0x7f894c1553c0 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8938003520 con 0x7f894c1553c0 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365883043 0 0) 0x7f894c0cc750 con 0x7f894c0cec50 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f894c0b3420 con 0x7f894c0cec50 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 679664351 0 0) 0x7f8938003520 con 0x7f894c1553c0 2024-06-10T00:18:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 >> v2:172.21.15.117:3300/0 conn(0x7f894c0cd230 msgr2=0x7f894c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 --2- 172.21.15.79:0/2515648086 >> v2:172.21.15.117:3300/0 conn(0x7f894c0cd230 0x7f894c0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 >> v1:172.21.15.117:6789/0 conn(0x7f894c0cec50 legacy=0x7f894c071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c0ccd10 con 0x7f894c1553c0 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f8948001670 con 0x7f894c1553c0 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8950b70640 1 --2- 172.21.15.79:0/2515648086 >> v2:172.21.15.117:3300/0 conn(0x7f894c0cd230 0x7f894c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 >> v1:172.21.15.79:6789/0 conn(0x7f894c1553c0 legacy=0x7f894c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8938003b40 0x7f8938003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8938004800 0x7f8938004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380051c0 0x7f893800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f894c0cca30 con 0x7f89380051c0 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f893800c040 con 0x7f8938003b40 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f893800c240 con 0x7f8938004800 2024-06-10T00:18:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8951b72640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380051c0 0x7f893800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8951371640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8938003b40 0x7f8938003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8950b70640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8938004800 0x7f8938004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8951b72640 1 -- 172.21.15.79:0/2515648086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8938004800 msgr2=0x7f8938004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8951b72640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8938004800 0x7f8938004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8951b72640 1 -- 172.21.15.79:0/2515648086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8938003b40 msgr2=0x7f8938003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8951b72640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8938003b40 0x7f8938003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.511+0000 7f8951b72640 1 -- 172.21.15.79:0/2515648086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8938003520 con 0x7f89380051c0 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.512+0000 7f8951b72640 1 -- 172.21.15.79:0/2515648086 reap_dead start 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.512+0000 7f8951b72640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380051c0 0x7f893800b9c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8944001fd0 tx=0x7f8938005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff626f9131c14c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.512+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944001bf0 con 0x7f89380051c0 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.512+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8944003b70 con 0x7f89380051c0 2024-06-10T00:18:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.512+0000 7f8943fff640 1 -- 172.21.15.79:0/2515648086 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89440050d0 con 0x7f89380051c0 2024-06-10T00:18:42.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.513+0000 7f89535d5640 1 -- 172.21.15.79:0/2515648086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380051c0 msgr2=0x7f893800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.513+0000 7f89535d5640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380051c0 0x7f893800b9c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8944001fd0 tx=0x7f8938005830 comp rx=0 tx=0).stop 2024-06-10T00:18:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.513+0000 7f89535d5640 1 -- 172.21.15.79:0/2515648086 shutdown_connections 2024-06-10T00:18:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.513+0000 7f89535d5640 1 --2- 172.21.15.79:0/2515648086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380051c0 0x7f893800b9c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.513+0000 7f89535d5640 1 -- 172.21.15.79:0/2515648086 >> 172.21.15.79:0/2515648086 conn(0x7f894c0b19f0 msgr2=0x7f894c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.513+0000 7f89535d5640 1 -- 172.21.15.79:0/2515648086 shutdown_connections 2024-06-10T00:18:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.513+0000 7f89535d5640 1 -- 172.21.15.79:0/2515648086 wait complete. 2024-06-10T00:18:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.514+0000 7f89535d5640 1 Processor -- start 2024-06-10T00:18:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.514+0000 7f89535d5640 1 -- start start 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f89535d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89380051c0 0x7f894c0ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f89535d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f894c15d8c0 0x7f894c14a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f89535d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f894c15dd20 0x7f894c14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f89535d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f894c155920 con 0x7f894c15d8c0 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f89535d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f894c1557a0 con 0x7f89380051c0 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f89535d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f894c0b2cf0 con 0x7f894c15dd20 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f894c15d8c0 0x7f894c14a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f894c15d8c0 0x7f894c14a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55210/0 (socket says 172.21.15.79:55210) 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 -- 172.21.15.79:0/1614389561 learned_addr learned my addr 172.21.15.79:0/1614389561 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8951371640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89380051c0 0x7f894c0ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8951b72640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f894c15dd20 0x7f894c14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 -- 172.21.15.79:0/1614389561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f894c15dd20 msgr2=0x7f894c14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f894c15dd20 0x7f894c14a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 -- 172.21.15.79:0/1614389561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89380051c0 msgr2=0x7f894c0ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89380051c0 0x7f894c0ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 -- 172.21.15.79:0/1614389561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c15e2a0 con 0x7f894c15d8c0 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.515+0000 7f8950b70640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f894c15d8c0 0x7f894c14a2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f893c011a90 tx=0x7f893c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.516+0000 7f8941ffb640 1 -- 172.21.15.79:0/1614389561 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c00fb50 con 0x7f894c15d8c0 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.516+0000 7f8941ffb640 1 -- 172.21.15.79:0/1614389561 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893c00fcf0 con 0x7f894c15d8c0 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.516+0000 7f8941ffb640 1 -- 172.21.15.79:0/1614389561 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c00fea0 con 0x7f894c15d8c0 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.516+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894c15e580 con 0x7f894c15d8c0 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.516+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f894c15eb40 con 0x7f894c15d8c0 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.517+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894c068430 con 0x7f894c15d8c0 2024-06-10T00:18:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.517+0000 7f8941ffb640 1 -- 172.21.15.79:0/1614389561 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f893c012040 con 0x7f894c15d8c0 2024-06-10T00:18:42.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.518+0000 7f8941ffb640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893006be60 0x7f893006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.518+0000 7f8941ffb640 1 -- 172.21.15.79:0/1614389561 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f893c08b0a0 con 0x7f894c15d8c0 2024-06-10T00:18:42.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.518+0000 7f8951371640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893006be60 0x7f893006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.518+0000 7f8951371640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893006be60 0x7f893006e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8948001050 tx=0x7f8948001e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.522+0000 7f8941ffb640 1 -- 172.21.15.79:0/1614389561 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f893c019030 con 0x7f894c15d8c0 2024-06-10T00:18:42.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.699+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f894c0aefe0 con 0x7f894c15d8c0 2024-06-10T00:18:42.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.700+0000 7f8941ffb640 1 -- 172.21.15.79:0/1614389561 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f893c059530 con 0x7f894c15d8c0 2024-06-10T00:18:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:42.700 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:18:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:18:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-06-10T00:18:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-06-10T00:18:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:42.700 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:18:42.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893006be60 msgr2=0x7f893006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893006be60 0x7f893006e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8948001050 tx=0x7f8948001e40 comp rx=0 tx=0).stop 2024-06-10T00:18:42.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f894c15d8c0 msgr2=0x7f894c14a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f894c15d8c0 0x7f894c14a2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f893c011a90 tx=0x7f893c011e90 comp rx=0 tx=0).stop 2024-06-10T00:18:42.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 shutdown_connections 2024-06-10T00:18:42.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f893006be60 0x7f893006e320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f894c15dd20 0x7f894c14a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f894c15d8c0 0x7f894c14a2f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 --2- 172.21.15.79:0/1614389561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89380051c0 0x7f894c0ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 >> 172.21.15.79:0/1614389561 conn(0x7f894c0b19f0 msgr2=0x7f894c0ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:42.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 shutdown_connections 2024-06-10T00:18:42.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.702+0000 7f89535d5640 1 -- 172.21.15.79:0/1614389561 wait complete. 2024-06-10T00:18:42.713 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-10T00:18:42.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-10T00:18:42.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.816+0000 7f1c2629e640 1 Processor -- start 2024-06-10T00:18:42.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.816+0000 7f1c2629e640 1 -- start start 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c2629e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c2015a810 0x7f1c200b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c2629e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c20072020 0x7f1c200b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c2629e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c20073270 con 0x7f1c200af420 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c2629e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1c200ce560 con 0x7f1c2015a810 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c2629e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c200b4e30 con 0x7f1c20072020 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c1f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1c200af420 0x7f1c2015e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52144/0 (socket says 172.21.15.79:52144) 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c1f7fe640 1 -- 172.21.15.79:0/188079620 learned_addr learned my addr 172.21.15.79:0/188079620 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c1ffff640 1 --2- 172.21.15.79:0/188079620 >> v2:172.21.15.117:3300/0 conn(0x7f1c2015a810 0x7f1c200b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.817+0000 7f1c2483b640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c20072020 0x7f1c200b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252478709 0 0) 0x7f1c20073270 con 0x7f1c200af420 2024-06-10T00:18:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c08003520 con 0x7f1c200af420 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3393093649 0 0) 0x7f1c08003520 con 0x7f1c200af420 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c20072020 msgr2=0x7f1c200b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c20072020 0x7f1c200b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 >> v2:172.21.15.117:3300/0 conn(0x7f1c2015a810 msgr2=0x7f1c200b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 --2- 172.21.15.79:0/188079620 >> v2:172.21.15.117:3300/0 conn(0x7f1c2015a810 0x7f1c200b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2015abf0 con 0x7f1c200af420 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f1c14001670 con 0x7f1c200af420 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 >> v1:172.21.15.79:6789/0 conn(0x7f1c200af420 legacy=0x7f1c2015e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080039b0 0x7f1c08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c20072020 0x7f1c08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c08004d40 0x7f1c080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c200ce560 con 0x7f1c08004d40 2024-06-10T00:18:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c200b4e30 con 0x7f1c080039b0 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0800b9c0 con 0x7f1c20072020 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1ffff640 1 --2- 172.21.15.79:0/188079620 >> v2:172.21.15.117:3300/0 conn(0x7f1c2015a810 0x7f1c200b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c2483b640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c08004d40 0x7f1c080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1f7fe640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c20072020 0x7f1c08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1ffff640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080039b0 0x7f1c08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c2483b640 1 -- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c20072020 msgr2=0x7f1c08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c2483b640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c20072020 0x7f1c08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c2483b640 1 -- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080039b0 msgr2=0x7f1c08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c2483b640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080039b0 0x7f1c08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c2483b640 1 -- 172.21.15.79:0/188079620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c08003520 con 0x7f1c08004d40 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.818+0000 7f1c1ffff640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080039b0 0x7f1c08003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.819+0000 7f1c2483b640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c08004d40 0x7f1c080051c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009fc0 tx=0x7f1c08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad7ce4130f09467 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.819+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18009c10 con 0x7f1c08004d40 2024-06-10T00:18:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.819+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1802e640 con 0x7f1c08004d40 2024-06-10T00:18:42.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.819+0000 7f1c1effd640 1 -- 172.21.15.79:0/188079620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1802e9f0 con 0x7f1c08004d40 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.820+0000 7f1c2629e640 1 -- 172.21.15.79:0/188079620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c08004d40 msgr2=0x7f1c080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.820+0000 7f1c2629e640 1 --2- 172.21.15.79:0/188079620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c08004d40 0x7f1c080051c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009fc0 tx=0x7f1c08005830 comp rx=0 tx=0).stop 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.820+0000 7f1c2483b640 1 -- 172.21.15.79:0/188079620 reap_dead start 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.820+0000 7f1c2629e640 1 -- 172.21.15.79:0/188079620 shutdown_connections 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.820+0000 7f1c2629e640 1 -- 172.21.15.79:0/188079620 >> 172.21.15.79:0/188079620 conn(0x7f1c200b1980 msgr2=0x7f1c200b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.820+0000 7f1c2629e640 1 -- 172.21.15.79:0/188079620 shutdown_connections 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.820+0000 7f1c2629e640 1 -- 172.21.15.79:0/188079620 wait complete. 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.821+0000 7f1c2629e640 1 Processor -- start 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.821+0000 7f1c2629e640 1 -- start start 2024-06-10T00:18:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2629e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c08004d40 0x7f1c2009d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2629e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c2015add0 0x7f1c201444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2629e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20146ce0 0x7f1c20147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2629e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c200ced70 con 0x7f1c20146ce0 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2629e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c200cea90 con 0x7f1c08004d40 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2629e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c200cf050 con 0x7f1c2015add0 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20146ce0 0x7f1c20147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20146ce0 0x7f1c20147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55234/0 (socket says 172.21.15.79:55234) 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 -- 172.21.15.79:0/2914583651 learned_addr learned my addr 172.21.15.79:0/2914583651 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c1ffff640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c08004d40 0x7f1c2009d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c1f7fe640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c2015add0 0x7f1c201444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 -- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c2015add0 msgr2=0x7f1c201444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c2015add0 0x7f1c201444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 -- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c08004d40 msgr2=0x7f1c2009d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c08004d40 0x7f1c2009d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 -- 172.21.15.79:0/2914583651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c200ad9a0 con 0x7f1c20146ce0 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c1ffff640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c08004d40 0x7f1c2009d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c1f7fe640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c2015add0 0x7f1c201444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2483b640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20146ce0 0x7f1c20147190 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1c18007090 tx=0x7f1c18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c1cff9640 1 -- 172.21.15.79:0/2914583651 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18009c10 con 0x7f1c20146ce0 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c1cff9640 1 -- 172.21.15.79:0/2914583651 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c18043420 con 0x7f1c20146ce0 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c200adc80 con 0x7f1c20146ce0 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c1cff9640 1 -- 172.21.15.79:0/2914583651 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c180437f0 con 0x7f1c20146ce0 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.822+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c200ae240 con 0x7f1c20146ce0 2024-06-10T00:18:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.824+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c20068540 con 0x7f1c20146ce0 2024-06-10T00:18:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.824+0000 7f1c1cff9640 1 -- 172.21.15.79:0/2914583651 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c18005d10 con 0x7f1c20146ce0 2024-06-10T00:18:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.824+0000 7f1c1cff9640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c0c06be60 0x7f1c0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.824+0000 7f1c1cff9640 1 -- 172.21.15.79:0/2914583651 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f1c180ad3d0 con 0x7f1c20146ce0 2024-06-10T00:18:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.825+0000 7f1c1ffff640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c0c06be60 0x7f1c0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.825+0000 7f1c1ffff640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c0c06be60 0x7f1c0c06e320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009b90 tx=0x7f1c10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:42.829+0000 7f1c1cff9640 1 -- 172.21.15.79:0/2914583651 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1c18034030 con 0x7f1c20146ce0 2024-06-10T00:18:43.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.002+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1c2006f270 con 0x7f1c20146ce0 2024-06-10T00:18:43.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.030+0000 7f1c1cff9640 1 -- 172.21.15.79:0/2914583651 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f1c18041320 con 0x7f1c20146ce0 2024-06-10T00:18:43.030 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c0c06be60 msgr2=0x7f1c0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c0c06be60 0x7f1c0c06e320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009b90 tx=0x7f1c10008040 comp rx=0 tx=0).stop 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20146ce0 msgr2=0x7f1c20147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20146ce0 0x7f1c20147190 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1c18007090 tx=0x7f1c18009750 comp rx=0 tx=0).stop 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 shutdown_connections 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1c0c06be60 0x7f1c0c06e320 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c20146ce0 0x7f1c20147190 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c2015add0 0x7f1c201444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 --2- 172.21.15.79:0/2914583651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c08004d40 0x7f1c2009d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 >> 172.21.15.79:0/2914583651 conn(0x7f1c200b1980 msgr2=0x7f1c20158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 shutdown_connections 2024-06-10T00:18:43.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.033+0000 7f1c2629e640 1 -- 172.21.15.79:0/2914583651 wait complete. 2024-06-10T00:18:43.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-10T00:18:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.152+0000 7fa676322640 1 Processor -- start 2024-06-10T00:18:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.152+0000 7fa676322640 1 -- start start 2024-06-10T00:18:43.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa676322640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6700b3000 0x7fa6700b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:43.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa676322640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa67015bd70 0x7fa67015c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:43.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa676322640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67006d950 con 0x7fa670154d60 2024-06-10T00:18:43.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa676322640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa67006dc30 con 0x7fa6700b3000 2024-06-10T00:18:43.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa676322640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa67006df10 con 0x7fa67015bd70 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa667fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6700b3000 0x7fa6700b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa66ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa670154d60 0x7fa67006cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52158/0 (socket says 172.21.15.79:52158) 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa66ffff640 1 -- 172.21.15.79:0/2790651723 learned_addr learned my addr 172.21.15.79:0/2790651723 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.153+0000 7fa667fff640 1 --2- 172.21.15.79:0/2790651723 >> v2:172.21.15.79:3300/0 conn(0x7fa6700b3000 0x7fa6700b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55238/0 (socket says 172.21.15.79:55238) 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.154+0000 7fa6748bf640 1 --2- 172.21.15.79:0/2790651723 >> v2:172.21.15.117:3300/0 conn(0x7fa67015bd70 0x7fa67015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.154+0000 7fa667fff640 1 -- 172.21.15.79:0/2790651723 >> v2:172.21.15.117:3300/0 conn(0x7fa67015bd70 msgr2=0x7fa67015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.154+0000 7fa667fff640 1 --2- 172.21.15.79:0/2790651723 >> v2:172.21.15.117:3300/0 conn(0x7fa67015bd70 0x7fa67015c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.154+0000 7fa667fff640 1 -- 172.21.15.79:0/2790651723 >> v1:172.21.15.79:6789/0 conn(0x7fa670154d60 legacy=0x7fa67006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.154+0000 7fa667fff640 1 -- 172.21.15.79:0/2790651723 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67006e1f0 con 0x7fa6700b3000 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.154+0000 7fa66f7fe640 1 -- 172.21.15.79:0/2790651723 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932482847 0 0) 0x7fa67006d950 con 0x7fa670154d60 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.154+0000 7fa6748bf640 1 --2- 172.21.15.79:0/2790651723 >> v2:172.21.15.117:3300/0 conn(0x7fa67015bd70 0x7fa67015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa667fff640 1 --2- 172.21.15.79:0/2790651723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa6700b3480 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa67006f2c0 tx=0x7fa65802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada13ca0b2a4672f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:43.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa66f7fe640 1 -- 172.21.15.79:0/2790651723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658037070 con 0x7fa6700b3000 2024-06-10T00:18:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa66f7fe640 1 -- 172.21.15.79:0/2790651723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa658032440 con 0x7fa6700b3000 2024-06-10T00:18:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa66f7fe640 1 -- 172.21.15.79:0/2790651723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658032810 con 0x7fa6700b3000 2024-06-10T00:18:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa676322640 1 -- 172.21.15.79:0/2790651723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 msgr2=0x7fa6700b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa676322640 1 --2- 172.21.15.79:0/2790651723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa6700b3480 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa67006f2c0 tx=0x7fa65802a230 comp rx=0 tx=0).stop 2024-06-10T00:18:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa676322640 1 -- 172.21.15.79:0/2790651723 shutdown_connections 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa676322640 1 --2- 172.21.15.79:0/2790651723 >> v2:172.21.15.117:3300/0 conn(0x7fa67015bd70 0x7fa67015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa676322640 1 --2- 172.21.15.79:0/2790651723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa6700b3480 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa676322640 1 -- 172.21.15.79:0/2790651723 >> 172.21.15.79:0/2790651723 conn(0x7fa67006b7e0 msgr2=0x7fa67006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa676322640 1 -- 172.21.15.79:0/2790651723 shutdown_connections 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.155+0000 7fa676322640 1 -- 172.21.15.79:0/2790651723 wait complete. 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.156+0000 7fa676322640 1 Processor -- start 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa676322640 1 -- start start 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa676322640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa670148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa676322640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa670154d60 0x7fa67014c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa676322640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa67015bd70 0x7fa67014c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa676322640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa67006d670 con 0x7fa6700b3000 2024-06-10T00:18:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa676322640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa67006d4f0 con 0x7fa67015bd70 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa676322640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa6700cffd0 con 0x7fa670154d60 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa66ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa670148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa66ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa670148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55254/0 (socket says 172.21.15.79:55254) 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.157+0000 7fa66ffff640 1 -- 172.21.15.79:0/2537854281 learned_addr learned my addr 172.21.15.79:0/2537854281 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa6748bf640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa67015bd70 0x7fa67014c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa667fff640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa670154d60 0x7fa67014c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66ffff640 1 -- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa670154d60 msgr2=0x7fa67014c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66ffff640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa670154d60 0x7fa67014c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66ffff640 1 -- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa67015bd70 msgr2=0x7fa67014c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66ffff640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa67015bd70 0x7fa67014c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66ffff640 1 -- 172.21.15.79:0/2537854281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa670142dd0 con 0x7fa6700b3000 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa6748bf640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa67015bd70 0x7fa67014c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66ffff640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa670148ee0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c500 tx=0x7fa66000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66d7fa640 1 -- 172.21.15.79:0/2537854281 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa660018070 con 0x7fa6700b3000 2024-06-10T00:18:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66d7fa640 1 -- 172.21.15.79:0/2537854281 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa660007580 con 0x7fa6700b3000 2024-06-10T00:18:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6701430b0 con 0x7fa6700b3000 2024-06-10T00:18:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa66d7fa640 1 -- 172.21.15.79:0/2537854281 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa660004a20 con 0x7fa6700b3000 2024-06-10T00:18:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.158+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6701690f0 con 0x7fa6700b3000 2024-06-10T00:18:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.159+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6700683c0 con 0x7fa6700b3000 2024-06-10T00:18:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.160+0000 7fa66d7fa640 1 -- 172.21.15.79:0/2537854281 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa66001b070 con 0x7fa6700b3000 2024-06-10T00:18:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.160+0000 7fa66d7fa640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa65006be30 0x7fa65006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.160+0000 7fa667fff640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa65006be30 0x7fa65006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.160+0000 7fa66d7fa640 1 -- 172.21.15.79:0/2537854281 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5619+0+0 (secure 0 0 0) 0x7fa66008a0f0 con 0x7fa6700b3000 2024-06-10T00:18:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.161+0000 7fa667fff640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa65006be30 0x7fa65006e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa658034000 tx=0x7fa65802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:43.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.165+0000 7fa66d7fa640 1 -- 172.21.15.79:0/2537854281 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa660058b80 con 0x7fa6700b3000 2024-06-10T00:18:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:43.339+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa67009dc50 con 0x7fa6700b3000 2024-06-10T00:18:44.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:18:44.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:18:44.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.032+0000 7fa66d7fa640 1 -- 172.21.15.79:0/2537854281 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7fa660058480 con 0x7fa6700b3000 2024-06-10T00:18:44.032 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-06-10T00:18:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa65006be30 msgr2=0x7fa65006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa65006be30 0x7fa65006e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa658034000 tx=0x7fa65802e000 comp rx=0 tx=0).stop 2024-06-10T00:18:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 msgr2=0x7fa670148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa670148ee0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c500 tx=0x7fa66000c9c0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 shutdown_connections 2024-06-10T00:18:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa65006be30 0x7fa65006e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa67015bd70 0x7fa67014c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa670154d60 0x7fa67014c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 --2- 172.21.15.79:0/2537854281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6700b3000 0x7fa670148ee0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.035+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 >> 172.21.15.79:0/2537854281 conn(0x7fa67006b7e0 msgr2=0x7fa67006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:44.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.036+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 shutdown_connections 2024-06-10T00:18:44.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.036+0000 7fa676322640 1 -- 172.21.15.79:0/2537854281 wait complete. 2024-06-10T00:18:44.061 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-10T00:18:44.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.222+0000 7f154583f640 1 Processor -- start 2024-06-10T00:18:44.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.222+0000 7f154583f640 1 -- start start 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.222+0000 7f154583f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1540154c20 0x7f15400b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f154583f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f154006d6d0 0x7f1540071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f154583f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1540155000 con 0x7f15400b3a20 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f154583f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f154006dd30 con 0x7f154006d6d0 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f154583f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f154006e010 con 0x7f1540154c20 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f153f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f154006d6d0 0x7f1540071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f153f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f154006d6d0 0x7f1540071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55266/0 (socket says 172.21.15.79:55266) 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f153f7fe640 1 -- 172.21.15.79:0/228498704 learned_addr learned my addr 172.21.15.79:0/228498704 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f153effd640 1 --2- 172.21.15.79:0/228498704 >> v2:172.21.15.117:3300/0 conn(0x7f1540154c20 0x7f15400b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f153f7fe640 1 -- 172.21.15.79:0/228498704 >> v2:172.21.15.117:3300/0 conn(0x7f1540154c20 msgr2=0x7f15400b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f153f7fe640 1 --2- 172.21.15.79:0/228498704 >> v2:172.21.15.117:3300/0 conn(0x7f1540154c20 0x7f15400b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f153f7fe640 1 -- 172.21.15.79:0/228498704 >> v1:172.21.15.117:6789/0 conn(0x7f15400b3a20 legacy=0x7f154006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.223+0000 7f153f7fe640 1 -- 172.21.15.79:0/228498704 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154006e2f0 con 0x7f154006d6d0 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.224+0000 7f153f7fe640 1 --2- 172.21.15.79:0/228498704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f154006d6d0 0x7f1540071550 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f154006f210 tx=0x7f153802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9d44940b8fe882 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.224+0000 7f153dffb640 1 -- 172.21.15.79:0/228498704 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15380335b0 con 0x7f154006d6d0 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.224+0000 7f153dffb640 1 -- 172.21.15.79:0/228498704 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1538039070 con 0x7f154006d6d0 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.224+0000 7f153dffb640 1 -- 172.21.15.79:0/228498704 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538033970 con 0x7f154006d6d0 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.225+0000 7f154583f640 1 -- 172.21.15.79:0/228498704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f154006d6d0 msgr2=0x7f1540071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.225+0000 7f154583f640 1 --2- 172.21.15.79:0/228498704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f154006d6d0 0x7f1540071550 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f154006f210 tx=0x7f153802c940 comp rx=0 tx=0).stop 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.225+0000 7f154583f640 1 -- 172.21.15.79:0/228498704 shutdown_connections 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.225+0000 7f154583f640 1 --2- 172.21.15.79:0/228498704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f154006d6d0 0x7f1540071550 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.225+0000 7f154583f640 1 --2- 172.21.15.79:0/228498704 >> v2:172.21.15.117:3300/0 conn(0x7f1540154c20 0x7f15400b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.225+0000 7f154583f640 1 -- 172.21.15.79:0/228498704 >> 172.21.15.79:0/228498704 conn(0x7f15400b1d10 msgr2=0x7f15400b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.225+0000 7f154583f640 1 -- 172.21.15.79:0/228498704 shutdown_connections 2024-06-10T00:18:44.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.225+0000 7f154583f640 1 -- 172.21.15.79:0/228498704 wait complete. 2024-06-10T00:18:44.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.226+0000 7f154583f640 1 Processor -- start 2024-06-10T00:18:44.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.226+0000 7f154583f640 1 -- start start 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f154583f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f154006d6d0 0x7f1540147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f154583f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15400b3a20 0x7f15400b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f154583f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1540154c20 0x7f154015ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f154583f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15400d01a0 con 0x7f1540154c20 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f154583f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15400d0020 con 0x7f15400b3a20 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f154583f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15400d0320 con 0x7f154006d6d0 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1540154c20 0x7f154015ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1540154c20 0x7f154015ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55270/0 (socket says 172.21.15.79:55270) 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153f7fe640 1 -- 172.21.15.79:0/1768666810 learned_addr learned my addr 172.21.15.79:0/1768666810 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153effd640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f154006d6d0 0x7f1540147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153e7fc640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15400b3a20 0x7f15400b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153f7fe640 1 -- 172.21.15.79:0/1768666810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f154006d6d0 msgr2=0x7f1540147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153f7fe640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f154006d6d0 0x7f1540147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153f7fe640 1 -- 172.21.15.79:0/1768666810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15400b3a20 msgr2=0x7f15400b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153f7fe640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15400b3a20 0x7f15400b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.227+0000 7f153f7fe640 1 -- 172.21.15.79:0/1768666810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154009c1a0 con 0x7f1540154c20 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.228+0000 7f153f7fe640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1540154c20 0x7f154015ab10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f153800d240 tx=0x7f1538004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.228+0000 7f1527fff640 1 -- 172.21.15.79:0/1768666810 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538033e40 con 0x7f1540154c20 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.228+0000 7f1527fff640 1 -- 172.21.15.79:0/1768666810 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1538034440 con 0x7f1540154c20 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.228+0000 7f1527fff640 1 -- 172.21.15.79:0/1768666810 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538034810 con 0x7f1540154c20 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.228+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154009c480 con 0x7f1540154c20 2024-06-10T00:18:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.228+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154009ca40 con 0x7f1540154c20 2024-06-10T00:18:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.229+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15400683c0 con 0x7f1540154c20 2024-06-10T00:18:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.229+0000 7f1527fff640 1 -- 172.21.15.79:0/1768666810 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15380349b0 con 0x7f1540154c20 2024-06-10T00:18:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.230+0000 7f1527fff640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f152c06be30 0x7f152c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.230+0000 7f1527fff640 1 -- 172.21.15.79:0/1768666810 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6001+0+0 (secure 0 0 0) 0x7f15380ade00 con 0x7f1540154c20 2024-06-10T00:18:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.230+0000 7f153effd640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f152c06be30 0x7f152c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.230+0000 7f153effd640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f152c06be30 0x7f152c06e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1530009aa0 tx=0x7f1530009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:44.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.234+0000 7f1527fff640 1 -- 172.21.15.79:0/1768666810 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1538042070 con 0x7f1540154c20 2024-06-10T00:18:44.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:44.455+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f15400b2500 con 0x7f1540154c20 2024-06-10T00:18:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.060+0000 7f1527fff640 1 -- 172.21.15.79:0/1768666810 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v35) ==== 174+0+0 (secure 0 0 0) 0x7f153807c150 con 0x7f1540154c20 2024-06-10T00:18:45.064 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 11 and data pool 12 2024-06-10T00:18:45.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.070+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f152c06be30 msgr2=0x7f152c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.070+0000 7f154583f640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f152c06be30 0x7f152c06e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1530009aa0 tx=0x7f1530009190 comp rx=0 tx=0).stop 2024-06-10T00:18:45.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.070+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1540154c20 msgr2=0x7f154015ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.070+0000 7f154583f640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1540154c20 0x7f154015ab10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f153800d240 tx=0x7f1538004a40 comp rx=0 tx=0).stop 2024-06-10T00:18:45.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.075+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 shutdown_connections 2024-06-10T00:18:45.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.075+0000 7f154583f640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f152c06be30 0x7f152c06e2f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.075+0000 7f154583f640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1540154c20 0x7f154015ab10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.075+0000 7f154583f640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15400b3a20 0x7f15400b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.075+0000 7f154583f640 1 --2- 172.21.15.79:0/1768666810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f154006d6d0 0x7f1540147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.075+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 >> 172.21.15.79:0/1768666810 conn(0x7f15400b1d10 msgr2=0x7f15400727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:45.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.076+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 shutdown_connections 2024-06-10T00:18:45.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.077+0000 7f154583f640 1 -- 172.21.15.79:0/1768666810 wait complete. 2024-06-10T00:18:45.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:18:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.192+0000 7f92a3770640 1 Processor -- start 2024-06-10T00:18:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.192+0000 7f92a3770640 1 -- start start 2024-06-10T00:18:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a3770640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae910 0x7f929c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a3770640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f929c0cf360 0x7f929c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a3770640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f929c06d130 con 0x7f929c06ea20 2024-06-10T00:18:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a3770640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f929c06ee60 con 0x7f929c0cf360 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a3770640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f929c06d410 con 0x7f929c0ae910 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a150c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae910 0x7f929c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a0d0b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f929c06ea20 0x7f929c0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:34442/0 (socket says 172.21.15.79:34442) 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a1d0d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f929c0cf360 0x7f929c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a0d0b640 1 -- 172.21.15.79:0/2075836372 learned_addr learned my addr 172.21.15.79:0/2075836372 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f9293fff640 1 -- 172.21.15.79:0/2075836372 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731865430 0 0) 0x7f929c06d130 con 0x7f929c06ea20 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f9293fff640 1 -- 172.21.15.79:0/2075836372 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9288003520 con 0x7f929c06ea20 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a150c640 1 -- 172.21.15.79:0/2075836372 >> v2:172.21.15.117:3300/0 conn(0x7f929c0cf360 msgr2=0x7f929c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a150c640 1 --2- 172.21.15.79:0/2075836372 >> v2:172.21.15.117:3300/0 conn(0x7f929c0cf360 0x7f929c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a150c640 1 -- 172.21.15.79:0/2075836372 >> v1:172.21.15.117:6789/0 conn(0x7f929c06ea20 legacy=0x7f929c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a150c640 1 -- 172.21.15.79:0/2075836372 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929c06d6f0 con 0x7f929c0ae910 2024-06-10T00:18:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.193+0000 7f92a1d0d640 1 --2- 172.21.15.79:0/2075836372 >> v2:172.21.15.117:3300/0 conn(0x7f929c0cf360 0x7f929c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.194+0000 7f92a150c640 1 --2- 172.21.15.79:0/2075836372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae910 0x7f929c06e4e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92980097d0 tx=0x7f929802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18d407a9ad71cd1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.194+0000 7f9293fff640 1 -- 172.21.15.79:0/2075836372 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298037070 con 0x7f929c0ae910 2024-06-10T00:18:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.194+0000 7f9293fff640 1 -- 172.21.15.79:0/2075836372 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929802ae40 con 0x7f929c0ae910 2024-06-10T00:18:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.194+0000 7f9293fff640 1 -- 172.21.15.79:0/2075836372 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298032660 con 0x7f929c0ae910 2024-06-10T00:18:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.195+0000 7f92a3770640 1 -- 172.21.15.79:0/2075836372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae910 msgr2=0x7f929c06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.195+0000 7f92a3770640 1 --2- 172.21.15.79:0/2075836372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae910 0x7f929c06e4e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92980097d0 tx=0x7f929802a130 comp rx=0 tx=0).stop 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.195+0000 7f92a3770640 1 -- 172.21.15.79:0/2075836372 shutdown_connections 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.195+0000 7f92a3770640 1 --2- 172.21.15.79:0/2075836372 >> v2:172.21.15.117:3300/0 conn(0x7f929c0cf360 0x7f929c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.195+0000 7f92a3770640 1 --2- 172.21.15.79:0/2075836372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae910 0x7f929c06e4e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.195+0000 7f92a3770640 1 -- 172.21.15.79:0/2075836372 >> 172.21.15.79:0/2075836372 conn(0x7f929c0b19f0 msgr2=0x7f929c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.195+0000 7f92a3770640 1 -- 172.21.15.79:0/2075836372 shutdown_connections 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.195+0000 7f92a3770640 1 -- 172.21.15.79:0/2075836372 wait complete. 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.196+0000 7f92a3770640 1 Processor -- start 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.196+0000 7f92a3770640 1 -- start start 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a3770640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c06ea20 0x7f929c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a3770640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0ae910 0x7f929c1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a3770640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c0cf360 0x7f929c09b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a3770640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f929c0ad280 con 0x7f929c0ae910 2024-06-10T00:18:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a3770640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f929c0aecf0 con 0x7f929c0cf360 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a3770640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f929c0ad400 con 0x7f929c06ea20 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a0d0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0ae910 0x7f929c1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a0d0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0ae910 0x7f929c1577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55284/0 (socket says 172.21.15.79:55284) 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a0d0b640 1 -- 172.21.15.79:0/2385326788 learned_addr learned my addr 172.21.15.79:0/2385326788 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a150c640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c06ea20 0x7f929c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a1d0d640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c0cf360 0x7f929c09b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a0d0b640 1 -- 172.21.15.79:0/2385326788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c06ea20 msgr2=0x7f929c155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a0d0b640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c06ea20 0x7f929c155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a0d0b640 1 -- 172.21.15.79:0/2385326788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c0cf360 msgr2=0x7f929c09b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a0d0b640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c0cf360 0x7f929c09b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.197+0000 7f92a0d0b640 1 -- 172.21.15.79:0/2385326788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929c09db20 con 0x7f929c0ae910 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.198+0000 7f92a0d0b640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0ae910 0x7f929c1577c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c3c0 tx=0x7f928c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.198+0000 7f9291ffb640 1 -- 172.21.15.79:0/2385326788 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c017070 con 0x7f929c0ae910 2024-06-10T00:18:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.198+0000 7f9291ffb640 1 -- 172.21.15.79:0/2385326788 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c005ce0 con 0x7f929c0ae910 2024-06-10T00:18:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.198+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929c09d560 con 0x7f929c0ae910 2024-06-10T00:18:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.198+0000 7f9291ffb640 1 -- 172.21.15.79:0/2385326788 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c0072d0 con 0x7f929c0ae910 2024-06-10T00:18:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.198+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f929c15c810 con 0x7f929c0ae910 2024-06-10T00:18:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.199+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f929c068430 con 0x7f929c0ae910 2024-06-10T00:18:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.199+0000 7f9291ffb640 1 -- 172.21.15.79:0/2385326788 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f928c01a070 con 0x7f929c0ae910 2024-06-10T00:18:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.200+0000 7f9291ffb640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.200+0000 7f9291ffb640 1 -- 172.21.15.79:0/2385326788 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f928c08a280 con 0x7f929c0ae910 2024-06-10T00:18:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.200+0000 7f92a150c640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.200+0000 7f92a150c640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9298034000 tx=0x7f929802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.204+0000 7f9291ffb640 1 -- 172.21.15.79:0/2385326788 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f928c058450 con 0x7f929c0ae910 2024-06-10T00:18:45.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.379+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f929c0ceea0 con 0x7f929c0ae910 2024-06-10T00:18:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.380+0000 7f9291ffb640 1 -- 172.21.15.79:0/2385326788 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16910 (secure 0 0 0) 0x7f928c05c750 con 0x7f929c0ae910 2024-06-10T00:18:45.380 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:45.380 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:18:44.456135+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:18:43.020724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-06-10T00:18:43.357910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:18:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 msgr2=0x7f928006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9298034000 tx=0x7f929802e000 comp rx=0 tx=0).stop 2024-06-10T00:18:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0ae910 msgr2=0x7f929c1577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0ae910 0x7f929c1577c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c3c0 tx=0x7f928c00c7c0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 shutdown_connections 2024-06-10T00:18:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c0cf360 0x7f929c09b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929c0ae910 0x7f929c1577c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 --2- 172.21.15.79:0/2385326788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c06ea20 0x7f929c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 >> 172.21.15.79:0/2385326788 conn(0x7f929c0b19f0 msgr2=0x7f929c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 shutdown_connections 2024-06-10T00:18:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.382+0000 7f92a3770640 1 -- 172.21.15.79:0/2385326788 wait complete. 2024-06-10T00:18:45.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:18:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.493+0000 7f98b99e7640 1 Processor -- start 2024-06-10T00:18:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.493+0000 7f98b99e7640 1 -- start start 2024-06-10T00:18:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.493+0000 7f98b99e7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98b4161830 0x7f98b40b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.493+0000 7f98b99e7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98b4161c10 0x7f98b40d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.493+0000 7f98b99e7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b40cebb0 con 0x7f98b40d0a00 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.493+0000 7f98b99e7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f98b40d4cf0 con 0x7f98b4161830 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.493+0000 7f98b99e7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f98b40d2fc0 con 0x7f98b4161c10 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.494+0000 7f98b2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98b4161830 0x7f98b40b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.494+0000 7f98b2ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98b4161830 0x7f98b40b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55288/0 (socket says 172.21.15.79:55288) 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.494+0000 7f98b2ffd640 1 -- 172.21.15.79:0/333322096 learned_addr learned my addr 172.21.15.79:0/333322096 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.494+0000 7f98b27fc640 1 --2- 172.21.15.79:0/333322096 >> v2:172.21.15.117:3300/0 conn(0x7f98b4161c10 0x7f98b40d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.494+0000 7f98b2ffd640 1 -- 172.21.15.79:0/333322096 >> v2:172.21.15.117:3300/0 conn(0x7f98b4161c10 msgr2=0x7f98b40d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.494+0000 7f98b2ffd640 1 --2- 172.21.15.79:0/333322096 >> v2:172.21.15.117:3300/0 conn(0x7f98b4161c10 0x7f98b40d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.494+0000 7f98b2ffd640 1 -- 172.21.15.79:0/333322096 >> v1:172.21.15.117:6789/0 conn(0x7f98b40d0a00 legacy=0x7f98b41620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.494+0000 7f98b2ffd640 1 -- 172.21.15.79:0/333322096 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b40d4f20 con 0x7f98b4161830 2024-06-10T00:18:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b2ffd640 1 --2- 172.21.15.79:0/333322096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b4161830 0x7f98b40b5270 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f98b408e890 tx=0x7f98a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2100c1d4ed9aeee server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b1ffb640 1 -- 172.21.15.79:0/333322096 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4037070 con 0x7f98b4161830 2024-06-10T00:18:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b1ffb640 1 -- 172.21.15.79:0/333322096 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a4032440 con 0x7f98b4161830 2024-06-10T00:18:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b1ffb640 1 -- 172.21.15.79:0/333322096 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4032810 con 0x7f98b4161830 2024-06-10T00:18:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b99e7640 1 -- 172.21.15.79:0/333322096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b4161830 msgr2=0x7f98b40b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b99e7640 1 --2- 172.21.15.79:0/333322096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b4161830 0x7f98b40b5270 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f98b408e890 tx=0x7f98a402a270 comp rx=0 tx=0).stop 2024-06-10T00:18:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b99e7640 1 -- 172.21.15.79:0/333322096 shutdown_connections 2024-06-10T00:18:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b99e7640 1 --2- 172.21.15.79:0/333322096 >> v2:172.21.15.117:3300/0 conn(0x7f98b4161c10 0x7f98b40d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b99e7640 1 --2- 172.21.15.79:0/333322096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b4161830 0x7f98b40b5270 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b99e7640 1 -- 172.21.15.79:0/333322096 >> 172.21.15.79:0/333322096 conn(0x7f98b409d3e0 msgr2=0x7f98b40d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b99e7640 1 -- 172.21.15.79:0/333322096 shutdown_connections 2024-06-10T00:18:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.495+0000 7f98b99e7640 1 -- 172.21.15.79:0/333322096 wait complete. 2024-06-10T00:18:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.496+0000 7f98b99e7640 1 Processor -- start 2024-06-10T00:18:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.497+0000 7f98b99e7640 1 -- start start 2024-06-10T00:18:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.497+0000 7f98b99e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b40d0a00 0x7f98b40c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.497+0000 7f98b99e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b4161830 0x7f98b40cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.497+0000 7f98b99e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b4161c10 0x7f98b40b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.497+0000 7f98b99e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98b40d2ce0 con 0x7f98b40d0a00 2024-06-10T00:18:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.497+0000 7f98b99e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f98b40d2a00 con 0x7f98b4161830 2024-06-10T00:18:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.497+0000 7f98b99e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f98b40d0060 con 0x7f98b4161c10 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.497+0000 7f98b2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b40d0a00 0x7f98b40c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b40d0a00 0x7f98b40c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55304/0 (socket says 172.21.15.79:55304) 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b2ffd640 1 -- 172.21.15.79:0/3121510392 learned_addr learned my addr 172.21.15.79:0/3121510392 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b37fe640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b4161c10 0x7f98b40b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b27fc640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b4161830 0x7f98b40cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b2ffd640 1 -- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b4161c10 msgr2=0x7f98b40b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b2ffd640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b4161c10 0x7f98b40b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b2ffd640 1 -- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b4161830 msgr2=0x7f98b40cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b2ffd640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b4161830 0x7f98b40cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b2ffd640 1 -- 172.21.15.79:0/3121510392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b40b6e20 con 0x7f98b40d0a00 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b27fc640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b4161830 0x7f98b40cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b37fe640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b4161c10 0x7f98b40b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b2ffd640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b40d0a00 0x7f98b40c6e80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f98a402a2b0 tx=0x7f98a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f989bfff640 1 -- 172.21.15.79:0/3121510392 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4041020 con 0x7f98b40d0a00 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f989bfff640 1 -- 172.21.15.79:0/3121510392 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a40306c0 con 0x7f98b40d0a00 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f989bfff640 1 -- 172.21.15.79:0/3121510392 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4037040 con 0x7f98b40d0a00 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b40b70c0 con 0x7f98b40d0a00 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.498+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b40b7680 con 0x7f98b40d0a00 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.499+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b4068430 con 0x7f98b40d0a00 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.500+0000 7f989bfff640 1 -- 172.21.15.79:0/3121510392 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98a4044020 con 0x7f98b40d0a00 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.500+0000 7f989bfff640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f98a006be60 0x7f98a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.500+0000 7f989bfff640 1 -- 172.21.15.79:0/3121510392 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f98a40ab7f0 con 0x7f98b40d0a00 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.500+0000 7f98b27fc640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f98a006be60 0x7f98a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.501+0000 7f98b27fc640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f98a006be60 0x7f98a006e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98b40b80e0 tx=0x7f98a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.504+0000 7f989bfff640 1 -- 172.21.15.79:0/3121510392 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f98a404b030 con 0x7f98b40d0a00 2024-06-10T00:18:45.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.679+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98b40d1650 con 0x7f98b40d0a00 2024-06-10T00:18:45.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.680+0000 7f989bfff640 1 -- 172.21.15.79:0/3121510392 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16910 (secure 0 0 0) 0x7f98a407a020 con 0x7f98b40d0a00 2024-06-10T00:18:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:45.680 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:18:44.456135+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:18:43.020724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-06-10T00:18:43.357910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:18:45.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f98a006be60 msgr2=0x7f98a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f98a006be60 0x7f98a006e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98b40b80e0 tx=0x7f98a8008040 comp rx=0 tx=0).stop 2024-06-10T00:18:45.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b40d0a00 msgr2=0x7f98b40c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b40d0a00 0x7f98b40c6e80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f98a402a2b0 tx=0x7f98a40046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 shutdown_connections 2024-06-10T00:18:45.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f98a006be60 0x7f98a006e320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b4161c10 0x7f98b40b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b4161830 0x7f98b40cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 --2- 172.21.15.79:0/3121510392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98b40d0a00 0x7f98b40c6e80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.682+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 >> 172.21.15.79:0/3121510392 conn(0x7f98b409d3e0 msgr2=0x7f98b4160b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:45.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.683+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 shutdown_connections 2024-06-10T00:18:45.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.683+0000 7f98b99e7640 1 -- 172.21.15.79:0/3121510392 wait complete. 2024-06-10T00:18:45.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-10T00:18:45.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.795+0000 7f534077e640 1 Processor -- start 2024-06-10T00:18:45.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.796+0000 7f534077e640 1 -- start start 2024-06-10T00:18:45.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.796+0000 7f534077e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f53380d0020 0x7f53380d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.796+0000 7f534077e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533806e1f0 0x7f533806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.796+0000 7f534077e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5338155700 con 0x7f5338155320 2024-06-10T00:18:45.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f534077e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f53380d09c0 con 0x7f53380d0020 2024-06-10T00:18:45.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f534077e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f533815b6b0 con 0x7f533806e1f0 2024-06-10T00:18:45.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533dd19640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f53380d0020 0x7f53380d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533e51a640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5338155320 0x7f53380b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:34468/0 (socket says 172.21.15.79:34468) 2024-06-10T00:18:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533ed1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533806e1f0 0x7f533806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533e51a640 1 -- 172.21.15.79:0/472422043 learned_addr learned my addr 172.21.15.79:0/472422043 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533ed1b640 1 -- 172.21.15.79:0/472422043 >> v2:172.21.15.117:3300/0 conn(0x7f53380d0020 msgr2=0x7f53380d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533ed1b640 1 --2- 172.21.15.79:0/472422043 >> v2:172.21.15.117:3300/0 conn(0x7f53380d0020 0x7f53380d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533ed1b640 1 -- 172.21.15.79:0/472422043 >> v1:172.21.15.117:6789/0 conn(0x7f5338155320 legacy=0x7f53380b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533ed1b640 1 -- 172.21.15.79:0/472422043 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533815b990 con 0x7f533806e1f0 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533d518640 1 -- 172.21.15.79:0/472422043 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016522767 0 0) 0x7f5338155700 con 0x7f5338155320 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.797+0000 7f533dd19640 1 --2- 172.21.15.79:0/472422043 >> v2:172.21.15.117:3300/0 conn(0x7f53380d0020 0x7f53380d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.798+0000 7f533ed1b640 1 --2- 172.21.15.79:0/472422043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533806e1f0 0x7f533806e680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5328009d90 tx=0x7f532802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19e5c87011fd9c97 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.798+0000 7f533d518640 1 -- 172.21.15.79:0/472422043 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328007740 con 0x7f533806e1f0 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.798+0000 7f533d518640 1 -- 172.21.15.79:0/472422043 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53280078e0 con 0x7f533806e1f0 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.798+0000 7f533d518640 1 -- 172.21.15.79:0/472422043 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328007cb0 con 0x7f533806e1f0 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.799+0000 7f534077e640 1 -- 172.21.15.79:0/472422043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533806e1f0 msgr2=0x7f533806e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.799+0000 7f534077e640 1 --2- 172.21.15.79:0/472422043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533806e1f0 0x7f533806e680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5328009d90 tx=0x7f532802a660 comp rx=0 tx=0).stop 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.799+0000 7f534077e640 1 -- 172.21.15.79:0/472422043 shutdown_connections 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.799+0000 7f534077e640 1 --2- 172.21.15.79:0/472422043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533806e1f0 0x7f533806e680 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.799+0000 7f534077e640 1 --2- 172.21.15.79:0/472422043 >> v2:172.21.15.117:3300/0 conn(0x7f53380d0020 0x7f53380d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.799+0000 7f534077e640 1 -- 172.21.15.79:0/472422043 >> 172.21.15.79:0/472422043 conn(0x7f53380b1d10 msgr2=0x7f53380b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.799+0000 7f534077e640 1 -- 172.21.15.79:0/472422043 shutdown_connections 2024-06-10T00:18:45.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.799+0000 7f534077e640 1 -- 172.21.15.79:0/472422043 wait complete. 2024-06-10T00:18:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.800+0000 7f534077e640 1 Processor -- start 2024-06-10T00:18:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.800+0000 7f534077e640 1 -- start start 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f534077e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533806e1f0 0x7f533814a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f534077e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53380d0020 0x7f533809d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f534077e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5338155320 0x7f53380b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f534077e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f533806ebc0 con 0x7f533806e1f0 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f534077e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f533815bf50 con 0x7f5338155320 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f534077e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f53380cd910 con 0x7f53380d0020 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533806e1f0 0x7f533814a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533806e1f0 0x7f533814a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55312/0 (socket says 172.21.15.79:55312) 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 -- 172.21.15.79:0/889166989 learned_addr learned my addr 172.21.15.79:0/889166989 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533dd19640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53380d0020 0x7f533809d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533ed1b640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5338155320 0x7f53380b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 -- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53380d0020 msgr2=0x7f533809d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53380d0020 0x7f533809d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 -- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5338155320 msgr2=0x7f53380b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5338155320 0x7f53380b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 -- 172.21.15.79:0/889166989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53380cd330 con 0x7f533806e1f0 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533dd19640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53380d0020 0x7f533809d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533ed1b640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5338155320 0x7f53380b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f533e51a640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533806e1f0 0x7f533814a850 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f533000c400 tx=0x7f533000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f5336ffd640 1 -- 172.21.15.79:0/889166989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330017070 con 0x7f533806e1f0 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f5336ffd640 1 -- 172.21.15.79:0/889166989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5330005ce0 con 0x7f533806e1f0 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533814ad90 con 0x7f533806e1f0 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.801+0000 7f5336ffd640 1 -- 172.21.15.79:0/889166989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330007310 con 0x7f533806e1f0 2024-06-10T00:18:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.802+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53380cd5a0 con 0x7f533806e1f0 2024-06-10T00:18:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.803+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53380683c0 con 0x7f533806e1f0 2024-06-10T00:18:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.803+0000 7f5336ffd640 1 -- 172.21.15.79:0/889166989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f533001a070 con 0x7f533806e1f0 2024-06-10T00:18:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.804+0000 7f5336ffd640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f532406be30 0x7f532406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.804+0000 7f5336ffd640 1 -- 172.21.15.79:0/889166989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f533008a450 con 0x7f533806e1f0 2024-06-10T00:18:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.804+0000 7f533dd19640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f532406be30 0x7f532406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.804+0000 7f533dd19640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f532406be30 0x7f532406e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f533814fae0 tx=0x7f532c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:45.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:45.808+0000 7f5336ffd640 1 -- 172.21.15.79:0/889166989 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5330058c70 con 0x7f533806e1f0 2024-06-10T00:18:46.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.017+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f53380cf640 con 0x7f533806e1f0 2024-06-10T00:18:46.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.070+0000 7f5336ffd640 1 -- 172.21.15.79:0/889166989 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) ==== 118+0+0 (secure 0 0 0) 0x7f5330058570 con 0x7f533806e1f0 2024-06-10T00:18:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f532406be30 msgr2=0x7f532406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f532406be30 0x7f532406e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f533814fae0 tx=0x7f532c008040 comp rx=0 tx=0).stop 2024-06-10T00:18:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533806e1f0 msgr2=0x7f533814a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533806e1f0 0x7f533814a850 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f533000c400 tx=0x7f533000c8c0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 shutdown_connections 2024-06-10T00:18:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f532406be30 0x7f532406e2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5338155320 0x7f53380b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53380d0020 0x7f533809d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 --2- 172.21.15.79:0/889166989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533806e1f0 0x7f533814a850 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 >> 172.21.15.79:0/889166989 conn(0x7f53380b1d10 msgr2=0x7f53380b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 shutdown_connections 2024-06-10T00:18:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.073+0000 7f534077e640 1 -- 172.21.15.79:0/889166989 wait complete. 2024-06-10T00:18:46.083 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-10T00:18:46.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-10T00:18:46.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.185+0000 7fbf0c37e640 1 Processor -- start 2024-06-10T00:18:46.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.185+0000 7fbf0c37e640 1 -- start start 2024-06-10T00:18:46.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf0c37e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf040d0020 0x7fbf040d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:46.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf0c37e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbf0406e1f0 0x7fbf0406e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:46.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf0c37e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf04155700 con 0x7fbf04155320 2024-06-10T00:18:46.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf0c37e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbf040d09c0 con 0x7fbf040d0020 2024-06-10T00:18:46.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf0c37e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbf0415b6b0 con 0x7fbf0406e1f0 2024-06-10T00:18:46.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf09919640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf040d0020 0x7fbf040d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:46.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf09919640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf040d0020 0x7fbf040d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55314/0 (socket says 172.21.15.79:55314) 2024-06-10T00:18:46.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf09919640 1 -- 172.21.15.79:0/3361105675 learned_addr learned my addr 172.21.15.79:0/3361105675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:46.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.186+0000 7fbf0a91b640 1 --2- 172.21.15.79:0/3361105675 >> v2:172.21.15.117:3300/0 conn(0x7fbf0406e1f0 0x7fbf0406e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:46.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.187+0000 7fbf09919640 1 -- 172.21.15.79:0/3361105675 >> v2:172.21.15.117:3300/0 conn(0x7fbf0406e1f0 msgr2=0x7fbf0406e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:46.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.187+0000 7fbf09919640 1 --2- 172.21.15.79:0/3361105675 >> v2:172.21.15.117:3300/0 conn(0x7fbf0406e1f0 0x7fbf0406e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.187+0000 7fbf09919640 1 -- 172.21.15.79:0/3361105675 >> v1:172.21.15.117:6789/0 conn(0x7fbf04155320 legacy=0x7fbf040b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:46.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.187+0000 7fbf09919640 1 -- 172.21.15.79:0/3361105675 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0415b990 con 0x7fbf040d0020 2024-06-10T00:18:46.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.187+0000 7fbf09919640 1 --2- 172.21.15.79:0/3361105675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf040d0480 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbf040b52b0 tx=0x7fbef402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb901f7777cec4b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:46.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.187+0000 7fbf09118640 1 -- 172.21.15.79:0/3361105675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef40325a0 con 0x7fbf040d0020 2024-06-10T00:18:46.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.187+0000 7fbf09118640 1 -- 172.21.15.79:0/3361105675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef4038070 con 0x7fbf040d0020 2024-06-10T00:18:46.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.187+0000 7fbf09118640 1 -- 172.21.15.79:0/3361105675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4032960 con 0x7fbf040d0020 2024-06-10T00:18:46.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.188+0000 7fbf0c37e640 1 -- 172.21.15.79:0/3361105675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 msgr2=0x7fbf040d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:46.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.188+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/3361105675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf040d0480 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbf040b52b0 tx=0x7fbef402c8e0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.188+0000 7fbf0c37e640 1 -- 172.21.15.79:0/3361105675 shutdown_connections 2024-06-10T00:18:46.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.188+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/3361105675 >> v2:172.21.15.117:3300/0 conn(0x7fbf0406e1f0 0x7fbf0406e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.188+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/3361105675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf040d0480 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.188+0000 7fbf0c37e640 1 -- 172.21.15.79:0/3361105675 >> 172.21.15.79:0/3361105675 conn(0x7fbf040b1d10 msgr2=0x7fbf040b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:46.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.188+0000 7fbf0c37e640 1 -- 172.21.15.79:0/3361105675 shutdown_connections 2024-06-10T00:18:46.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.188+0000 7fbf0c37e640 1 -- 172.21.15.79:0/3361105675 wait complete. 2024-06-10T00:18:46.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.189+0000 7fbf0c37e640 1 Processor -- start 2024-06-10T00:18:46.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.189+0000 7fbf0c37e640 1 -- start start 2024-06-10T00:18:46.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf0c37e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0406e1f0 0x7fbf04149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:46.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf0c37e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf0415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:46.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf0c37e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04155320 0x7fbf040b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:46.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf0c37e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0415b2f0 con 0x7fbf040d0020 2024-06-10T00:18:46.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf0c37e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0415bf50 con 0x7fbf0406e1f0 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf0c37e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0415b470 con 0x7fbf04155320 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf09919640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf0415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf09919640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf0415ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55324/0 (socket says 172.21.15.79:55324) 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf09919640 1 -- 172.21.15.79:0/382834257 learned_addr learned my addr 172.21.15.79:0/382834257 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf0a11a640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0406e1f0 0x7fbf04149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.190+0000 7fbf0a91b640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04155320 0x7fbf040b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbf09919640 1 -- 172.21.15.79:0/382834257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04155320 msgr2=0x7fbf040b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbf09919640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04155320 0x7fbf040b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbf09919640 1 -- 172.21.15.79:0/382834257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0406e1f0 msgr2=0x7fbf04149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbf09919640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0406e1f0 0x7fbf04149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbf09919640 1 -- 172.21.15.79:0/382834257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0415f6e0 con 0x7fbf040d0020 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbf09919640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf0415ed70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbef402c920 tx=0x7fbef4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbefaffd640 1 -- 172.21.15.79:0/382834257 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4043070 con 0x7fbf040d0020 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbefaffd640 1 -- 172.21.15.79:0/382834257 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef4033c70 con 0x7fbf040d0020 2024-06-10T00:18:46.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf04155ae0 con 0x7fbf040d0020 2024-06-10T00:18:46.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbefaffd640 1 -- 172.21.15.79:0/382834257 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef403c640 con 0x7fbf040d0020 2024-06-10T00:18:46.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.191+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf041560a0 con 0x7fbf040d0020 2024-06-10T00:18:46.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.192+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf040683c0 con 0x7fbf040d0020 2024-06-10T00:18:46.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.192+0000 7fbefaffd640 1 -- 172.21.15.79:0/382834257 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbef4046070 con 0x7fbf040d0020 2024-06-10T00:18:46.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.193+0000 7fbefaffd640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbee806be60 0x7fbee806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:46.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.193+0000 7fbf0a11a640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbee806be60 0x7fbee806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:46.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.193+0000 7fbefaffd640 1 -- 172.21.15.79:0/382834257 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fbef4030020 con 0x7fbf040d0020 2024-06-10T00:18:46.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.193+0000 7fbf0a11a640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbee806be60 0x7fbee806e320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbf00004f60 tx=0x7fbf00007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:46.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.197+0000 7fbefaffd640 1 -- 172.21.15.79:0/382834257 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbef404d030 con 0x7fbf040d0020 2024-06-10T00:18:46.308 INFO:tasks.ceph.mds.c.smithi079.stderr:2024-06-10T00:18:46.308+0000 7f38bb49f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:18:46.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:46.408+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbf040ae1c0 con 0x7fbf040d0020 2024-06-10T00:18:47.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.074+0000 7fbefaffd640 1 -- 172.21.15.79:0/382834257 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7fbef4033e20 con 0x7fbf040d0020 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbee806be60 msgr2=0x7fbee806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbee806be60 0x7fbee806e320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbf00004f60 tx=0x7fbf00007e30 comp rx=0 tx=0).stop 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 msgr2=0x7fbf0415ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf0415ed70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbef402c920 tx=0x7fbef4004730 comp rx=0 tx=0).stop 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 shutdown_connections 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbee806be60 0x7fbee806e320 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04155320 0x7fbf040b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf040d0020 0x7fbf0415ed70 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 --2- 172.21.15.79:0/382834257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0406e1f0 0x7fbf04149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 >> 172.21.15.79:0/382834257 conn(0x7fbf040b1d10 msgr2=0x7fbf040ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:47.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 shutdown_connections 2024-06-10T00:18:47.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.076+0000 7fbf0c37e640 1 -- 172.21.15.79:0/382834257 wait complete. 2024-06-10T00:18:47.088 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-10T00:18:47.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.189+0000 7f4ea36e1640 1 Processor -- start 2024-06-10T00:18:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.189+0000 7f4ea36e1640 1 -- start start 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea36e1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e9c1553c0 0x7f4e9c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea36e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e9c0b2cf0 0x7f4e9c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea36e1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e9c0b31a0 con 0x7f4e9c0cec50 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea36e1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c15c3f0 con 0x7f4e9c1553c0 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea36e1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c0b3420 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea147d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e9c1553c0 0x7f4e9c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea147d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e9c1553c0 0x7f4e9c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55338/0 (socket says 172.21.15.79:55338) 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea1c7e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4e9c0cec50 0x7f4e9c071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52164/0 (socket says 172.21.15.79:52164) 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea147d640 1 -- 172.21.15.79:0/4092086394 learned_addr learned my addr 172.21.15.79:0/4092086394 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea147d640 1 -- 172.21.15.79:0/4092086394 >> v2:172.21.15.117:3300/0 conn(0x7f4e9c0b2cf0 msgr2=0x7f4e9c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea0c7c640 1 --2- 172.21.15.79:0/4092086394 >> v2:172.21.15.117:3300/0 conn(0x7f4e9c0b2cf0 0x7f4e9c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4e93fff640 1 -- 172.21.15.79:0/4092086394 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937096016 0 0) 0x7f4e94001110 con 0x7f4e9c0cec50 2024-06-10T00:18:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea147d640 1 --2- 172.21.15.79:0/4092086394 >> v2:172.21.15.117:3300/0 conn(0x7f4e9c0b2cf0 0x7f4e9c15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea147d640 1 -- 172.21.15.79:0/4092086394 >> v1:172.21.15.79:6789/0 conn(0x7f4e9c0cec50 legacy=0x7f4e9c071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea147d640 1 -- 172.21.15.79:0/4092086394 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c0cc750 con 0x7f4e9c1553c0 2024-06-10T00:18:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.190+0000 7f4ea0c7c640 1 --2- 172.21.15.79:0/4092086394 >> v2:172.21.15.117:3300/0 conn(0x7f4e9c0b2cf0 0x7f4e9c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.191+0000 7f4ea147d640 1 --2- 172.21.15.79:0/4092086394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c1553c0 0x7f4e9c0cd230 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009e50 tx=0x7f4e9802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67fd7cb4c649dc7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.191+0000 7f4e93fff640 1 -- 172.21.15.79:0/4092086394 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98036070 con 0x7f4e9c1553c0 2024-06-10T00:18:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.191+0000 7f4e93fff640 1 -- 172.21.15.79:0/4092086394 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e98031600 con 0x7f4e9c1553c0 2024-06-10T00:18:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.191+0000 7f4e93fff640 1 -- 172.21.15.79:0/4092086394 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980319d0 con 0x7f4e9c1553c0 2024-06-10T00:18:47.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.192+0000 7f4ea36e1640 1 -- 172.21.15.79:0/4092086394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c1553c0 msgr2=0x7f4e9c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.192+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/4092086394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c1553c0 0x7f4e9c0cd230 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009e50 tx=0x7f4e9802a760 comp rx=0 tx=0).stop 2024-06-10T00:18:47.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.192+0000 7f4ea36e1640 1 -- 172.21.15.79:0/4092086394 shutdown_connections 2024-06-10T00:18:47.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.192+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/4092086394 >> v2:172.21.15.117:3300/0 conn(0x7f4e9c0b2cf0 0x7f4e9c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.192+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/4092086394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c1553c0 0x7f4e9c0cd230 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.192+0000 7f4ea36e1640 1 -- 172.21.15.79:0/4092086394 >> 172.21.15.79:0/4092086394 conn(0x7f4e9c0b19f0 msgr2=0x7f4e9c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.192+0000 7f4ea36e1640 1 -- 172.21.15.79:0/4092086394 shutdown_connections 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.192+0000 7f4ea36e1640 1 -- 172.21.15.79:0/4092086394 wait complete. 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.193+0000 7f4ea36e1640 1 Processor -- start 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.193+0000 7f4ea36e1640 1 -- start start 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea36e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c0b2cf0 0x7f4e9c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea36e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e9c0cec50 0x7f4e9c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea36e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e9c1553c0 0x7f4e9c0ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea36e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c0b3700 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea36e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c0ccd10 con 0x7f4e9c0cec50 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea36e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9c1557a0 con 0x7f4e9c1553c0 2024-06-10T00:18:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c0b2cf0 0x7f4e9c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c0b2cf0 0x7f4e9c15e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55354/0 (socket says 172.21.15.79:55354) 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 -- 172.21.15.79:0/356182490 learned_addr learned my addr 172.21.15.79:0/356182490 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 -- 172.21.15.79:0/356182490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e9c1553c0 msgr2=0x7f4e9c0ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e9c1553c0 0x7f4e9c0ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 -- 172.21.15.79:0/356182490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e9c0cec50 msgr2=0x7f4e9c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e9c0cec50 0x7f4e9c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 -- 172.21.15.79:0/356182490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c154c70 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea147d640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c0b2cf0 0x7f4e9c15e3c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4e98034040 tx=0x7f4e98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4e91ffb640 1 -- 172.21.15.79:0/356182490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98036050 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4e91ffb640 1 -- 172.21.15.79:0/356182490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e98042070 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c15ea30 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.194+0000 7f4e91ffb640 1 -- 172.21.15.79:0/356182490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98009510 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.195+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c15c820 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.195+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9c068430 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.196+0000 7f4e91ffb640 1 -- 172.21.15.79:0/356182490 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e98007c50 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.196+0000 7f4e91ffb640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e8006be30 0x7f4e8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.196+0000 7f4e91ffb640 1 -- 172.21.15.79:0/356182490 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f4e980abe20 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.196+0000 7f4ea0c7c640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e8006be30 0x7f4e8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.197+0000 7f4ea0c7c640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e8006be30 0x7f4e8006e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c006fd0 tx=0x7f4e8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.201+0000 7f4e91ffb640 1 -- 172.21.15.79:0/356182490 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4e9807a6d0 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.410+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e9c072e50 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.410+0000 7f4e91ffb640 1 -- 172.21.15.79:0/356182490 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5183 (secure 0 0 0) 0x7f4e98079fd0 con 0x7f4e9c0b2cf0 2024-06-10T00:18:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:47.410 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:18:46.409798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1640828017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1640828017},{"type":"v1","addr":"172.21.15.79:6835","nonce":1640828017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":5}]} 2024-06-10T00:18:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 37 2024-06-10T00:18:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e8006be30 msgr2=0x7f4e8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e8006be30 0x7f4e8006e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c006fd0 tx=0x7f4e8c008040 comp rx=0 tx=0).stop 2024-06-10T00:18:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c0b2cf0 msgr2=0x7f4e9c15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c0b2cf0 0x7f4e9c15e3c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4e98034040 tx=0x7f4e98004a40 comp rx=0 tx=0).stop 2024-06-10T00:18:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 shutdown_connections 2024-06-10T00:18:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4e8006be30 0x7f4e8006e2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e9c1553c0 0x7f4e9c0ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e9c0cec50 0x7f4e9c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 --2- 172.21.15.79:0/356182490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c0b2cf0 0x7f4e9c15e3c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 >> 172.21.15.79:0/356182490 conn(0x7f4e9c0b19f0 msgr2=0x7f4e9c06e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 shutdown_connections 2024-06-10T00:18:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.412+0000 7f4ea36e1640 1 -- 172.21.15.79:0/356182490 wait complete. 2024-06-10T00:18:47.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:18:47.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.523+0000 7f0da16b3640 1 Processor -- start 2024-06-10T00:18:47.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.523+0000 7f0da16b3640 1 -- start start 2024-06-10T00:18:47.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.523+0000 7f0da16b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d9c1618e0 0x7f0d9c0cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.523+0000 7f0da16b3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d9c161cc0 0x7f0d9c0d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.523+0000 7f0da16b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c0d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.523+0000 7f0da16b3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c0b4130 con 0x7f0d9c1618e0 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.523+0000 7f0da16b3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c0d03e0 con 0x7f0d9c161cc0 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.523+0000 7f0da16b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c0d0100 con 0x7f0d9c0d4cd0 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d9c1618e0 0x7f0d9c0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d9c1618e0 0x7f0d9c0cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55370/0 (socket says 172.21.15.79:55370) 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9affd640 1 -- 172.21.15.79:0/1596937329 learned_addr learned my addr 172.21.15.79:0/1596937329 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9a7fc640 1 --2- 172.21.15.79:0/1596937329 >> v2:172.21.15.117:3300/0 conn(0x7f0d9c161cc0 0x7f0d9c0d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9b7fe640 1 --2- 172.21.15.79:0/1596937329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c0d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9affd640 1 -- 172.21.15.79:0/1596937329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 msgr2=0x7f0d9c0d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9affd640 1 --2- 172.21.15.79:0/1596937329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c0d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9affd640 1 -- 172.21.15.79:0/1596937329 >> v2:172.21.15.117:3300/0 conn(0x7f0d9c161cc0 msgr2=0x7f0d9c0d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:47.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9affd640 1 --2- 172.21.15.79:0/1596937329 >> v2:172.21.15.117:3300/0 conn(0x7f0d9c161cc0 0x7f0d9c0d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9affd640 1 -- 172.21.15.79:0/1596937329 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c0b3ae0 con 0x7f0d9c1618e0 2024-06-10T00:18:47.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.524+0000 7f0d9b7fe640 1 --2- 172.21.15.79:0/1596937329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c0d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:47.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0d9affd640 1 --2- 172.21.15.79:0/1596937329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0cf800 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0cb160 tx=0x7f0d8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bc489a19978433 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0d99ffb640 1 -- 172.21.15.79:0/1596937329 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c037070 con 0x7f0d9c1618e0 2024-06-10T00:18:47.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0d99ffb640 1 -- 172.21.15.79:0/1596937329 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c032440 con 0x7f0d9c1618e0 2024-06-10T00:18:47.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0d99ffb640 1 -- 172.21.15.79:0/1596937329 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c032810 con 0x7f0d9c1618e0 2024-06-10T00:18:47.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 -- 172.21.15.79:0/1596937329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 msgr2=0x7f0d9c0cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 --2- 172.21.15.79:0/1596937329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0cf800 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0cb160 tx=0x7f0d8c02a1e0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 -- 172.21.15.79:0/1596937329 shutdown_connections 2024-06-10T00:18:47.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 --2- 172.21.15.79:0/1596937329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c0d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 --2- 172.21.15.79:0/1596937329 >> v2:172.21.15.117:3300/0 conn(0x7f0d9c161cc0 0x7f0d9c0d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 --2- 172.21.15.79:0/1596937329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0cf800 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 -- 172.21.15.79:0/1596937329 >> 172.21.15.79:0/1596937329 conn(0x7f0d9c09d410 msgr2=0x7f0d9c0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:47.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 -- 172.21.15.79:0/1596937329 shutdown_connections 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.525+0000 7f0da16b3640 1 -- 172.21.15.79:0/1596937329 wait complete. 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.527+0000 7f0da16b3640 1 Processor -- start 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.527+0000 7f0da16b3640 1 -- start start 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.527+0000 7f0da16b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c14b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.527+0000 7f0da16b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.527+0000 7f0da16b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d9c161cc0 0x7f0d9c0b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.527+0000 7f0da16b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c0cfec0 con 0x7f0d9c1618e0 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.527+0000 7f0da16b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c0cfd40 con 0x7f0d9c161cc0 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.527+0000 7f0da16b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c0d0af0 con 0x7f0d9c0d4cd0 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0b9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55382/0 (socket says 172.21.15.79:55382) 2024-06-10T00:18:47.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 -- 172.21.15.79:0/2633446675 learned_addr learned my addr 172.21.15.79:0/2633446675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9affd640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c14b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9b7fe640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d9c161cc0 0x7f0d9c0b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 -- 172.21.15.79:0/2633446675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 msgr2=0x7f0d9c14b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c14b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 -- 172.21.15.79:0/2633446675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d9c161cc0 msgr2=0x7f0d9c0b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d9c161cc0 0x7f0d9c0b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 -- 172.21.15.79:0/2633446675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c14bce0 con 0x7f0d9c1618e0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d9a7fc640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0b9620 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e870 tx=0x7f0d9000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d837fe640 1 -- 172.21.15.79:0/2633446675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90017070 con 0x7f0d9c1618e0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d837fe640 1 -- 172.21.15.79:0/2633446675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9000c940 con 0x7f0d9c1618e0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c1f75f0 con 0x7f0d9c1618e0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0d837fe640 1 -- 172.21.15.79:0/2633446675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000cd30 con 0x7f0d9c1618e0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.528+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1f7bb0 con 0x7f0d9c1618e0 2024-06-10T00:18:47.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.529+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c068430 con 0x7f0d9c1618e0 2024-06-10T00:18:47.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.530+0000 7f0d837fe640 1 -- 172.21.15.79:0/2633446675 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d9001a070 con 0x7f0d9c1618e0 2024-06-10T00:18:47.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.530+0000 7f0d837fe640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d8806be30 0x7f0d8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.530+0000 7f0d837fe640 1 -- 172.21.15.79:0/2633446675 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f0d9008aea0 con 0x7f0d9c1618e0 2024-06-10T00:18:47.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.530+0000 7f0d9affd640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d8806be30 0x7f0d8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.531+0000 7f0d9affd640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d8806be30 0x7f0d8806e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c034000 tx=0x7f0d8c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.534+0000 7f0d837fe640 1 -- 172.21.15.79:0/2633446675 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0d900596c0 con 0x7f0d9c1618e0 2024-06-10T00:18:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.709+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d9c0d4890 con 0x7f0d9c1618e0 2024-06-10T00:18:47.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.710+0000 7f0d837fe640 1 -- 172.21.15.79:0/2633446675 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16897 (secure 0 0 0) 0x7f0d90058fc0 con 0x7f0d9c1618e0 2024-06-10T00:18:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:47.710 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":75,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:18:46.048554+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:18:43.020724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-06-10T00:18:43.357910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:18:47.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d8806be30 msgr2=0x7f0d8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d8806be30 0x7f0d8806e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c034000 tx=0x7f0d8c02e000 comp rx=0 tx=0).stop 2024-06-10T00:18:47.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 msgr2=0x7f0d9c0b9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0b9620 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e870 tx=0x7f0d9000ed30 comp rx=0 tx=0).stop 2024-06-10T00:18:47.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 shutdown_connections 2024-06-10T00:18:47.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0d8806be30 0x7f0d8806e2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d9c161cc0 0x7f0d9c0b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c1618e0 0x7f0d9c0b9620 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 --2- 172.21.15.79:0/2633446675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d9c0d4cd0 0x7f0d9c14b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.712+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 >> 172.21.15.79:0/2633446675 conn(0x7f0d9c09d410 msgr2=0x7f0d9c0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:47.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.713+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 shutdown_connections 2024-06-10T00:18:47.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.713+0000 7f0da16b3640 1 -- 172.21.15.79:0/2633446675 wait complete. 2024-06-10T00:18:47.725 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:18:47.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:18:47.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.825+0000 7f3429810640 1 Processor -- start 2024-06-10T00:18:47.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.825+0000 7f3429810640 1 -- start start 2024-06-10T00:18:47.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.826+0000 7f3429810640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3424159d80 0x7f34240d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.826+0000 7f3429810640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342415cc60 0x7f342409aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.826+0000 7f3429810640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342415d1a0 con 0x7f342409aa10 2024-06-10T00:18:47.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.826+0000 7f3429810640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f34240b50c0 con 0x7f3424159d80 2024-06-10T00:18:47.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.826+0000 7f3429810640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f342415d480 con 0x7f342415cc60 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.826+0000 7f3422ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3424159d80 0x7f34240d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.826+0000 7f34227fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f342409aa10 0x7f342415c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52170/0 (socket says 172.21.15.79:52170) 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.826+0000 7f34227fc640 1 -- 172.21.15.79:0/3198039941 learned_addr learned my addr 172.21.15.79:0/3198039941 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f34237fe640 1 --2- 172.21.15.79:0/3198039941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342415cc60 0x7f342409aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3422ffd640 1 -- 172.21.15.79:0/3198039941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342415cc60 msgr2=0x7f342409aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3421ffb640 1 -- 172.21.15.79:0/3198039941 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701549082 0 0) 0x7f342415d1a0 con 0x7f342409aa10 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3422ffd640 1 --2- 172.21.15.79:0/3198039941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342415cc60 0x7f342409aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3422ffd640 1 -- 172.21.15.79:0/3198039941 >> v1:172.21.15.79:6789/0 conn(0x7f342409aa10 legacy=0x7f342415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3422ffd640 1 -- 172.21.15.79:0/3198039941 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34240d1ba0 con 0x7f3424159d80 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3422ffd640 1 --2- 172.21.15.79:0/3198039941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3424159d80 0x7f34240d2680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f3414009dc0 tx=0x7f341402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8f794b8c8d0e0c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3421ffb640 1 -- 172.21.15.79:0/3198039941 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341402ae60 con 0x7f3424159d80 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3421ffb640 1 -- 172.21.15.79:0/3198039941 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3414007740 con 0x7f3424159d80 2024-06-10T00:18:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.827+0000 7f3421ffb640 1 -- 172.21.15.79:0/3198039941 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414007b10 con 0x7f3424159d80 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.828+0000 7f3429810640 1 -- 172.21.15.79:0/3198039941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3424159d80 msgr2=0x7f34240d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.828+0000 7f3429810640 1 --2- 172.21.15.79:0/3198039941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3424159d80 0x7f34240d2680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f3414009dc0 tx=0x7f341402a680 comp rx=0 tx=0).stop 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.828+0000 7f3429810640 1 -- 172.21.15.79:0/3198039941 shutdown_connections 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.828+0000 7f3429810640 1 --2- 172.21.15.79:0/3198039941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342415cc60 0x7f342409aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.828+0000 7f3429810640 1 --2- 172.21.15.79:0/3198039941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3424159d80 0x7f34240d2680 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.828+0000 7f3429810640 1 -- 172.21.15.79:0/3198039941 >> 172.21.15.79:0/3198039941 conn(0x7f34240b7270 msgr2=0x7f34240b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.828+0000 7f3429810640 1 -- 172.21.15.79:0/3198039941 shutdown_connections 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.828+0000 7f3429810640 1 -- 172.21.15.79:0/3198039941 wait complete. 2024-06-10T00:18:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.829+0000 7f3429810640 1 Processor -- start 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.829+0000 7f3429810640 1 -- start start 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f3429810640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342409aa10 0x7f34241431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f3429810640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342415cc60 0x7f34240b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f3429810640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3424155d60 0x7f34241561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f3429810640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f34240d2bc0 con 0x7f342415cc60 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f3429810640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f34240d2160 con 0x7f3424155d60 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f3429810640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f34240b1d20 con 0x7f342409aa10 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f34227fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342415cc60 0x7f34240b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f34227fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342415cc60 0x7f34240b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55394/0 (socket says 172.21.15.79:55394) 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f34227fc640 1 -- 172.21.15.79:0/1655658323 learned_addr learned my addr 172.21.15.79:0/1655658323 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f3422ffd640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342409aa10 0x7f34241431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f34237fe640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3424155d60 0x7f34241561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f34227fc640 1 -- 172.21.15.79:0/1655658323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342409aa10 msgr2=0x7f34241431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.830+0000 7f34227fc640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342409aa10 0x7f34241431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f34227fc640 1 -- 172.21.15.79:0/1655658323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3424155d60 msgr2=0x7f34241561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f34227fc640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3424155d60 0x7f34241561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f34227fc640 1 -- 172.21.15.79:0/1655658323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34240af570 con 0x7f342415cc60 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f34227fc640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342415cc60 0x7f34240b0610 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f341800c4d0 tx=0x7f341800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f340bfff640 1 -- 172.21.15.79:0/1655658323 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418018070 con 0x7f342415cc60 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f340bfff640 1 -- 172.21.15.79:0/1655658323 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3418007500 con 0x7f342415cc60 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34240af850 con 0x7f342415cc60 2024-06-10T00:18:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f340bfff640 1 -- 172.21.15.79:0/1655658323 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418004a20 con 0x7f342415cc60 2024-06-10T00:18:47.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.831+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34240afe10 con 0x7f342415cc60 2024-06-10T00:18:47.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.832+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34240b7bb0 con 0x7f342415cc60 2024-06-10T00:18:47.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.832+0000 7f340bfff640 1 -- 172.21.15.79:0/1655658323 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3418004bc0 con 0x7f342415cc60 2024-06-10T00:18:47.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.833+0000 7f340bfff640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f341006be60 0x7f341006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:47.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.833+0000 7f3422ffd640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f341006be60 0x7f341006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:47.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.833+0000 7f340bfff640 1 -- 172.21.15.79:0/1655658323 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f341808a3b0 con 0x7f342415cc60 2024-06-10T00:18:47.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.833+0000 7f3422ffd640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f341006be60 0x7f341006e320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3414034000 tx=0x7f341402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:47.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:47.837+0000 7f340bfff640 1 -- 172.21.15.79:0/1655658323 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f34240b7bb0 con 0x7f342415cc60 2024-06-10T00:18:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.006+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3424068ad0 con 0x7f341006be60 2024-06-10T00:18:48.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.012+0000 7f340bfff640 1 -- 172.21.15.79:0/1655658323 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252025 (secure 0 0 0) 0x7f3424068ad0 con 0x7f341006be60 2024-06-10T00:18:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:48.016 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:18:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f341006be60 msgr2=0x7f341006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f341006be60 0x7f341006e320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3414034000 tx=0x7f341402f000 comp rx=0 tx=0).stop 2024-06-10T00:18:48.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342415cc60 msgr2=0x7f34240b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342415cc60 0x7f34240b0610 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f341800c4d0 tx=0x7f341800c990 comp rx=0 tx=0).stop 2024-06-10T00:18:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 shutdown_connections 2024-06-10T00:18:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f341006be60 0x7f341006e320 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3424155d60 0x7f34241561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342415cc60 0x7f34240b0610 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 --2- 172.21.15.79:0/1655658323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f342409aa10 0x7f34241431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 >> 172.21.15.79:0/1655658323 conn(0x7f34240b7270 msgr2=0x7f342415bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.015+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 shutdown_connections 2024-06-10T00:18:48.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.016+0000 7f3429810640 1 -- 172.21.15.79:0/1655658323 wait complete. 2024-06-10T00:18:48.026 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-06-10T00:18:47.199438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228652,"kb_used_data":8296,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746068,"statfs":{"total":773094113280,"available":772859973632,"internally_reserved":0,"allocated":8495104,"data_stored":4471180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.167711"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054709+0000","last_change":"2024-06-10T00:18:45.065201+0000","last_active":"2024-06-10T00:18:46.054709+0000","last_peered":"2024-06-10T00:18:46.054709+0000","last_clean":"2024-06-10T00:18:46.054709+0000","last_became_active":"2024-06-10T00:18:45.064919+0000","last_became_peered":"2024-06-10T00:18:45.064919+0000","last_unstale":"2024-06-10T00:18:46.054709+0000","last_undegraded":"2024-06-10T00:18:46.054709+0000","last_fullsized":"2024-06-10T00:18:46.054709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:25:28.578468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078729+0000","last_change":"2024-06-10T00:18:45.076738+0000","last_active":"2024-06-10T00:18:45.078729+0000","last_peered":"2024-06-10T00:18:45.078729+0000","last_clean":"2024-06-10T00:18:45.078729+0000","last_became_active":"2024-06-10T00:18:45.076442+0000","last_became_peered":"2024-06-10T00:18:45.076442+0000","last_unstale":"2024-06-10T00:18:45.078729+0000","last_undegraded":"2024-06-10T00:18:45.078729+0000","last_fullsized":"2024-06-10T00:18:45.078729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:05:58.128592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.076533+0000","last_change":"2024-06-10T00:18:45.071378+0000","last_active":"2024-06-10T00:18:45.076533+0000","last_peered":"2024-06-10T00:18:45.076533+0000","last_clean":"2024-06-10T00:18:45.076533+0000","last_became_active":"2024-06-10T00:18:45.071100+0000","last_became_peered":"2024-06-10T00:18:45.071100+0000","last_unstale":"2024-06-10T00:18:45.076533+0000","last_undegraded":"2024-06-10T00:18:45.076533+0000","last_fullsized":"2024-06-10T00:18:45.076533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:30:52.332325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.066725+0000","last_change":"2024-06-10T00:18:45.059816+0000","last_active":"2024-06-10T00:18:45.066725+0000","last_peered":"2024-06-10T00:18:45.066725+0000","last_clean":"2024-06-10T00:18:45.066725+0000","last_became_active":"2024-06-10T00:18:45.058801+0000","last_became_peered":"2024-06-10T00:18:45.058801+0000","last_unstale":"2024-06-10T00:18:45.066725+0000","last_undegraded":"2024-06-10T00:18:45.066725+0000","last_fullsized":"2024-06-10T00:18:45.066725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:22.812781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072323+0000","last_change":"2024-06-10T00:18:45.063708+0000","last_active":"2024-06-10T00:18:45.072323+0000","last_peered":"2024-06-10T00:18:45.072323+0000","last_clean":"2024-06-10T00:18:45.072323+0000","last_became_active":"2024-06-10T00:18:45.063467+0000","last_became_peered":"2024-06-10T00:18:45.063467+0000","last_unstale":"2024-06-10T00:18:45.072323+0000","last_undegraded":"2024-06-10T00:18:45.072323+0000","last_fullsized":"2024-06-10T00:18:45.072323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:49:45.780075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056042+0000","last_change":"2024-06-10T00:18:45.070111+0000","last_active":"2024-06-10T00:18:46.056042+0000","last_peered":"2024-06-10T00:18:46.056042+0000","last_clean":"2024-06-10T00:18:46.056042+0000","last_became_active":"2024-06-10T00:18:45.069159+0000","last_became_peered":"2024-06-10T00:18:45.069159+0000","last_unstale":"2024-06-10T00:18:46.056042+0000","last_undegraded":"2024-06-10T00:18:46.056042+0000","last_fullsized":"2024-06-10T00:18:46.056042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:47:30.692310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080923+0000","last_change":"2024-06-10T00:18:45.077937+0000","last_active":"2024-06-10T00:18:45.080923+0000","last_peered":"2024-06-10T00:18:45.080923+0000","last_clean":"2024-06-10T00:18:45.080923+0000","last_became_active":"2024-06-10T00:18:45.077615+0000","last_became_peered":"2024-06-10T00:18:45.077615+0000","last_unstale":"2024-06-10T00:18:45.080923+0000","last_undegraded":"2024-06-10T00:18:45.080923+0000","last_fullsized":"2024-06-10T00:18:45.080923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:32:26.320277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.071911+0000","last_change":"2024-06-10T00:18:45.063068+0000","last_active":"2024-06-10T00:18:45.071911+0000","last_peered":"2024-06-10T00:18:45.071911+0000","last_clean":"2024-06-10T00:18:45.071911+0000","last_became_active":"2024-06-10T00:18:45.062807+0000","last_became_peered":"2024-06-10T00:18:45.062807+0000","last_unstale":"2024-06-10T00:18:45.071911+0000","last_undegraded":"2024-06-10T00:18:45.071911+0000","last_fullsized":"2024-06-10T00:18:45.071911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:25:12.828830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053425+0000","last_change":"2024-06-10T00:18:45.065214+0000","last_active":"2024-06-10T00:18:46.053425+0000","last_peered":"2024-06-10T00:18:46.053425+0000","last_clean":"2024-06-10T00:18:46.053425+0000","last_became_active":"2024-06-10T00:18:45.064446+0000","last_became_peered":"2024-06-10T00:18:45.064446+0000","last_unstale":"2024-06-10T00:18:46.053425+0000","last_undegraded":"2024-06-10T00:18:46.053425+0000","last_fullsized":"2024-06-10T00:18:46.053425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:21.859451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.069229+0000","last_change":"2024-06-10T00:18:45.065593+0000","last_active":"2024-06-10T00:18:45.069229+0000","last_peered":"2024-06-10T00:18:45.069229+0000","last_clean":"2024-06-10T00:18:45.069229+0000","last_became_active":"2024-06-10T00:18:45.065297+0000","last_became_peered":"2024-06-10T00:18:45.065297+0000","last_unstale":"2024-06-10T00:18:45.069229+0000","last_undegraded":"2024-06-10T00:18:45.069229+0000","last_fullsized":"2024-06-10T00:18:45.069229+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:55:47.470531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.079380+0000","last_change":"2024-06-10T00:18:45.077146+0000","last_active":"2024-06-10T00:18:45.079380+0000","last_peered":"2024-06-10T00:18:45.079380+0000","last_clean":"2024-06-10T00:18:45.079380+0000","last_became_active":"2024-06-10T00:18:45.076363+0000","last_became_peered":"2024-06-10T00:18:45.076363+0000","last_unstale":"2024-06-10T00:18:45.079380+0000","last_undegraded":"2024-06-10T00:18:45.079380+0000","last_fullsized":"2024-06-10T00:18:45.079380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:53:04.858860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078078+0000","last_change":"2024-06-10T00:18:45.070735+0000","last_active":"2024-06-10T00:18:45.078078+0000","last_peered":"2024-06-10T00:18:45.078078+0000","last_clean":"2024-06-10T00:18:45.078078+0000","last_became_active":"2024-06-10T00:18:45.070418+0000","last_became_peered":"2024-06-10T00:18:45.070418+0000","last_unstale":"2024-06-10T00:18:45.078078+0000","last_undegraded":"2024-06-10T00:18:45.078078+0000","last_fullsized":"2024-06-10T00:18:45.078078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:40.321778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072345+0000","last_change":"2024-06-10T00:18:45.066023+0000","last_active":"2024-06-10T00:18:45.072345+0000","last_peered":"2024-06-10T00:18:45.072345+0000","last_clean":"2024-06-10T00:18:45.072345+0000","last_became_active":"2024-06-10T00:18:45.065752+0000","last_became_peered":"2024-06-10T00:18:45.065752+0000","last_unstale":"2024-06-10T00:18:45.072345+0000","last_undegraded":"2024-06-10T00:18:45.072345+0000","last_fullsized":"2024-06-10T00:18:45.072345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:02:46.810539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056056+0000","last_change":"2024-06-10T00:18:45.069880+0000","last_active":"2024-06-10T00:18:46.056056+0000","last_peered":"2024-06-10T00:18:46.056056+0000","last_clean":"2024-06-10T00:18:46.056056+0000","last_became_active":"2024-06-10T00:18:45.068778+0000","last_became_peered":"2024-06-10T00:18:45.068778+0000","last_unstale":"2024-06-10T00:18:46.056056+0000","last_undegraded":"2024-06-10T00:18:46.056056+0000","last_fullsized":"2024-06-10T00:18:46.056056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:25:28.578468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077568+0000","last_change":"2024-06-10T00:18:45.070378+0000","last_active":"2024-06-10T00:18:45.077568+0000","last_peered":"2024-06-10T00:18:45.077568+0000","last_clean":"2024-06-10T00:18:45.077568+0000","last_became_active":"2024-06-10T00:18:45.070135+0000","last_became_peered":"2024-06-10T00:18:45.070135+0000","last_unstale":"2024-06-10T00:18:45.077568+0000","last_undegraded":"2024-06-10T00:18:45.077568+0000","last_fullsized":"2024-06-10T00:18:45.077568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:23:30.017916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054272+0000","last_change":"2024-06-10T00:18:45.068789+0000","last_active":"2024-06-10T00:18:46.054272+0000","last_peered":"2024-06-10T00:18:46.054272+0000","last_clean":"2024-06-10T00:18:46.054272+0000","last_became_active":"2024-06-10T00:18:45.068505+0000","last_became_peered":"2024-06-10T00:18:45.068505+0000","last_unstale":"2024-06-10T00:18:46.054272+0000","last_undegraded":"2024-06-10T00:18:46.054272+0000","last_fullsized":"2024-06-10T00:18:46.054272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:25:50.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.074360+0000","last_change":"2024-06-10T00:18:45.071194+0000","last_active":"2024-06-10T00:18:45.074360+0000","last_peered":"2024-06-10T00:18:45.074360+0000","last_clean":"2024-06-10T00:18:45.074360+0000","last_became_active":"2024-06-10T00:18:45.070410+0000","last_became_peered":"2024-06-10T00:18:45.070410+0000","last_unstale":"2024-06-10T00:18:45.074360+0000","last_undegraded":"2024-06-10T00:18:45.074360+0000","last_fullsized":"2024-06-10T00:18:45.074360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:32:48.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.071317+0000","last_change":"2024-06-10T00:18:45.065548+0000","last_active":"2024-06-10T00:18:45.071317+0000","last_peered":"2024-06-10T00:18:45.071317+0000","last_clean":"2024-06-10T00:18:45.071317+0000","last_became_active":"2024-06-10T00:18:45.065275+0000","last_became_peered":"2024-06-10T00:18:45.065275+0000","last_unstale":"2024-06-10T00:18:45.071317+0000","last_undegraded":"2024-06-10T00:18:45.071317+0000","last_fullsized":"2024-06-10T00:18:45.071317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:38:24.082103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056045+0000","last_change":"2024-06-10T00:18:45.065615+0000","last_active":"2024-06-10T00:18:46.056045+0000","last_peered":"2024-06-10T00:18:46.056045+0000","last_clean":"2024-06-10T00:18:46.056045+0000","last_became_active":"2024-06-10T00:18:45.065334+0000","last_became_peered":"2024-06-10T00:18:45.065334+0000","last_unstale":"2024-06-10T00:18:46.056045+0000","last_undegraded":"2024-06-10T00:18:46.056045+0000","last_fullsized":"2024-06-10T00:18:46.056045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:51.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080658+0000","last_change":"2024-06-10T00:18:45.074940+0000","last_active":"2024-06-10T00:18:45.080658+0000","last_peered":"2024-06-10T00:18:45.080658+0000","last_clean":"2024-06-10T00:18:45.080658+0000","last_became_active":"2024-06-10T00:18:45.069628+0000","last_became_peered":"2024-06-10T00:18:45.069628+0000","last_unstale":"2024-06-10T00:18:45.080658+0000","last_undegraded":"2024-06-10T00:18:45.080658+0000","last_fullsized":"2024-06-10T00:18:45.080658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:53:40.425366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053236+0000","last_change":"2024-06-10T00:18:45.065054+0000","last_active":"2024-06-10T00:18:46.053236+0000","last_peered":"2024-06-10T00:18:46.053236+0000","last_clean":"2024-06-10T00:18:46.053236+0000","last_became_active":"2024-06-10T00:18:45.064772+0000","last_became_peered":"2024-06-10T00:18:45.064772+0000","last_unstale":"2024-06-10T00:18:46.053236+0000","last_undegraded":"2024-06-10T00:18:46.053236+0000","last_fullsized":"2024-06-10T00:18:46.053236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:27.822385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072030+0000","last_change":"2024-06-10T00:18:45.066652+0000","last_active":"2024-06-10T00:18:45.072030+0000","last_peered":"2024-06-10T00:18:45.072030+0000","last_clean":"2024-06-10T00:18:45.072030+0000","last_became_active":"2024-06-10T00:18:45.066402+0000","last_became_peered":"2024-06-10T00:18:45.066402+0000","last_unstale":"2024-06-10T00:18:45.072030+0000","last_undegraded":"2024-06-10T00:18:45.072030+0000","last_fullsized":"2024-06-10T00:18:45.072030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:40.290943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.052996+0000","last_change":"2024-06-10T00:18:45.060612+0000","last_active":"2024-06-10T00:18:46.052996+0000","last_peered":"2024-06-10T00:18:46.052996+0000","last_clean":"2024-06-10T00:18:46.052996+0000","last_became_active":"2024-06-10T00:18:45.059439+0000","last_became_peered":"2024-06-10T00:18:45.059439+0000","last_unstale":"2024-06-10T00:18:46.052996+0000","last_undegraded":"2024-06-10T00:18:46.052996+0000","last_fullsized":"2024-06-10T00:18:46.052996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:02:44.813985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077594+0000","last_change":"2024-06-10T00:18:45.071342+0000","last_active":"2024-06-10T00:18:45.077594+0000","last_peered":"2024-06-10T00:18:45.077594+0000","last_clean":"2024-06-10T00:18:45.077594+0000","last_became_active":"2024-06-10T00:18:45.070573+0000","last_became_peered":"2024-06-10T00:18:45.070573+0000","last_unstale":"2024-06-10T00:18:45.077594+0000","last_undegraded":"2024-06-10T00:18:45.077594+0000","last_fullsized":"2024-06-10T00:18:45.077594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:22.812781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078634+0000","last_change":"2024-06-10T00:18:45.074738+0000","last_active":"2024-06-10T00:18:45.078634+0000","last_peered":"2024-06-10T00:18:45.078634+0000","last_clean":"2024-06-10T00:18:45.078634+0000","last_became_active":"2024-06-10T00:18:45.074479+0000","last_became_peered":"2024-06-10T00:18:45.074479+0000","last_unstale":"2024-06-10T00:18:45.078634+0000","last_undegraded":"2024-06-10T00:18:45.078634+0000","last_fullsized":"2024-06-10T00:18:45.078634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:55:47.470531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080518+0000","last_change":"2024-06-10T00:18:45.073517+0000","last_active":"2024-06-10T00:18:45.080518+0000","last_peered":"2024-06-10T00:18:45.080518+0000","last_clean":"2024-06-10T00:18:45.080518+0000","last_became_active":"2024-06-10T00:18:45.073249+0000","last_became_peered":"2024-06-10T00:18:45.073249+0000","last_unstale":"2024-06-10T00:18:45.080518+0000","last_undegraded":"2024-06-10T00:18:45.080518+0000","last_fullsized":"2024-06-10T00:18:45.080518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:05:58.128592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054713+0000","last_change":"2024-06-10T00:18:45.066629+0000","last_active":"2024-06-10T00:18:46.054713+0000","last_peered":"2024-06-10T00:18:46.054713+0000","last_clean":"2024-06-10T00:18:46.054713+0000","last_became_active":"2024-06-10T00:18:45.066102+0000","last_became_peered":"2024-06-10T00:18:45.066102+0000","last_unstale":"2024-06-10T00:18:46.054713+0000","last_undegraded":"2024-06-10T00:18:46.054713+0000","last_fullsized":"2024-06-10T00:18:46.054713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:10.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072250+0000","last_change":"2024-06-10T00:18:45.066183+0000","last_active":"2024-06-10T00:18:45.072250+0000","last_peered":"2024-06-10T00:18:45.072250+0000","last_clean":"2024-06-10T00:18:45.072250+0000","last_became_active":"2024-06-10T00:18:45.065561+0000","last_became_peered":"2024-06-10T00:18:45.065561+0000","last_unstale":"2024-06-10T00:18:45.072250+0000","last_undegraded":"2024-06-10T00:18:45.072250+0000","last_fullsized":"2024-06-10T00:18:45.072250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:27:52.279087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.069201+0000","last_change":"2024-06-10T00:18:45.067885+0000","last_active":"2024-06-10T00:18:45.069201+0000","last_peered":"2024-06-10T00:18:45.069201+0000","last_clean":"2024-06-10T00:18:45.069201+0000","last_became_active":"2024-06-10T00:18:45.067529+0000","last_became_peered":"2024-06-10T00:18:45.067529+0000","last_unstale":"2024-06-10T00:18:45.069201+0000","last_undegraded":"2024-06-10T00:18:45.069201+0000","last_fullsized":"2024-06-10T00:18:45.069201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:05:33.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054456+0000","last_change":"2024-06-10T00:18:45.071438+0000","last_active":"2024-06-10T00:18:46.054456+0000","last_peered":"2024-06-10T00:18:46.054456+0000","last_clean":"2024-06-10T00:18:46.054456+0000","last_became_active":"2024-06-10T00:18:45.071148+0000","last_became_peered":"2024-06-10T00:18:45.071148+0000","last_unstale":"2024-06-10T00:18:46.054456+0000","last_undegraded":"2024-06-10T00:18:46.054456+0000","last_fullsized":"2024-06-10T00:18:46.054456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:51.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072167+0000","last_change":"2024-06-10T00:18:45.066685+0000","last_active":"2024-06-10T00:18:45.072167+0000","last_peered":"2024-06-10T00:18:45.072167+0000","last_clean":"2024-06-10T00:18:45.072167+0000","last_became_active":"2024-06-10T00:18:45.066140+0000","last_became_peered":"2024-06-10T00:18:45.066140+0000","last_unstale":"2024-06-10T00:18:45.072167+0000","last_undegraded":"2024-06-10T00:18:45.072167+0000","last_fullsized":"2024-06-10T00:18:45.072167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:58:45.808307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054303+0000","last_change":"2024-06-10T00:18:45.068618+0000","last_active":"2024-06-10T00:18:46.054303+0000","last_peered":"2024-06-10T00:18:46.054303+0000","last_clean":"2024-06-10T00:18:46.054303+0000","last_became_active":"2024-06-10T00:18:45.068142+0000","last_became_peered":"2024-06-10T00:18:45.068142+0000","last_unstale":"2024-06-10T00:18:46.054303+0000","last_undegraded":"2024-06-10T00:18:46.054303+0000","last_fullsized":"2024-06-10T00:18:46.054303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:47:30.692310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.063567+0000","last_change":"2024-06-10T00:18:45.060396+0000","last_active":"2024-06-10T00:18:45.063567+0000","last_peered":"2024-06-10T00:18:45.063567+0000","last_clean":"2024-06-10T00:18:45.063567+0000","last_became_active":"2024-06-10T00:18:45.060133+0000","last_became_peered":"2024-06-10T00:18:45.060133+0000","last_unstale":"2024-06-10T00:18:45.063567+0000","last_undegraded":"2024-06-10T00:18:45.063567+0000","last_fullsized":"2024-06-10T00:18:45.063567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:21.859451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.085229+0000","last_change":"2024-06-10T00:18:44.054473+0000","last_active":"2024-06-10T00:18:45.085229+0000","last_peered":"2024-06-10T00:18:45.085229+0000","last_clean":"2024-06-10T00:18:45.085229+0000","last_became_active":"2024-06-10T00:18:44.054227+0000","last_became_peered":"2024-06-10T00:18:44.054227+0000","last_unstale":"2024-06-10T00:18:45.085229+0000","last_undegraded":"2024-06-10T00:18:45.085229+0000","last_fullsized":"2024-06-10T00:18:45.085229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:53:14.990420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.071986+0000","last_change":"2024-06-10T00:18:45.068778+0000","last_active":"2024-06-10T00:18:45.071986+0000","last_peered":"2024-06-10T00:18:45.071986+0000","last_clean":"2024-06-10T00:18:45.071986+0000","last_became_active":"2024-06-10T00:18:45.068527+0000","last_became_peered":"2024-06-10T00:18:45.068527+0000","last_unstale":"2024-06-10T00:18:45.071986+0000","last_undegraded":"2024-06-10T00:18:45.071986+0000","last_fullsized":"2024-06-10T00:18:45.071986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:03:33.015513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054560+0000","last_change":"2024-06-10T00:18:44.057504+0000","last_active":"2024-06-10T00:18:46.054560+0000","last_peered":"2024-06-10T00:18:46.054560+0000","last_clean":"2024-06-10T00:18:46.054560+0000","last_became_active":"2024-06-10T00:18:44.057215+0000","last_became_peered":"2024-06-10T00:18:44.057215+0000","last_unstale":"2024-06-10T00:18:46.054560+0000","last_undegraded":"2024-06-10T00:18:46.054560+0000","last_fullsized":"2024-06-10T00:18:46.054560+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:39.320207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053067+0000","last_change":"2024-06-10T00:18:45.064172+0000","last_active":"2024-06-10T00:18:46.053067+0000","last_peered":"2024-06-10T00:18:46.053067+0000","last_clean":"2024-06-10T00:18:46.053067+0000","last_became_active":"2024-06-10T00:18:45.063795+0000","last_became_peered":"2024-06-10T00:18:45.063795+0000","last_unstale":"2024-06-10T00:18:46.053067+0000","last_undegraded":"2024-06-10T00:18:46.053067+0000","last_fullsized":"2024-06-10T00:18:46.053067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:30:53.378953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054554+0000","last_change":"2024-06-10T00:18:44.056925+0000","last_active":"2024-06-10T00:18:46.054554+0000","last_peered":"2024-06-10T00:18:46.054554+0000","last_clean":"2024-06-10T00:18:46.054554+0000","last_became_active":"2024-06-10T00:18:44.056630+0000","last_became_peered":"2024-06-10T00:18:44.056630+0000","last_unstale":"2024-06-10T00:18:46.054554+0000","last_undegraded":"2024-06-10T00:18:46.054554+0000","last_fullsized":"2024-06-10T00:18:46.054554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:23:29.016345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053134+0000","last_change":"2024-06-10T00:18:45.063612+0000","last_active":"2024-06-10T00:18:46.053134+0000","last_peered":"2024-06-10T00:18:46.053134+0000","last_clean":"2024-06-10T00:18:46.053134+0000","last_became_active":"2024-06-10T00:18:45.063243+0000","last_became_peered":"2024-06-10T00:18:45.063243+0000","last_unstale":"2024-06-10T00:18:46.053134+0000","last_undegraded":"2024-06-10T00:18:46.053134+0000","last_fullsized":"2024-06-10T00:18:46.053134+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:13.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.083806+0000","last_change":"2024-06-10T00:18:44.054734+0000","last_active":"2024-06-10T00:18:45.083806+0000","last_peered":"2024-06-10T00:18:45.083806+0000","last_clean":"2024-06-10T00:18:45.083806+0000","last_became_active":"2024-06-10T00:18:44.054306+0000","last_became_peered":"2024-06-10T00:18:44.054306+0000","last_unstale":"2024-06-10T00:18:45.083806+0000","last_undegraded":"2024-06-10T00:18:45.083806+0000","last_fullsized":"2024-06-10T00:18:45.083806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:15.393450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.079214+0000","last_change":"2024-06-10T00:18:45.076911+0000","last_active":"2024-06-10T00:18:45.079214+0000","last_peered":"2024-06-10T00:18:45.079214+0000","last_clean":"2024-06-10T00:18:45.079214+0000","last_became_active":"2024-06-10T00:18:45.076622+0000","last_became_peered":"2024-06-10T00:18:45.076622+0000","last_unstale":"2024-06-10T00:18:45.079214+0000","last_undegraded":"2024-06-10T00:18:45.079214+0000","last_fullsized":"2024-06-10T00:18:45.079214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:51:20.387141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053308+0000","last_change":"2024-06-10T00:18:44.049344+0000","last_active":"2024-06-10T00:18:46.053308+0000","last_peered":"2024-06-10T00:18:46.053308+0000","last_clean":"2024-06-10T00:18:46.053308+0000","last_became_active":"2024-06-10T00:18:44.049006+0000","last_became_peered":"2024-06-10T00:18:44.049006+0000","last_unstale":"2024-06-10T00:18:46.053308+0000","last_undegraded":"2024-06-10T00:18:46.053308+0000","last_fullsized":"2024-06-10T00:18:46.053308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:33:28.298940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078704+0000","last_change":"2024-06-10T00:18:45.076571+0000","last_active":"2024-06-10T00:18:45.078704+0000","last_peered":"2024-06-10T00:18:45.078704+0000","last_clean":"2024-06-10T00:18:45.078704+0000","last_became_active":"2024-06-10T00:18:45.076150+0000","last_became_peered":"2024-06-10T00:18:45.076150+0000","last_unstale":"2024-06-10T00:18:45.078704+0000","last_undegraded":"2024-06-10T00:18:45.078704+0000","last_fullsized":"2024-06-10T00:18:45.078704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:40.321778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080561+0000","last_change":"2024-06-10T00:18:44.055614+0000","last_active":"2024-06-10T00:18:45.080561+0000","last_peered":"2024-06-10T00:18:45.080561+0000","last_clean":"2024-06-10T00:18:45.080561+0000","last_became_active":"2024-06-10T00:18:44.055248+0000","last_became_peered":"2024-06-10T00:18:44.055248+0000","last_unstale":"2024-06-10T00:18:45.080561+0000","last_undegraded":"2024-06-10T00:18:45.080561+0000","last_fullsized":"2024-06-10T00:18:45.080561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:23:29.016345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053503+0000","last_change":"2024-06-10T00:18:45.064050+0000","last_active":"2024-06-10T00:18:46.053503+0000","last_peered":"2024-06-10T00:18:46.053503+0000","last_clean":"2024-06-10T00:18:46.053503+0000","last_became_active":"2024-06-10T00:18:45.063528+0000","last_became_peered":"2024-06-10T00:18:45.063528+0000","last_unstale":"2024-06-10T00:18:46.053503+0000","last_undegraded":"2024-06-10T00:18:46.053503+0000","last_fullsized":"2024-06-10T00:18:46.053503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:38:24.082103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.061168+0000","last_change":"2024-06-10T00:18:44.057400+0000","last_active":"2024-06-10T00:18:45.061168+0000","last_peered":"2024-06-10T00:18:45.061168+0000","last_clean":"2024-06-10T00:18:45.061168+0000","last_became_active":"2024-06-10T00:18:44.057128+0000","last_became_peered":"2024-06-10T00:18:44.057128+0000","last_unstale":"2024-06-10T00:18:45.061168+0000","last_undegraded":"2024-06-10T00:18:45.061168+0000","last_fullsized":"2024-06-10T00:18:45.061168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:30:53.338895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080817+0000","last_change":"2024-06-10T00:18:45.077297+0000","last_active":"2024-06-10T00:18:45.080817+0000","last_peered":"2024-06-10T00:18:45.080817+0000","last_clean":"2024-06-10T00:18:45.080817+0000","last_became_active":"2024-06-10T00:18:45.076976+0000","last_became_peered":"2024-06-10T00:18:45.076976+0000","last_unstale":"2024-06-10T00:18:45.080817+0000","last_undegraded":"2024-06-10T00:18:45.080817+0000","last_fullsized":"2024-06-10T00:18:45.080817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:38:24.082103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.055917+0000","last_change":"2024-06-10T00:18:44.046156+0000","last_active":"2024-06-10T00:18:45.055917+0000","last_peered":"2024-06-10T00:18:45.055917+0000","last_clean":"2024-06-10T00:18:45.055917+0000","last_became_active":"2024-06-10T00:18:44.045865+0000","last_became_peered":"2024-06-10T00:18:44.045865+0000","last_unstale":"2024-06-10T00:18:45.055917+0000","last_undegraded":"2024-06-10T00:18:45.055917+0000","last_fullsized":"2024-06-10T00:18:45.055917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:10.895784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077574+0000","last_change":"2024-06-10T00:18:45.070577+0000","last_active":"2024-06-10T00:18:45.077574+0000","last_peered":"2024-06-10T00:18:45.077574+0000","last_clean":"2024-06-10T00:18:45.077574+0000","last_became_active":"2024-06-10T00:18:45.070300+0000","last_became_peered":"2024-06-10T00:18:45.070300+0000","last_unstale":"2024-06-10T00:18:45.077574+0000","last_undegraded":"2024-06-10T00:18:45.077574+0000","last_fullsized":"2024-06-10T00:18:45.077574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:07.794199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054666+0000","last_change":"2024-06-10T00:18:44.054716+0000","last_active":"2024-06-10T00:18:46.054666+0000","last_peered":"2024-06-10T00:18:46.054666+0000","last_clean":"2024-06-10T00:18:46.054666+0000","last_became_active":"2024-06-10T00:18:44.054025+0000","last_became_peered":"2024-06-10T00:18:44.054025+0000","last_unstale":"2024-06-10T00:18:46.054666+0000","last_undegraded":"2024-06-10T00:18:46.054666+0000","last_fullsized":"2024-06-10T00:18:46.054666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:21.811210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.066701+0000","last_change":"2024-06-10T00:18:45.059536+0000","last_active":"2024-06-10T00:18:45.066701+0000","last_peered":"2024-06-10T00:18:45.066701+0000","last_clean":"2024-06-10T00:18:45.066701+0000","last_became_active":"2024-06-10T00:18:45.059203+0000","last_became_peered":"2024-06-10T00:18:45.059203+0000","last_unstale":"2024-06-10T00:18:45.066701+0000","last_undegraded":"2024-06-10T00:18:45.066701+0000","last_fullsized":"2024-06-10T00:18:45.066701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:23.825201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.053226+0000","last_change":"2024-06-10T00:18:44.050051+0000","last_active":"2024-06-10T00:18:45.053226+0000","last_peered":"2024-06-10T00:18:45.053226+0000","last_clean":"2024-06-10T00:18:45.053226+0000","last_became_active":"2024-06-10T00:18:44.049746+0000","last_became_peered":"2024-06-10T00:18:44.049746+0000","last_unstale":"2024-06-10T00:18:45.053226+0000","last_undegraded":"2024-06-10T00:18:45.053226+0000","last_fullsized":"2024-06-10T00:18:45.053226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:06.792628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056199+0000","last_change":"2024-06-10T00:18:45.069439+0000","last_active":"2024-06-10T00:18:46.056199+0000","last_peered":"2024-06-10T00:18:46.056199+0000","last_clean":"2024-06-10T00:18:46.056199+0000","last_became_active":"2024-06-10T00:18:45.067855+0000","last_became_peered":"2024-06-10T00:18:45.067855+0000","last_unstale":"2024-06-10T00:18:46.056199+0000","last_undegraded":"2024-06-10T00:18:46.056199+0000","last_fullsized":"2024-06-10T00:18:46.056199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:10.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.085492+0000","last_change":"2024-06-10T00:18:44.053155+0000","last_active":"2024-06-10T00:18:45.085492+0000","last_peered":"2024-06-10T00:18:45.085492+0000","last_clean":"2024-06-10T00:18:45.085492+0000","last_became_active":"2024-06-10T00:18:44.052907+0000","last_became_peered":"2024-06-10T00:18:44.052907+0000","last_unstale":"2024-06-10T00:18:45.085492+0000","last_undegraded":"2024-06-10T00:18:45.085492+0000","last_fullsized":"2024-06-10T00:18:45.085492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:56:52.300974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.071821+0000","last_change":"2024-06-10T00:18:45.070216+0000","last_active":"2024-06-10T00:18:45.071821+0000","last_peered":"2024-06-10T00:18:45.071821+0000","last_clean":"2024-06-10T00:18:45.071821+0000","last_became_active":"2024-06-10T00:18:45.069958+0000","last_became_peered":"2024-06-10T00:18:45.069958+0000","last_unstale":"2024-06-10T00:18:45.071821+0000","last_undegraded":"2024-06-10T00:18:45.071821+0000","last_fullsized":"2024-06-10T00:18:45.071821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:32:26.320277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.086844+0000","last_change":"2024-06-10T00:18:44.056194+0000","last_active":"2024-06-10T00:18:45.086844+0000","last_peered":"2024-06-10T00:18:45.086844+0000","last_clean":"2024-06-10T00:18:45.086844+0000","last_became_active":"2024-06-10T00:18:44.055920+0000","last_became_peered":"2024-06-10T00:18:44.055920+0000","last_unstale":"2024-06-10T00:18:45.086844+0000","last_undegraded":"2024-06-10T00:18:45.086844+0000","last_fullsized":"2024-06-10T00:18:45.086844+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:02:43.812414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.066749+0000","last_change":"2024-06-10T00:18:45.059982+0000","last_active":"2024-06-10T00:18:45.066749+0000","last_peered":"2024-06-10T00:18:45.066749+0000","last_clean":"2024-06-10T00:18:45.066749+0000","last_became_active":"2024-06-10T00:18:45.059713+0000","last_became_peered":"2024-06-10T00:18:45.059713+0000","last_unstale":"2024-06-10T00:18:45.066749+0000","last_undegraded":"2024-06-10T00:18:45.066749+0000","last_fullsized":"2024-06-10T00:18:45.066749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:57:57.725541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080691+0000","last_change":"2024-06-10T00:18:44.044336+0000","last_active":"2024-06-10T00:18:45.080691+0000","last_peered":"2024-06-10T00:18:45.080691+0000","last_clean":"2024-06-10T00:18:45.080691+0000","last_became_active":"2024-06-10T00:18:44.044047+0000","last_became_peered":"2024-06-10T00:18:44.044047+0000","last_unstale":"2024-06-10T00:18:45.080691+0000","last_undegraded":"2024-06-10T00:18:45.080691+0000","last_fullsized":"2024-06-10T00:18:45.080691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:03:32.013943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078049+0000","last_change":"2024-06-10T00:18:45.072440+0000","last_active":"2024-06-10T00:18:45.078049+0000","last_peered":"2024-06-10T00:18:45.078049+0000","last_clean":"2024-06-10T00:18:45.078049+0000","last_became_active":"2024-06-10T00:18:45.072042+0000","last_became_peered":"2024-06-10T00:18:45.072042+0000","last_unstale":"2024-06-10T00:18:45.078049+0000","last_undegraded":"2024-06-10T00:18:45.078049+0000","last_fullsized":"2024-06-10T00:18:45.078049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:21.859451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054212+0000","last_change":"2024-06-10T00:18:44.056988+0000","last_active":"2024-06-10T00:18:46.054212+0000","last_peered":"2024-06-10T00:18:46.054212+0000","last_clean":"2024-06-10T00:18:46.054212+0000","last_became_active":"2024-06-10T00:18:44.056640+0000","last_became_peered":"2024-06-10T00:18:44.056640+0000","last_unstale":"2024-06-10T00:18:46.054212+0000","last_undegraded":"2024-06-10T00:18:46.054212+0000","last_fullsized":"2024-06-10T00:18:46.054212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:06.792628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.075294+0000","last_change":"2024-06-10T00:18:45.070846+0000","last_active":"2024-06-10T00:18:45.075294+0000","last_peered":"2024-06-10T00:18:45.075294+0000","last_clean":"2024-06-10T00:18:45.075294+0000","last_became_active":"2024-06-10T00:18:45.070562+0000","last_became_peered":"2024-06-10T00:18:45.070562+0000","last_unstale":"2024-06-10T00:18:45.075294+0000","last_undegraded":"2024-06-10T00:18:45.075294+0000","last_fullsized":"2024-06-10T00:18:45.075294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:14:56.158246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.056351+0000","last_change":"2024-06-10T00:18:44.053248+0000","last_active":"2024-06-10T00:18:45.056351+0000","last_peered":"2024-06-10T00:18:45.056351+0000","last_clean":"2024-06-10T00:18:45.056351+0000","last_became_active":"2024-06-10T00:18:44.052920+0000","last_became_peered":"2024-06-10T00:18:44.052920+0000","last_unstale":"2024-06-10T00:18:45.056351+0000","last_undegraded":"2024-06-10T00:18:45.056351+0000","last_fullsized":"2024-06-10T00:18:45.056351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:48:20.013586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.070379+0000","last_change":"2024-06-10T00:18:45.068636+0000","last_active":"2024-06-10T00:18:45.070379+0000","last_peered":"2024-06-10T00:18:45.070379+0000","last_clean":"2024-06-10T00:18:45.070379+0000","last_became_active":"2024-06-10T00:18:45.068308+0000","last_became_peered":"2024-06-10T00:18:45.068308+0000","last_unstale":"2024-06-10T00:18:45.070379+0000","last_undegraded":"2024-06-10T00:18:45.070379+0000","last_fullsized":"2024-06-10T00:18:45.070379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:30:53.378953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.087347+0000","last_change":"2024-06-10T00:18:44.051965+0000","last_active":"2024-06-10T00:18:45.087347+0000","last_peered":"2024-06-10T00:18:45.087347+0000","last_clean":"2024-06-10T00:18:45.087347+0000","last_became_active":"2024-06-10T00:18:44.051672+0000","last_became_peered":"2024-06-10T00:18:44.051672+0000","last_unstale":"2024-06-10T00:18:45.087347+0000","last_undegraded":"2024-06-10T00:18:45.087347+0000","last_fullsized":"2024-06-10T00:18:45.087347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:36:06.748446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.055744+0000","last_change":"2024-06-10T00:18:45.073679+0000","last_active":"2024-06-10T00:18:46.055744+0000","last_peered":"2024-06-10T00:18:46.055744+0000","last_clean":"2024-06-10T00:18:46.055744+0000","last_became_active":"2024-06-10T00:18:45.073362+0000","last_became_peered":"2024-06-10T00:18:45.073362+0000","last_unstale":"2024-06-10T00:18:46.055744+0000","last_undegraded":"2024-06-10T00:18:46.055744+0000","last_fullsized":"2024-06-10T00:18:46.055744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:00:39.840115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054752+0000","last_change":"2024-06-10T00:18:44.054823+0000","last_active":"2024-06-10T00:18:46.054752+0000","last_peered":"2024-06-10T00:18:46.054752+0000","last_clean":"2024-06-10T00:18:46.054752+0000","last_became_active":"2024-06-10T00:18:44.054340+0000","last_became_peered":"2024-06-10T00:18:44.054340+0000","last_unstale":"2024-06-10T00:18:46.054752+0000","last_undegraded":"2024-06-10T00:18:46.054752+0000","last_fullsized":"2024-06-10T00:18:46.054752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:57:56.723970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080032+0000","last_change":"2024-06-10T00:18:45.072777+0000","last_active":"2024-06-10T00:18:45.080032+0000","last_peered":"2024-06-10T00:18:45.080032+0000","last_clean":"2024-06-10T00:18:45.080032+0000","last_became_active":"2024-06-10T00:18:45.072518+0000","last_became_peered":"2024-06-10T00:18:45.072518+0000","last_unstale":"2024-06-10T00:18:45.080032+0000","last_undegraded":"2024-06-10T00:18:45.080032+0000","last_fullsized":"2024-06-10T00:18:45.080032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:11:12.281468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053491+0000","last_change":"2024-06-10T00:18:44.049336+0000","last_active":"2024-06-10T00:18:46.053491+0000","last_peered":"2024-06-10T00:18:46.053491+0000","last_clean":"2024-06-10T00:18:46.053491+0000","last_became_active":"2024-06-10T00:18:44.049043+0000","last_became_peered":"2024-06-10T00:18:44.049043+0000","last_unstale":"2024-06-10T00:18:46.053491+0000","last_undegraded":"2024-06-10T00:18:46.053491+0000","last_fullsized":"2024-06-10T00:18:46.053491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:00:17.808361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.074330+0000","last_change":"2024-06-10T00:18:45.070628+0000","last_active":"2024-06-10T00:18:45.074330+0000","last_peered":"2024-06-10T00:18:45.074330+0000","last_clean":"2024-06-10T00:18:45.074330+0000","last_became_active":"2024-06-10T00:18:45.070337+0000","last_became_peered":"2024-06-10T00:18:45.070337+0000","last_unstale":"2024-06-10T00:18:45.074330+0000","last_undegraded":"2024-06-10T00:18:45.074330+0000","last_fullsized":"2024-06-10T00:18:45.074330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:02:33.681287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.086626+0000","last_change":"2024-06-10T00:18:44.052597+0000","last_active":"2024-06-10T00:18:45.086626+0000","last_peered":"2024-06-10T00:18:45.086626+0000","last_clean":"2024-06-10T00:18:45.086626+0000","last_became_active":"2024-06-10T00:18:44.052308+0000","last_became_peered":"2024-06-10T00:18:44.052308+0000","last_unstale":"2024-06-10T00:18:45.086626+0000","last_undegraded":"2024-06-10T00:18:45.086626+0000","last_fullsized":"2024-06-10T00:18:45.086626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:56:50.057761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.055969+0000","last_change":"2024-06-10T00:18:45.074026+0000","last_active":"2024-06-10T00:18:46.055969+0000","last_peered":"2024-06-10T00:18:46.055969+0000","last_clean":"2024-06-10T00:18:46.055969+0000","last_became_active":"2024-06-10T00:18:45.073536+0000","last_became_peered":"2024-06-10T00:18:45.073536+0000","last_unstale":"2024-06-10T00:18:46.055969+0000","last_undegraded":"2024-06-10T00:18:46.055969+0000","last_fullsized":"2024-06-10T00:18:46.055969+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:25:50.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.051212+0000","last_change":"2024-06-10T00:18:44.047588+0000","last_active":"2024-06-10T00:18:45.051212+0000","last_peered":"2024-06-10T00:18:45.051212+0000","last_clean":"2024-06-10T00:18:45.051212+0000","last_became_active":"2024-06-10T00:18:44.047329+0000","last_became_peered":"2024-06-10T00:18:44.047329+0000","last_unstale":"2024-06-10T00:18:45.051212+0000","last_undegraded":"2024-06-10T00:18:45.051212+0000","last_fullsized":"2024-06-10T00:18:45.051212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:12.609998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077529+0000","last_change":"2024-06-10T00:18:45.069742+0000","last_active":"2024-06-10T00:18:45.077529+0000","last_peered":"2024-06-10T00:18:45.077529+0000","last_clean":"2024-06-10T00:18:45.077529+0000","last_became_active":"2024-06-10T00:18:45.069476+0000","last_became_peered":"2024-06-10T00:18:45.069476+0000","last_unstale":"2024-06-10T00:18:45.077529+0000","last_undegraded":"2024-06-10T00:18:45.077529+0000","last_fullsized":"2024-06-10T00:18:45.077529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:38.555916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056052+0000","last_change":"2024-06-10T00:18:44.050931+0000","last_active":"2024-06-10T00:18:46.056052+0000","last_peered":"2024-06-10T00:18:46.056052+0000","last_clean":"2024-06-10T00:18:46.056052+0000","last_became_active":"2024-06-10T00:18:44.050665+0000","last_became_peered":"2024-06-10T00:18:44.050665+0000","last_unstale":"2024-06-10T00:18:46.056052+0000","last_undegraded":"2024-06-10T00:18:46.056052+0000","last_fullsized":"2024-06-10T00:18:46.056052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:57:56.723970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078689+0000","last_change":"2024-06-10T00:18:45.072725+0000","last_active":"2024-06-10T00:18:45.078689+0000","last_peered":"2024-06-10T00:18:45.078689+0000","last_clean":"2024-06-10T00:18:45.078689+0000","last_became_active":"2024-06-10T00:18:45.072451+0000","last_became_peered":"2024-06-10T00:18:45.072451+0000","last_unstale":"2024-06-10T00:18:45.078689+0000","last_undegraded":"2024-06-10T00:18:45.078689+0000","last_fullsized":"2024-06-10T00:18:45.078689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:57:57.725541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.055847+0000","last_change":"2024-06-10T00:18:44.051359+0000","last_active":"2024-06-10T00:18:46.055847+0000","last_peered":"2024-06-10T00:18:46.055847+0000","last_clean":"2024-06-10T00:18:46.055847+0000","last_became_active":"2024-06-10T00:18:44.051102+0000","last_became_peered":"2024-06-10T00:18:44.051102+0000","last_unstale":"2024-06-10T00:18:46.055847+0000","last_undegraded":"2024-06-10T00:18:46.055847+0000","last_fullsized":"2024-06-10T00:18:46.055847+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:21.811210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.068514+0000","last_change":"2024-06-10T00:18:45.067452+0000","last_active":"2024-06-10T00:18:45.068514+0000","last_peered":"2024-06-10T00:18:45.068514+0000","last_clean":"2024-06-10T00:18:45.068514+0000","last_became_active":"2024-06-10T00:18:45.067173+0000","last_became_peered":"2024-06-10T00:18:45.067173+0000","last_unstale":"2024-06-10T00:18:45.068514+0000","last_undegraded":"2024-06-10T00:18:45.068514+0000","last_fullsized":"2024-06-10T00:18:45.068514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:30:26.073536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.055791+0000","last_change":"2024-06-10T00:18:44.052211+0000","last_active":"2024-06-10T00:18:46.055791+0000","last_peered":"2024-06-10T00:18:46.055791+0000","last_clean":"2024-06-10T00:18:46.055791+0000","last_became_active":"2024-06-10T00:18:44.051900+0000","last_became_peered":"2024-06-10T00:18:44.051900+0000","last_unstale":"2024-06-10T00:18:46.055791+0000","last_undegraded":"2024-06-10T00:18:46.055791+0000","last_fullsized":"2024-06-10T00:18:46.055791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:22.823630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053029+0000","last_change":"2024-06-10T00:18:45.066282+0000","last_active":"2024-06-10T00:18:46.053029+0000","last_peered":"2024-06-10T00:18:46.053029+0000","last_clean":"2024-06-10T00:18:46.053029+0000","last_became_active":"2024-06-10T00:18:45.065989+0000","last_became_peered":"2024-06-10T00:18:45.065989+0000","last_unstale":"2024-06-10T00:18:46.053029+0000","last_undegraded":"2024-06-10T00:18:46.053029+0000","last_fullsized":"2024-06-10T00:18:46.053029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:30:26.073536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080733+0000","last_change":"2024-06-10T00:18:44.049115+0000","last_active":"2024-06-10T00:18:45.080733+0000","last_peered":"2024-06-10T00:18:45.080733+0000","last_clean":"2024-06-10T00:18:45.080733+0000","last_became_active":"2024-06-10T00:18:44.048841+0000","last_became_peered":"2024-06-10T00:18:44.048841+0000","last_unstale":"2024-06-10T00:18:45.080733+0000","last_undegraded":"2024-06-10T00:18:45.080733+0000","last_fullsized":"2024-06-10T00:18:45.080733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:37.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.070344+0000","last_change":"2024-06-10T00:18:45.068702+0000","last_active":"2024-06-10T00:18:45.070344+0000","last_peered":"2024-06-10T00:18:45.070344+0000","last_clean":"2024-06-10T00:18:45.070344+0000","last_became_active":"2024-06-10T00:18:45.068406+0000","last_became_peered":"2024-06-10T00:18:45.068406+0000","last_unstale":"2024-06-10T00:18:45.070344+0000","last_undegraded":"2024-06-10T00:18:45.070344+0000","last_fullsized":"2024-06-10T00:18:45.070344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:13.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.064267+0000","last_change":"2024-06-10T00:18:44.057361+0000","last_active":"2024-06-10T00:18:45.064267+0000","last_peered":"2024-06-10T00:18:45.064267+0000","last_clean":"2024-06-10T00:18:45.064267+0000","last_became_active":"2024-06-10T00:18:44.057075+0000","last_became_peered":"2024-06-10T00:18:44.057075+0000","last_unstale":"2024-06-10T00:18:45.064267+0000","last_undegraded":"2024-06-10T00:18:45.064267+0000","last_fullsized":"2024-06-10T00:18:45.064267+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:27:37.022566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053296+0000","last_change":"2024-06-10T00:18:45.064080+0000","last_active":"2024-06-10T00:18:46.053296+0000","last_peered":"2024-06-10T00:18:46.053296+0000","last_clean":"2024-06-10T00:18:46.053296+0000","last_became_active":"2024-06-10T00:18:45.063545+0000","last_became_peered":"2024-06-10T00:18:45.063545+0000","last_unstale":"2024-06-10T00:18:46.053296+0000","last_undegraded":"2024-06-10T00:18:46.053296+0000","last_fullsized":"2024-06-10T00:18:46.053296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:14:56.158246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054799+0000","last_change":"2024-06-10T00:18:44.054893+0000","last_active":"2024-06-10T00:18:46.054799+0000","last_peered":"2024-06-10T00:18:46.054799+0000","last_clean":"2024-06-10T00:18:46.054799+0000","last_became_active":"2024-06-10T00:18:44.054496+0000","last_became_peered":"2024-06-10T00:18:44.054496+0000","last_unstale":"2024-06-10T00:18:46.054799+0000","last_undegraded":"2024-06-10T00:18:46.054799+0000","last_fullsized":"2024-06-10T00:18:46.054799+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:55:46.468960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077505+0000","last_change":"2024-06-10T00:18:45.071125+0000","last_active":"2024-06-10T00:18:45.077505+0000","last_peered":"2024-06-10T00:18:45.077505+0000","last_clean":"2024-06-10T00:18:45.077505+0000","last_became_active":"2024-06-10T00:18:45.070861+0000","last_became_peered":"2024-06-10T00:18:45.070861+0000","last_unstale":"2024-06-10T00:18:45.077505+0000","last_undegraded":"2024-06-10T00:18:45.077505+0000","last_fullsized":"2024-06-10T00:18:45.077505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:23.825201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054401+0000","last_change":"2024-06-10T00:18:44.051808+0000","last_active":"2024-06-10T00:18:46.054401+0000","last_peered":"2024-06-10T00:18:46.054401+0000","last_clean":"2024-06-10T00:18:46.054401+0000","last_became_active":"2024-06-10T00:18:44.051532+0000","last_became_peered":"2024-06-10T00:18:44.051532+0000","last_unstale":"2024-06-10T00:18:46.054401+0000","last_undegraded":"2024-06-10T00:18:46.054401+0000","last_fullsized":"2024-06-10T00:18:46.054401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:22.823630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.076361+0000","last_change":"2024-06-10T00:18:45.069636+0000","last_active":"2024-06-10T00:18:45.076361+0000","last_peered":"2024-06-10T00:18:45.076361+0000","last_clean":"2024-06-10T00:18:45.076361+0000","last_became_active":"2024-06-10T00:18:45.069360+0000","last_became_peered":"2024-06-10T00:18:45.069360+0000","last_unstale":"2024-06-10T00:18:45.076361+0000","last_undegraded":"2024-06-10T00:18:45.076361+0000","last_fullsized":"2024-06-10T00:18:45.076361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:27.822385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.063110+0000","last_change":"2024-06-10T00:18:44.054852+0000","last_active":"2024-06-10T00:18:45.063110+0000","last_peered":"2024-06-10T00:18:45.063110+0000","last_clean":"2024-06-10T00:18:45.063110+0000","last_became_active":"2024-06-10T00:18:44.054559+0000","last_became_peered":"2024-06-10T00:18:44.054559+0000","last_unstale":"2024-06-10T00:18:45.063110+0000","last_undegraded":"2024-06-10T00:18:45.063110+0000","last_fullsized":"2024-06-10T00:18:45.063110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:14:15.946285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080869+0000","last_change":"2024-06-10T00:18:45.077374+0000","last_active":"2024-06-10T00:18:45.080869+0000","last_peered":"2024-06-10T00:18:45.080869+0000","last_clean":"2024-06-10T00:18:45.080869+0000","last_became_active":"2024-06-10T00:18:45.077076+0000","last_became_peered":"2024-06-10T00:18:45.077076+0000","last_unstale":"2024-06-10T00:18:45.080869+0000","last_undegraded":"2024-06-10T00:18:45.080869+0000","last_fullsized":"2024-06-10T00:18:45.080869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:58:45.808307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.056110+0000","last_change":"2024-06-10T00:18:44.055315+0000","last_active":"2024-06-10T00:18:45.056110+0000","last_peered":"2024-06-10T00:18:45.056110+0000","last_clean":"2024-06-10T00:18:45.056110+0000","last_became_active":"2024-06-10T00:18:44.055056+0000","last_became_peered":"2024-06-10T00:18:44.055056+0000","last_unstale":"2024-06-10T00:18:45.056110+0000","last_undegraded":"2024-06-10T00:18:45.056110+0000","last_fullsized":"2024-06-10T00:18:45.056110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:03:00.534882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.079176+0000","last_change":"2024-06-10T00:18:45.078522+0000","last_active":"2024-06-10T00:18:45.079176+0000","last_peered":"2024-06-10T00:18:45.079176+0000","last_clean":"2024-06-10T00:18:45.079176+0000","last_became_active":"2024-06-10T00:18:45.078255+0000","last_became_peered":"2024-06-10T00:18:45.078255+0000","last_unstale":"2024-06-10T00:18:45.079176+0000","last_undegraded":"2024-06-10T00:18:45.079176+0000","last_fullsized":"2024-06-10T00:18:45.079176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:33:42.202447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.063433+0000","last_change":"2024-06-10T00:18:44.054792+0000","last_active":"2024-06-10T00:18:45.063433+0000","last_peered":"2024-06-10T00:18:45.063433+0000","last_clean":"2024-06-10T00:18:45.063433+0000","last_became_active":"2024-06-10T00:18:44.054482+0000","last_became_peered":"2024-06-10T00:18:44.054482+0000","last_unstale":"2024-06-10T00:18:45.063433+0000","last_undegraded":"2024-06-10T00:18:45.063433+0000","last_fullsized":"2024-06-10T00:18:45.063433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:46:07.566757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.066859+0000","last_change":"2024-06-10T00:18:45.060026+0000","last_active":"2024-06-10T00:18:45.066859+0000","last_peered":"2024-06-10T00:18:45.066859+0000","last_clean":"2024-06-10T00:18:45.066859+0000","last_became_active":"2024-06-10T00:18:45.059693+0000","last_became_peered":"2024-06-10T00:18:45.059693+0000","last_unstale":"2024-06-10T00:18:45.066859+0000","last_undegraded":"2024-06-10T00:18:45.066859+0000","last_fullsized":"2024-06-10T00:18:45.066859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:14:56.158246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.051268+0000","last_change":"2024-06-10T00:18:44.048941+0000","last_active":"2024-06-10T00:18:45.051268+0000","last_peered":"2024-06-10T00:18:45.051268+0000","last_clean":"2024-06-10T00:18:45.051268+0000","last_became_active":"2024-06-10T00:18:44.048668+0000","last_became_peered":"2024-06-10T00:18:44.048668+0000","last_unstale":"2024-06-10T00:18:45.051268+0000","last_undegraded":"2024-06-10T00:18:45.051268+0000","last_fullsized":"2024-06-10T00:18:45.051268+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:26.820814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054718+0000","last_change":"2024-06-10T00:18:45.067551+0000","last_active":"2024-06-10T00:18:46.054718+0000","last_peered":"2024-06-10T00:18:46.054718+0000","last_clean":"2024-06-10T00:18:46.054718+0000","last_became_active":"2024-06-10T00:18:45.067254+0000","last_became_peered":"2024-06-10T00:18:45.067254+0000","last_unstale":"2024-06-10T00:18:46.054718+0000","last_undegraded":"2024-06-10T00:18:46.054718+0000","last_fullsized":"2024-06-10T00:18:46.054718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:53.744217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056269+0000","last_change":"2024-06-10T00:18:44.054280+0000","last_active":"2024-06-10T00:18:46.056269+0000","last_peered":"2024-06-10T00:18:46.056269+0000","last_clean":"2024-06-10T00:18:46.056269+0000","last_became_active":"2024-06-10T00:18:44.053999+0000","last_became_peered":"2024-06-10T00:18:44.053999+0000","last_unstale":"2024-06-10T00:18:46.056269+0000","last_undegraded":"2024-06-10T00:18:46.056269+0000","last_fullsized":"2024-06-10T00:18:46.056269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:55:46.468960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054332+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:18:46.054332+0000","last_peered":"2024-06-10T00:18:46.054332+0000","last_clean":"2024-06-10T00:18:46.054332+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:18:46.054332+0000","last_undegraded":"2024-06-10T00:18:46.054332+0000","last_fullsized":"2024-06-10T00:18:46.054332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1503232,"data_stored":1001093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":412315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":410737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":412419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":411285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":411445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":410815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1499136,"data_stored":1001071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:18:48.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:18:48.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.166+0000 7fd1759c8640 1 Processor -- start 2024-06-10T00:18:48.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.166+0000 7fd1759c8640 1 -- start start 2024-06-10T00:18:48.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.167+0000 7fd1759c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17006fab0 0x7fd1700b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.167+0000 7fd1759c8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1700b3c00 0x7fd17006b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.167+0000 7fd1759c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd17006ff90 con 0x7fd17015e260 2024-06-10T00:18:48.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.167+0000 7fd1759c8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd1700d14f0 con 0x7fd1700b3c00 2024-06-10T00:18:48.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.167+0000 7fd1759c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd1700d17d0 con 0x7fd17006fab0 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.167+0000 7fd16effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd17015e260 0x7fd17006e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35956/0 (socket says 172.21.15.79:35956) 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.167+0000 7fd16effd640 1 -- 172.21.15.79:0/2729893343 learned_addr learned my addr 172.21.15.79:0/2729893343 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16f7fe640 1 --2- 172.21.15.79:0/2729893343 >> v2:172.21.15.117:3300/0 conn(0x7fd1700b3c00 0x7fd17006b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16e7fc640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17006fab0 0x7fd1700b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843711223 0 0) 0x7fd17006ff90 con 0x7fd17015e260 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd158003520 con 0x7fd17015e260 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3782161741 0 0) 0x7fd158003520 con 0x7fd17015e260 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17006fab0 msgr2=0x7fd1700b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17006fab0 0x7fd1700b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 >> v2:172.21.15.117:3300/0 conn(0x7fd1700b3c00 msgr2=0x7fd17006b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 --2- 172.21.15.79:0/2729893343 >> v2:172.21.15.117:3300/0 conn(0x7fd1700b3c00 0x7fd17006b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1700b5aa0 con 0x7fd17015e260 2024-06-10T00:18:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fd1600019f0 con 0x7fd17015e260 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 >> v1:172.21.15.79:6789/0 conn(0x7fd17015e260 legacy=0x7fd17006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17006fab0 0x7fd1580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd158003f30 0x7fd158004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd158004d40 0x7fd1580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1700d14f0 con 0x7fd158004d40 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd1700d17d0 con 0x7fd158003f30 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd15800ba10 con 0x7fd17006fab0 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16f7fe640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd158004d40 0x7fd1580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16effd640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17006fab0 0x7fd1580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16e7fc640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd158003f30 0x7fd158004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16f7fe640 1 -- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17006fab0 msgr2=0x7fd1580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16f7fe640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17006fab0 0x7fd1580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16f7fe640 1 -- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd158003f30 msgr2=0x7fd158004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16f7fe640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd158003f30 0x7fd158004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.168+0000 7fd16f7fe640 1 -- 172.21.15.79:0/2729893343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd158003520 con 0x7fd158004d40 2024-06-10T00:18:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.169+0000 7fd16f7fe640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd158004d40 0x7fd1580051c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd168009af0 tx=0x7fd158005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef9614e50e21016 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.169+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168036070 con 0x7fd158004d40 2024-06-10T00:18:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.169+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168031400 con 0x7fd158004d40 2024-06-10T00:18:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.169+0000 7fd16dffb640 1 -- 172.21.15.79:0/2729893343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168009690 con 0x7fd158004d40 2024-06-10T00:18:48.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.170+0000 7fd1759c8640 1 -- 172.21.15.79:0/2729893343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd158004d40 msgr2=0x7fd1580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.170+0000 7fd1759c8640 1 --2- 172.21.15.79:0/2729893343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd158004d40 0x7fd1580051c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd168009af0 tx=0x7fd158005830 comp rx=0 tx=0).stop 2024-06-10T00:18:48.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.170+0000 7fd16f7fe640 1 -- 172.21.15.79:0/2729893343 reap_dead start 2024-06-10T00:18:48.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.170+0000 7fd1759c8640 1 -- 172.21.15.79:0/2729893343 shutdown_connections 2024-06-10T00:18:48.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.170+0000 7fd1759c8640 1 -- 172.21.15.79:0/2729893343 >> 172.21.15.79:0/2729893343 conn(0x7fd17006c4d0 msgr2=0x7fd17006c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:48.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.170+0000 7fd1759c8640 1 -- 172.21.15.79:0/2729893343 shutdown_connections 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.170+0000 7fd1759c8640 1 -- 172.21.15.79:0/2729893343 wait complete. 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.171+0000 7fd1759c8640 1 Processor -- start 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.171+0000 7fd1759c8640 1 -- start start 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd1759c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd158004d40 0x7fd1701f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd1759c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17014a8c0 0x7fd170160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd1759c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd170160c80 0x7fd17015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd1759c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1700b5fc0 con 0x7fd17014a8c0 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd1759c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd170072e50 con 0x7fd170160c80 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd1759c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd1700b6140 con 0x7fd158004d40 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17014a8c0 0x7fd170160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17014a8c0 0x7fd170160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34640/0 (socket says 172.21.15.79:34640) 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 -- 172.21.15.79:0/3616218177 learned_addr learned my addr 172.21.15.79:0/3616218177 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 -- 172.21.15.79:0/3616218177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd158004d40 msgr2=0x7fd1701f7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd158004d40 0x7fd1701f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 -- 172.21.15.79:0/3616218177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd170160c80 msgr2=0x7fd17015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16f7fe640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd170160c80 0x7fd17015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd170160c80 0x7fd17015c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 -- 172.21.15.79:0/3616218177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1701611e0 con 0x7fd17014a8c0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.172+0000 7fd16e7fc640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17014a8c0 0x7fd170160740 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd164011a00 tx=0x7fd164011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.173+0000 7fd157fff640 1 -- 172.21.15.79:0/3616218177 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16400fb50 con 0x7fd17014a8c0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.173+0000 7fd157fff640 1 -- 172.21.15.79:0/3616218177 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16400fcf0 con 0x7fd17014a8c0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.173+0000 7fd157fff640 1 -- 172.21.15.79:0/3616218177 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16400fea0 con 0x7fd17014a8c0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.173+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1701614c0 con 0x7fd17014a8c0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.173+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1701f7560 con 0x7fd17014a8c0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.174+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1700b40b0 con 0x7fd17014a8c0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.174+0000 7fd157fff640 1 -- 172.21.15.79:0/3616218177 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd164012040 con 0x7fd17014a8c0 2024-06-10T00:18:48.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.174+0000 7fd157fff640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd15c06be30 0x7fd15c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.175+0000 7fd157fff640 1 -- 172.21.15.79:0/3616218177 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd16408b670 con 0x7fd17014a8c0 2024-06-10T00:18:48.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.175+0000 7fd16effd640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd15c06be30 0x7fd15c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.175+0000 7fd16effd640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd15c06be30 0x7fd15c06e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd160001330 tx=0x7fd1600014d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.179+0000 7fd157fff640 1 -- 172.21.15.79:0/3616218177 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd1700b40b0 con 0x7fd17014a8c0 2024-06-10T00:18:48.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.349+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd170068ad0 con 0x7fd15c06be30 2024-06-10T00:18:48.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.355+0000 7fd157fff640 1 -- 172.21.15.79:0/3616218177 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252025 (secure 0 0 0) 0x7fd170068ad0 con 0x7fd15c06be30 2024-06-10T00:18:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:48.358 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:18:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.357+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd15c06be30 msgr2=0x7fd15c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.357+0000 7fd1759c8640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd15c06be30 0x7fd15c06e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd160001330 tx=0x7fd1600014d0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17014a8c0 msgr2=0x7fd170160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17014a8c0 0x7fd170160740 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd164011a00 tx=0x7fd164011ec0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 shutdown_connections 2024-06-10T00:18:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd15c06be30 0x7fd15c06e2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd170160c80 0x7fd17015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17014a8c0 0x7fd170160740 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 --2- 172.21.15.79:0/3616218177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd158004d40 0x7fd1701f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 >> 172.21.15.79:0/3616218177 conn(0x7fd17006c4d0 msgr2=0x7fd17006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 shutdown_connections 2024-06-10T00:18:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.358+0000 7fd1759c8640 1 -- 172.21.15.79:0/3616218177 wait complete. 2024-06-10T00:18:48.368 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-06-10T00:18:47.199438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228652,"kb_used_data":8296,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746068,"statfs":{"total":773094113280,"available":772859973632,"internally_reserved":0,"allocated":8495104,"data_stored":4471180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.167711"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054709+0000","last_change":"2024-06-10T00:18:45.065201+0000","last_active":"2024-06-10T00:18:46.054709+0000","last_peered":"2024-06-10T00:18:46.054709+0000","last_clean":"2024-06-10T00:18:46.054709+0000","last_became_active":"2024-06-10T00:18:45.064919+0000","last_became_peered":"2024-06-10T00:18:45.064919+0000","last_unstale":"2024-06-10T00:18:46.054709+0000","last_undegraded":"2024-06-10T00:18:46.054709+0000","last_fullsized":"2024-06-10T00:18:46.054709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:25:28.578468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078729+0000","last_change":"2024-06-10T00:18:45.076738+0000","last_active":"2024-06-10T00:18:45.078729+0000","last_peered":"2024-06-10T00:18:45.078729+0000","last_clean":"2024-06-10T00:18:45.078729+0000","last_became_active":"2024-06-10T00:18:45.076442+0000","last_became_peered":"2024-06-10T00:18:45.076442+0000","last_unstale":"2024-06-10T00:18:45.078729+0000","last_undegraded":"2024-06-10T00:18:45.078729+0000","last_fullsized":"2024-06-10T00:18:45.078729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:05:58.128592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.076533+0000","last_change":"2024-06-10T00:18:45.071378+0000","last_active":"2024-06-10T00:18:45.076533+0000","last_peered":"2024-06-10T00:18:45.076533+0000","last_clean":"2024-06-10T00:18:45.076533+0000","last_became_active":"2024-06-10T00:18:45.071100+0000","last_became_peered":"2024-06-10T00:18:45.071100+0000","last_unstale":"2024-06-10T00:18:45.076533+0000","last_undegraded":"2024-06-10T00:18:45.076533+0000","last_fullsized":"2024-06-10T00:18:45.076533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:30:52.332325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.066725+0000","last_change":"2024-06-10T00:18:45.059816+0000","last_active":"2024-06-10T00:18:45.066725+0000","last_peered":"2024-06-10T00:18:45.066725+0000","last_clean":"2024-06-10T00:18:45.066725+0000","last_became_active":"2024-06-10T00:18:45.058801+0000","last_became_peered":"2024-06-10T00:18:45.058801+0000","last_unstale":"2024-06-10T00:18:45.066725+0000","last_undegraded":"2024-06-10T00:18:45.066725+0000","last_fullsized":"2024-06-10T00:18:45.066725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:22.812781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072323+0000","last_change":"2024-06-10T00:18:45.063708+0000","last_active":"2024-06-10T00:18:45.072323+0000","last_peered":"2024-06-10T00:18:45.072323+0000","last_clean":"2024-06-10T00:18:45.072323+0000","last_became_active":"2024-06-10T00:18:45.063467+0000","last_became_peered":"2024-06-10T00:18:45.063467+0000","last_unstale":"2024-06-10T00:18:45.072323+0000","last_undegraded":"2024-06-10T00:18:45.072323+0000","last_fullsized":"2024-06-10T00:18:45.072323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:49:45.780075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056042+0000","last_change":"2024-06-10T00:18:45.070111+0000","last_active":"2024-06-10T00:18:46.056042+0000","last_peered":"2024-06-10T00:18:46.056042+0000","last_clean":"2024-06-10T00:18:46.056042+0000","last_became_active":"2024-06-10T00:18:45.069159+0000","last_became_peered":"2024-06-10T00:18:45.069159+0000","last_unstale":"2024-06-10T00:18:46.056042+0000","last_undegraded":"2024-06-10T00:18:46.056042+0000","last_fullsized":"2024-06-10T00:18:46.056042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:47:30.692310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080923+0000","last_change":"2024-06-10T00:18:45.077937+0000","last_active":"2024-06-10T00:18:45.080923+0000","last_peered":"2024-06-10T00:18:45.080923+0000","last_clean":"2024-06-10T00:18:45.080923+0000","last_became_active":"2024-06-10T00:18:45.077615+0000","last_became_peered":"2024-06-10T00:18:45.077615+0000","last_unstale":"2024-06-10T00:18:45.080923+0000","last_undegraded":"2024-06-10T00:18:45.080923+0000","last_fullsized":"2024-06-10T00:18:45.080923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:32:26.320277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.071911+0000","last_change":"2024-06-10T00:18:45.063068+0000","last_active":"2024-06-10T00:18:45.071911+0000","last_peered":"2024-06-10T00:18:45.071911+0000","last_clean":"2024-06-10T00:18:45.071911+0000","last_became_active":"2024-06-10T00:18:45.062807+0000","last_became_peered":"2024-06-10T00:18:45.062807+0000","last_unstale":"2024-06-10T00:18:45.071911+0000","last_undegraded":"2024-06-10T00:18:45.071911+0000","last_fullsized":"2024-06-10T00:18:45.071911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:25:12.828830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053425+0000","last_change":"2024-06-10T00:18:45.065214+0000","last_active":"2024-06-10T00:18:46.053425+0000","last_peered":"2024-06-10T00:18:46.053425+0000","last_clean":"2024-06-10T00:18:46.053425+0000","last_became_active":"2024-06-10T00:18:45.064446+0000","last_became_peered":"2024-06-10T00:18:45.064446+0000","last_unstale":"2024-06-10T00:18:46.053425+0000","last_undegraded":"2024-06-10T00:18:46.053425+0000","last_fullsized":"2024-06-10T00:18:46.053425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:21.859451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.069229+0000","last_change":"2024-06-10T00:18:45.065593+0000","last_active":"2024-06-10T00:18:45.069229+0000","last_peered":"2024-06-10T00:18:45.069229+0000","last_clean":"2024-06-10T00:18:45.069229+0000","last_became_active":"2024-06-10T00:18:45.065297+0000","last_became_peered":"2024-06-10T00:18:45.065297+0000","last_unstale":"2024-06-10T00:18:45.069229+0000","last_undegraded":"2024-06-10T00:18:45.069229+0000","last_fullsized":"2024-06-10T00:18:45.069229+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:55:47.470531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.079380+0000","last_change":"2024-06-10T00:18:45.077146+0000","last_active":"2024-06-10T00:18:45.079380+0000","last_peered":"2024-06-10T00:18:45.079380+0000","last_clean":"2024-06-10T00:18:45.079380+0000","last_became_active":"2024-06-10T00:18:45.076363+0000","last_became_peered":"2024-06-10T00:18:45.076363+0000","last_unstale":"2024-06-10T00:18:45.079380+0000","last_undegraded":"2024-06-10T00:18:45.079380+0000","last_fullsized":"2024-06-10T00:18:45.079380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:53:04.858860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078078+0000","last_change":"2024-06-10T00:18:45.070735+0000","last_active":"2024-06-10T00:18:45.078078+0000","last_peered":"2024-06-10T00:18:45.078078+0000","last_clean":"2024-06-10T00:18:45.078078+0000","last_became_active":"2024-06-10T00:18:45.070418+0000","last_became_peered":"2024-06-10T00:18:45.070418+0000","last_unstale":"2024-06-10T00:18:45.078078+0000","last_undegraded":"2024-06-10T00:18:45.078078+0000","last_fullsized":"2024-06-10T00:18:45.078078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:40.321778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072345+0000","last_change":"2024-06-10T00:18:45.066023+0000","last_active":"2024-06-10T00:18:45.072345+0000","last_peered":"2024-06-10T00:18:45.072345+0000","last_clean":"2024-06-10T00:18:45.072345+0000","last_became_active":"2024-06-10T00:18:45.065752+0000","last_became_peered":"2024-06-10T00:18:45.065752+0000","last_unstale":"2024-06-10T00:18:45.072345+0000","last_undegraded":"2024-06-10T00:18:45.072345+0000","last_fullsized":"2024-06-10T00:18:45.072345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:02:46.810539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056056+0000","last_change":"2024-06-10T00:18:45.069880+0000","last_active":"2024-06-10T00:18:46.056056+0000","last_peered":"2024-06-10T00:18:46.056056+0000","last_clean":"2024-06-10T00:18:46.056056+0000","last_became_active":"2024-06-10T00:18:45.068778+0000","last_became_peered":"2024-06-10T00:18:45.068778+0000","last_unstale":"2024-06-10T00:18:46.056056+0000","last_undegraded":"2024-06-10T00:18:46.056056+0000","last_fullsized":"2024-06-10T00:18:46.056056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:25:28.578468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077568+0000","last_change":"2024-06-10T00:18:45.070378+0000","last_active":"2024-06-10T00:18:45.077568+0000","last_peered":"2024-06-10T00:18:45.077568+0000","last_clean":"2024-06-10T00:18:45.077568+0000","last_became_active":"2024-06-10T00:18:45.070135+0000","last_became_peered":"2024-06-10T00:18:45.070135+0000","last_unstale":"2024-06-10T00:18:45.077568+0000","last_undegraded":"2024-06-10T00:18:45.077568+0000","last_fullsized":"2024-06-10T00:18:45.077568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:23:30.017916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054272+0000","last_change":"2024-06-10T00:18:45.068789+0000","last_active":"2024-06-10T00:18:46.054272+0000","last_peered":"2024-06-10T00:18:46.054272+0000","last_clean":"2024-06-10T00:18:46.054272+0000","last_became_active":"2024-06-10T00:18:45.068505+0000","last_became_peered":"2024-06-10T00:18:45.068505+0000","last_unstale":"2024-06-10T00:18:46.054272+0000","last_undegraded":"2024-06-10T00:18:46.054272+0000","last_fullsized":"2024-06-10T00:18:46.054272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:25:50.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.074360+0000","last_change":"2024-06-10T00:18:45.071194+0000","last_active":"2024-06-10T00:18:45.074360+0000","last_peered":"2024-06-10T00:18:45.074360+0000","last_clean":"2024-06-10T00:18:45.074360+0000","last_became_active":"2024-06-10T00:18:45.070410+0000","last_became_peered":"2024-06-10T00:18:45.070410+0000","last_unstale":"2024-06-10T00:18:45.074360+0000","last_undegraded":"2024-06-10T00:18:45.074360+0000","last_fullsized":"2024-06-10T00:18:45.074360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:32:48.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.071317+0000","last_change":"2024-06-10T00:18:45.065548+0000","last_active":"2024-06-10T00:18:45.071317+0000","last_peered":"2024-06-10T00:18:45.071317+0000","last_clean":"2024-06-10T00:18:45.071317+0000","last_became_active":"2024-06-10T00:18:45.065275+0000","last_became_peered":"2024-06-10T00:18:45.065275+0000","last_unstale":"2024-06-10T00:18:45.071317+0000","last_undegraded":"2024-06-10T00:18:45.071317+0000","last_fullsized":"2024-06-10T00:18:45.071317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:38:24.082103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056045+0000","last_change":"2024-06-10T00:18:45.065615+0000","last_active":"2024-06-10T00:18:46.056045+0000","last_peered":"2024-06-10T00:18:46.056045+0000","last_clean":"2024-06-10T00:18:46.056045+0000","last_became_active":"2024-06-10T00:18:45.065334+0000","last_became_peered":"2024-06-10T00:18:45.065334+0000","last_unstale":"2024-06-10T00:18:46.056045+0000","last_undegraded":"2024-06-10T00:18:46.056045+0000","last_fullsized":"2024-06-10T00:18:46.056045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:51.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080658+0000","last_change":"2024-06-10T00:18:45.074940+0000","last_active":"2024-06-10T00:18:45.080658+0000","last_peered":"2024-06-10T00:18:45.080658+0000","last_clean":"2024-06-10T00:18:45.080658+0000","last_became_active":"2024-06-10T00:18:45.069628+0000","last_became_peered":"2024-06-10T00:18:45.069628+0000","last_unstale":"2024-06-10T00:18:45.080658+0000","last_undegraded":"2024-06-10T00:18:45.080658+0000","last_fullsized":"2024-06-10T00:18:45.080658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:53:40.425366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053236+0000","last_change":"2024-06-10T00:18:45.065054+0000","last_active":"2024-06-10T00:18:46.053236+0000","last_peered":"2024-06-10T00:18:46.053236+0000","last_clean":"2024-06-10T00:18:46.053236+0000","last_became_active":"2024-06-10T00:18:45.064772+0000","last_became_peered":"2024-06-10T00:18:45.064772+0000","last_unstale":"2024-06-10T00:18:46.053236+0000","last_undegraded":"2024-06-10T00:18:46.053236+0000","last_fullsized":"2024-06-10T00:18:46.053236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:27.822385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072030+0000","last_change":"2024-06-10T00:18:45.066652+0000","last_active":"2024-06-10T00:18:45.072030+0000","last_peered":"2024-06-10T00:18:45.072030+0000","last_clean":"2024-06-10T00:18:45.072030+0000","last_became_active":"2024-06-10T00:18:45.066402+0000","last_became_peered":"2024-06-10T00:18:45.066402+0000","last_unstale":"2024-06-10T00:18:45.072030+0000","last_undegraded":"2024-06-10T00:18:45.072030+0000","last_fullsized":"2024-06-10T00:18:45.072030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:55:40.290943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.052996+0000","last_change":"2024-06-10T00:18:45.060612+0000","last_active":"2024-06-10T00:18:46.052996+0000","last_peered":"2024-06-10T00:18:46.052996+0000","last_clean":"2024-06-10T00:18:46.052996+0000","last_became_active":"2024-06-10T00:18:45.059439+0000","last_became_peered":"2024-06-10T00:18:45.059439+0000","last_unstale":"2024-06-10T00:18:46.052996+0000","last_undegraded":"2024-06-10T00:18:46.052996+0000","last_fullsized":"2024-06-10T00:18:46.052996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:02:44.813985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077594+0000","last_change":"2024-06-10T00:18:45.071342+0000","last_active":"2024-06-10T00:18:45.077594+0000","last_peered":"2024-06-10T00:18:45.077594+0000","last_clean":"2024-06-10T00:18:45.077594+0000","last_became_active":"2024-06-10T00:18:45.070573+0000","last_became_peered":"2024-06-10T00:18:45.070573+0000","last_unstale":"2024-06-10T00:18:45.077594+0000","last_undegraded":"2024-06-10T00:18:45.077594+0000","last_fullsized":"2024-06-10T00:18:45.077594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:22.812781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078634+0000","last_change":"2024-06-10T00:18:45.074738+0000","last_active":"2024-06-10T00:18:45.078634+0000","last_peered":"2024-06-10T00:18:45.078634+0000","last_clean":"2024-06-10T00:18:45.078634+0000","last_became_active":"2024-06-10T00:18:45.074479+0000","last_became_peered":"2024-06-10T00:18:45.074479+0000","last_unstale":"2024-06-10T00:18:45.078634+0000","last_undegraded":"2024-06-10T00:18:45.078634+0000","last_fullsized":"2024-06-10T00:18:45.078634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:55:47.470531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080518+0000","last_change":"2024-06-10T00:18:45.073517+0000","last_active":"2024-06-10T00:18:45.080518+0000","last_peered":"2024-06-10T00:18:45.080518+0000","last_clean":"2024-06-10T00:18:45.080518+0000","last_became_active":"2024-06-10T00:18:45.073249+0000","last_became_peered":"2024-06-10T00:18:45.073249+0000","last_unstale":"2024-06-10T00:18:45.080518+0000","last_undegraded":"2024-06-10T00:18:45.080518+0000","last_fullsized":"2024-06-10T00:18:45.080518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:05:58.128592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054713+0000","last_change":"2024-06-10T00:18:45.066629+0000","last_active":"2024-06-10T00:18:46.054713+0000","last_peered":"2024-06-10T00:18:46.054713+0000","last_clean":"2024-06-10T00:18:46.054713+0000","last_became_active":"2024-06-10T00:18:45.066102+0000","last_became_peered":"2024-06-10T00:18:45.066102+0000","last_unstale":"2024-06-10T00:18:46.054713+0000","last_undegraded":"2024-06-10T00:18:46.054713+0000","last_fullsized":"2024-06-10T00:18:46.054713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:10.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072250+0000","last_change":"2024-06-10T00:18:45.066183+0000","last_active":"2024-06-10T00:18:45.072250+0000","last_peered":"2024-06-10T00:18:45.072250+0000","last_clean":"2024-06-10T00:18:45.072250+0000","last_became_active":"2024-06-10T00:18:45.065561+0000","last_became_peered":"2024-06-10T00:18:45.065561+0000","last_unstale":"2024-06-10T00:18:45.072250+0000","last_undegraded":"2024-06-10T00:18:45.072250+0000","last_fullsized":"2024-06-10T00:18:45.072250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:27:52.279087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.069201+0000","last_change":"2024-06-10T00:18:45.067885+0000","last_active":"2024-06-10T00:18:45.069201+0000","last_peered":"2024-06-10T00:18:45.069201+0000","last_clean":"2024-06-10T00:18:45.069201+0000","last_became_active":"2024-06-10T00:18:45.067529+0000","last_became_peered":"2024-06-10T00:18:45.067529+0000","last_unstale":"2024-06-10T00:18:45.069201+0000","last_undegraded":"2024-06-10T00:18:45.069201+0000","last_fullsized":"2024-06-10T00:18:45.069201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:05:33.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054456+0000","last_change":"2024-06-10T00:18:45.071438+0000","last_active":"2024-06-10T00:18:46.054456+0000","last_peered":"2024-06-10T00:18:46.054456+0000","last_clean":"2024-06-10T00:18:46.054456+0000","last_became_active":"2024-06-10T00:18:45.071148+0000","last_became_peered":"2024-06-10T00:18:45.071148+0000","last_unstale":"2024-06-10T00:18:46.054456+0000","last_undegraded":"2024-06-10T00:18:46.054456+0000","last_fullsized":"2024-06-10T00:18:46.054456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:56:51.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.072167+0000","last_change":"2024-06-10T00:18:45.066685+0000","last_active":"2024-06-10T00:18:45.072167+0000","last_peered":"2024-06-10T00:18:45.072167+0000","last_clean":"2024-06-10T00:18:45.072167+0000","last_became_active":"2024-06-10T00:18:45.066140+0000","last_became_peered":"2024-06-10T00:18:45.066140+0000","last_unstale":"2024-06-10T00:18:45.072167+0000","last_undegraded":"2024-06-10T00:18:45.072167+0000","last_fullsized":"2024-06-10T00:18:45.072167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:58:45.808307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054303+0000","last_change":"2024-06-10T00:18:45.068618+0000","last_active":"2024-06-10T00:18:46.054303+0000","last_peered":"2024-06-10T00:18:46.054303+0000","last_clean":"2024-06-10T00:18:46.054303+0000","last_became_active":"2024-06-10T00:18:45.068142+0000","last_became_peered":"2024-06-10T00:18:45.068142+0000","last_unstale":"2024-06-10T00:18:46.054303+0000","last_undegraded":"2024-06-10T00:18:46.054303+0000","last_fullsized":"2024-06-10T00:18:46.054303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:47:30.692310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.063567+0000","last_change":"2024-06-10T00:18:45.060396+0000","last_active":"2024-06-10T00:18:45.063567+0000","last_peered":"2024-06-10T00:18:45.063567+0000","last_clean":"2024-06-10T00:18:45.063567+0000","last_became_active":"2024-06-10T00:18:45.060133+0000","last_became_peered":"2024-06-10T00:18:45.060133+0000","last_unstale":"2024-06-10T00:18:45.063567+0000","last_undegraded":"2024-06-10T00:18:45.063567+0000","last_fullsized":"2024-06-10T00:18:45.063567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:21.859451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.085229+0000","last_change":"2024-06-10T00:18:44.054473+0000","last_active":"2024-06-10T00:18:45.085229+0000","last_peered":"2024-06-10T00:18:45.085229+0000","last_clean":"2024-06-10T00:18:45.085229+0000","last_became_active":"2024-06-10T00:18:44.054227+0000","last_became_peered":"2024-06-10T00:18:44.054227+0000","last_unstale":"2024-06-10T00:18:45.085229+0000","last_undegraded":"2024-06-10T00:18:45.085229+0000","last_fullsized":"2024-06-10T00:18:45.085229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:53:14.990420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.071986+0000","last_change":"2024-06-10T00:18:45.068778+0000","last_active":"2024-06-10T00:18:45.071986+0000","last_peered":"2024-06-10T00:18:45.071986+0000","last_clean":"2024-06-10T00:18:45.071986+0000","last_became_active":"2024-06-10T00:18:45.068527+0000","last_became_peered":"2024-06-10T00:18:45.068527+0000","last_unstale":"2024-06-10T00:18:45.071986+0000","last_undegraded":"2024-06-10T00:18:45.071986+0000","last_fullsized":"2024-06-10T00:18:45.071986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:03:33.015513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054560+0000","last_change":"2024-06-10T00:18:44.057504+0000","last_active":"2024-06-10T00:18:46.054560+0000","last_peered":"2024-06-10T00:18:46.054560+0000","last_clean":"2024-06-10T00:18:46.054560+0000","last_became_active":"2024-06-10T00:18:44.057215+0000","last_became_peered":"2024-06-10T00:18:44.057215+0000","last_unstale":"2024-06-10T00:18:46.054560+0000","last_undegraded":"2024-06-10T00:18:46.054560+0000","last_fullsized":"2024-06-10T00:18:46.054560+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:39.320207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053067+0000","last_change":"2024-06-10T00:18:45.064172+0000","last_active":"2024-06-10T00:18:46.053067+0000","last_peered":"2024-06-10T00:18:46.053067+0000","last_clean":"2024-06-10T00:18:46.053067+0000","last_became_active":"2024-06-10T00:18:45.063795+0000","last_became_peered":"2024-06-10T00:18:45.063795+0000","last_unstale":"2024-06-10T00:18:46.053067+0000","last_undegraded":"2024-06-10T00:18:46.053067+0000","last_fullsized":"2024-06-10T00:18:46.053067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:30:53.378953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054554+0000","last_change":"2024-06-10T00:18:44.056925+0000","last_active":"2024-06-10T00:18:46.054554+0000","last_peered":"2024-06-10T00:18:46.054554+0000","last_clean":"2024-06-10T00:18:46.054554+0000","last_became_active":"2024-06-10T00:18:44.056630+0000","last_became_peered":"2024-06-10T00:18:44.056630+0000","last_unstale":"2024-06-10T00:18:46.054554+0000","last_undegraded":"2024-06-10T00:18:46.054554+0000","last_fullsized":"2024-06-10T00:18:46.054554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:23:29.016345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053134+0000","last_change":"2024-06-10T00:18:45.063612+0000","last_active":"2024-06-10T00:18:46.053134+0000","last_peered":"2024-06-10T00:18:46.053134+0000","last_clean":"2024-06-10T00:18:46.053134+0000","last_became_active":"2024-06-10T00:18:45.063243+0000","last_became_peered":"2024-06-10T00:18:45.063243+0000","last_unstale":"2024-06-10T00:18:46.053134+0000","last_undegraded":"2024-06-10T00:18:46.053134+0000","last_fullsized":"2024-06-10T00:18:46.053134+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:13.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.083806+0000","last_change":"2024-06-10T00:18:44.054734+0000","last_active":"2024-06-10T00:18:45.083806+0000","last_peered":"2024-06-10T00:18:45.083806+0000","last_clean":"2024-06-10T00:18:45.083806+0000","last_became_active":"2024-06-10T00:18:44.054306+0000","last_became_peered":"2024-06-10T00:18:44.054306+0000","last_unstale":"2024-06-10T00:18:45.083806+0000","last_undegraded":"2024-06-10T00:18:45.083806+0000","last_fullsized":"2024-06-10T00:18:45.083806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:15.393450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.079214+0000","last_change":"2024-06-10T00:18:45.076911+0000","last_active":"2024-06-10T00:18:45.079214+0000","last_peered":"2024-06-10T00:18:45.079214+0000","last_clean":"2024-06-10T00:18:45.079214+0000","last_became_active":"2024-06-10T00:18:45.076622+0000","last_became_peered":"2024-06-10T00:18:45.076622+0000","last_unstale":"2024-06-10T00:18:45.079214+0000","last_undegraded":"2024-06-10T00:18:45.079214+0000","last_fullsized":"2024-06-10T00:18:45.079214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:51:20.387141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053308+0000","last_change":"2024-06-10T00:18:44.049344+0000","last_active":"2024-06-10T00:18:46.053308+0000","last_peered":"2024-06-10T00:18:46.053308+0000","last_clean":"2024-06-10T00:18:46.053308+0000","last_became_active":"2024-06-10T00:18:44.049006+0000","last_became_peered":"2024-06-10T00:18:44.049006+0000","last_unstale":"2024-06-10T00:18:46.053308+0000","last_undegraded":"2024-06-10T00:18:46.053308+0000","last_fullsized":"2024-06-10T00:18:46.053308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:33:28.298940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078704+0000","last_change":"2024-06-10T00:18:45.076571+0000","last_active":"2024-06-10T00:18:45.078704+0000","last_peered":"2024-06-10T00:18:45.078704+0000","last_clean":"2024-06-10T00:18:45.078704+0000","last_became_active":"2024-06-10T00:18:45.076150+0000","last_became_peered":"2024-06-10T00:18:45.076150+0000","last_unstale":"2024-06-10T00:18:45.078704+0000","last_undegraded":"2024-06-10T00:18:45.078704+0000","last_fullsized":"2024-06-10T00:18:45.078704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:40.321778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080561+0000","last_change":"2024-06-10T00:18:44.055614+0000","last_active":"2024-06-10T00:18:45.080561+0000","last_peered":"2024-06-10T00:18:45.080561+0000","last_clean":"2024-06-10T00:18:45.080561+0000","last_became_active":"2024-06-10T00:18:44.055248+0000","last_became_peered":"2024-06-10T00:18:44.055248+0000","last_unstale":"2024-06-10T00:18:45.080561+0000","last_undegraded":"2024-06-10T00:18:45.080561+0000","last_fullsized":"2024-06-10T00:18:45.080561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:23:29.016345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053503+0000","last_change":"2024-06-10T00:18:45.064050+0000","last_active":"2024-06-10T00:18:46.053503+0000","last_peered":"2024-06-10T00:18:46.053503+0000","last_clean":"2024-06-10T00:18:46.053503+0000","last_became_active":"2024-06-10T00:18:45.063528+0000","last_became_peered":"2024-06-10T00:18:45.063528+0000","last_unstale":"2024-06-10T00:18:46.053503+0000","last_undegraded":"2024-06-10T00:18:46.053503+0000","last_fullsized":"2024-06-10T00:18:46.053503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:38:24.082103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.061168+0000","last_change":"2024-06-10T00:18:44.057400+0000","last_active":"2024-06-10T00:18:45.061168+0000","last_peered":"2024-06-10T00:18:45.061168+0000","last_clean":"2024-06-10T00:18:45.061168+0000","last_became_active":"2024-06-10T00:18:44.057128+0000","last_became_peered":"2024-06-10T00:18:44.057128+0000","last_unstale":"2024-06-10T00:18:45.061168+0000","last_undegraded":"2024-06-10T00:18:45.061168+0000","last_fullsized":"2024-06-10T00:18:45.061168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:30:53.338895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080817+0000","last_change":"2024-06-10T00:18:45.077297+0000","last_active":"2024-06-10T00:18:45.080817+0000","last_peered":"2024-06-10T00:18:45.080817+0000","last_clean":"2024-06-10T00:18:45.080817+0000","last_became_active":"2024-06-10T00:18:45.076976+0000","last_became_peered":"2024-06-10T00:18:45.076976+0000","last_unstale":"2024-06-10T00:18:45.080817+0000","last_undegraded":"2024-06-10T00:18:45.080817+0000","last_fullsized":"2024-06-10T00:18:45.080817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:38:24.082103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.055917+0000","last_change":"2024-06-10T00:18:44.046156+0000","last_active":"2024-06-10T00:18:45.055917+0000","last_peered":"2024-06-10T00:18:45.055917+0000","last_clean":"2024-06-10T00:18:45.055917+0000","last_became_active":"2024-06-10T00:18:44.045865+0000","last_became_peered":"2024-06-10T00:18:44.045865+0000","last_unstale":"2024-06-10T00:18:45.055917+0000","last_undegraded":"2024-06-10T00:18:45.055917+0000","last_fullsized":"2024-06-10T00:18:45.055917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:10.895784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077574+0000","last_change":"2024-06-10T00:18:45.070577+0000","last_active":"2024-06-10T00:18:45.077574+0000","last_peered":"2024-06-10T00:18:45.077574+0000","last_clean":"2024-06-10T00:18:45.077574+0000","last_became_active":"2024-06-10T00:18:45.070300+0000","last_became_peered":"2024-06-10T00:18:45.070300+0000","last_unstale":"2024-06-10T00:18:45.077574+0000","last_undegraded":"2024-06-10T00:18:45.077574+0000","last_fullsized":"2024-06-10T00:18:45.077574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:07.794199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054666+0000","last_change":"2024-06-10T00:18:44.054716+0000","last_active":"2024-06-10T00:18:46.054666+0000","last_peered":"2024-06-10T00:18:46.054666+0000","last_clean":"2024-06-10T00:18:46.054666+0000","last_became_active":"2024-06-10T00:18:44.054025+0000","last_became_peered":"2024-06-10T00:18:44.054025+0000","last_unstale":"2024-06-10T00:18:46.054666+0000","last_undegraded":"2024-06-10T00:18:46.054666+0000","last_fullsized":"2024-06-10T00:18:46.054666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:21.811210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.066701+0000","last_change":"2024-06-10T00:18:45.059536+0000","last_active":"2024-06-10T00:18:45.066701+0000","last_peered":"2024-06-10T00:18:45.066701+0000","last_clean":"2024-06-10T00:18:45.066701+0000","last_became_active":"2024-06-10T00:18:45.059203+0000","last_became_peered":"2024-06-10T00:18:45.059203+0000","last_unstale":"2024-06-10T00:18:45.066701+0000","last_undegraded":"2024-06-10T00:18:45.066701+0000","last_fullsized":"2024-06-10T00:18:45.066701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:23.825201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.053226+0000","last_change":"2024-06-10T00:18:44.050051+0000","last_active":"2024-06-10T00:18:45.053226+0000","last_peered":"2024-06-10T00:18:45.053226+0000","last_clean":"2024-06-10T00:18:45.053226+0000","last_became_active":"2024-06-10T00:18:44.049746+0000","last_became_peered":"2024-06-10T00:18:44.049746+0000","last_unstale":"2024-06-10T00:18:45.053226+0000","last_undegraded":"2024-06-10T00:18:45.053226+0000","last_fullsized":"2024-06-10T00:18:45.053226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:06.792628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056199+0000","last_change":"2024-06-10T00:18:45.069439+0000","last_active":"2024-06-10T00:18:46.056199+0000","last_peered":"2024-06-10T00:18:46.056199+0000","last_clean":"2024-06-10T00:18:46.056199+0000","last_became_active":"2024-06-10T00:18:45.067855+0000","last_became_peered":"2024-06-10T00:18:45.067855+0000","last_unstale":"2024-06-10T00:18:46.056199+0000","last_undegraded":"2024-06-10T00:18:46.056199+0000","last_fullsized":"2024-06-10T00:18:46.056199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:10.743187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.085492+0000","last_change":"2024-06-10T00:18:44.053155+0000","last_active":"2024-06-10T00:18:45.085492+0000","last_peered":"2024-06-10T00:18:45.085492+0000","last_clean":"2024-06-10T00:18:45.085492+0000","last_became_active":"2024-06-10T00:18:44.052907+0000","last_became_peered":"2024-06-10T00:18:44.052907+0000","last_unstale":"2024-06-10T00:18:45.085492+0000","last_undegraded":"2024-06-10T00:18:45.085492+0000","last_fullsized":"2024-06-10T00:18:45.085492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:56:52.300974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.071821+0000","last_change":"2024-06-10T00:18:45.070216+0000","last_active":"2024-06-10T00:18:45.071821+0000","last_peered":"2024-06-10T00:18:45.071821+0000","last_clean":"2024-06-10T00:18:45.071821+0000","last_became_active":"2024-06-10T00:18:45.069958+0000","last_became_peered":"2024-06-10T00:18:45.069958+0000","last_unstale":"2024-06-10T00:18:45.071821+0000","last_undegraded":"2024-06-10T00:18:45.071821+0000","last_fullsized":"2024-06-10T00:18:45.071821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:32:26.320277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.086844+0000","last_change":"2024-06-10T00:18:44.056194+0000","last_active":"2024-06-10T00:18:45.086844+0000","last_peered":"2024-06-10T00:18:45.086844+0000","last_clean":"2024-06-10T00:18:45.086844+0000","last_became_active":"2024-06-10T00:18:44.055920+0000","last_became_peered":"2024-06-10T00:18:44.055920+0000","last_unstale":"2024-06-10T00:18:45.086844+0000","last_undegraded":"2024-06-10T00:18:45.086844+0000","last_fullsized":"2024-06-10T00:18:45.086844+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:02:43.812414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.066749+0000","last_change":"2024-06-10T00:18:45.059982+0000","last_active":"2024-06-10T00:18:45.066749+0000","last_peered":"2024-06-10T00:18:45.066749+0000","last_clean":"2024-06-10T00:18:45.066749+0000","last_became_active":"2024-06-10T00:18:45.059713+0000","last_became_peered":"2024-06-10T00:18:45.059713+0000","last_unstale":"2024-06-10T00:18:45.066749+0000","last_undegraded":"2024-06-10T00:18:45.066749+0000","last_fullsized":"2024-06-10T00:18:45.066749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:57:57.725541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080691+0000","last_change":"2024-06-10T00:18:44.044336+0000","last_active":"2024-06-10T00:18:45.080691+0000","last_peered":"2024-06-10T00:18:45.080691+0000","last_clean":"2024-06-10T00:18:45.080691+0000","last_became_active":"2024-06-10T00:18:44.044047+0000","last_became_peered":"2024-06-10T00:18:44.044047+0000","last_unstale":"2024-06-10T00:18:45.080691+0000","last_undegraded":"2024-06-10T00:18:45.080691+0000","last_fullsized":"2024-06-10T00:18:45.080691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:03:32.013943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078049+0000","last_change":"2024-06-10T00:18:45.072440+0000","last_active":"2024-06-10T00:18:45.078049+0000","last_peered":"2024-06-10T00:18:45.078049+0000","last_clean":"2024-06-10T00:18:45.078049+0000","last_became_active":"2024-06-10T00:18:45.072042+0000","last_became_peered":"2024-06-10T00:18:45.072042+0000","last_unstale":"2024-06-10T00:18:45.078049+0000","last_undegraded":"2024-06-10T00:18:45.078049+0000","last_fullsized":"2024-06-10T00:18:45.078049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:18:21.859451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054212+0000","last_change":"2024-06-10T00:18:44.056988+0000","last_active":"2024-06-10T00:18:46.054212+0000","last_peered":"2024-06-10T00:18:46.054212+0000","last_clean":"2024-06-10T00:18:46.054212+0000","last_became_active":"2024-06-10T00:18:44.056640+0000","last_became_peered":"2024-06-10T00:18:44.056640+0000","last_unstale":"2024-06-10T00:18:46.054212+0000","last_undegraded":"2024-06-10T00:18:46.054212+0000","last_fullsized":"2024-06-10T00:18:46.054212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:06.792628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.075294+0000","last_change":"2024-06-10T00:18:45.070846+0000","last_active":"2024-06-10T00:18:45.075294+0000","last_peered":"2024-06-10T00:18:45.075294+0000","last_clean":"2024-06-10T00:18:45.075294+0000","last_became_active":"2024-06-10T00:18:45.070562+0000","last_became_peered":"2024-06-10T00:18:45.070562+0000","last_unstale":"2024-06-10T00:18:45.075294+0000","last_undegraded":"2024-06-10T00:18:45.075294+0000","last_fullsized":"2024-06-10T00:18:45.075294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:14:56.158246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.056351+0000","last_change":"2024-06-10T00:18:44.053248+0000","last_active":"2024-06-10T00:18:45.056351+0000","last_peered":"2024-06-10T00:18:45.056351+0000","last_clean":"2024-06-10T00:18:45.056351+0000","last_became_active":"2024-06-10T00:18:44.052920+0000","last_became_peered":"2024-06-10T00:18:44.052920+0000","last_unstale":"2024-06-10T00:18:45.056351+0000","last_undegraded":"2024-06-10T00:18:45.056351+0000","last_fullsized":"2024-06-10T00:18:45.056351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:48:20.013586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.070379+0000","last_change":"2024-06-10T00:18:45.068636+0000","last_active":"2024-06-10T00:18:45.070379+0000","last_peered":"2024-06-10T00:18:45.070379+0000","last_clean":"2024-06-10T00:18:45.070379+0000","last_became_active":"2024-06-10T00:18:45.068308+0000","last_became_peered":"2024-06-10T00:18:45.068308+0000","last_unstale":"2024-06-10T00:18:45.070379+0000","last_undegraded":"2024-06-10T00:18:45.070379+0000","last_fullsized":"2024-06-10T00:18:45.070379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:30:53.378953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.087347+0000","last_change":"2024-06-10T00:18:44.051965+0000","last_active":"2024-06-10T00:18:45.087347+0000","last_peered":"2024-06-10T00:18:45.087347+0000","last_clean":"2024-06-10T00:18:45.087347+0000","last_became_active":"2024-06-10T00:18:44.051672+0000","last_became_peered":"2024-06-10T00:18:44.051672+0000","last_unstale":"2024-06-10T00:18:45.087347+0000","last_undegraded":"2024-06-10T00:18:45.087347+0000","last_fullsized":"2024-06-10T00:18:45.087347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:36:06.748446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.055744+0000","last_change":"2024-06-10T00:18:45.073679+0000","last_active":"2024-06-10T00:18:46.055744+0000","last_peered":"2024-06-10T00:18:46.055744+0000","last_clean":"2024-06-10T00:18:46.055744+0000","last_became_active":"2024-06-10T00:18:45.073362+0000","last_became_peered":"2024-06-10T00:18:45.073362+0000","last_unstale":"2024-06-10T00:18:46.055744+0000","last_undegraded":"2024-06-10T00:18:46.055744+0000","last_fullsized":"2024-06-10T00:18:46.055744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:00:39.840115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054752+0000","last_change":"2024-06-10T00:18:44.054823+0000","last_active":"2024-06-10T00:18:46.054752+0000","last_peered":"2024-06-10T00:18:46.054752+0000","last_clean":"2024-06-10T00:18:46.054752+0000","last_became_active":"2024-06-10T00:18:44.054340+0000","last_became_peered":"2024-06-10T00:18:44.054340+0000","last_unstale":"2024-06-10T00:18:46.054752+0000","last_undegraded":"2024-06-10T00:18:46.054752+0000","last_fullsized":"2024-06-10T00:18:46.054752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:57:56.723970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080032+0000","last_change":"2024-06-10T00:18:45.072777+0000","last_active":"2024-06-10T00:18:45.080032+0000","last_peered":"2024-06-10T00:18:45.080032+0000","last_clean":"2024-06-10T00:18:45.080032+0000","last_became_active":"2024-06-10T00:18:45.072518+0000","last_became_peered":"2024-06-10T00:18:45.072518+0000","last_unstale":"2024-06-10T00:18:45.080032+0000","last_undegraded":"2024-06-10T00:18:45.080032+0000","last_fullsized":"2024-06-10T00:18:45.080032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:11:12.281468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053491+0000","last_change":"2024-06-10T00:18:44.049336+0000","last_active":"2024-06-10T00:18:46.053491+0000","last_peered":"2024-06-10T00:18:46.053491+0000","last_clean":"2024-06-10T00:18:46.053491+0000","last_became_active":"2024-06-10T00:18:44.049043+0000","last_became_peered":"2024-06-10T00:18:44.049043+0000","last_unstale":"2024-06-10T00:18:46.053491+0000","last_undegraded":"2024-06-10T00:18:46.053491+0000","last_fullsized":"2024-06-10T00:18:46.053491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:00:17.808361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.074330+0000","last_change":"2024-06-10T00:18:45.070628+0000","last_active":"2024-06-10T00:18:45.074330+0000","last_peered":"2024-06-10T00:18:45.074330+0000","last_clean":"2024-06-10T00:18:45.074330+0000","last_became_active":"2024-06-10T00:18:45.070337+0000","last_became_peered":"2024-06-10T00:18:45.070337+0000","last_unstale":"2024-06-10T00:18:45.074330+0000","last_undegraded":"2024-06-10T00:18:45.074330+0000","last_fullsized":"2024-06-10T00:18:45.074330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:02:33.681287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.086626+0000","last_change":"2024-06-10T00:18:44.052597+0000","last_active":"2024-06-10T00:18:45.086626+0000","last_peered":"2024-06-10T00:18:45.086626+0000","last_clean":"2024-06-10T00:18:45.086626+0000","last_became_active":"2024-06-10T00:18:44.052308+0000","last_became_peered":"2024-06-10T00:18:44.052308+0000","last_unstale":"2024-06-10T00:18:45.086626+0000","last_undegraded":"2024-06-10T00:18:45.086626+0000","last_fullsized":"2024-06-10T00:18:45.086626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:56:50.057761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.055969+0000","last_change":"2024-06-10T00:18:45.074026+0000","last_active":"2024-06-10T00:18:46.055969+0000","last_peered":"2024-06-10T00:18:46.055969+0000","last_clean":"2024-06-10T00:18:46.055969+0000","last_became_active":"2024-06-10T00:18:45.073536+0000","last_became_peered":"2024-06-10T00:18:45.073536+0000","last_unstale":"2024-06-10T00:18:46.055969+0000","last_undegraded":"2024-06-10T00:18:46.055969+0000","last_fullsized":"2024-06-10T00:18:46.055969+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:25:50.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.051212+0000","last_change":"2024-06-10T00:18:44.047588+0000","last_active":"2024-06-10T00:18:45.051212+0000","last_peered":"2024-06-10T00:18:45.051212+0000","last_clean":"2024-06-10T00:18:45.051212+0000","last_became_active":"2024-06-10T00:18:44.047329+0000","last_became_peered":"2024-06-10T00:18:44.047329+0000","last_unstale":"2024-06-10T00:18:45.051212+0000","last_undegraded":"2024-06-10T00:18:45.051212+0000","last_fullsized":"2024-06-10T00:18:45.051212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:12.609998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077529+0000","last_change":"2024-06-10T00:18:45.069742+0000","last_active":"2024-06-10T00:18:45.077529+0000","last_peered":"2024-06-10T00:18:45.077529+0000","last_clean":"2024-06-10T00:18:45.077529+0000","last_became_active":"2024-06-10T00:18:45.069476+0000","last_became_peered":"2024-06-10T00:18:45.069476+0000","last_unstale":"2024-06-10T00:18:45.077529+0000","last_undegraded":"2024-06-10T00:18:45.077529+0000","last_fullsized":"2024-06-10T00:18:45.077529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:38.555916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056052+0000","last_change":"2024-06-10T00:18:44.050931+0000","last_active":"2024-06-10T00:18:46.056052+0000","last_peered":"2024-06-10T00:18:46.056052+0000","last_clean":"2024-06-10T00:18:46.056052+0000","last_became_active":"2024-06-10T00:18:44.050665+0000","last_became_peered":"2024-06-10T00:18:44.050665+0000","last_unstale":"2024-06-10T00:18:46.056052+0000","last_undegraded":"2024-06-10T00:18:46.056052+0000","last_fullsized":"2024-06-10T00:18:46.056052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:57:56.723970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.078689+0000","last_change":"2024-06-10T00:18:45.072725+0000","last_active":"2024-06-10T00:18:45.078689+0000","last_peered":"2024-06-10T00:18:45.078689+0000","last_clean":"2024-06-10T00:18:45.078689+0000","last_became_active":"2024-06-10T00:18:45.072451+0000","last_became_peered":"2024-06-10T00:18:45.072451+0000","last_unstale":"2024-06-10T00:18:45.078689+0000","last_undegraded":"2024-06-10T00:18:45.078689+0000","last_fullsized":"2024-06-10T00:18:45.078689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:57:57.725541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.055847+0000","last_change":"2024-06-10T00:18:44.051359+0000","last_active":"2024-06-10T00:18:46.055847+0000","last_peered":"2024-06-10T00:18:46.055847+0000","last_clean":"2024-06-10T00:18:46.055847+0000","last_became_active":"2024-06-10T00:18:44.051102+0000","last_became_peered":"2024-06-10T00:18:44.051102+0000","last_unstale":"2024-06-10T00:18:46.055847+0000","last_undegraded":"2024-06-10T00:18:46.055847+0000","last_fullsized":"2024-06-10T00:18:46.055847+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:21.811210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.068514+0000","last_change":"2024-06-10T00:18:45.067452+0000","last_active":"2024-06-10T00:18:45.068514+0000","last_peered":"2024-06-10T00:18:45.068514+0000","last_clean":"2024-06-10T00:18:45.068514+0000","last_became_active":"2024-06-10T00:18:45.067173+0000","last_became_peered":"2024-06-10T00:18:45.067173+0000","last_unstale":"2024-06-10T00:18:45.068514+0000","last_undegraded":"2024-06-10T00:18:45.068514+0000","last_fullsized":"2024-06-10T00:18:45.068514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:30:26.073536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.055791+0000","last_change":"2024-06-10T00:18:44.052211+0000","last_active":"2024-06-10T00:18:46.055791+0000","last_peered":"2024-06-10T00:18:46.055791+0000","last_clean":"2024-06-10T00:18:46.055791+0000","last_became_active":"2024-06-10T00:18:44.051900+0000","last_became_peered":"2024-06-10T00:18:44.051900+0000","last_unstale":"2024-06-10T00:18:46.055791+0000","last_undegraded":"2024-06-10T00:18:46.055791+0000","last_fullsized":"2024-06-10T00:18:46.055791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:22.823630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053029+0000","last_change":"2024-06-10T00:18:45.066282+0000","last_active":"2024-06-10T00:18:46.053029+0000","last_peered":"2024-06-10T00:18:46.053029+0000","last_clean":"2024-06-10T00:18:46.053029+0000","last_became_active":"2024-06-10T00:18:45.065989+0000","last_became_peered":"2024-06-10T00:18:45.065989+0000","last_unstale":"2024-06-10T00:18:46.053029+0000","last_undegraded":"2024-06-10T00:18:46.053029+0000","last_fullsized":"2024-06-10T00:18:46.053029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:30:26.073536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080733+0000","last_change":"2024-06-10T00:18:44.049115+0000","last_active":"2024-06-10T00:18:45.080733+0000","last_peered":"2024-06-10T00:18:45.080733+0000","last_clean":"2024-06-10T00:18:45.080733+0000","last_became_active":"2024-06-10T00:18:44.048841+0000","last_became_peered":"2024-06-10T00:18:44.048841+0000","last_unstale":"2024-06-10T00:18:45.080733+0000","last_undegraded":"2024-06-10T00:18:45.080733+0000","last_fullsized":"2024-06-10T00:18:45.080733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:37.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.070344+0000","last_change":"2024-06-10T00:18:45.068702+0000","last_active":"2024-06-10T00:18:45.070344+0000","last_peered":"2024-06-10T00:18:45.070344+0000","last_clean":"2024-06-10T00:18:45.070344+0000","last_became_active":"2024-06-10T00:18:45.068406+0000","last_became_peered":"2024-06-10T00:18:45.068406+0000","last_unstale":"2024-06-10T00:18:45.070344+0000","last_undegraded":"2024-06-10T00:18:45.070344+0000","last_fullsized":"2024-06-10T00:18:45.070344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:13.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.064267+0000","last_change":"2024-06-10T00:18:44.057361+0000","last_active":"2024-06-10T00:18:45.064267+0000","last_peered":"2024-06-10T00:18:45.064267+0000","last_clean":"2024-06-10T00:18:45.064267+0000","last_became_active":"2024-06-10T00:18:44.057075+0000","last_became_peered":"2024-06-10T00:18:44.057075+0000","last_unstale":"2024-06-10T00:18:45.064267+0000","last_undegraded":"2024-06-10T00:18:45.064267+0000","last_fullsized":"2024-06-10T00:18:45.064267+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:27:37.022566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.053296+0000","last_change":"2024-06-10T00:18:45.064080+0000","last_active":"2024-06-10T00:18:46.053296+0000","last_peered":"2024-06-10T00:18:46.053296+0000","last_clean":"2024-06-10T00:18:46.053296+0000","last_became_active":"2024-06-10T00:18:45.063545+0000","last_became_peered":"2024-06-10T00:18:45.063545+0000","last_unstale":"2024-06-10T00:18:46.053296+0000","last_undegraded":"2024-06-10T00:18:46.053296+0000","last_fullsized":"2024-06-10T00:18:46.053296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:14:56.158246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054799+0000","last_change":"2024-06-10T00:18:44.054893+0000","last_active":"2024-06-10T00:18:46.054799+0000","last_peered":"2024-06-10T00:18:46.054799+0000","last_clean":"2024-06-10T00:18:46.054799+0000","last_became_active":"2024-06-10T00:18:44.054496+0000","last_became_peered":"2024-06-10T00:18:44.054496+0000","last_unstale":"2024-06-10T00:18:46.054799+0000","last_undegraded":"2024-06-10T00:18:46.054799+0000","last_fullsized":"2024-06-10T00:18:46.054799+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:55:46.468960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.077505+0000","last_change":"2024-06-10T00:18:45.071125+0000","last_active":"2024-06-10T00:18:45.077505+0000","last_peered":"2024-06-10T00:18:45.077505+0000","last_clean":"2024-06-10T00:18:45.077505+0000","last_became_active":"2024-06-10T00:18:45.070861+0000","last_became_peered":"2024-06-10T00:18:45.070861+0000","last_unstale":"2024-06-10T00:18:45.077505+0000","last_undegraded":"2024-06-10T00:18:45.077505+0000","last_fullsized":"2024-06-10T00:18:45.077505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:23.825201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054401+0000","last_change":"2024-06-10T00:18:44.051808+0000","last_active":"2024-06-10T00:18:46.054401+0000","last_peered":"2024-06-10T00:18:46.054401+0000","last_clean":"2024-06-10T00:18:46.054401+0000","last_became_active":"2024-06-10T00:18:44.051532+0000","last_became_peered":"2024-06-10T00:18:44.051532+0000","last_unstale":"2024-06-10T00:18:46.054401+0000","last_undegraded":"2024-06-10T00:18:46.054401+0000","last_fullsized":"2024-06-10T00:18:46.054401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:38:22.823630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.076361+0000","last_change":"2024-06-10T00:18:45.069636+0000","last_active":"2024-06-10T00:18:45.076361+0000","last_peered":"2024-06-10T00:18:45.076361+0000","last_clean":"2024-06-10T00:18:45.076361+0000","last_became_active":"2024-06-10T00:18:45.069360+0000","last_became_peered":"2024-06-10T00:18:45.069360+0000","last_unstale":"2024-06-10T00:18:45.076361+0000","last_undegraded":"2024-06-10T00:18:45.076361+0000","last_fullsized":"2024-06-10T00:18:45.076361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:27.822385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.063110+0000","last_change":"2024-06-10T00:18:44.054852+0000","last_active":"2024-06-10T00:18:45.063110+0000","last_peered":"2024-06-10T00:18:45.063110+0000","last_clean":"2024-06-10T00:18:45.063110+0000","last_became_active":"2024-06-10T00:18:44.054559+0000","last_became_peered":"2024-06-10T00:18:44.054559+0000","last_unstale":"2024-06-10T00:18:45.063110+0000","last_undegraded":"2024-06-10T00:18:45.063110+0000","last_fullsized":"2024-06-10T00:18:45.063110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:14:15.946285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.080869+0000","last_change":"2024-06-10T00:18:45.077374+0000","last_active":"2024-06-10T00:18:45.080869+0000","last_peered":"2024-06-10T00:18:45.080869+0000","last_clean":"2024-06-10T00:18:45.080869+0000","last_became_active":"2024-06-10T00:18:45.077076+0000","last_became_peered":"2024-06-10T00:18:45.077076+0000","last_unstale":"2024-06-10T00:18:45.080869+0000","last_undegraded":"2024-06-10T00:18:45.080869+0000","last_fullsized":"2024-06-10T00:18:45.080869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:58:45.808307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.056110+0000","last_change":"2024-06-10T00:18:44.055315+0000","last_active":"2024-06-10T00:18:45.056110+0000","last_peered":"2024-06-10T00:18:45.056110+0000","last_clean":"2024-06-10T00:18:45.056110+0000","last_became_active":"2024-06-10T00:18:44.055056+0000","last_became_peered":"2024-06-10T00:18:44.055056+0000","last_unstale":"2024-06-10T00:18:45.056110+0000","last_undegraded":"2024-06-10T00:18:45.056110+0000","last_fullsized":"2024-06-10T00:18:45.056110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:03:00.534882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.079176+0000","last_change":"2024-06-10T00:18:45.078522+0000","last_active":"2024-06-10T00:18:45.079176+0000","last_peered":"2024-06-10T00:18:45.079176+0000","last_clean":"2024-06-10T00:18:45.079176+0000","last_became_active":"2024-06-10T00:18:45.078255+0000","last_became_peered":"2024-06-10T00:18:45.078255+0000","last_unstale":"2024-06-10T00:18:45.079176+0000","last_undegraded":"2024-06-10T00:18:45.079176+0000","last_fullsized":"2024-06-10T00:18:45.079176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:33:42.202447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.063433+0000","last_change":"2024-06-10T00:18:44.054792+0000","last_active":"2024-06-10T00:18:45.063433+0000","last_peered":"2024-06-10T00:18:45.063433+0000","last_clean":"2024-06-10T00:18:45.063433+0000","last_became_active":"2024-06-10T00:18:44.054482+0000","last_became_peered":"2024-06-10T00:18:44.054482+0000","last_unstale":"2024-06-10T00:18:45.063433+0000","last_undegraded":"2024-06-10T00:18:45.063433+0000","last_fullsized":"2024-06-10T00:18:45.063433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:46:07.566757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.066859+0000","last_change":"2024-06-10T00:18:45.060026+0000","last_active":"2024-06-10T00:18:45.066859+0000","last_peered":"2024-06-10T00:18:45.066859+0000","last_clean":"2024-06-10T00:18:45.066859+0000","last_became_active":"2024-06-10T00:18:45.059693+0000","last_became_peered":"2024-06-10T00:18:45.059693+0000","last_unstale":"2024-06-10T00:18:45.066859+0000","last_undegraded":"2024-06-10T00:18:45.066859+0000","last_fullsized":"2024-06-10T00:18:45.066859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:14:56.158246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-06-10T00:18:45.051268+0000","last_change":"2024-06-10T00:18:44.048941+0000","last_active":"2024-06-10T00:18:45.051268+0000","last_peered":"2024-06-10T00:18:45.051268+0000","last_clean":"2024-06-10T00:18:45.051268+0000","last_became_active":"2024-06-10T00:18:44.048668+0000","last_became_peered":"2024-06-10T00:18:44.048668+0000","last_unstale":"2024-06-10T00:18:45.051268+0000","last_undegraded":"2024-06-10T00:18:45.051268+0000","last_fullsized":"2024-06-10T00:18:45.051268+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:26.820814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054718+0000","last_change":"2024-06-10T00:18:45.067551+0000","last_active":"2024-06-10T00:18:46.054718+0000","last_peered":"2024-06-10T00:18:46.054718+0000","last_clean":"2024-06-10T00:18:46.054718+0000","last_became_active":"2024-06-10T00:18:45.067254+0000","last_became_peered":"2024-06-10T00:18:45.067254+0000","last_unstale":"2024-06-10T00:18:46.054718+0000","last_undegraded":"2024-06-10T00:18:46.054718+0000","last_fullsized":"2024-06-10T00:18:46.054718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:44.031226+0000","last_clean_scrub_stamp":"2024-06-10T00:18:44.031226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:36:53.744217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.056269+0000","last_change":"2024-06-10T00:18:44.054280+0000","last_active":"2024-06-10T00:18:46.056269+0000","last_peered":"2024-06-10T00:18:46.056269+0000","last_clean":"2024-06-10T00:18:46.056269+0000","last_became_active":"2024-06-10T00:18:44.053999+0000","last_became_peered":"2024-06-10T00:18:44.053999+0000","last_unstale":"2024-06-10T00:18:46.056269+0000","last_undegraded":"2024-06-10T00:18:46.056269+0000","last_fullsized":"2024-06-10T00:18:46.056269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:18:43.029655+0000","last_clean_scrub_stamp":"2024-06-10T00:18:43.029655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:55:46.468960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-06-10T00:18:46.054332+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:18:46.054332+0000","last_peered":"2024-06-10T00:18:46.054332+0000","last_clean":"2024-06-10T00:18:46.054332+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:18:46.054332+0000","last_undegraded":"2024-06-10T00:18:46.054332+0000","last_fullsized":"2024-06-10T00:18:46.054332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1503232,"data_stored":1001093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":412315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":410737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":412419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":411285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":411445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":410815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1499136,"data_stored":1001071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:18:48.372 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:18:48.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-10T00:18:48.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.515+0000 7efcd6f42640 1 Processor -- start 2024-06-10T00:18:48.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.515+0000 7efcd6f42640 1 -- start start 2024-06-10T00:18:48.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efcd6f42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd0154d60 0x7efcd006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efcd6f42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efcd006d320 0x7efcd00b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efcd6f42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd006d950 con 0x7efcd00b3540 2024-06-10T00:18:48.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efcd6f42640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efcd006dc30 con 0x7efcd006d320 2024-06-10T00:18:48.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efcd6f42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efcd006df10 con 0x7efcd0154d60 2024-06-10T00:18:48.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efcd4cde640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd0154d60 0x7efcd006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efcd54df640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7efcd00b3540 0x7efcd015e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:51788/0 (socket says 172.21.15.79:51788) 2024-06-10T00:18:48.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efcd54df640 1 -- 172.21.15.79:0/4064585535 learned_addr learned my addr 172.21.15.79:0/4064585535 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:48.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.516+0000 7efccffff640 1 --2- 172.21.15.79:0/4064585535 >> v2:172.21.15.117:3300/0 conn(0x7efcd006d320 0x7efcd00b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.517+0000 7efcd4cde640 1 -- 172.21.15.79:0/4064585535 >> v2:172.21.15.117:3300/0 conn(0x7efcd006d320 msgr2=0x7efcd00b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:48.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.517+0000 7efcd4cde640 1 --2- 172.21.15.79:0/4064585535 >> v2:172.21.15.117:3300/0 conn(0x7efcd006d320 0x7efcd00b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.517+0000 7efcd4cde640 1 -- 172.21.15.79:0/4064585535 >> v1:172.21.15.117:6789/0 conn(0x7efcd00b3540 legacy=0x7efcd015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.517+0000 7efcd4cde640 1 -- 172.21.15.79:0/4064585535 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd006e1f0 con 0x7efcd0154d60 2024-06-10T00:18:48.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.517+0000 7efcd4cde640 1 --2- 172.21.15.79:0/4064585535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd0154d60 0x7efcd006cde0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efcc00097a0 tx=0x7efcc002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700759caa5144f31 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efccf7fe640 1 -- 172.21.15.79:0/4064585535 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0037070 con 0x7efcd0154d60 2024-06-10T00:18:48.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efccf7fe640 1 -- 172.21.15.79:0/4064585535 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc0032440 con 0x7efcd0154d60 2024-06-10T00:18:48.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efccf7fe640 1 -- 172.21.15.79:0/4064585535 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0032810 con 0x7efcd0154d60 2024-06-10T00:18:48.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efcd6f42640 1 -- 172.21.15.79:0/4064585535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd0154d60 msgr2=0x7efcd006cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efcd6f42640 1 --2- 172.21.15.79:0/4064585535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd0154d60 0x7efcd006cde0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efcc00097a0 tx=0x7efcc002a210 comp rx=0 tx=0).stop 2024-06-10T00:18:48.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efcd6f42640 1 -- 172.21.15.79:0/4064585535 shutdown_connections 2024-06-10T00:18:48.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efcd6f42640 1 --2- 172.21.15.79:0/4064585535 >> v2:172.21.15.117:3300/0 conn(0x7efcd006d320 0x7efcd00b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efcd6f42640 1 --2- 172.21.15.79:0/4064585535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd0154d60 0x7efcd006cde0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efcd6f42640 1 -- 172.21.15.79:0/4064585535 >> 172.21.15.79:0/4064585535 conn(0x7efcd006b7e0 msgr2=0x7efcd006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:48.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efcd6f42640 1 -- 172.21.15.79:0/4064585535 shutdown_connections 2024-06-10T00:18:48.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.518+0000 7efcd6f42640 1 -- 172.21.15.79:0/4064585535 wait complete. 2024-06-10T00:18:48.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.519+0000 7efcd6f42640 1 Processor -- start 2024-06-10T00:18:48.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.519+0000 7efcd6f42640 1 -- start start 2024-06-10T00:18:48.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd6f42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd006d320 0x7efcd0140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd6f42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd00b3540 0x7efcd009bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd6f42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd0154d60 0x7efcd0141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd6f42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efcd00b3950 con 0x7efcd006d320 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd6f42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efcd006d700 con 0x7efcd0154d60 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd6f42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efcd015cd80 con 0x7efcd00b3540 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd4cde640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd006d320 0x7efcd0140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd4cde640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd006d320 0x7efcd0140760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34644/0 (socket says 172.21.15.79:34644) 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.520+0000 7efcd4cde640 1 -- 172.21.15.79:0/234316527 learned_addr learned my addr 172.21.15.79:0/234316527 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd54df640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd0154d60 0x7efcd0141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efccffff640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd00b3540 0x7efcd009bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd4cde640 1 -- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd00b3540 msgr2=0x7efcd009bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd4cde640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd00b3540 0x7efcd009bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd4cde640 1 -- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd0154d60 msgr2=0x7efcd0141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd4cde640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd0154d60 0x7efcd0141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd4cde640 1 -- 172.21.15.79:0/234316527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd009b0e0 con 0x7efcd006d320 2024-06-10T00:18:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efccffff640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd00b3540 0x7efcd009bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd4cde640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd006d320 0x7efcd0140760 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efcc0000c00 tx=0x7efcc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efccd7fa640 1 -- 172.21.15.79:0/234316527 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0041070 con 0x7efcd006d320 2024-06-10T00:18:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efccd7fa640 1 -- 172.21.15.79:0/234316527 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc003c870 con 0x7efcd006d320 2024-06-10T00:18:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd009b3c0 con 0x7efcd006d320 2024-06-10T00:18:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efccd7fa640 1 -- 172.21.15.79:0/234316527 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0037040 con 0x7efcd006d320 2024-06-10T00:18:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.521+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd009b980 con 0x7efcd006d320 2024-06-10T00:18:48.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.522+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd00683c0 con 0x7efcd006d320 2024-06-10T00:18:48.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.523+0000 7efccd7fa640 1 -- 172.21.15.79:0/234316527 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcc0044070 con 0x7efcd006d320 2024-06-10T00:18:48.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.523+0000 7efccd7fa640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efcbc06be30 0x7efcbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.523+0000 7efccffff640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efcbc06be30 0x7efcbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.523+0000 7efccd7fa640 1 -- 172.21.15.79:0/234316527 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7efcc00abb30 con 0x7efcd006d320 2024-06-10T00:18:48.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.524+0000 7efccffff640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efcbc06be30 0x7efcbc06e2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efcd00cf210 tx=0x7efcc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.528+0000 7efccd7fa640 1 -- 172.21.15.79:0/234316527 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efcc0079e20 con 0x7efcd006d320 2024-06-10T00:18:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.765+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efcd0142d80 con 0x7efcd006d320 2024-06-10T00:18:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.767+0000 7efccd7fa640 1 -- 172.21.15.79:0/234316527 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7efcc007e120 con 0x7efcd006d320 2024-06-10T00:18:48.767 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-06-10T00:18:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:18:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-06-10T00:18:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-06-10T00:18:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-10T00:18:48.767 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efcbc06be30 msgr2=0x7efcbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efcbc06be30 0x7efcbc06e2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efcd00cf210 tx=0x7efcc4008040 comp rx=0 tx=0).stop 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd006d320 msgr2=0x7efcd0140760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd006d320 0x7efcd0140760 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efcc0000c00 tx=0x7efcc00046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 shutdown_connections 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efcbc06be30 0x7efcbc06e2f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd0154d60 0x7efcd0141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd00b3540 0x7efcd009bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 --2- 172.21.15.79:0/234316527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd006d320 0x7efcd0140760 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 >> 172.21.15.79:0/234316527 conn(0x7efcd006b7e0 msgr2=0x7efcd014c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 shutdown_connections 2024-06-10T00:18:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.769+0000 7efcd6f42640 1 -- 172.21.15.79:0/234316527 wait complete. 2024-06-10T00:18:48.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.880+0000 7f9cbe8e1640 1 Processor -- start 2024-06-10T00:18:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.880+0000 7f9cbe8e1640 1 -- start start 2024-06-10T00:18:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbe8e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9cb81553c0 0x7f9cb80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbe8e1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9cb80cec50 0x7f9cb80cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbe8e1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb80b31a0 con 0x7f9cb80b2cf0 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbe8e1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb80b3420 con 0x7f9cb80cec50 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbe8e1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb80cc750 con 0x7f9cb81553c0 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbce7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9cb80cec50 0x7f9cb80cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cb77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9cb80b2cf0 0x7f9cb815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35964/0 (socket says 172.21.15.79:35964) 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cb77fe640 1 -- 172.21.15.79:0/968461836 learned_addr learned my addr 172.21.15.79:0/968461836 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbce7e640 1 -- 172.21.15.79:0/968461836 >> v2:172.21.15.117:3300/0 conn(0x7f9cb81553c0 msgr2=0x7f9cb80cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cb7fff640 1 --2- 172.21.15.79:0/968461836 >> v2:172.21.15.117:3300/0 conn(0x7f9cb81553c0 0x7f9cb80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbce7e640 1 --2- 172.21.15.79:0/968461836 >> v2:172.21.15.117:3300/0 conn(0x7f9cb81553c0 0x7f9cb80cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbce7e640 1 -- 172.21.15.79:0/968461836 >> v1:172.21.15.79:6789/0 conn(0x7f9cb80b2cf0 legacy=0x7f9cb815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cbce7e640 1 -- 172.21.15.79:0/968461836 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb80cca30 con 0x7f9cb80cec50 2024-06-10T00:18:48.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cb6ffd640 1 -- 172.21.15.79:0/968461836 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413949334 0 0) 0x7f9cac001110 con 0x7f9cb80b2cf0 2024-06-10T00:18:48.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.881+0000 7f9cb7fff640 1 --2- 172.21.15.79:0/968461836 >> v2:172.21.15.117:3300/0 conn(0x7f9cb81553c0 0x7f9cb80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:48.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.882+0000 7f9cbce7e640 1 --2- 172.21.15.79:0/968461836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80cec50 0x7f9cb80cf0e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009d90 tx=0x7f9cb002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7278fccb0084152 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.882+0000 7f9cb6ffd640 1 -- 172.21.15.79:0/968461836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0007740 con 0x7f9cb80cec50 2024-06-10T00:18:48.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.882+0000 7f9cb6ffd640 1 -- 172.21.15.79:0/968461836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb00078e0 con 0x7f9cb80cec50 2024-06-10T00:18:48.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.882+0000 7f9cb6ffd640 1 -- 172.21.15.79:0/968461836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0007cb0 con 0x7f9cb80cec50 2024-06-10T00:18:48.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.883+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/968461836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80cec50 msgr2=0x7f9cb80cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.883+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/968461836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80cec50 0x7f9cb80cf0e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009d90 tx=0x7f9cb002a6a0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.883+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/968461836 shutdown_connections 2024-06-10T00:18:48.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.883+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/968461836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb80cec50 0x7f9cb80cf0e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.883+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/968461836 >> v2:172.21.15.117:3300/0 conn(0x7f9cb81553c0 0x7f9cb80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.883+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/968461836 >> 172.21.15.79:0/968461836 conn(0x7f9cb80b19f0 msgr2=0x7f9cb80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.883+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/968461836 shutdown_connections 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.883+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/968461836 wait complete. 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.884+0000 7f9cbe8e1640 1 Processor -- start 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.884+0000 7f9cbe8e1640 1 -- start start 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbe8e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80b2cf0 0x7f9cb8150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbe8e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb80cec50 0x7f9cb813fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbe8e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb81553c0 0x7f9cb815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbe8e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb81557a0 con 0x7f9cb81553c0 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbe8e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb80b3700 con 0x7f9cb80cec50 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbe8e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb8155920 con 0x7f9cb80b2cf0 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb81553c0 0x7f9cb815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb81553c0 0x7f9cb815cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34664/0 (socket says 172.21.15.79:34664) 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 -- 172.21.15.79:0/1769366604 learned_addr learned my addr 172.21.15.79:0/1769366604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 -- 172.21.15.79:0/1769366604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80b2cf0 msgr2=0x7f9cb8150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80b2cf0 0x7f9cb8150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 -- 172.21.15.79:0/1769366604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb80cec50 msgr2=0x7f9cb813fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb80cec50 0x7f9cb813fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 -- 172.21.15.79:0/1769366604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb809d900 con 0x7f9cb81553c0 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbce7e640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb81553c0 0x7f9cb815cd40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9cb002ac90 tx=0x7f9cb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cb4ff9640 1 -- 172.21.15.79:0/1769366604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0040070 con 0x7f9cb81553c0 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cb4ff9640 1 -- 172.21.15.79:0/1769366604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb0031c90 con 0x7f9cb81553c0 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb809d340 con 0x7f9cb81553c0 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cb4ff9640 1 -- 172.21.15.79:0/1769366604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0045680 con 0x7f9cb81553c0 2024-06-10T00:18:48.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.885+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb815c260 con 0x7f9cb81553c0 2024-06-10T00:18:48.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.886+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb8068430 con 0x7f9cb81553c0 2024-06-10T00:18:48.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.887+0000 7f9cb4ff9640 1 -- 172.21.15.79:0/1769366604 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cb0039040 con 0x7f9cb81553c0 2024-06-10T00:18:48.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.887+0000 7f9cb4ff9640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ca406be60 0x7f9ca406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:48.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.887+0000 7f9cb4ff9640 1 -- 172.21.15.79:0/1769366604 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f9cb00aca30 con 0x7f9cb81553c0 2024-06-10T00:18:48.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.887+0000 7f9cb7fff640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ca406be60 0x7f9ca406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:48.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.888+0000 7f9cb7fff640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ca406be60 0x7f9ca406e320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8006fd0 tx=0x7f9ca8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:48.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:48.892+0000 7f9cb4ff9640 1 -- 172.21.15.79:0/1769366604 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9cb0043360 con 0x7f9cb81553c0 2024-06-10T00:18:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.104+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cb815ca20 con 0x7f9cb81553c0 2024-06-10T00:18:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.105+0000 7f9cb4ff9640 1 -- 172.21.15.79:0/1769366604 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5183 (secure 0 0 0) 0x7f9cb815ca20 con 0x7f9cb81553c0 2024-06-10T00:18:49.105 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:49.105 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:18:46.409798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1640828017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1640828017},{"type":"v1","addr":"172.21.15.79:6835","nonce":1640828017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":5}]} 2024-06-10T00:18:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 37 2024-06-10T00:18:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ca406be60 msgr2=0x7f9ca406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ca406be60 0x7f9ca406e320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8006fd0 tx=0x7f9ca8008040 comp rx=0 tx=0).stop 2024-06-10T00:18:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb81553c0 msgr2=0x7f9cb815cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb81553c0 0x7f9cb815cd40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9cb002ac90 tx=0x7f9cb0004a40 comp rx=0 tx=0).stop 2024-06-10T00:18:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 shutdown_connections 2024-06-10T00:18:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9ca406be60 0x7f9ca406e320 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb81553c0 0x7f9cb815cd40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb80cec50 0x7f9cb813fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 --2- 172.21.15.79:0/1769366604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb80b2cf0 0x7f9cb8150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 >> 172.21.15.79:0/1769366604 conn(0x7f9cb80b19f0 msgr2=0x7f9cb80cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 shutdown_connections 2024-06-10T00:18:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.107+0000 7f9cbe8e1640 1 -- 172.21.15.79:0/1769366604 wait complete. 2024-06-10T00:18:49.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:18:44.456453+0000', 'modified': '2024-06-10T00:18:46.409798+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6288': {'gid': 6288, 'name': 'c', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/1640828017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 1640828017}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 1640828017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6288, 'qdb_cluster': [6288]} 2024-06-10T00:18:49.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:18:49.521 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-10T00:18:49.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.621+0000 7f0cecf21640 1 Processor -- start 2024-06-10T00:18:49.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.621+0000 7f0cecf21640 1 -- start start 2024-06-10T00:18:49.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0cecf21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 0x7f0ce8166c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0cecf21640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce8072820 con 0x7f0ce80cc6d0 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0cecf21640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce8072b00 con 0x7f0ce80b46d0 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0cecf21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce8072de0 con 0x7f0ce8072370 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0ce659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0ce80cc6d0 0x7f0ce80ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35980/0 (socket says 172.21.15.79:35980) 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0ce659c640 1 -- 172.21.15.79:0/3137860850 learned_addr learned my addr 172.21.15.79:0/3137860850 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0ce6d9d640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 0x7f0ce8166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346230655 0 0) 0x7f0ce8072820 con 0x7f0ce80cc6d0 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.622+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cd0003520 con 0x7f0ce80cc6d0 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3084458678 0 0) 0x7f0cd0003520 con 0x7f0ce80cc6d0 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 msgr2=0x7f0ce8166c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 0x7f0ce8166c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 >> v1:172.21.15.117:6789/0 conn(0x7f0ce80b46d0 legacy=0x7f0ce8071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce80b31a0 con 0x7f0ce80cc6d0 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f0cd8001670 con 0x7f0ce80cc6d0 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 >> v1:172.21.15.79:6789/0 conn(0x7f0ce80cc6d0 legacy=0x7f0ce80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd00039e0 0x7f0cd0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cd0004390 0x7f0cd0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 0x7f0cd00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8072de0 con 0x7f0cd0004390 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd000b9c0 con 0x7f0cd00039e0 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd000bbc0 con 0x7f0ce8072370 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cd0004390 0x7f0cd0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce659c640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd00039e0 0x7f0cd0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce6d9d640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 0x7f0cd00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 msgr2=0x7f0cd00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 0x7f0cd00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd00039e0 msgr2=0x7f0cd0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd00039e0 0x7f0cd0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/3137860850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd0003520 con 0x7f0cd0004390 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.623+0000 7f0ce6d9d640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce8072370 0x7f0cd00050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.624+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cd0004390 0x7f0cd0004860 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0018e0 tx=0x7f0cd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bf8546c2924cfb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.624+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc037070 con 0x7f0cd0004390 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.624+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cdc02ac10 con 0x7f0cd0004390 2024-06-10T00:18:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.624+0000 7f0ce559a640 1 -- 172.21.15.79:0/3137860850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0014e0 con 0x7f0cd0004390 2024-06-10T00:18:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.625+0000 7f0cecf21640 1 -- 172.21.15.79:0/3137860850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cd0004390 msgr2=0x7f0cd0004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.625+0000 7f0cecf21640 1 --2- 172.21.15.79:0/3137860850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cd0004390 0x7f0cd0004860 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0018e0 tx=0x7f0cd0005830 comp rx=0 tx=0).stop 2024-06-10T00:18:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.625+0000 7f0ce6d9d640 1 -- 172.21.15.79:0/3137860850 reap_dead start 2024-06-10T00:18:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.625+0000 7f0cecf21640 1 -- 172.21.15.79:0/3137860850 shutdown_connections 2024-06-10T00:18:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.625+0000 7f0cecf21640 1 -- 172.21.15.79:0/3137860850 >> 172.21.15.79:0/3137860850 conn(0x7f0ce80b19f0 msgr2=0x7f0ce80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.625+0000 7f0cecf21640 1 -- 172.21.15.79:0/3137860850 shutdown_connections 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.625+0000 7f0cecf21640 1 -- 172.21.15.79:0/3137860850 wait complete. 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.626+0000 7f0cecf21640 1 Processor -- start 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.626+0000 7f0cecf21640 1 -- start start 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cecf21640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd0004390 0x7f0ce8157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cecf21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce814bbc0 0x7f0ce814b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cecf21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce81550b0 0x7f0ce8155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cecf21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8164c30 con 0x7f0ce814bbc0 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cecf21640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8159f60 con 0x7f0cd0004390 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cecf21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce8164db0 con 0x7f0ce81550b0 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce814bbc0 0x7f0ce814b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce814bbc0 0x7f0ce814b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34688/0 (socket says 172.21.15.79:34688) 2024-06-10T00:18:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/1539835921 learned_addr learned my addr 172.21.15.79:0/1539835921 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce659c640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd0004390 0x7f0ce8157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/1539835921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce81550b0 msgr2=0x7f0ce8155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce81550b0 0x7f0ce8155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/1539835921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd0004390 msgr2=0x7f0ce8157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd0004390 0x7f0ce8157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/1539835921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce8153a70 con 0x7f0ce814bbc0 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce814bbc0 0x7f0ce814b350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc02a700 tx=0x7f0cdc0012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cd6ffd640 1 -- 172.21.15.79:0/1539835921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc037040 con 0x7f0ce814bbc0 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cd6ffd640 1 -- 172.21.15.79:0/1539835921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cdc0052e0 con 0x7f0ce814bbc0 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cecf21640 1 -- 172.21.15.79:0/1539835921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce8153ce0 con 0x7f0ce814bbc0 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cd6ffd640 1 -- 172.21.15.79:0/1539835921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc007240 con 0x7f0ce814bbc0 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.627+0000 7f0cecf21640 1 -- 172.21.15.79:0/1539835921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce81542a0 con 0x7f0ce814bbc0 2024-06-10T00:18:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.629+0000 7f0cd6ffd640 1 -- 172.21.15.79:0/1539835921 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0cdc03a070 con 0x7f0ce814bbc0 2024-06-10T00:18:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.629+0000 7f0cd6ffd640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0cc806be30 0x7f0cc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.629+0000 7f0cd6ffd640 1 -- 172.21.15.79:0/1539835921 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f0cdc0aaed0 con 0x7f0ce814bbc0 2024-06-10T00:18:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.629+0000 7f0ce659c640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0cc806be30 0x7f0cc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.630+0000 7f0ce659c640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0cc806be30 0x7f0cc806e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8001770 tx=0x7f0cd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.630+0000 7f0cefc2a740 1 Processor -- start 2024-06-10T00:18:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0cefc2a740 1 -- start start 2024-06-10T00:18:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab43dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab40d960 0x55b5ab413990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab459ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b5ab376740 con 0x55b5ab43d700 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b5ab314a80 con 0x55b5ab40d960 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b5ab372700 con 0x55b5ab459660 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0ce659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab43dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0ce659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab43dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34690/0 (socket says 172.21.15.79:34690) 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.631+0000 7f0ce659c640 1 -- 172.21.15.79:0/1529347993 learned_addr learned my addr 172.21.15.79:0/1529347993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0ce659c640 1 -- 172.21.15.79:0/1529347993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 msgr2=0x55b5ab459ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0ce659c640 1 --2- 172.21.15.79:0/1529347993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab459ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/1529347993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab40d960 0x55b5ab413990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0ce659c640 1 -- 172.21.15.79:0/1529347993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab40d960 msgr2=0x55b5ab413990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0ce659c640 1 --2- 172.21.15.79:0/1529347993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab40d960 0x55b5ab413990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0ce659c640 1 -- 172.21.15.79:0/1529347993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ab33ffb0 con 0x55b5ab43d700 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0ce659c640 1 --2- 172.21.15.79:0/1529347993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab43dae0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80071f0 tx=0x7f0cd8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7821e62712943fbe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0cc7fff640 1 -- 172.21.15.79:0/1529347993 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8027070 con 0x55b5ab43d700 2024-06-10T00:18:49.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0cc7fff640 1 -- 172.21.15.79:0/1529347993 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd8014900 con 0x55b5ab43d700 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.632+0000 7f0cc7fff640 1 -- 172.21.15.79:0/1529347993 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8014cb0 con 0x55b5ab43d700 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 -- 172.21.15.79:0/1529347993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 msgr2=0x55b5ab43dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/1529347993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab43dae0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80071f0 tx=0x7f0cd8013000 comp rx=0 tx=0).stop 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 -- 172.21.15.79:0/1529347993 shutdown_connections 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/1529347993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab459ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/1529347993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab40d960 0x55b5ab413990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/1529347993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab43dae0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 -- 172.21.15.79:0/1529347993 >> 172.21.15.79:0/1529347993 conn(0x55b5ab40fbd0 msgr2=0x55b5ab458510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 -- 172.21.15.79:0/1529347993 shutdown_connections 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 -- 172.21.15.79:0/1529347993 wait complete. 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 -- start start 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.633+0000 7f0cefc2a740 1 Processor -- start 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab437e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab45dbc0 0x55b5ab458d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b5ab413ed0 con 0x55b5ab43d700 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b5ab2ffc30 con 0x55b5ab45dbc0 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b5ab413500 con 0x55b5ab459660 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0cefc2a740 10 client.0 _ll_register_callbacks cb 0x55b5ab3317f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0ce659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab437e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0ce659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab437e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34704/0 (socket says 172.21.15.79:34704) 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0ce659c640 1 -- 172.21.15.79:0/999568787 learned_addr learned my addr 172.21.15.79:0/999568787 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.634+0000 7f0ce6d9d640 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab45dbc0 0x55b5ab458d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0ce659c640 1 -- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 msgr2=0x55b5ab4587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0ce659c640 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0ce659c640 1 -- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab45dbc0 msgr2=0x55b5ab458d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0ce659c640 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab45dbc0 0x55b5ab458d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0ce659c640 1 -- 172.21.15.79:0/999568787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ab08a2d0 con 0x55b5ab43d700 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0ce659c640 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab437e30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009010 tx=0x7f0cd80019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c200af486f09a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cc57fa640 1 -- 172.21.15.79:0/999568787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8027070 con 0x55b5ab43d700 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cc57fa640 1 -- 172.21.15.79:0/999568787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f0cd8022a00 con 0x55b5ab43d700 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 1 -- 172.21.15.79:0/999568787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd8014900 con 0x55b5ab43d700 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cc57fa640 1 -- 172.21.15.79:0/999568787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0cd8036050 con 0x55b5ab43d700 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 10 client.6414 fetch_fsmap learned FSMap version 37 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 1 -- 172.21.15.79:0/999568787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x55b5ab1546b0 con 0x55b5ab43d700 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cc57fa640 1 -- 172.21.15.79:0/999568787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd8014900 con 0x55b5ab43d700 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cc57fa640 1 -- 172.21.15.79:0/999568787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7f0cd8039020 con 0x55b5ab43d700 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 10 client.6414 fetch_fsmap finished waiting for FSMap version 37 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 10 client.6414 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-10T00:18:49.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 20 client.6414 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] conn(0x55b5ab43e510 0x55b5ab441250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 4 client.6414 mds_command: new command op to 6288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.635+0000 7f0cefc2a740 1 -- 172.21.15.79:0/999568787 --> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5ab383e70 con 0x55b5ab43e510 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.636+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] conn(0x55b5ab43e510 0x55b5ab441250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.636+0000 7f0cc57fa640 10 client.6414 ms_handle_connect on v2:172.21.15.79:6834/1640828017 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.636+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] conn(0x55b5ab43e510 0x55b5ab441250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de4b21c6b4040d08 server_cookie=770e6a3eca8ab594 in_seq=0 out_seq=0 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.636+0000 7f0cc57fa640 1 -- 172.21.15.79:0/999568787 <== mds.0 v2:172.21.15.79:6834/1640828017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b5ab383e70 con 0x55b5ab43e510 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.636+0000 7f0cc57fa640 10 client.6414 handle_command_reply: tid=0 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.636+0000 7f0cefc2a740 1 client.6414 shutdown 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 -- 172.21.15.79:0/999568787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 msgr2=0x55b5ab437e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab437e30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009010 tx=0x7f0cd80019c0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 -- 172.21.15.79:0/999568787 shutdown_connections 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] conn(0x55b5ab43e510 0x55b5ab441250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab45dbc0 0x55b5ab458d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/999568787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab43d700 0x55b5ab437e30 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 -- 172.21.15.79:0/999568787 >> 172.21.15.79:0/999568787 conn(0x55b5ab40d960 msgr2=0x55b5ab45ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cc57fa640 0 client.6414 ms_handle_reset on v2:172.21.15.79:6834/1640828017 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 -- 172.21.15.79:0/999568787 shutdown_connections 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 1 -- 172.21.15.79:0/999568787 wait complete. 2024-06-10T00:18:49.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.637+0000 7f0cefc2a740 20 client.6414 trim_cache size 0 max 16384 2024-06-10T00:18:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0cefc2a740 1 Processor -- start 2024-06-10T00:18:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0cefc2a740 1 -- start start 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4353e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab45dbc0 0x55b5ab435920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81fc100 con 0x55b5ab45dbc0 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce806ed30 con 0x55b5ab43d700 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce8152810 con 0x55b5ab459660 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0ce6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab45dbc0 0x55b5ab435920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.656+0000 7f0ce6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab45dbc0 0x55b5ab435920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34714/0 (socket says 172.21.15.79:34714) 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce6d9d640 1 -- 172.21.15.79:0/2550971204 learned_addr learned my addr 172.21.15.79:0/2550971204 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce659c640 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce6d9d640 1 -- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 msgr2=0x55b5ab4353e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce6d9d640 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4353e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce6d9d640 1 -- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 msgr2=0x55b5ab4d5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce6d9d640 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce6d9d640 1 -- 172.21.15.79:0/2550971204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ab457760 con 0x55b5ab45dbc0 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce659c640 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0ce6d9d640 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab45dbc0 0x55b5ab435920 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00073e0 tx=0x7f0ce0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e033bec14b235c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0cc77fe640 1 -- 172.21.15.79:0/2550971204 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce001a070 con 0x55b5ab45dbc0 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0cc77fe640 1 -- 172.21.15.79:0/2550971204 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0003b90 con 0x55b5ab45dbc0 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.657+0000 7f0cc77fe640 1 -- 172.21.15.79:0/2550971204 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0004020 con 0x55b5ab45dbc0 2024-06-10T00:18:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 -- 172.21.15.79:0/2550971204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab45dbc0 msgr2=0x55b5ab435920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab45dbc0 0x55b5ab435920 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00073e0 tx=0x7f0ce0009f90 comp rx=0 tx=0).stop 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 -- 172.21.15.79:0/2550971204 shutdown_connections 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab45dbc0 0x55b5ab435920 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab459660 0x55b5ab4353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/2550971204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 -- 172.21.15.79:0/2550971204 >> 172.21.15.79:0/2550971204 conn(0x55b5ab40d960 msgr2=0x55b5ab409090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 -- 172.21.15.79:0/2550971204 shutdown_connections 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 -- 172.21.15.79:0/2550971204 wait complete. 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 -- start start 2024-06-10T00:18:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.658+0000 7f0cefc2a740 1 Processor -- start 2024-06-10T00:18:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab459660 0x55b5ab47b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0cefc2a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab45dbc0 0x55b5ab4358c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b5ab45fbf0 con 0x55b5ab459660 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b5ab4406b0 con 0x55b5ab43d700 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0cefc2a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b5ab43e920 con 0x55b5ab45dbc0 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0cefc2a740 10 client.0 _ll_register_callbacks cb 0x7f0cd80070c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab459660 0x55b5ab47b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab459660 0x55b5ab47b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34728/0 (socket says 172.21.15.79:34728) 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/471232176 learned_addr learned my addr 172.21.15.79:0/471232176 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce659c640 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce6d9d640 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab45dbc0 0x55b5ab4358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab45dbc0 msgr2=0x55b5ab4358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab45dbc0 0x55b5ab4358c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 msgr2=0x55b5ab4d39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.659+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0ce5d9b640 1 -- 172.21.15.79:0/471232176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ab4d3f20 con 0x55b5ab459660 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0ce659c640 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0ce5d9b640 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab459660 0x55b5ab47b780 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc075450 tx=0x7f0cdc0796f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3970b7df48e35f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cc57fa640 1 -- 172.21.15.79:0/471232176 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc081bd0 con 0x55b5ab459660 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cc57fa640 1 -- 172.21.15.79:0/471232176 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f0cdc075660 con 0x55b5ab459660 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 1 -- 172.21.15.79:0/471232176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ce0003b90 con 0x55b5ab459660 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cc57fa640 1 -- 172.21.15.79:0/471232176 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0cdc079250 con 0x55b5ab459660 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 10 client.6420 fetch_fsmap learned FSMap version 37 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 1 -- 172.21.15.79:0/471232176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x55b5ab4399f0 con 0x55b5ab459660 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cc57fa640 1 -- 172.21.15.79:0/471232176 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0003b90 con 0x55b5ab459660 2024-06-10T00:18:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cc57fa640 1 -- 172.21.15.79:0/471232176 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7f0cdc04c060 con 0x55b5ab459660 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 10 client.6420 fetch_fsmap finished waiting for FSMap version 37 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 10 client.6420 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 20 client.6420 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] conn(0x55b5ab436a40 0x55b5ab436e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 4 client.6420 mds_command: new command op to 6288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0cefc2a740 1 -- 172.21.15.79:0/471232176 --> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] -- command(tid 0: {"prefix": "status"}) -- 0x55b5ab37e1c0 con 0x55b5ab436a40 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.660+0000 7f0ce659c640 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] conn(0x55b5ab436a40 0x55b5ab436e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cc57fa640 10 client.6420 ms_handle_connect on v2:172.21.15.79:6834/1640828017 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0ce659c640 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] conn(0x55b5ab436a40 0x55b5ab436e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26205eb615d32d04 server_cookie=79643a94e0f4f2d5 in_seq=0 out_seq=0 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cc57fa640 1 -- 172.21.15.79:0/471232176 <== mds.0 v2:172.21.15.79:6834/1640828017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b5ab37e1c0 con 0x55b5ab436a40 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cc57fa640 10 client.6420 handle_command_reply: tid=0 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 client.6420 shutdown 2024-06-10T00:18:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 -- 172.21.15.79:0/471232176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab459660 msgr2=0x55b5ab47b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab459660 0x55b5ab47b780 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc075450 tx=0x7f0cdc0796f0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 -- 172.21.15.79:0/471232176 shutdown_connections 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.79:6834/1640828017,v1:172.21.15.79:6835/1640828017] conn(0x55b5ab436a40 0x55b5ab436e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5ab45dbc0 0x55b5ab4358c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cc57fa640 0 client.6420 ms_handle_reset on v2:172.21.15.79:6834/1640828017 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5ab459660 0x55b5ab47b780 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 --2- 172.21.15.79:0/471232176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5ab43d700 0x55b5ab4d39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 -- 172.21.15.79:0/471232176 >> 172.21.15.79:0/471232176 conn(0x55b5ab40d960 msgr2=0x55b5ab441230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 -- 172.21.15.79:0/471232176 shutdown_connections 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 1 -- 172.21.15.79:0/471232176 wait complete. 2024-06-10T00:18:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.661+0000 7f0cefc2a740 20 client.6420 trim_cache size 0 max 16384 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6288, 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.5997271629999998, 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 37, 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 75, 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 75, 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 8.6748651829999996 2024-06-10T00:18:49.668 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:18:49.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 -- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0cc806be30 msgr2=0x7f0cc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0cc806be30 0x7f0cc806e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8001770 tx=0x7f0cd8009040 comp rx=0 tx=0).stop 2024-06-10T00:18:49.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 -- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce814bbc0 msgr2=0x7f0ce814b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce814bbc0 0x7f0ce814b350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc02a700 tx=0x7f0cdc0012b0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 -- 172.21.15.79:0/1539835921 shutdown_connections 2024-06-10T00:18:49.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0cc806be30 0x7f0cc806e2f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ce81550b0 0x7f0ce8155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce814bbc0 0x7f0ce814b350 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 --2- 172.21.15.79:0/1539835921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd0004390 0x7f0ce8157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 -- 172.21.15.79:0/1539835921 >> 172.21.15.79:0/1539835921 conn(0x7f0ce80b19f0 msgr2=0x7f0ce80af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 -- 172.21.15.79:0/1539835921 shutdown_connections 2024-06-10T00:18:49.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.662+0000 7f0cecf21640 1 -- 172.21.15.79:0/1539835921 wait complete. 2024-06-10T00:18:49.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:18:49.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.772+0000 7fbaafdee640 1 Processor -- start 2024-06-10T00:18:49.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.772+0000 7fbaafdee640 1 -- start start 2024-06-10T00:18:49.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaafdee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbaa815a870 0x7fbaa806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaafdee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbaa80aef70 0x7fbaa80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaafdee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa806e390 con 0x7fbaa80af3d0 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaafdee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa815ac50 con 0x7fbaa815a870 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaafdee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa806cdb0 con 0x7fbaa80aef70 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaadb8a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbaa815a870 0x7fbaa806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaae38b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbaa80af3d0 0x7fbaa80cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35984/0 (socket says 172.21.15.79:35984) 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaae38b640 1 -- 172.21.15.79:0/3576224410 learned_addr learned my addr 172.21.15.79:0/3576224410 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaad389640 1 --2- 172.21.15.79:0/3576224410 >> v2:172.21.15.117:3300/0 conn(0x7fbaa80aef70 0x7fbaa80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaadb8a640 1 -- 172.21.15.79:0/3576224410 >> v2:172.21.15.117:3300/0 conn(0x7fbaa80aef70 msgr2=0x7fbaa80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaadb8a640 1 --2- 172.21.15.79:0/3576224410 >> v2:172.21.15.117:3300/0 conn(0x7fbaa80aef70 0x7fbaa80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaadb8a640 1 -- 172.21.15.79:0/3576224410 >> v1:172.21.15.79:6789/0 conn(0x7fbaa80af3d0 legacy=0x7fbaa80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaacb88640 1 -- 172.21.15.79:0/3576224410 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248661065 0 0) 0x7fbaa806e390 con 0x7fbaa80af3d0 2024-06-10T00:18:49.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaadb8a640 1 -- 172.21.15.79:0/3576224410 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa806d090 con 0x7fbaa815a870 2024-06-10T00:18:49.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.773+0000 7fbaad389640 1 --2- 172.21.15.79:0/3576224410 >> v2:172.21.15.117:3300/0 conn(0x7fbaa80aef70 0x7fbaa80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:49.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.774+0000 7fbaadb8a640 1 --2- 172.21.15.79:0/3576224410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa806de50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80b4070 tx=0x7fbaa402b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d3988baa3b1d28 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.774+0000 7fbaacb88640 1 -- 172.21.15.79:0/3576224410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400b040 con 0x7fbaa815a870 2024-06-10T00:18:49.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.774+0000 7fbaacb88640 1 -- 172.21.15.79:0/3576224410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa4030710 con 0x7fbaa815a870 2024-06-10T00:18:49.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.774+0000 7fbaacb88640 1 -- 172.21.15.79:0/3576224410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4030ae0 con 0x7fbaa815a870 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.775+0000 7fbaafdee640 1 -- 172.21.15.79:0/3576224410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 msgr2=0x7fbaa806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.775+0000 7fbaafdee640 1 --2- 172.21.15.79:0/3576224410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa806de50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80b4070 tx=0x7fbaa402b4d0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.775+0000 7fbaafdee640 1 -- 172.21.15.79:0/3576224410 shutdown_connections 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.775+0000 7fbaafdee640 1 --2- 172.21.15.79:0/3576224410 >> v2:172.21.15.117:3300/0 conn(0x7fbaa80aef70 0x7fbaa80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.775+0000 7fbaafdee640 1 --2- 172.21.15.79:0/3576224410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa806de50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.775+0000 7fbaafdee640 1 -- 172.21.15.79:0/3576224410 >> 172.21.15.79:0/3576224410 conn(0x7fbaa80b19f0 msgr2=0x7fbaa80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.775+0000 7fbaafdee640 1 -- 172.21.15.79:0/3576224410 shutdown_connections 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.775+0000 7fbaafdee640 1 -- 172.21.15.79:0/3576224410 wait complete. 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.776+0000 7fbaafdee640 1 Processor -- start 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.776+0000 7fbaafdee640 1 -- start start 2024-06-10T00:18:49.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaafdee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa80aef70 0x7fbaa81f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaafdee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80af3d0 0x7fbaa81f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaafdee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa81f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaafdee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa806d930 con 0x7fbaa815a870 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaafdee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa806d650 con 0x7fbaa80af3d0 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaafdee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa80b2e40 con 0x7fbaa80aef70 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa81f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa81f7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34744/0 (socket says 172.21.15.79:34744) 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 -- 172.21.15.79:0/1626480505 learned_addr learned my addr 172.21.15.79:0/1626480505 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaadb8a640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa80aef70 0x7fbaa81f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaad389640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80af3d0 0x7fbaa81f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 -- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa80aef70 msgr2=0x7fbaa81f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa80aef70 0x7fbaa81f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 -- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80af3d0 msgr2=0x7fbaa81f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80af3d0 0x7fbaa81f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 -- 172.21.15.79:0/1626480505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa81f76e0 con 0x7fbaa815a870 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaadb8a640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa80aef70 0x7fbaa81f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaad389640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80af3d0 0x7fbaa81f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaae38b640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa81f7ea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000c7a0 tx=0x7fbaa000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fba9e7fc640 1 -- 172.21.15.79:0/1626480505 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0018070 con 0x7fbaa815a870 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fba9e7fc640 1 -- 172.21.15.79:0/1626480505 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa000a640 con 0x7fbaa815a870 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fba9e7fc640 1 -- 172.21.15.79:0/1626480505 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000aa70 con 0x7fbaa815a870 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa80cb640 con 0x7fbaa815a870 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.777+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa80cbc00 con 0x7fbaa815a870 2024-06-10T00:18:49.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.778+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa8068430 con 0x7fbaa815a870 2024-06-10T00:18:49.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.779+0000 7fba9e7fc640 1 -- 172.21.15.79:0/1626480505 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaa001b070 con 0x7fbaa815a870 2024-06-10T00:18:49.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.779+0000 7fba9e7fc640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba8c06be30 0x7fba8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:49.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.780+0000 7fbaadb8a640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba8c06be30 0x7fba8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:49.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.780+0000 7fba9e7fc640 1 -- 172.21.15.79:0/1626480505 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fbaa008a530 con 0x7fbaa815a870 2024-06-10T00:18:49.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.780+0000 7fbaadb8a640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba8c06be30 0x7fba8c06e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4035000 tx=0x7fbaa400c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:49.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.784+0000 7fba9e7fc640 1 -- 172.21.15.79:0/1626480505 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbaa0058de0 con 0x7fbaa815a870 2024-06-10T00:18:49.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.994+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbaa8068bb0 con 0x7fbaa815a870 2024-06-10T00:18:49.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.994+0000 7fba9e7fc640 1 -- 172.21.15.79:0/1626480505 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7fbaa00586e0 con 0x7fbaa815a870 2024-06-10T00:18:49.994 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba8c06be30 msgr2=0x7fba8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba8c06be30 0x7fba8c06e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4035000 tx=0x7fbaa400c040 comp rx=0 tx=0).stop 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 msgr2=0x7fbaa81f7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa81f7ea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000c7a0 tx=0x7fbaa000cc60 comp rx=0 tx=0).stop 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 shutdown_connections 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fba8c06be30 0x7fba8c06e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa815a870 0x7fbaa81f7ea0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80af3d0 0x7fbaa81f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 --2- 172.21.15.79:0/1626480505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa80aef70 0x7fbaa81f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 >> 172.21.15.79:0/1626480505 conn(0x7fbaa80b19f0 msgr2=0x7fbaa814f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:49.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 shutdown_connections 2024-06-10T00:18:49.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:49.996+0000 7fbaafdee640 1 -- 172.21.15.79:0/1626480505 wait complete. 2024-06-10T00:18:50.006 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:18:50.006 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:18:50.006 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:18:50.007 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:18:50.007 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:50.007 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:18:50.007 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:18:50.007 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:18:50.007 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:18:50.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:50.007 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:18:50.023 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:18:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:18:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:18:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:18:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42514sec preferred_lft 42514sec 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:18:50.026 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:50.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:50.026 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:18:50.088 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:18:50.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:50.089 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:18:50.145 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:18:50.145 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:18:50.145 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:18:50.145 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:18:50.145 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:18:50.145 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:18:50.146 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:18:50.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:18:50.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:18:50.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:18:50.146 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:18:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:18:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:18:50.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:50.273 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:18:50.288 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:18:50.288 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:18:50.288 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:18:50.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:50.289 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:18:50.353 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:18:50.353 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:18:50.353 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:50.409 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:18:50.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:18:50.410 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:50.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:18:50.529 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:18:50.585 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:18:50.585 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:18:50.585 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:18:50.585 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:18:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:50.587 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:50.588 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:50.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:50.588 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:18:50.640 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:18:50.640 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:18:50.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:18:50.707 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:18:50.764 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:18:50.764+0000 7fba8a644480 -1 init, newargv = 0x55df320be5a0 newargc=15 2024-06-10T00:18:50.764 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:18:50.764 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:18:50.764 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:18:50.764 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:18:50.764 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:18:50.764 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:18:50.764 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:18:50.765 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:50.766 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:50.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[60048]: starting ceph client 2024-06-10T00:18:50.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:50.767 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:18:50.768 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[60048]: starting fuse 2024-06-10T00:18:50.782 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:18:50.782 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:18:50.783 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:50.784 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:18:50.785 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:18:50.900 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.60048.asok 2024-06-10T00:18:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:18:50.910 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.60048.asok 2024-06-10T00:18:50.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:50.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.60048.asok status 2024-06-10T00:18:51.045 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:18:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:18:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:18:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:18:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:18:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:18:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:18:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "60048", 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6435, 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 6435 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:18:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2404869568 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2404869568 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.6435 192.168.0.1:0/2404869568", 2024-06-10T00:18:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/2404869568", 2024-06-10T00:18:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:18:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 37, 2024-06-10T00:18:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 75, 2024-06-10T00:18:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:18:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:18:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:18:51.048 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:18:51.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:51.053 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:18:51.054 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:51.070 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:18:51.070 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:51.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:51.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:51.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:51.136 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-06-10T00:18:51.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:51.196 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-06-10T00:18:51.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:51.255 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-06-10T00:18:51.312 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:18:51.313 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:18:51.313 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:18:51.313 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:51.313 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-06-10T00:18:51.313 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:18:51.417 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-06-10T00:18:51.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:18:51.425 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:18:51.426 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:51.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:18:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.623+0000 7f54223ed640 1 Processor -- start 2024-06-10T00:18:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.623+0000 7f54223ed640 1 -- start start 2024-06-10T00:18:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.623+0000 7f54223ed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f541c0d2680 0x7f541c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.623+0000 7f54223ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f541c0d0ad0 con 0x7f541c0cef70 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.623+0000 7f54223ed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f541c15f890 con 0x7f541c0d1fc0 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.623+0000 7f54223ed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f541c0d13e0 con 0x7f541c0d2680 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.623+0000 7f542098a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f541c0cef70 0x7f541c0cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35990/0 (socket says 172.21.15.79:35990) 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f542098a640 1 -- 172.21.15.79:0/3912203949 learned_addr learned my addr 172.21.15.79:0/3912203949 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557661550 0 0) 0x7f541c0d0ad0 con 0x7f541c0cef70 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541bfff640 1 --2- 172.21.15.79:0/3912203949 >> v2:172.21.15.117:3300/0 conn(0x7f541c0d2680 0x7f541c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5404003520 con 0x7f541c0cef70 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2989649476 0 0) 0x7f5404003520 con 0x7f541c0cef70 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 >> v2:172.21.15.117:3300/0 conn(0x7f541c0d2680 msgr2=0x7f541c15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 --2- 172.21.15.79:0/3912203949 >> v2:172.21.15.117:3300/0 conn(0x7f541c0d2680 0x7f541c15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 >> v1:172.21.15.117:6789/0 conn(0x7f541c0d1fc0 legacy=0x7f541c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c0d0d90 con 0x7f541c0cef70 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f54140019f0 con 0x7f541c0cef70 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 >> v1:172.21.15.79:6789/0 conn(0x7f541c0cef70 legacy=0x7f541c0cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040039b0 0x7f5404003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404004800 0x7f5404004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54040051c0 0x7f540400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f541c0d13e0 con 0x7f54040051c0 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f540400c090 con 0x7f5404004800 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f540400c290 con 0x7f54040039b0 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f542098a640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54040051c0 0x7f540400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541b7fe640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404004800 0x7f5404004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.624+0000 7f541bfff640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040039b0 0x7f5404003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f542098a640 1 -- 172.21.15.79:0/3912203949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040039b0 msgr2=0x7f5404003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f542098a640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040039b0 0x7f5404003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f542098a640 1 -- 172.21.15.79:0/3912203949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404004800 msgr2=0x7f5404004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f542098a640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404004800 0x7f5404004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f542098a640 1 -- 172.21.15.79:0/3912203949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5404003520 con 0x7f54040051c0 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f542098a640 1 -- 172.21.15.79:0/3912203949 reap_dead start 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f542098a640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54040051c0 0x7f540400b9c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f541400a860 tx=0x7f5404005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff96cfd40df5a93c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541400a480 con 0x7f54040051c0 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541402f070 con 0x7f54040051c0 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.625+0000 7f541affd640 1 -- 172.21.15.79:0/3912203949 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541402bcc0 con 0x7f54040051c0 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.626+0000 7f54223ed640 1 -- 172.21.15.79:0/3912203949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54040051c0 msgr2=0x7f540400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.626+0000 7f54223ed640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54040051c0 0x7f540400b9c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f541400a860 tx=0x7f5404005830 comp rx=0 tx=0).stop 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.626+0000 7f54223ed640 1 -- 172.21.15.79:0/3912203949 shutdown_connections 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.626+0000 7f54223ed640 1 --2- 172.21.15.79:0/3912203949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54040051c0 0x7f540400b9c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.626+0000 7f54223ed640 1 -- 172.21.15.79:0/3912203949 >> 172.21.15.79:0/3912203949 conn(0x7f541c09d3f0 msgr2=0x7f541c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.626+0000 7f54223ed640 1 -- 172.21.15.79:0/3912203949 shutdown_connections 2024-06-10T00:18:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.626+0000 7f54223ed640 1 -- 172.21.15.79:0/3912203949 wait complete. 2024-06-10T00:18:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.627+0000 7f54223ed640 1 Processor -- start 2024-06-10T00:18:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.627+0000 7f54223ed640 1 -- start start 2024-06-10T00:18:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f54223ed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040051c0 0x7f541c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f54223ed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f541c1f4420 0x7f541c1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f54223ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f541c15b350 0x7f541c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f54223ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f541c0d4f00 con 0x7f541c15b350 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f54223ed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f541c0d2400 con 0x7f541c1f4420 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f54223ed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f541c0d1870 con 0x7f54040051c0 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f542098a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f541c15b350 0x7f541c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f542098a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f541c15b350 0x7f541c15b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34758/0 (socket says 172.21.15.79:34758) 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f542098a640 1 -- 172.21.15.79:0/3958229850 learned_addr learned my addr 172.21.15.79:0/3958229850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f541bfff640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040051c0 0x7f541c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f541b7fe640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f541c1f4420 0x7f541c1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f542098a640 1 -- 172.21.15.79:0/3958229850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040051c0 msgr2=0x7f541c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f542098a640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040051c0 0x7f541c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f542098a640 1 -- 172.21.15.79:0/3958229850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f541c1f4420 msgr2=0x7f541c1f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f542098a640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f541c1f4420 0x7f541c1f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.628+0000 7f542098a640 1 -- 172.21.15.79:0/3958229850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c15aa50 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.629+0000 7f542098a640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f541c15b350 0x7f541c15b7e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f541400a980 tx=0x7f541c0d4050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.629+0000 7f5418ff9640 1 -- 172.21.15.79:0/3958229850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414044070 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.629+0000 7f5418ff9640 1 -- 172.21.15.79:0/3958229850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541402bdc0 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.629+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541c15bec0 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.629+0000 7f5418ff9640 1 -- 172.21.15.79:0/3958229850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541400a480 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.629+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f541c15c480 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.630+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f541c068430 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.630+0000 7f5418ff9640 1 -- 172.21.15.79:0/3958229850 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5414047070 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.631+0000 7f5418ff9640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f540806be30 0x7f540806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.631+0000 7f5418ff9640 1 -- 172.21.15.79:0/3958229850 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f54140aaa30 con 0x7f541c15b350 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.631+0000 7f541bfff640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f540806be30 0x7f540806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.631+0000 7f541bfff640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f540806be30 0x7f540806e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f540c009a80 tx=0x7f540c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.635+0000 7f5418ff9640 1 -- 172.21.15.79:0/3958229850 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5414078c00 con 0x7f541c15b350 2024-06-10T00:18:51.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.821+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f541c0d04e0 con 0x7f541c15b350 2024-06-10T00:18:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.821+0000 7f5418ff9640 1 -- 172.21.15.79:0/3958229850 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7f541407cf00 con 0x7f541c15b350 2024-06-10T00:18:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:18:51.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f540806be30 msgr2=0x7f540806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f540806be30 0x7f540806e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f540c009a80 tx=0x7f540c008040 comp rx=0 tx=0).stop 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f541c15b350 msgr2=0x7f541c15b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f541c15b350 0x7f541c15b7e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f541400a980 tx=0x7f541c0d4050 comp rx=0 tx=0).stop 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 shutdown_connections 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f540806be30 0x7f540806e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f541c15b350 0x7f541c15b7e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f541c1f4420 0x7f541c1f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 --2- 172.21.15.79:0/3958229850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040051c0 0x7f541c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.823+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 >> 172.21.15.79:0/3958229850 conn(0x7f541c09d3f0 msgr2=0x7f541c161130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.824+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 shutdown_connections 2024-06-10T00:18:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:51.824+0000 7f54223ed640 1 -- 172.21.15.79:0/3958229850 wait complete. 2024-06-10T00:18:51.875 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:18:51.875 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:51.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:18:52.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.032+0000 7fc390a7d640 1 Processor -- start 2024-06-10T00:18:52.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.032+0000 7fc390a7d640 1 -- start start 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc390a7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 0x7fc38c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc390a7d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38c06d130 con 0x7fc38c0cf360 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc390a7d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38c06d410 con 0x7fc38c06ea20 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc390a7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc38c06ee60 con 0x7fc38c0ae910 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc38c0cf360 0x7fc38c0acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35992/0 (socket says 172.21.15.79:35992) 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38ad9d640 1 -- 172.21.15.79:0/703476538 learned_addr learned my addr 172.21.15.79:0/703476538 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38a59c640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 0x7fc38c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2392262649 0 0) 0x7fc38c06d130 con 0x7fc38c0cf360 2024-06-10T00:18:52.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc374003520 con 0x7fc38c0cf360 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3738259795 0 0) 0x7fc374003520 con 0x7fc38c0cf360 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 msgr2=0x7fc38c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 0x7fc38c06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 >> v1:172.21.15.117:6789/0 conn(0x7fc38c06ea20 legacy=0x7fc38c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c06d6f0 con 0x7fc38c0cf360 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fc3840019f0 con 0x7fc38c0cf360 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 >> v1:172.21.15.79:6789/0 conn(0x7fc38c0cf360 legacy=0x7fc38c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3740039e0 0x7fc374003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374004800 0x7fc374004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 0x7fc374005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c06ee60 con 0x7fc374004800 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc37400dd00 con 0x7fc3740039e0 2024-06-10T00:18:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc37400df00 con 0x7fc38c0ae910 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc389d9b640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374004800 0x7fc374004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.033+0000 7fc38a59c640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3740039e0 0x7fc374003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc38ad9d640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 0x7fc374005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc389d9b640 1 -- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 msgr2=0x7fc374005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc389d9b640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 0x7fc374005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc389d9b640 1 -- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3740039e0 msgr2=0x7fc374003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc389d9b640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3740039e0 0x7fc374003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc389d9b640 1 -- 172.21.15.79:0/703476538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc374003520 con 0x7fc374004800 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc38ad9d640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc38c0ae910 0x7fc374005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc389d9b640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374004800 0x7fc374004c80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc380001750 tx=0x7fc374005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba82f7daeeca973 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.034+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380001370 con 0x7fc374004800 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3800052d0 con 0x7fc374004800 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc38959a640 1 -- 172.21.15.79:0/703476538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38002abe0 con 0x7fc374004800 2024-06-10T00:18:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc390a7d640 1 -- 172.21.15.79:0/703476538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374004800 msgr2=0x7fc374004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc390a7d640 1 --2- 172.21.15.79:0/703476538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374004800 0x7fc374004c80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc380001750 tx=0x7fc374005830 comp rx=0 tx=0).stop 2024-06-10T00:18:52.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc38ad9d640 1 -- 172.21.15.79:0/703476538 reap_dead start 2024-06-10T00:18:52.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc390a7d640 1 -- 172.21.15.79:0/703476538 shutdown_connections 2024-06-10T00:18:52.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc390a7d640 1 -- 172.21.15.79:0/703476538 >> 172.21.15.79:0/703476538 conn(0x7fc38c0b19f0 msgr2=0x7fc38c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:52.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc390a7d640 1 -- 172.21.15.79:0/703476538 shutdown_connections 2024-06-10T00:18:52.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.035+0000 7fc390a7d640 1 -- 172.21.15.79:0/703476538 wait complete. 2024-06-10T00:18:52.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.036+0000 7fc390a7d640 1 Processor -- start 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.036+0000 7fc390a7d640 1 -- start start 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc390a7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc374004800 0x7fc38c0c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc390a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c09aeb0 0x7fc38c09c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc390a7d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c09b330 0x7fc38c1f0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc390a7d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c06e4e0 con 0x7fc38c09aeb0 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc390a7d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c0aecf0 con 0x7fc38c09b330 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc390a7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc38c06e660 con 0x7fc374004800 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc389d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c09aeb0 0x7fc38c09c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc389d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c09aeb0 0x7fc38c09c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34772/0 (socket says 172.21.15.79:34772) 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc389d9b640 1 -- 172.21.15.79:0/1376377873 learned_addr learned my addr 172.21.15.79:0/1376377873 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc38ad9d640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c09b330 0x7fc38c1f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.037+0000 7fc38a59c640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc374004800 0x7fc38c0c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc389d9b640 1 -- 172.21.15.79:0/1376377873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc374004800 msgr2=0x7fc38c0c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc389d9b640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc374004800 0x7fc38c0c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc389d9b640 1 -- 172.21.15.79:0/1376377873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c09b330 msgr2=0x7fc38c1f0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc389d9b640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c09b330 0x7fc38c1f0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc389d9b640 1 -- 172.21.15.79:0/1376377873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c09b7b0 con 0x7fc38c09aeb0 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc389d9b640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c09aeb0 0x7fc38c09c850 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc380001870 tx=0x7fc380001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc37affd640 1 -- 172.21.15.79:0/1376377873 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380040020 con 0x7fc38c09aeb0 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc37affd640 1 -- 172.21.15.79:0/1376377873 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc380007680 con 0x7fc38c09aeb0 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38c09ba90 con 0x7fc38c09aeb0 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc37affd640 1 -- 172.21.15.79:0/1376377873 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380007a30 con 0x7fc38c09aeb0 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.038+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc38c09c050 con 0x7fc38c09aeb0 2024-06-10T00:18:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.039+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38c068430 con 0x7fc38c09aeb0 2024-06-10T00:18:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.039+0000 7fc37affd640 1 -- 172.21.15.79:0/1376377873 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc380043020 con 0x7fc38c09aeb0 2024-06-10T00:18:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.040+0000 7fc37affd640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc36c06be60 0x7fc36c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.040+0000 7fc37affd640 1 -- 172.21.15.79:0/1376377873 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fc3800aaf90 con 0x7fc38c09aeb0 2024-06-10T00:18:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.040+0000 7fc38a59c640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc36c06be60 0x7fc36c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.040+0000 7fc38a59c640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc36c06be60 0x7fc36c06e320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc38c09d470 tx=0x7fc37c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.044+0000 7fc37affd640 1 -- 172.21.15.79:0/1376377873 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc38004a030 con 0x7fc38c09aeb0 2024-06-10T00:18:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.232+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc38c068cf0 con 0x7fc38c09aeb0 2024-06-10T00:18:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.233+0000 7fc37affd640 1 -- 172.21.15.79:0/1376377873 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7fc3800797b0 con 0x7fc38c09aeb0 2024-06-10T00:18:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc36c06be60 msgr2=0x7fc36c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc36c06be60 0x7fc36c06e320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc38c09d470 tx=0x7fc37c008040 comp rx=0 tx=0).stop 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c09aeb0 msgr2=0x7fc38c09c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c09aeb0 0x7fc38c09c850 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc380001870 tx=0x7fc380001120 comp rx=0 tx=0).stop 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 shutdown_connections 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc36c06be60 0x7fc36c06e320 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c09b330 0x7fc38c1f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c09aeb0 0x7fc38c09c850 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 --2- 172.21.15.79:0/1376377873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc374004800 0x7fc38c0c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 >> 172.21.15.79:0/1376377873 conn(0x7fc38c0b19f0 msgr2=0x7fc38c0cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 shutdown_connections 2024-06-10T00:18:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.235+0000 7fc390a7d640 1 -- 172.21.15.79:0/1376377873 wait complete. 2024-06-10T00:18:52.245 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:18:52.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:52.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:52.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[60048]: fuse finished with error 0 and tester_r 0 2024-06-10T00:18:52.270 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:18:52.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:18:52.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:52.353 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:18:52.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.509+0000 7f7ff8c76640 1 Processor -- start 2024-06-10T00:18:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.509+0000 7f7ff8c76640 1 -- start start 2024-06-10T00:18:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.510+0000 7f7ff8c76640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ff40ae910 0x7f7ff406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.510+0000 7f7ff8c76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ff406ea20 0x7f7ff40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.510+0000 7f7ff8c76640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff406d130 con 0x7f7ff40cf190 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.510+0000 7f7ff8c76640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff406ee90 con 0x7f7ff40ae910 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.510+0000 7f7ff8c76640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff406d410 con 0x7f7ff406ea20 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.510+0000 7f7ff259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ff40ae910 0x7f7ff406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.510+0000 7f7ff2d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7ff40cf190 0x7f7ff415ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36000/0 (socket says 172.21.15.79:36000) 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.510+0000 7f7ff2d9d640 1 -- 172.21.15.79:0/1313764615 learned_addr learned my addr 172.21.15.79:0/1313764615 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff259c640 1 -- 172.21.15.79:0/1313764615 >> v2:172.21.15.117:3300/0 conn(0x7f7ff406ea20 msgr2=0x7f7ff40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff259c640 1 --2- 172.21.15.79:0/1313764615 >> v2:172.21.15.117:3300/0 conn(0x7f7ff406ea20 0x7f7ff40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff259c640 1 -- 172.21.15.79:0/1313764615 >> v1:172.21.15.79:6789/0 conn(0x7f7ff40cf190 legacy=0x7f7ff415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff259c640 1 -- 172.21.15.79:0/1313764615 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff406d6f0 con 0x7f7ff40ae910 2024-06-10T00:18:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff159a640 1 -- 172.21.15.79:0/1313764615 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402700182 0 0) 0x7f7ff406d130 con 0x7f7ff40cf190 2024-06-10T00:18:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff259c640 1 --2- 172.21.15.79:0/1313764615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40ae910 0x7f7ff406e4e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4070c80 tx=0x7f7fe402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c5198a150c48ed server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff159a640 1 -- 172.21.15.79:0/1313764615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4037070 con 0x7f7ff40ae910 2024-06-10T00:18:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff159a640 1 -- 172.21.15.79:0/1313764615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe4032440 con 0x7f7ff40ae910 2024-06-10T00:18:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.511+0000 7f7ff159a640 1 -- 172.21.15.79:0/1313764615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe402ae60 con 0x7f7ff40ae910 2024-06-10T00:18:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.512+0000 7f7ff8c76640 1 -- 172.21.15.79:0/1313764615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40ae910 msgr2=0x7f7ff406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.512+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/1313764615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40ae910 0x7f7ff406e4e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4070c80 tx=0x7f7fe402a110 comp rx=0 tx=0).stop 2024-06-10T00:18:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.512+0000 7f7ff8c76640 1 -- 172.21.15.79:0/1313764615 shutdown_connections 2024-06-10T00:18:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.512+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/1313764615 >> v2:172.21.15.117:3300/0 conn(0x7f7ff406ea20 0x7f7ff40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.512+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/1313764615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40ae910 0x7f7ff406e4e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.512+0000 7f7ff8c76640 1 -- 172.21.15.79:0/1313764615 >> 172.21.15.79:0/1313764615 conn(0x7f7ff40b19f0 msgr2=0x7f7ff40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.512+0000 7f7ff8c76640 1 -- 172.21.15.79:0/1313764615 shutdown_connections 2024-06-10T00:18:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.512+0000 7f7ff8c76640 1 -- 172.21.15.79:0/1313764615 wait complete. 2024-06-10T00:18:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.513+0000 7f7ff8c76640 1 Processor -- start 2024-06-10T00:18:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff8c76640 1 -- start start 2024-06-10T00:18:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff8c76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff406ea20 0x7f7ff409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff8c76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff40ae910 0x7f7ff4153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff8c76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40cf190 0x7f7ff4149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff8c76640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40aecf0 con 0x7f7ff40cf190 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff8c76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40cf5e0 con 0x7f7ff40ae910 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff8c76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff40add50 con 0x7f7ff406ea20 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40cf190 0x7f7ff4149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40cf190 0x7f7ff4149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34784/0 (socket says 172.21.15.79:34784) 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff2d9d640 1 -- 172.21.15.79:0/4115161775 learned_addr learned my addr 172.21.15.79:0/4115161775 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.514+0000 7f7ff1d9b640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff40ae910 0x7f7ff4153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff259c640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff406ea20 0x7f7ff409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff2d9d640 1 -- 172.21.15.79:0/4115161775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff406ea20 msgr2=0x7f7ff409b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff2d9d640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff406ea20 0x7f7ff409b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff2d9d640 1 -- 172.21.15.79:0/4115161775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff40ae910 msgr2=0x7f7ff4153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff2d9d640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff40ae910 0x7f7ff4153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff2d9d640 1 -- 172.21.15.79:0/4115161775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff4154220 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff2d9d640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40cf190 0x7f7ff4149070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00c7d0 tx=0x7f7fec00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7fe2ffd640 1 -- 172.21.15.79:0/4115161775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec018070 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7fe2ffd640 1 -- 172.21.15.79:0/4115161775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fec00a640 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff4152620 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7fe2ffd640 1 -- 172.21.15.79:0/4115161775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec00aa70 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.515+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff4152be0 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.516+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff4068430 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.516+0000 7f7fe2ffd640 1 -- 172.21.15.79:0/4115161775 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fec01b070 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.517+0000 7f7fe2ffd640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd406be30 0x7f7fd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.517+0000 7f7fe2ffd640 1 -- 172.21.15.79:0/4115161775 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f7fec08a5d0 con 0x7f7ff40cf190 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.517+0000 7f7ff259c640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd406be30 0x7f7fd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.517+0000 7f7ff259c640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd406be30 0x7f7fd406e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4034000 tx=0x7f7fe402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.521+0000 7f7fe2ffd640 1 -- 172.21.15.79:0/4115161775 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7fec058df0 con 0x7f7ff40cf190 2024-06-10T00:18:52.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.733+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ff40cf800 con 0x7f7ff40cf190 2024-06-10T00:18:52.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.734+0000 7f7fe2ffd640 1 -- 172.21.15.79:0/4115161775 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5183 (secure 0 0 0) 0x7f7fec0586f0 con 0x7f7ff40cf190 2024-06-10T00:18:52.733 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:52.733 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:18:46.409798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1640828017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1640828017},{"type":"v1","addr":"172.21.15.79:6835","nonce":1640828017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":5}]} 2024-06-10T00:18:52.734 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 37 2024-06-10T00:18:52.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.735+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd406be30 msgr2=0x7f7fd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.735+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd406be30 0x7f7fd406e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4034000 tx=0x7f7fe402e000 comp rx=0 tx=0).stop 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40cf190 msgr2=0x7f7ff4149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40cf190 0x7f7ff4149070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00c7d0 tx=0x7f7fec00cc90 comp rx=0 tx=0).stop 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 shutdown_connections 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd406be30 0x7f7fd406e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ff40cf190 0x7f7ff4149070 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff40ae910 0x7f7ff4153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 --2- 172.21.15.79:0/4115161775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff406ea20 0x7f7ff409b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 >> 172.21.15.79:0/4115161775 conn(0x7f7ff40b19f0 msgr2=0x7f7ff4072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 shutdown_connections 2024-06-10T00:18:52.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.736+0000 7f7ff8c76640 1 -- 172.21.15.79:0/4115161775 wait complete. 2024-06-10T00:18:52.746 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-06-10T00:18:52.879 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0} 2024-06-10T00:18:52.879 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:18:52.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:18:52.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.981+0000 7f8de0858640 1 Processor -- start 2024-06-10T00:18:52.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.981+0000 7f8de0858640 1 -- start start 2024-06-10T00:18:52.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8de0858640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cd230 0x7f8ddc0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8de0858640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ddc0b3420 con 0x7f8ddc1553c0 2024-06-10T00:18:52.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8de0858640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ddc0cc750 con 0x7f8ddc0cec50 2024-06-10T00:18:52.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8de0858640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8ddc0cca30 con 0x7f8ddc0cd230 2024-06-10T00:18:52.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dda59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8ddc1553c0 0x7f8ddc15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36014/0 (socket says 172.21.15.79:36014) 2024-06-10T00:18:52.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dda59c640 1 -- 172.21.15.79:0/3974146063 learned_addr learned my addr 172.21.15.79:0/3974146063 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:52.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251596611 0 0) 0x7f8ddc0b3420 con 0x7f8ddc1553c0 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc8003520 con 0x7f8ddc1553c0 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd3fff640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cd230 0x7f8ddc0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1472957307 0 0) 0x7f8dc8003520 con 0x7f8ddc1553c0 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cd230 msgr2=0x7f8ddc0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cd230 0x7f8ddc0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 >> v1:172.21.15.117:6789/0 conn(0x7f8ddc0cec50 legacy=0x7f8ddc071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc0ccd10 con 0x7f8ddc1553c0 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f8dcc001670 con 0x7f8ddc1553c0 2024-06-10T00:18:52.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.982+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 >> v1:172.21.15.79:6789/0 conn(0x7f8ddc1553c0 legacy=0x7f8ddc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd9d9b640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cd230 0x7f8dc80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd9d9b640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc8003f60 0x7f8dc8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd9d9b640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc8004d40 0x7f8dc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc0cca30 con 0x7f8dc8003f60 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc800baa0 con 0x7f8dc8004d40 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc800deb0 con 0x7f8ddc0cd230 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd3fff640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc8003f60 0x7f8dc8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dda59c640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cd230 0x7f8dc80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8ddad9d640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc8004d40 0x7f8dc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd3fff640 1 -- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cd230 msgr2=0x7f8dc80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd3fff640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cd230 0x7f8dc80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd3fff640 1 -- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc8004d40 msgr2=0x7f8dc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd3fff640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc8004d40 0x7f8dc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8dd3fff640 1 -- 172.21.15.79:0/3974146063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc8003520 con 0x7f8dc8003f60 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.983+0000 7f8ddad9d640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc8004d40 0x7f8dc80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8dd3fff640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc8003f60 0x7f8dc8004800 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009ac0 tx=0x7f8dc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d7950e0d99a33d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4036070 con 0x7f8dc8003f60 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc4031400 con 0x7f8dc8003f60 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8dd9d9b640 1 -- 172.21.15.79:0/3974146063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4009690 con 0x7f8dc8003f60 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8de0858640 1 -- 172.21.15.79:0/3974146063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc8003f60 msgr2=0x7f8dc8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8de0858640 1 --2- 172.21.15.79:0/3974146063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc8003f60 0x7f8dc8004800 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009ac0 tx=0x7f8dc8005830 comp rx=0 tx=0).stop 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8ddad9d640 1 -- 172.21.15.79:0/3974146063 reap_dead start 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8de0858640 1 -- 172.21.15.79:0/3974146063 shutdown_connections 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8de0858640 1 -- 172.21.15.79:0/3974146063 >> 172.21.15.79:0/3974146063 conn(0x7f8ddc0b19f0 msgr2=0x7f8ddc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:52.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8de0858640 1 -- 172.21.15.79:0/3974146063 shutdown_connections 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.984+0000 7f8de0858640 1 -- 172.21.15.79:0/3974146063 wait complete. 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8de0858640 1 Processor -- start 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8de0858640 1 -- start start 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8de0858640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc8003f60 0x7f8ddc1e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8de0858640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc1e19f0 0x7f8ddc0b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8de0858640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ddc1f3cd0 0x7f8ddc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8de0858640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc155920 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8de0858640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1557a0 con 0x7f8ddc1e19f0 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8de0858640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8ddc0b2cf0 con 0x7f8dc8003f60 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.986+0000 7f8ddad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ddc1f3cd0 0x7f8ddc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8ddad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ddc1f3cd0 0x7f8ddc0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34812/0 (socket says 172.21.15.79:34812) 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8ddad9d640 1 -- 172.21.15.79:0/2826032549 learned_addr learned my addr 172.21.15.79:0/2826032549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8dda59c640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc8003f60 0x7f8ddc1e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8dd3fff640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc1e19f0 0x7f8ddc0b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8ddad9d640 1 -- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc8003f60 msgr2=0x7f8ddc1e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8ddad9d640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc8003f60 0x7f8ddc1e14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8ddad9d640 1 -- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc1e19f0 msgr2=0x7f8ddc0b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8ddad9d640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc1e19f0 0x7f8ddc0b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8ddad9d640 1 -- 172.21.15.79:0/2826032549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc09cd70 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8dda59c640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc8003f60 0x7f8ddc1e14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8dd3fff640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc1e19f0 0x7f8ddc0b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8ddad9d640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ddc1f3cd0 0x7f8ddc0b0d10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4000f80 tx=0x7f8dd400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8dd2ffd640 1 -- 172.21.15.79:0/2826032549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4006b50 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8dd2ffd640 1 -- 172.21.15.79:0/2826032549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd4006d10 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc1f3210 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8dd2ffd640 1 -- 172.21.15.79:0/2826032549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4003970 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.987+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc1f34d0 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.988+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ddc068430 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.989+0000 7f8dd2ffd640 1 -- 172.21.15.79:0/2826032549 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8dd401a020 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.989+0000 7f8dd2ffd640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8dbc06be60 0x7f8dbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:52.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.989+0000 7f8dda59c640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8dbc06be60 0x7f8dbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:52.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.989+0000 7f8dd2ffd640 1 -- 172.21.15.79:0/2826032549 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8dd408a720 con 0x7f8ddc1f3cd0 2024-06-10T00:18:52.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.990+0000 7f8dda59c640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8dbc06be60 0x7f8dbc06e320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc007d70 tx=0x7f8dcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:52.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:52.993+0000 7f8dd2ffd640 1 -- 172.21.15.79:0/2826032549 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8dd4058ee0 con 0x7f8ddc1f3cd0 2024-06-10T00:18:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.209+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8ddc15b260 con 0x7f8ddc1f3cd0 2024-06-10T00:18:53.209 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:18:53.209+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:18:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.210+0000 7f8dd2ffd640 1 -- 172.21.15.79:0/2826032549 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7f8dd40587e0 con 0x7f8ddc1f3cd0 2024-06-10T00:18:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:18:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8dbc06be60 msgr2=0x7f8dbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8dbc06be60 0x7f8dbc06e320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc007d70 tx=0x7f8dcc009040 comp rx=0 tx=0).stop 2024-06-10T00:18:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ddc1f3cd0 msgr2=0x7f8ddc0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ddc1f3cd0 0x7f8ddc0b0d10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4000f80 tx=0x7f8dd400eb90 comp rx=0 tx=0).stop 2024-06-10T00:18:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 shutdown_connections 2024-06-10T00:18:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8dbc06be60 0x7f8dbc06e320 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ddc1f3cd0 0x7f8ddc0b0d10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc1e19f0 0x7f8ddc0b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 --2- 172.21.15.79:0/2826032549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc8003f60 0x7f8ddc1e14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 >> 172.21.15.79:0/2826032549 conn(0x7f8ddc0b19f0 msgr2=0x7f8ddc0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 shutdown_connections 2024-06-10T00:18:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.214+0000 7f8de0858640 1 -- 172.21.15.79:0/2826032549 wait complete. 2024-06-10T00:18:53.215 INFO:tasks.ceph.mds.c.smithi079.stderr: -3285> 2024-06-10T00:18:46.308+0000 7f38bb49f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:18:53.226 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-06-10T00:18:53.245 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:18:53.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.272+0000 7fa2e0445f40 1 Processor -- start 2024-06-10T00:18:53.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.272+0000 7fa2e0445f40 1 -- start start 2024-06-10T00:18:53.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2e0445f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26eff2c0 0x55ee26f2dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2e0445f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26f2e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2e0445f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26fbad00 0x55ee26fb81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2e0445f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ee26ea7e30 con 0x55ee26f4a010 2024-06-10T00:18:53.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2e0445f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ee26eabe70 con 0x55ee26fbad00 2024-06-10T00:18:53.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2e0445f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ee26f4a420 con 0x55ee26eff2c0 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26f2e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26f2e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34832/0 (socket says 172.21.15.79:34832) 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2d7fff640 1 -- 172.21.15.79:0/522052215 learned_addr learned my addr 172.21.15.79:0/522052215 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2de747640 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26fbad00 0x55ee26fb81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2ddf46640 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26eff2c0 0x55ee26f2dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2d7fff640 1 -- 172.21.15.79:0/522052215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26eff2c0 msgr2=0x55ee26f2dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2d7fff640 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26eff2c0 0x55ee26f2dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2d7fff640 1 -- 172.21.15.79:0/522052215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26fbad00 msgr2=0x55ee26fb81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2d7fff640 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26fbad00 0x55ee26fb81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.273+0000 7fa2d7fff640 1 -- 172.21.15.79:0/522052215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee26f2c3c0 con 0x55ee26f4a010 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2d7fff640 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26f2e400 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b2c0 tx=0x7fa2c800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc98dbe65cb9e67c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2dcf44640 1 -- 172.21.15.79:0/522052215 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8008070 con 0x55ee26f4a010 2024-06-10T00:18:53.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2dcf44640 1 -- 172.21.15.79:0/522052215 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c800d500 con 0x55ee26f4a010 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2dcf44640 1 -- 172.21.15.79:0/522052215 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800d930 con 0x55ee26f4a010 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 -- 172.21.15.79:0/522052215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 msgr2=0x55ee26f2e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26f2e400 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b2c0 tx=0x7fa2c800b780 comp rx=0 tx=0).stop 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 -- 172.21.15.79:0/522052215 shutdown_connections 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26fbad00 0x55ee26fb81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26f2e400 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 --2- 172.21.15.79:0/522052215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26eff2c0 0x55ee26f2dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 -- 172.21.15.79:0/522052215 >> 172.21.15.79:0/522052215 conn(0x55ee26f01280 msgr2=0x55ee26f2a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 -- 172.21.15.79:0/522052215 shutdown_connections 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.274+0000 7fa2e0445f40 1 -- 172.21.15.79:0/522052215 wait complete. 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.275+0000 7fa2e0445f40 1 Processor -- start 2024-06-10T00:18:53.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.275+0000 7fa2e0445f40 1 -- start start 2024-06-10T00:18:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.275+0000 7fa2e0445f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26eff2c0 0x55ee26fb4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.275+0000 7fa2e0445f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26fd8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.275+0000 7fa2e0445f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26fbad00 0x55ee26fd85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.275+0000 7fa2e0445f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ee26fb9ee0 con 0x55ee26f4a010 2024-06-10T00:18:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.275+0000 7fa2e0445f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ee26f30240 con 0x55ee26eff2c0 2024-06-10T00:18:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.275+0000 7fa2e0445f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ee26fdad00 con 0x55ee26fbad00 2024-06-10T00:18:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26fd8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26fd8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34834/0 (socket says 172.21.15.79:34834) 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 -- 172.21.15.79:0/1730973213 learned_addr learned my addr 172.21.15.79:0/1730973213 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2ddf46640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26eff2c0 0x55ee26fb4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2de747640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26fbad00 0x55ee26fd85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 -- 172.21.15.79:0/1730973213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26fbad00 msgr2=0x55ee26fd85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ee26fbad00 0x55ee26fd85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 -- 172.21.15.79:0/1730973213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26eff2c0 msgr2=0x55ee26fb4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ee26eff2c0 0x55ee26fb4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 -- 172.21.15.79:0/1730973213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee26f2fb50 con 0x55ee26f4a010 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d7fff640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26fd8070 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8000c00 tx=0x7fa2c8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d6ffd640 1 -- 172.21.15.79:0/1730973213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80012b0 con 0x55ee26f4a010 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d6ffd640 1 -- 172.21.15.79:0/1730973213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c8020070 con 0x55ee26f4a010 2024-06-10T00:18:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2d6ffd640 1 -- 172.21.15.79:0/1730973213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800fc70 con 0x55ee26f4a010 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee26fd21b0 con 0x55ee26f4a010 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.276+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee26f2f870 con 0x55ee26f4a010 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.278+0000 7fa2d6ffd640 1 -- 172.21.15.79:0/1730973213 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2c8017040 con 0x55ee26f4a010 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.278+0000 7fa2d6ffd640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2c006a840 0x7fa2c006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.278+0000 7fa2d6ffd640 1 -- 172.21.15.79:0/1730973213 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fa2c808bfd0 con 0x55ee26f4a010 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.278+0000 7fa2ddf46640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2c006a840 0x7fa2c006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.278+0000 7fa2e0445f40 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ee26fcfcd0 0x55ee26fd4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.278+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76) -- 0x55ee26fd4c90 con 0x55ee26fcfcd0 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.278+0000 7fa2de747640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ee26fcfcd0 0x55ee26fd4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.278+0000 7fa2ddf46640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2c006a840 0x7fa2c006cd00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0057000 tx=0x7fa2d0052000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.279+0000 7fa2de747640 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ee26fcfcd0 0x55ee26fd4750 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2de747640 1 -- 172.21.15.79:0/1730973213 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v76'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa2d80038b0 con 0x55ee26fcfcd0 2024-06-10T00:18:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ee26fcfcd0 msgr2=0x55ee26fd4750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ee26fcfcd0 0x55ee26fd4750 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2c006a840 msgr2=0x7fa2c006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2c006a840 0x7fa2c006cd00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0057000 tx=0x7fa2d0052000 comp rx=0 tx=0).stop 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 msgr2=0x55ee26fd8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 --2- 172.21.15.79:0/1730973213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee26f4a010 0x55ee26fd8070 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8000c00 tx=0x7fa2c8000ed0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2de747640 1 -- 172.21.15.79:0/1730973213 reap_dead start 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 shutdown_connections 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 >> 172.21.15.79:0/1730973213 conn(0x55ee26f01280 msgr2=0x55ee26efe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 shutdown_connections 2024-06-10T00:18:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.280+0000 7fa2e0445f40 1 -- 172.21.15.79:0/1730973213 wait complete. 2024-06-10T00:18:53.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-06-10T00:18:53.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.427+0000 7f296cf1b640 1 Processor -- start 2024-06-10T00:18:53.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.427+0000 7f296cf1b640 1 -- start start 2024-06-10T00:18:53.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296cf1b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29680d08f0 0x7f29680b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296cf1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d0cd0 0x7f29680cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296cf1b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29680cf190 0x7f29680d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296cf1b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f29680d1c80 con 0x7f29680d08f0 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296cf1b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f29680cf620 con 0x7f29680cf190 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296cf1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29680cf8a0 con 0x7f29680d0cd0 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29680d08f0 0x7f29680b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29680d08f0 0x7f29680b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34844/0 (socket says 172.21.15.79:34844) 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.428+0000 7f296659c640 1 -- 172.21.15.79:0/1870015658 learned_addr learned my addr 172.21.15.79:0/1870015658 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.429+0000 7f296659c640 1 -- 172.21.15.79:0/1870015658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d0cd0 msgr2=0x7f29680cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.429+0000 7f296659c640 1 --2- 172.21.15.79:0/1870015658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d0cd0 0x7f29680cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.429+0000 7f296659c640 1 -- 172.21.15.79:0/1870015658 >> v2:172.21.15.117:3300/0 conn(0x7f29680cf190 msgr2=0x7f29680d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.429+0000 7f2966d9d640 1 --2- 172.21.15.79:0/1870015658 >> v2:172.21.15.117:3300/0 conn(0x7f29680cf190 0x7f29680d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.429+0000 7f296659c640 1 --2- 172.21.15.79:0/1870015658 >> v2:172.21.15.117:3300/0 conn(0x7f29680cf190 0x7f29680d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.429+0000 7f296659c640 1 -- 172.21.15.79:0/1870015658 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29680cfb80 con 0x7f29680d08f0 2024-06-10T00:18:53.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.429+0000 7f296659c640 1 --2- 172.21.15.79:0/1870015658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680d08f0 0x7f29680b3800 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f29680d1c10 tx=0x7f295802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827a3681413a15ab server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296559a640 1 -- 172.21.15.79:0/1870015658 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958036070 con 0x7f29680d08f0 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296559a640 1 -- 172.21.15.79:0/1870015658 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2958031600 con 0x7f29680d08f0 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296559a640 1 -- 172.21.15.79:0/1870015658 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29580319d0 con 0x7f29680d08f0 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 -- 172.21.15.79:0/1870015658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680d08f0 msgr2=0x7f29680b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 --2- 172.21.15.79:0/1870015658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680d08f0 0x7f29680b3800 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f29680d1c10 tx=0x7f295802a6a0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 -- 172.21.15.79:0/1870015658 shutdown_connections 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 --2- 172.21.15.79:0/1870015658 >> v2:172.21.15.117:3300/0 conn(0x7f29680cf190 0x7f29680d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 --2- 172.21.15.79:0/1870015658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d0cd0 0x7f29680cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 --2- 172.21.15.79:0/1870015658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680d08f0 0x7f29680b3800 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 -- 172.21.15.79:0/1870015658 >> 172.21.15.79:0/1870015658 conn(0x7f296809d3c0 msgr2=0x7f29680d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 -- 172.21.15.79:0/1870015658 shutdown_connections 2024-06-10T00:18:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.430+0000 7f296cf1b640 1 -- 172.21.15.79:0/1870015658 wait complete. 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296cf1b640 1 Processor -- start 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296cf1b640 1 -- start start 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296cf1b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680cf190 0x7f29680c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296cf1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d08f0 0x7f29681f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296cf1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29680d0cd0 0x7f2968149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296cf1b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29680b50c0 con 0x7f29680cf190 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296cf1b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29680d1ed0 con 0x7f29680d0cd0 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296cf1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29680d1150 con 0x7f29680d08f0 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680cf190 0x7f29680c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680cf190 0x7f29680c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34858/0 (socket says 172.21.15.79:34858) 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.432+0000 7f296659c640 1 -- 172.21.15.79:0/561859935 learned_addr learned my addr 172.21.15.79:0/561859935 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f2966d9d640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29680d0cd0 0x7f2968149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f2965d9b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d08f0 0x7f29681f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f296659c640 1 -- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d08f0 msgr2=0x7f29681f3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f296659c640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d08f0 0x7f29681f3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f296659c640 1 -- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29680d0cd0 msgr2=0x7f2968149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f296659c640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29680d0cd0 0x7f2968149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f296659c640 1 -- 172.21.15.79:0/561859935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29680c8120 con 0x7f29680cf190 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f2965d9b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d08f0 0x7f29681f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f2966d9d640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29680d0cd0 0x7f2968149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f296659c640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680cf190 0x7f29680c7be0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2958034040 tx=0x7f2958004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f295effd640 1 -- 172.21.15.79:0/561859935 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958036050 con 0x7f29680cf190 2024-06-10T00:18:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f295effd640 1 -- 172.21.15.79:0/561859935 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2958042070 con 0x7f29680cf190 2024-06-10T00:18:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29680ca0a0 con 0x7f29680cf190 2024-06-10T00:18:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f295effd640 1 -- 172.21.15.79:0/561859935 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958009510 con 0x7f29680cf190 2024-06-10T00:18:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.433+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29680ca620 con 0x7f29680cf190 2024-06-10T00:18:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.434+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29680683c0 con 0x7f29680cf190 2024-06-10T00:18:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.435+0000 7f295effd640 1 -- 172.21.15.79:0/561859935 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2958007c70 con 0x7f29680cf190 2024-06-10T00:18:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.435+0000 7f295effd640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294806be30 0x7f294806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.435+0000 7f295effd640 1 -- 172.21.15.79:0/561859935 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f29580ac030 con 0x7f29680cf190 2024-06-10T00:18:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.435+0000 7f2965d9b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294806be30 0x7f294806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.436+0000 7f2965d9b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294806be30 0x7f294806e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2950006fd0 tx=0x7f2950008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.439+0000 7f295effd640 1 -- 172.21.15.79:0/561859935 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f295807a800 con 0x7f29680cf190 2024-06-10T00:18:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.651+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f29680b3360 con 0x7f29680cf190 2024-06-10T00:18:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.808+0000 7f295effd640 1 -- 172.21.15.79:0/561859935 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v39) ==== 162+0+0 (secure 0 0 0) 0x7f295807a100 con 0x7f29680cf190 2024-06-10T00:18:53.807 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-06-10T00:18:53.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294806be30 msgr2=0x7f294806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294806be30 0x7f294806e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2950006fd0 tx=0x7f2950008040 comp rx=0 tx=0).stop 2024-06-10T00:18:53.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680cf190 msgr2=0x7f29680c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680cf190 0x7f29680c7be0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2958034040 tx=0x7f2958004a40 comp rx=0 tx=0).stop 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 shutdown_connections 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f294806be30 0x7f294806e2f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29680d0cd0 0x7f2968149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29680d08f0 0x7f29681f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 --2- 172.21.15.79:0/561859935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29680cf190 0x7f29680c7be0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 >> 172.21.15.79:0/561859935 conn(0x7f296809d3c0 msgr2=0x7f29680d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 shutdown_connections 2024-06-10T00:18:53.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.810+0000 7f296cf1b640 1 -- 172.21.15.79:0/561859935 wait complete. 2024-06-10T00:18:53.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:53.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.921+0000 7fcb69cee640 1 Processor -- start 2024-06-10T00:18:53.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.921+0000 7fcb69cee640 1 -- start start 2024-06-10T00:18:53.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb69cee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb64156830 0x7fcb64071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb69cee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb64165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb69cee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb640725f0 con 0x7fcb64072130 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb69cee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcb640b3090 con 0x7fcb64156830 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb69cee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb640728d0 con 0x7fcb6415c7f0 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb62ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcb64072130 0x7fcb640cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36038/0 (socket says 172.21.15.79:36038) 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb62ffd640 1 -- 172.21.15.79:0/412798394 learned_addr learned my addr 172.21.15.79:0/412798394 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb63fff640 1 --2- 172.21.15.79:0/412798394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb64165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb637fe640 1 --2- 172.21.15.79:0/412798394 >> v2:172.21.15.117:3300/0 conn(0x7fcb64156830 0x7fcb64071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb627fc640 1 -- 172.21.15.79:0/412798394 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223243136 0 0) 0x7fcb640725f0 con 0x7fcb64072130 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.922+0000 7fcb627fc640 1 -- 172.21.15.79:0/412798394 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb4c003520 con 0x7fcb64072130 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.923+0000 7fcb63fff640 1 -- 172.21.15.79:0/412798394 >> v2:172.21.15.117:3300/0 conn(0x7fcb64156830 msgr2=0x7fcb64071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.923+0000 7fcb63fff640 1 --2- 172.21.15.79:0/412798394 >> v2:172.21.15.117:3300/0 conn(0x7fcb64156830 0x7fcb64071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.923+0000 7fcb63fff640 1 -- 172.21.15.79:0/412798394 >> v1:172.21.15.79:6789/0 conn(0x7fcb64072130 legacy=0x7fcb640cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.923+0000 7fcb627fc640 1 -- 172.21.15.79:0/412798394 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2556761811 0 0) 0x7fcb4c003520 con 0x7fcb64072130 2024-06-10T00:18:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.923+0000 7fcb63fff640 1 -- 172.21.15.79:0/412798394 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb64072bb0 con 0x7fcb6415c7f0 2024-06-10T00:18:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.923+0000 7fcb637fe640 1 --2- 172.21.15.79:0/412798394 >> v2:172.21.15.117:3300/0 conn(0x7fcb64156830 0x7fcb64071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:18:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.923+0000 7fcb63fff640 1 --2- 172.21.15.79:0/412798394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb64165cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009d90 tx=0x7fcb5c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f43a803b888b505a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.923+0000 7fcb627fc640 1 -- 172.21.15.79:0/412798394 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58001670 con 0x7fcb6415c7f0 2024-06-10T00:18:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb627fc640 1 -- 172.21.15.79:0/412798394 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c007540 con 0x7fcb6415c7f0 2024-06-10T00:18:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb627fc640 1 -- 172.21.15.79:0/412798394 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c007910 con 0x7fcb6415c7f0 2024-06-10T00:18:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb69cee640 1 -- 172.21.15.79:0/412798394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 msgr2=0x7fcb64165cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb69cee640 1 --2- 172.21.15.79:0/412798394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb64165cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009d90 tx=0x7fcb5c02a5f0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb69cee640 1 -- 172.21.15.79:0/412798394 shutdown_connections 2024-06-10T00:18:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb69cee640 1 --2- 172.21.15.79:0/412798394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb64165cc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb69cee640 1 --2- 172.21.15.79:0/412798394 >> v2:172.21.15.117:3300/0 conn(0x7fcb64156830 0x7fcb64071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb69cee640 1 -- 172.21.15.79:0/412798394 >> 172.21.15.79:0/412798394 conn(0x7fcb640b19f0 msgr2=0x7fcb640b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb69cee640 1 -- 172.21.15.79:0/412798394 shutdown_connections 2024-06-10T00:18:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.924+0000 7fcb69cee640 1 -- 172.21.15.79:0/412798394 wait complete. 2024-06-10T00:18:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.925+0000 7fcb69cee640 1 Processor -- start 2024-06-10T00:18:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.925+0000 7fcb69cee640 1 -- start start 2024-06-10T00:18:53.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb69cee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb64072130 0x7fcb640d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb69cee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb64156830 0x7fcb64147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb69cee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb641586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb69cee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb640ccf00 con 0x7fcb64156830 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb69cee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb640ccd80 con 0x7fcb64072130 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb69cee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb640cd080 con 0x7fcb6415c7f0 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb62ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb64156830 0x7fcb64147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb62ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb64156830 0x7fcb64147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34866/0 (socket says 172.21.15.79:34866) 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb62ffd640 1 -- 172.21.15.79:0/4110338884 learned_addr learned my addr 172.21.15.79:0/4110338884 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb637fe640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb64072130 0x7fcb640d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.926+0000 7fcb63fff640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb641586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb62ffd640 1 -- 172.21.15.79:0/4110338884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 msgr2=0x7fcb641586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb62ffd640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb641586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb62ffd640 1 -- 172.21.15.79:0/4110338884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb64072130 msgr2=0x7fcb640d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb62ffd640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb64072130 0x7fcb640d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb62ffd640 1 -- 172.21.15.79:0/4110338884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb640d0a30 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb62ffd640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb64156830 0x7fcb64147620 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800c780 tx=0x7fcb5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb4bfff640 1 -- 172.21.15.79:0/4110338884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58017070 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb4bfff640 1 -- 172.21.15.79:0/4110338884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb58005ad0 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6415abf0 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb4bfff640 1 -- 172.21.15.79:0/4110338884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58007070 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.927+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6415b1b0 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.928+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb64071520 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.928+0000 7fcb4bfff640 1 -- 172.21.15.79:0/4110338884 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb5801a070 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.929+0000 7fcb4bfff640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5006be30 0x7fcb5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.929+0000 7fcb4bfff640 1 -- 172.21.15.79:0/4110338884 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fcb5808a470 con 0x7fcb64156830 2024-06-10T00:18:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.929+0000 7fcb637fe640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5006be30 0x7fcb5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:53.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.929+0000 7fcb637fe640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5006be30 0x7fcb5006e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009560 tx=0x7fcb54009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:53.933+0000 7fcb4bfff640 1 -- 172.21.15.79:0/4110338884 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcb64071520 con 0x7fcb64156830 2024-06-10T00:18:54.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.142+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb6415ecf0 con 0x7fcb64156830 2024-06-10T00:18:54.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.142+0000 7fcb4bfff640 1 -- 172.21.15.79:0/4110338884 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5177 (secure 0 0 0) 0x7fcb58058680 con 0x7fcb64156830 2024-06-10T00:18:54.142 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:54.142 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:18:53.807151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-06-10T00:18:54.142 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 39 2024-06-10T00:18:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5006be30 msgr2=0x7fcb5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5006be30 0x7fcb5006e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009560 tx=0x7fcb54009190 comp rx=0 tx=0).stop 2024-06-10T00:18:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb64156830 msgr2=0x7fcb64147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb64156830 0x7fcb64147620 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800c780 tx=0x7fcb5800cc40 comp rx=0 tx=0).stop 2024-06-10T00:18:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 shutdown_connections 2024-06-10T00:18:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5006be30 0x7fcb5006e2f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6415c7f0 0x7fcb641586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb64156830 0x7fcb64147620 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:54.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 --2- 172.21.15.79:0/4110338884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb64072130 0x7fcb640d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:54.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 >> 172.21.15.79:0/4110338884 conn(0x7fcb640b19f0 msgr2=0x7fcb640b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:54.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 shutdown_connections 2024-06-10T00:18:54.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:54.144+0000 7fcb69cee640 1 -- 172.21.15.79:0/4110338884 wait complete. 2024-06-10T00:18:54.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:18:44.456453+0000', 'modified': '2024-06-10T00:18:53.807151+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6471}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6471': {'gid': 6471, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6835/2491534848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2491534848}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 2491534848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:18:54.557 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6471:up:replay 2024-06-10T00:18:55.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.670+0000 7fddeea72640 1 Processor -- start 2024-06-10T00:18:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.670+0000 7fddeea72640 1 -- start start 2024-06-10T00:18:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fddeea72640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdde80ae910 0x7fdde806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fddeea72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdde80cf360 0x7fdde80acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fddeea72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde806d130 con 0x7fdde806ea20 2024-06-10T00:18:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fddeea72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdde806ee90 con 0x7fdde80cf360 2024-06-10T00:18:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fddeea72640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdde806d410 con 0x7fdde80ae910 2024-06-10T00:18:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fdded00f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdde80cf360 0x7fdde80acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fdddffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdde806ea20 0x7fdde80cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36050/0 (socket says 172.21.15.79:36050) 2024-06-10T00:18:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fdddffff640 1 -- 172.21.15.79:0/582128850 learned_addr learned my addr 172.21.15.79:0/582128850 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fddec80e640 1 --2- 172.21.15.79:0/582128850 >> v2:172.21.15.117:3300/0 conn(0x7fdde80ae910 0x7fdde806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fdded00f640 1 -- 172.21.15.79:0/582128850 >> v2:172.21.15.117:3300/0 conn(0x7fdde80ae910 msgr2=0x7fdde806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fdded00f640 1 --2- 172.21.15.79:0/582128850 >> v2:172.21.15.117:3300/0 conn(0x7fdde80ae910 0x7fdde806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fdded00f640 1 -- 172.21.15.79:0/582128850 >> v1:172.21.15.79:6789/0 conn(0x7fdde806ea20 legacy=0x7fdde80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fdddf7fe640 1 -- 172.21.15.79:0/582128850 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 78803573 0 0) 0x7fdde806d130 con 0x7fdde806ea20 2024-06-10T00:18:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.671+0000 7fdded00f640 1 -- 172.21.15.79:0/582128850 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde806d6f0 con 0x7fdde80cf360 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.672+0000 7fdded00f640 1 --2- 172.21.15.79:0/582128850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde80acd40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdde80750b0 tx=0x7fdde002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38af91023a287b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.672+0000 7fdddf7fe640 1 -- 172.21.15.79:0/582128850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0007740 con 0x7fdde80cf360 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.672+0000 7fdddf7fe640 1 -- 172.21.15.79:0/582128850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde00078e0 con 0x7fdde80cf360 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.672+0000 7fdddf7fe640 1 -- 172.21.15.79:0/582128850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0007cb0 con 0x7fdde80cf360 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.673+0000 7fddeea72640 1 -- 172.21.15.79:0/582128850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 msgr2=0x7fdde80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.673+0000 7fddeea72640 1 --2- 172.21.15.79:0/582128850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde80acd40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdde80750b0 tx=0x7fdde002a5f0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.673+0000 7fddeea72640 1 -- 172.21.15.79:0/582128850 shutdown_connections 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.673+0000 7fddeea72640 1 --2- 172.21.15.79:0/582128850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde80acd40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.673+0000 7fddeea72640 1 --2- 172.21.15.79:0/582128850 >> v2:172.21.15.117:3300/0 conn(0x7fdde80ae910 0x7fdde806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.673+0000 7fddeea72640 1 -- 172.21.15.79:0/582128850 >> 172.21.15.79:0/582128850 conn(0x7fdde80b19f0 msgr2=0x7fdde80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.673+0000 7fddeea72640 1 -- 172.21.15.79:0/582128850 shutdown_connections 2024-06-10T00:18:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.673+0000 7fddeea72640 1 -- 172.21.15.79:0/582128850 wait complete. 2024-06-10T00:18:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.674+0000 7fddeea72640 1 Processor -- start 2024-06-10T00:18:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.674+0000 7fddeea72640 1 -- start start 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fddeea72640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdde806ea20 0x7fdde814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fddeea72640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdde80ae910 0x7fdde8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fddeea72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde8071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fddeea72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80ad280 con 0x7fdde80cf360 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fddeea72640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80aecf0 con 0x7fdde806ea20 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fddeea72640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdde80ad400 con 0x7fdde80ae910 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdded00f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde8071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdded00f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde8071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34886/0 (socket says 172.21.15.79:34886) 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdded00f640 1 -- 172.21.15.79:0/3762527769 learned_addr learned my addr 172.21.15.79:0/3762527769 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fddec80e640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdde806ea20 0x7fdde814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdddffff640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdde80ae910 0x7fdde8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdded00f640 1 -- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdde80ae910 msgr2=0x7fdde8071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdded00f640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdde80ae910 0x7fdde8071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdded00f640 1 -- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdde806ea20 msgr2=0x7fdde814d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdded00f640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdde806ea20 0x7fdde814d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdded00f640 1 -- 172.21.15.79:0/3762527769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde8159ba0 con 0x7fdde80cf360 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.675+0000 7fdddffff640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdde80ae910 0x7fdde8071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.676+0000 7fdded00f640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde8071ff0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009e80 tx=0x7fdde0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.676+0000 7fdddd7fa640 1 -- 172.21.15.79:0/3762527769 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0040070 con 0x7fdde80cf360 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.676+0000 7fdddd7fa640 1 -- 172.21.15.79:0/3762527769 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde0031c40 con 0x7fdde80cf360 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.676+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde809b770 con 0x7fdde80cf360 2024-06-10T00:18:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.676+0000 7fdddd7fa640 1 -- 172.21.15.79:0/3762527769 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0009450 con 0x7fdde80cf360 2024-06-10T00:18:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.676+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde809bd30 con 0x7fdde80cf360 2024-06-10T00:18:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.677+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde8068430 con 0x7fdde80cf360 2024-06-10T00:18:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.677+0000 7fdddd7fa640 1 -- 172.21.15.79:0/3762527769 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdde0039040 con 0x7fdde80cf360 2024-06-10T00:18:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.678+0000 7fdddd7fa640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fddd406be30 0x7fddd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.678+0000 7fddec80e640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fddd406be30 0x7fddd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.678+0000 7fdddd7fa640 1 -- 172.21.15.79:0/3762527769 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fdde00ac1e0 con 0x7fdde80cf360 2024-06-10T00:18:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.678+0000 7fddec80e640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fddd406be30 0x7fddd406e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdde4006fd0 tx=0x7fdde4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.682+0000 7fdddd7fa640 1 -- 172.21.15.79:0/3762527769 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdde007a370 con 0x7fdde80cf360 2024-06-10T00:18:55.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.894+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdde815aae0 con 0x7fdde80cf360 2024-06-10T00:18:55.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.895+0000 7fdddd7fa640 1 -- 172.21.15.79:0/3762527769 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5177 (secure 0 0 0) 0x7fdde007e670 con 0x7fdde80cf360 2024-06-10T00:18:55.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:55.895 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:18:54.811835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-06-10T00:18:55.895 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 41 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fddd406be30 msgr2=0x7fddd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fddd406be30 0x7fddd406e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdde4006fd0 tx=0x7fdde4008040 comp rx=0 tx=0).stop 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 msgr2=0x7fdde8071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde8071ff0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009e80 tx=0x7fdde0004a40 comp rx=0 tx=0).stop 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 shutdown_connections 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fddd406be30 0x7fddd406e2f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80cf360 0x7fdde8071ff0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdde80ae910 0x7fdde8071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 --2- 172.21.15.79:0/3762527769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdde806ea20 0x7fdde814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:55.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 >> 172.21.15.79:0/3762527769 conn(0x7fdde80b19f0 msgr2=0x7fdde8072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:55.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 shutdown_connections 2024-06-10T00:18:55.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:55.897+0000 7fddeea72640 1 -- 172.21.15.79:0/3762527769 wait complete. 2024-06-10T00:18:56.310 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:18:44.456453+0000', 'modified': '2024-06-10T00:18:54.811835+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6471}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6471': {'gid': 6471, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6835/2491534848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2491534848}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 2491534848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:18:56.310 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6471:up:rejoin 2024-06-10T00:18:57.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:18:57.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.422+0000 7efee4aca640 1 Processor -- start 2024-06-10T00:18:57.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.422+0000 7efee4aca640 1 -- start start 2024-06-10T00:18:57.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.423+0000 7efee4aca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efee015f1a0 0x7efee00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:57.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.423+0000 7efee4aca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee015f5e0 con 0x7efee00cef70 2024-06-10T00:18:57.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.423+0000 7efee4aca640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee00d0ad0 con 0x7efee00d2680 2024-06-10T00:18:57.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.423+0000 7efee4aca640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efee00d13e0 con 0x7efee015f1a0 2024-06-10T00:18:57.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efeded9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efee00cef70 0x7efee00cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36054/0 (socket says 172.21.15.79:36054) 2024-06-10T00:18:57.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efeded9d640 1 -- 172.21.15.79:0/3082027226 learned_addr learned my addr 172.21.15.79:0/3082027226 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:18:57.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efeddd9b640 1 --2- 172.21.15.79:0/3082027226 >> v2:172.21.15.117:3300/0 conn(0x7efee015f1a0 0x7efee00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:57.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111315598 0 0) 0x7efee015f5e0 con 0x7efee00cef70 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efec8003520 con 0x7efee00cef70 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3173914932 0 0) 0x7efee00d0ad0 con 0x7efee00d2680 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee015f5e0 con 0x7efee00d2680 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2953760970 0 0) 0x7efec8003520 con 0x7efee00cef70 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 >> v2:172.21.15.117:3300/0 conn(0x7efee015f1a0 msgr2=0x7efee00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 --2- 172.21.15.79:0/3082027226 >> v2:172.21.15.117:3300/0 conn(0x7efee015f1a0 0x7efee00d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 >> v1:172.21.15.117:6789/0 conn(0x7efee00d2680 legacy=0x7efee00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee015f890 con 0x7efee00cef70 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7efed8001670 con 0x7efee00cef70 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 >> v1:172.21.15.79:6789/0 conn(0x7efee00cef70 legacy=0x7efee00cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec8003b90 0x7efec8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec8004800 0x7efec8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec80051c0 0x7efec800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:57.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efee00d13e0 con 0x7efec8004800 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efec800c090 con 0x7efec8003b90 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efec800c290 con 0x7efec80051c0 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efeddd9b640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec8004800 0x7efec8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.424+0000 7efede59c640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec8003b90 0x7efec8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeded9d640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec80051c0 0x7efec800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeddd9b640 1 -- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec80051c0 msgr2=0x7efec800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeddd9b640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec80051c0 0x7efec800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeddd9b640 1 -- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec8003b90 msgr2=0x7efec8003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeddd9b640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec8003b90 0x7efec8003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeddd9b640 1 -- 172.21.15.79:0/3082027226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec8003520 con 0x7efec8004800 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeded9d640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec80051c0 0x7efec800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeded9d640 1 -- 172.21.15.79:0/3082027226 reap_dead start 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.425+0000 7efeddd9b640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec8004800 0x7efec8004c80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7efed4009ac0 tx=0x7efec8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef9367d7aee6763 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:57.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4036070 con 0x7efec8004800 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed4031400 con 0x7efec8004800 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efedd59a640 1 -- 172.21.15.79:0/3082027226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4009690 con 0x7efec8004800 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efee4aca640 1 -- 172.21.15.79:0/3082027226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec8004800 msgr2=0x7efec8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efee4aca640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec8004800 0x7efec8004c80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7efed4009ac0 tx=0x7efec8005830 comp rx=0 tx=0).stop 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efee4aca640 1 -- 172.21.15.79:0/3082027226 shutdown_connections 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efee4aca640 1 --2- 172.21.15.79:0/3082027226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efec8004800 0x7efec8004c80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efee4aca640 1 -- 172.21.15.79:0/3082027226 >> 172.21.15.79:0/3082027226 conn(0x7efee009d3f0 msgr2=0x7efee00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efee4aca640 1 -- 172.21.15.79:0/3082027226 shutdown_connections 2024-06-10T00:18:57.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.426+0000 7efee4aca640 1 -- 172.21.15.79:0/3082027226 wait complete. 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efee4aca640 1 Processor -- start 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efee4aca640 1 -- start start 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efee4aca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec8004800 0x7efee00ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efee4aca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efee0160dd0 0x7efee0161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efee4aca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00cc4b0 0x7efee00cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efee4aca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efee00d4f00 con 0x7efee00cc4b0 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efee4aca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efee00d1070 con 0x7efee0160dd0 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efee4aca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efee00d1870 con 0x7efec8004800 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efeded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00cc4b0 0x7efee00cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:57.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efeded9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00cc4b0 0x7efee00cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34898/0 (socket says 172.21.15.79:34898) 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.428+0000 7efeded9d640 1 -- 172.21.15.79:0/200087932 learned_addr learned my addr 172.21.15.79:0/200087932 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efede59c640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec8004800 0x7efee00ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeded9d640 1 -- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec8004800 msgr2=0x7efee00ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeddd9b640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efee0160dd0 0x7efee0161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeded9d640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec8004800 0x7efee00ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeded9d640 1 -- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efee0160dd0 msgr2=0x7efee0161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeded9d640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efee0160dd0 0x7efee0161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeded9d640 1 -- 172.21.15.79:0/200087932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee00cd260 con 0x7efee00cc4b0 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efede59c640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec8004800 0x7efee00ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeddd9b640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efee0160dd0 0x7efee0161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeded9d640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00cc4b0 0x7efee00cc930 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efee00d3d10 tx=0x7efed800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeceffd640 1 -- 172.21.15.79:0/200087932 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8019070 con 0x7efee00cc4b0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeceffd640 1 -- 172.21.15.79:0/200087932 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed8010510 con 0x7efee00cc4b0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efeceffd640 1 -- 172.21.15.79:0/200087932 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed80108e0 con 0x7efee00cc4b0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee00b86a0 con 0x7efee00cc4b0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.429+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee00b8c60 con 0x7efee00cc4b0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.430+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee0161770 con 0x7efee00cc4b0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.431+0000 7efeceffd640 1 -- 172.21.15.79:0/200087932 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efed801c070 con 0x7efee00cc4b0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.431+0000 7efeceffd640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efec006be30 0x7efec006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.431+0000 7efeceffd640 1 -- 172.21.15.79:0/200087932 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7efed808a440 con 0x7efee00cc4b0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.431+0000 7efede59c640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efec006be30 0x7efec006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:57.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.431+0000 7efede59c640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efec006be30 0x7efec006e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efed0003fc0 tx=0x7efed0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:57.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.435+0000 7efeceffd640 1 -- 172.21.15.79:0/200087932 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efed8058650 con 0x7efee00cc4b0 2024-06-10T00:18:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.643+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efee00d04e0 con 0x7efee00cc4b0 2024-06-10T00:18:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.643+0000 7efeceffd640 1 -- 172.21.15.79:0/200087932 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5184 (secure 0 0 0) 0x7efed805c950 con 0x7efee00cc4b0 2024-06-10T00:18:57.643 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:18:57.643 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:18:56.817646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6471,"qdb_cluster":[6471]},"id":5}]} 2024-06-10T00:18:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 42 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efec006be30 msgr2=0x7efec006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efec006be30 0x7efec006e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efed0003fc0 tx=0x7efed0009040 comp rx=0 tx=0).stop 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00cc4b0 msgr2=0x7efee00cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00cc4b0 0x7efee00cc930 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efee00d3d10 tx=0x7efed800e960 comp rx=0 tx=0).stop 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 shutdown_connections 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efec006be30 0x7efec006e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efee00cc4b0 0x7efee00cc930 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efee0160dd0 0x7efee0161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 --2- 172.21.15.79:0/200087932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec8004800 0x7efee00ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 >> 172.21.15.79:0/200087932 conn(0x7efee009d3f0 msgr2=0x7efee00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 shutdown_connections 2024-06-10T00:18:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:57.645+0000 7efee4aca640 1 -- 172.21.15.79:0/200087932 wait complete. 2024-06-10T00:18:58.058 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:18:44.456453+0000', 'modified': '2024-06-10T00:18:56.817646+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6471}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6471': {'gid': 6471, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6835/2491534848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2491534848}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 2491534848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6471, 'qdb_cluster': [6471]} 2024-06-10T00:18:58.058 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:18:58.059 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-10T00:18:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.161+0000 7ff18baee640 1 Processor -- start 2024-06-10T00:18:58.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.161+0000 7ff18baee640 1 -- start start 2024-06-10T00:18:58.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18baee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1840cc6d0 0x7ff1840ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18baee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff184072110 0x7ff1840b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18baee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1840ccff0 con 0x7ff184071c60 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18baee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff184072820 con 0x7ff1840cc6d0 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18baee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff184072b00 con 0x7ff184072110 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18988a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1840cc6d0 0x7ff1840ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18988a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1840cc6d0 0x7ff1840ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49730/0 (socket says 172.21.15.79:49730) 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18988a640 1 -- 172.21.15.79:0/231398401 learned_addr learned my addr 172.21.15.79:0/231398401 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18988a640 1 -- 172.21.15.79:0/231398401 >> v2:172.21.15.117:3300/0 conn(0x7ff184072110 msgr2=0x7ff1840b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18988a640 1 --2- 172.21.15.79:0/231398401 >> v2:172.21.15.117:3300/0 conn(0x7ff184072110 0x7ff1840b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18988a640 1 -- 172.21.15.79:0/231398401 >> v1:172.21.15.117:6789/0 conn(0x7ff184071c60 legacy=0x7ff1840b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.162+0000 7ff18988a640 1 -- 172.21.15.79:0/231398401 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff184072de0 con 0x7ff1840cc6d0 2024-06-10T00:18:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.163+0000 7ff18988a640 1 --2- 172.21.15.79:0/231398401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1840cc6d0 0x7ff1840ccab0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff1840af8f0 tx=0x7ff18002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70ae3917b9c0581 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.163+0000 7ff188888640 1 -- 172.21.15.79:0/231398401 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180037070 con 0x7ff1840cc6d0 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.163+0000 7ff188888640 1 -- 172.21.15.79:0/231398401 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff180032440 con 0x7ff1840cc6d0 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.163+0000 7ff188888640 1 -- 172.21.15.79:0/231398401 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180032810 con 0x7ff1840cc6d0 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.164+0000 7ff18baee640 1 -- 172.21.15.79:0/231398401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1840cc6d0 msgr2=0x7ff1840ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.164+0000 7ff18baee640 1 --2- 172.21.15.79:0/231398401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1840cc6d0 0x7ff1840ccab0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff1840af8f0 tx=0x7ff18002a230 comp rx=0 tx=0).stop 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.164+0000 7ff18baee640 1 -- 172.21.15.79:0/231398401 shutdown_connections 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.164+0000 7ff18baee640 1 --2- 172.21.15.79:0/231398401 >> v2:172.21.15.117:3300/0 conn(0x7ff184072110 0x7ff1840b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.164+0000 7ff18baee640 1 --2- 172.21.15.79:0/231398401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1840cc6d0 0x7ff1840ccab0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.164+0000 7ff18baee640 1 -- 172.21.15.79:0/231398401 >> 172.21.15.79:0/231398401 conn(0x7ff1840b19f0 msgr2=0x7ff1840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:58.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.164+0000 7ff18baee640 1 -- 172.21.15.79:0/231398401 shutdown_connections 2024-06-10T00:18:58.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.164+0000 7ff18baee640 1 -- 172.21.15.79:0/231398401 wait complete. 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.165+0000 7ff18baee640 1 Processor -- start 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.165+0000 7ff18baee640 1 -- start start 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff18baee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff184071c60 0x7ff184151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff18baee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff184072110 0x7ff1841f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff18baee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840cc6d0 0x7ff1840cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff18baee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff18415c890 con 0x7ff184072110 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff18baee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff184072540 con 0x7ff1840cc6d0 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff18baee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff184159f60 con 0x7ff184071c60 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff184072110 0x7ff1841f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff184072110 0x7ff1841f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49736/0 (socket says 172.21.15.79:49736) 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 -- 172.21.15.79:0/3789333657 learned_addr learned my addr 172.21.15.79:0/3789333657 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff18a08b640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840cc6d0 0x7ff1840cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff18988a640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff184071c60 0x7ff184151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 -- 172.21.15.79:0/3789333657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff184071c60 msgr2=0x7ff184151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff184071c60 0x7ff184151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 -- 172.21.15.79:0/3789333657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840cc6d0 msgr2=0x7ff1840cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840cc6d0 0x7ff1840cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 -- 172.21.15.79:0/3789333657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff184152b50 con 0x7ff184072110 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.166+0000 7ff189089640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff184072110 0x7ff1841f62b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff17400b3e0 tx=0x7ff17400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.167+0000 7ff17a7fc640 1 -- 172.21.15.79:0/3789333657 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174015020 con 0x7ff184072110 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.167+0000 7ff17a7fc640 1 -- 172.21.15.79:0/3789333657 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174011850 con 0x7ff184072110 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.167+0000 7ff18baee640 1 -- 172.21.15.79:0/3789333657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff184152e30 con 0x7ff184072110 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.167+0000 7ff17a7fc640 1 -- 172.21.15.79:0/3789333657 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174011c40 con 0x7ff184072110 2024-06-10T00:18:58.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.167+0000 7ff18baee640 1 -- 172.21.15.79:0/3789333657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18414e3f0 con 0x7ff184072110 2024-06-10T00:18:58.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.168+0000 7ff17a7fc640 1 -- 172.21.15.79:0/3789333657 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff174018020 con 0x7ff184072110 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.169+0000 7ff17a7fc640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff16806be30 0x7ff16806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.169+0000 7ff17a7fc640 1 -- 172.21.15.79:0/3789333657 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7ff17408afe0 con 0x7ff184072110 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.169+0000 7ff18988a640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff16806be30 0x7ff16806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18988a640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff16806be30 0x7ff16806e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff180034000 tx=0x7ff18002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18e7f8740 1 Processor -- start 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18e7f8740 1 -- start start 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d84d00 0x559e03d87510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d850e0 0x559e03d87a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d57960 0x559e03d5b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559e03cc0740 con 0x559e03d84d00 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559e03c5ea80 con 0x559e03d850e0 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.170+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559e03cbc700 con 0x559e03d57960 2024-06-10T00:18:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d84d00 0x559e03d87510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d84d00 0x559e03d87510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49744/0 (socket says 172.21.15.79:49744) 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 -- 172.21.15.79:0/1316306778 learned_addr learned my addr 172.21.15.79:0/1316306778 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 -- 172.21.15.79:0/1316306778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d57960 msgr2=0x559e03d5b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 --2- 172.21.15.79:0/1316306778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d57960 0x559e03d5b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 -- 172.21.15.79:0/1316306778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d850e0 msgr2=0x559e03d87a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 --2- 172.21.15.79:0/1316306778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d850e0 0x559e03d87a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 -- 172.21.15.79:0/1316306778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e03c89fb0 con 0x559e03d84d00 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff18988a640 1 --2- 172.21.15.79:0/1316306778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d84d00 0x559e03d87510 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff180009630 tx=0x7ff18002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3175a27380e95e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff1677fe640 1 -- 172.21.15.79:0/1316306778 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18004e070 con 0x559e03d84d00 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff1677fe640 1 -- 172.21.15.79:0/1316306778 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff180032d30 con 0x559e03d84d00 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.171+0000 7ff1677fe640 1 -- 172.21.15.79:0/1316306778 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180037040 con 0x559e03d84d00 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 -- 172.21.15.79:0/1316306778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d84d00 msgr2=0x559e03d87510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/1316306778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d84d00 0x559e03d87510 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff180009630 tx=0x7ff18002c000 comp rx=0 tx=0).stop 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 -- 172.21.15.79:0/1316306778 shutdown_connections 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/1316306778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d57960 0x559e03d5b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/1316306778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d850e0 0x559e03d87a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/1316306778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d84d00 0x559e03d87510 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 -- 172.21.15.79:0/1316306778 >> 172.21.15.79:0/1316306778 conn(0x559e03d59bd0 msgr2=0x559e03da2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 -- 172.21.15.79:0/1316306778 shutdown_connections 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 -- 172.21.15.79:0/1316306778 wait complete. 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 -- start start 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.172+0000 7ff18e7f8740 1 Processor -- start 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d84d00 0x559e03d7d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03da4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03da4640 0x559e03d812b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559e03d5cd80 con 0x559e03d850e0 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559e03c49c30 con 0x559e03da4640 2024-06-10T00:18:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559e03d5d060 con 0x559e03d84d00 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff18e7f8740 10 client.0 _ll_register_callbacks cb 0x559e03c7b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff189089640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03da4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff189089640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03da4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49752/0 (socket says 172.21.15.79:49752) 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.173+0000 7ff189089640 1 -- 172.21.15.79:0/3359875912 learned_addr learned my addr 172.21.15.79:0/3359875912 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18988a640 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d84d00 0x559e03d7d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18a08b640 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03da4640 0x559e03d812b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff189089640 1 -- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d84d00 msgr2=0x559e03d7d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff189089640 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d84d00 0x559e03d7d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff189089640 1 -- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03da4640 msgr2=0x559e03d812b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff189089640 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03da4640 0x559e03d812b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff189089640 1 -- 172.21.15.79:0/3359875912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e039d42d0 con 0x559e03d850e0 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18988a640 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d84d00 0x559e03d7d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff189089640 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03da4100 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff174089330 tx=0x7ff1740590b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81dc076d218ff63 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff164ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff164ff9640 1 -- 172.21.15.79:0/3359875912 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174071020 con 0x559e03d850e0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff164ff9640 1 -- 172.21.15.79:0/3359875912 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7ff17405d110 con 0x559e03d850e0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3359875912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff180032d30 con 0x559e03d850e0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff164ff9640 1 -- 172.21.15.79:0/3359875912 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff1740890d0 con 0x559e03d850e0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 10 client.6522 fetch_fsmap learned FSMap version 42 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3359875912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x559e03a9e6b0 con 0x559e03d850e0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff164ff9640 1 -- 172.21.15.79:0/3359875912 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff180032d30 con 0x559e03d850e0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff164ff9640 1 -- 172.21.15.79:0/3359875912 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 3494+0+0 (secure 0 0 0) 0x7ff174055720 con 0x559e03d850e0 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 10 client.6522 fetch_fsmap finished waiting for FSMap version 42 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 10 client.6522 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 20 client.6522 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x559e03d9d280 0x559e03dc07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 4 client.6522 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.174+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3359875912 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e03ccde70 con 0x559e03d9d280 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.175+0000 7ff18988a640 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x559e03d9d280 0x559e03dc07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.175+0000 7ff164ff9640 10 client.6522 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.175+0000 7ff18988a640 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x559e03d9d280 0x559e03dc07c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e6c96a67c7b728c server_cookie=301cbb849c44fec in_seq=0 out_seq=0 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.175+0000 7ff164ff9640 1 -- 172.21.15.79:0/3359875912 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559e03ccde70 con 0x559e03d9d280 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.175+0000 7ff164ff9640 10 client.6522 handle_command_reply: tid=0 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.175+0000 7ff18e7f8740 1 client.6522 shutdown 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3359875912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 msgr2=0x559e03da4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03da4100 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff174089330 tx=0x7ff1740590b0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3359875912 shutdown_connections 2024-06-10T00:18:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03da4640 0x559e03d812b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x559e03d9d280 0x559e03dc07c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03da4100 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3359875912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03d84d00 0x559e03d7d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff164ff9640 0 client.6522 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:18:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3359875912 >> 172.21.15.79:0/3359875912 conn(0x559e03d57960 msgr2=0x559e03da00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3359875912 shutdown_connections 2024-06-10T00:18:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3359875912 wait complete. 2024-06-10T00:18:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.176+0000 7ff18e7f8740 20 client.6522 trim_cache size 0 max 16384 2024-06-10T00:18:58.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.194+0000 7ff18e7f8740 1 Processor -- start 2024-06-10T00:18:58.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.194+0000 7ff18e7f8740 1 -- start start 2024-06-10T00:18:58.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03d87580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03d9fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 0x559e03d58560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841fde80 con 0x559e03d850e0 2024-06-10T00:18:58.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff184150e50 con 0x559e03d84d00 2024-06-10T00:18:58.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff18414f1c0 con 0x559e03da4640 2024-06-10T00:18:58.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03d9fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03d9fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49756/0 (socket says 172.21.15.79:49756) 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 -- 172.21.15.79:0/3769424669 learned_addr learned my addr 172.21.15.79:0/3769424669 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff18988a640 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03d87580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 -- 172.21.15.79:0/3769424669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 msgr2=0x559e03d58560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 0x559e03d58560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 -- 172.21.15.79:0/3769424669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 msgr2=0x559e03d87580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03d87580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 -- 172.21.15.79:0/3769424669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e03d5dc00 con 0x559e03d850e0 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff18988a640 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03d87580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff189089640 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03d9fda0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff174057360 tx=0x7ff17401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad533879b024a26 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.195+0000 7ff166ffd640 1 -- 172.21.15.79:0/3769424669 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174071020 con 0x559e03d850e0 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff166ffd640 1 -- 172.21.15.79:0/3769424669 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174061c90 con 0x559e03d850e0 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff166ffd640 1 -- 172.21.15.79:0/3769424669 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174078110 con 0x559e03d850e0 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3769424669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 msgr2=0x559e03d9fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03d9fda0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff174057360 tx=0x7ff17401c000 comp rx=0 tx=0).stop 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3769424669 shutdown_connections 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 0x559e03d58560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03d9fda0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/3769424669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03d87580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3769424669 >> 172.21.15.79:0/3769424669 conn(0x559e03d57960 msgr2=0x559e03d56970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3769424669 shutdown_connections 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.196+0000 7ff18e7f8740 1 -- 172.21.15.79:0/3769424669 wait complete. 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.197+0000 7ff18e7f8740 1 -- start start 2024-06-10T00:18:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.197+0000 7ff18e7f8740 1 Processor -- start 2024-06-10T00:18:58.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03e20640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03db58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 0x559e03d9bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559e03d9d100 con 0x559e03d850e0 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559e03da6160 con 0x559e03d84d00 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559e03d9d720 con 0x559e03da4640 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 10 client.0 _ll_register_callbacks cb 0x7ff174017350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03db58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03db58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49760/0 (socket says 172.21.15.79:49760) 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 -- 172.21.15.79:0/826846969 learned_addr learned my addr 172.21.15.79:0/826846969 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18988a640 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03e20640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18a08b640 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 0x559e03d9bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 -- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 msgr2=0x559e03d9bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 0x559e03d9bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 -- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 msgr2=0x559e03e20640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03e20640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 -- 172.21.15.79:0/826846969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e03e20b80 con 0x559e03d850e0 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18988a640 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03e20640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff189089640 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03db58e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff174059040 tx=0x7ff1740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ba32a9a7c017cd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff164ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff164ff9640 1 -- 172.21.15.79:0/826846969 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174058750 con 0x559e03d850e0 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff164ff9640 1 -- 172.21.15.79:0/826846969 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7ff174054e00 con 0x559e03d850e0 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 1 -- 172.21.15.79:0/826846969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff174061c90 con 0x559e03d850e0 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff164ff9640 1 -- 172.21.15.79:0/826846969 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff174055000 con 0x559e03d850e0 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 10 client.6528 fetch_fsmap learned FSMap version 42 2024-06-10T00:18:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff18e7f8740 1 -- 172.21.15.79:0/826846969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x559e03db5e20 con 0x559e03d850e0 2024-06-10T00:18:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.198+0000 7ff164ff9640 1 -- 172.21.15.79:0/826846969 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174061c90 con 0x559e03d850e0 2024-06-10T00:18:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff164ff9640 1 -- 172.21.15.79:0/826846969 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 3494+0+0 (secure 0 0 0) 0x7ff174057f70 con 0x559e03d850e0 2024-06-10T00:18:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 10 client.6528 fetch_fsmap finished waiting for FSMap version 42 2024-06-10T00:18:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 10 client.6528 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-10T00:18:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 20 client.6528 populate_metadata read hostname 'smithi079' 2024-06-10T00:18:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x559e03da02e0 0x559e03e241e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 4 client.6528 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:18:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 -- 172.21.15.79:0/826846969 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "status"}) -- 0x559e03d88c80 con 0x559e03da02e0 2024-06-10T00:18:58.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18988a640 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x559e03da02e0 0x559e03e241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff164ff9640 10 client.6528 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:18:58.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18988a640 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x559e03da02e0 0x559e03e241e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fa175b743e94fa4 server_cookie=548ececd051c0b97 in_seq=0 out_seq=0 2024-06-10T00:18:58.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff164ff9640 1 -- 172.21.15.79:0/826846969 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559e03d88c80 con 0x559e03da02e0 2024-06-10T00:18:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff164ff9640 10 client.6528 handle_command_reply: tid=0 2024-06-10T00:18:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 client.6528 shutdown 2024-06-10T00:18:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 -- 172.21.15.79:0/826846969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 msgr2=0x559e03db58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03db58e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff174059040 tx=0x7ff1740046b0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 -- 172.21.15.79:0/826846969 shutdown_connections 2024-06-10T00:18:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e03da4640 0x559e03d9bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x559e03da02e0 0x559e03e241e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559e03d850e0 0x559e03db58e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 --2- 172.21.15.79:0/826846969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e03d84d00 0x559e03e20640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff18e7f8740 1 -- 172.21.15.79:0/826846969 >> 172.21.15.79:0/826846969 conn(0x559e03d57960 msgr2=0x559e03d584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:58.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.199+0000 7ff164ff9640 0 client.6528 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:18:58.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18e7f8740 1 -- 172.21.15.79:0/826846969 shutdown_connections 2024-06-10T00:18:58.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18e7f8740 1 -- 172.21.15.79:0/826846969 wait complete. 2024-06-10T00:18:58.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18e7f8740 20 client.6528 trim_cache size 0 max 16384 2024-06-10T00:18:58.208 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:18:58.208 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:18:58.209 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:18:58.209 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6471, 2024-06-10T00:18:58.209 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:18:58.209 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:18:58.209 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:18:58.209 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3910626800000001, 2024-06-10T00:18:58.209 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 42, 2024-06-10T00:18:58.209 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 76, 2024-06-10T00:18:58.210 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 76, 2024-06-10T00:18:58.210 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 4.9522377180000001 2024-06-10T00:18:58.210 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:18:58.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 -- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff16806be30 msgr2=0x7ff16806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff16806be30 0x7ff16806e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff180034000 tx=0x7ff18002e000 comp rx=0 tx=0).stop 2024-06-10T00:18:58.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 -- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff184072110 msgr2=0x7ff1841f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff184072110 0x7ff1841f62b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff17400b3e0 tx=0x7ff17400b8a0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 -- 172.21.15.79:0/3789333657 shutdown_connections 2024-06-10T00:18:58.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff16806be30 0x7ff16806e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840cc6d0 0x7ff1840cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff184072110 0x7ff1841f62b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 --2- 172.21.15.79:0/3789333657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff184071c60 0x7ff184151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 -- 172.21.15.79:0/3789333657 >> 172.21.15.79:0/3789333657 conn(0x7ff1840b19f0 msgr2=0x7ff18415ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:58.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 -- 172.21.15.79:0/3789333657 shutdown_connections 2024-06-10T00:18:58.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.200+0000 7ff18baee640 1 -- 172.21.15.79:0/3789333657 wait complete. 2024-06-10T00:18:58.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:18:58.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.313+0000 7fdb45458640 1 Processor -- start 2024-06-10T00:18:58.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.313+0000 7fdb45458640 1 -- start start 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb45458640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb400d2680 0x7fdb4015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb45458640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb400d1fc0 0x7fdb400d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb45458640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb40162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb45458640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdb400d13e0 con 0x7fdb400d1fc0 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb45458640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdb400d2fa0 con 0x7fdb400d2680 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb45458640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdb400d0ad0 con 0x7fdb40161fa0 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb37fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb400d1fc0 0x7fdb400d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb37fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb400d1fc0 0x7fdb400d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49770/0 (socket says 172.21.15.79:49770) 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb37fff640 1 -- 172.21.15.79:0/304548884 learned_addr learned my addr 172.21.15.79:0/304548884 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb3f7fe640 1 --2- 172.21.15.79:0/304548884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb40162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb3effd640 1 --2- 172.21.15.79:0/304548884 >> v2:172.21.15.117:3300/0 conn(0x7fdb400d2680 0x7fdb4015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb37fff640 1 -- 172.21.15.79:0/304548884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 msgr2=0x7fdb40162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb37fff640 1 --2- 172.21.15.79:0/304548884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb40162410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb37fff640 1 -- 172.21.15.79:0/304548884 >> v2:172.21.15.117:3300/0 conn(0x7fdb400d2680 msgr2=0x7fdb4015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb37fff640 1 --2- 172.21.15.79:0/304548884 >> v2:172.21.15.117:3300/0 conn(0x7fdb400d2680 0x7fdb4015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb37fff640 1 -- 172.21.15.79:0/304548884 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4015f890 con 0x7fdb400d1fc0 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb3f7fe640 1 --2- 172.21.15.79:0/304548884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb40162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.314+0000 7fdb3effd640 1 --2- 172.21.15.79:0/304548884 >> v2:172.21.15.117:3300/0 conn(0x7fdb400d2680 0x7fdb4015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.315+0000 7fdb37fff640 1 --2- 172.21.15.79:0/304548884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d1fc0 0x7fdb400d2a60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdb4008ca40 tx=0x7fdb2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6232382b95442c0b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.315+0000 7fdb3e7fc640 1 -- 172.21.15.79:0/304548884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28037070 con 0x7fdb400d1fc0 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.315+0000 7fdb3e7fc640 1 -- 172.21.15.79:0/304548884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb28032440 con 0x7fdb400d1fc0 2024-06-10T00:18:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.315+0000 7fdb3e7fc640 1 -- 172.21.15.79:0/304548884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28032810 con 0x7fdb400d1fc0 2024-06-10T00:18:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 -- 172.21.15.79:0/304548884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d1fc0 msgr2=0x7fdb400d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 --2- 172.21.15.79:0/304548884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d1fc0 0x7fdb400d2a60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdb4008ca40 tx=0x7fdb2802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 -- 172.21.15.79:0/304548884 shutdown_connections 2024-06-10T00:18:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 --2- 172.21.15.79:0/304548884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb40162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 --2- 172.21.15.79:0/304548884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d1fc0 0x7fdb400d2a60 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 --2- 172.21.15.79:0/304548884 >> v2:172.21.15.117:3300/0 conn(0x7fdb400d2680 0x7fdb4015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 -- 172.21.15.79:0/304548884 >> 172.21.15.79:0/304548884 conn(0x7fdb4009d3f0 msgr2=0x7fdb400d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 -- 172.21.15.79:0/304548884 shutdown_connections 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.316+0000 7fdb45458640 1 -- 172.21.15.79:0/304548884 wait complete. 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.317+0000 7fdb45458640 1 Processor -- start 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.317+0000 7fdb45458640 1 -- start start 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb45458640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb400d1fc0 0x7fdb4015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb45458640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d2680 0x7fdb4014abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb45458640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb4014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb45458640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdb400d2400 con 0x7fdb400d2680 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb45458640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdb400d1070 con 0x7fdb400d1fc0 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb45458640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdb400d4f00 con 0x7fdb40161fa0 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d2680 0x7fdb4014abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d2680 0x7fdb4014abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49774/0 (socket says 172.21.15.79:49774) 2024-06-10T00:18:58.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 -- 172.21.15.79:0/4001518990 learned_addr learned my addr 172.21.15.79:0/4001518990 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb3f7fe640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb4014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb3effd640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb400d1fc0 0x7fdb4015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 -- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 msgr2=0x7fdb4014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb4014b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 -- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb400d1fc0 msgr2=0x7fdb4015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb400d1fc0 0x7fdb4015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 -- 172.21.15.79:0/4001518990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb400b9b10 con 0x7fdb400d2680 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb3f7fe640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb4014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb3effd640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb400d1fc0 0x7fdb4015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb37fff640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d2680 0x7fdb4014abe0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdb2802a220 tx=0x7fdb280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb377fe640 1 -- 172.21.15.79:0/4001518990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28037040 con 0x7fdb400d2680 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb377fe640 1 -- 172.21.15.79:0/4001518990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb28042070 con 0x7fdb400d2680 2024-06-10T00:18:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb400b9570 con 0x7fdb400d2680 2024-06-10T00:18:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb377fe640 1 -- 172.21.15.79:0/4001518990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28030bb0 con 0x7fdb400d2680 2024-06-10T00:18:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.318+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4015cda0 con 0x7fdb400d2680 2024-06-10T00:18:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.319+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb4015a900 con 0x7fdb400d2680 2024-06-10T00:18:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.320+0000 7fdb377fe640 1 -- 172.21.15.79:0/4001518990 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb28047460 con 0x7fdb400d2680 2024-06-10T00:18:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.320+0000 7fdb377fe640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:18:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.320+0000 7fdb377fe640 1 -- 172.21.15.79:0/4001518990 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fdb280abbf0 con 0x7fdb400d2680 2024-06-10T00:18:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.320+0000 7fdb3effd640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:18:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.321+0000 7fdb3effd640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb2006be30 0x7fdb2006e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb30006b10 tx=0x7fdb30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:18:58.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.324+0000 7fdb377fe640 1 -- 172.21.15.79:0/4001518990 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdb28045360 con 0x7fdb400d2680 2024-06-10T00:18:58.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.531+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdb40068430 con 0x7fdb400d2680 2024-06-10T00:18:58.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.532+0000 7fdb377fe640 1 -- 172.21.15.79:0/4001518990 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) ==== 53+0+73 (secure 0 0 0) 0x7fdb2807a450 con 0x7fdb400d2680 2024-06-10T00:18:58.532 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:18:58.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.533+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb2006be30 msgr2=0x7fdb2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.533+0000 7fdb45458640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb2006be30 0x7fdb2006e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb30006b10 tx=0x7fdb30008040 comp rx=0 tx=0).stop 2024-06-10T00:18:58.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.533+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d2680 msgr2=0x7fdb4014abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.533+0000 7fdb45458640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d2680 0x7fdb4014abe0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdb2802a220 tx=0x7fdb280046c0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.534+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 shutdown_connections 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.534+0000 7fdb45458640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.534+0000 7fdb45458640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb40161fa0 0x7fdb4014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.534+0000 7fdb45458640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb400d2680 0x7fdb4014abe0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.534+0000 7fdb45458640 1 --2- 172.21.15.79:0/4001518990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb400d1fc0 0x7fdb4015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.534+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 >> 172.21.15.79:0/4001518990 conn(0x7fdb4009d3f0 msgr2=0x7fdb400b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.534+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 shutdown_connections 2024-06-10T00:18:58.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58.534+0000 7fdb45458640 1 -- 172.21.15.79:0/4001518990 wait complete. 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:18:58.545 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:18:58.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:58.546 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:18:58.563 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:18:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:18:58.563 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:18:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:58.566 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:18:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:18:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42506sec preferred_lft 42506sec 2024-06-10T00:18:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:18:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:58.566 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:18:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:18:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:18:58.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:58.568 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:18:58.626 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:18:58.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:58.627 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:18:58.683 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:18:58.684 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:18:58.684 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:18:58.684 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:18:58.684 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:18:58.684 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:18:58.684 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:18:58.684 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:18:58.684 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:18:58.684 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:18:58.684 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:18:58.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:18:58.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:18:58.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:58.810 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:18:58.813 INFO:tasks.ceph.mds.c.smithi079.stderr:2024-06-10T00:18:58.813+0000 7fe8a42ff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:18:58.825 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:18:58.825 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:18:58.825 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:18:58.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:58.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:18:58.891 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:18:58.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:18:58.891 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:58.946 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:18:58.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:18:58.947 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:59.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:18:59.066 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:18:59.122 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:18:59.123 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:18:59.124 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:18:59.125 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:59.125 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:59.125 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:59.125 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:59.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:59.125 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:18:59.177 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:18:59.177 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:18:59.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:18:59.244 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:18:59.301 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:18:59.302 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:59.303 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:18:59.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:18:59.300+0000 7fbfbfa91480 -1 init, newargv = 0x557ec87f3380 newargc=15 2024-06-10T00:18:59.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:59.304 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:18:59.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[61093]: starting ceph client 2024-06-10T00:18:59.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[61093]: starting fuse 2024-06-10T00:18:59.321 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:18:59.321 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:18:59.321 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:18:59.321 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:18:59.321 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:18:59.321 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:18:59.321 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:18:59.321 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:59.321 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:18:59.321 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:18:59.322 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:18:59.323 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:18:59.323 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:18:59.323 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:59.323 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:18:59.323 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:18:59.439 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.61093.asok 2024-06-10T00:18:59.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:18:59.450 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61093.asok 2024-06-10T00:18:59.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:59.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.61093.asok status 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "61093", 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:18:59.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6543, 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 6543 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2423438699 2024-06-10T00:18:59.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2423438699 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.6543 192.168.0.1:0/2423438699", 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/2423438699", 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 42, 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 76, 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:18:59.588 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:18:59.589 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:18:59.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:59.592 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:18:59.592 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:59.607 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:18:59.608 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:59.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:59.608 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:18:59.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:59.674 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-06-10T00:18:59.732 INFO:teuthology.orchestra.run.smithi079.stdout:file_undamaged 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> import json 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> import sys 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> try: 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-06-10T00:18:59.733 DEBUG:teuthology.orchestra.run.smithi079:> except OSError as e: 2024-06-10T00:18:59.734 DEBUG:teuthology.orchestra.run.smithi079:> sys.exit(e.errno) 2024-06-10T00:18:59.734 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:18:59.734 DEBUG:teuthology.orchestra.run.smithi079:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-06-10T00:18:59.734 DEBUG:teuthology.orchestra.run.smithi079:> print(json.dumps( 2024-06-10T00:18:59.734 DEBUG:teuthology.orchestra.run.smithi079:> dict([(a, getattr(s, a)) for a in attrs]), 2024-06-10T00:18:59.734 DEBUG:teuthology.orchestra.run.smithi079:> indent=2)) 2024-06-10T00:18:59.734 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:18:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:18:59 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-06-10T00:18:59.850 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-06-10T00:18:59.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:18:59.850 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-06-10T00:18:59.907 INFO:teuthology.orchestra.run.smithi079.stdout:2 2024-06-10T00:18:59.908 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:18:59.908 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:18:59.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:19:00.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.104+0000 7fd00d0e1640 1 Processor -- start 2024-06-10T00:19:00.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.104+0000 7fd00d0e1640 1 -- start start 2024-06-10T00:19:00.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00d0e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0080b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00d0e1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0080af3b0 0x7fd0080b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00d0e1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd00815ac50 con 0x7fd00815a870 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00d0e1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd0080b4fe0 con 0x7fd0080af3b0 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00d0e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd00806cdb0 con 0x7fd0080aef70 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00759e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0080af3b0 0x7fd0080b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00759e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0080af3b0 0x7fd0080b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49780/0 (socket says 172.21.15.79:49780) 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00759e640 1 -- 172.21.15.79:0/29500845 learned_addr learned my addr 172.21.15.79:0/29500845 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00659c640 1 --2- 172.21.15.79:0/29500845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0080b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00759e640 1 -- 172.21.15.79:0/29500845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 msgr2=0x7fd0080b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00759e640 1 --2- 172.21.15.79:0/29500845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0080b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00759e640 1 -- 172.21.15.79:0/29500845 >> v1:172.21.15.117:6789/0 conn(0x7fd00815a870 legacy=0x7fd00806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00759e640 1 -- 172.21.15.79:0/29500845 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00806d090 con 0x7fd0080af3b0 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.105+0000 7fd00659c640 1 --2- 172.21.15.79:0/29500845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0080b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.106+0000 7fd00759e640 1 --2- 172.21.15.79:0/29500845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080b4aa0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd00000d150 tx=0x7fd00002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e98b70ebde8270 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.106+0000 7fd005d9b640 1 -- 172.21.15.79:0/29500845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd000039070 con 0x7fd0080af3b0 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.106+0000 7fd005d9b640 1 -- 172.21.15.79:0/29500845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd000009600 con 0x7fd0080af3b0 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.106+0000 7fd005d9b640 1 -- 172.21.15.79:0/29500845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0000099d0 con 0x7fd0080af3b0 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.107+0000 7fd00d0e1640 1 -- 172.21.15.79:0/29500845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 msgr2=0x7fd0080b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.107+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/29500845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080b4aa0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd00000d150 tx=0x7fd00002c890 comp rx=0 tx=0).stop 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.107+0000 7fd00d0e1640 1 -- 172.21.15.79:0/29500845 shutdown_connections 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.107+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/29500845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080b4aa0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.107+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/29500845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0080b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.107+0000 7fd00d0e1640 1 -- 172.21.15.79:0/29500845 >> 172.21.15.79:0/29500845 conn(0x7fd0080b19f0 msgr2=0x7fd0080b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:00.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.107+0000 7fd00d0e1640 1 -- 172.21.15.79:0/29500845 shutdown_connections 2024-06-10T00:19:00.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.107+0000 7fd00d0e1640 1 -- 172.21.15.79:0/29500845 wait complete. 2024-06-10T00:19:00.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.108+0000 7fd00d0e1640 1 Processor -- start 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.108+0000 7fd00d0e1640 1 -- start start 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00d0e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0081f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00d0e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00d0e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00815a870 0x7fd0080ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00d0e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd00806d930 con 0x7fd0080af3b0 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00d0e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd00806d650 con 0x7fd00815a870 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00d0e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0080b2e40 con 0x7fd0080aef70 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49790/0 (socket says 172.21.15.79:49790) 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00659c640 1 -- 172.21.15.79:0/4203954372 learned_addr learned my addr 172.21.15.79:0/4203954372 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd006d9d640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0081f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00759e640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00815a870 0x7fd0080ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00659c640 1 -- 172.21.15.79:0/4203954372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 msgr2=0x7fd0081f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00659c640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0081f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00659c640 1 -- 172.21.15.79:0/4203954372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00815a870 msgr2=0x7fd0080ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00659c640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00815a870 0x7fd0080ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.109+0000 7fd00659c640 1 -- 172.21.15.79:0/4203954372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0081f4490 con 0x7fd0080af3b0 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.110+0000 7fd00659c640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080add90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00d7d0 tx=0x7fcffc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.110+0000 7fcfef7fe640 1 -- 172.21.15.79:0/4203954372 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc004030 con 0x7fd0080af3b0 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.110+0000 7fcfef7fe640 1 -- 172.21.15.79:0/4203954372 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcffc0041d0 con 0x7fd0080af3b0 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.110+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd008153200 con 0x7fd0080af3b0 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.110+0000 7fcfef7fe640 1 -- 172.21.15.79:0/4203954372 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0096a0 con 0x7fd0080af3b0 2024-06-10T00:19:00.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.110+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0081537c0 con 0x7fd0080af3b0 2024-06-10T00:19:00.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.111+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd008068430 con 0x7fd0080af3b0 2024-06-10T00:19:00.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.111+0000 7fcfef7fe640 1 -- 172.21.15.79:0/4203954372 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcffc009840 con 0x7fd0080af3b0 2024-06-10T00:19:00.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.112+0000 7fcfef7fe640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcff406be30 0x7fcff406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.112+0000 7fcfef7fe640 1 -- 172.21.15.79:0/4203954372 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fcffc08b120 con 0x7fd0080af3b0 2024-06-10T00:19:00.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.112+0000 7fd006d9d640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcff406be30 0x7fcff406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.112+0000 7fd006d9d640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcff406be30 0x7fcff406e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcff8001780 tx=0x7fcff8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:00.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.116+0000 7fcfef7fe640 1 -- 172.21.15.79:0/4203954372 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd0081f4490 con 0x7fd0080af3b0 2024-06-10T00:19:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.303+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd0080cc010 con 0x7fd0080af3b0 2024-06-10T00:19:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.304+0000 7fcfef7fe640 1 -- 172.21.15.79:0/4203954372 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v76) ==== 80+0+122 (secure 0 0 0) 0x7fcffc059330 con 0x7fd0080af3b0 2024-06-10T00:19:00.305 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6835/1640828017 2024-06-11T00:18:53.210236+0000 2024-06-10T00:19:00.305 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6834/1640828017 2024-06-11T00:18:53.210236+0000 2024-06-10T00:19:00.305 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.305+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcff406be30 msgr2=0x7fcff406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcff406be30 0x7fcff406e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcff8001780 tx=0x7fcff8009040 comp rx=0 tx=0).stop 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 msgr2=0x7fd0080add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080add90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00d7d0 tx=0x7fcffc00dc90 comp rx=0 tx=0).stop 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 shutdown_connections 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcff406be30 0x7fcff406e2f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00815a870 0x7fd0080ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0080af3b0 0x7fd0080add90 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 --2- 172.21.15.79:0/4203954372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080aef70 0x7fd0081f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 >> 172.21.15.79:0/4203954372 conn(0x7fd0080b19f0 msgr2=0x7fd00806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:00.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 shutdown_connections 2024-06-10T00:19:00.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.306+0000 7fd00d0e1640 1 -- 172.21.15.79:0/4203954372 wait complete. 2024-06-10T00:19:00.317 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:19:00.317 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:19:00.333 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:19:00.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.471+0000 7f8b6629e640 1 Processor -- start 2024-06-10T00:19:00.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.471+0000 7f8b6629e640 1 -- start start 2024-06-10T00:19:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.471+0000 7f8b6629e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b600cc6d0 0x7f8b600ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.471+0000 7f8b6629e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b60071c60 0x7f8b600720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.471+0000 7f8b6629e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b600b36c0 0x7f8b600b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.471+0000 7f8b6629e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8b600ccff0 con 0x7f8b600b36c0 2024-06-10T00:19:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.471+0000 7f8b6629e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8b60072820 con 0x7f8b600cc6d0 2024-06-10T00:19:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.471+0000 7f8b6629e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b60072b00 con 0x7f8b60071c60 2024-06-10T00:19:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b6483b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b600b36c0 0x7f8b600b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b6483b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b600b36c0 0x7f8b600b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49806/0 (socket says 172.21.15.79:49806) 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b6483b640 1 -- 172.21.15.79:0/3856804483 learned_addr learned my addr 172.21.15.79:0/3856804483 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b5f7fe640 1 --2- 172.21.15.79:0/3856804483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b60071c60 0x7f8b600720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b5ffff640 1 --2- 172.21.15.79:0/3856804483 >> v2:172.21.15.117:3300/0 conn(0x7f8b600cc6d0 0x7f8b600ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b6483b640 1 -- 172.21.15.79:0/3856804483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b60071c60 msgr2=0x7f8b600720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b6483b640 1 --2- 172.21.15.79:0/3856804483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b60071c60 0x7f8b600720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b6483b640 1 -- 172.21.15.79:0/3856804483 >> v2:172.21.15.117:3300/0 conn(0x7f8b600cc6d0 msgr2=0x7f8b600ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b6483b640 1 --2- 172.21.15.79:0/3856804483 >> v2:172.21.15.117:3300/0 conn(0x7f8b600cc6d0 0x7f8b600ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.472+0000 7f8b6483b640 1 -- 172.21.15.79:0/3856804483 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b60072de0 con 0x7f8b600b36c0 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6483b640 1 --2- 172.21.15.79:0/3856804483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b600b3b30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8b6009e090 tx=0x7f8b5802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e25658ef9feda2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b5effd640 1 -- 172.21.15.79:0/3856804483 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58036070 con 0x7f8b600b36c0 2024-06-10T00:19:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b5effd640 1 -- 172.21.15.79:0/3856804483 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b58031600 con 0x7f8b600b36c0 2024-06-10T00:19:00.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b5effd640 1 -- 172.21.15.79:0/3856804483 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b580319d0 con 0x7f8b600b36c0 2024-06-10T00:19:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 -- 172.21.15.79:0/3856804483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 msgr2=0x7f8b600b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3856804483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b600b3b30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8b6009e090 tx=0x7f8b5802a6a0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 -- 172.21.15.79:0/3856804483 shutdown_connections 2024-06-10T00:19:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3856804483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b600b3b30 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3856804483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b60071c60 0x7f8b600720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3856804483 >> v2:172.21.15.117:3300/0 conn(0x7f8b600cc6d0 0x7f8b600ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 -- 172.21.15.79:0/3856804483 >> 172.21.15.79:0/3856804483 conn(0x7f8b600b19f0 msgr2=0x7f8b600b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 -- 172.21.15.79:0/3856804483 shutdown_connections 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.473+0000 7f8b6629e640 1 -- 172.21.15.79:0/3856804483 wait complete. 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.474+0000 7f8b6629e640 1 Processor -- start 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b6629e640 1 -- start start 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b6629e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60071c60 0x7f8b60155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b6629e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b60147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b6629e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b600cc6d0 0x7f8b60157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b6629e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b60159f60 con 0x7f8b600b36c0 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b6629e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6015c890 con 0x7f8b60071c60 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b6629e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b600b4070 con 0x7f8b600cc6d0 2024-06-10T00:19:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b5f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b60147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b5f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b60147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49808/0 (socket says 172.21.15.79:49808) 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.475+0000 7f8b5f7fe640 1 -- 172.21.15.79:0/3717780167 learned_addr learned my addr 172.21.15.79:0/3717780167 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5ffff640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60071c60 0x7f8b60155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b6483b640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b600cc6d0 0x7f8b60157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5f7fe640 1 -- 172.21.15.79:0/3717780167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b600cc6d0 msgr2=0x7f8b60157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5f7fe640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b600cc6d0 0x7f8b60157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5f7fe640 1 -- 172.21.15.79:0/3717780167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60071c60 msgr2=0x7f8b60155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5f7fe640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60071c60 0x7f8b60155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5f7fe640 1 -- 172.21.15.79:0/3717780167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b60147af0 con 0x7f8b600b36c0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5f7fe640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b60147050 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c7f0 tx=0x7f8b4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5cff9640 1 -- 172.21.15.79:0/3717780167 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48015070 con 0x7f8b600b36c0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5cff9640 1 -- 172.21.15.79:0/3717780167 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b48004220 con 0x7f8b600b36c0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b60147590 con 0x7f8b600b36c0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b5cff9640 1 -- 172.21.15.79:0/3717780167 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48007620 con 0x7f8b600b36c0 2024-06-10T00:19:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.476+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b60155030 con 0x7f8b600b36c0 2024-06-10T00:19:00.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.477+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b60068430 con 0x7f8b600b36c0 2024-06-10T00:19:00.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.477+0000 7f8b5cff9640 1 -- 172.21.15.79:0/3717780167 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b480077c0 con 0x7f8b600b36c0 2024-06-10T00:19:00.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.478+0000 7f8b5cff9640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4006be30 0x7f8b4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:00.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.478+0000 7f8b5ffff640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4006be30 0x7f8b4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:00.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.478+0000 7f8b5cff9640 1 -- 172.21.15.79:0/3717780167 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8b4808aef0 con 0x7f8b600b36c0 2024-06-10T00:19:00.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.478+0000 7f8b5ffff640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4006be30 0x7f8b4006e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8b50006fd0 tx=0x7f8b50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:00.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.482+0000 7f8b5cff9640 1 -- 172.21.15.79:0/3717780167 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8b48059630 con 0x7f8b600b36c0 2024-06-10T00:19:00.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.672+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8b600b07a0 con 0x7f8b600b36c0 2024-06-10T00:19:00.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.672+0000 7f8b5cff9640 1 -- 172.21.15.79:0/3717780167 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v76) ==== 80+0+122 (secure 0 0 0) 0x7f8b48058f30 con 0x7f8b600b36c0 2024-06-10T00:19:00.673 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6835/1640828017 2024-06-11T00:18:53.210236+0000 2024-06-10T00:19:00.673 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6834/1640828017 2024-06-11T00:18:53.210236+0000 2024-06-10T00:19:00.673 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-06-10T00:19:00.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4006be30 msgr2=0x7f8b4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4006be30 0x7f8b4006e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8b50006fd0 tx=0x7f8b50008040 comp rx=0 tx=0).stop 2024-06-10T00:19:00.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 msgr2=0x7f8b60147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:00.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b60147050 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c7f0 tx=0x7f8b4800ccb0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 shutdown_connections 2024-06-10T00:19:00.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4006be30 0x7f8b4006e2f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b600cc6d0 0x7f8b60157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b36c0 0x7f8b60147050 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 --2- 172.21.15.79:0/3717780167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60071c60 0x7f8b60155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:00.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 >> 172.21.15.79:0/3717780167 conn(0x7f8b600b19f0 msgr2=0x7f8b600b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:00.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 shutdown_connections 2024-06-10T00:19:00.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:00.674+0000 7f8b6629e640 1 -- 172.21.15.79:0/3717780167 wait complete. 2024-06-10T00:19:00.685 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:19:00.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:19:00.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:19:00.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[61093]: fuse finished with error 0 and tester_r 0 2024-06-10T00:19:00.710 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:19:03.833 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:19:03.833+0000 7f522c39e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-10T00:19:06.812 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:19:06.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:19:06.812 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:19:06.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:19:06.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-06-10T00:19:06.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.987+0000 7f9a00f90640 1 Processor -- start 2024-06-10T00:19:06.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.987+0000 7f9a00f90640 1 -- start start 2024-06-10T00:19:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.987+0000 7f9a00f90640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f99fc0cec60 0x7f99fc0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f9a00f90640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99fc0acd40 con 0x7f99fc0ad800 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f9a00f90640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99fc15bfe0 con 0x7f99fc155590 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f9a00f90640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f99fc15c2c0 con 0x7f99fc0cec60 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99fad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f99fc0ad800 0x7f99fc0adc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51770/0 (socket says 172.21.15.79:51770) 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99fad9d640 1 -- 172.21.15.79:0/513777161 learned_addr learned my addr 172.21.15.79:0/513777161 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f3fff640 1 --2- 172.21.15.79:0/513777161 >> v2:172.21.15.117:3300/0 conn(0x7f99fc0cec60 0x7f99fc0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286808937 0 0) 0x7f99fc0acd40 con 0x7f99fc0ad800 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99e8003520 con 0x7f99fc0ad800 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3624477981 0 0) 0x7f99e8003520 con 0x7f99fc0ad800 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 >> v2:172.21.15.117:3300/0 conn(0x7f99fc0cec60 msgr2=0x7f99fc0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 --2- 172.21.15.79:0/513777161 >> v2:172.21.15.117:3300/0 conn(0x7f99fc0cec60 0x7f99fc0cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 >> v1:172.21.15.117:6789/0 conn(0x7f99fc155590 legacy=0x7f99fc15b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc0ad000 con 0x7f99fc0ad800 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f99f40019f0 con 0x7f99fc0ad800 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 >> v1:172.21.15.79:6789/0 conn(0x7f99fc0ad800 legacy=0x7f99fc0adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99e80039b0 0x7f99e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e8004800 0x7f99e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e80051c0 0x7f99e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc15c2c0 con 0x7f99e80051c0 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99e800c060 con 0x7f99e8004800 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f99e800c260 con 0x7f99e80039b0 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99fad9d640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e80051c0 0x7f99e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99f3fff640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e8004800 0x7f99e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.988+0000 7f99fa59c640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99e80039b0 0x7f99e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.989+0000 7f99fad9d640 1 -- 172.21.15.79:0/513777161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99e80039b0 msgr2=0x7f99e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.989+0000 7f99fad9d640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99e80039b0 0x7f99e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.989+0000 7f99fad9d640 1 -- 172.21.15.79:0/513777161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e8004800 msgr2=0x7f99e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.989+0000 7f99fad9d640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e8004800 0x7f99e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.989+0000 7f99fad9d640 1 -- 172.21.15.79:0/513777161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e8003520 con 0x7f99e80051c0 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.989+0000 7f99fad9d640 1 -- 172.21.15.79:0/513777161 reap_dead start 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.989+0000 7f99fad9d640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e80051c0 0x7f99e800b9c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f99f400a840 tx=0x7f99e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8002849c4cf70 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f400a460 con 0x7f99e80051c0 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f402f070 con 0x7f99e80051c0 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f99f9d9b640 1 -- 172.21.15.79:0/513777161 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f402bcb0 con 0x7f99e80051c0 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f9a00f90640 1 -- 172.21.15.79:0/513777161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e80051c0 msgr2=0x7f99e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f9a00f90640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e80051c0 0x7f99e800b9c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f99f400a840 tx=0x7f99e8005830 comp rx=0 tx=0).stop 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f9a00f90640 1 -- 172.21.15.79:0/513777161 shutdown_connections 2024-06-10T00:19:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f9a00f90640 1 --2- 172.21.15.79:0/513777161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e80051c0 0x7f99e800b9c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f9a00f90640 1 -- 172.21.15.79:0/513777161 >> 172.21.15.79:0/513777161 conn(0x7f99fc0b1980 msgr2=0x7f99fc0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f9a00f90640 1 -- 172.21.15.79:0/513777161 shutdown_connections 2024-06-10T00:19:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.990+0000 7f9a00f90640 1 -- 172.21.15.79:0/513777161 wait complete. 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f9a00f90640 1 Processor -- start 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f9a00f90640 1 -- start start 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f9a00f90640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e80051c0 0x7f99fc06e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f9a00f90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99fc06e890 0x7f99fc0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f9a00f90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99fc150d30 0x7f99fc0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f9a00f90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc0cf0e0 con 0x7f99fc06e890 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f9a00f90640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc0b26d0 con 0x7f99e80051c0 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f9a00f90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f99fc0cf260 con 0x7f99fc150d30 2024-06-10T00:19:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f99f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99fc06e890 0x7f99fc0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.992+0000 7f99f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99fc06e890 0x7f99fc0cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49828/0 (socket says 172.21.15.79:49828) 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f3fff640 1 -- 172.21.15.79:0/1493317071 learned_addr learned my addr 172.21.15.79:0/1493317071 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f3fff640 1 -- 172.21.15.79:0/1493317071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99fc150d30 msgr2=0x7f99fc0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f3fff640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99fc150d30 0x7f99fc0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f3fff640 1 -- 172.21.15.79:0/1493317071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e80051c0 msgr2=0x7f99fc06e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99fa59c640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e80051c0 0x7f99fc06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f3fff640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e80051c0 0x7f99fc06e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f3fff640 1 -- 172.21.15.79:0/1493317071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc09abb0 con 0x7f99fc06e890 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f3fff640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99fc06e890 0x7f99fc0cfae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f99e40118e0 tx=0x7f99e4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f2ffd640 1 -- 172.21.15.79:0/1493317071 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e400faf0 con 0x7f99fc06e890 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f2ffd640 1 -- 172.21.15.79:0/1493317071 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e400fc90 con 0x7f99fc06e890 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f99f2ffd640 1 -- 172.21.15.79:0/1493317071 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4014440 con 0x7f99fc06e890 2024-06-10T00:19:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f9a00f90640 1 -- 172.21.15.79:0/1493317071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99fc09ae50 con 0x7f99fc06e890 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.993+0000 7f9a00f90640 1 -- 172.21.15.79:0/1493317071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99fc09b410 con 0x7f99fc06e890 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.995+0000 7f99f2ffd640 1 -- 172.21.15.79:0/1493317071 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99e4012040 con 0x7f99fc06e890 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.995+0000 7f99f2ffd640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f99dc06be60 0x7f99dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.995+0000 7f99f2ffd640 1 -- 172.21.15.79:0/1493317071 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f99e408b6d0 con 0x7f99fc06e890 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.995+0000 7f99fa59c640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f99dc06be60 0x7f99dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.996+0000 7f99fa59c640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f99dc06be60 0x7f99dc06e320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f99ec000c00 tx=0x7f99ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.996+0000 7f9a03d7c740 1 Processor -- start 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.996+0000 7f9a03d7c740 1 -- start start 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 0x55857d74ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d71ec90 0x55857d747360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d74a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55857d683050 con 0x55857d7478a0 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55857d629ec0 con 0x55857d746f80 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55857d67f010 con 0x55857d71ec90 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f99fad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d74a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f99fad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d74a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49832/0 (socket says 172.21.15.79:49832) 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f99fad9d640 1 -- 172.21.15.79:0/3767555002 learned_addr learned my addr 172.21.15.79:0/3767555002 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f99fa59c640 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 0x55857d74ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.997+0000 7f99f3fff640 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d71ec90 0x55857d747360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99fad9d640 1 -- 172.21.15.79:0/3767555002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d71ec90 msgr2=0x55857d747360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99fad9d640 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d71ec90 0x55857d747360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99fad9d640 1 -- 172.21.15.79:0/3767555002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 msgr2=0x55857d74ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99fad9d640 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 0x55857d74ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99fad9d640 1 -- 172.21.15.79:0/3767555002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55857d462a20 con 0x55857d7478a0 2024-06-10T00:19:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99fad9d640 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d74a130 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f99f400a930 tx=0x7f99f402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2108b3ad00ae86e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99dbfff640 1 -- 172.21.15.79:0/3767555002 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f40017b0 con 0x55857d7478a0 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99dbfff640 1 -- 172.21.15.79:0/3767555002 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f402f070 con 0x55857d7478a0 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.998+0000 7f99dbfff640 1 -- 172.21.15.79:0/3767555002 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f402b850 con 0x55857d7478a0 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 -- 172.21.15.79:0/3767555002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 msgr2=0x55857d74a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d74a130 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f99f400a930 tx=0x7f99f402d070 comp rx=0 tx=0).stop 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 -- 172.21.15.79:0/3767555002 shutdown_connections 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d74a130 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d71ec90 0x55857d747360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/3767555002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 0x55857d74ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 -- 172.21.15.79:0/3767555002 >> 172.21.15.79:0/3767555002 conn(0x55857d71c890 msgr2=0x55857d765130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 -- 172.21.15.79:0/3767555002 shutdown_connections 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 -- 172.21.15.79:0/3767555002 wait complete. 2024-06-10T00:19:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 -- start start 2024-06-10T00:19:07.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:06.999+0000 7f9a03d7c740 1 Processor -- start 2024-06-10T00:19:07.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d763300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d7478a0 0x55857d7480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d740810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55857d71abe0 con 0x55857d746f80 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55857d63d4a0 con 0x55857d7478a0 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55857d71a620 con 0x55857d73dee0 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f9a03d7c740 10 client.0 _ll_register_callbacks cb 0x55857d63e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f99fa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d763300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f99fa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d763300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49842/0 (socket says 172.21.15.79:49842) 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.000+0000 7f99fa59c640 1 -- 172.21.15.79:0/4050728207 learned_addr learned my addr 172.21.15.79:0/4050728207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99fad9d640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d740810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99f3fff640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d7478a0 0x55857d7480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99fa59c640 1 -- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 msgr2=0x55857d740810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99fa59c640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d740810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99fa59c640 1 -- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d7478a0 msgr2=0x55857d7480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99fa59c640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d7478a0 0x55857d7480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99fa59c640 1 -- 172.21.15.79:0/4050728207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55857d356310 con 0x55857d746f80 2024-06-10T00:19:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99fad9d640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d740810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99f3fff640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d7478a0 0x55857d7480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99fa59c640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d763300 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f99ec001bb0 tx=0x7f99ec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679e5fa07eb8786d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99d97fa640 1 -- 172.21.15.79:0/4050728207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec028060 con 0x55857d746f80 2024-06-10T00:19:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99d97fa640 1 -- 172.21.15.79:0/4050728207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f99ec023c90 con 0x55857d746f80 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4050728207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99f402f070 con 0x55857d746f80 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99d97fa640 1 -- 172.21.15.79:0/4050728207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f99ec014e10 con 0x55857d746f80 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 10 client.6567 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4050728207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55857d4c31b0 con 0x55857d746f80 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99d97fa640 1 -- 172.21.15.79:0/4050728207 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f402f070 con 0x55857d746f80 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f99d97fa640 1 -- 172.21.15.79:0/4050728207 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f99ec0215a0 con 0x55857d746f80 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 10 client.6567 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 10 client.6567 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 20 client.6567 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55857d7669c0 0x55857d766e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 4 client.6567 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.001+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4050728207 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55857d690780 con 0x55857d7669c0 2024-06-10T00:19:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.002+0000 7f99f3fff640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55857d7669c0 0x55857d766e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.002+0000 7f99d97fa640 10 client.6567 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.002+0000 7f99f3fff640 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55857d7669c0 0x55857d766e40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b6441d6d8adc38d server_cookie=3b0b9c2d0246ebdf in_seq=0 out_seq=0 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.002+0000 7f99d97fa640 1 -- 172.21.15.79:0/4050728207 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55857d690780 con 0x55857d7669c0 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.002+0000 7f99d97fa640 10 client.6567 handle_command_reply: tid=0 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.002+0000 7f9a03d7c740 1 client.6567 shutdown 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4050728207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 msgr2=0x55857d763300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d763300 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f99ec001bb0 tx=0x7f99ec001120 comp rx=0 tx=0).stop 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4050728207 shutdown_connections 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d740810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d7478a0 0x55857d7480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55857d7669c0 0x55857d766e40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4050728207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d763300 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f99d97fa640 0 client.6567 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4050728207 >> 172.21.15.79:0/4050728207 conn(0x55857d71ec90 msgr2=0x55857d7194d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4050728207 shutdown_connections 2024-06-10T00:19:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4050728207 wait complete. 2024-06-10T00:19:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.003+0000 7f9a03d7c740 20 client.6567 trim_cache size 0 max 16384 2024-06-10T00:19:07.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.021+0000 7f9a03d7c740 1 Processor -- start 2024-06-10T00:19:07.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.021+0000 7f9a03d7c740 1 -- start start 2024-06-10T00:19:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d73dee0 0x55857d71e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d7412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d7478a0 0x55857d746650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc1fd0f0 con 0x55857d746f80 2024-06-10T00:19:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc1fc210 con 0x55857d73dee0 2024-06-10T00:19:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f99fc1fb570 con 0x55857d7478a0 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d7412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d7412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49850/0 (socket says 172.21.15.79:49850) 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 -- 172.21.15.79:0/4144432293 learned_addr learned my addr 172.21.15.79:0/4144432293 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99fad9d640 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d7478a0 0x55857d746650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99fa59c640 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d73dee0 0x55857d71e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 -- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d7478a0 msgr2=0x55857d746650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d7478a0 0x55857d746650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 -- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d73dee0 msgr2=0x55857d71e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d73dee0 0x55857d71e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 -- 172.21.15.79:0/4144432293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55857d32f490 con 0x55857d746f80 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99fad9d640 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d7478a0 0x55857d746650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99fa59c640 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d73dee0 0x55857d71e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99f3fff640 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d7412d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f99e4089ab0 tx=0x7f99e4006aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73035791f4c8c46c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.022+0000 7f99db7fe640 1 -- 172.21.15.79:0/4144432293 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e40578d0 con 0x55857d746f80 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f99db7fe640 1 -- 172.21.15.79:0/4144432293 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e4057b30 con 0x55857d746f80 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f99db7fe640 1 -- 172.21.15.79:0/4144432293 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4061f80 con 0x55857d746f80 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4144432293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 msgr2=0x55857d7412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d7412d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f99e4089ab0 tx=0x7f99e4006aa0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4144432293 shutdown_connections 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d7478a0 0x55857d746650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d746f80 0x55857d7412d0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4144432293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d73dee0 0x55857d71e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4144432293 >> 172.21.15.79:0/4144432293 conn(0x55857d71ec90 msgr2=0x55857d765960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4144432293 shutdown_connections 2024-06-10T00:19:07.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.023+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4144432293 wait complete. 2024-06-10T00:19:07.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.024+0000 7f9a03d7c740 1 -- start start 2024-06-10T00:19:07.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.024+0000 7f9a03d7c740 1 Processor -- start 2024-06-10T00:19:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d71de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 0x55857d71e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f9a03d7c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d767fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55857d720490 con 0x55857d7478a0 2024-06-10T00:19:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc1fbbc0 con 0x55857d746f80 2024-06-10T00:19:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f9a03d7c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55857d73c480 con 0x55857d73dee0 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f9a03d7c740 10 client.0 _ll_register_callbacks cb 0x7f99ec001800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d767fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d767fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49852/0 (socket says 172.21.15.79:49852) 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 -- 172.21.15.79:0/4278824864 learned_addr learned my addr 172.21.15.79:0/4278824864 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99f3fff640 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 0x55857d71e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fa59c640 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d71de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 -- 172.21.15.79:0/4278824864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 msgr2=0x55857d71de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d71de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 -- 172.21.15.79:0/4278824864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 msgr2=0x55857d71e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 0x55857d71e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 -- 172.21.15.79:0/4278824864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55857d740af0 con 0x55857d7478a0 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99fad9d640 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d767fa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f99f4036000 tx=0x7f99fc15c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb070a48ca4f7333 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99d97fa640 1 -- 172.21.15.79:0/4278824864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f402bc60 con 0x55857d7478a0 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f99d97fa640 1 -- 172.21.15.79:0/4278824864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f99f402be00 con 0x55857d7478a0 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.025+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4278824864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99e4057b30 con 0x55857d7478a0 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f99d97fa640 1 -- 172.21.15.79:0/4278824864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f99f4034470 con 0x55857d7478a0 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f9a03d7c740 10 client.6573 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4278824864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55857d7624a0 con 0x55857d7478a0 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f99d97fa640 1 -- 172.21.15.79:0/4278824864 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e4057b30 con 0x55857d7478a0 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f99d97fa640 1 -- 172.21.15.79:0/4278824864 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f99f4048070 con 0x55857d7478a0 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f9a03d7c740 10 client.6573 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f9a03d7c740 10 client.6573 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f9a03d7c740 20 client.6573 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55857d7197f0 0x55857d7684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f9a03d7c740 4 client.6573 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4278824864 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) -- 0x55857d68aad0 con 0x55857d7197f0 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f99fa59c640 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55857d7197f0 0x55857d7684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f99d97fa640 10 client.6573 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.026+0000 7f99fa59c640 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55857d7197f0 0x55857d7684e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9adb6c690c13487 server_cookie=eb45ba6eb09232e8 in_seq=0 out_seq=0 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f99d97fa640 1 -- 172.21.15.79:0/4278824864 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55857d68aad0 con 0x55857d7197f0 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f99d97fa640 10 client.6573 handle_command_reply: tid=0 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 client.6573 shutdown 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4278824864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 msgr2=0x55857d767fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d767fa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f99f4036000 tx=0x7f99fc15c1b0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4278824864 shutdown_connections 2024-06-10T00:19:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55857d7197f0 0x55857d7684e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55857d7478a0 0x55857d767fa0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55857d746f80 0x55857d71e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f99d97fa640 0 client.6573 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 --2- 172.21.15.79:0/4278824864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55857d73dee0 0x55857d71de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4278824864 >> 172.21.15.79:0/4278824864 conn(0x55857d71ec90 msgr2=0x55857d7210f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4278824864 shutdown_connections 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 1 -- 172.21.15.79:0/4278824864 wait complete. 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.027+0000 7f9a03d7c740 20 client.6573 trim_cache size 0 max 16384 2024-06-10T00:19:07.034 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:19:07.035 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:19:07.035 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "654d849a-04fb-42a3-aeb9-3112696272b8", 2024-06-10T00:19:07.035 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:19:07.035 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 -- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f99dc06be60 msgr2=0x7f99dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f99dc06be60 0x7f99dc06e320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f99ec000c00 tx=0x7f99ec009040 comp rx=0 tx=0).stop 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 -- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99fc06e890 msgr2=0x7f99fc0cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99fc06e890 0x7f99fc0cfae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f99e40118e0 tx=0x7f99e4011da0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 -- 172.21.15.79:0/1493317071 shutdown_connections 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f99dc06be60 0x7f99dc06e320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99fc150d30 0x7f99fc0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99fc06e890 0x7f99fc0cfae0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 --2- 172.21.15.79:0/1493317071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99e80051c0 0x7f99fc06e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 -- 172.21.15.79:0/1493317071 >> 172.21.15.79:0/1493317071 conn(0x7f99fc0b1980 msgr2=0x7f99fc0b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 -- 172.21.15.79:0/1493317071 shutdown_connections 2024-06-10T00:19:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.028+0000 7f9a00f90640 1 -- 172.21.15.79:0/1493317071 wait complete. 2024-06-10T00:19:07.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:19:07.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-06-10T00:19:07.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.140+0000 7f753889e640 1 Processor -- start 2024-06-10T00:19:07.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.140+0000 7f753889e640 1 -- start start 2024-06-10T00:19:07.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753889e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7534155320 0x7f75340b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753889e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75340d0730 0x7f753406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753889e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7534155700 con 0x7f75340b34e0 2024-06-10T00:19:07.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753889e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f753415b6b0 con 0x7f7534155320 2024-06-10T00:19:07.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753889e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f753415b990 con 0x7f75340d0730 2024-06-10T00:19:07.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7534155320 0x7f75340b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7534155320 0x7f75340b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49862/0 (socket says 172.21.15.79:49862) 2024-06-10T00:19:07.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f7531d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f75340b34e0 0x7f75340d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51774/0 (socket says 172.21.15.79:51774) 2024-06-10T00:19:07.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753259c640 1 -- 172.21.15.79:0/1587730300 learned_addr learned my addr 172.21.15.79:0/1587730300 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753259c640 1 -- 172.21.15.79:0/1587730300 >> v2:172.21.15.117:3300/0 conn(0x7f75340d0730 msgr2=0x7f753406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753259c640 1 --2- 172.21.15.79:0/1587730300 >> v2:172.21.15.117:3300/0 conn(0x7f75340d0730 0x7f753406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753259c640 1 -- 172.21.15.79:0/1587730300 >> v1:172.21.15.79:6789/0 conn(0x7f75340b34e0 legacy=0x7f75340d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.141+0000 7f753259c640 1 -- 172.21.15.79:0/1587730300 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753415bc70 con 0x7f7534155320 2024-06-10T00:19:07.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.142+0000 7f753259c640 1 --2- 172.21.15.79:0/1587730300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534155320 0x7f75340b2fa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f75340b52b0 tx=0x7f752402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc4f29f2f16d347 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.142+0000 7f753159a640 1 -- 172.21.15.79:0/1587730300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524037070 con 0x7f7534155320 2024-06-10T00:19:07.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.142+0000 7f753159a640 1 -- 172.21.15.79:0/1587730300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524032440 con 0x7f7534155320 2024-06-10T00:19:07.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.142+0000 7f753159a640 1 -- 172.21.15.79:0/1587730300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524032810 con 0x7f7534155320 2024-06-10T00:19:07.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.143+0000 7f753889e640 1 -- 172.21.15.79:0/1587730300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534155320 msgr2=0x7f75340b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.143+0000 7f753889e640 1 --2- 172.21.15.79:0/1587730300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534155320 0x7f75340b2fa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f75340b52b0 tx=0x7f752402a270 comp rx=0 tx=0).stop 2024-06-10T00:19:07.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.143+0000 7f753889e640 1 -- 172.21.15.79:0/1587730300 shutdown_connections 2024-06-10T00:19:07.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.143+0000 7f753889e640 1 --2- 172.21.15.79:0/1587730300 >> v2:172.21.15.117:3300/0 conn(0x7f75340d0730 0x7f753406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.143+0000 7f753889e640 1 --2- 172.21.15.79:0/1587730300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7534155320 0x7f75340b2fa0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.143+0000 7f753889e640 1 -- 172.21.15.79:0/1587730300 >> 172.21.15.79:0/1587730300 conn(0x7f75340b1d10 msgr2=0x7f75340b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.143+0000 7f753889e640 1 -- 172.21.15.79:0/1587730300 shutdown_connections 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.143+0000 7f753889e640 1 -- 172.21.15.79:0/1587730300 wait complete. 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.144+0000 7f753889e640 1 Processor -- start 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.144+0000 7f753889e640 1 -- start start 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f753889e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75340b34e0 0x7f7534072730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f753889e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75340d0730 0x7f7534150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f753889e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7534155320 0x7f753415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f753889e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f753415b470 con 0x7f75340d0730 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f753889e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f753415b2f0 con 0x7f75340b34e0 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f753889e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f753406e730 con 0x7f7534155320 2024-06-10T00:19:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7531d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75340d0730 0x7f7534150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7531d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75340d0730 0x7f7534150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49876/0 (socket says 172.21.15.79:49876) 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7531d9b640 1 -- 172.21.15.79:0/2817159802 learned_addr learned my addr 172.21.15.79:0/2817159802 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f753259c640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75340b34e0 0x7f7534072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7532d9d640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7534155320 0x7f753415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7531d9b640 1 -- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7534155320 msgr2=0x7f753415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7531d9b640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7534155320 0x7f753415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7531d9b640 1 -- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75340b34e0 msgr2=0x7f7534072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7531d9b640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75340b34e0 0x7f7534072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7531d9b640 1 -- 172.21.15.79:0/2817159802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7534071690 con 0x7f75340d0730 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.145+0000 7f7532d9d640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7534155320 0x7f753415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.146+0000 7f7531d9b640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75340d0730 0x7f7534150560 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f752800c400 tx=0x7f752800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.146+0000 7f7522ffd640 1 -- 172.21.15.79:0/2817159802 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280074e0 con 0x7f75340d0730 2024-06-10T00:19:07.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.146+0000 7f7522ffd640 1 -- 172.21.15.79:0/2817159802 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7528007680 con 0x7f75340d0730 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.146+0000 7f753889e640 1 -- 172.21.15.79:0/2817159802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7534071970 con 0x7f75340d0730 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.146+0000 7f7522ffd640 1 -- 172.21.15.79:0/2817159802 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528004a00 con 0x7f75340d0730 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.146+0000 7f753889e640 1 -- 172.21.15.79:0/2817159802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7534071f30 con 0x7f75340d0730 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.147+0000 7f7522ffd640 1 -- 172.21.15.79:0/2817159802 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f752801a020 con 0x7f75340d0730 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.148+0000 7f7522ffd640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.148+0000 7f753259c640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.148+0000 7f7522ffd640 1 -- 172.21.15.79:0/2817159802 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f752808a7f0 con 0x7f75340d0730 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.148+0000 7f753259c640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f751406be30 0x7f751406e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7524034000 tx=0x7f752402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.149+0000 7f753b5af740 1 Processor -- start 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.149+0000 7f753b5af740 1 -- start start 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753b5af740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d9af0 0x55932e4b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753b5af740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4b11a0 0x55932e4b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753b5af740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4b86d0 0x55932e4b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753b5af740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55932e3db7e0 con 0x55932e4d9af0 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753b5af740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55932e419e80 con 0x55932e4b86d0 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753b5af740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55932e3b7700 con 0x55932e4b11a0 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d9af0 0x55932e4b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d9af0 0x55932e4b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49878/0 (socket says 172.21.15.79:49878) 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 -- 172.21.15.79:0/963460416 learned_addr learned my addr 172.21.15.79:0/963460416 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f7532d9d640 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4b86d0 0x55932e4b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f7531d9b640 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4b11a0 0x55932e4b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 -- 172.21.15.79:0/963460416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4b11a0 msgr2=0x55932e4b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4b11a0 0x55932e4b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 -- 172.21.15.79:0/963460416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4b86d0 msgr2=0x55932e4b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4b86d0 0x55932e4b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 -- 172.21.15.79:0/963460416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55932e3d6dd0 con 0x55932e4d9af0 2024-06-10T00:19:07.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f753259c640 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d9af0 0x55932e4b6120 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7524035040 tx=0x7f752402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56255ff807205b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f7513fff640 1 -- 172.21.15.79:0/963460416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524037040 con 0x55932e4d9af0 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f7513fff640 1 -- 172.21.15.79:0/963460416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524032ba0 con 0x55932e4d9af0 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.150+0000 7f7513fff640 1 -- 172.21.15.79:0/963460416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752403c440 con 0x55932e4d9af0 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 -- 172.21.15.79:0/963460416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d9af0 msgr2=0x55932e4b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d9af0 0x55932e4b6120 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7524035040 tx=0x7f752402c000 comp rx=0 tx=0).stop 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 -- 172.21.15.79:0/963460416 shutdown_connections 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4b86d0 0x55932e4b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4b11a0 0x55932e4b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 --2- 172.21.15.79:0/963460416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d9af0 0x55932e4b6120 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 -- 172.21.15.79:0/963460416 >> 172.21.15.79:0/963460416 conn(0x55932e4b3410 msgr2=0x55932e4fbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 -- 172.21.15.79:0/963460416 shutdown_connections 2024-06-10T00:19:07.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.151+0000 7f753b5af740 1 -- 172.21.15.79:0/963460416 wait complete. 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.152+0000 7f753b5af740 1 -- start start 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.152+0000 7f753b5af740 1 Processor -- start 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4d2930 0x55932e4e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4ddb90 0x55932e4de010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55932e3a2640 con 0x55932e4ddb90 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55932e415e40 con 0x55932e4d2930 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55932e4b4be0 con 0x55932e4d9af0 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 10 client.0 _ll_register_callbacks cb 0x55932e3d4430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4ddb90 0x55932e4de010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4ddb90 0x55932e4de010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49886/0 (socket says 172.21.15.79:49886) 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 -- 172.21.15.79:0/1690122845 learned_addr learned my addr 172.21.15.79:0/1690122845 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7531d9b640 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4d2930 0x55932e4e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753259c640 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 -- 172.21.15.79:0/1690122845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 msgr2=0x55932e4e43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4e43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 -- 172.21.15.79:0/1690122845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4d2930 msgr2=0x55932e4e48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4d2930 0x55932e4e48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 -- 172.21.15.79:0/1690122845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55932e1f77d0 con 0x55932e4ddb90 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f7532d9d640 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4ddb90 0x55932e4de010 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f752c00abc0 tx=0x7f752c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7799432c7faef349 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f75117fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f75117fa640 1 -- 172.21.15.79:0/1690122845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c01b060 con 0x55932e4ddb90 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f75117fa640 1 -- 172.21.15.79:0/1690122845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f752c0165f0 con 0x55932e4ddb90 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 1 -- 172.21.15.79:0/1690122845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7524032ba0 con 0x55932e4ddb90 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f75117fa640 1 -- 172.21.15.79:0/1690122845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f752c021050 con 0x55932e4ddb90 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 10 client.6588 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.153+0000 7f753b5af740 1 -- 172.21.15.79:0/1690122845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55932e12d3f0 con 0x55932e4ddb90 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f75117fa640 1 -- 172.21.15.79:0/1690122845 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524032ba0 con 0x55932e4ddb90 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f75117fa640 1 -- 172.21.15.79:0/1690122845 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f752c024020 con 0x55932e4ddb90 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f753b5af740 10 client.6588 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f753b5af740 10 client.6588 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f753b5af740 20 client.6588 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f753b5af740 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55932e517210 0x55932e519600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f753b5af740 4 client.6588 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f753b5af740 1 -- 172.21.15.79:0/1690122845 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55932e4275b0 con 0x55932e517210 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f753259c640 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55932e517210 0x55932e519600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f75117fa640 10 client.6588 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.154+0000 7f753259c640 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55932e517210 0x55932e519600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f279e551f7990a8f server_cookie=212e39143e93eb1 in_seq=0 out_seq=0 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f75117fa640 1 -- 172.21.15.79:0/1690122845 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55932e4275b0 con 0x55932e517210 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f75117fa640 10 client.6588 handle_command_reply: tid=0 2024-06-10T00:19:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 client.6588 shutdown 2024-06-10T00:19:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 -- 172.21.15.79:0/1690122845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4ddb90 msgr2=0x55932e4de010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4ddb90 0x55932e4de010 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f752c00abc0 tx=0x7f752c007680 comp rx=0 tx=0).stop 2024-06-10T00:19:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 -- 172.21.15.79:0/1690122845 shutdown_connections 2024-06-10T00:19:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55932e517210 0x55932e519600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4ddb90 0x55932e4de010 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f75117fa640 0 client.6588 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4d2930 0x55932e4e48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 --2- 172.21.15.79:0/1690122845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4e43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 -- 172.21.15.79:0/1690122845 >> 172.21.15.79:0/1690122845 conn(0x55932e4b86d0 msgr2=0x55932e4b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 -- 172.21.15.79:0/1690122845 shutdown_connections 2024-06-10T00:19:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 1 -- 172.21.15.79:0/1690122845 wait complete. 2024-06-10T00:19:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.155+0000 7f753b5af740 20 client.6588 trim_cache size 0 max 16384 2024-06-10T00:19:07.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.173+0000 7f753b5af740 1 Processor -- start 2024-06-10T00:19:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.173+0000 7f753b5af740 1 -- start start 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753b5af740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e4b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753b5af740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753b5af740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 0x55932e4d6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753b5af740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7534200df0 con 0x55932e4d2930 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753b5af740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75341ffe90 con 0x55932e4ddb90 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753b5af740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75340cd160 con 0x55932e4d9af0 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e4b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e4b71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49900/0 (socket says 172.21.15.79:49900) 2024-06-10T00:19:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 -- 172.21.15.79:0/192856665 learned_addr learned my addr 172.21.15.79:0/192856665 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 -- 172.21.15.79:0/192856665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 msgr2=0x55932e4dfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 --2- 172.21.15.79:0/192856665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 -- 172.21.15.79:0/192856665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 msgr2=0x55932e4d6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 --2- 172.21.15.79:0/192856665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 0x55932e4d6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 -- 172.21.15.79:0/192856665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55932e0ed0f0 con 0x55932e4d2930 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.174+0000 7f753259c640 1 --2- 172.21.15.79:0/192856665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e4b71b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f752402a860 tx=0x7f752403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ac55a97faa3b2b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f75137fe640 1 -- 172.21.15.79:0/192856665 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752403c700 con 0x55932e4d2930 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f75137fe640 1 -- 172.21.15.79:0/192856665 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524057070 con 0x55932e4d2930 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f75137fe640 1 -- 172.21.15.79:0/192856665 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752403caa0 con 0x55932e4d2930 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 -- 172.21.15.79:0/192856665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 msgr2=0x55932e4b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 --2- 172.21.15.79:0/192856665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e4b71b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f752402a860 tx=0x7f752403c000 comp rx=0 tx=0).stop 2024-06-10T00:19:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 -- 172.21.15.79:0/192856665 shutdown_connections 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 --2- 172.21.15.79:0/192856665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 0x55932e4d6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 --2- 172.21.15.79:0/192856665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 --2- 172.21.15.79:0/192856665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e4b71b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 -- 172.21.15.79:0/192856665 >> 172.21.15.79:0/192856665 conn(0x55932e4b86d0 msgr2=0x55932e4ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 -- 172.21.15.79:0/192856665 shutdown_connections 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.175+0000 7f753b5af740 1 -- 172.21.15.79:0/192856665 wait complete. 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.176+0000 7f753b5af740 1 -- start start 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.176+0000 7f753b5af740 1 Processor -- start 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e55f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 0x55932e4e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55932e4fed40 con 0x55932e4d2930 2024-06-10T00:19:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7534157240 con 0x55932e4ddb90 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55932e4e1760 con 0x55932e4d9af0 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 10 client.0 _ll_register_callbacks cb 0x7f752c00a750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e55f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e55f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49914/0 (socket says 172.21.15.79:49914) 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 -- 172.21.15.79:0/1539226039 learned_addr learned my addr 172.21.15.79:0/1539226039 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f7532d9d640 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 0x55932e4e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f7531d9b640 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 -- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 msgr2=0x55932e4d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 -- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 msgr2=0x55932e4e41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 0x55932e4e41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 -- 172.21.15.79:0/1539226039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55932e3e0560 con 0x55932e4d2930 2024-06-10T00:19:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f7532d9d640 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 0x55932e4e41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753259c640 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e55f850 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7524009960 tx=0x7f752402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78ddaa825e93e46 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f75117fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f75117fa640 1 -- 172.21.15.79:0/1539226039 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524063070 con 0x55932e4d2930 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f75117fa640 1 -- 172.21.15.79:0/1539226039 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f752403c800 con 0x55932e4d2930 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 1 -- 172.21.15.79:0/1539226039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7524057070 con 0x55932e4d2930 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f75117fa640 1 -- 172.21.15.79:0/1539226039 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f752406e050 con 0x55932e4d2930 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 10 client.6594 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.177+0000 7f753b5af740 1 -- 172.21.15.79:0/1539226039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55932e4d52f0 con 0x55932e4d2930 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f75117fa640 1 -- 172.21.15.79:0/1539226039 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524057070 con 0x55932e4d2930 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f75117fa640 1 -- 172.21.15.79:0/1539226039 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f7524071020 con 0x55932e4d2930 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 10 client.6594 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 10 client.6594 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 20 client.6594 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55932e4e46e0 0x55932e4f1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 4 client.6594 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 1 -- 172.21.15.79:0/1539226039 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55932e421900 con 0x55932e4e46e0 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f7531d9b640 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55932e4e46e0 0x55932e4f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f75117fa640 10 client.6594 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f7531d9b640 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55932e4e46e0 0x55932e4f1900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57f8a4ddaa3ea302 server_cookie=717c4ccd693d188e in_seq=0 out_seq=0 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f75117fa640 1 -- 172.21.15.79:0/1539226039 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55932e421900 con 0x55932e4e46e0 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f75117fa640 10 client.6594 handle_command_reply: tid=0 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 1 client.6594 shutdown 2024-06-10T00:19:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 1 -- 172.21.15.79:0/1539226039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 msgr2=0x55932e55f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.178+0000 7f753b5af740 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e55f850 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7524009960 tx=0x7f752402c070 comp rx=0 tx=0).stop 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 1 -- 172.21.15.79:0/1539226039 shutdown_connections 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55932e4ddb90 0x55932e4e41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55932e4d9af0 0x55932e4d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55932e4e46e0 0x55932e4f1900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 1 --2- 172.21.15.79:0/1539226039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55932e4d2930 0x55932e55f850 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f75117fa640 0 client.6594 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 1 -- 172.21.15.79:0/1539226039 >> 172.21.15.79:0/1539226039 conn(0x55932e4b86d0 msgr2=0x55932e4b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 1 -- 172.21.15.79:0/1539226039 shutdown_connections 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 1 -- 172.21.15.79:0/1539226039 wait complete. 2024-06-10T00:19:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753b5af740 20 client.6594 trim_cache size 0 max 16384 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "654d849a-04fb-42a3-aeb9-3112696272b8": { 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/subdir", 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "654d849a-04fb-42a3-aeb9-3112696272b8", 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive" 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:19:07.233 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 -- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f751406be30 msgr2=0x7f751406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f751406be30 0x7f751406e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7524034000 tx=0x7f752402e000 comp rx=0 tx=0).stop 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 -- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75340d0730 msgr2=0x7f7534150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75340d0730 0x7f7534150560 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f752800c400 tx=0x7f752800c8c0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 -- 172.21.15.79:0/2817159802 shutdown_connections 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7534155320 0x7f753415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75340d0730 0x7f7534150560 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 --2- 172.21.15.79:0/2817159802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75340b34e0 0x7f7534072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 -- 172.21.15.79:0/2817159802 >> 172.21.15.79:0/2817159802 conn(0x7f75340b1d10 msgr2=0x7f7534158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 -- 172.21.15.79:0/2817159802 shutdown_connections 2024-06-10T00:19:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:07.179+0000 7f753889e640 1 -- 172.21.15.79:0/2817159802 wait complete. 2024-06-10T00:19:07.236 INFO:tasks.cephfs.filesystem:scrub status for tag:654d849a-04fb-42a3-aeb9-3112696272b8 - {'path': '/subdir', 'tag': '654d849a-04fb-42a3-aeb9-3112696272b8', 'options': 'recursive'} 2024-06-10T00:19:14.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:19:14.176 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:19:37.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:19:37.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-06-10T00:19:37.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.351+0000 7f7c1fd5a640 1 Processor -- start 2024-06-10T00:19:37.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.352+0000 7f7c1fd5a640 1 -- start start 2024-06-10T00:19:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.352+0000 7f7c1fd5a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c180b3800 0x7f7c180cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.352+0000 7f7c1fd5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180cf190 0x7f7c180d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.352+0000 7f7c1fd5a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c180cf620 con 0x7f7c180d08f0 2024-06-10T00:19:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.352+0000 7f7c1fd5a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7c180d1c80 con 0x7f7c180b3800 2024-06-10T00:19:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.352+0000 7f7c1fd5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7c180b3cb0 con 0x7f7c180cf190 2024-06-10T00:19:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1e2f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180cf190 0x7f7c180d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1d2f5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c180b3800 0x7f7c180cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1daf6640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7c180d08f0 0x7f7c180d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:58488/0 (socket says 172.21.15.79:58488) 2024-06-10T00:19:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1daf6640 1 -- 172.21.15.79:0/500767801 learned_addr learned my addr 172.21.15.79:0/500767801 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:19:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1caf4640 1 -- 172.21.15.79:0/500767801 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586180946 0 0) 0x7f7c14001490 con 0x7f7c180d08f0 2024-06-10T00:19:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1caf4640 1 -- 172.21.15.79:0/500767801 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c04003520 con 0x7f7c180d08f0 2024-06-10T00:19:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/500767801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180cf190 msgr2=0x7f7c180d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/500767801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180cf190 0x7f7c180d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/500767801 >> v1:172.21.15.117:6789/0 conn(0x7f7c180d08f0 legacy=0x7f7c180d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/500767801 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c180cf8a0 con 0x7f7c180b3800 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.353+0000 7f7c1e2f7640 1 --2- 172.21.15.79:0/500767801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180cf190 0x7f7c180d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.354+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/500767801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180b3800 0x7f7c180cec50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7c080097d0 tx=0x7f7c0802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fe8807212f1d61c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.354+0000 7f7c1caf4640 1 -- 172.21.15.79:0/500767801 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08037070 con 0x7f7c180b3800 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.354+0000 7f7c1caf4640 1 -- 172.21.15.79:0/500767801 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c08032440 con 0x7f7c180b3800 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.354+0000 7f7c1caf4640 1 -- 172.21.15.79:0/500767801 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c080327f0 con 0x7f7c180b3800 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.355+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/500767801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180b3800 msgr2=0x7f7c180cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.355+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/500767801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180b3800 0x7f7c180cec50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7c080097d0 tx=0x7f7c0802a1c0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.355+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/500767801 shutdown_connections 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.355+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/500767801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180cf190 0x7f7c180d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.355+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/500767801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180b3800 0x7f7c180cec50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.355+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/500767801 >> 172.21.15.79:0/500767801 conn(0x7f7c1809d3c0 msgr2=0x7f7c180d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.355+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/500767801 shutdown_connections 2024-06-10T00:19:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.355+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/500767801 wait complete. 2024-06-10T00:19:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.356+0000 7f7c1fd5a640 1 Processor -- start 2024-06-10T00:19:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.356+0000 7f7c1fd5a640 1 -- start start 2024-06-10T00:19:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.357+0000 7f7c1fd5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180b3800 0x7f7c181f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.357+0000 7f7c1fd5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c180cf190 0x7f7c181e6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.357+0000 7f7c1fd5a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180d08f0 0x7f7c181f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.357+0000 7f7c1fd5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c180d1ed0 con 0x7f7c180cf190 2024-06-10T00:19:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.357+0000 7f7c1fd5a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c180cfe60 con 0x7f7c180d08f0 2024-06-10T00:19:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.357+0000 7f7c1fd5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7c180b50c0 con 0x7f7c180b3800 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c180cf190 0x7f7c181e6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c180cf190 0x7f7c181e6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49432/0 (socket says 172.21.15.79:49432) 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/661091551 learned_addr learned my addr 172.21.15.79:0/661091551 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1e2f7640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180d08f0 0x7f7c181f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180b3800 0x7f7c181f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/661091551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180b3800 msgr2=0x7f7c181f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180b3800 0x7f7c181f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/661091551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180d08f0 msgr2=0x7f7c181f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180d08f0 0x7f7c181f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/661091551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c181e7000 con 0x7f7c180cf190 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c180cf190 0x7f7c181e6ac0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7c080098f0 tx=0x7f7c080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c0e7fc640 1 -- 172.21.15.79:0/661091551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08041020 con 0x7f7c180cf190 2024-06-10T00:19:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c0e7fc640 1 -- 172.21.15.79:0/661091551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0803d620 con 0x7f7c180cf190 2024-06-10T00:19:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/661091551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c180caaf0 con 0x7f7c180cf190 2024-06-10T00:19:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c0e7fc640 1 -- 172.21.15.79:0/661091551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08037040 con 0x7f7c180cf190 2024-06-10T00:19:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.358+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/661091551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c180c8340 con 0x7f7c180cf190 2024-06-10T00:19:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.360+0000 7f7c0e7fc640 1 -- 172.21.15.79:0/661091551 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c08044020 con 0x7f7c180cf190 2024-06-10T00:19:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.360+0000 7f7c0e7fc640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7bfc06be30 0x7f7bfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.360+0000 7f7c0e7fc640 1 -- 172.21.15.79:0/661091551 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f7c080ab6e0 con 0x7f7c180cf190 2024-06-10T00:19:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.360+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7bfc06be30 0x7f7bfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.361+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7bfc06be30 0x7f7bfc06e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c14005c00 tx=0x7f7c14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.361+0000 7f7c22a62740 1 Processor -- start 2024-06-10T00:19:37.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c22a62740 1 -- start start 2024-06-10T00:19:37.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb309af0 0x55a8fb2e6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb2e11a0 0x55a8fb2e6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb2e86d0 0x55a8fb2e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c22a62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8fb20b7e0 con 0x55a8fb309af0 2024-06-10T00:19:37.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c22a62740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a8fb249e80 con 0x55a8fb2e86d0 2024-06-10T00:19:37.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c22a62740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a8fb1e7700 con 0x55a8fb2e11a0 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c1daf6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb309af0 0x55a8fb2e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c1daf6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb309af0 0x55a8fb2e6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49438/0 (socket says 172.21.15.79:49438) 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.362+0000 7f7c1daf6640 1 -- 172.21.15.79:0/375613234 learned_addr learned my addr 172.21.15.79:0/375613234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7c1daf6640 1 -- 172.21.15.79:0/375613234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb2e11a0 msgr2=0x55a8fb2e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/375613234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb2e11a0 0x55a8fb2e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7c1daf6640 1 -- 172.21.15.79:0/375613234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb2e86d0 msgr2=0x55a8fb2e6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7c1e2f7640 1 --2- 172.21.15.79:0/375613234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb2e86d0 0x55a8fb2e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/375613234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb2e86d0 0x55a8fb2e6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7c1daf6640 1 -- 172.21.15.79:0/375613234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8fb206dd0 con 0x55a8fb309af0 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/375613234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb309af0 0x55a8fb2e6120 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400edb0 tx=0x7f7c14011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba581f89f59f8839 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7bfb7fe640 1 -- 172.21.15.79:0/375613234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14007860 con 0x55a8fb309af0 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7bfb7fe640 1 -- 172.21.15.79:0/375613234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c14007a00 con 0x55a8fb309af0 2024-06-10T00:19:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.363+0000 7f7bfb7fe640 1 -- 172.21.15.79:0/375613234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14021690 con 0x55a8fb309af0 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 -- 172.21.15.79:0/375613234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb309af0 msgr2=0x55a8fb2e6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 --2- 172.21.15.79:0/375613234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb309af0 0x55a8fb2e6120 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400edb0 tx=0x7f7c14011000 comp rx=0 tx=0).stop 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 -- 172.21.15.79:0/375613234 shutdown_connections 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 --2- 172.21.15.79:0/375613234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb2e86d0 0x55a8fb2e6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 --2- 172.21.15.79:0/375613234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb2e11a0 0x55a8fb2e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 --2- 172.21.15.79:0/375613234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb309af0 0x55a8fb2e6120 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 -- 172.21.15.79:0/375613234 >> 172.21.15.79:0/375613234 conn(0x55a8fb2e3410 msgr2=0x55a8fb32bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 -- 172.21.15.79:0/375613234 shutdown_connections 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 -- 172.21.15.79:0/375613234 wait complete. 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 -- start start 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.364+0000 7f7c22a62740 1 Processor -- start 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb309af0 0x55a8fb30d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb3107e0 0x55a8fb310bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb30ef50 0x55a8fb30f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c22a62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8fb1d2640 con 0x55a8fb3107e0 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c22a62740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a8fb245e40 con 0x55a8fb309af0 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c22a62740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a8fb2e4be0 con 0x55a8fb30ef50 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c22a62740 10 client.0 _ll_register_callbacks cb 0x55a8fb204430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c1d2f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb3107e0 0x55a8fb310bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c1d2f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb3107e0 0x55a8fb310bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49450/0 (socket says 172.21.15.79:49450) 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.365+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/399598967 learned_addr learned my addr 172.21.15.79:0/399598967 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c1e2f7640 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb30ef50 0x55a8fb30f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb309af0 0x55a8fb30d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/399598967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb30ef50 msgr2=0x55a8fb30f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb30ef50 0x55a8fb30f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/399598967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb309af0 msgr2=0x55a8fb30d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb309af0 0x55a8fb30d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/399598967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8fb0277d0 con 0x55a8fb3107e0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb3107e0 0x55a8fb310bc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7c0802a7b0 tx=0x7f7c080791e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5573316925966199 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7bf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/399598967 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08079c20 con 0x55a8fb3107e0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/399598967 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f7c08081f10 con 0x55a8fb3107e0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c22a62740 1 -- 172.21.15.79:0/399598967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c14007a00 con 0x55a8fb3107e0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/399598967 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7c0807db70 con 0x55a8fb3107e0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c22a62740 10 client.6603 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c22a62740 1 -- 172.21.15.79:0/399598967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55a8faf5d3f0 con 0x55a8fb3107e0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/399598967 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c14007a00 con 0x55a8fb3107e0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/399598967 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f7c0803a030 con 0x55a8fb3107e0 2024-06-10T00:19:37.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c22a62740 10 client.6603 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c22a62740 10 client.6603 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.366+0000 7f7c22a62740 20 client.6603 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.367+0000 7f7c22a62740 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55a8fb3131e0 0x55a8fb3135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.367+0000 7f7c22a62740 4 client.6603 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.367+0000 7f7c22a62740 1 -- 172.21.15.79:0/399598967 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8fb2575b0 con 0x55a8fb3131e0 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.367+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55a8fb3131e0 0x55a8fb3135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.367+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55a8fb3131e0 0x55a8fb3135f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c3b9c308a2c1e8 server_cookie=3468eee05892a774 in_seq=0 out_seq=0 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.367+0000 7f7bf8ff9640 10 client.6603 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.367+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/399598967 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a8fb2575b0 con 0x55a8fb3131e0 2024-06-10T00:19:37.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.367+0000 7f7bf8ff9640 10 client.6603 handle_command_reply: tid=0 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 client.6603 shutdown 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 -- 172.21.15.79:0/399598967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb3107e0 msgr2=0x55a8fb310bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb3107e0 0x55a8fb310bc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7c0802a7b0 tx=0x7f7c080791e0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 -- 172.21.15.79:0/399598967 shutdown_connections 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb30ef50 0x55a8fb30f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55a8fb3131e0 0x55a8fb3135f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb3107e0 0x55a8fb310bc0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 --2- 172.21.15.79:0/399598967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb309af0 0x55a8fb30d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 -- 172.21.15.79:0/399598967 >> 172.21.15.79:0/399598967 conn(0x55a8fb2e86d0 msgr2=0x55a8fb2e5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7bf8ff9640 0 client.6603 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 -- 172.21.15.79:0/399598967 shutdown_connections 2024-06-10T00:19:37.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 1 -- 172.21.15.79:0/399598967 wait complete. 2024-06-10T00:19:37.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.368+0000 7f7c22a62740 20 client.6603 trim_cache size 0 max 16384 2024-06-10T00:19:37.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.386+0000 7f7c22a62740 1 Processor -- start 2024-06-10T00:19:37.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.386+0000 7f7c22a62740 1 -- start start 2024-06-10T00:19:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.386+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 0x55a8fb2e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.386+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb3136c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.386+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb34fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.386+0000 7f7c22a62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c18200f10 con 0x55a8fb30ef50 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.386+0000 7f7c22a62740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c181fff30 con 0x55a8fb3107e0 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.386+0000 7f7c22a62740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7c180c9620 con 0x55a8fb309af0 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb3136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb3136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49464/0 (socket says 172.21.15.79:49464) 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/1401843457 learned_addr learned my addr 172.21.15.79:0/1401843457 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/1401843457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 msgr2=0x55a8fb2e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/1401843457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 0x55a8fb2e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/1401843457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 msgr2=0x55a8fb34fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1e2f7640 1 --2- 172.21.15.79:0/1401843457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb34fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/1401843457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb34fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/1401843457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8fb310f30 con 0x55a8fb30ef50 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/1401843457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb3136c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7c08079f10 tx=0x7f7c0803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b7fdb5240517d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7bfaffd640 1 -- 172.21.15.79:0/1401843457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08098de0 con 0x55a8fb30ef50 2024-06-10T00:19:37.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7bfaffd640 1 -- 172.21.15.79:0/1401843457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c080a9e50 con 0x55a8fb30ef50 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.387+0000 7f7bfaffd640 1 -- 172.21.15.79:0/1401843457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08082150 con 0x55a8fb30ef50 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 -- 172.21.15.79:0/1401843457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 msgr2=0x55a8fb3136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 --2- 172.21.15.79:0/1401843457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb3136c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7c08079f10 tx=0x7f7c0803e000 comp rx=0 tx=0).stop 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 -- 172.21.15.79:0/1401843457 shutdown_connections 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 --2- 172.21.15.79:0/1401843457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb34fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 --2- 172.21.15.79:0/1401843457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb3136c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 --2- 172.21.15.79:0/1401843457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 0x55a8fb2e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 -- 172.21.15.79:0/1401843457 >> 172.21.15.79:0/1401843457 conn(0x55a8fb2e86d0 msgr2=0x55a8fb30ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 -- 172.21.15.79:0/1401843457 shutdown_connections 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 -- 172.21.15.79:0/1401843457 wait complete. 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 -- start start 2024-06-10T00:19:37.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.388+0000 7f7c22a62740 1 Processor -- start 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 0x55a8fb30a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb38fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c22a62740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb304b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c22a62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8fb314480 con 0x55a8fb30ef50 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c22a62740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c180c9c70 con 0x55a8fb3107e0 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c22a62740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a8fb310c30 con 0x55a8fb309af0 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c22a62740 10 client.0 _ll_register_callbacks cb 0x7f7c08079300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c1d2f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb38fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c1d2f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb38fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49468/0 (socket says 172.21.15.79:49468) 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.389+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/3183158248 learned_addr learned my addr 172.21.15.79:0/3183158248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 0x55a8fb30a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1e2f7640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb304b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 msgr2=0x55a8fb30a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 0x55a8fb30a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 msgr2=0x55a8fb304b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb304b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1d2f5640 1 -- 172.21.15.79:0/3183158248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8faf1d0f0 con 0x55a8fb30ef50 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1e2f7640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb304b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 0x55a8fb30a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c1d2f5640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb38fff0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7c08075c20 tx=0x7f7c08079250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f382fce7eb4b9efb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7bf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:37.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/3183158248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c080823f0 con 0x55a8fb30ef50 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/3183158248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f7c0807aaf0 con 0x55a8fb30ef50 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 1 -- 172.21.15.79:0/3183158248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c080a9e50 con 0x55a8fb30ef50 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/3183158248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7c0807ad10 con 0x55a8fb30ef50 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 10 client.6609 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 1 -- 172.21.15.79:0/3183158248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55a8fb210560 con 0x55a8fb30ef50 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/3183158248 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c080a9e50 con 0x55a8fb30ef50 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/3183158248 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f7c08098be0 con 0x55a8fb30ef50 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 10 client.6609 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 10 client.6609 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 20 client.6609 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:37.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55a8fb3050d0 0x55a8fb2e4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 4 client.6609 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.390+0000 7f7c22a62740 1 -- 172.21.15.79:0/3183158248 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a8fb3124e0 con 0x55a8fb3050d0 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55a8fb3050d0 0x55a8fb2e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7bf8ff9640 10 client.6609 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c1daf6640 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55a8fb3050d0 0x55a8fb2e4800 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6911f2498e2d59c4 server_cookie=e83e671310cc44da in_seq=0 out_seq=0 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7bf8ff9640 1 -- 172.21.15.79:0/3183158248 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a8fb3124e0 con 0x55a8fb3050d0 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7bf8ff9640 10 client.6609 handle_command_reply: tid=0 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 client.6609 shutdown 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 -- 172.21.15.79:0/3183158248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 msgr2=0x55a8fb38fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb38fff0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7c08075c20 tx=0x7f7c08079250 comp rx=0 tx=0).stop 2024-06-10T00:19:37.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 -- 172.21.15.79:0/3183158248 shutdown_connections 2024-06-10T00:19:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8fb3107e0 0x55a8fb304b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55a8fb3050d0 0x55a8fb2e4800 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8fb30ef50 0x55a8fb38fff0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 --2- 172.21.15.79:0/3183158248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8fb309af0 0x55a8fb30a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7bf8ff9640 0 client.6609 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 -- 172.21.15.79:0/3183158248 >> 172.21.15.79:0/3183158248 conn(0x55a8fb2e86d0 msgr2=0x55a8fb32f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 -- 172.21.15.79:0/3183158248 shutdown_connections 2024-06-10T00:19:37.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 1 -- 172.21.15.79:0/3183158248 wait complete. 2024-06-10T00:19:37.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.391+0000 7f7c22a62740 20 client.6609 trim_cache size 0 max 16384 2024-06-10T00:19:37.399 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:19:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:19:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:19:37.399 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:19:37.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7bfc06be30 msgr2=0x7f7bfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7bfc06be30 0x7f7bfc06e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c14005c00 tx=0x7f7c14009040 comp rx=0 tx=0).stop 2024-06-10T00:19:37.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c180cf190 msgr2=0x7f7c181e6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c180cf190 0x7f7c181e6ac0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7c080098f0 tx=0x7f7c080046c0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/661091551 shutdown_connections 2024-06-10T00:19:37.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7bfc06be30 0x7f7bfc06e2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180d08f0 0x7f7c181f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c180cf190 0x7f7c181e6ac0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 --2- 172.21.15.79:0/661091551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180b3800 0x7f7c181f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/661091551 >> 172.21.15.79:0/661091551 conn(0x7f7c1809d3c0 msgr2=0x7f7c180b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/661091551 shutdown_connections 2024-06-10T00:19:37.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.392+0000 7f7c1fd5a640 1 -- 172.21.15.79:0/661091551 wait complete. 2024-06-10T00:19:37.402 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:19:37.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:19:37.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.501+0000 7f1227822640 1 Processor -- start 2024-06-10T00:19:37.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.501+0000 7f1227822640 1 -- start start 2024-06-10T00:19:37.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f1227822640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f12200cc6d0 0x7f12200ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f1227822640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12200ccff0 con 0x7f1220072110 2024-06-10T00:19:37.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f1227822640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1220072820 con 0x7f1220071c60 2024-06-10T00:19:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f1227822640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1220072b00 con 0x7f12200cc6d0 2024-06-10T00:19:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f12255be640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f12200cc6d0 0x7f12200ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f1225dbf640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1220072110 0x7f12200b3dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51224/0 (socket says 172.21.15.79:51224) 2024-06-10T00:19:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f1225dbf640 1 -- 172.21.15.79:0/3968586737 learned_addr learned my addr 172.21.15.79:0/3968586737 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:19:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f12255be640 1 -- 172.21.15.79:0/3968586737 >> v1:172.21.15.117:6789/0 conn(0x7f1220071c60 legacy=0x7f12200b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f12255be640 1 -- 172.21.15.79:0/3968586737 >> v1:172.21.15.79:6789/0 conn(0x7f1220072110 legacy=0x7f12200b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f12255be640 1 -- 172.21.15.79:0/3968586737 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1220072de0 con 0x7f12200cc6d0 2024-06-10T00:19:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.502+0000 7f1217fff640 1 -- 172.21.15.79:0/3968586737 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983184479 0 0) 0x7f12200ccff0 con 0x7f1220072110 2024-06-10T00:19:37.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f12255be640 1 --2- 172.21.15.79:0/3968586737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12200cc6d0 0x7f12200ccab0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f12100097a0 tx=0x7f121002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01826f542eeabe1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1217fff640 1 -- 172.21.15.79:0/3968586737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1210037070 con 0x7f12200cc6d0 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1217fff640 1 -- 172.21.15.79:0/3968586737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1210032440 con 0x7f12200cc6d0 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1217fff640 1 -- 172.21.15.79:0/3968586737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1210032810 con 0x7f12200cc6d0 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1227822640 1 -- 172.21.15.79:0/3968586737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12200cc6d0 msgr2=0x7f12200ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1227822640 1 --2- 172.21.15.79:0/3968586737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12200cc6d0 0x7f12200ccab0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f12100097a0 tx=0x7f121002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1227822640 1 -- 172.21.15.79:0/3968586737 shutdown_connections 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1227822640 1 --2- 172.21.15.79:0/3968586737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12200cc6d0 0x7f12200ccab0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1227822640 1 -- 172.21.15.79:0/3968586737 >> 172.21.15.79:0/3968586737 conn(0x7f12200b19f0 msgr2=0x7f12200b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.503+0000 7f1227822640 1 -- 172.21.15.79:0/3968586737 shutdown_connections 2024-06-10T00:19:37.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.504+0000 7f1227822640 1 -- 172.21.15.79:0/3968586737 wait complete. 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1227822640 1 Processor -- start 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1227822640 1 -- start start 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1227822640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1220071c60 0x7f1220147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1227822640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1220072110 0x7f12200cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1227822640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12200cc6d0 0x7f12200d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1227822640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f122015c890 con 0x7f1220072110 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1227822640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1220072540 con 0x7f12200cc6d0 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1227822640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1220159f60 con 0x7f1220071c60 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.505+0000 7f1224dbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1220072110 0x7f12200cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1224dbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1220072110 0x7f12200cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49478/0 (socket says 172.21.15.79:49478) 2024-06-10T00:19:37.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1224dbd640 1 -- 172.21.15.79:0/1579991253 learned_addr learned my addr 172.21.15.79:0/1579991253 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1224dbd640 1 -- 172.21.15.79:0/1579991253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1220071c60 msgr2=0x7f1220147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f12255be640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1220071c60 0x7f1220147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1225dbf640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12200cc6d0 0x7f12200d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1224dbd640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1220071c60 0x7f1220147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1224dbd640 1 -- 172.21.15.79:0/1579991253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12200cc6d0 msgr2=0x7f12200d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1224dbd640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12200cc6d0 0x7f12200d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1224dbd640 1 -- 172.21.15.79:0/1579991253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12201580f0 con 0x7f1220072110 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1224dbd640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1220072110 0x7f12200cfe80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f121c00b3e0 tx=0x7f121c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1215ffb640 1 -- 172.21.15.79:0/1579991253 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c015020 con 0x7f1220072110 2024-06-10T00:19:37.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1215ffb640 1 -- 172.21.15.79:0/1579991253 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c011850 con 0x7f1220072110 2024-06-10T00:19:37.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12201583d0 con 0x7f1220072110 2024-06-10T00:19:37.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1215ffb640 1 -- 172.21.15.79:0/1579991253 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c011c40 con 0x7f1220072110 2024-06-10T00:19:37.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.506+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1220158990 con 0x7f1220072110 2024-06-10T00:19:37.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.507+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1220068430 con 0x7f1220072110 2024-06-10T00:19:37.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.508+0000 7f1215ffb640 1 -- 172.21.15.79:0/1579991253 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f121c018020 con 0x7f1220072110 2024-06-10T00:19:37.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.508+0000 7f1215ffb640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f120406be30 0x7f120406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.508+0000 7f1215ffb640 1 -- 172.21.15.79:0/1579991253 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f121c08af90 con 0x7f1220072110 2024-06-10T00:19:37.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.508+0000 7f12255be640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f120406be30 0x7f120406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.509+0000 7f12255be640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f120406be30 0x7f120406e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1210034000 tx=0x7f121002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.512+0000 7f1215ffb640 1 -- 172.21.15.79:0/1579991253 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f121c01f020 con 0x7f1220072110 2024-06-10T00:19:37.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.720+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12200aea80 con 0x7f1220072110 2024-06-10T00:19:37.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.720+0000 7f1215ffb640 1 -- 172.21.15.79:0/1579991253 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5184 (secure 0 0 0) 0x7f121c0172c0 con 0x7f1220072110 2024-06-10T00:19:37.720 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:19:37.720 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:19:03.818027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6471,"qdb_cluster":[6471]},"id":5}]} 2024-06-10T00:19:37.721 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 43 2024-06-10T00:19:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.722+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f120406be30 msgr2=0x7f120406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.722+0000 7f1227822640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f120406be30 0x7f120406e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1210034000 tx=0x7f121002e000 comp rx=0 tx=0).stop 2024-06-10T00:19:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.722+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1220072110 msgr2=0x7f12200cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.722+0000 7f1227822640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1220072110 0x7f12200cfe80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f121c00b3e0 tx=0x7f121c00b8a0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.722+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 shutdown_connections 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.723+0000 7f1227822640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f120406be30 0x7f120406e2f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.723+0000 7f1227822640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12200cc6d0 0x7f12200d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.723+0000 7f1227822640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1220072110 0x7f12200cfe80 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.723+0000 7f1227822640 1 --2- 172.21.15.79:0/1579991253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1220071c60 0x7f1220147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.723+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 >> 172.21.15.79:0/1579991253 conn(0x7f12200b19f0 msgr2=0x7f122015ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.723+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 shutdown_connections 2024-06-10T00:19:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.723+0000 7f1227822640 1 -- 172.21.15.79:0/1579991253 wait complete. 2024-06-10T00:19:37.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-06-10T00:19:37.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.835+0000 7f8b6bc31640 1 Processor -- start 2024-06-10T00:19:37.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.835+0000 7f8b6bc31640 1 -- start start 2024-06-10T00:19:37.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b6bc31640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b64155320 0x7f8b640b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b6bc31640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640b34e0 0x7f8b640d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b6bc31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b640d0560 0x7f8b6406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b6bc31640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8b64155700 con 0x7f8b64155320 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b6bc31640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6415b6b0 con 0x7f8b640d0560 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b6bc31640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6415b990 con 0x7f8b640b34e0 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b699cd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b64155320 0x7f8b640b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b699cd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b64155320 0x7f8b640b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49494/0 (socket says 172.21.15.79:49494) 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b699cd640 1 -- 172.21.15.79:0/1551640269 learned_addr learned my addr 172.21.15.79:0/1551640269 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b699cd640 1 -- 172.21.15.79:0/1551640269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640b34e0 msgr2=0x7f8b640d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1551640269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640b34e0 0x7f8b640d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b699cd640 1 -- 172.21.15.79:0/1551640269 >> v2:172.21.15.117:3300/0 conn(0x7f8b640d0560 msgr2=0x7f8b6406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1551640269 >> v2:172.21.15.117:3300/0 conn(0x7f8b640d0560 0x7f8b6406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.836+0000 7f8b699cd640 1 -- 172.21.15.79:0/1551640269 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6415bc70 con 0x7f8b64155320 2024-06-10T00:19:37.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.837+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1551640269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b640b2fa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8b64158e20 tx=0x7f8b6002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72167e98fd4aa07f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.837+0000 7f8b689cb640 1 -- 172.21.15.79:0/1551640269 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60032790 con 0x7f8b64155320 2024-06-10T00:19:37.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.837+0000 7f8b689cb640 1 -- 172.21.15.79:0/1551640269 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b60038070 con 0x7f8b64155320 2024-06-10T00:19:37.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.837+0000 7f8b689cb640 1 -- 172.21.15.79:0/1551640269 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60032b50 con 0x7f8b64155320 2024-06-10T00:19:37.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.837+0000 7f8b6bc31640 1 -- 172.21.15.79:0/1551640269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 msgr2=0x7f8b640b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.837+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/1551640269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b640b2fa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8b64158e20 tx=0x7f8b6002c890 comp rx=0 tx=0).stop 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.838+0000 7f8b6bc31640 1 -- 172.21.15.79:0/1551640269 shutdown_connections 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.838+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/1551640269 >> v2:172.21.15.117:3300/0 conn(0x7f8b640d0560 0x7f8b6406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.838+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/1551640269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640b34e0 0x7f8b640d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.838+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/1551640269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b640b2fa0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.838+0000 7f8b6bc31640 1 -- 172.21.15.79:0/1551640269 >> 172.21.15.79:0/1551640269 conn(0x7f8b640b1d10 msgr2=0x7f8b640b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.838+0000 7f8b6bc31640 1 -- 172.21.15.79:0/1551640269 shutdown_connections 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.838+0000 7f8b6bc31640 1 -- 172.21.15.79:0/1551640269 wait complete. 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.839+0000 7f8b6bc31640 1 Processor -- start 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.839+0000 7f8b6bc31640 1 -- start start 2024-06-10T00:19:37.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.839+0000 7f8b6bc31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b640b34e0 0x7f8b6409b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.839+0000 7f8b6bc31640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640d0560 0x7f8b6409b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.839+0000 7f8b6bc31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b6409c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6bc31640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6415b470 con 0x7f8b64155320 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6bc31640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6415b2f0 con 0x7f8b640b34e0 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6bc31640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6406e730 con 0x7f8b640d0560 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b6409c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b6409c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49504/0 (socket says 172.21.15.79:49504) 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 -- 172.21.15.79:0/165086705 learned_addr learned my addr 172.21.15.79:0/165086705 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b699cd640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b640b34e0 0x7f8b6409b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 -- 172.21.15.79:0/165086705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640d0560 msgr2=0x7f8b6409b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b691cc640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640d0560 0x7f8b6409b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640d0560 0x7f8b6409b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 -- 172.21.15.79:0/165086705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b640b34e0 msgr2=0x7f8b6409b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b640b34e0 0x7f8b6409b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 -- 172.21.15.79:0/165086705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b640cd710 con 0x7f8b64155320 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b6409c140 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b970 tx=0x7f8b5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b5a7fc640 1 -- 172.21.15.79:0/165086705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c019070 con 0x7f8b64155320 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b5a7fc640 1 -- 172.21.15.79:0/165086705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c00cb60 con 0x7f8b64155320 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6bc31640 1 -- 172.21.15.79:0/165086705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b640cd9f0 con 0x7f8b64155320 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b5a7fc640 1 -- 172.21.15.79:0/165086705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c014440 con 0x7f8b64155320 2024-06-10T00:19:37.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.840+0000 7f8b6bc31640 1 -- 172.21.15.79:0/165086705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b640cdfb0 con 0x7f8b64155320 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.842+0000 7f8b5a7fc640 1 -- 172.21.15.79:0/165086705 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b5c01c070 con 0x7f8b64155320 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.842+0000 7f8b5a7fc640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4806be30 0x7f8b4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.842+0000 7f8b5a7fc640 1 -- 172.21.15.79:0/165086705 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8b5c08ad20 con 0x7f8b64155320 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.842+0000 7f8b699cd640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4806be30 0x7f8b4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.843+0000 7f8b699cd640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4806be30 0x7f8b4806e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8b60037000 tx=0x7f8b60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.843+0000 7f8b6ea1c740 1 Processor -- start 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.843+0000 7f8b6ea1c740 1 -- start start 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2d89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db3084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db308a00 0x55c0db2dd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c0db241d80 con 0x55c0db326020 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c0db1df2f0 con 0x55c0db308a00 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c0db23dd40 con 0x55c0db309140 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b699cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2d89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b699cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2d89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49514/0 (socket says 172.21.15.79:49514) 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b699cd640 1 -- 172.21.15.79:0/4069304907 learned_addr learned my addr 172.21.15.79:0/4069304907 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b691cc640 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db3084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db308a00 0x55c0db2dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b699cd640 1 -- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 msgr2=0x55c0db3084c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b699cd640 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db3084c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b699cd640 1 -- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db308a00 msgr2=0x55c0db2dd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.844+0000 7f8b699cd640 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db308a00 0x55c0db2dd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b699cd640 1 -- 172.21.15.79:0/4069304907 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0db0217c0 con 0x55c0db326020 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db308a00 0x55c0db2dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b699cd640 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2d89b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8b60032a80 tx=0x7f8b60031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c035c3bd12bbbbb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b477fe640 1 -- 172.21.15.79:0/4069304907 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6004e070 con 0x55c0db326020 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b477fe640 1 -- 172.21.15.79:0/4069304907 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b60038040 con 0x55c0db326020 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b477fe640 1 -- 172.21.15.79:0/4069304907 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6003cce0 con 0x55c0db326020 2024-06-10T00:19:37.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/4069304907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 msgr2=0x55c0db2d89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2d89b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8b60032a80 tx=0x7f8b60031000 comp rx=0 tx=0).stop 2024-06-10T00:19:37.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/4069304907 shutdown_connections 2024-06-10T00:19:37.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db308a00 0x55c0db2dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db3084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/4069304907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2d89b0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.845+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/4069304907 >> 172.21.15.79:0/4069304907 conn(0x55c0db2dac20 msgr2=0x55c0db3234c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.846+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/4069304907 shutdown_connections 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.846+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/4069304907 wait complete. 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.846+0000 7f8b6ea1c740 1 -- start start 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.846+0000 7f8b6ea1c740 1 Processor -- start 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 0x55c0db2f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db31a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db2f9080 0x55c0db2f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c0db2dcdd0 con 0x55c0db326020 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c0db1dcda0 con 0x55c0db309140 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c0db2dc1c0 con 0x55c0db2f9080 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b6ea1c740 10 client.0 _ll_register_callbacks cb 0x55c0daf54ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b691cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db31a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b691cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db31a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49518/0 (socket says 172.21.15.79:49518) 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b691cc640 1 -- 172.21.15.79:0/1915281577 learned_addr learned my addr 172.21.15.79:0/1915281577 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 0x55c0db2f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db2f9080 0x55c0db2f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b691cc640 1 -- 172.21.15.79:0/1915281577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db2f9080 msgr2=0x55c0db2f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b691cc640 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db2f9080 0x55c0db2f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b691cc640 1 -- 172.21.15.79:0/1915281577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 msgr2=0x55c0db2f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b691cc640 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 0x55c0db2f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.847+0000 7f8b691cc640 1 -- 172.21.15.79:0/1915281577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0db081f50 con 0x55c0db326020 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b691cc640 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db31a180 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400f4f0 tx=0x7f8b5400f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f4fd1498546396 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1915281577 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54013850 con 0x55c0db326020 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1915281577 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8b540139f0 con 0x55c0db326020 2024-06-10T00:19:37.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1915281577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b60038040 con 0x55c0db326020 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1915281577 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f8b54013c30 con 0x55c0db326020 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 10 client.6630 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1915281577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55c0daf150b0 con 0x55c0db326020 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1915281577 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b60038040 con 0x55c0db326020 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1915281577 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f8b54026080 con 0x55c0db326020 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 10 client.6630 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 10 client.6630 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 20 client.6630 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55c0db309c70 0x55c0db30a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 4 client.6630 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1915281577 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0db24f4b0 con 0x55c0db309c70 2024-06-10T00:19:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.848+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55c0db309c70 0x55c0db30a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b44ff9640 10 client.6630 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55c0db309c70 0x55c0db30a050 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccb8d074c01b41a8 server_cookie=9c2969e8552d026f in_seq=0 out_seq=0 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1915281577 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c0db24f4b0 con 0x55c0db309c70 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b44ff9640 10 client.6630 handle_command_reply: tid=0 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 client.6630 shutdown 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1915281577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 msgr2=0x55c0db31a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db31a180 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400f4f0 tx=0x7f8b5400f9b0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1915281577 shutdown_connections 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db2f9080 0x55c0db2f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55c0db309c70 0x55c0db30a050 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db31a180 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b44ff9640 0 client.6630 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1915281577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 0x55c0db2f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.849+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1915281577 >> 172.21.15.79:0/1915281577 conn(0x55c0db308a00 msgr2=0x55c0db3255a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.850+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1915281577 shutdown_connections 2024-06-10T00:19:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.850+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1915281577 wait complete. 2024-06-10T00:19:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.850+0000 7f8b6ea1c740 20 client.6630 trim_cache size 0 max 16384 2024-06-10T00:19:37.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.863+0000 7f8b6ea1c740 1 Processor -- start 2024-06-10T00:19:37.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.863+0000 7f8b6ea1c740 1 -- start start 2024-06-10T00:19:37.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db2f9080 0x55c0db2d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db2de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2de920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641ffdc0 con 0x55c0db326020 2024-06-10T00:19:37.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641ff100 con 0x55c0db2f9080 2024-06-10T00:19:37.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b641ff750 con 0x55c0db309140 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2de920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2de920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49520/0 (socket says 172.21.15.79:49520) 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 -- 172.21.15.79:0/1084096628 learned_addr learned my addr 172.21.15.79:0/1084096628 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db2f9080 0x55c0db2d7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b691cc640 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db2de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 -- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 msgr2=0x55c0db2de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db2de3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 -- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db2f9080 msgr2=0x55c0db2d7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db2f9080 0x55c0db2d7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 -- 172.21.15.79:0/1084096628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0db2dbd50 con 0x55c0db326020 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b691cc640 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db2de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.864+0000 7f8b6a1ce640 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2de920 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c058e10 tx=0x7f8b5c00e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4563ed6c316232fe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b46ffd640 1 -- 172.21.15.79:0/1084096628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c0554f0 con 0x55c0db326020 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b46ffd640 1 -- 172.21.15.79:0/1084096628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c0615d0 con 0x55c0db326020 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b46ffd640 1 -- 172.21.15.79:0/1084096628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c055690 con 0x55c0db326020 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1084096628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 msgr2=0x55c0db2de920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2de920 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c058e10 tx=0x7f8b5c00e040 comp rx=0 tx=0).stop 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1084096628 shutdown_connections 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db326020 0x55c0db2de920 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db309140 0x55c0db2de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1084096628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db2f9080 0x55c0db2d7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1084096628 >> 172.21.15.79:0/1084096628 conn(0x55c0db308a00 msgr2=0x55c0db325380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1084096628 shutdown_connections 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.865+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1084096628 wait complete. 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.866+0000 7f8b6ea1c740 1 -- start start 2024-06-10T00:19:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.866+0000 7f8b6ea1c740 1 Processor -- start 2024-06-10T00:19:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db2f9080 0x55c0db326740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 0x55c0db326c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db326020 0x55c0db331bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c0db31b370 con 0x55c0db2f9080 2024-06-10T00:19:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c0db31adb0 con 0x55c0db309140 2024-06-10T00:19:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c0db324ac0 con 0x55c0db326020 2024-06-10T00:19:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 10 client.0 _ll_register_callbacks cb 0x7f8b5400a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db2f9080 0x55c0db326740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db2f9080 0x55c0db326740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49534/0 (socket says 172.21.15.79:49534) 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 -- 172.21.15.79:0/1422803891 learned_addr learned my addr 172.21.15.79:0/1422803891 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 -- 172.21.15.79:0/1422803891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db326020 msgr2=0x55c0db331bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db326020 0x55c0db331bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 -- 172.21.15.79:0/1422803891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 msgr2=0x55c0db326c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 0x55c0db326c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 -- 172.21.15.79:0/1422803891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0db347ae0 con 0x55c0db2f9080 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b699cd640 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db2f9080 0x55c0db326740 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000bc00 tx=0x7f8b60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fbf60847bbe3a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1422803891 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6004e040 con 0x55c0db2f9080 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1422803891 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8b6005fca0 con 0x55c0db2f9080 2024-06-10T00:19:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1422803891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b5c0615d0 con 0x55c0db2f9080 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1422803891 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f8b60066050 con 0x55c0db2f9080 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 10 client.6636 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.867+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1422803891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55c0db2d9e90 con 0x55c0db2f9080 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1422803891 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c0615d0 con 0x55c0db2f9080 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1422803891 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f8b60069020 con 0x55c0db2f9080 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 10 client.6636 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 10 client.6636 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 20 client.6636 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55c0db3a1f70 0x55c0db3a2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 4 client.6636 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1422803891 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55c0db249800 con 0x55c0db3a1f70 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b691cc640 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55c0db3a1f70 0x55c0db3a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b44ff9640 10 client.6636 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b691cc640 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55c0db3a1f70 0x55c0db3a2350 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e03afcdb007ac66 server_cookie=1ff87e92e69a31f0 in_seq=0 out_seq=0 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b44ff9640 1 -- 172.21.15.79:0/1422803891 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+237 (crc 0 0 0) 0x55c0db249800 con 0x55c0db3a1f70 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b44ff9640 10 client.6636 handle_command_reply: tid=0 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 client.6636 shutdown 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1422803891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db2f9080 msgr2=0x55c0db326740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db2f9080 0x55c0db326740 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000bc00 tx=0x7f8b60004730 comp rx=0 tx=0).stop 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1422803891 shutdown_connections 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c0db326020 0x55c0db331bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c0db309140 0x55c0db326c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55c0db3a1f70 0x55c0db3a2350 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 --2- 172.21.15.79:0/1422803891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0db2f9080 0x55c0db326740 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b44ff9640 0 client.6636 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.868+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1422803891 >> 172.21.15.79:0/1422803891 conn(0x55c0db308a00 msgr2=0x55c0db323730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1422803891 shutdown_connections 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6ea1c740 1 -- 172.21.15.79:0/1422803891 wait complete. 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6ea1c740 20 client.6636 trim_cache size 0 max 16384 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "dentry", 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 1253058133, 2024-06-10T00:19:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627776, 2024-06-10T00:19:37.876 INFO:teuthology.orchestra.run.smithi079.stdout: "frag": "*", 2024-06-10T00:19:37.876 INFO:teuthology.orchestra.run.smithi079.stdout: "dname": "file_to_be_damaged", 2024-06-10T00:19:37.876 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_id": "head", 2024-06-10T00:19:37.876 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/subdir/file_to_be_damaged" 2024-06-10T00:19:37.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:19:37.876 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 -- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4806be30 msgr2=0x7f8b4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4806be30 0x7f8b4806e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8b60037000 tx=0x7f8b60008040 comp rx=0 tx=0).stop 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 -- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 msgr2=0x7f8b6409c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b6409c140 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b970 tx=0x7f8b5c00be30 comp rx=0 tx=0).stop 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 -- 172.21.15.79:0/165086705 shutdown_connections 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8b4806be30 0x7f8b4806e2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64155320 0x7f8b6409c140 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640d0560 0x7f8b6409b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 --2- 172.21.15.79:0/165086705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b640b34e0 0x7f8b6409b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 -- 172.21.15.79:0/165086705 >> 172.21.15.79:0/165086705 conn(0x7f8b640b1d10 msgr2=0x7f8b640b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 -- 172.21.15.79:0/165086705 shutdown_connections 2024-06-10T00:19:37.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.869+0000 7f8b6bc31640 1 -- 172.21.15.79:0/165086705 wait complete. 2024-06-10T00:19:37.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-10T00:19:37.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.979+0000 7f742954f640 1 Processor -- start 2024-06-10T00:19:37.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.979+0000 7f742954f640 1 -- start start 2024-06-10T00:19:37.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.979+0000 7f742954f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240d2680 0x7f742415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.979+0000 7f742954f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74240d0ad0 con 0x7f74240cef70 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.979+0000 7f742954f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742415f890 con 0x7f74240d1fc0 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.979+0000 7f742954f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f74240d13e0 con 0x7f74240d2680 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.979+0000 7f74237fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f74240cef70 0x7f74240cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39004/0 (socket says 172.21.15.79:39004) 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f74237fe640 1 -- 172.21.15.79:0/1032810461 learned_addr learned my addr 172.21.15.79:0/1032810461 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553199611 0 0) 0x7f74240d0ad0 con 0x7f74240cef70 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7422ffd640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240d2680 0x7f742415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f740c003520 con 0x7f74240cef70 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1543093605 0 0) 0x7f740c003520 con 0x7f74240cef70 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240d2680 msgr2=0x7f742415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240d2680 0x7f742415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 >> v1:172.21.15.117:6789/0 conn(0x7f74240d1fc0 legacy=0x7f74240d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74240d0d90 con 0x7f74240cef70 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f7414001670 con 0x7f74240cef70 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 >> v1:172.21.15.79:6789/0 conn(0x7f74240cef70 legacy=0x7f74240cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f740c0039e0 0x7f740c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240d2680 0x7f740c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c004d40 0x7f740c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f74240d13e0 con 0x7f740c0039e0 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f740c00ba70 con 0x7f740c004d40 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f740c00bc70 con 0x7f74240d2680 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7422ffd640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f740c0039e0 0x7f740c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f74227fc640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240d2680 0x7f740c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f74237fe640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c004d40 0x7f740c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7422ffd640 1 -- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240d2680 msgr2=0x7f740c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7422ffd640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240d2680 0x7f740c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7422ffd640 1 -- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c004d40 msgr2=0x7f740c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7422ffd640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c004d40 0x7f740c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.980+0000 7f7422ffd640 1 -- 172.21.15.79:0/1032810461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740c003520 con 0x7f740c0039e0 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.981+0000 7f7422ffd640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f740c0039e0 0x7f740c003e00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f741c009a90 tx=0x7f740c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e32d10ffbad6851 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.981+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c036070 con 0x7f740c0039e0 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.981+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c031400 con 0x7f740c0039e0 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.981+0000 7f7421ffb640 1 -- 172.21.15.79:0/1032810461 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c009690 con 0x7f740c0039e0 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.982+0000 7f742954f640 1 -- 172.21.15.79:0/1032810461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f740c0039e0 msgr2=0x7f740c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.982+0000 7f742954f640 1 --2- 172.21.15.79:0/1032810461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f740c0039e0 0x7f740c003e00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f741c009a90 tx=0x7f740c005830 comp rx=0 tx=0).stop 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.982+0000 7f74237fe640 1 -- 172.21.15.79:0/1032810461 reap_dead start 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.982+0000 7f742954f640 1 -- 172.21.15.79:0/1032810461 shutdown_connections 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.982+0000 7f742954f640 1 -- 172.21.15.79:0/1032810461 >> 172.21.15.79:0/1032810461 conn(0x7f742409d3f0 msgr2=0x7f74240d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.982+0000 7f742954f640 1 -- 172.21.15.79:0/1032810461 shutdown_connections 2024-06-10T00:19:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.982+0000 7f742954f640 1 -- 172.21.15.79:0/1032810461 wait complete. 2024-06-10T00:19:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.983+0000 7f742954f640 1 Processor -- start 2024-06-10T00:19:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.983+0000 7f742954f640 1 -- start start 2024-06-10T00:19:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f742954f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c0039e0 0x7f742415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f742954f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742415de10 0x7f74240b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f742954f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240b60f0 0x7f74240c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f742954f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f74240d4f00 con 0x7f742415de10 2024-06-10T00:19:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f742954f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f74240d2400 con 0x7f740c0039e0 2024-06-10T00:19:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f742954f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f74240d1870 con 0x7f74240b60f0 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742415de10 0x7f74240b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742415de10 0x7f74240b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60892/0 (socket says 172.21.15.79:60892) 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 -- 172.21.15.79:0/751314133 learned_addr learned my addr 172.21.15.79:0/751314133 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74237fe640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240b60f0 0x7f74240c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f7422ffd640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c0039e0 0x7f742415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 -- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240b60f0 msgr2=0x7f74240c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240b60f0 0x7f74240c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 -- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c0039e0 msgr2=0x7f742415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c0039e0 0x7f742415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 -- 172.21.15.79:0/751314133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742415e7f0 con 0x7f742415de10 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f7422ffd640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c0039e0 0x7f742415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.984+0000 7f74227fc640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742415de10 0x7f74240b5bb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f741800fb90 tx=0x7f741800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.985+0000 7f740b7fe640 1 -- 172.21.15.79:0/751314133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741800fe90 con 0x7f742415de10 2024-06-10T00:19:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.985+0000 7f740b7fe640 1 -- 172.21.15.79:0/751314133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7418018070 con 0x7f742415de10 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.985+0000 7f740b7fe640 1 -- 172.21.15.79:0/751314133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418003970 con 0x7f742415de10 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.985+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742409e070 con 0x7f742415de10 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.985+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742415a9d0 con 0x7f742415de10 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.986+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742409de60 con 0x7f742415de10 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.986+0000 7f740b7fe640 1 -- 172.21.15.79:0/751314133 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7418003b10 con 0x7f742415de10 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.987+0000 7f740b7fe640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f741006bfd0 0x7f741006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.987+0000 7f740b7fe640 1 -- 172.21.15.79:0/751314133 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f741808b230 con 0x7f742415de10 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.987+0000 7f7422ffd640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f741006bfd0 0x7f741006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.987+0000 7f7422ffd640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f741006bfd0 0x7f741006e490 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f741c033000 tx=0x7f741c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:37.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:37.991+0000 7f740b7fe640 1 -- 172.21.15.79:0/751314133 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7418059a90 con 0x7f742415de10 2024-06-10T00:19:38.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.202+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7424068430 con 0x7f742415de10 2024-06-10T00:19:38.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.202+0000 7f740b7fe640 1 -- 172.21.15.79:0/751314133 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f7418059390 con 0x7f742415de10 2024-06-10T00:19:38.202 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:19:38.202 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-06-10T00:19:38.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f741006bfd0 msgr2=0x7f741006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f741006bfd0 0x7f741006e490 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f741c033000 tx=0x7f741c008030 comp rx=0 tx=0).stop 2024-06-10T00:19:38.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742415de10 msgr2=0x7f74240b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742415de10 0x7f74240b5bb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f741800fb90 tx=0x7f741800d520 comp rx=0 tx=0).stop 2024-06-10T00:19:38.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 shutdown_connections 2024-06-10T00:19:38.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f741006bfd0 0x7f741006e490 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74240b60f0 0x7f74240c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742415de10 0x7f74240b5bb0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 --2- 172.21.15.79:0/751314133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f740c0039e0 0x7f742415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 >> 172.21.15.79:0/751314133 conn(0x7f742409d3f0 msgr2=0x7f74240d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 shutdown_connections 2024-06-10T00:19:38.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.204+0000 7f742954f640 1 -- 172.21.15.79:0/751314133 wait complete. 2024-06-10T00:19:38.215 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-06-10T00:19:38.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:19:38.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-06-10T00:19:38.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.319+0000 7f601f21c640 1 Processor -- start 2024-06-10T00:19:38.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.319+0000 7f601f21c640 1 -- start start 2024-06-10T00:19:38.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f601f21c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60180cf0e0 0x7f60180adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f601f21c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60180acd40 con 0x7f60180cec60 2024-06-10T00:19:38.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f601f21c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60180cf570 con 0x7f6018155590 2024-06-10T00:19:38.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f601f21c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f601815bfe0 con 0x7f60180cf0e0 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f6017fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f60180cec60 0x7f60180ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39010/0 (socket says 172.21.15.79:39010) 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f6017fff640 1 -- 172.21.15.79:0/1466015183 learned_addr learned my addr 172.21.15.79:0/1466015183 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033241250 0 0) 0x7f60180acd40 con 0x7f60180cec60 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6008003520 con 0x7f60180cec60 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f601d7b9640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60180cf0e0 0x7f60180adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2504250147 0 0) 0x7f6008003520 con 0x7f60180cec60 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60180cf0e0 msgr2=0x7f60180adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60180cf0e0 0x7f60180adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 >> v1:172.21.15.117:6789/0 conn(0x7f6018155590 legacy=0x7f601815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601815c2c0 con 0x7f60180cec60 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f6004001670 con 0x7f60180cec60 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 >> v1:172.21.15.79:6789/0 conn(0x7f60180cec60 legacy=0x7f60180ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60180cf0e0 0x7f60080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6008003f60 0x7f6008004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6008004d40 0x7f60080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f601815bfe0 con 0x7f6008003f60 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f600800baa0 con 0x7f6008004d40 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.320+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f600800deb0 con 0x7f60180cf0e0 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f6017fff640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6008003f60 0x7f6008004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f601cfb8640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60180cf0e0 0x7f60080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f601d7b9640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6008004d40 0x7f60080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f6017fff640 1 -- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60180cf0e0 msgr2=0x7f60080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f6017fff640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60180cf0e0 0x7f60080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f6017fff640 1 -- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6008004d40 msgr2=0x7f60080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f6017fff640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6008004d40 0x7f60080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f6017fff640 1 -- 172.21.15.79:0/1466015183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6008003520 con 0x7f6008003f60 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.321+0000 7f6017fff640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6008003f60 0x7f6008004800 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f600400c240 tx=0x7f6008005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7a69e8f39953b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004007d10 con 0x7f6008003f60 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6004005ad0 con 0x7f6008003f60 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f60177fe640 1 -- 172.21.15.79:0/1466015183 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004007070 con 0x7f6008003f60 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f601f21c640 1 -- 172.21.15.79:0/1466015183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6008003f60 msgr2=0x7f6008004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f601f21c640 1 --2- 172.21.15.79:0/1466015183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6008003f60 0x7f6008004800 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f600400c240 tx=0x7f6008005830 comp rx=0 tx=0).stop 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f601d7b9640 1 -- 172.21.15.79:0/1466015183 reap_dead start 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f601f21c640 1 -- 172.21.15.79:0/1466015183 shutdown_connections 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f601f21c640 1 -- 172.21.15.79:0/1466015183 >> 172.21.15.79:0/1466015183 conn(0x7f60180b1980 msgr2=0x7f60180b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f601f21c640 1 -- 172.21.15.79:0/1466015183 shutdown_connections 2024-06-10T00:19:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.322+0000 7f601f21c640 1 -- 172.21.15.79:0/1466015183 wait complete. 2024-06-10T00:19:38.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.323+0000 7f601f21c640 1 Processor -- start 2024-06-10T00:19:38.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.323+0000 7f601f21c640 1 -- start start 2024-06-10T00:19:38.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601f21c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6008003f60 0x7f601814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601f21c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f601806eb90 0x7f601806f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601f21c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60180add70 0x7f60180ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601f21c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60180b26d0 con 0x7f60180add70 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601f21c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60180ad2e0 con 0x7f601806eb90 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601f21c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f601815bb70 con 0x7f6008003f60 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601d7b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60180add70 0x7f60180ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601d7b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60180add70 0x7f60180ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60902/0 (socket says 172.21.15.79:60902) 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601d7b9640 1 -- 172.21.15.79:0/3063835618 learned_addr learned my addr 172.21.15.79:0/3063835618 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f6017fff640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f601806eb90 0x7f601806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.324+0000 7f601cfb8640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6008003f60 0x7f601814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f601d7b9640 1 -- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6008003f60 msgr2=0x7f601814f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f601d7b9640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6008003f60 0x7f601814f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f601d7b9640 1 -- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f601806eb90 msgr2=0x7f601806f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f601d7b9640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f601806eb90 0x7f601806f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f601d7b9640 1 -- 172.21.15.79:0/3063835618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601809b210 con 0x7f60180add70 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f6017fff640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f601806eb90 0x7f601806f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f601d7b9640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60180add70 0x7f60180ae220 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f601806fbc0 tx=0x7f601000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f60157fa640 1 -- 172.21.15.79:0/3063835618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601000fde0 con 0x7f60180add70 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f60157fa640 1 -- 172.21.15.79:0/3063835618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601001d070 con 0x7f60180add70 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f60157fa640 1 -- 172.21.15.79:0/3063835618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6010015670 con 0x7f60180add70 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f601f21c640 1 -- 172.21.15.79:0/3063835618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601809b4f0 con 0x7f60180add70 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.325+0000 7f601f21c640 1 -- 172.21.15.79:0/3063835618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601809bab0 con 0x7f60180add70 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.326+0000 7f60157fa640 1 -- 172.21.15.79:0/3063835618 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6010015810 con 0x7f60180add70 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.327+0000 7f60157fa640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ffc06be30 0x7f5ffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.327+0000 7f60157fa640 1 -- 172.21.15.79:0/3063835618 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f601008b9b0 con 0x7f60180add70 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.327+0000 7f601cfb8640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ffc06be30 0x7f5ffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.327+0000 7f601cfb8640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ffc06be30 0x7f5ffc06e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f60180aeaf0 tx=0x7f600c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.328+0000 7f602200a740 1 Processor -- start 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.328+0000 7f602200a740 1 -- start start 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.328+0000 7f602200a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47a08c0 0x556ee47a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.328+0000 7f602200a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee4770b20 0x556ee4776b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.328+0000 7f602200a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47bcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f602200a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ee46d8c40 con 0x556ee47bc820 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f602200a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556ee4676e70 con 0x556ee47a08c0 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f602200a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556ee46d4c00 con 0x556ee4770b20 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47bcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47bcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60910/0 (socket says 172.21.15.79:60910) 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 -- 172.21.15.79:0/3310717364 learned_addr learned my addr 172.21.15.79:0/3310717364 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 -- 172.21.15.79:0/3310717364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee4770b20 msgr2=0x556ee4776b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 --2- 172.21.15.79:0/3310717364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee4770b20 0x556ee4776b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 -- 172.21.15.79:0/3310717364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47a08c0 msgr2=0x556ee47a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 --2- 172.21.15.79:0/3310717364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47a08c0 0x556ee47a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 -- 172.21.15.79:0/3310717364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee44b4a50 con 0x556ee47bc820 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f601d7b9640 1 --2- 172.21.15.79:0/3310717364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47bcca0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f60100596f0 tx=0x7f601005a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7de898906b7a665 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f60027fc640 1 -- 172.21.15.79:0/3310717364 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6010062660 con 0x556ee47bc820 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f60027fc640 1 -- 172.21.15.79:0/3310717364 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6010057d80 con 0x556ee47bc820 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.329+0000 7f60027fc640 1 -- 172.21.15.79:0/3310717364 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60100600c0 con 0x556ee47bc820 2024-06-10T00:19:38.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 -- 172.21.15.79:0/3310717364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 msgr2=0x556ee47bcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 --2- 172.21.15.79:0/3310717364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47bcca0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f60100596f0 tx=0x7f601005a240 comp rx=0 tx=0).stop 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 -- 172.21.15.79:0/3310717364 shutdown_connections 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 --2- 172.21.15.79:0/3310717364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47bcca0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 --2- 172.21.15.79:0/3310717364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee4770b20 0x556ee4776b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 --2- 172.21.15.79:0/3310717364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47a08c0 0x556ee47a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 -- 172.21.15.79:0/3310717364 >> 172.21.15.79:0/3310717364 conn(0x556ee4772d90 msgr2=0x556ee47bb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 -- 172.21.15.79:0/3310717364 shutdown_connections 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 -- 172.21.15.79:0/3310717364 wait complete. 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.330+0000 7f602200a740 1 -- start start 2024-06-10T00:19:38.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f602200a740 1 Processor -- start 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f602200a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47a08c0 0x556ee478cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f602200a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47bc820 0x556ee47a1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f602200a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee479bc80 0x556ee47a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f602200a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ee4777090 con 0x556ee479bc80 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f602200a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556ee4662020 con 0x556ee47bc820 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f602200a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556ee47766c0 con 0x556ee47a08c0 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f602200a740 10 client.0 _ll_register_callbacks cb 0x556ee4693b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f601d7b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee479bc80 0x556ee47a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f601d7b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee479bc80 0x556ee47a3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60922/0 (socket says 172.21.15.79:60922) 2024-06-10T00:19:38.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.331+0000 7f601d7b9640 1 -- 172.21.15.79:0/4269797004 learned_addr learned my addr 172.21.15.79:0/4269797004 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f6017fff640 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47bc820 0x556ee47a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f601d7b9640 1 -- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47a08c0 msgr2=0x556ee478cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f601cfb8640 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47a08c0 0x556ee478cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f601d7b9640 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47a08c0 0x556ee478cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f601d7b9640 1 -- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47bc820 msgr2=0x556ee47a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f601d7b9640 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47bc820 0x556ee47a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f601d7b9640 1 -- 172.21.15.79:0/4269797004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ee43ac3e0 con 0x556ee479bc80 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f6017fff640 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47bc820 0x556ee47a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f601d7b9640 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee479bc80 0x556ee47a3bf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f601005a330 tx=0x7f6010000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48e0eee62b722d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f5ff77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f5ff77fe640 1 -- 172.21.15.79:0/4269797004 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6010076060 con 0x556ee479bc80 2024-06-10T00:19:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f5ff77fe640 1 -- 172.21.15.79:0/4269797004 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f6010058ed0 con 0x556ee479bc80 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 1 -- 172.21.15.79:0/4269797004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6010057d80 con 0x556ee479bc80 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f5ff77fe640 1 -- 172.21.15.79:0/4269797004 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f60100590f0 con 0x556ee479bc80 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 10 client.6654 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 1 -- 172.21.15.79:0/4269797004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x556ee45151e0 con 0x556ee479bc80 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f5ff77fe640 1 -- 172.21.15.79:0/4269797004 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6010057d80 con 0x556ee479bc80 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f5ff77fe640 1 -- 172.21.15.79:0/4269797004 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f6010071ce0 con 0x556ee479bc80 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 10 client.6654 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 10 client.6654 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 20 client.6654 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x556ee47a2d70 0x556ee47a3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 4 client.6654 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:19:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.332+0000 7f602200a740 1 -- 172.21.15.79:0/4269797004 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ee46ec660 con 0x556ee47a2d70 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.333+0000 7f601cfb8640 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x556ee47a2d70 0x556ee47a3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.333+0000 7f5ff77fe640 10 client.6654 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.333+0000 7f601cfb8640 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x556ee47a2d70 0x556ee47a3150 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=307692b92f5bc97c server_cookie=f247245ff0316e67 in_seq=0 out_seq=0 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.333+0000 7f5ff77fe640 1 -- 172.21.15.79:0/4269797004 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556ee46ec660 con 0x556ee47a2d70 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.333+0000 7f5ff77fe640 10 client.6654 handle_command_reply: tid=0 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.333+0000 7f602200a740 1 client.6654 shutdown 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.333+0000 7f602200a740 1 -- 172.21.15.79:0/4269797004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee479bc80 msgr2=0x556ee47a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.333+0000 7f602200a740 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee479bc80 0x556ee47a3bf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f601005a330 tx=0x7f6010000f40 comp rx=0 tx=0).stop 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 1 -- 172.21.15.79:0/4269797004 shutdown_connections 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x556ee47a2d70 0x556ee47a3150 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee479bc80 0x556ee47a3bf0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47bc820 0x556ee47a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 1 --2- 172.21.15.79:0/4269797004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47a08c0 0x556ee478cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f5ff77fe640 0 client.6654 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 1 -- 172.21.15.79:0/4269797004 >> 172.21.15.79:0/4269797004 conn(0x556ee4770b20 msgr2=0x556ee47bde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 1 -- 172.21.15.79:0/4269797004 shutdown_connections 2024-06-10T00:19:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 1 -- 172.21.15.79:0/4269797004 wait complete. 2024-06-10T00:19:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.334+0000 7f602200a740 20 client.6654 trim_cache size 0 max 16384 2024-06-10T00:19:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.352+0000 7f602200a740 1 Processor -- start 2024-06-10T00:19:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.352+0000 7f602200a740 1 -- start start 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.352+0000 7f602200a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee479bc80 0x556ee47be510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.352+0000 7f602200a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47a08c0 0x556ee47a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.352+0000 7f602200a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47a1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.352+0000 7f602200a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ee47b2a20 con 0x556ee47bc820 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.352+0000 7f602200a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60181fd1f0 con 0x556ee47a08c0 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.352+0000 7f602200a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60181fc290 con 0x556ee479bc80 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60924/0 (socket says 172.21.15.79:60924) 2024-06-10T00:19:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 -- 172.21.15.79:0/4274750359 learned_addr learned my addr 172.21.15.79:0/4274750359 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 -- 172.21.15.79:0/4274750359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee479bc80 msgr2=0x556ee47be510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 --2- 172.21.15.79:0/4274750359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee479bc80 0x556ee47be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 -- 172.21.15.79:0/4274750359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47a08c0 msgr2=0x556ee47a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 --2- 172.21.15.79:0/4274750359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47a08c0 0x556ee47a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 -- 172.21.15.79:0/4274750359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee43854a0 con 0x556ee47bc820 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f601d7b9640 1 --2- 172.21.15.79:0/4274750359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47a1270 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6010057d30 tx=0x7f6010027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eedecf9910c8ac6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f6001ffb640 1 -- 172.21.15.79:0/4274750359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60100602d0 con 0x556ee47bc820 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f6001ffb640 1 -- 172.21.15.79:0/4274750359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6010057d80 con 0x556ee47bc820 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.353+0000 7f6001ffb640 1 -- 172.21.15.79:0/4274750359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60100557d0 con 0x556ee47bc820 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 -- 172.21.15.79:0/4274750359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 msgr2=0x556ee47a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 --2- 172.21.15.79:0/4274750359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47a1270 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6010057d30 tx=0x7f6010027000 comp rx=0 tx=0).stop 2024-06-10T00:19:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 -- 172.21.15.79:0/4274750359 shutdown_connections 2024-06-10T00:19:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 --2- 172.21.15.79:0/4274750359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47bc820 0x556ee47a1270 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 --2- 172.21.15.79:0/4274750359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee47a08c0 0x556ee47a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 --2- 172.21.15.79:0/4274750359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee479bc80 0x556ee47be510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 -- 172.21.15.79:0/4274750359 >> 172.21.15.79:0/4274750359 conn(0x556ee4770b20 msgr2=0x556ee4777800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 -- 172.21.15.79:0/4274750359 shutdown_connections 2024-06-10T00:19:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 -- 172.21.15.79:0/4274750359 wait complete. 2024-06-10T00:19:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 -- start start 2024-06-10T00:19:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.354+0000 7f602200a740 1 Processor -- start 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f602200a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee479bc80 0x556ee483d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f602200a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47a08c0 0x556ee47d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f602200a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47bc820 0x556ee479c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f602200a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60181fbc40 con 0x556ee47a08c0 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f602200a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f601815e7f0 con 0x556ee479bc80 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f602200a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556ee479b590 con 0x556ee47bc820 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f602200a740 10 client.0 _ll_register_callbacks cb 0x7f60100593e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f6017fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47a08c0 0x556ee47d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f6017fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47a08c0 0x556ee47d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60936/0 (socket says 172.21.15.79:60936) 2024-06-10T00:19:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f6017fff640 1 -- 172.21.15.79:0/276962490 learned_addr learned my addr 172.21.15.79:0/276962490 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f601d7b9640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47bc820 0x556ee479c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f601cfb8640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee479bc80 0x556ee483d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f6017fff640 1 -- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47bc820 msgr2=0x556ee479c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f6017fff640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47bc820 0x556ee479c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f6017fff640 1 -- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee479bc80 msgr2=0x556ee483d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.355+0000 7f6017fff640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee479bc80 0x556ee483d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f6017fff640 1 -- 172.21.15.79:0/276962490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ee4773c50 con 0x556ee47a08c0 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f601d7b9640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47bc820 0x556ee479c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f601cfb8640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee479bc80 0x556ee483d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f6017fff640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47a08c0 0x556ee47d2780 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f600400c240 tx=0x7f6004001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa2fd47acba87ec server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f5ff77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f5ff77fe640 1 -- 172.21.15.79:0/276962490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004044070 con 0x556ee47a08c0 2024-06-10T00:19:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f5ff77fe640 1 -- 172.21.15.79:0/276962490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f60040049e0 con 0x556ee47a08c0 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 1 -- 172.21.15.79:0/276962490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6010057d80 con 0x556ee47a08c0 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f5ff77fe640 1 -- 172.21.15.79:0/276962490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f6004004be0 con 0x556ee47a08c0 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 10 client.6660 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 1 -- 172.21.15.79:0/276962490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x556ee47a1450 con 0x556ee47a08c0 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f5ff77fe640 1 -- 172.21.15.79:0/276962490 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6010057d80 con 0x556ee47a08c0 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f5ff77fe640 1 -- 172.21.15.79:0/276962490 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f600403e040 con 0x556ee47a08c0 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 10 client.6660 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 10 client.6660 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 20 client.6660 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x556ee47cf190 0x556ee47c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 4 client.6660 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f602200a740 1 -- 172.21.15.79:0/276962490 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) -- 0x556ee46e6370 con 0x556ee47cf190 2024-06-10T00:19:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.356+0000 7f601cfb8640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x556ee47cf190 0x556ee47c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.357+0000 7f5ff77fe640 10 client.6660 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.357+0000 7f601cfb8640 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x556ee47cf190 0x556ee47c6c20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6abd0acd972dfdb server_cookie=7661903425000cb4 in_seq=0 out_seq=0 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.357+0000 7f5ff77fe640 1 -- 172.21.15.79:0/276962490 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556ee46e6370 con 0x556ee47cf190 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.357+0000 7f5ff77fe640 10 client.6660 handle_command_reply: tid=0 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.357+0000 7f602200a740 1 client.6660 shutdown 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 -- 172.21.15.79:0/276962490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47a08c0 msgr2=0x556ee47d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47a08c0 0x556ee47d2780 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f600400c240 tx=0x7f6004001c50 comp rx=0 tx=0).stop 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 -- 172.21.15.79:0/276962490 shutdown_connections 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556ee47bc820 0x556ee479c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x556ee47cf190 0x556ee47c6c20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ee47a08c0 0x556ee47d2780 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 --2- 172.21.15.79:0/276962490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556ee479bc80 0x556ee483d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f5ff77fe640 0 client.6660 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 -- 172.21.15.79:0/276962490 >> 172.21.15.79:0/276962490 conn(0x556ee4770b20 msgr2=0x556ee47bb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 -- 172.21.15.79:0/276962490 shutdown_connections 2024-06-10T00:19:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 1 -- 172.21.15.79:0/276962490 wait complete. 2024-06-10T00:19:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f602200a740 20 client.6660 trim_cache size 0 max 16384 2024-06-10T00:19:38.364 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:19:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:19:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "9f1c0728-4b33-4673-9ba6-8410cdbcda38", 2024-06-10T00:19:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:19:38.365 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:19:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 -- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ffc06be30 msgr2=0x7f5ffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ffc06be30 0x7f5ffc06e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f60180aeaf0 tx=0x7f600c009040 comp rx=0 tx=0).stop 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 -- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60180add70 msgr2=0x7f60180ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60180add70 0x7f60180ae220 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f601806fbc0 tx=0x7f601000f580 comp rx=0 tx=0).stop 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 -- 172.21.15.79:0/3063835618 shutdown_connections 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ffc06be30 0x7f5ffc06e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60180add70 0x7f60180ae220 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f601806eb90 0x7f601806f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 --2- 172.21.15.79:0/3063835618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6008003f60 0x7f601814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 -- 172.21.15.79:0/3063835618 >> 172.21.15.79:0/3063835618 conn(0x7f60180b1980 msgr2=0x7f601815b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 -- 172.21.15.79:0/3063835618 shutdown_connections 2024-06-10T00:19:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.358+0000 7f601f21c640 1 -- 172.21.15.79:0/3063835618 wait complete. 2024-06-10T00:19:38.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:19:38.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-06-10T00:19:38.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.471+0000 7f38731ee640 1 Processor -- start 2024-06-10T00:19:38.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.471+0000 7f38731ee640 1 -- start start 2024-06-10T00:19:38.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f38731ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c0b3bf0 0x7f386c06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f38731ee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c155000 con 0x7f386c06d500 2024-06-10T00:19:38.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f38731ee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c06dd30 con 0x7f386c154c20 2024-06-10T00:19:38.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f38731ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f386c06e010 con 0x7f386c0b3bf0 2024-06-10T00:19:38.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f387178b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f386c06d500 0x7f386c071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39026/0 (socket says 172.21.15.79:39026) 2024-06-10T00:19:38.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f387178b640 1 -- 172.21.15.79:0/2620008993 learned_addr learned my addr 172.21.15.79:0/2620008993 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:19:38.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161647637 0 0) 0x7f386c155000 con 0x7f386c06d500 2024-06-10T00:19:38.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f385c003440 con 0x7f386c06d500 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386bfff640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c0b3bf0 0x7f386c06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2998283700 0 0) 0x7f385c003440 con 0x7f386c06d500 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c0b3bf0 msgr2=0x7f386c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c0b3bf0 0x7f386c06cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 >> v1:172.21.15.117:6789/0 conn(0x7f386c154c20 legacy=0x7f386c0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c06e2f0 con 0x7f386c06d500 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f38640019f0 con 0x7f386c06d500 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 >> v1:172.21.15.79:6789/0 conn(0x7f386c06d500 legacy=0x7f386c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c0b3bf0 0x7f385c003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c0040a0 0x7f385c00a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f385c00b040 0x7f385c00d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f386c06e010 con 0x7f385c00b040 2024-06-10T00:19:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f385c00dd10 con 0x7f385c0040a0 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f385c00df10 con 0x7f386c0b3bf0 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.472+0000 7f387178b640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f385c00b040 0x7f385c00d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.473+0000 7f386bfff640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c0040a0 0x7f385c00a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.473+0000 7f3870f8a640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c0b3bf0 0x7f385c003ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.473+0000 7f387178b640 1 -- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c0b3bf0 msgr2=0x7f385c003ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.473+0000 7f387178b640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c0b3bf0 0x7f385c003ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.473+0000 7f387178b640 1 -- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c0040a0 msgr2=0x7f385c00a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.473+0000 7f387178b640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c0040a0 0x7f385c00a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.473+0000 7f387178b640 1 -- 172.21.15.79:0/2620008993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c003440 con 0x7f385c00b040 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.473+0000 7f387178b640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f385c00b040 0x7f385c00d4d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f386400a770 tx=0x7f385c003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b401bdceef1df9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386400a390 con 0x7f385c00b040 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386402f070 con 0x7f385c00b040 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f386b7fe640 1 -- 172.21.15.79:0/2620008993 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386402bc00 con 0x7f385c00b040 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f38731ee640 1 -- 172.21.15.79:0/2620008993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f385c00b040 msgr2=0x7f385c00d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f38731ee640 1 --2- 172.21.15.79:0/2620008993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f385c00b040 0x7f385c00d4d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f386400a770 tx=0x7f385c003730 comp rx=0 tx=0).stop 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f387178b640 1 -- 172.21.15.79:0/2620008993 reap_dead start 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f38731ee640 1 -- 172.21.15.79:0/2620008993 shutdown_connections 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f38731ee640 1 -- 172.21.15.79:0/2620008993 >> 172.21.15.79:0/2620008993 conn(0x7f386c0b1d10 msgr2=0x7f386c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f38731ee640 1 -- 172.21.15.79:0/2620008993 shutdown_connections 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.474+0000 7f38731ee640 1 -- 172.21.15.79:0/2620008993 wait complete. 2024-06-10T00:19:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.475+0000 7f38731ee640 1 Processor -- start 2024-06-10T00:19:38.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.475+0000 7f38731ee640 1 -- start start 2024-06-10T00:19:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f38731ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c00b040 0x7f386c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f38731ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c0b06b0 0x7f386c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f38731ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c14e5b0 0x7f386c14ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f38731ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f386c06cfc0 con 0x7f386c0b06b0 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f38731ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f386c06d9b0 con 0x7f385c00b040 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f38731ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f386c06d140 con 0x7f386c14e5b0 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f386bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c0b06b0 0x7f386c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f386bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c0b06b0 0x7f386c14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60948/0 (socket says 172.21.15.79:60948) 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f386bfff640 1 -- 172.21.15.79:0/4290653034 learned_addr learned my addr 172.21.15.79:0/4290653034 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f3870f8a640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c00b040 0x7f386c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.476+0000 7f387178b640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c14e5b0 0x7f386c14ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f386bfff640 1 -- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c14e5b0 msgr2=0x7f386c14ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f386bfff640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c14e5b0 0x7f386c14ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f386bfff640 1 -- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c00b040 msgr2=0x7f386c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f386bfff640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c00b040 0x7f386c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f386bfff640 1 -- 172.21.15.79:0/4290653034 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c09ada0 con 0x7f386c0b06b0 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f3870f8a640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c00b040 0x7f386c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f386bfff640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c0b06b0 0x7f386c14e070 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3858011990 tx=0x7f3858011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f38697fa640 1 -- 172.21.15.79:0/4290653034 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858019070 con 0x7f386c0b06b0 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f38697fa640 1 -- 172.21.15.79:0/4290653034 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3858004240 con 0x7f386c0b06b0 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f38731ee640 1 -- 172.21.15.79:0/4290653034 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c14ef70 con 0x7f386c0b06b0 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f38697fa640 1 -- 172.21.15.79:0/4290653034 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385800f860 con 0x7f386c0b06b0 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.477+0000 7f38731ee640 1 -- 172.21.15.79:0/4290653034 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c0b0ed0 con 0x7f386c0b06b0 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.479+0000 7f38697fa640 1 -- 172.21.15.79:0/4290653034 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f385801c070 con 0x7f386c0b06b0 2024-06-10T00:19:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.479+0000 7f38697fa640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f385006be60 0x7f385006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.479+0000 7f38697fa640 1 -- 172.21.15.79:0/4290653034 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f385808b450 con 0x7f386c0b06b0 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.479+0000 7f3870f8a640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f385006be60 0x7f385006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.480+0000 7f3870f8a640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f385006be60 0x7f385006e320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f386c0b2470 tx=0x7f3860009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.480+0000 7f3875fd8740 1 Processor -- start 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.480+0000 7f3875fd8740 1 -- start start 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0864d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf086481a0 0x55cf0864d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0864f6d0 0x55cf0864dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3875fd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cf085727e0 con 0x55cf08670af0 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3875fd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cf085b0e80 con 0x55cf0864f6d0 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3875fd8740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cf0854e700 con 0x55cf086481a0 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0864d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0864d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60962/0 (socket says 172.21.15.79:60962) 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 -- 172.21.15.79:0/81880828 learned_addr learned my addr 172.21.15.79:0/81880828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f386bfff640 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf086481a0 0x55cf0864d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f387178b640 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0864f6d0 0x55cf0864dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 -- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf086481a0 msgr2=0x55cf0864d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf086481a0 0x55cf0864d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 -- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0864f6d0 msgr2=0x55cf0864dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0864f6d0 0x55cf0864dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 -- 172.21.15.79:0/81880828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0856ddd0 con 0x55cf08670af0 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f386bfff640 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf086481a0 0x55cf0864d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f387178b640 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0864f6d0 0x55cf0864dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:19:38.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f3870f8a640 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0864d120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3860001930 tx=0x7f3860014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29c3c455404651d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f38567fc640 1 -- 172.21.15.79:0/81880828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860028070 con 0x55cf08670af0 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f38567fc640 1 -- 172.21.15.79:0/81880828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3860015c00 con 0x55cf08670af0 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.481+0000 7f38567fc640 1 -- 172.21.15.79:0/81880828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600143d0 con 0x55cf08670af0 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 -- 172.21.15.79:0/81880828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 msgr2=0x55cf0864d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0864d120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3860001930 tx=0x7f3860014000 comp rx=0 tx=0).stop 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 -- 172.21.15.79:0/81880828 shutdown_connections 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0864f6d0 0x55cf0864dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf086481a0 0x55cf0864d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 --2- 172.21.15.79:0/81880828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0864d120 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 -- 172.21.15.79:0/81880828 >> 172.21.15.79:0/81880828 conn(0x55cf0864a410 msgr2=0x55cf08692f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 -- 172.21.15.79:0/81880828 shutdown_connections 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.482+0000 7f3875fd8740 1 -- 172.21.15.79:0/81880828 wait complete. 2024-06-10T00:19:38.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.483+0000 7f3875fd8740 1 -- start start 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.483+0000 7f3875fd8740 1 Processor -- start 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.483+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf0866b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.483+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0867afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08673590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cf08539640 con 0x55cf0866c110 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cf085ace40 con 0x55cf0867b4e0 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cf0864bbe0 con 0x55cf08670af0 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 10 client.0 _ll_register_callbacks cb 0x55cf0856b430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0867afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0867afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60974/0 (socket says 172.21.15.79:60974) 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 -- 172.21.15.79:0/1812608463 learned_addr learned my addr 172.21.15.79:0/1812608463 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f387178b640 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08673590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3870f8a640 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf0866b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 -- 172.21.15.79:0/1812608463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 msgr2=0x55cf0866b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf0866b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 -- 172.21.15.79:0/1812608463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 msgr2=0x55cf08673590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08673590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 -- 172.21.15.79:0/1812608463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf0838e7d0 con 0x55cf0866c110 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f386bfff640 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0867afa0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f38580897a0 tx=0x7f3858059520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b94000fb4dc1cc server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f384b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f384b7fe640 1 -- 172.21.15.79:0/1812608463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858023070 con 0x55cf0866c110 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f384b7fe640 1 -- 172.21.15.79:0/1812608463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f3858061c70 con 0x55cf0866c110 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 1 -- 172.21.15.79:0/1812608463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3860015c00 con 0x55cf0866c110 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f384b7fe640 1 -- 172.21.15.79:0/1812608463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f385808b270 con 0x55cf0866c110 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 10 client.6672 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:38.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 1 -- 172.21.15.79:0/1812608463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55cf082c43f0 con 0x55cf0866c110 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f384b7fe640 1 -- 172.21.15.79:0/1812608463 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3860015c00 con 0x55cf0866c110 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f384b7fe640 1 -- 172.21.15.79:0/1812608463 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f3858089bc0 con 0x55cf0866c110 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 10 client.6672 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.484+0000 7f3875fd8740 10 client.6672 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f3875fd8740 20 client.6672 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f3875fd8740 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55cf08678b70 0x55cf08678f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f3875fd8740 4 client.6672 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f3875fd8740 1 -- 172.21.15.79:0/1812608463 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf085be5b0 con 0x55cf08678b70 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f3870f8a640 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55cf08678b70 0x55cf08678f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f384b7fe640 10 client.6672 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f3870f8a640 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55cf08678b70 0x55cf08678f50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67560e21681cec6d server_cookie=460067b1712f1c36 in_seq=0 out_seq=0 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f384b7fe640 1 -- 172.21.15.79:0/1812608463 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cf085be5b0 con 0x55cf08678b70 2024-06-10T00:19:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.485+0000 7f384b7fe640 10 client.6672 handle_command_reply: tid=0 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 client.6672 shutdown 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 -- 172.21.15.79:0/1812608463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 msgr2=0x55cf0867afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0867afa0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f38580897a0 tx=0x7f3858059520 comp rx=0 tx=0).stop 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 -- 172.21.15.79:0/1812608463 shutdown_connections 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08673590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55cf08678b70 0x55cf08678f50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0867afa0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 --2- 172.21.15.79:0/1812608463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf0866b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f384b7fe640 0 client.6672 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 -- 172.21.15.79:0/1812608463 >> 172.21.15.79:0/1812608463 conn(0x55cf0864f6d0 msgr2=0x55cf0864c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 -- 172.21.15.79:0/1812608463 shutdown_connections 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 1 -- 172.21.15.79:0/1812608463 wait complete. 2024-06-10T00:19:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.486+0000 7f3875fd8740 20 client.6672 trim_cache size 0 max 16384 2024-06-10T00:19:38.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.504+0000 7f3875fd8740 1 Processor -- start 2024-06-10T00:19:38.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.504+0000 7f3875fd8740 1 -- start start 2024-06-10T00:19:38.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf0866c110 0x55cf08679140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0867a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf0867a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3875fd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f386c2016d0 con 0x55cf08670af0 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3875fd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f386c2006d0 con 0x55cf0867b4e0 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3875fd8740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f386c1ffa30 con 0x55cf0866c110 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0867a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0867a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60978/0 (socket says 172.21.15.79:60978) 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 -- 172.21.15.79:0/342850626 learned_addr learned my addr 172.21.15.79:0/342850626 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 -- 172.21.15.79:0/342850626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf0866c110 msgr2=0x55cf08679140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 --2- 172.21.15.79:0/342850626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf0866c110 0x55cf08679140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 -- 172.21.15.79:0/342850626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 msgr2=0x55cf0867a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 --2- 172.21.15.79:0/342850626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf0867a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 -- 172.21.15.79:0/342850626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf082840f0 con 0x55cf08670af0 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f386bfff640 1 --2- 172.21.15.79:0/342850626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0867a230 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f385800f710 tx=0x7f385808b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba231935440e7616 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3855ffb640 1 -- 172.21.15.79:0/342850626 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858061c70 con 0x55cf08670af0 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3855ffb640 1 -- 172.21.15.79:0/342850626 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38580893d0 con 0x55cf08670af0 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.505+0000 7f3855ffb640 1 -- 172.21.15.79:0/342850626 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858058970 con 0x55cf08670af0 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 -- 172.21.15.79:0/342850626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 msgr2=0x55cf0867a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 --2- 172.21.15.79:0/342850626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0867a230 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f385800f710 tx=0x7f385808b000 comp rx=0 tx=0).stop 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 -- 172.21.15.79:0/342850626 shutdown_connections 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 --2- 172.21.15.79:0/342850626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf0867a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 --2- 172.21.15.79:0/342850626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf08670af0 0x55cf0867a230 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 --2- 172.21.15.79:0/342850626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf0866c110 0x55cf08679140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 -- 172.21.15.79:0/342850626 >> 172.21.15.79:0/342850626 conn(0x55cf0864f6d0 msgr2=0x55cf0866b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 -- 172.21.15.79:0/342850626 shutdown_connections 2024-06-10T00:19:38.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 -- 172.21.15.79:0/342850626 wait complete. 2024-06-10T00:19:38.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.506+0000 7f3875fd8740 1 -- start start 2024-06-10T00:19:38.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3875fd8740 1 Processor -- start 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0866fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf08669720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3875fd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08669c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3875fd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cf0866ea20 con 0x55cf0866c110 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3875fd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f386c200080 con 0x55cf0867b4e0 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3875fd8740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cf086471b0 con 0x55cf08670af0 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3875fd8740 10 client.0 _ll_register_callbacks cb 0x7f3858058ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3870f8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0866fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3870f8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0866fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60988/0 (socket says 172.21.15.79:60988) 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.507+0000 7f3870f8a640 1 -- 172.21.15.79:0/2566708226 learned_addr learned my addr 172.21.15.79:0/2566708226 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f386bfff640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf08669720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f387178b640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08669c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3870f8a640 1 -- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 msgr2=0x55cf08669720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3870f8a640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf08669720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3870f8a640 1 -- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 msgr2=0x55cf08669c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3870f8a640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08669c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3870f8a640 1 -- 172.21.15.79:0/2566708226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf08577560 con 0x55cf0866c110 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f386bfff640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf08669720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f387178b640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08669c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3870f8a640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0866fc70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x55cf08649560 tx=0x7f3860007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523c053c7c08d3f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f384b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f384b7fe640 1 -- 172.21.15.79:0/2566708226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386003e060 con 0x55cf0866c110 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f384b7fe640 1 -- 172.21.15.79:0/2566708226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f38600226a0 con 0x55cf0866c110 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 1 -- 172.21.15.79:0/2566708226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38580893d0 con 0x55cf0866c110 2024-06-10T00:19:38.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f384b7fe640 1 -- 172.21.15.79:0/2566708226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3860044050 con 0x55cf0866c110 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 10 client.6678 fetch_fsmap learned FSMap version 43 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 1 -- 172.21.15.79:0/2566708226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55cf08670470 con 0x55cf0866c110 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f384b7fe640 1 -- 172.21.15.79:0/2566708226 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38580893d0 con 0x55cf0866c110 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f384b7fe640 1 -- 172.21.15.79:0/2566708226 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 3494+0+0 (secure 0 0 0) 0x7f3860047020 con 0x55cf0866c110 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 10 client.6678 fetch_fsmap finished waiting for FSMap version 43 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 10 client.6678 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 20 client.6678 populate_metadata read hostname 'smithi079' 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55cf0864e130 0x55cf08679140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 4 client.6678 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f3875fd8740 1 -- 172.21.15.79:0/2566708226 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cf085b8900 con 0x55cf0864e130 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.508+0000 7f386bfff640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55cf0864e130 0x55cf08679140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f384b7fe640 10 client.6678 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f386bfff640 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55cf0864e130 0x55cf08679140 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a075b6049e534ef server_cookie=c239c203b2fd373a in_seq=0 out_seq=0 2024-06-10T00:19:38.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f384b7fe640 1 -- 172.21.15.79:0/2566708226 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x55cf085b8900 con 0x55cf0864e130 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f384b7fe640 10 client.6678 handle_command_reply: tid=0 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 client.6678 shutdown 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 -- 172.21.15.79:0/2566708226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 msgr2=0x55cf0866fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0866fc70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x55cf08649560 tx=0x7f3860007c80 comp rx=0 tx=0).stop 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 -- 172.21.15.79:0/2566708226 shutdown_connections 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf0867b4e0 0x55cf08669c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cf08670af0 0x55cf08669720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55cf0864e130 0x55cf08679140 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 --2- 172.21.15.79:0/2566708226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf0866c110 0x55cf0866fc70 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f384b7fe640 0 client.6678 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 -- 172.21.15.79:0/2566708226 >> 172.21.15.79:0/2566708226 conn(0x55cf0864f6d0 msgr2=0x55cf0864bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 -- 172.21.15.79:0/2566708226 shutdown_connections 2024-06-10T00:19:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 1 -- 172.21.15.79:0/2566708226 wait complete. 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.509+0000 7f3875fd8740 20 client.6678 trim_cache size 0 max 16384 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "9f1c0728-4b33-4673-9ba6-8410cdbcda38": { 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/subdir", 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "9f1c0728-4b33-4673-9ba6-8410cdbcda38", 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:19:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:19:38.519 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 -- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f385006be60 msgr2=0x7f385006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f385006be60 0x7f385006e320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f386c0b2470 tx=0x7f3860009040 comp rx=0 tx=0).stop 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 -- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c0b06b0 msgr2=0x7f386c14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c0b06b0 0x7f386c14e070 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3858011990 tx=0x7f3858011e50 comp rx=0 tx=0).stop 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 -- 172.21.15.79:0/4290653034 shutdown_connections 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f385006be60 0x7f385006e320 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386c14e5b0 0x7f386c14ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c0b06b0 0x7f386c14e070 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 --2- 172.21.15.79:0/4290653034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385c00b040 0x7f386c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:19:38.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 -- 172.21.15.79:0/4290653034 >> 172.21.15.79:0/4290653034 conn(0x7f386c0b1d10 msgr2=0x7f386c1536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:19:38.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 -- 172.21.15.79:0/4290653034 shutdown_connections 2024-06-10T00:19:38.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:19:38.510+0000 7f38731ee640 1 -- 172.21.15.79:0/4290653034 wait complete. 2024-06-10T00:19:38.521 INFO:tasks.cephfs.filesystem:scrub status for tag:9f1c0728-4b33-4673-9ba6-8410cdbcda38 - {'path': '/subdir', 'tag': '9f1c0728-4b33-4673-9ba6-8410cdbcda38', 'options': 'recursive,repair'} 2024-06-10T00:19:44.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:19:44.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:20:08.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:08.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-06-10T00:20:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.637+0000 7fb33e215640 1 Processor -- start 2024-06-10T00:20:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.637+0000 7fb33e215640 1 -- start start 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.638+0000 7fb33e215640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3380b2bf0 0x7fb3380d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.638+0000 7fb33e215640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3380b3080 con 0x7fb3380d0560 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.638+0000 7fb33e215640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33815c870 con 0x7fb3380b3b40 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.638+0000 7fb33e215640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb3380d09b0 con 0x7fb3380b2bf0 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.638+0000 7fb336ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3380b2bf0 0x7fb3380d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.638+0000 7fb337fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb3380d0560 0x7fb33806d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51638/0 (socket says 172.21.15.79:51638) 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.638+0000 7fb336ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3380b2bf0 0x7fb3380d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60800/0 (socket says 172.21.15.79:60800) 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.638+0000 7fb337fff640 1 -- 172.21.15.79:0/1232107656 learned_addr learned my addr 172.21.15.79:0/1232107656 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.639+0000 7fb336ffd640 1 -- 172.21.15.79:0/1232107656 >> v1:172.21.15.117:6789/0 conn(0x7fb3380b3b40 legacy=0x7fb3380b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.639+0000 7fb336ffd640 1 -- 172.21.15.79:0/1232107656 >> v1:172.21.15.79:6789/0 conn(0x7fb3380d0560 legacy=0x7fb33806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.639+0000 7fb336ffd640 1 -- 172.21.15.79:0/1232107656 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33815cb50 con 0x7fb3380b2bf0 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.639+0000 7fb3367fc640 1 -- 172.21.15.79:0/1232107656 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049217746 0 0) 0x7fb3380b3080 con 0x7fb3380d0560 2024-06-10T00:20:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.639+0000 7fb336ffd640 1 --2- 172.21.15.79:0/1232107656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380b2bf0 0x7fb3380d0020 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0097a0 tx=0x7fb32c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9367824a93d18fe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb3367fc640 1 -- 172.21.15.79:0/1232107656 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c037070 con 0x7fb3380b2bf0 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb3367fc640 1 -- 172.21.15.79:0/1232107656 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c032440 con 0x7fb3380b2bf0 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb3367fc640 1 -- 172.21.15.79:0/1232107656 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c032810 con 0x7fb3380b2bf0 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb33e215640 1 -- 172.21.15.79:0/1232107656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380b2bf0 msgr2=0x7fb3380d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb33e215640 1 --2- 172.21.15.79:0/1232107656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380b2bf0 0x7fb3380d0020 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0097a0 tx=0x7fb32c02a1e0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb33e215640 1 -- 172.21.15.79:0/1232107656 shutdown_connections 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb33e215640 1 --2- 172.21.15.79:0/1232107656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380b2bf0 0x7fb3380d0020 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb33e215640 1 -- 172.21.15.79:0/1232107656 >> 172.21.15.79:0/1232107656 conn(0x7fb3380b1d10 msgr2=0x7fb3380b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb33e215640 1 -- 172.21.15.79:0/1232107656 shutdown_connections 2024-06-10T00:20:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.640+0000 7fb33e215640 1 -- 172.21.15.79:0/1232107656 wait complete. 2024-06-10T00:20:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.642+0000 7fb33e215640 1 Processor -- start 2024-06-10T00:20:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.642+0000 7fb33e215640 1 -- start start 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb33e215640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3380b2bf0 0x7fb3381e5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb33e215640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3380b3b40 0x7fb33809c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb33e215640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380d0560 0x7fb33809c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb33e215640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb33815d3f0 con 0x7fb3380d0560 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb33e215640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb33815d110 con 0x7fb3380b2bf0 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb33e215640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3380b3f20 con 0x7fb3380b3b40 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380d0560 0x7fb33809c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380d0560 0x7fb33809c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60816/0 (socket says 172.21.15.79:60816) 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 -- 172.21.15.79:0/1889005048 learned_addr learned my addr 172.21.15.79:0/1889005048 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3380b2bf0 0x7fb3381e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb336ffd640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3380b3b40 0x7fb33809c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 -- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3380b3b40 msgr2=0x7fb33809c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3380b3b40 0x7fb33809c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 -- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3380b2bf0 msgr2=0x7fb3381e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3380b2bf0 0x7fb3381e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 -- 172.21.15.79:0/1889005048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb338145cf0 con 0x7fb3380d0560 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb336ffd640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3380b3b40 0x7fb33809c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3380b2bf0 0x7fb3381e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb337fff640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380d0560 0x7fb33809c980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c410 tx=0x7fb33000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb31ffff640 1 -- 172.21.15.79:0/1889005048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300074e0 con 0x7fb3380d0560 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb31ffff640 1 -- 172.21.15.79:0/1889005048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3300047e0 con 0x7fb3380d0560 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb33e215640 1 -- 172.21.15.79:0/1889005048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33809d1a0 con 0x7fb3380d0560 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.643+0000 7fb31ffff640 1 -- 172.21.15.79:0/1889005048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330004bd0 con 0x7fb3380d0560 2024-06-10T00:20:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.644+0000 7fb33e215640 1 -- 172.21.15.79:0/1889005048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33809cec0 con 0x7fb3380d0560 2024-06-10T00:20:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.645+0000 7fb31ffff640 1 -- 172.21.15.79:0/1889005048 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb330011070 con 0x7fb3380d0560 2024-06-10T00:20:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.645+0000 7fb31ffff640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb32406be30 0x7fb32406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.646+0000 7fb31ffff640 1 -- 172.21.15.79:0/1889005048 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fb33008ac10 con 0x7fb3380d0560 2024-06-10T00:20:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.646+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb32406be30 0x7fb32406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.646+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb32406be30 0x7fb32406e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb328001dc0 tx=0x7fb328009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.646+0000 7fb341001740 1 Processor -- start 2024-06-10T00:20:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.647+0000 7fb341001740 1 -- start start 2024-06-10T00:20:08.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.647+0000 7fb341001740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc96014120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.647+0000 7fb341001740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc96014660 0x55fc96014aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb341001740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9603f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb341001740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fc95f397e0 con 0x55fc9603ef70 2024-06-10T00:20:08.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb341001740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fc95f77e80 con 0x55fc9603be60 2024-06-10T00:20:08.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb341001740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fc95f15700 con 0x55fc96014660 2024-06-10T00:20:08.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9603f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9603f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60824/0 (socket says 172.21.15.79:60824) 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 -- 172.21.15.79:0/1548301777 learned_addr learned my addr 172.21.15.79:0/1548301777 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb336ffd640 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc96014660 0x55fc96014aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc96014120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 -- 172.21.15.79:0/1548301777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc96014660 msgr2=0x55fc96014aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc96014660 0x55fc96014aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 -- 172.21.15.79:0/1548301777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 msgr2=0x55fc96014120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc96014120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 -- 172.21.15.79:0/1548301777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc95f34dd0 con 0x55fc9603ef70 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb337fff640 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9603f3f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb330088f00 tx=0x7fb3300593e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714a6f80d694fabe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb31d7fa640 1 -- 172.21.15.79:0/1548301777 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330087070 con 0x55fc9603ef70 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb31d7fa640 1 -- 172.21.15.79:0/1548301777 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3300618c0 con 0x55fc9603ef70 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.648+0000 7fb31d7fa640 1 -- 172.21.15.79:0/1548301777 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33006e070 con 0x55fc9603ef70 2024-06-10T00:20:08.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 -- 172.21.15.79:0/1548301777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 msgr2=0x55fc9603f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9603f3f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb330088f00 tx=0x7fb3300593e0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 -- 172.21.15.79:0/1548301777 shutdown_connections 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9603f3f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc96014660 0x55fc96014aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 --2- 172.21.15.79:0/1548301777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc96014120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 -- 172.21.15.79:0/1548301777 >> 172.21.15.79:0/1548301777 conn(0x55fc96011410 msgr2=0x55fc96059f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 -- 172.21.15.79:0/1548301777 shutdown_connections 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.649+0000 7fb341001740 1 -- 172.21.15.79:0/1548301777 wait complete. 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 1 -- start start 2024-06-10T00:20:08.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 1 Processor -- start 2024-06-10T00:20:08.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc9600e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9605ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9605bdd0 0x55fc960348c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fc95f00640 con 0x55fc9603ef70 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fc95f73e40 con 0x55fc9603be60 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fc9600f1a0 con 0x55fc9605bdd0 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.650+0000 7fb341001740 10 client.0 _ll_register_callbacks cb 0x55fc95f32430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9605ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9605ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60838/0 (socket says 172.21.15.79:60838) 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 -- 172.21.15.79:0/1045294060 learned_addr learned my addr 172.21.15.79:0/1045294060 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb337fff640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9605bdd0 0x55fc960348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc9600e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 -- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9605bdd0 msgr2=0x55fc960348c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9605bdd0 0x55fc960348c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 -- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 msgr2=0x55fc9600e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc9600e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 -- 172.21.15.79:0/1045294060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc95d557d0 con 0x55fc9603ef70 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb337fff640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9605bdd0 0x55fc960348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc9600e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb336ffd640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9605ccd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb32c035040 tx=0x7fb32c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6d30e80198938d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb3167fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb3167fc640 1 -- 172.21.15.79:0/1045294060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c037040 con 0x55fc9603ef70 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb3167fc640 1 -- 172.21.15.79:0/1045294060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fb32c004230 con 0x55fc9603ef70 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb341001740 1 -- 172.21.15.79:0/1045294060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3300618c0 con 0x55fc9603ef70 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb3167fc640 1 -- 172.21.15.79:0/1045294060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb32c04d050 con 0x55fc9603ef70 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb341001740 10 client.6693 fetch_fsmap learned FSMap version 44 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb341001740 1 -- 172.21.15.79:0/1045294060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55fc95c8b3f0 con 0x55fc9603ef70 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.651+0000 7fb3167fc640 1 -- 172.21.15.79:0/1045294060 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3300618c0 con 0x55fc9603ef70 2024-06-10T00:20:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb3167fc640 1 -- 172.21.15.79:0/1045294060 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 3494+0+0 (secure 0 0 0) 0x7fb32c050020 con 0x55fc9603ef70 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb341001740 10 client.6693 fetch_fsmap finished waiting for FSMap version 44 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb341001740 10 client.6693 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb341001740 20 client.6693 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb341001740 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fc96035910 0x55fc9603a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb341001740 4 client.6693 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb341001740 1 -- 172.21.15.79:0/1045294060 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc95f855b0 con 0x55fc96035910 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fc96035910 0x55fc9603a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb3167fc640 10 client.6693 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.652+0000 7fb3377fe640 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fc96035910 0x55fc9603a400 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b178d0a41fd3d1b server_cookie=2828b594f0b06890 in_seq=0 out_seq=0 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb3167fc640 1 -- 172.21.15.79:0/1045294060 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fc95f855b0 con 0x55fc96035910 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb3167fc640 10 client.6693 handle_command_reply: tid=0 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 client.6693 shutdown 2024-06-10T00:20:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 -- 172.21.15.79:0/1045294060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 msgr2=0x55fc9605ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9605ccd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb32c035040 tx=0x7fb32c004730 comp rx=0 tx=0).stop 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 -- 172.21.15.79:0/1045294060 shutdown_connections 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9605bdd0 0x55fc960348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fc96035910 0x55fc9603a400 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb3167fc640 0 client.6693 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc9605ccd0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 --2- 172.21.15.79:0/1045294060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9603be60 0x55fc9600e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 -- 172.21.15.79:0/1045294060 >> 172.21.15.79:0/1045294060 conn(0x55fc96014660 msgr2=0x55fc9603c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 -- 172.21.15.79:0/1045294060 shutdown_connections 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 1 -- 172.21.15.79:0/1045294060 wait complete. 2024-06-10T00:20:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.653+0000 7fb341001740 20 client.6693 trim_cache size 0 max 16384 2024-06-10T00:20:08.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.671+0000 7fb341001740 1 Processor -- start 2024-06-10T00:20:08.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.671+0000 7fb341001740 1 -- start start 2024-06-10T00:20:08.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb341001740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603be60 0x55fc9605cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb341001740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603ef70 0x55fc96059f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb341001740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc9605a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb341001740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb338072930 con 0x55fc9603be60 2024-06-10T00:20:08.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb341001740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb338071970 con 0x55fc9605bdd0 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb341001740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb338148890 con 0x55fc9603ef70 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603be60 0x55fc9605cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603be60 0x55fc9605cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60854/0 (socket says 172.21.15.79:60854) 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 -- 172.21.15.79:0/3444301801 learned_addr learned my addr 172.21.15.79:0/3444301801 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 -- 172.21.15.79:0/3444301801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603ef70 msgr2=0x55fc96059f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 --2- 172.21.15.79:0/3444301801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603ef70 0x55fc96059f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb337fff640 1 --2- 172.21.15.79:0/3444301801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc9605a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 -- 172.21.15.79:0/3444301801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 msgr2=0x55fc9605a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 --2- 172.21.15.79:0/3444301801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc9605a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 -- 172.21.15.79:0/3444301801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc95c4b0f0 con 0x55fc9603be60 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.672+0000 7fb3377fe640 1 --2- 172.21.15.79:0/3444301801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603be60 0x55fc9605cc50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb328003b50 tx=0x7fb328011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f494b3c0cb11d54 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb31cff9640 1 -- 172.21.15.79:0/3444301801 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328027040 con 0x55fc9603be60 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb31cff9640 1 -- 172.21.15.79:0/3444301801 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32800dde0 con 0x55fc9603be60 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb31cff9640 1 -- 172.21.15.79:0/3444301801 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3280057d0 con 0x55fc9603be60 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 -- 172.21.15.79:0/3444301801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603be60 msgr2=0x55fc9605cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 --2- 172.21.15.79:0/3444301801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603be60 0x55fc9605cc50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb328003b50 tx=0x7fb328011000 comp rx=0 tx=0).stop 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 -- 172.21.15.79:0/3444301801 shutdown_connections 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 --2- 172.21.15.79:0/3444301801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc9605a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 --2- 172.21.15.79:0/3444301801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603ef70 0x55fc96059f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 --2- 172.21.15.79:0/3444301801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603be60 0x55fc9605cc50 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 -- 172.21.15.79:0/3444301801 >> 172.21.15.79:0/3444301801 conn(0x55fc96014660 msgr2=0x55fc96034690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 -- 172.21.15.79:0/3444301801 shutdown_connections 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.673+0000 7fb341001740 1 -- 172.21.15.79:0/3444301801 wait complete. 2024-06-10T00:20:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.674+0000 7fb341001740 1 -- start start 2024-06-10T00:20:08.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.674+0000 7fb341001740 1 Processor -- start 2024-06-10T00:20:08.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb341001740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603be60 0x55fc96056a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb341001740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc960db330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb341001740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc96013ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb341001740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb338071320 con 0x55fc9603ef70 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb341001740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fc96014410 con 0x55fc9605bdd0 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb341001740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fc960347c0 con 0x55fc9603be60 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb341001740 10 client.0 _ll_register_callbacks cb 0x7fb32c009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc960db330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc960db330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60860/0 (socket says 172.21.15.79:60860) 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 -- 172.21.15.79:0/3848937019 learned_addr learned my addr 172.21.15.79:0/3848937019 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb337fff640 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc96013ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb3377fe640 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603be60 0x55fc96056a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 -- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603be60 msgr2=0x55fc96056a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603be60 0x55fc96056a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 -- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 msgr2=0x55fc96013ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc96013ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 -- 172.21.15.79:0/3848937019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc95f3e560 con 0x55fc9603ef70 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb337fff640 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc96013ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb336ffd640 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc960db330 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb32c000c00 tx=0x7fb32c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6aa70dca50d2d9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb3167fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb3167fc640 1 -- 172.21.15.79:0/3848937019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c037040 con 0x55fc9603ef70 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb3167fc640 1 -- 172.21.15.79:0/3848937019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fb32c032c90 con 0x55fc9603ef70 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.675+0000 7fb341001740 1 -- 172.21.15.79:0/3848937019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb32800dde0 con 0x55fc9603ef70 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb3167fc640 1 -- 172.21.15.79:0/3848937019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb32c05e050 con 0x55fc9603ef70 2024-06-10T00:20:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 10 client.6699 fetch_fsmap learned FSMap version 44 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 -- 172.21.15.79:0/3848937019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55fc96034560 con 0x55fc9603ef70 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb3167fc640 1 -- 172.21.15.79:0/3848937019 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32800dde0 con 0x55fc9603ef70 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb3167fc640 1 -- 172.21.15.79:0/3848937019 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 3494+0+0 (secure 0 0 0) 0x7fb32c061020 con 0x55fc9603ef70 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 10 client.6699 fetch_fsmap finished waiting for FSMap version 44 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 10 client.6699 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 20 client.6699 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fc96033b40 0x55fc96033f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 4 client.6699 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 -- 172.21.15.79:0/3848937019 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fc95f7f900 con 0x55fc96033b40 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb3377fe640 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fc96033b40 0x55fc96033f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb3167fc640 10 client.6699 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb3377fe640 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fc96033b40 0x55fc96033f50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c55bf9d91d739ea8 server_cookie=ed95a9c54326a7c8 in_seq=0 out_seq=0 2024-06-10T00:20:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb3167fc640 1 -- 172.21.15.79:0/3848937019 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fc95f7f900 con 0x55fc96033b40 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb3167fc640 10 client.6699 handle_command_reply: tid=0 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 client.6699 shutdown 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 -- 172.21.15.79:0/3848937019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 msgr2=0x55fc960db330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc960db330 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb32c000c00 tx=0x7fb32c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 -- 172.21.15.79:0/3848937019 shutdown_connections 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc9605bdd0 0x55fc96013ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.676+0000 7fb341001740 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fc96033b40 0x55fc96033f50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb341001740 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc9603ef70 0x55fc960db330 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb3167fc640 0 client.6699 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb341001740 1 --2- 172.21.15.79:0/3848937019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fc9603be60 0x55fc96056a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb341001740 1 -- 172.21.15.79:0/3848937019 >> 172.21.15.79:0/3848937019 conn(0x55fc96014660 msgr2=0x55fc9604fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb341001740 1 -- 172.21.15.79:0/3848937019 shutdown_connections 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb341001740 1 -- 172.21.15.79:0/3848937019 wait complete. 2024-06-10T00:20:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb341001740 20 client.6699 trim_cache size 0 max 16384 2024-06-10T00:20:08.684 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:08.684 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:20:08.684 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:20:08.684 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 -- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb32406be30 msgr2=0x7fb32406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb32406be30 0x7fb32406e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb328001dc0 tx=0x7fb328009040 comp rx=0 tx=0).stop 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 -- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380d0560 msgr2=0x7fb33809c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380d0560 0x7fb33809c980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c410 tx=0x7fb33000c8d0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 -- 172.21.15.79:0/1889005048 shutdown_connections 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb32406be30 0x7fb32406e2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3380d0560 0x7fb33809c980 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3380b3b40 0x7fb33809c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 --2- 172.21.15.79:0/1889005048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3380b2bf0 0x7fb3381e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 -- 172.21.15.79:0/1889005048 >> 172.21.15.79:0/1889005048 conn(0x7fb3380b1d10 msgr2=0x7fb3380cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:08.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 -- 172.21.15.79:0/1889005048 shutdown_connections 2024-06-10T00:20:08.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.677+0000 7fb33e215640 1 -- 172.21.15.79:0/1889005048 wait complete. 2024-06-10T00:20:08.688 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:20:08.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:08.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.788+0000 7fe5ded89640 1 Processor -- start 2024-06-10T00:20:08.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.788+0000 7fe5ded89640 1 -- start start 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5ded89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 0x7fe5d806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5ded89640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5d806ea20 0x7fe5d80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5ded89640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5d80cf190 0x7fe5d815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5ded89640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d806ee60 con 0x7fe5d806ea20 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5ded89640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d80cf620 con 0x7fe5d80cf190 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5ded89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d806d130 con 0x7fe5d80ae910 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5d7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5d806ea20 0x7fe5d80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5d7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5d806ea20 0x7fe5d80cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60862/0 (socket says 172.21.15.79:60862) 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5d7fff640 1 -- 172.21.15.79:0/875901660 learned_addr learned my addr 172.21.15.79:0/875901660 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:08.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5dcb25640 1 --2- 172.21.15.79:0/875901660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 0x7fe5d806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5dd326640 1 --2- 172.21.15.79:0/875901660 >> v2:172.21.15.117:3300/0 conn(0x7fe5d80cf190 0x7fe5d815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5d7fff640 1 -- 172.21.15.79:0/875901660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 msgr2=0x7fe5d806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5d7fff640 1 --2- 172.21.15.79:0/875901660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 0x7fe5d806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5d7fff640 1 -- 172.21.15.79:0/875901660 >> v2:172.21.15.117:3300/0 conn(0x7fe5d80cf190 msgr2=0x7fe5d815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:08.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5d7fff640 1 --2- 172.21.15.79:0/875901660 >> v2:172.21.15.117:3300/0 conn(0x7fe5d80cf190 0x7fe5d815ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.789+0000 7fe5d7fff640 1 -- 172.21.15.79:0/875901660 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d806d410 con 0x7fe5d806ea20 2024-06-10T00:20:08.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5d7fff640 1 --2- 172.21.15.79:0/875901660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d80cec50 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009870 tx=0x7fe5c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b4906aba1997aa server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5d77fe640 1 -- 172.21.15.79:0/875901660 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4037070 con 0x7fe5d806ea20 2024-06-10T00:20:08.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5d77fe640 1 -- 172.21.15.79:0/875901660 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c4032440 con 0x7fe5d806ea20 2024-06-10T00:20:08.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5d77fe640 1 -- 172.21.15.79:0/875901660 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4032810 con 0x7fe5d806ea20 2024-06-10T00:20:08.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5ded89640 1 -- 172.21.15.79:0/875901660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 msgr2=0x7fe5d80cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5ded89640 1 --2- 172.21.15.79:0/875901660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d80cec50 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009870 tx=0x7fe5c402a180 comp rx=0 tx=0).stop 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5ded89640 1 -- 172.21.15.79:0/875901660 shutdown_connections 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5ded89640 1 --2- 172.21.15.79:0/875901660 >> v2:172.21.15.117:3300/0 conn(0x7fe5d80cf190 0x7fe5d815ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5ded89640 1 --2- 172.21.15.79:0/875901660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d80cec50 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5ded89640 1 --2- 172.21.15.79:0/875901660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 0x7fe5d806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5ded89640 1 -- 172.21.15.79:0/875901660 >> 172.21.15.79:0/875901660 conn(0x7fe5d80b19f0 msgr2=0x7fe5d80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.790+0000 7fe5ded89640 1 -- 172.21.15.79:0/875901660 shutdown_connections 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.791+0000 7fe5ded89640 1 -- 172.21.15.79:0/875901660 wait complete. 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.792+0000 7fe5ded89640 1 Processor -- start 2024-06-10T00:20:08.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.792+0000 7fe5ded89640 1 -- start start 2024-06-10T00:20:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.792+0000 7fe5ded89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.792+0000 7fe5ded89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 0x7fe5d81516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.792+0000 7fe5ded89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d80cf190 0x7fe5d80cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.792+0000 7fe5ded89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80aecf0 con 0x7fe5d806ea20 2024-06-10T00:20:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.792+0000 7fe5ded89640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d806d9d0 con 0x7fe5d80cf190 2024-06-10T00:20:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.792+0000 7fe5ded89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d815f010 con 0x7fe5d80ae910 2024-06-10T00:20:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d815cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60870/0 (socket says 172.21.15.79:60870) 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 -- 172.21.15.79:0/558043235 learned_addr learned my addr 172.21.15.79:0/558043235 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 -- 172.21.15.79:0/558043235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 msgr2=0x7fe5d81516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 0x7fe5d81516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 -- 172.21.15.79:0/558043235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d80cf190 msgr2=0x7fe5d80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d80cf190 0x7fe5d80cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 -- 172.21.15.79:0/558043235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d81e6120 con 0x7fe5d806ea20 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5dcb25640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d815cef0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00d800 tx=0x7fe5cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5d57fa640 1 -- 172.21.15.79:0/558043235 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc018020 con 0x7fe5d806ea20 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5d57fa640 1 -- 172.21.15.79:0/558043235 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0096a0 con 0x7fe5d806ea20 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5d57fa640 1 -- 172.21.15.79:0/558043235 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc009a70 con 0x7fe5d806ea20 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d81e6400 con 0x7fe5d806ea20 2024-06-10T00:20:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.793+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d81e69c0 con 0x7fe5d806ea20 2024-06-10T00:20:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.794+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d8068430 con 0x7fe5d806ea20 2024-06-10T00:20:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.795+0000 7fe5d57fa640 1 -- 172.21.15.79:0/558043235 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5cc01b020 con 0x7fe5d806ea20 2024-06-10T00:20:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.795+0000 7fe5d57fa640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.795+0000 7fe5d57fa640 1 -- 172.21.15.79:0/558043235 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fe5cc08b320 con 0x7fe5d806ea20 2024-06-10T00:20:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.795+0000 7fe5d7fff640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.796+0000 7fe5d7fff640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4034000 tx=0x7fe5c402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:08.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:08.799+0000 7fe5d57fa640 1 -- 172.21.15.79:0/558043235 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe5cc022030 con 0x7fe5d806ea20 2024-06-10T00:20:09.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.013+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5d8151ce0 con 0x7fe5d806ea20 2024-06-10T00:20:09.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.014+0000 7fe5d57fa640 1 -- 172.21.15.79:0/558043235 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5185 (secure 0 0 0) 0x7fe5cc059a70 con 0x7fe5d806ea20 2024-06-10T00:20:09.013 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:09.013 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:19:43.820079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6471,"qdb_cluster":[6471]},"id":5}]} 2024-06-10T00:20:09.014 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 44 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe5bc06be30 msgr2=0x7fe5bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4034000 tx=0x7fe5c402c000 comp rx=0 tx=0).stop 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 msgr2=0x7fe5d815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d815cef0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00d800 tx=0x7fe5cc00dcc0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 shutdown_connections 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe5bc06be30 0x7fe5bc06e2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d80cf190 0x7fe5d80cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5d80ae910 0x7fe5d81516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 --2- 172.21.15.79:0/558043235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d806ea20 0x7fe5d815cef0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 >> 172.21.15.79:0/558043235 conn(0x7fe5d80b19f0 msgr2=0x7fe5d80b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 shutdown_connections 2024-06-10T00:20:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.016+0000 7fe5ded89640 1 -- 172.21.15.79:0/558043235 wait complete. 2024-06-10T00:20:09.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-06-10T00:20:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.128+0000 7f02d60c1640 1 Processor -- start 2024-06-10T00:20:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.128+0000 7f02d60c1640 1 -- start start 2024-06-10T00:20:09.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02d60c1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02d00d0020 0x7f02d00d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02d60c1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d0155700 con 0x7f02d006e1f0 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02d60c1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d015b6b0 con 0x7f02d0155320 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02d60c1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f02d00d09c0 con 0x7f02d00d0020 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02ceffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02d00d0020 0x7f02d00d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02cffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f02d006e1f0 0x7f02d006e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51642/0 (socket says 172.21.15.79:51642) 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02ceffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02d00d0020 0x7f02d00d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60882/0 (socket says 172.21.15.79:60882) 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02cffff640 1 -- 172.21.15.79:0/149361828 learned_addr learned my addr 172.21.15.79:0/149361828 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02ceffd640 1 -- 172.21.15.79:0/149361828 >> v1:172.21.15.117:6789/0 conn(0x7f02d0155320 legacy=0x7f02d00b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02ceffd640 1 -- 172.21.15.79:0/149361828 >> v1:172.21.15.79:6789/0 conn(0x7f02d006e1f0 legacy=0x7f02d006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.129+0000 7f02ceffd640 1 -- 172.21.15.79:0/149361828 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d015b990 con 0x7f02d00d0020 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.130+0000 7f02ceffd640 1 --2- 172.21.15.79:0/149361828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d00d0020 0x7f02d00d0480 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f02c40097a0 tx=0x7f02c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93016872371ab69 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.130+0000 7f02ce7fc640 1 -- 172.21.15.79:0/149361828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4037070 con 0x7f02d00d0020 2024-06-10T00:20:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.130+0000 7f02ce7fc640 1 -- 172.21.15.79:0/149361828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c4032440 con 0x7f02d00d0020 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.130+0000 7f02ce7fc640 1 -- 172.21.15.79:0/149361828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4032810 con 0x7f02d00d0020 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.131+0000 7f02d60c1640 1 -- 172.21.15.79:0/149361828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d00d0020 msgr2=0x7f02d00d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.131+0000 7f02d60c1640 1 --2- 172.21.15.79:0/149361828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d00d0020 0x7f02d00d0480 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f02c40097a0 tx=0x7f02c402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.131+0000 7f02d60c1640 1 -- 172.21.15.79:0/149361828 shutdown_connections 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.131+0000 7f02d60c1640 1 --2- 172.21.15.79:0/149361828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d00d0020 0x7f02d00d0480 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.131+0000 7f02d60c1640 1 -- 172.21.15.79:0/149361828 >> 172.21.15.79:0/149361828 conn(0x7f02d00b1d10 msgr2=0x7f02d00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.131+0000 7f02d60c1640 1 -- 172.21.15.79:0/149361828 shutdown_connections 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.131+0000 7f02d60c1640 1 -- 172.21.15.79:0/149361828 wait complete. 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.132+0000 7f02d60c1640 1 Processor -- start 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.132+0000 7f02d60c1640 1 -- start start 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02d60c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d006e1f0 0x7f02d00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02d60c1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d00d0020 0x7f02d014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02d60c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d0155320 0x7f02d0158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02d60c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02d015bf50 con 0x7f02d0155320 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02d60c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f02d015b2f0 con 0x7f02d006e1f0 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02d60c1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f02d015b470 con 0x7f02d00d0020 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d0155320 0x7f02d0158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d0155320 0x7f02d0158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60898/0 (socket says 172.21.15.79:60898) 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 -- 172.21.15.79:0/2752619122 learned_addr learned my addr 172.21.15.79:0/2752619122 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02ceffd640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d00d0020 0x7f02d014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d006e1f0 0x7f02d00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 -- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d00d0020 msgr2=0x7f02d014bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d00d0020 0x7f02d014bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 -- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d006e1f0 msgr2=0x7f02d00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d006e1f0 0x7f02d00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 -- 172.21.15.79:0/2752619122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d015ea60 con 0x7f02d0155320 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02ceffd640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d00d0020 0x7f02d014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d006e1f0 0x7f02d00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02cffff640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d0155320 0x7f02d0158d10 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c9f0 tx=0x7f02c800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02b7fff640 1 -- 172.21.15.79:0/2752619122 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8017070 con 0x7f02d0155320 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.133+0000 7f02b7fff640 1 -- 172.21.15.79:0/2752619122 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c800ab70 con 0x7f02d0155320 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.134+0000 7f02b7fff640 1 -- 172.21.15.79:0/2752619122 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8012400 con 0x7f02d0155320 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.134+0000 7f02d60c1640 1 -- 172.21.15.79:0/2752619122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d00cf370 con 0x7f02d0155320 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.134+0000 7f02d60c1640 1 -- 172.21.15.79:0/2752619122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d015efc0 con 0x7f02d0155320 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.135+0000 7f02b7fff640 1 -- 172.21.15.79:0/2752619122 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02c801a070 con 0x7f02d0155320 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.136+0000 7f02b7fff640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02bc06be30 0x7f02bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.136+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02bc06be30 0x7f02bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.136+0000 7f02b7fff640 1 -- 172.21.15.79:0/2752619122 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f02c808ac40 con 0x7f02d0155320 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.136+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02bc06be30 0x7f02bc06e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f02d00b4340 tx=0x7f02c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.137+0000 7f02d8dcd740 1 Processor -- start 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.137+0000 7f02d8dcd740 1 -- start start 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe941b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe944b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944ba00 0x55fbe9420810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbe9384d80 con 0x55fbe944c140 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fbe93222f0 con 0x55fbe9469020 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fbe9380d40 con 0x55fbe944ba00 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe944b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe944b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60906/0 (socket says 172.21.15.79:60906) 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 -- 172.21.15.79:0/245110179 learned_addr learned my addr 172.21.15.79:0/245110179 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:09.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 -- 172.21.15.79:0/245110179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944ba00 msgr2=0x55fbe9420810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe941b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02cffff640 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944ba00 0x55fbe9420810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944ba00 0x55fbe9420810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 -- 172.21.15.79:0/245110179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 msgr2=0x55fbe941b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe941b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 -- 172.21.15.79:0/245110179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe91647c0 con 0x55fbe944c140 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02ceffd640 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe944b4c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f02c40098c0 tx=0x7f02c402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fb3079ec6bc3c0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02b57fa640 1 -- 172.21.15.79:0/245110179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4037040 con 0x55fbe944c140 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02b57fa640 1 -- 172.21.15.79:0/245110179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c4032740 con 0x55fbe944c140 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.138+0000 7f02b57fa640 1 -- 172.21.15.79:0/245110179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4032b10 con 0x55fbe944c140 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 -- 172.21.15.79:0/245110179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 msgr2=0x55fbe944b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe944b4c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f02c40098c0 tx=0x7f02c402c000 comp rx=0 tx=0).stop 2024-06-10T00:20:09.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 -- 172.21.15.79:0/245110179 shutdown_connections 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944ba00 0x55fbe9420810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe944b4c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/245110179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe941b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 -- 172.21.15.79:0/245110179 >> 172.21.15.79:0/245110179 conn(0x55fbe941dc20 msgr2=0x55fbe94664c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 -- 172.21.15.79:0/245110179 shutdown_connections 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.139+0000 7f02d8dcd740 1 -- 172.21.15.79:0/245110179 wait complete. 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.140+0000 7f02d8dcd740 1 -- start start 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.140+0000 7f02d8dcd740 1 Processor -- start 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.140+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944c140 0x55fbe943be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.140+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9469020 0x55fbe94761b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.140+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 0x55fbe944ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.140+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbe941fdd0 con 0x55fbe9469020 2024-06-10T00:20:09.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.140+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fbe931fda0 con 0x55fbe944e7d0 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.140+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fbe941f1c0 con 0x55fbe944c140 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02d8dcd740 10 client.0 _ll_register_callbacks cb 0x55fbe9097ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9469020 0x55fbe94761b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9469020 0x55fbe94761b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60916/0 (socket says 172.21.15.79:60916) 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 -- 172.21.15.79:0/473571796 learned_addr learned my addr 172.21.15.79:0/473571796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944c140 0x55fbe943be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 -- 172.21.15.79:0/473571796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944c140 msgr2=0x55fbe943be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944c140 0x55fbe943be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02cffff640 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 0x55fbe944ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 -- 172.21.15.79:0/473571796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 msgr2=0x55fbe944ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 0x55fbe944ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 -- 172.21.15.79:0/473571796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe91c4f50 con 0x55fbe9469020 2024-06-10T00:20:09.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ceffd640 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9469020 0x55fbe94761b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f02c40040c0 tx=0x7f02c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a261b362efd3ba server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ae7fc640 1 -- 172.21.15.79:0/473571796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c404a070 con 0x55fbe9469020 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ae7fc640 1 -- 172.21.15.79:0/473571796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f02c4032af0 con 0x55fbe9469020 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02d8dcd740 1 -- 172.21.15.79:0/473571796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c4032740 con 0x55fbe9469020 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02ae7fc640 1 -- 172.21.15.79:0/473571796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f02c4054050 con 0x55fbe9469020 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02d8dcd740 10 client.6720 fetch_fsmap learned FSMap version 44 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.141+0000 7f02d8dcd740 1 -- 172.21.15.79:0/473571796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55fbe90580b0 con 0x55fbe9469020 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02ae7fc640 1 -- 172.21.15.79:0/473571796 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c4032740 con 0x55fbe9469020 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02ae7fc640 1 -- 172.21.15.79:0/473571796 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 3494+0+0 (secure 0 0 0) 0x7f02c4057020 con 0x55fbe9469020 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02d8dcd740 10 client.6720 fetch_fsmap finished waiting for FSMap version 44 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02d8dcd740 10 client.6720 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02d8dcd740 20 client.6720 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fbe9449af0 0x55fbe9449ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02d8dcd740 4 client.6720 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02d8dcd740 1 -- 172.21.15.79:0/473571796 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbe93924b0 con 0x55fbe9449af0 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fbe9449af0 0x55fbe9449ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02ae7fc640 10 client.6720 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.142+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fbe9449af0 0x55fbe9449ed0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac4fba2f9b54de2b server_cookie=3537a6cadc70d191 in_seq=0 out_seq=0 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02ae7fc640 1 -- 172.21.15.79:0/473571796 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fbe93924b0 con 0x55fbe9449af0 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02ae7fc640 10 client.6720 handle_command_reply: tid=0 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 client.6720 shutdown 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 -- 172.21.15.79:0/473571796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9469020 msgr2=0x55fbe94761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9469020 0x55fbe94761b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f02c40040c0 tx=0x7f02c4004730 comp rx=0 tx=0).stop 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 -- 172.21.15.79:0/473571796 shutdown_connections 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 0x55fbe944ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fbe9449af0 0x55fbe9449ed0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe9469020 0x55fbe94761b0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/473571796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944c140 0x55fbe943be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02ae7fc640 0 client.6720 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 -- 172.21.15.79:0/473571796 >> 172.21.15.79:0/473571796 conn(0x55fbe944ba00 msgr2=0x55fbe941aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 -- 172.21.15.79:0/473571796 shutdown_connections 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 1 -- 172.21.15.79:0/473571796 wait complete. 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.143+0000 7f02d8dcd740 20 client.6720 trim_cache size 0 max 16384 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.156+0000 7f02d8dcd740 1 Processor -- start 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.156+0000 7f02d8dcd740 1 -- start start 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe9448be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944e7d0 0x55fbe9447460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe9480270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01feca0 con 0x55fbe944c140 2024-06-10T00:20:09.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01fdcc0 con 0x55fbe9469020 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f02d01fd080 con 0x55fbe944e7d0 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe9448be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe9448be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60930/0 (socket says 172.21.15.79:60930) 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.157+0000 7f02cf7fe640 1 -- 172.21.15.79:0/354293400 learned_addr learned my addr 172.21.15.79:0/354293400 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02cf7fe640 1 -- 172.21.15.79:0/354293400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944e7d0 msgr2=0x55fbe9447460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944e7d0 0x55fbe9447460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02cf7fe640 1 -- 172.21.15.79:0/354293400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 msgr2=0x55fbe9480270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02cffff640 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe9480270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe9480270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02cf7fe640 1 -- 172.21.15.79:0/354293400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe9468180 con 0x55fbe944c140 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02cffff640 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe9480270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe9448be0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005360 tx=0x7f02c000b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378f3f8f5cef8a45 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02b4ff9640 1 -- 172.21.15.79:0/354293400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0015960 con 0x55fbe944c140 2024-06-10T00:20:09.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02b4ff9640 1 -- 172.21.15.79:0/354293400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c0015b00 con 0x55fbe944c140 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02b4ff9640 1 -- 172.21.15.79:0/354293400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0013470 con 0x55fbe944c140 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02d8dcd740 1 -- 172.21.15.79:0/354293400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 msgr2=0x55fbe9448be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.158+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe9448be0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005360 tx=0x7f02c000b000 comp rx=0 tx=0).stop 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 -- 172.21.15.79:0/354293400 shutdown_connections 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe9469020 0x55fbe9480270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe944e7d0 0x55fbe9447460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/354293400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe9448be0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 -- 172.21.15.79:0/354293400 >> 172.21.15.79:0/354293400 conn(0x55fbe944ba00 msgr2=0x55fbe941e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 -- 172.21.15.79:0/354293400 shutdown_connections 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 -- 172.21.15.79:0/354293400 wait complete. 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 -- start start 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.159+0000 7f02d8dcd740 1 Processor -- start 2024-06-10T00:20:09.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe94485b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 0x55fbe94e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02d8dcd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe9469020 0x55fbe945be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fbe944cd90 con 0x55fbe944c140 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01fd670 con 0x55fbe944e7d0 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02d8dcd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fbe944db30 con 0x55fbe9469020 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02d8dcd740 10 client.0 _ll_register_callbacks cb 0x7f02c4009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe94485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe94485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60938/0 (socket says 172.21.15.79:60938) 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 -- 172.21.15.79:0/3942145618 learned_addr learned my addr 172.21.15.79:0/3942145618 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02ceffd640 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 0x55fbe94e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cffff640 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe9469020 0x55fbe945be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 -- 172.21.15.79:0/3942145618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe9469020 msgr2=0x55fbe945be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe9469020 0x55fbe945be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 -- 172.21.15.79:0/3942145618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 msgr2=0x55fbe94e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 0x55fbe94e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 -- 172.21.15.79:0/3942145618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe945cab0 con 0x55fbe944c140 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02cf7fe640 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe94485b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f02c000d520 tx=0x7f02c00036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b14bef251b76228 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02ae7fc640 1 -- 172.21.15.79:0/3942145618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00152b0 con 0x55fbe944c140 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.160+0000 7f02ae7fc640 1 -- 172.21.15.79:0/3942145618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f02c0036cb0 con 0x55fbe944c140 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 1 -- 172.21.15.79:0/3942145618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c0015b00 con 0x55fbe944c140 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02ae7fc640 1 -- 172.21.15.79:0/3942145618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f02c003d050 con 0x55fbe944c140 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 10 client.6726 fetch_fsmap learned FSMap version 44 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 1 -- 172.21.15.79:0/3942145618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55fbe94ea1c0 con 0x55fbe944c140 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02ae7fc640 1 -- 172.21.15.79:0/3942145618 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c0015b00 con 0x55fbe944c140 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02ae7fc640 1 -- 172.21.15.79:0/3942145618 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 3494+0+0 (secure 0 0 0) 0x7f02c0040020 con 0x55fbe944c140 2024-06-10T00:20:09.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 10 client.6726 fetch_fsmap finished waiting for FSMap version 44 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 10 client.6726 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 20 client.6726 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fbe945c390 0x55fbe9445ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 4 client.6726 mds_command: new command op to 6471 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02d8dcd740 1 -- 172.21.15.79:0/3942145618 --> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55fbe938c800 con 0x55fbe945c390 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02ceffd640 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fbe945c390 0x55fbe9445ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02ae7fc640 10 client.6726 ms_handle_connect on v2:172.21.15.79:6834/2491534848 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02ceffd640 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fbe945c390 0x55fbe9445ee0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f5a18940ac7296 server_cookie=e4478d6b9a109fde in_seq=0 out_seq=0 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02ae7fc640 1 -- 172.21.15.79:0/3942145618 <== mds.0 v2:172.21.15.79:6834/2491534848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbe938c800 con 0x55fbe945c390 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.161+0000 7f02ae7fc640 10 client.6726 handle_command_reply: tid=0 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 client.6726 shutdown 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 -- 172.21.15.79:0/3942145618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 msgr2=0x55fbe94485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe94485b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f02c000d520 tx=0x7f02c00036f0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 -- 172.21.15.79:0/3942145618 shutdown_connections 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fbe9469020 0x55fbe945be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fbe944e7d0 0x55fbe94e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.79:6834/2491534848,v1:172.21.15.79:6835/2491534848] conn(0x55fbe945c390 0x55fbe9445ee0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 --2- 172.21.15.79:0/3942145618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fbe944c140 0x55fbe94485b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 -- 172.21.15.79:0/3942145618 >> 172.21.15.79:0/3942145618 conn(0x55fbe944ba00 msgr2=0x55fbe94664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02ae7fc640 0 client.6726 ms_handle_reset on v2:172.21.15.79:6834/2491534848 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 -- 172.21.15.79:0/3942145618 shutdown_connections 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 1 -- 172.21.15.79:0/3942145618 wait complete. 2024-06-10T00:20:09.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d8dcd740 20 client.6726 trim_cache size 0 max 16384 2024-06-10T00:20:09.373 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:09.373 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-06-10T00:20:09.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 -- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02bc06be30 msgr2=0x7f02bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02bc06be30 0x7f02bc06e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f02d00b4340 tx=0x7f02c0009040 comp rx=0 tx=0).stop 2024-06-10T00:20:09.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 -- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d0155320 msgr2=0x7f02d0158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d0155320 0x7f02d0158d10 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c9f0 tx=0x7f02c800ceb0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 -- 172.21.15.79:0/2752619122 shutdown_connections 2024-06-10T00:20:09.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02bc06be30 0x7f02bc06e2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02d0155320 0x7f02d0158d10 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d00d0020 0x7f02d014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 --2- 172.21.15.79:0/2752619122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d006e1f0 0x7f02d00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 -- 172.21.15.79:0/2752619122 >> 172.21.15.79:0/2752619122 conn(0x7f02d00b1d10 msgr2=0x7f02d00b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 -- 172.21.15.79:0/2752619122 shutdown_connections 2024-06-10T00:20:09.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.162+0000 7f02d60c1640 1 -- 172.21.15.79:0/2752619122 wait complete. 2024-06-10T00:20:09.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-10T00:20:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.475+0000 7f8615b09640 1 Processor -- start 2024-06-10T00:20:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.475+0000 7f8615b09640 1 -- start start 2024-06-10T00:20:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f8615b09640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8610156830 0x7f8610071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f8615b09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f861015c7f0 0x7f8610165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f8615b09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86100725f0 con 0x7f8610072130 2024-06-10T00:20:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f8615b09640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f86100b3090 con 0x7f8610156830 2024-06-10T00:20:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f8615b09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86100728d0 con 0x7f861015c7f0 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f860effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8610072130 0x7f86100cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51652/0 (socket says 172.21.15.79:51652) 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f860effd640 1 -- 172.21.15.79:0/2367110029 learned_addr learned my addr 172.21.15.79:0/2367110029 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f860f7fe640 1 --2- 172.21.15.79:0/2367110029 >> v2:172.21.15.117:3300/0 conn(0x7f8610156830 0x7f8610071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f860ffff640 1 --2- 172.21.15.79:0/2367110029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f861015c7f0 0x7f8610165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f860e7fc640 1 -- 172.21.15.79:0/2367110029 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564876513 0 0) 0x7f86100725f0 con 0x7f8610072130 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.476+0000 7f860e7fc640 1 -- 172.21.15.79:0/2367110029 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f8003520 con 0x7f8610072130 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.477+0000 7f860f7fe640 1 -- 172.21.15.79:0/2367110029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f861015c7f0 msgr2=0x7f8610165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.477+0000 7f860f7fe640 1 --2- 172.21.15.79:0/2367110029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f861015c7f0 0x7f8610165cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.477+0000 7f860f7fe640 1 -- 172.21.15.79:0/2367110029 >> v1:172.21.15.79:6789/0 conn(0x7f8610072130 legacy=0x7f86100cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.477+0000 7f860f7fe640 1 -- 172.21.15.79:0/2367110029 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8610072bb0 con 0x7f8610156830 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.477+0000 7f860f7fe640 1 --2- 172.21.15.79:0/2367110029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610156830 0x7f8610071bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86000097a0 tx=0x7f860002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14745ac97417b161 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.477+0000 7f860e7fc640 1 -- 172.21.15.79:0/2367110029 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600037070 con 0x7f8610156830 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f860e7fc640 1 -- 172.21.15.79:0/2367110029 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8600032440 con 0x7f8610156830 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f860e7fc640 1 -- 172.21.15.79:0/2367110029 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86000327f0 con 0x7f8610156830 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f8615b09640 1 -- 172.21.15.79:0/2367110029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610156830 msgr2=0x7f8610071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f8615b09640 1 --2- 172.21.15.79:0/2367110029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610156830 0x7f8610071bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86000097a0 tx=0x7f860002a180 comp rx=0 tx=0).stop 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f8615b09640 1 -- 172.21.15.79:0/2367110029 shutdown_connections 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f8615b09640 1 --2- 172.21.15.79:0/2367110029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f861015c7f0 0x7f8610165cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f8615b09640 1 --2- 172.21.15.79:0/2367110029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610156830 0x7f8610071bf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f8615b09640 1 -- 172.21.15.79:0/2367110029 >> 172.21.15.79:0/2367110029 conn(0x7f86100b19f0 msgr2=0x7f86100b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f8615b09640 1 -- 172.21.15.79:0/2367110029 shutdown_connections 2024-06-10T00:20:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.478+0000 7f8615b09640 1 -- 172.21.15.79:0/2367110029 wait complete. 2024-06-10T00:20:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.479+0000 7f8615b09640 1 Processor -- start 2024-06-10T00:20:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.479+0000 7f8615b09640 1 -- start start 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f8615b09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610072130 0x7f86100cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f8615b09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8610156830 0x7f86101467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f8615b09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015c7f0 0x7f861015ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f8615b09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f86100ccf00 con 0x7f861015c7f0 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f8615b09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86100ccd80 con 0x7f8610072130 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f8615b09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86100cd080 con 0x7f8610156830 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f860ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015c7f0 0x7f861015ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f860ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015c7f0 0x7f861015ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60950/0 (socket says 172.21.15.79:60950) 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f860ffff640 1 -- 172.21.15.79:0/1861489254 learned_addr learned my addr 172.21.15.79:0/1861489254 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f860f7fe640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610072130 0x7f86100cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f860effd640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8610156830 0x7f86101467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.480+0000 7f860ffff640 1 -- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8610156830 msgr2=0x7f86101467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f860ffff640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8610156830 0x7f86101467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f860ffff640 1 -- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610072130 msgr2=0x7f86100cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f860ffff640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610072130 0x7f86100cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f860ffff640 1 -- 172.21.15.79:0/1861489254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86100ce120 con 0x7f861015c7f0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f860f7fe640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610072130 0x7f86100cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f860ffff640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015c7f0 0x7f861015ead0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8608009d30 tx=0x7f860800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f85f7fff640 1 -- 172.21.15.79:0/1861489254 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608018020 con 0x7f861015c7f0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f85f7fff640 1 -- 172.21.15.79:0/1861489254 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8608014480 con 0x7f861015c7f0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86100ce400 con 0x7f861015c7f0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f85f7fff640 1 -- 172.21.15.79:0/1861489254 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608014870 con 0x7f861015c7f0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.481+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86100ce9c0 con 0x7f861015c7f0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.482+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8610068430 con 0x7f861015c7f0 2024-06-10T00:20:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.482+0000 7f85f7fff640 1 -- 172.21.15.79:0/1861489254 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8608005d10 con 0x7f861015c7f0 2024-06-10T00:20:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.483+0000 7f85f7fff640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f85fc06be30 0x7f85fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.483+0000 7f85f7fff640 1 -- 172.21.15.79:0/1861489254 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f860808bea0 con 0x7f861015c7f0 2024-06-10T00:20:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.483+0000 7f860f7fe640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f85fc06be30 0x7f85fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.483+0000 7f860f7fe640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f85fc06be30 0x7f85fc06e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8600034000 tx=0x7f860002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.487+0000 7f85f7fff640 1 -- 172.21.15.79:0/1861489254 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8608022030 con 0x7f861015c7f0 2024-06-10T00:20:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.695+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f861009dd70 con 0x7f861015c7f0 2024-06-10T00:20:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.696+0000 7f85f7fff640 1 -- 172.21.15.79:0/1861489254 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8608010040 con 0x7f861015c7f0 2024-06-10T00:20:09.695 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:09.696 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-10T00:20:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.697+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f85fc06be30 msgr2=0x7f85fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f85fc06be30 0x7f85fc06e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8600034000 tx=0x7f860002e000 comp rx=0 tx=0).stop 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015c7f0 msgr2=0x7f861015ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015c7f0 0x7f861015ead0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8608009d30 tx=0x7f860800c490 comp rx=0 tx=0).stop 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 shutdown_connections 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f85fc06be30 0x7f85fc06e2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f861015c7f0 0x7f861015ead0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8610156830 0x7f86101467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 --2- 172.21.15.79:0/1861489254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8610072130 0x7f86100cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 >> 172.21.15.79:0/1861489254 conn(0x7f86100b19f0 msgr2=0x7f86100ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 shutdown_connections 2024-06-10T00:20:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.698+0000 7f8615b09640 1 -- 172.21.15.79:0/1861489254 wait complete. 2024-06-10T00:20:09.708 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-06-10T00:20:09.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:20:09.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.808+0000 7f505c763640 1 Processor -- start 2024-06-10T00:20:09.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.808+0000 7f505c763640 1 -- start start 2024-06-10T00:20:09.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f505c763640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50540ae910 0x7f505406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f505c763640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505406ea20 0x7f50540cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f505c763640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50540cf620 con 0x7f50540cf190 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f505c763640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f505406ee60 con 0x7f50540ae910 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f505c763640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f505406d130 con 0x7f505406ea20 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f505ad00640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f50540cf190 0x7f505415ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51666/0 (socket says 172.21.15.79:51666) 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f505ad00640 1 -- 172.21.15.79:0/1554227137 learned_addr learned my addr 172.21.15.79:0/1554227137 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f505a4ff640 1 --2- 172.21.15.79:0/1554227137 >> v2:172.21.15.117:3300/0 conn(0x7f50540ae910 0x7f505406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f5059cfe640 1 --2- 172.21.15.79:0/1554227137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505406ea20 0x7f50540cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f50594fd640 1 -- 172.21.15.79:0/1554227137 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107495198 0 0) 0x7f50540cf620 con 0x7f50540cf190 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.809+0000 7f50594fd640 1 -- 172.21.15.79:0/1554227137 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5040005730 con 0x7f50540cf190 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.810+0000 7f50594fd640 1 -- 172.21.15.79:0/1554227137 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4219513323 0 0) 0x7f5040005730 con 0x7f50540cf190 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.810+0000 7f5059cfe640 1 -- 172.21.15.79:0/1554227137 >> v2:172.21.15.117:3300/0 conn(0x7f50540ae910 msgr2=0x7f505406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.810+0000 7f5059cfe640 1 --2- 172.21.15.79:0/1554227137 >> v2:172.21.15.117:3300/0 conn(0x7f50540ae910 0x7f505406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.810+0000 7f5059cfe640 1 -- 172.21.15.79:0/1554227137 >> v1:172.21.15.79:6789/0 conn(0x7f50540cf190 legacy=0x7f505415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.810+0000 7f5059cfe640 1 -- 172.21.15.79:0/1554227137 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505406d410 con 0x7f505406ea20 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.810+0000 7f5059cfe640 1 --2- 172.21.15.79:0/1554227137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505406ea20 0x7f50540cec50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f50440097d0 tx=0x7f504402a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2404fdbaf77d01a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f50594fd640 1 -- 172.21.15.79:0/1554227137 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044037070 con 0x7f505406ea20 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f50594fd640 1 -- 172.21.15.79:0/1554227137 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504402ab40 con 0x7f505406ea20 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f50594fd640 1 -- 172.21.15.79:0/1554227137 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c0019f0 con 0x7f505406ea20 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f505c763640 1 -- 172.21.15.79:0/1554227137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505406ea20 msgr2=0x7f50540cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f505c763640 1 --2- 172.21.15.79:0/1554227137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505406ea20 0x7f50540cec50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f50440097d0 tx=0x7f504402a0b0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f505c763640 1 -- 172.21.15.79:0/1554227137 shutdown_connections 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f505c763640 1 --2- 172.21.15.79:0/1554227137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505406ea20 0x7f50540cec50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f505c763640 1 --2- 172.21.15.79:0/1554227137 >> v2:172.21.15.117:3300/0 conn(0x7f50540ae910 0x7f505406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f505c763640 1 -- 172.21.15.79:0/1554227137 >> 172.21.15.79:0/1554227137 conn(0x7f50540b19f0 msgr2=0x7f50540b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f505c763640 1 -- 172.21.15.79:0/1554227137 shutdown_connections 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.811+0000 7f505c763640 1 -- 172.21.15.79:0/1554227137 wait complete. 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.812+0000 7f505c763640 1 Processor -- start 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.812+0000 7f505c763640 1 -- start start 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505c763640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f505406ea20 0x7f50541481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505c763640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50540ae910 0x7f505415d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505c763640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50540cf190 0x7f505415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505c763640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f50540aecf0 con 0x7f505406ea20 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505c763640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f505406d9d0 con 0x7f50540ae910 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505c763640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50540add50 con 0x7f50540cf190 2024-06-10T00:20:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505a4ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f505406ea20 0x7f50541481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505a4ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f505406ea20 0x7f50541481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60952/0 (socket says 172.21.15.79:60952) 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505a4ff640 1 -- 172.21.15.79:0/179351645 learned_addr learned my addr 172.21.15.79:0/179351645 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f5059cfe640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50540ae910 0x7f505415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505ad00640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50540cf190 0x7f505415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505a4ff640 1 -- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50540cf190 msgr2=0x7f505415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505a4ff640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50540cf190 0x7f505415de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505a4ff640 1 -- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50540ae910 msgr2=0x7f505415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505a4ff640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50540ae910 0x7f505415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f505a4ff640 1 -- 172.21.15.79:0/179351645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50540c4f90 con 0x7f505406ea20 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.813+0000 7f5059cfe640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50540ae910 0x7f505415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.814+0000 7f505a4ff640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f505406ea20 0x7f50541481b0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f505000e9b0 tx=0x7f505000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.814+0000 7f504affd640 1 -- 172.21.15.79:0/179351645 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050017070 con 0x7f505406ea20 2024-06-10T00:20:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.814+0000 7f504affd640 1 -- 172.21.15.79:0/179351645 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505000c9a0 con 0x7f505406ea20 2024-06-10T00:20:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.814+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505414a790 con 0x7f505406ea20 2024-06-10T00:20:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.814+0000 7f504affd640 1 -- 172.21.15.79:0/179351645 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505000cd90 con 0x7f505406ea20 2024-06-10T00:20:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.814+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f505414ad50 con 0x7f505406ea20 2024-06-10T00:20:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.815+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5054068430 con 0x7f505406ea20 2024-06-10T00:20:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.815+0000 7f504affd640 1 -- 172.21.15.79:0/179351645 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f505001a070 con 0x7f505406ea20 2024-06-10T00:20:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.816+0000 7f504affd640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f503806be30 0x7f503806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.816+0000 7f504affd640 1 -- 172.21.15.79:0/179351645 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f505008b070 con 0x7f505406ea20 2024-06-10T00:20:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.816+0000 7f5059cfe640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f503806be30 0x7f503806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.816+0000 7f5059cfe640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f503806be30 0x7f503806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5044034000 tx=0x7f504402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:09.820+0000 7f504affd640 1 -- 172.21.15.79:0/179351645 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f50540c4f90 con 0x7f505406ea20 2024-06-10T00:20:10.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.028+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5054159b20 con 0x7f505406ea20 2024-06-10T00:20:10.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.028+0000 7f504affd640 1 -- 172.21.15.79:0/179351645 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7f5050059840 con 0x7f505406ea20 2024-06-10T00:20:10.028 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:20:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f503806be30 msgr2=0x7f503806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f503806be30 0x7f503806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5044034000 tx=0x7f504402e000 comp rx=0 tx=0).stop 2024-06-10T00:20:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f505406ea20 msgr2=0x7f50541481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f505406ea20 0x7f50541481b0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f505000e9b0 tx=0x7f505000ee70 comp rx=0 tx=0).stop 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 shutdown_connections 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f503806be30 0x7f503806e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50540cf190 0x7f505415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50540ae910 0x7f505415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 --2- 172.21.15.79:0/179351645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f505406ea20 0x7f50541481b0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 >> 172.21.15.79:0/179351645 conn(0x7f50540b19f0 msgr2=0x7f5054072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 shutdown_connections 2024-06-10T00:20:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10.030+0000 7f505c763640 1 -- 172.21.15.79:0/179351645 wait complete. 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:20:10.041 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:10.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:10.042 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:20:10.058 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:20:10.059 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42434sec preferred_lft 42434sec 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:20:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:20:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:10.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:10.064 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:20:10.121 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:20:10.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:10.123 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:20:10.179 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:20:10.179 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:20:10.180 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:20:10.180 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:20:10.180 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:20:10.180 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:20:10.180 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:20:10.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:20:10.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:20:10.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:20:10.181 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:20:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:20:10.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:20:10.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:10.305 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:20:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:20:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:20:10.320 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:10.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:10.321 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:20:10.385 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:20:10.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:20:10.385 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:10.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:20:10.441 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:10.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:20:10.561 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:20:10.617 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:20:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:20:10.619 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:10.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:10.620 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:20:10.672 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:20:10.673 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:20:10.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:20:10.739 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:20:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:20:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:20:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:20:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:20:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:20:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:10.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:10.798 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:20:10.799 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:20:10.796+0000 7fc56780c480 -1 init, newargv = 0x556ec5dcc570 newargc=15 2024-06-10T00:20:10.799 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[62448]: starting ceph client 2024-06-10T00:20:10.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[62448]: starting fuse 2024-06-10T00:20:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:20:10.814 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:20:10.814 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:20:10.814 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:20:10.814 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:20:10.814 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:20:10.814 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:20:10.814 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:10.814 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:20:10.815 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:20:10.816 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:20:10.816 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:20:10.816 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:20:10.816 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:20:10.816 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:10.816 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:20:10.816 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:20:10.931 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.62448.asok 2024-06-10T00:20:10.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:20:10.942 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.62448.asok 2024-06-10T00:20:10.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:10.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.62448.asok status 2024-06-10T00:20:11.077 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:20:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:20:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:20:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "62448", 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6744, 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:20:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 6744 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3002072207 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3002072207 2024-06-10T00:20:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.6744 192.168.0.1:0/3002072207", 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/3002072207", 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 44, 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 76, 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:20:11.080 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:11.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:11.087 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:20:11.087 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:11.102 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:20:11.103 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:11.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:11.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:11.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:11.167 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-06-10T00:20:11.224 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:20:11.225 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-06-10T00:20:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.309+0000 7fab089ebf40 1 Processor -- start 2024-06-10T00:20:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.309+0000 7fab089ebf40 1 -- start start 2024-06-10T00:20:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab089ebf40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ef6a45ec00 0x55ef6a5168e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab089ebf40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ef6a48a650 0x55ef6a536bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab089ebf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a51dd70 0x55ef6a537110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab089ebf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef6a538840 con 0x55ef6a51dd70 2024-06-10T00:20:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab089ebf40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ef6a407e30 con 0x55ef6a45ec00 2024-06-10T00:20:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab089ebf40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ef6a538ae0 con 0x55ef6a48a650 2024-06-10T00:20:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a51dd70 0x55ef6a537110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a51dd70 0x55ef6a537110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60968/0 (socket says 172.21.15.79:60968) 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 -- 172.21.15.79:0/1713827465 learned_addr learned my addr 172.21.15.79:0/1713827465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 -- 172.21.15.79:0/1713827465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ef6a48a650 msgr2=0x55ef6a536bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 --2- 172.21.15.79:0/1713827465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ef6a48a650 0x55ef6a536bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 -- 172.21.15.79:0/1713827465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ef6a45ec00 msgr2=0x55ef6a5168e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 --2- 172.21.15.79:0/1713827465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ef6a45ec00 0x55ef6a5168e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 -- 172.21.15.79:0/1713827465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef6a38ccb0 con 0x55ef6a51dd70 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab06ced640 1 --2- 172.21.15.79:0/1713827465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a51dd70 0x55ef6a537110 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fab0000a4b0 tx=0x7fab00050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70eefcacf099ed server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab054ea640 1 -- 172.21.15.79:0/1713827465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00051c20 con 0x55ef6a51dd70 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab054ea640 1 -- 172.21.15.79:0/1713827465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab00051de0 con 0x55ef6a51dd70 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.310+0000 7fab054ea640 1 -- 172.21.15.79:0/1713827465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0005a690 con 0x55ef6a51dd70 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 -- 172.21.15.79:0/1713827465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a51dd70 msgr2=0x55ef6a537110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 --2- 172.21.15.79:0/1713827465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a51dd70 0x55ef6a537110 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fab0000a4b0 tx=0x7fab00050000 comp rx=0 tx=0).stop 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 -- 172.21.15.79:0/1713827465 shutdown_connections 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 --2- 172.21.15.79:0/1713827465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a51dd70 0x55ef6a537110 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 --2- 172.21.15.79:0/1713827465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ef6a48a650 0x55ef6a536bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 --2- 172.21.15.79:0/1713827465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ef6a45ec00 0x55ef6a5168e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 -- 172.21.15.79:0/1713827465 >> 172.21.15.79:0/1713827465 conn(0x55ef6a45fa40 msgr2=0x55ef6a48fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 -- 172.21.15.79:0/1713827465 shutdown_connections 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 -- 172.21.15.79:0/1713827465 wait complete. 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 Processor -- start 2024-06-10T00:20:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.311+0000 7fab089ebf40 1 -- start start 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab089ebf40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a45ec00 0x55ef6a53a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab089ebf40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ef6a48a650 0x55ef6a5d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab089ebf40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ef6a51dd70 0x55ef6a5d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab089ebf40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef6a45ffe0 con 0x55ef6a45ec00 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab089ebf40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ef6a51b3e0 con 0x55ef6a48a650 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab089ebf40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ef6a48bf70 con 0x55ef6a51dd70 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab064ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a45ec00 0x55ef6a53a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab064ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a45ec00 0x55ef6a53a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60976/0 (socket says 172.21.15.79:60976) 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab064ec640 1 -- 172.21.15.79:0/1168106978 learned_addr learned my addr 172.21.15.79:0/1168106978 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab06ced640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ef6a51dd70 0x55ef6a5d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7faafdceb640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ef6a48a650 0x55ef6a5d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.312+0000 7fab064ec640 1 -- 172.21.15.79:0/1168106978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ef6a51dd70 msgr2=0x55ef6a5d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7fab064ec640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ef6a51dd70 0x55ef6a5d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7fab064ec640 1 -- 172.21.15.79:0/1168106978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ef6a48a650 msgr2=0x55ef6a5d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7fab064ec640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ef6a48a650 0x55ef6a5d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7fab064ec640 1 -- 172.21.15.79:0/1168106978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef6a5308f0 con 0x55ef6a45ec00 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7fab064ec640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a45ec00 0x55ef6a53a3d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7faaf8008490 tx=0x7faaf8008950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7faafffff640 1 -- 172.21.15.79:0/1168106978 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8016070 con 0x55ef6a45ec00 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7faafffff640 1 -- 172.21.15.79:0/1168106978 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf80067c0 con 0x55ef6a45ec00 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef6a530f00 con 0x55ef6a45ec00 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7faafffff640 1 -- 172.21.15.79:0/1168106978 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8006bb0 con 0x55ef6a45ec00 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.313+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef6a530b60 con 0x55ef6a45ec00 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.314+0000 7faafffff640 1 -- 172.21.15.79:0/1168106978 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaf8019070 con 0x55ef6a45ec00 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.315+0000 7faafffff640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faae806a840 0x7faae806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.315+0000 7faafdceb640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faae806a840 0x7faae806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.315+0000 7faafffff640 1 -- 172.21.15.79:0/1168106978 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7faaf8089670 con 0x55ef6a45ec00 2024-06-10T00:20:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.315+0000 7fab089ebf40 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ef6a53a910 0x55ef6a5337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.315+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76) -- 0x55ef6a4a7f70 con 0x55ef6a53a910 2024-06-10T00:20:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.315+0000 7fab06ced640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ef6a53a910 0x55ef6a5337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.315+0000 7faafdceb640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faae806a840 0x7faae806cd00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55ef6a53b3a0 tx=0x7faaf0006490 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.315+0000 7fab06ced640 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ef6a53a910 0x55ef6a5337c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab06ced640 1 -- 172.21.15.79:0/1168106978 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v76'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab00051b40 con 0x55ef6a53a910 2024-06-10T00:20:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ef6a53a910 msgr2=0x55ef6a5337c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ef6a53a910 0x55ef6a5337c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faae806a840 msgr2=0x7faae806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faae806a840 0x7faae806cd00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55ef6a53b3a0 tx=0x7faaf0006490 comp rx=0 tx=0).stop 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a45ec00 msgr2=0x55ef6a53a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 --2- 172.21.15.79:0/1168106978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef6a45ec00 0x55ef6a53a3d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7faaf8008490 tx=0x7faaf8008950 comp rx=0 tx=0).stop 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab06ced640 1 -- 172.21.15.79:0/1168106978 reap_dead start 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 shutdown_connections 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 >> 172.21.15.79:0/1168106978 conn(0x55ef6a45fa40 msgr2=0x55ef6a536bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 shutdown_connections 2024-06-10T00:20:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.317+0000 7fab089ebf40 1 -- 172.21.15.79:0/1168106978 wait complete. 2024-06-10T00:20:11.320 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:20:11.321 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:20:11.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:20:11.413 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:20:11.413 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:20:11.413 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:20:11.413 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:11.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:20:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.568+0000 7f255499e640 1 Processor -- start 2024-06-10T00:20:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.568+0000 7f255499e640 1 -- start start 2024-06-10T00:20:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.568+0000 7f255499e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500ae910 0x7f255006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f255499e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f255006ea20 0x7f25500cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f255499e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25500cf620 con 0x7f25500cf190 2024-06-10T00:20:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f255499e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f255006ee60 con 0x7f255006ea20 2024-06-10T00:20:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f255499e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f255006d130 con 0x7f25500ae910 2024-06-10T00:20:11.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f254e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500ae910 0x7f255006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f2545d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f255006ea20 0x7f25500cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f254ed9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f25500cf190 0x7f255015ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:36700/0 (socket says 172.21.15.79:36700) 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f254ed9d640 1 -- 172.21.15.79:0/4072272014 learned_addr learned my addr 172.21.15.79:0/4072272014 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f254e59c640 1 -- 172.21.15.79:0/4072272014 >> v2:172.21.15.117:3300/0 conn(0x7f255006ea20 msgr2=0x7f25500cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f254e59c640 1 --2- 172.21.15.79:0/4072272014 >> v2:172.21.15.117:3300/0 conn(0x7f255006ea20 0x7f25500cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f254e59c640 1 -- 172.21.15.79:0/4072272014 >> v1:172.21.15.117:6789/0 conn(0x7f25500cf190 legacy=0x7f255015ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f254dd9b640 1 -- 172.21.15.79:0/4072272014 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1120383279 0 0) 0x7f25500cf620 con 0x7f25500cf190 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f254e59c640 1 -- 172.21.15.79:0/4072272014 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255006d410 con 0x7f25500ae910 2024-06-10T00:20:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.569+0000 7f2545d9b640 1 --2- 172.21.15.79:0/4072272014 >> v2:172.21.15.117:3300/0 conn(0x7f255006ea20 0x7f25500cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:20:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.570+0000 7f254e59c640 1 --2- 172.21.15.79:0/4072272014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500ae910 0x7f255006e4e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25400097d0 tx=0x7f254002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7882fe41de23cf1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.570+0000 7f254dd9b640 1 -- 172.21.15.79:0/4072272014 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540037070 con 0x7f25500ae910 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.570+0000 7f254dd9b640 1 -- 172.21.15.79:0/4072272014 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254002ae40 con 0x7f25500ae910 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.570+0000 7f254dd9b640 1 -- 172.21.15.79:0/4072272014 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540032660 con 0x7f25500ae910 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.571+0000 7f255499e640 1 -- 172.21.15.79:0/4072272014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500ae910 msgr2=0x7f255006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.571+0000 7f255499e640 1 --2- 172.21.15.79:0/4072272014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500ae910 0x7f255006e4e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25400097d0 tx=0x7f254002a130 comp rx=0 tx=0).stop 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.571+0000 7f255499e640 1 -- 172.21.15.79:0/4072272014 shutdown_connections 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.571+0000 7f255499e640 1 --2- 172.21.15.79:0/4072272014 >> v2:172.21.15.117:3300/0 conn(0x7f255006ea20 0x7f25500cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.571+0000 7f255499e640 1 --2- 172.21.15.79:0/4072272014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500ae910 0x7f255006e4e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.571+0000 7f255499e640 1 -- 172.21.15.79:0/4072272014 >> 172.21.15.79:0/4072272014 conn(0x7f25500b19f0 msgr2=0x7f25500b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.571+0000 7f255499e640 1 -- 172.21.15.79:0/4072272014 shutdown_connections 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.571+0000 7f255499e640 1 -- 172.21.15.79:0/4072272014 wait complete. 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.572+0000 7f255499e640 1 Processor -- start 2024-06-10T00:20:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.572+0000 7f255499e640 1 -- start start 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f255499e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f255006ea20 0x7f25501f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f255499e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25500ae910 0x7f25501510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f255499e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500cf190 0x7f25501f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f255499e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25500aecf0 con 0x7f25500ae910 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f255499e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f255006d9d0 con 0x7f255006ea20 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f255499e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25500add50 con 0x7f25500cf190 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f2545d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25500ae910 0x7f25501510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f2545d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25500ae910 0x7f25501510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60990/0 (socket says 172.21.15.79:60990) 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f2545d9b640 1 -- 172.21.15.79:0/390553356 learned_addr learned my addr 172.21.15.79:0/390553356 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f254e59c640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f255006ea20 0x7f25501f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f254ed9d640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500cf190 0x7f25501f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f2545d9b640 1 -- 172.21.15.79:0/390553356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500cf190 msgr2=0x7f25501f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f2545d9b640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500cf190 0x7f25501f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.573+0000 7f2545d9b640 1 -- 172.21.15.79:0/390553356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f255006ea20 msgr2=0x7f25501f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.574+0000 7f2545d9b640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f255006ea20 0x7f25501f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.574+0000 7f2545d9b640 1 -- 172.21.15.79:0/390553356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25501f6120 con 0x7f25500ae910 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.574+0000 7f2545d9b640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25500ae910 0x7f25501510f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f253800e960 tx=0x7f253800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.574+0000 7f25477fe640 1 -- 172.21.15.79:0/390553356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538017070 con 0x7f25500ae910 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.574+0000 7f25477fe640 1 -- 172.21.15.79:0/390553356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253800ca00 con 0x7f25500ae910 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.574+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25501f2630 con 0x7f25500ae910 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.574+0000 7f25477fe640 1 -- 172.21.15.79:0/390553356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253800cdd0 con 0x7f25500ae910 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.574+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25501f53e0 con 0x7f25500ae910 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.575+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2550068430 con 0x7f25500ae910 2024-06-10T00:20:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.575+0000 7f25477fe640 1 -- 172.21.15.79:0/390553356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f253801a070 con 0x7f25500ae910 2024-06-10T00:20:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.576+0000 7f25477fe640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f253006be30 0x7f253006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.576+0000 7f25477fe640 1 -- 172.21.15.79:0/390553356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f253808af20 con 0x7f25500ae910 2024-06-10T00:20:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.576+0000 7f254e59c640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f253006be30 0x7f253006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.576+0000 7f254e59c640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f253006be30 0x7f253006e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2540034000 tx=0x7f254002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:11.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.580+0000 7f25477fe640 1 -- 172.21.15.79:0/390553356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f25501f6120 con 0x7f25500ae910 2024-06-10T00:20:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.764+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f25500749b0 con 0x7f25500ae910 2024-06-10T00:20:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.765+0000 7f25477fe640 1 -- 172.21.15.79:0/390553356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v76) ==== 80+0+122 (secure 0 0 0) 0x7f25380596f0 con 0x7f25500ae910 2024-06-10T00:20:11.765 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6835/1640828017 2024-06-11T00:18:53.210236+0000 2024-06-10T00:20:11.765 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6834/1640828017 2024-06-11T00:18:53.210236+0000 2024-06-10T00:20:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f253006be30 msgr2=0x7f253006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f253006be30 0x7f253006e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2540034000 tx=0x7f254002e000 comp rx=0 tx=0).stop 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25500ae910 msgr2=0x7f25501510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25500ae910 0x7f25501510f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f253800e960 tx=0x7f253800ee20 comp rx=0 tx=0).stop 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 shutdown_connections 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f253006be30 0x7f253006e2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25500cf190 0x7f25501f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25500ae910 0x7f25501510f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 --2- 172.21.15.79:0/390553356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f255006ea20 0x7f25501f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 >> 172.21.15.79:0/390553356 conn(0x7f25500b19f0 msgr2=0x7f25500acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 shutdown_connections 2024-06-10T00:20:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:11.767+0000 7f255499e640 1 -- 172.21.15.79:0/390553356 wait complete. 2024-06-10T00:20:11.777 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:20:11.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:11.777 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:11.800 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[62448]: fuse finished with error 0 and tester_r 0 2024-06-10T00:20:11.802 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:20:11.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:11.802 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:20:11.968 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:20:11.968 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:20:11.968 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:11.988 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:20:11.988 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:20:11.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:11.988 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-10T00:20:12.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:20:12.048 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-10T00:20:12.048 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:20:12.048 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:20:12.048 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:12.064 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:20:12.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:20:12.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:12.064 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-10T00:20:12.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:20:12.119 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-10T00:20:12.120 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:20:12.120 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:20:12.120 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:12.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:20:12.138 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:20:12.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:12.138 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-10T00:20:12.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:20:12.194 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-10T00:20:12.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:12.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.294+0000 7fb2640b3640 1 Processor -- start 2024-06-10T00:20:12.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.295+0000 7fb2640b3640 1 -- start start 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb2640b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb25c1553c0 0x7fb25c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb2640b3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25c0b31a0 con 0x7fb25c0cec50 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb2640b3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25c0b3420 con 0x7fb25c0b2cf0 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb2640b3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb25c0cc750 con 0x7fb25c1553c0 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb261e4f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb25c1553c0 0x7fb25c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb262650640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb25c0cec50 0x7fb25c071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51676/0 (socket says 172.21.15.79:51676) 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb262650640 1 -- 172.21.15.79:0/275590388 learned_addr learned my addr 172.21.15.79:0/275590388 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb261e4f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb25c1553c0 0x7fb25c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32770/0 (socket says 172.21.15.79:32770) 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb261e4f640 1 -- 172.21.15.79:0/275590388 >> v1:172.21.15.117:6789/0 conn(0x7fb25c0b2cf0 legacy=0x7fb25c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb261e4f640 1 -- 172.21.15.79:0/275590388 >> v1:172.21.15.79:6789/0 conn(0x7fb25c0cec50 legacy=0x7fb25c071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb260e4d640 1 -- 172.21.15.79:0/275590388 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909888153 0 0) 0x7fb24c001490 con 0x7fb25c0cec50 2024-06-10T00:20:12.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.296+0000 7fb261e4f640 1 -- 172.21.15.79:0/275590388 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c0cca30 con 0x7fb25c1553c0 2024-06-10T00:20:12.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb261e4f640 1 --2- 172.21.15.79:0/275590388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c1553c0 0x7fb25c0cd230 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb2540097d0 tx=0x7fb25402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44730196a3367ec server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb260e4d640 1 -- 172.21.15.79:0/275590388 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254037070 con 0x7fb25c1553c0 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb260e4d640 1 -- 172.21.15.79:0/275590388 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb254032440 con 0x7fb25c1553c0 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb260e4d640 1 -- 172.21.15.79:0/275590388 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254032810 con 0x7fb25c1553c0 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb2640b3640 1 -- 172.21.15.79:0/275590388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c1553c0 msgr2=0x7fb25c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb2640b3640 1 --2- 172.21.15.79:0/275590388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c1553c0 0x7fb25c0cd230 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb2540097d0 tx=0x7fb25402a210 comp rx=0 tx=0).stop 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb2640b3640 1 -- 172.21.15.79:0/275590388 shutdown_connections 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb2640b3640 1 --2- 172.21.15.79:0/275590388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c1553c0 0x7fb25c0cd230 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb2640b3640 1 -- 172.21.15.79:0/275590388 >> 172.21.15.79:0/275590388 conn(0x7fb25c0b19f0 msgr2=0x7fb25c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.297+0000 7fb2640b3640 1 -- 172.21.15.79:0/275590388 shutdown_connections 2024-06-10T00:20:12.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.298+0000 7fb2640b3640 1 -- 172.21.15.79:0/275590388 wait complete. 2024-06-10T00:20:12.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb2640b3640 1 Processor -- start 2024-06-10T00:20:12.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb2640b3640 1 -- start start 2024-06-10T00:20:12.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb2640b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb25c0b2cf0 0x7fb25c15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb2640b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c0cec50 0x7fb25c145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb2640b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb25c1553c0 0x7fb25c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb2640b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c1557a0 con 0x7fb25c0cec50 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb2640b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0b3700 con 0x7fb25c0b2cf0 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb2640b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb25c155920 con 0x7fb25c1553c0 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb26164e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c0cec50 0x7fb25c145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb26164e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c0cec50 0x7fb25c145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32780/0 (socket says 172.21.15.79:32780) 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.299+0000 7fb26164e640 1 -- 172.21.15.79:0/253717294 learned_addr learned my addr 172.21.15.79:0/253717294 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb261e4f640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb25c0b2cf0 0x7fb25c15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb26164e640 1 -- 172.21.15.79:0/253717294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb25c1553c0 msgr2=0x7fb25c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb26164e640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb25c1553c0 0x7fb25c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb26164e640 1 -- 172.21.15.79:0/253717294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb25c0b2cf0 msgr2=0x7fb25c15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb26164e640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb25c0b2cf0 0x7fb25c15dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb26164e640 1 -- 172.21.15.79:0/253717294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c151da0 con 0x7fb25c0cec50 2024-06-10T00:20:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb26164e640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c0cec50 0x7fb25c145640 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb25000b3e0 tx=0x7fb25000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb25a7fc640 1 -- 172.21.15.79:0/253717294 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250015020 con 0x7fb25c0cec50 2024-06-10T00:20:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb25a7fc640 1 -- 172.21.15.79:0/253717294 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb250011850 con 0x7fb25c0cec50 2024-06-10T00:20:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb25a7fc640 1 -- 172.21.15.79:0/253717294 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250011c40 con 0x7fb25c0cec50 2024-06-10T00:20:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c15ca20 con 0x7fb25c0cec50 2024-06-10T00:20:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.300+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c15cfe0 con 0x7fb25c0cec50 2024-06-10T00:20:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.301+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c068430 con 0x7fb25c0cec50 2024-06-10T00:20:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.302+0000 7fb25a7fc640 1 -- 172.21.15.79:0/253717294 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb250018020 con 0x7fb25c0cec50 2024-06-10T00:20:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.302+0000 7fb25a7fc640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb24806be60 0x7fb24806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.302+0000 7fb25a7fc640 1 -- 172.21.15.79:0/253717294 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fb25008aef0 con 0x7fb25c0cec50 2024-06-10T00:20:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.302+0000 7fb261e4f640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb24806be60 0x7fb24806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.303+0000 7fb261e4f640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb24806be60 0x7fb24806e320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb254034000 tx=0x7fb25402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.306+0000 7fb25a7fc640 1 -- 172.21.15.79:0/253717294 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb25001f020 con 0x7fb25c0cec50 2024-06-10T00:20:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.514+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb25c0cf820 con 0x7fb25c0cec50 2024-06-10T00:20:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.515+0000 7fb25a7fc640 1 -- 172.21.15.79:0/253717294 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5185 (secure 0 0 0) 0x7fb2500172c0 con 0x7fb25c0cec50 2024-06-10T00:20:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:12.515 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:19:43.820079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6471,"qdb_cluster":[6471]},"id":5}]} 2024-06-10T00:20:12.515 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 44 2024-06-10T00:20:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb24806be60 msgr2=0x7fb24806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb24806be60 0x7fb24806e320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb254034000 tx=0x7fb25402e000 comp rx=0 tx=0).stop 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c0cec50 msgr2=0x7fb25c145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c0cec50 0x7fb25c145640 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb25000b3e0 tx=0x7fb25000b8a0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 shutdown_connections 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb24806be60 0x7fb24806e320 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb25c1553c0 0x7fb25c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb25c0cec50 0x7fb25c145640 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 --2- 172.21.15.79:0/253717294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb25c0b2cf0 0x7fb25c15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 >> 172.21.15.79:0/253717294 conn(0x7fb25c0b19f0 msgr2=0x7fb25c06e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 shutdown_connections 2024-06-10T00:20:12.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.517+0000 7fb2640b3640 1 -- 172.21.15.79:0/253717294 wait complete. 2024-06-10T00:20:12.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:12.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.626+0000 7fd390cd4640 1 Processor -- start 2024-06-10T00:20:12.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.626+0000 7fd390cd4640 1 -- start start 2024-06-10T00:20:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd390cd4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd38c0ae910 0x7fd38c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd390cd4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 0x7fd38c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd390cd4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38c0cf620 con 0x7fd38c0cf190 2024-06-10T00:20:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd390cd4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd38c06ee60 con 0x7fd38c0ae910 2024-06-10T00:20:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd390cd4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c06d130 con 0x7fd38c06ea20 2024-06-10T00:20:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd38a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd38c0ae910 0x7fd38c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd38ad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd38c0cf190 0x7fd38c15ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51684/0 (socket says 172.21.15.79:51684) 2024-06-10T00:20:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd38ad9d640 1 -- 172.21.15.79:0/3869452311 learned_addr learned my addr 172.21.15.79:0/3869452311 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.627+0000 7fd38a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd38c0ae910 0x7fd38c06e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32788/0 (socket says 172.21.15.79:32788) 2024-06-10T00:20:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd389d9b640 1 --2- 172.21.15.79:0/3869452311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 0x7fd38c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38a59c640 1 -- 172.21.15.79:0/3869452311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 msgr2=0x7fd38c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38a59c640 1 --2- 172.21.15.79:0/3869452311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 0x7fd38c0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38a59c640 1 -- 172.21.15.79:0/3869452311 >> v1:172.21.15.79:6789/0 conn(0x7fd38c0cf190 legacy=0x7fd38c15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38959a640 1 -- 172.21.15.79:0/3869452311 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092618826 0 0) 0x7fd38c0cf620 con 0x7fd38c0cf190 2024-06-10T00:20:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38a59c640 1 -- 172.21.15.79:0/3869452311 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c06d410 con 0x7fd38c0ae910 2024-06-10T00:20:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38a59c640 1 --2- 172.21.15.79:0/3869452311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0ae910 0x7fd38c06e4e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0097d0 tx=0x7fd37c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01e55bbeea6be30 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38959a640 1 -- 172.21.15.79:0/3869452311 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c037070 con 0x7fd38c0ae910 2024-06-10T00:20:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38959a640 1 -- 172.21.15.79:0/3869452311 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c02ae40 con 0x7fd38c0ae910 2024-06-10T00:20:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.628+0000 7fd38959a640 1 -- 172.21.15.79:0/3869452311 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c032660 con 0x7fd38c0ae910 2024-06-10T00:20:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.629+0000 7fd390cd4640 1 -- 172.21.15.79:0/3869452311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0ae910 msgr2=0x7fd38c06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.629+0000 7fd390cd4640 1 --2- 172.21.15.79:0/3869452311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0ae910 0x7fd38c06e4e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0097d0 tx=0x7fd37c02a130 comp rx=0 tx=0).stop 2024-06-10T00:20:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.629+0000 7fd390cd4640 1 -- 172.21.15.79:0/3869452311 shutdown_connections 2024-06-10T00:20:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.629+0000 7fd390cd4640 1 --2- 172.21.15.79:0/3869452311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 0x7fd38c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.629+0000 7fd390cd4640 1 --2- 172.21.15.79:0/3869452311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0ae910 0x7fd38c06e4e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.629+0000 7fd390cd4640 1 -- 172.21.15.79:0/3869452311 >> 172.21.15.79:0/3869452311 conn(0x7fd38c0b19f0 msgr2=0x7fd38c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.629+0000 7fd390cd4640 1 -- 172.21.15.79:0/3869452311 shutdown_connections 2024-06-10T00:20:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.629+0000 7fd390cd4640 1 -- 172.21.15.79:0/3869452311 wait complete. 2024-06-10T00:20:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.630+0000 7fd390cd4640 1 Processor -- start 2024-06-10T00:20:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.630+0000 7fd390cd4640 1 -- start start 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd390cd4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 0x7fd38c09db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd390cd4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd38c0ae910 0x7fd38c156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd390cd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0cf190 0x7fd38c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd390cd4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c0aecf0 con 0x7fd38c0cf190 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd390cd4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c06d9d0 con 0x7fd38c0ae910 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd390cd4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c0add50 con 0x7fd38c06ea20 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd38ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0cf190 0x7fd38c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd38ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0cf190 0x7fd38c150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32798/0 (socket says 172.21.15.79:32798) 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd38ad9d640 1 -- 172.21.15.79:0/1798283654 learned_addr learned my addr 172.21.15.79:0/1798283654 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd38a59c640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 0x7fd38c09db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd389d9b640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd38c0ae910 0x7fd38c156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd38ad9d640 1 -- 172.21.15.79:0/1798283654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 msgr2=0x7fd38c09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd38ad9d640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 0x7fd38c09db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd38ad9d640 1 -- 172.21.15.79:0/1798283654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd38c0ae910 msgr2=0x7fd38c156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.631+0000 7fd38ad9d640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd38c0ae910 0x7fd38c156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.632+0000 7fd38ad9d640 1 -- 172.21.15.79:0/1798283654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c152c20 con 0x7fd38c0cf190 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.632+0000 7fd38ad9d640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0cf190 0x7fd38c150d90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd38400c7d0 tx=0x7fd38400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.632+0000 7fd37affd640 1 -- 172.21.15.79:0/1798283654 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384018070 con 0x7fd38c0cf190 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.632+0000 7fd37affd640 1 -- 172.21.15.79:0/1798283654 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38400a640 con 0x7fd38c0cf190 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.632+0000 7fd37affd640 1 -- 172.21.15.79:0/1798283654 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38400aa70 con 0x7fd38c0cf190 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.632+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38c155a10 con 0x7fd38c0cf190 2024-06-10T00:20:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.632+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38c1556c0 con 0x7fd38c0cf190 2024-06-10T00:20:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.633+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38c068430 con 0x7fd38c0cf190 2024-06-10T00:20:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.633+0000 7fd37affd640 1 -- 172.21.15.79:0/1798283654 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd38401b070 con 0x7fd38c0cf190 2024-06-10T00:20:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.634+0000 7fd37affd640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd36c06be30 0x7fd36c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.634+0000 7fd37affd640 1 -- 172.21.15.79:0/1798283654 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fd38408a5e0 con 0x7fd38c0cf190 2024-06-10T00:20:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.634+0000 7fd38a59c640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd36c06be30 0x7fd36c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.634+0000 7fd38a59c640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd36c06be30 0x7fd36c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd37c034000 tx=0x7fd37c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.638+0000 7fd37affd640 1 -- 172.21.15.79:0/1798283654 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd384058760 con 0x7fd38c0cf190 2024-06-10T00:20:12.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.844+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd38c0b2100 con 0x7fd38c0cf190 2024-06-10T00:20:12.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.845+0000 7fd37affd640 1 -- 172.21.15.79:0/1798283654 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5185 (secure 0 0 0) 0x7fd38405ca60 con 0x7fd38c0cf190 2024-06-10T00:20:12.845 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:12.845 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:19:43.820079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6471,"qdb_cluster":[6471]},"id":5}]} 2024-06-10T00:20:12.845 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 44 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd36c06be30 msgr2=0x7fd36c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd36c06be30 0x7fd36c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd37c034000 tx=0x7fd37c02e000 comp rx=0 tx=0).stop 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0cf190 msgr2=0x7fd38c150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0cf190 0x7fd38c150d90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd38400c7d0 tx=0x7fd38400cc90 comp rx=0 tx=0).stop 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 shutdown_connections 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd36c06be30 0x7fd36c06e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38c0cf190 0x7fd38c150d90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd38c0ae910 0x7fd38c156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 --2- 172.21.15.79:0/1798283654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38c06ea20 0x7fd38c09db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 >> 172.21.15.79:0/1798283654 conn(0x7fd38c0b19f0 msgr2=0x7fd38c0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 shutdown_connections 2024-06-10T00:20:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.847+0000 7fd390cd4640 1 -- 172.21.15.79:0/1798283654 wait complete. 2024-06-10T00:20:12.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:20:12.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.957+0000 7efdc325d640 1 Processor -- start 2024-06-10T00:20:12.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.957+0000 7efdc325d640 1 -- start start 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.958+0000 7efdc325d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc0cd230 0x7efdbc0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.958+0000 7efdc325d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc0b3420 con 0x7efdbc1553c0 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.958+0000 7efdc325d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc0cc750 con 0x7efdbc0cec50 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.958+0000 7efdc325d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efdbc0cca30 con 0x7efdbc0cd230 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.958+0000 7efdc0ff9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efdbc1553c0 0x7efdbc15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51686/0 (socket says 172.21.15.79:51686) 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.958+0000 7efdc0ff9640 1 -- 172.21.15.79:0/218427628 learned_addr learned my addr 172.21.15.79:0/218427628 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbbfff640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc0cd230 0x7efdbc0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3142755035 0 0) 0x7efdbc0b3420 con 0x7efdbc1553c0 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda4003520 con 0x7efdbc1553c0 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 515710509 0 0) 0x7efda4003520 con 0x7efdbc1553c0 2024-06-10T00:20:12.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc0cd230 msgr2=0x7efdbc0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc0cd230 0x7efdbc0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 >> v1:172.21.15.117:6789/0 conn(0x7efdbc0cec50 legacy=0x7efdbc071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc0ccd10 con 0x7efdbc1553c0 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7efdac001670 con 0x7efdbc1553c0 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 >> v1:172.21.15.79:6789/0 conn(0x7efdbc1553c0 legacy=0x7efdbc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda40039e0 0x7efda4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc0cd230 0x7efda4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efda4004d40 0x7efda40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc0cca30 con 0x7efda4004d40 2024-06-10T00:20:12.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efda400ba70 con 0x7efda40039e0 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efda400de80 con 0x7efdbc0cd230 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdc17fa640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efda4004d40 0x7efda40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdc0ff9640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda40039e0 0x7efda4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdbbfff640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc0cd230 0x7efda4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdc17fa640 1 -- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc0cd230 msgr2=0x7efda4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdc17fa640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc0cd230 0x7efda4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdc17fa640 1 -- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda40039e0 msgr2=0x7efda4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdc17fa640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda40039e0 0x7efda4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.959+0000 7efdc17fa640 1 -- 172.21.15.79:0/218427628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda4003520 con 0x7efda4004d40 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.960+0000 7efdc17fa640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efda4004d40 0x7efda40051c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efdb4001e20 tx=0x7efda4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b26a44abf3f5330 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.960+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4001a70 con 0x7efda4004d40 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.960+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb402ae40 con 0x7efda4004d40 2024-06-10T00:20:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.960+0000 7efdbb7fe640 1 -- 172.21.15.79:0/218427628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4003bb0 con 0x7efda4004d40 2024-06-10T00:20:12.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.961+0000 7efdc325d640 1 -- 172.21.15.79:0/218427628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efda4004d40 msgr2=0x7efda40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.961+0000 7efdc325d640 1 --2- 172.21.15.79:0/218427628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efda4004d40 0x7efda40051c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efdb4001e20 tx=0x7efda4005830 comp rx=0 tx=0).stop 2024-06-10T00:20:12.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.961+0000 7efdc17fa640 1 -- 172.21.15.79:0/218427628 reap_dead start 2024-06-10T00:20:12.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.961+0000 7efdc325d640 1 -- 172.21.15.79:0/218427628 shutdown_connections 2024-06-10T00:20:12.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.961+0000 7efdc325d640 1 -- 172.21.15.79:0/218427628 >> 172.21.15.79:0/218427628 conn(0x7efdbc0b19f0 msgr2=0x7efdbc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:12.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.961+0000 7efdc325d640 1 -- 172.21.15.79:0/218427628 shutdown_connections 2024-06-10T00:20:12.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.961+0000 7efdc325d640 1 -- 172.21.15.79:0/218427628 wait complete. 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.962+0000 7efdc325d640 1 Processor -- start 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.962+0000 7efdc325d640 1 -- start start 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdc325d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda4004d40 0x7efdbc09bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdc325d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdbc09aa10 0x7efdbc0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdc325d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc149550 0x7efdbc0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdc325d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc155920 con 0x7efdbc09aa10 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdc325d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc1557a0 con 0x7efda4004d40 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdc325d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efdbc0b2cf0 con 0x7efdbc149550 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdbc09aa10 0x7efdbc0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdbc09aa10 0x7efdbc0b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32818/0 (socket says 172.21.15.79:32818) 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 -- 172.21.15.79:0/4218561759 learned_addr learned my addr 172.21.15.79:0/4218561759 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdc0ff9640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda4004d40 0x7efdbc09bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 -- 172.21.15.79:0/4218561759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc149550 msgr2=0x7efdbc0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc149550 0x7efdbc0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 -- 172.21.15.79:0/4218561759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda4004d40 msgr2=0x7efdbc09bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda4004d40 0x7efdbc09bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 -- 172.21.15.79:0/4218561759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc09aea0 con 0x7efdbc09aa10 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdbbfff640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdbc09aa10 0x7efdbc0b0d40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efdb0011950 tx=0x7efdb0011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdb97fa640 1 -- 172.21.15.79:0/4218561759 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb000faf0 con 0x7efdbc09aa10 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdb97fa640 1 -- 172.21.15.79:0/4218561759 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb000fc90 con 0x7efdbc09aa10 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc09b180 con 0x7efdbc09aa10 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.963+0000 7efdb97fa640 1 -- 172.21.15.79:0/4218561759 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0014440 con 0x7efdbc09aa10 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.964+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdbc09b740 con 0x7efdbc09aa10 2024-06-10T00:20:12.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.964+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdbc06c700 con 0x7efdbc09aa10 2024-06-10T00:20:12.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.965+0000 7efdb97fa640 1 -- 172.21.15.79:0/4218561759 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdb0012040 con 0x7efdbc09aa10 2024-06-10T00:20:12.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.965+0000 7efdb97fa640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:12.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.965+0000 7efdb97fa640 1 -- 172.21.15.79:0/4218561759 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7efdb008b690 con 0x7efdbc09aa10 2024-06-10T00:20:12.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.965+0000 7efdc0ff9640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:12.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.966+0000 7efdc0ff9640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efda806be30 0x7efda806e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efdac007c70 tx=0x7efdac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:12.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:12.970+0000 7efdb97fa640 1 -- 172.21.15.79:0/4218561759 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efdbc06c700 con 0x7efdbc09aa10 2024-06-10T00:20:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.150+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdbc068430 con 0x7efdbc09aa10 2024-06-10T00:20:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.151+0000 7efdb97fa640 1 -- 172.21.15.79:0/4218561759 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17026 (secure 0 0 0) 0x7efdb0019030 con 0x7efdbc09aa10 2024-06-10T00:20:13.151 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:13.151 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":76,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:18:53.210257+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:18:43.020724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-06-10T00:18:43.357910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6835/1640828017":"2024-06-11T00:18:53.210236+0000","172.21.15.79:6834/1640828017":"2024-06-11T00:18:53.210236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:20:13.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.153+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efda806be30 msgr2=0x7efda806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.153+0000 7efdc325d640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efda806be30 0x7efda806e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efdac007c70 tx=0x7efdac009040 comp rx=0 tx=0).stop 2024-06-10T00:20:13.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.153+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdbc09aa10 msgr2=0x7efdbc0b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.153+0000 7efdc325d640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdbc09aa10 0x7efdbc0b0d40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efdb0011950 tx=0x7efdb0011e10 comp rx=0 tx=0).stop 2024-06-10T00:20:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.154+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 shutdown_connections 2024-06-10T00:20:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.154+0000 7efdc325d640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.154+0000 7efdc325d640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc149550 0x7efdbc0adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.154+0000 7efdc325d640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdbc09aa10 0x7efdbc0b0d40 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.154+0000 7efdc325d640 1 --2- 172.21.15.79:0/4218561759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda4004d40 0x7efdbc09bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.154+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 >> 172.21.15.79:0/4218561759 conn(0x7efdbc0b19f0 msgr2=0x7efdbc0747a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.154+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 shutdown_connections 2024-06-10T00:20:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.154+0000 7efdc325d640 1 -- 172.21.15.79:0/4218561759 wait complete. 2024-06-10T00:20:13.164 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:20:13.165 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:13.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.264+0000 7f2e73c88640 1 Processor -- start 2024-06-10T00:20:13.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.264+0000 7f2e73c88640 1 -- start start 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e73c88640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e6c15c7f0 0x7f2e6c0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e73c88640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e6c0b4530 0x7f2e6c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e73c88640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6c0725f0 con 0x7f2e6c156830 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e73c88640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6c0b3090 con 0x7f2e6c15c7f0 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e73c88640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6c0728d0 con 0x7f2e6c0b4530 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e71223640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e6c15c7f0 0x7f2e6c0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e71a24640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2e6c156830 0x7f2e6c071bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51692/0 (socket says 172.21.15.79:51692) 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e71a24640 1 -- 172.21.15.79:0/2910289721 learned_addr learned my addr 172.21.15.79:0/2910289721 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:13.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e71223640 1 -- 172.21.15.79:0/2910289721 >> v2:172.21.15.117:3300/0 conn(0x7f2e6c0b4530 msgr2=0x7f2e6c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:13.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e72225640 1 --2- 172.21.15.79:0/2910289721 >> v2:172.21.15.117:3300/0 conn(0x7f2e6c0b4530 0x7f2e6c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e71223640 1 --2- 172.21.15.79:0/2910289721 >> v2:172.21.15.117:3300/0 conn(0x7f2e6c0b4530 0x7f2e6c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e71223640 1 -- 172.21.15.79:0/2910289721 >> v1:172.21.15.79:6789/0 conn(0x7f2e6c156830 legacy=0x7f2e6c071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e71223640 1 -- 172.21.15.79:0/2910289721 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c072bb0 con 0x7f2e6c15c7f0 2024-06-10T00:20:13.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e70a22640 1 -- 172.21.15.79:0/2910289721 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003967795 0 0) 0x7f2e6c0725f0 con 0x7f2e6c156830 2024-06-10T00:20:13.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.265+0000 7f2e72225640 1 --2- 172.21.15.79:0/2910289721 >> v2:172.21.15.117:3300/0 conn(0x7f2e6c0b4530 0x7f2e6c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:13.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e71223640 1 --2- 172.21.15.79:0/2910289721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c15c7f0 0x7f2e6c0cc670 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0aef60 tx=0x7f2e6802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5e3963549e46e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e70a22640 1 -- 172.21.15.79:0/2910289721 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68037070 con 0x7f2e6c15c7f0 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e70a22640 1 -- 172.21.15.79:0/2910289721 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e68032440 con 0x7f2e6c15c7f0 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e70a22640 1 -- 172.21.15.79:0/2910289721 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68032810 con 0x7f2e6c15c7f0 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e73c88640 1 -- 172.21.15.79:0/2910289721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c15c7f0 msgr2=0x7f2e6c0cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2910289721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c15c7f0 0x7f2e6c0cc670 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0aef60 tx=0x7f2e6802a1a0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e73c88640 1 -- 172.21.15.79:0/2910289721 shutdown_connections 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2910289721 >> v2:172.21.15.117:3300/0 conn(0x7f2e6c0b4530 0x7f2e6c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2910289721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c15c7f0 0x7f2e6c0cc670 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.266+0000 7f2e73c88640 1 -- 172.21.15.79:0/2910289721 >> 172.21.15.79:0/2910289721 conn(0x7f2e6c0b19f0 msgr2=0x7f2e6c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.267+0000 7f2e73c88640 1 -- 172.21.15.79:0/2910289721 shutdown_connections 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.267+0000 7f2e73c88640 1 -- 172.21.15.79:0/2910289721 wait complete. 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e73c88640 1 Processor -- start 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e73c88640 1 -- start start 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e73c88640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e6c0b4530 0x7f2e6c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e73c88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c156830 0x7f2e6c09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e73c88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e6c15c7f0 0x7f2e6c143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e73c88640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c165cc0 con 0x7f2e6c156830 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e73c88640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c072300 con 0x7f2e6c0b4530 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e73c88640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c165e40 con 0x7f2e6c15c7f0 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.268+0000 7f2e71223640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c156830 0x7f2e6c09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71223640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c156830 0x7f2e6c09aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32838/0 (socket says 172.21.15.79:32838) 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71223640 1 -- 172.21.15.79:0/2159165565 learned_addr learned my addr 172.21.15.79:0/2159165565 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71a24640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e6c0b4530 0x7f2e6c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e72225640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e6c15c7f0 0x7f2e6c143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71223640 1 -- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e6c15c7f0 msgr2=0x7f2e6c143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71223640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e6c15c7f0 0x7f2e6c143c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71223640 1 -- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e6c0b4530 msgr2=0x7f2e6c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71223640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e6c0b4530 0x7f2e6c151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71223640 1 -- 172.21.15.79:0/2159165565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c150c90 con 0x7f2e6c156830 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e72225640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e6c15c7f0 0x7f2e6c143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e71223640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c156830 0x7f2e6c09aa10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f2e68035040 tx=0x7f2e680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e5e7fc640 1 -- 172.21.15.79:0/2159165565 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68037050 con 0x7f2e6c156830 2024-06-10T00:20:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e5e7fc640 1 -- 172.21.15.79:0/2159165565 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e68038040 con 0x7f2e6c156830 2024-06-10T00:20:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6c150f70 con 0x7f2e6c156830 2024-06-10T00:20:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e5e7fc640 1 -- 172.21.15.79:0/2159165565 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68004450 con 0x7f2e6c156830 2024-06-10T00:20:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.269+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6c14e890 con 0x7f2e6c156830 2024-06-10T00:20:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.270+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6c15d370 con 0x7f2e6c156830 2024-06-10T00:20:13.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.271+0000 7f2e5e7fc640 1 -- 172.21.15.79:0/2159165565 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e68030980 con 0x7f2e6c156830 2024-06-10T00:20:13.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.271+0000 7f2e5e7fc640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.271+0000 7f2e5e7fc640 1 -- 172.21.15.79:0/2159165565 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f2e680abbf0 con 0x7f2e6c156830 2024-06-10T00:20:13.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.271+0000 7f2e71a24640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.271+0000 7f2e71a24640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2e60000f60 tx=0x7f2e60007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.275+0000 7f2e5e7fc640 1 -- 172.21.15.79:0/2159165565 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2e6c15d370 con 0x7f2e6c156830 2024-06-10T00:20:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.483+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e6c068430 con 0x7f2e6c156830 2024-06-10T00:20:13.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.483+0000 7f2e5e7fc640 1 -- 172.21.15.79:0/2159165565 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5185 (secure 0 0 0) 0x7f2e6807a570 con 0x7f2e6c156830 2024-06-10T00:20:13.483 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:13.483 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:19:43.820079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6471,"qdb_cluster":[6471]},"id":5}]} 2024-06-10T00:20:13.484 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 44 2024-06-10T00:20:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 msgr2=0x7f2e5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2e60000f60 tx=0x7f2e60007b50 comp rx=0 tx=0).stop 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c156830 msgr2=0x7f2e6c09aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c156830 0x7f2e6c09aa10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f2e68035040 tx=0x7f2e680046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 shutdown_connections 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e6c15c7f0 0x7f2e6c143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6c156830 0x7f2e6c09aa10 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.485+0000 7f2e73c88640 1 --2- 172.21.15.79:0/2159165565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e6c0b4530 0x7f2e6c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.486+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 >> 172.21.15.79:0/2159165565 conn(0x7f2e6c0b19f0 msgr2=0x7f2e6c152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.486+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 shutdown_connections 2024-06-10T00:20:13.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.486+0000 7f2e73c88640 1 -- 172.21.15.79:0/2159165565 wait complete. 2024-06-10T00:20:13.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.596+0000 7fedfe934640 1 Processor -- start 2024-06-10T00:20:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.596+0000 7fedfe934640 1 -- start start 2024-06-10T00:20:13.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedfe934640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf80aef70 0x7fedf80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedfe934640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf815ac50 con 0x7fedf80af3b0 2024-06-10T00:20:13.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedfe934640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf806cdb0 con 0x7fedf815a870 2024-06-10T00:20:13.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedfe934640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fedf806d090 con 0x7fedf80aef70 2024-06-10T00:20:13.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedfced1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fedf80af3b0 0x7fedf80cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51694/0 (socket says 172.21.15.79:51694) 2024-06-10T00:20:13.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedfced1640 1 -- 172.21.15.79:0/4143433890 learned_addr learned my addr 172.21.15.79:0/4143433890 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:13.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315491623 0 0) 0x7fedf815ac50 con 0x7fedf80af3b0 2024-06-10T00:20:13.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede0003520 con 0x7fedf80af3b0 2024-06-10T00:20:13.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf77fe640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf80aef70 0x7fedf80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2998162001 0 0) 0x7fede0003520 con 0x7fedf80af3b0 2024-06-10T00:20:13.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf80aef70 msgr2=0x7fedf80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:13.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf6ffd640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf80aef70 0x7fedf80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 >> v1:172.21.15.117:6789/0 conn(0x7fedf815a870 legacy=0x7fedf806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf806d370 con 0x7fedf80af3b0 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.597+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fedf00019f0 con 0x7fedf80af3b0 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 >> v1:172.21.15.79:6789/0 conn(0x7fedf80af3b0 legacy=0x7fedf80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf6ffd640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede00039e0 0x7fede0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf6ffd640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede0004800 0x7fede0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf6ffd640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf80aef70 0x7fede0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fedf806d090 con 0x7fede00039e0 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fede000baf0 con 0x7fede0004800 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fede000bcf0 con 0x7fedf80aef70 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf7fff640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede00039e0 0x7fede0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf77fe640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede0004800 0x7fede0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedfced1640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf80aef70 0x7fede0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf7fff640 1 -- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf80aef70 msgr2=0x7fede0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf7fff640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf80aef70 0x7fede0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf7fff640 1 -- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede0004800 msgr2=0x7fede0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf7fff640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede0004800 0x7fede0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.598+0000 7fedf7fff640 1 -- 172.21.15.79:0/4143433890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede0003520 con 0x7fede00039e0 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedf7fff640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede00039e0 0x7fede0003e00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fede8001750 tx=0x7fede0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6214c33179e46da9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8001370 con 0x7fede00039e0 2024-06-10T00:20:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede80052d0 con 0x7fede00039e0 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedf6ffd640 1 -- 172.21.15.79:0/4143433890 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede802abe0 con 0x7fede00039e0 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedfe934640 1 -- 172.21.15.79:0/4143433890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede00039e0 msgr2=0x7fede0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedfe934640 1 --2- 172.21.15.79:0/4143433890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede00039e0 0x7fede0003e00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fede8001750 tx=0x7fede0005830 comp rx=0 tx=0).stop 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedfced1640 1 -- 172.21.15.79:0/4143433890 reap_dead start 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedfe934640 1 -- 172.21.15.79:0/4143433890 shutdown_connections 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedfe934640 1 -- 172.21.15.79:0/4143433890 >> 172.21.15.79:0/4143433890 conn(0x7fedf80b19f0 msgr2=0x7fedf80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedfe934640 1 -- 172.21.15.79:0/4143433890 shutdown_connections 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.599+0000 7fedfe934640 1 -- 172.21.15.79:0/4143433890 wait complete. 2024-06-10T00:20:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.601+0000 7fedfe934640 1 Processor -- start 2024-06-10T00:20:13.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.601+0000 7fedfe934640 1 -- start start 2024-06-10T00:20:13.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.601+0000 7fedfe934640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede00039e0 0x7fedf80ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.601+0000 7fedfe934640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf80adb00 0x7fedf814b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.601+0000 7fedfe934640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf8072170 0x7fedf80725f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.601+0000 7fedfe934640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80b2e40 con 0x7fedf80adb00 2024-06-10T00:20:13.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.601+0000 7fedfe934640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fedf806d930 con 0x7fede00039e0 2024-06-10T00:20:13.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.601+0000 7fedfe934640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80b2fc0 con 0x7fedf8072170 2024-06-10T00:20:13.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf80adb00 0x7fedf814b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf80adb00 0x7fedf814b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32852/0 (socket says 172.21.15.79:32852) 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 -- 172.21.15.79:0/3115960228 learned_addr learned my addr 172.21.15.79:0/3115960228 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedfced1640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf8072170 0x7fedf80725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf7fff640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede00039e0 0x7fedf80ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 -- 172.21.15.79:0/3115960228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf8072170 msgr2=0x7fedf80725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf8072170 0x7fedf80725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 -- 172.21.15.79:0/3115960228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede00039e0 msgr2=0x7fedf80ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede00039e0 0x7fedf80ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 -- 172.21.15.79:0/3115960228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80710d0 con 0x7fedf80adb00 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf77fe640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf80adb00 0x7fedf814b8a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fedec013a00 tx=0x7fedec013ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf4ff9640 1 -- 172.21.15.79:0/3115960228 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec020070 con 0x7fedf80adb00 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf4ff9640 1 -- 172.21.15.79:0/3115960228 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedec00fd10 con 0x7fedf80adb00 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf80713b0 con 0x7fedf80adb00 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedf4ff9640 1 -- 172.21.15.79:0/3115960228 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec00b040 con 0x7fedf80adb00 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.602+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf8071970 con 0x7fedf80adb00 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.603+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf8068430 con 0x7fedf80adb00 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.604+0000 7fedf4ff9640 1 -- 172.21.15.79:0/3115960228 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedec023070 con 0x7fedf80adb00 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.604+0000 7fedf4ff9640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fede406be30 0x7fede406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.604+0000 7fedf4ff9640 1 -- 172.21.15.79:0/3115960228 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fedec08cf50 con 0x7fedf80adb00 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.604+0000 7fedf7fff640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fede406be30 0x7fede406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.605+0000 7fedf7fff640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fede406be30 0x7fede406e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fede8032000 tx=0x7fede802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.608+0000 7fedf4ff9640 1 -- 172.21.15.79:0/3115960228 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fedec05b160 con 0x7fedf80adb00 2024-06-10T00:20:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.816+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedf80cd6d0 con 0x7fedf80adb00 2024-06-10T00:20:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.817+0000 7fedf4ff9640 1 -- 172.21.15.79:0/3115960228 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5185 (secure 0 0 0) 0x7fedec05f460 con 0x7fedf80adb00 2024-06-10T00:20:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:13.817 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:18:44.456453+0000","modified":"2024-06-10T00:19:43.820079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6471},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6471":{"gid":6471,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.79:6835/2491534848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2491534848},{"type":"v1","addr":"172.21.15.79:6835","nonce":2491534848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6471,"qdb_cluster":[6471]},"id":5}]} 2024-06-10T00:20:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 44 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fede406be30 msgr2=0x7fede406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fede406be30 0x7fede406e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fede8032000 tx=0x7fede802e000 comp rx=0 tx=0).stop 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf80adb00 msgr2=0x7fedf814b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf80adb00 0x7fedf814b8a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fedec013a00 tx=0x7fedec013ec0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 shutdown_connections 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fede406be30 0x7fede406e2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf8072170 0x7fedf80725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedf80adb00 0x7fedf814b8a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 --2- 172.21.15.79:0/3115960228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede00039e0 0x7fedf80ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 >> 172.21.15.79:0/3115960228 conn(0x7fedf80b19f0 msgr2=0x7fedf80af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:13.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 shutdown_connections 2024-06-10T00:20:13.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.819+0000 7fedfe934640 1 -- 172.21.15.79:0/3115960228 wait complete. 2024-06-10T00:20:13.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:20:13.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.930+0000 7f1922688640 1 Processor -- start 2024-06-10T00:20:13.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.930+0000 7f1922688640 1 -- start start 2024-06-10T00:20:13.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1922688640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c15f1a0 0x7f191c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1922688640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f191c0cef70 0x7f191c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1922688640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191c15f5e0 con 0x7f191c0d2680 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1922688640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f191c0d13e0 con 0x7f191c0cef70 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1922688640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f191c0d0ad0 con 0x7f191c15f1a0 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1920c25640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f191c0cef70 0x7f191c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1920c25640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f191c0cef70 0x7f191c0cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32860/0 (socket says 172.21.15.79:32860) 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1920c25640 1 -- 172.21.15.79:0/3163582992 learned_addr learned my addr 172.21.15.79:0/3163582992 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f191b7fe640 1 --2- 172.21.15.79:0/3163582992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c15f1a0 0x7f191c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1920c25640 1 -- 172.21.15.79:0/3163582992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c15f1a0 msgr2=0x7f191c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1920c25640 1 --2- 172.21.15.79:0/3163582992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c15f1a0 0x7f191c0d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1920c25640 1 -- 172.21.15.79:0/3163582992 >> v1:172.21.15.117:6789/0 conn(0x7f191c0d2680 legacy=0x7f191c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.931+0000 7f1920c25640 1 -- 172.21.15.79:0/3163582992 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c15f890 con 0x7f191c0cef70 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.932+0000 7f1920c25640 1 --2- 172.21.15.79:0/3163582992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c0cef70 0x7f191c0cf400 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1914009e50 tx=0x7f191402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53be2ff38784d362 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.932+0000 7f191affd640 1 -- 172.21.15.79:0/3163582992 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914036070 con 0x7f191c0cef70 2024-06-10T00:20:13.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.932+0000 7f191affd640 1 -- 172.21.15.79:0/3163582992 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914031600 con 0x7f191c0cef70 2024-06-10T00:20:13.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.932+0000 7f191affd640 1 -- 172.21.15.79:0/3163582992 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19140319d0 con 0x7f191c0cef70 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.933+0000 7f1922688640 1 -- 172.21.15.79:0/3163582992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c0cef70 msgr2=0x7f191c0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.933+0000 7f1922688640 1 --2- 172.21.15.79:0/3163582992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c0cef70 0x7f191c0cf400 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1914009e50 tx=0x7f191402a6c0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.933+0000 7f1922688640 1 -- 172.21.15.79:0/3163582992 shutdown_connections 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.933+0000 7f1922688640 1 --2- 172.21.15.79:0/3163582992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c0cef70 0x7f191c0cf400 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.933+0000 7f1922688640 1 --2- 172.21.15.79:0/3163582992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c15f1a0 0x7f191c0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.933+0000 7f1922688640 1 -- 172.21.15.79:0/3163582992 >> 172.21.15.79:0/3163582992 conn(0x7f191c09d3f0 msgr2=0x7f191c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.933+0000 7f1922688640 1 -- 172.21.15.79:0/3163582992 shutdown_connections 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.933+0000 7f1922688640 1 -- 172.21.15.79:0/3163582992 wait complete. 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.934+0000 7f1922688640 1 Processor -- start 2024-06-10T00:20:13.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.934+0000 7f1922688640 1 -- start start 2024-06-10T00:20:13.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1922688640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f191c0cef70 0x7f191c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1922688640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c0d2680 0x7f191c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1922688640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c15f1a0 0x7f191c0b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1922688640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0d4f00 con 0x7f191c15f1a0 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1922688640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0d1070 con 0x7f191c0cef70 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1922688640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f191c0d1870 con 0x7f191c0d2680 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c15f1a0 0x7f191c0b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c15f1a0 0x7f191c0b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32876/0 (socket says 172.21.15.79:32876) 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 -- 172.21.15.79:0/1870892207 learned_addr learned my addr 172.21.15.79:0/1870892207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f191b7fe640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c0d2680 0x7f191c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f191bfff640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f191c0cef70 0x7f191c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 -- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c0d2680 msgr2=0x7f191c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c0d2680 0x7f191c0b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 -- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f191c0cef70 msgr2=0x7f191c0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:13.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f191c0cef70 0x7f191c0b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 -- 172.21.15.79:0/1870892207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c15dcc0 con 0x7f191c15f1a0 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f191b7fe640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c0d2680 0x7f191c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f191bfff640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f191c0cef70 0x7f191c0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1920c25640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c15f1a0 0x7f191c0b2410 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1914034040 tx=0x7f1914004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1918ff9640 1 -- 172.21.15.79:0/1870892207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914041020 con 0x7f191c15f1a0 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1918ff9640 1 -- 172.21.15.79:0/1870892207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19140077a0 con 0x7f191c15f1a0 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c15dfa0 con 0x7f191c15f1a0 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1918ff9640 1 -- 172.21.15.79:0/1870892207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914036040 con 0x7f191c15f1a0 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.935+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c0c8250 con 0x7f191c15f1a0 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.936+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c068430 con 0x7f191c15f1a0 2024-06-10T00:20:13.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.937+0000 7f1918ff9640 1 -- 172.21.15.79:0/1870892207 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1914044020 con 0x7f191c15f1a0 2024-06-10T00:20:13.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.937+0000 7f1918ff9640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:13.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.938+0000 7f191bfff640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:13.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.938+0000 7f1918ff9640 1 -- 172.21.15.79:0/1870892207 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f19140abe60 con 0x7f191c15f1a0 2024-06-10T00:20:13.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.938+0000 7f191bfff640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f190806be30 0x7f190806e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f190c003eb0 tx=0x7f190c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:13.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:13.942+0000 7f1918ff9640 1 -- 172.21.15.79:0/1870892207 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f191404b030 con 0x7f191c15f1a0 2024-06-10T00:20:14.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.119+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f191c0d04e0 con 0x7f191c15f1a0 2024-06-10T00:20:14.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.120+0000 7f1918ff9640 1 -- 172.21.15.79:0/1870892207 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17026 (secure 0 0 0) 0x7f191407a6c0 con 0x7f191c15f1a0 2024-06-10T00:20:14.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:14.120 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":76,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:18:53.210257+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:18:43.020724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-06-10T00:18:43.357910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6835/1640828017":"2024-06-11T00:18:53.210236+0000","172.21.15.79:6834/1640828017":"2024-06-11T00:18:53.210236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:20:14.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.122+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f190806be30 msgr2=0x7f190806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.122+0000 7f1922688640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f190806be30 0x7f190806e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f190c003eb0 tx=0x7f190c009040 comp rx=0 tx=0).stop 2024-06-10T00:20:14.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.122+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c15f1a0 msgr2=0x7f191c0b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.122+0000 7f1922688640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c15f1a0 0x7f191c0b2410 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1914034040 tx=0x7f1914004a40 comp rx=0 tx=0).stop 2024-06-10T00:20:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.123+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 shutdown_connections 2024-06-10T00:20:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.123+0000 7f1922688640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.123+0000 7f1922688640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f191c15f1a0 0x7f191c0b2410 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.123+0000 7f1922688640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191c0d2680 0x7f191c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.123+0000 7f1922688640 1 --2- 172.21.15.79:0/1870892207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f191c0cef70 0x7f191c0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.123+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 >> 172.21.15.79:0/1870892207 conn(0x7f191c09d3f0 msgr2=0x7f191c15e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.123+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 shutdown_connections 2024-06-10T00:20:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.123+0000 7f1922688640 1 -- 172.21.15.79:0/1870892207 wait complete. 2024-06-10T00:20:14.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:20:14.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.236+0000 7feb46e95640 1 Processor -- start 2024-06-10T00:20:14.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.236+0000 7feb46e95640 1 -- start start 2024-06-10T00:20:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.236+0000 7feb46e95640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb400d2680 0x7feb4015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb46e95640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb400cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb46e95640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb400d0ad0 con 0x7feb400d1fc0 2024-06-10T00:20:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb46e95640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7feb400d13e0 con 0x7feb400d2680 2024-06-10T00:20:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb46e95640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb4015f890 con 0x7feb400cef70 2024-06-10T00:20:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb44c31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb400d2680 0x7feb4015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb45432640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb400cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb3ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7feb400d1fc0 0x7feb400d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:36724/0 (socket says 172.21.15.79:36724) 2024-06-10T00:20:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb44c31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb400d2680 0x7feb4015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:57666/0 (socket says 172.21.15.79:57666) 2024-06-10T00:20:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb3ffff640 1 -- 172.21.15.79:0/2182609819 learned_addr learned my addr 172.21.15.79:0/2182609819 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb3f7fe640 1 -- 172.21.15.79:0/2182609819 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377992030 0 0) 0x7feb400d0ad0 con 0x7feb400d1fc0 2024-06-10T00:20:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb3f7fe640 1 -- 172.21.15.79:0/2182609819 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb30003520 con 0x7feb400d1fc0 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb44c31640 1 -- 172.21.15.79:0/2182609819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 msgr2=0x7feb400cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb44c31640 1 --2- 172.21.15.79:0/2182609819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb400cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb44c31640 1 -- 172.21.15.79:0/2182609819 >> v1:172.21.15.117:6789/0 conn(0x7feb400d1fc0 legacy=0x7feb400d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb44c31640 1 -- 172.21.15.79:0/2182609819 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb400d0d90 con 0x7feb400d2680 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.237+0000 7feb45432640 1 --2- 172.21.15.79:0/2182609819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb400cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.238+0000 7feb44c31640 1 --2- 172.21.15.79:0/2182609819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 0x7feb4015f1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feb340097a0 tx=0x7feb3402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=618997341a26fd53 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.238+0000 7feb3f7fe640 1 -- 172.21.15.79:0/2182609819 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34037070 con 0x7feb400d2680 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.238+0000 7feb3f7fe640 1 -- 172.21.15.79:0/2182609819 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb34032440 con 0x7feb400d2680 2024-06-10T00:20:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.238+0000 7feb3f7fe640 1 -- 172.21.15.79:0/2182609819 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb340327f0 con 0x7feb400d2680 2024-06-10T00:20:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.239+0000 7feb46e95640 1 -- 172.21.15.79:0/2182609819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 msgr2=0x7feb4015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.239+0000 7feb46e95640 1 --2- 172.21.15.79:0/2182609819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 0x7feb4015f1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feb340097a0 tx=0x7feb3402a180 comp rx=0 tx=0).stop 2024-06-10T00:20:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.239+0000 7feb46e95640 1 -- 172.21.15.79:0/2182609819 shutdown_connections 2024-06-10T00:20:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.239+0000 7feb46e95640 1 --2- 172.21.15.79:0/2182609819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb400cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.239+0000 7feb46e95640 1 --2- 172.21.15.79:0/2182609819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 0x7feb4015f1a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.239+0000 7feb46e95640 1 -- 172.21.15.79:0/2182609819 >> 172.21.15.79:0/2182609819 conn(0x7feb4009d3f0 msgr2=0x7feb400d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.239+0000 7feb46e95640 1 -- 172.21.15.79:0/2182609819 shutdown_connections 2024-06-10T00:20:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.239+0000 7feb46e95640 1 -- 172.21.15.79:0/2182609819 wait complete. 2024-06-10T00:20:14.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.240+0000 7feb46e95640 1 Processor -- start 2024-06-10T00:20:14.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.240+0000 7feb46e95640 1 -- start start 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb46e95640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb401599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb46e95640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb400d1fc0 0x7feb400cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb46e95640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 0x7feb400c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb46e95640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb400d4f00 con 0x7feb400d1fc0 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb46e95640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feb400d2400 con 0x7feb400d2680 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb46e95640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb400d1870 con 0x7feb400cef70 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb3ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb400d1fc0 0x7feb400cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb3ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb400d1fc0 0x7feb400cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32882/0 (socket says 172.21.15.79:32882) 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb3ffff640 1 -- 172.21.15.79:0/3382619147 learned_addr learned my addr 172.21.15.79:0/3382619147 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb44c31640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb401599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb45432640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 0x7feb400c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb3ffff640 1 -- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 msgr2=0x7feb401599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb3ffff640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb401599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb3ffff640 1 -- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 msgr2=0x7feb400c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb3ffff640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 0x7feb400c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb3ffff640 1 -- 172.21.15.79:0/3382619147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb400b6e80 con 0x7feb400d1fc0 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb44c31640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb401599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.241+0000 7feb45432640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 0x7feb400c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.242+0000 7feb3ffff640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb400d1fc0 0x7feb400cbba0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00c460 tx=0x7feb2c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.242+0000 7feb3d7fa640 1 -- 172.21.15.79:0/3382619147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c017070 con 0x7feb400d1fc0 2024-06-10T00:20:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.242+0000 7feb3d7fa640 1 -- 172.21.15.79:0/3382619147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c005ce0 con 0x7feb400d1fc0 2024-06-10T00:20:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.242+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb400b7160 con 0x7feb400d1fc0 2024-06-10T00:20:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.242+0000 7feb3d7fa640 1 -- 172.21.15.79:0/3382619147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c007290 con 0x7feb400d1fc0 2024-06-10T00:20:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.242+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb400b7720 con 0x7feb400d1fc0 2024-06-10T00:20:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.243+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb40068430 con 0x7feb400d1fc0 2024-06-10T00:20:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.243+0000 7feb3d7fa640 1 -- 172.21.15.79:0/3382619147 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb2c01a070 con 0x7feb400d1fc0 2024-06-10T00:20:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.244+0000 7feb3d7fa640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feb2406be30 0x7feb2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.244+0000 7feb3d7fa640 1 -- 172.21.15.79:0/3382619147 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7feb2c08a3c0 con 0x7feb400d1fc0 2024-06-10T00:20:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.244+0000 7feb44c31640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feb2406be30 0x7feb2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.244+0000 7feb44c31640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feb2406be30 0x7feb2406e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7feb34034000 tx=0x7feb3402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.252+0000 7feb3d7fa640 1 -- 172.21.15.79:0/3382619147 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7feb2c058ba0 con 0x7feb400d1fc0 2024-06-10T00:20:14.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:20:14.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:20:14.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.471+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feb400ce580 con 0x7feb400d1fc0 2024-06-10T00:20:14.471 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:20:14.472+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:20:14.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.473+0000 7feb3d7fa640 1 -- 172.21.15.79:0/3382619147 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) ==== 161+0+0 (secure 0 0 0) 0x7feb2c0584a0 con 0x7feb400d1fc0 2024-06-10T00:20:14.473 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:20:14.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feb2406be30 msgr2=0x7feb2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feb2406be30 0x7feb2406e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7feb34034000 tx=0x7feb3402e000 comp rx=0 tx=0).stop 2024-06-10T00:20:14.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb400d1fc0 msgr2=0x7feb400cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb400d1fc0 0x7feb400cbba0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00c460 tx=0x7feb2c00c920 comp rx=0 tx=0).stop 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 shutdown_connections 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feb2406be30 0x7feb2406e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400d2680 0x7feb400c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb400d1fc0 0x7feb400cbba0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 --2- 172.21.15.79:0/3382619147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb400cef70 0x7feb401599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.476+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 >> 172.21.15.79:0/3382619147 conn(0x7feb4009d3f0 msgr2=0x7feb400d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.477+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 shutdown_connections 2024-06-10T00:20:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.477+0000 7feb46e95640 1 -- 172.21.15.79:0/3382619147 wait complete. 2024-06-10T00:20:14.478 INFO:tasks.ceph.mds.c.smithi079.stderr: -4250> 2024-06-10T00:18:58.813+0000 7fe8a42ff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:20:14.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-10T00:20:14.510 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:20:14.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.596+0000 7fa2851ce640 1 Processor -- start 2024-06-10T00:20:14.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.597+0000 7fa2851ce640 1 -- start start 2024-06-10T00:20:14.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.597+0000 7fa2851ce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2800d08f0 0x7fa2800b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.597+0000 7fa2851ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800cf360 0x7fa2800d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.597+0000 7fa2851ce640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2800cf8a0 con 0x7fa2800d0cd0 2024-06-10T00:20:14.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa2851ce640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa2800d1c80 con 0x7fa2800d08f0 2024-06-10T00:20:14.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa2851ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2800cfb80 con 0x7fa2800cf360 2024-06-10T00:20:14.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800cf360 0x7fa2800d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27ed9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2800d08f0 0x7fa2800b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27e59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa2800d0cd0 0x7fa2800cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:36740/0 (socket says 172.21.15.79:36740) 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27e59c640 1 -- 172.21.15.79:0/304318559 learned_addr learned my addr 172.21.15.79:0/304318559 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27ed9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2800d08f0 0x7fa2800b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:57702/0 (socket says 172.21.15.79:57702) 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27f59e640 1 -- 172.21.15.79:0/304318559 >> v2:172.21.15.117:3300/0 conn(0x7fa2800d08f0 msgr2=0x7fa2800b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27f59e640 1 --2- 172.21.15.79:0/304318559 >> v2:172.21.15.117:3300/0 conn(0x7fa2800d08f0 0x7fa2800b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27f59e640 1 -- 172.21.15.79:0/304318559 >> v1:172.21.15.117:6789/0 conn(0x7fa2800d0cd0 legacy=0x7fa2800cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27f59e640 1 -- 172.21.15.79:0/304318559 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2800cfe60 con 0x7fa2800cf360 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27dd9b640 1 -- 172.21.15.79:0/304318559 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599628135 0 0) 0x7fa2800cf8a0 con 0x7fa2800d0cd0 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.598+0000 7fa27ed9d640 1 --2- 172.21.15.79:0/304318559 >> v2:172.21.15.117:3300/0 conn(0x7fa2800d08f0 0x7fa2800b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.599+0000 7fa27f59e640 1 --2- 172.21.15.79:0/304318559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800cf360 0x7fa2800d23f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa278009dc0 tx=0x7fa27802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92229f8d75a9e8d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.599+0000 7fa27dd9b640 1 -- 172.21.15.79:0/304318559 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27802ae60 con 0x7fa2800cf360 2024-06-10T00:20:14.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.599+0000 7fa27dd9b640 1 -- 172.21.15.79:0/304318559 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa278007740 con 0x7fa2800cf360 2024-06-10T00:20:14.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.599+0000 7fa27dd9b640 1 -- 172.21.15.79:0/304318559 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278007b10 con 0x7fa2800cf360 2024-06-10T00:20:14.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.600+0000 7fa2851ce640 1 -- 172.21.15.79:0/304318559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800cf360 msgr2=0x7fa2800d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.600+0000 7fa2851ce640 1 --2- 172.21.15.79:0/304318559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800cf360 0x7fa2800d23f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa278009dc0 tx=0x7fa27802a680 comp rx=0 tx=0).stop 2024-06-10T00:20:14.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.600+0000 7fa2851ce640 1 -- 172.21.15.79:0/304318559 shutdown_connections 2024-06-10T00:20:14.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.600+0000 7fa2851ce640 1 --2- 172.21.15.79:0/304318559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800cf360 0x7fa2800d23f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.600+0000 7fa2851ce640 1 --2- 172.21.15.79:0/304318559 >> v2:172.21.15.117:3300/0 conn(0x7fa2800d08f0 0x7fa2800b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.600+0000 7fa2851ce640 1 -- 172.21.15.79:0/304318559 >> 172.21.15.79:0/304318559 conn(0x7fa28009d3c0 msgr2=0x7fa2800d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:14.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.600+0000 7fa2851ce640 1 -- 172.21.15.79:0/304318559 shutdown_connections 2024-06-10T00:20:14.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.600+0000 7fa2851ce640 1 -- 172.21.15.79:0/304318559 wait complete. 2024-06-10T00:20:14.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.602+0000 7fa2851ce640 1 Processor -- start 2024-06-10T00:20:14.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.602+0000 7fa2851ce640 1 -- start start 2024-06-10T00:20:14.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa2851ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2800cf360 0x7fa28015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa2851ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800d08f0 0x7fa2800b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa2851ce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2800d0cd0 0x7fa280157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa2851ce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2800d1180 con 0x7fa2800cf360 2024-06-10T00:20:14.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa2851ce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa2800b50c0 con 0x7fa2800d0cd0 2024-06-10T00:20:14.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa2851ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2800b4a60 con 0x7fa2800d08f0 2024-06-10T00:20:14.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2800cf360 0x7fa28015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2800cf360 0x7fa28015bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32906/0 (socket says 172.21.15.79:32906) 2024-06-10T00:20:14.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 -- 172.21.15.79:0/3090046415 learned_addr learned my addr 172.21.15.79:0/3090046415 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:14.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27e59c640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800d08f0 0x7fa2800b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27f59e640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2800d0cd0 0x7fa280157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 -- 172.21.15.79:0/3090046415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800d08f0 msgr2=0x7fa2800b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800d08f0 0x7fa2800b93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 -- 172.21.15.79:0/3090046415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2800d0cd0 msgr2=0x7fa280157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2800d0cd0 0x7fa280157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 -- 172.21.15.79:0/3090046415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28015dd40 con 0x7fa2800cf360 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.604+0000 7fa27ed9d640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2800cf360 0x7fa28015bef0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa27000ebe0 tx=0x7fa27000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.605+0000 7fa2677fe640 1 -- 172.21.15.79:0/3090046415 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270017070 con 0x7fa2800cf360 2024-06-10T00:20:14.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.605+0000 7fa2677fe640 1 -- 172.21.15.79:0/3090046415 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27000cc30 con 0x7fa2800cf360 2024-06-10T00:20:14.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.605+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28015e080 con 0x7fa2800cf360 2024-06-10T00:20:14.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.605+0000 7fa2677fe640 1 -- 172.21.15.79:0/3090046415 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270013470 con 0x7fa2800cf360 2024-06-10T00:20:14.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.605+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2800b9110 con 0x7fa2800cf360 2024-06-10T00:20:14.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.606+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2800683c0 con 0x7fa2800cf360 2024-06-10T00:20:14.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.606+0000 7fa2677fe640 1 -- 172.21.15.79:0/3090046415 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa27001a070 con 0x7fa2800cf360 2024-06-10T00:20:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.607+0000 7fa2677fe640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa26c06be30 0x7fa26c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.607+0000 7fa2677fe640 1 -- 172.21.15.79:0/3090046415 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6273+0+0 (secure 0 0 0) 0x7fa27008afa0 con 0x7fa2800cf360 2024-06-10T00:20:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.607+0000 7fa27e59c640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa26c06be30 0x7fa26c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.607+0000 7fa27e59c640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa26c06be30 0x7fa26c06e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa28006c390 tx=0x7fa274007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:14.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.611+0000 7fa2677fe640 1 -- 172.21.15.79:0/3090046415 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa28015e080 con 0x7fa2800cf360 2024-06-10T00:20:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:14.829+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa2800d1730 con 0x7fa2800cf360 2024-06-10T00:20:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.477+0000 7fa2677fe640 1 -- 172.21.15.79:0/3090046415 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) ==== 104+0+0 (secure 0 0 0) 0x7fa2700590c0 con 0x7fa2800cf360 2024-06-10T00:20:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa26c06be30 msgr2=0x7fa26c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa26c06be30 0x7fa26c06e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa28006c390 tx=0x7fa274007de0 comp rx=0 tx=0).stop 2024-06-10T00:20:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2800cf360 msgr2=0x7fa28015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2800cf360 0x7fa28015bef0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa27000ebe0 tx=0x7fa27000c520 comp rx=0 tx=0).stop 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 shutdown_connections 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa26c06be30 0x7fa26c06e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2800d0cd0 0x7fa280157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2800d08f0 0x7fa2800b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 --2- 172.21.15.79:0/3090046415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2800cf360 0x7fa28015bef0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.479+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 >> 172.21.15.79:0/3090046415 conn(0x7fa28009d3c0 msgr2=0x7fa2800b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.480+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 shutdown_connections 2024-06-10T00:20:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.480+0000 7fa2851ce640 1 -- 172.21.15.79:0/3090046415 wait complete. 2024-06-10T00:20:15.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-10T00:20:15.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.635+0000 7f1f18841640 1 Processor -- start 2024-06-10T00:20:15.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.635+0000 7f1f18841640 1 -- start start 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f18841640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f1415be50 0x7f1f14071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f18841640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f14072570 con 0x7f1f140ccd30 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f18841640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f14072850 con 0x7f1f140720d0 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f18841640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1f140b3020 con 0x7f1f1415be50 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f1259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f1415be50 0x7f1f14071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f12d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1f140ccd30 0x7f1f140b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51718/0 (socket says 172.21.15.79:51718) 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f12d9d640 1 -- 172.21.15.79:0/1258319977 learned_addr learned my addr 172.21.15.79:0/1258319977 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f1259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f1415be50 0x7f1f14071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32916/0 (socket says 172.21.15.79:32916) 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f1259c640 1 -- 172.21.15.79:0/1258319977 >> v1:172.21.15.117:6789/0 conn(0x7f1f140720d0 legacy=0x7f1f140cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f1259c640 1 -- 172.21.15.79:0/1258319977 >> v1:172.21.15.79:6789/0 conn(0x7f1f140ccd30 legacy=0x7f1f140b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:15.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.636+0000 7f1f1259c640 1 -- 172.21.15.79:0/1258319977 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f14072b30 con 0x7f1f1415be50 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.637+0000 7f1f1259c640 1 --2- 172.21.15.79:0/1258319977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1415be50 0x7f1f14071b90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f1f040097a0 tx=0x7f1f0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376e25d7e3353498 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.637+0000 7f1f11d9b640 1 -- 172.21.15.79:0/1258319977 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04037070 con 0x7f1f1415be50 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.637+0000 7f1f11d9b640 1 -- 172.21.15.79:0/1258319977 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f04032440 con 0x7f1f1415be50 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.637+0000 7f1f11d9b640 1 -- 172.21.15.79:0/1258319977 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04032810 con 0x7f1f1415be50 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.637+0000 7f1f18841640 1 -- 172.21.15.79:0/1258319977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1415be50 msgr2=0x7f1f14071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.637+0000 7f1f18841640 1 --2- 172.21.15.79:0/1258319977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1415be50 0x7f1f14071b90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f1f040097a0 tx=0x7f1f0402a230 comp rx=0 tx=0).stop 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.637+0000 7f1f18841640 1 -- 172.21.15.79:0/1258319977 shutdown_connections 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.638+0000 7f1f18841640 1 --2- 172.21.15.79:0/1258319977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1415be50 0x7f1f14071b90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.638+0000 7f1f18841640 1 -- 172.21.15.79:0/1258319977 >> 172.21.15.79:0/1258319977 conn(0x7f1f140b1980 msgr2=0x7f1f140b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.638+0000 7f1f18841640 1 -- 172.21.15.79:0/1258319977 shutdown_connections 2024-06-10T00:20:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.638+0000 7f1f18841640 1 -- 172.21.15.79:0/1258319977 wait complete. 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.639+0000 7f1f18841640 1 Processor -- start 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.639+0000 7f1f18841640 1 -- start start 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f18841640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f140720d0 0x7f1f141457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f18841640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f140ccd30 0x7f1f141f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f18841640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f1415be50 0x7f1f140cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f18841640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1415c950 con 0x7f1f140720d0 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f18841640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14072ed0 con 0x7f1f1415be50 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f18841640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1415c230 con 0x7f1f140ccd30 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f140720d0 0x7f1f141457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f140720d0 0x7f1f141457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32932/0 (socket says 172.21.15.79:32932) 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 -- 172.21.15.79:0/192153785 learned_addr learned my addr 172.21.15.79:0/192153785 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f12d9d640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f1415be50 0x7f1f140cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f09d9b640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f140ccd30 0x7f1f141f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 -- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f140ccd30 msgr2=0x7f1f141f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f140ccd30 0x7f1f141f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 -- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f1415be50 msgr2=0x7f1f140cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f1415be50 0x7f1f140cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 -- 172.21.15.79:0/192153785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f140d0a30 con 0x7f1f140720d0 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f09d9b640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f140ccd30 0x7f1f141f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f1259c640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f140720d0 0x7f1f141457e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1f04000c00 tx=0x7f1f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.640+0000 7f1f0b7fe640 1 -- 172.21.15.79:0/192153785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04037040 con 0x7f1f140720d0 2024-06-10T00:20:15.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.641+0000 7f1f0b7fe640 1 -- 172.21.15.79:0/192153785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f04042070 con 0x7f1f140720d0 2024-06-10T00:20:15.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.641+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1406ce30 con 0x7f1f140720d0 2024-06-10T00:20:15.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.641+0000 7f1f0b7fe640 1 -- 172.21.15.79:0/192153785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04030a70 con 0x7f1f140720d0 2024-06-10T00:20:15.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.641+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1406d3f0 con 0x7f1f140720d0 2024-06-10T00:20:15.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.641+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f14068540 con 0x7f1f140720d0 2024-06-10T00:20:15.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.642+0000 7f1f0b7fe640 1 -- 172.21.15.79:0/192153785 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f04030c10 con 0x7f1f140720d0 2024-06-10T00:20:15.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.642+0000 7f1f0b7fe640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ef406be60 0x7f1ef406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:15.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.643+0000 7f1f0b7fe640 1 -- 172.21.15.79:0/192153785 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6273+0+0 (secure 0 0 0) 0x7f1f040abab0 con 0x7f1f140720d0 2024-06-10T00:20:15.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.643+0000 7f1f09d9b640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ef406be60 0x7f1ef406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:15.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.643+0000 7f1f09d9b640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ef406be60 0x7f1ef406e320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1f1409da80 tx=0x7f1efc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:15.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.647+0000 7f1f0b7fe640 1 -- 172.21.15.79:0/192153785 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1f04045360 con 0x7f1f140720d0 2024-06-10T00:20:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:15.820+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1f14075430 con 0x7f1f140720d0 2024-06-10T00:20:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.480+0000 7f1f0b7fe640 1 -- 172.21.15.79:0/192153785 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7f1f0407a2b0 con 0x7f1f140720d0 2024-06-10T00:20:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ef406be60 msgr2=0x7f1ef406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ef406be60 0x7f1ef406e320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1f1409da80 tx=0x7f1efc009040 comp rx=0 tx=0).stop 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f140720d0 msgr2=0x7f1f141457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f140720d0 0x7f1f141457e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1f04000c00 tx=0x7f1f040046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 shutdown_connections 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ef406be60 0x7f1ef406e320 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f1415be50 0x7f1f140cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f140ccd30 0x7f1f141f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 --2- 172.21.15.79:0/192153785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f140720d0 0x7f1f141457e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 >> 172.21.15.79:0/192153785 conn(0x7f1f140b1980 msgr2=0x7f1f140b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 shutdown_connections 2024-06-10T00:20:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.483+0000 7f1f18841640 1 -- 172.21.15.79:0/192153785 wait complete. 2024-06-10T00:20:16.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-10T00:20:16.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.600+0000 7f3b12fed640 1 Processor -- start 2024-06-10T00:20:16.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.600+0000 7f3b12fed640 1 -- start start 2024-06-10T00:20:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.601+0000 7f3b12fed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b0c15a810 0x7f3b0c0b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.601+0000 7f3b12fed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b0c072020 0x7f3b0c0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.601+0000 7f3b12fed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0c073270 con 0x7f3b0c0af420 2024-06-10T00:20:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.601+0000 7f3b12fed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c0ce560 con 0x7f3b0c15a810 2024-06-10T00:20:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.601+0000 7f3b12fed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c0b4e30 con 0x7f3b0c072020 2024-06-10T00:20:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.601+0000 7f3b10d89640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b0c15a810 0x7f3b0c0b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.601+0000 7f3b10d89640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b0c15a810 0x7f3b0c0b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32942/0 (socket says 172.21.15.79:32942) 2024-06-10T00:20:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.601+0000 7f3b10d89640 1 -- 172.21.15.79:0/1944530775 learned_addr learned my addr 172.21.15.79:0/1944530775 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.602+0000 7f3b10d89640 1 -- 172.21.15.79:0/1944530775 >> v2:172.21.15.117:3300/0 conn(0x7f3b0c072020 msgr2=0x7f3b0c0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.602+0000 7f3b10d89640 1 --2- 172.21.15.79:0/1944530775 >> v2:172.21.15.117:3300/0 conn(0x7f3b0c072020 0x7f3b0c0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.602+0000 7f3b10d89640 1 -- 172.21.15.79:0/1944530775 >> v1:172.21.15.117:6789/0 conn(0x7f3b0c0af420 legacy=0x7f3b0c15e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.602+0000 7f3b10d89640 1 -- 172.21.15.79:0/1944530775 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c15abf0 con 0x7f3b0c15a810 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.602+0000 7f3b10d89640 1 --2- 172.21.15.79:0/1944530775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c0b43b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0cfa00 tx=0x7f3afc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b379d6073c720b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.602+0000 7f3b0b7fe640 1 -- 172.21.15.79:0/1944530775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc037070 con 0x7f3b0c15a810 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b0b7fe640 1 -- 172.21.15.79:0/1944530775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc032440 con 0x7f3b0c15a810 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b0b7fe640 1 -- 172.21.15.79:0/1944530775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc032810 con 0x7f3b0c15a810 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b12fed640 1 -- 172.21.15.79:0/1944530775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 msgr2=0x7f3b0c0b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b12fed640 1 --2- 172.21.15.79:0/1944530775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c0b43b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0cfa00 tx=0x7f3afc02a230 comp rx=0 tx=0).stop 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b12fed640 1 -- 172.21.15.79:0/1944530775 shutdown_connections 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b12fed640 1 --2- 172.21.15.79:0/1944530775 >> v2:172.21.15.117:3300/0 conn(0x7f3b0c072020 0x7f3b0c0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b12fed640 1 --2- 172.21.15.79:0/1944530775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c0b43b0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b12fed640 1 -- 172.21.15.79:0/1944530775 >> 172.21.15.79:0/1944530775 conn(0x7f3b0c0b1980 msgr2=0x7f3b0c0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b12fed640 1 -- 172.21.15.79:0/1944530775 shutdown_connections 2024-06-10T00:20:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.603+0000 7f3b12fed640 1 -- 172.21.15.79:0/1944530775 wait complete. 2024-06-10T00:20:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.604+0000 7f3b12fed640 1 Processor -- start 2024-06-10T00:20:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.604+0000 7f3b12fed640 1 -- start start 2024-06-10T00:20:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b12fed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b0c072020 0x7f3b0c0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b12fed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b0c0af420 0x7f3b0c1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b12fed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b12fed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c0ced70 con 0x7f3b0c15a810 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b12fed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c0cea90 con 0x7f3b0c072020 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b12fed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0c0cf050 con 0x7f3b0c0af420 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b1158a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b1158a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32946/0 (socket says 172.21.15.79:32946) 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b1158a640 1 -- 172.21.15.79:0/3210953407 learned_addr learned my addr 172.21.15.79:0/3210953407 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b10d89640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b0c072020 0x7f3b0c0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b0bfff640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b0c0af420 0x7f3b0c1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b1158a640 1 -- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b0c0af420 msgr2=0x7f3b0c1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b1158a640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b0c0af420 0x7f3b0c1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b1158a640 1 -- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b0c072020 msgr2=0x7f3b0c0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b1158a640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b0c072020 0x7f3b0c0cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b1158a640 1 -- 172.21.15.79:0/3210953407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c154e70 con 0x7f3b0c15a810 2024-06-10T00:20:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.605+0000 7f3b10d89640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b0c072020 0x7f3b0c0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.606+0000 7f3b1158a640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c154930 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400b410 tx=0x7f3b0400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.606+0000 7f3b097fa640 1 -- 172.21.15.79:0/3210953407 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04015020 con 0x7f3b0c15a810 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.606+0000 7f3b097fa640 1 -- 172.21.15.79:0/3210953407 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b04011850 con 0x7f3b0c15a810 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.606+0000 7f3b097fa640 1 -- 172.21.15.79:0/3210953407 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011c40 con 0x7f3b0c15a810 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.606+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0c1555a0 con 0x7f3b0c15a810 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.606+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0c155b60 con 0x7f3b0c15a810 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.607+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0c068540 con 0x7f3b0c15a810 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.607+0000 7f3b097fa640 1 -- 172.21.15.79:0/3210953407 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b04018020 con 0x7f3b0c15a810 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.608+0000 7f3b097fa640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3af806be30 0x7f3af806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.608+0000 7f3b097fa640 1 -- 172.21.15.79:0/3210953407 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5835+0+0 (secure 0 0 0) 0x7f3b0408ad20 con 0x7f3b0c15a810 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.608+0000 7f3b10d89640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3af806be30 0x7f3af806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.608+0000 7f3b10d89640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3af806be30 0x7f3af806e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3afc034000 tx=0x7f3afc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.612+0000 7f3b097fa640 1 -- 172.21.15.79:0/3210953407 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3b0408f070 con 0x7f3b0c15a810 2024-06-10T00:20:16.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:16.787+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3b0c0b16f0 con 0x7f3b0c15a810 2024-06-10T00:20:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.482+0000 7f3b097fa640 1 -- 172.21.15.79:0/3210953407 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7f3b0401f020 con 0x7f3b0c15a810 2024-06-10T00:20:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-06-10T00:20:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3af806be30 msgr2=0x7f3af806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3af806be30 0x7f3af806e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3afc034000 tx=0x7f3afc02e000 comp rx=0 tx=0).stop 2024-06-10T00:20:17.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 msgr2=0x7f3b0c154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c154930 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400b410 tx=0x7f3b0400b810 comp rx=0 tx=0).stop 2024-06-10T00:20:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 shutdown_connections 2024-06-10T00:20:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3af806be30 0x7f3af806e2f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b0c15a810 0x7f3b0c154930 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b0c0af420 0x7f3b0c1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 --2- 172.21.15.79:0/3210953407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b0c072020 0x7f3b0c0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.485+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 >> 172.21.15.79:0/3210953407 conn(0x7f3b0c0b1980 msgr2=0x7f3b0c06e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.486+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 shutdown_connections 2024-06-10T00:20:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.486+0000 7f3b12fed640 1 -- 172.21.15.79:0/3210953407 wait complete. 2024-06-10T00:20:17.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-10T00:20:17.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.602+0000 7f358d6fc640 1 Processor -- start 2024-06-10T00:20:17.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.602+0000 7f358d6fc640 1 -- start start 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f358d6fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3588162080 0x7f35880d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f358d6fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f358815f410 0x7f358806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f358d6fc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35880d1970 con 0x7f3588162460 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f358d6fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f35880cec40 con 0x7f358815f410 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f358d6fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35880cee70 con 0x7f3588162080 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f3586ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3588162080 0x7f35880d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f35877fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f358815f410 0x7f358806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f357ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3588162460 0x7f358806bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:36758/0 (socket says 172.21.15.79:36758) 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f357ffff640 1 -- 172.21.15.79:0/743364310 learned_addr learned my addr 172.21.15.79:0/743364310 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f35877fe640 1 -- 172.21.15.79:0/743364310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3588162080 msgr2=0x7f35880d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:17.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f35877fe640 1 --2- 172.21.15.79:0/743364310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3588162080 0x7f35880d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f35877fe640 1 -- 172.21.15.79:0/743364310 >> v1:172.21.15.117:6789/0 conn(0x7f3588162460 legacy=0x7f358806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f35877fe640 1 -- 172.21.15.79:0/743364310 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35880cf150 con 0x7f358815f410 2024-06-10T00:20:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f35867fc640 1 -- 172.21.15.79:0/743364310 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201427572 0 0) 0x7f35880d1970 con 0x7f3588162460 2024-06-10T00:20:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.603+0000 7f3586ffd640 1 --2- 172.21.15.79:0/743364310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3588162080 0x7f35880d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:20:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.604+0000 7f35877fe640 1 --2- 172.21.15.79:0/743364310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358815f410 0x7f358806c650 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3580009d90 tx=0x7f358002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e43daff28ae1afda server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.604+0000 7f35867fc640 1 -- 172.21.15.79:0/743364310 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580007740 con 0x7f358815f410 2024-06-10T00:20:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.604+0000 7f35867fc640 1 -- 172.21.15.79:0/743364310 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35800078e0 con 0x7f358815f410 2024-06-10T00:20:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.604+0000 7f35867fc640 1 -- 172.21.15.79:0/743364310 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580007cb0 con 0x7f358815f410 2024-06-10T00:20:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.605+0000 7f358d6fc640 1 -- 172.21.15.79:0/743364310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358815f410 msgr2=0x7f358806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.605+0000 7f358d6fc640 1 --2- 172.21.15.79:0/743364310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358815f410 0x7f358806c650 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3580009d90 tx=0x7f358002a660 comp rx=0 tx=0).stop 2024-06-10T00:20:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.605+0000 7f358d6fc640 1 -- 172.21.15.79:0/743364310 shutdown_connections 2024-06-10T00:20:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.605+0000 7f358d6fc640 1 --2- 172.21.15.79:0/743364310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358815f410 0x7f358806c650 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.605+0000 7f358d6fc640 1 --2- 172.21.15.79:0/743364310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3588162080 0x7f35880d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.605+0000 7f358d6fc640 1 -- 172.21.15.79:0/743364310 >> 172.21.15.79:0/743364310 conn(0x7f35880d4030 msgr2=0x7f35880d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.605+0000 7f358d6fc640 1 -- 172.21.15.79:0/743364310 shutdown_connections 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.605+0000 7f358d6fc640 1 -- 172.21.15.79:0/743364310 wait complete. 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.606+0000 7f358d6fc640 1 Processor -- start 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.606+0000 7f358d6fc640 1 -- start start 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f358d6fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f358815f410 0x7f35880b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f358d6fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3588162080 0x7f35880c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f358d6fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3588162460 0x7f35881528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f358d6fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35880cf9f0 con 0x7f3588162460 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f358d6fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35880cf710 con 0x7f3588162080 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f358d6fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35880cff10 con 0x7f358815f410 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3588162460 0x7f35881528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3588162460 0x7f35881528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32956/0 (socket says 172.21.15.79:32956) 2024-06-10T00:20:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 -- 172.21.15.79:0/3075640326 learned_addr learned my addr 172.21.15.79:0/3075640326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f357ffff640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3588162080 0x7f35880c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f3586ffd640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f358815f410 0x7f35880b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 -- 172.21.15.79:0/3075640326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f358815f410 msgr2=0x7f35880b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f358815f410 0x7f35880b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 -- 172.21.15.79:0/3075640326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3588162080 msgr2=0x7f35880c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3588162080 0x7f35880c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 -- 172.21.15.79:0/3075640326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35880c8130 con 0x7f3588162460 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.607+0000 7f35877fe640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3588162460 0x7f35881528e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3580009d90 tx=0x7f3580004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.608+0000 7f357f7fe640 1 -- 172.21.15.79:0/3075640326 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358003f070 con 0x7f3588162460 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.608+0000 7f357f7fe640 1 -- 172.21.15.79:0/3075640326 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3580031c40 con 0x7f3588162460 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.608+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35880c8410 con 0x7f3588162460 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.608+0000 7f357f7fe640 1 -- 172.21.15.79:0/3075640326 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580009450 con 0x7f3588162460 2024-06-10T00:20:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.608+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35880c89d0 con 0x7f3588162460 2024-06-10T00:20:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.609+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35880b6110 con 0x7f3588162460 2024-06-10T00:20:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.609+0000 7f357f7fe640 1 -- 172.21.15.79:0/3075640326 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3580003990 con 0x7f3588162460 2024-06-10T00:20:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.610+0000 7f357f7fe640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f356806be60 0x7f356806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.610+0000 7f3586ffd640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f356806be60 0x7f356806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.610+0000 7f357f7fe640 1 -- 172.21.15.79:0/3075640326 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f35800aba80 con 0x7f3588162460 2024-06-10T00:20:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.610+0000 7f3586ffd640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f356806be60 0x7f356806e320 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3578009560 tx=0x7f3578009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.614+0000 7f357f7fe640 1 -- 172.21.15.79:0/3075640326 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f35880b6110 con 0x7f3588162460 2024-06-10T00:20:17.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.797+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f35880683c0 con 0x7f3588162460 2024-06-10T00:20:17.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.800+0000 7f357f7fe640 1 -- 172.21.15.79:0/3075640326 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f3580079e70 con 0x7f3588162460 2024-06-10T00:20:17.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f356806be60 msgr2=0x7f356806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f356806be60 0x7f356806e320 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3578009560 tx=0x7f3578009190 comp rx=0 tx=0).stop 2024-06-10T00:20:17.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3588162460 msgr2=0x7f35881528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3588162460 0x7f35881528e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3580009d90 tx=0x7f3580004a40 comp rx=0 tx=0).stop 2024-06-10T00:20:17.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 shutdown_connections 2024-06-10T00:20:17.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f356806be60 0x7f356806e320 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3588162460 0x7f35881528e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3588162080 0x7f35880c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 --2- 172.21.15.79:0/3075640326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f358815f410 0x7f35880b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 >> 172.21.15.79:0/3075640326 conn(0x7f35880d4030 msgr2=0x7f358806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:17.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 shutdown_connections 2024-06-10T00:20:17.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.802+0000 7f358d6fc640 1 -- 172.21.15.79:0/3075640326 wait complete. 2024-06-10T00:20:17.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-06-10T00:20:17.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.913+0000 7f50d619e640 1 Processor -- start 2024-06-10T00:20:17.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.913+0000 7f50d619e640 1 -- start start 2024-06-10T00:20:17.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50d619e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50d00cc6d0 0x7f50d00ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50d619e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d00b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50d619e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d0072580 con 0x7f50d0071c60 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50d619e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f50d00ccff0 con 0x7f50d00cc6d0 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50d619e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50d0072820 con 0x7f50d0072110 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50cf7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50d00cc6d0 0x7f50d00ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50cf7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50d00cc6d0 0x7f50d00ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32964/0 (socket says 172.21.15.79:32964) 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50cf7fe640 1 -- 172.21.15.79:0/3304905886 learned_addr learned my addr 172.21.15.79:0/3304905886 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50cffff640 1 --2- 172.21.15.79:0/3304905886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d00b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50cf7fe640 1 -- 172.21.15.79:0/3304905886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 msgr2=0x7f50d00b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50cf7fe640 1 --2- 172.21.15.79:0/3304905886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d00b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50cf7fe640 1 -- 172.21.15.79:0/3304905886 >> v1:172.21.15.117:6789/0 conn(0x7f50d0071c60 legacy=0x7f50d00b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.914+0000 7f50cf7fe640 1 -- 172.21.15.79:0/3304905886 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d0072b00 con 0x7f50d00cc6d0 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.915+0000 7f50cf7fe640 1 --2- 172.21.15.79:0/3304905886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d00cc6d0 0x7f50d00ccab0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009870 tx=0x7f50c002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5290925358ac61ed server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.915+0000 7f50ce7fc640 1 -- 172.21.15.79:0/3304905886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0037070 con 0x7f50d00cc6d0 2024-06-10T00:20:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.915+0000 7f50ce7fc640 1 -- 172.21.15.79:0/3304905886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c0032440 con 0x7f50d00cc6d0 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.915+0000 7f50ce7fc640 1 -- 172.21.15.79:0/3304905886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0032810 con 0x7f50d00cc6d0 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.916+0000 7f50d619e640 1 -- 172.21.15.79:0/3304905886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d00cc6d0 msgr2=0x7f50d00ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.916+0000 7f50d619e640 1 --2- 172.21.15.79:0/3304905886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d00cc6d0 0x7f50d00ccab0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009870 tx=0x7f50c002a210 comp rx=0 tx=0).stop 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.916+0000 7f50d619e640 1 -- 172.21.15.79:0/3304905886 shutdown_connections 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.916+0000 7f50d619e640 1 --2- 172.21.15.79:0/3304905886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d00b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.916+0000 7f50d619e640 1 --2- 172.21.15.79:0/3304905886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d00cc6d0 0x7f50d00ccab0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.916+0000 7f50d619e640 1 -- 172.21.15.79:0/3304905886 >> 172.21.15.79:0/3304905886 conn(0x7f50d00b19f0 msgr2=0x7f50d00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.916+0000 7f50d619e640 1 -- 172.21.15.79:0/3304905886 shutdown_connections 2024-06-10T00:20:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.916+0000 7f50d619e640 1 -- 172.21.15.79:0/3304905886 wait complete. 2024-06-10T00:20:17.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.917+0000 7f50d619e640 1 Processor -- start 2024-06-10T00:20:17.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.917+0000 7f50d619e640 1 -- start start 2024-06-10T00:20:17.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50d619e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d0071c60 0x7f50d015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50d619e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d01f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50d619e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d00cc6d0 0x7f50d01f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50d619e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f50d015c890 con 0x7f50d0071c60 2024-06-10T00:20:17.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50d619e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00b31a0 con 0x7f50d00cc6d0 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50d619e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50d0159f60 con 0x7f50d0072110 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d0071c60 0x7f50d015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d0071c60 0x7f50d015bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32968/0 (socket says 172.21.15.79:32968) 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 -- 172.21.15.79:0/1606377664 learned_addr learned my addr 172.21.15.79:0/1606377664 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50ceffd640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d01f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cffff640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d00cc6d0 0x7f50d01f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 -- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 msgr2=0x7f50d01f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d01f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 -- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d00cc6d0 msgr2=0x7f50d01f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d00cc6d0 0x7f50d01f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 -- 172.21.15.79:0/1606377664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d009add0 con 0x7f50d0071c60 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cffff640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d00cc6d0 0x7f50d01f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:17.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50ceffd640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d01f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50cf7fe640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d0071c60 0x7f50d015bf50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f50c00097c0 tx=0x7f50c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.918+0000 7f50b7fff640 1 -- 172.21.15.79:0/1606377664 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0041020 con 0x7f50d0071c60 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.919+0000 7f50b7fff640 1 -- 172.21.15.79:0/1606377664 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c0030970 con 0x7f50d0071c60 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.919+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d009d190 con 0x7f50d0071c60 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.919+0000 7f50b7fff640 1 -- 172.21.15.79:0/1606377664 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0037040 con 0x7f50d0071c60 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.919+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d009d750 con 0x7f50d0071c60 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.920+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d0068430 con 0x7f50d0071c60 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.920+0000 7f50b7fff640 1 -- 172.21.15.79:0/1606377664 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50c0044020 con 0x7f50d0071c60 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.920+0000 7f50b7fff640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f50bc06be30 0x7f50bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.921+0000 7f50ceffd640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f50bc06be30 0x7f50bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.921+0000 7f50b7fff640 1 -- 172.21.15.79:0/1606377664 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f50c00ab6c0 con 0x7f50d0071c60 2024-06-10T00:20:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.921+0000 7f50ceffd640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f50bc06be30 0x7f50bc06e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f50d01533c0 tx=0x7f50c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:17.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:17.925+0000 7f50b7fff640 1 -- 172.21.15.79:0/1606377664 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f50c004b030 con 0x7f50d0071c60 2024-06-10T00:20:18.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.167+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f50d00af9e0 con 0x7f50d0071c60 2024-06-10T00:20:18.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.483+0000 7f50b7fff640 1 -- 172.21.15.79:0/1606377664 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v269) ==== 166+0+0 (secure 0 0 0) 0x7f50c007a190 con 0x7f50d0071c60 2024-06-10T00:20:18.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f50bc06be30 msgr2=0x7f50bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f50bc06be30 0x7f50bc06e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f50d01533c0 tx=0x7f50c4008040 comp rx=0 tx=0).stop 2024-06-10T00:20:18.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d0071c60 msgr2=0x7f50d015bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d0071c60 0x7f50d015bf50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f50c00097c0 tx=0x7f50c00046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 shutdown_connections 2024-06-10T00:20:18.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f50bc06be30 0x7f50bc06e2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d00cc6d0 0x7f50d01f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d0072110 0x7f50d01f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 --2- 172.21.15.79:0/1606377664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d0071c60 0x7f50d015bf50 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 >> 172.21.15.79:0/1606377664 conn(0x7f50d00b19f0 msgr2=0x7f50d00b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:18.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 shutdown_connections 2024-06-10T00:20:18.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.485+0000 7f50d619e640 1 -- 172.21.15.79:0/1606377664 wait complete. 2024-06-10T00:20:18.496 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-06-10T00:20:18.496 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-06-10T00:20:18.497 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-06-10T00:20:18.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:20:18.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.597+0000 7f16965f9640 1 Processor -- start 2024-06-10T00:20:18.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.598+0000 7f16965f9640 1 -- start start 2024-06-10T00:20:18.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.598+0000 7f16965f9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16900d2680 0x7f169015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.598+0000 7f16965f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16900cef70 0x7f16900cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.598+0000 7f16965f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16900d0ad0 con 0x7f16900d1fc0 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.598+0000 7f16965f9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f16900d13e0 con 0x7f16900d2680 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.598+0000 7f16965f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f169015f890 con 0x7f16900cef70 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f16900d1fc0 0x7f16900d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51730/0 (socket says 172.21.15.79:51730) 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168f7fe640 1 -- 172.21.15.79:0/3803005769 learned_addr learned my addr 172.21.15.79:0/3803005769 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168ffff640 1 --2- 172.21.15.79:0/3803005769 >> v2:172.21.15.117:3300/0 conn(0x7f16900d2680 0x7f169015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14451197 0 0) 0x7f16900d0ad0 con 0x7f16900d1fc0 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f1694b96640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16900cef70 0x7f16900cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1678003520 con 0x7f16900d1fc0 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2759085312 0 0) 0x7f1678003520 con 0x7f16900d1fc0 2024-06-10T00:20:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16900cef70 msgr2=0x7f16900cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16900cef70 0x7f16900cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 >> v2:172.21.15.117:3300/0 conn(0x7f16900d2680 msgr2=0x7f169015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 --2- 172.21.15.79:0/3803005769 >> v2:172.21.15.117:3300/0 conn(0x7f16900d2680 0x7f169015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16900d0d90 con 0x7f16900d1fc0 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f1684001670 con 0x7f16900d1fc0 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 >> v1:172.21.15.79:6789/0 conn(0x7f16900d1fc0 legacy=0x7f16900d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16780039b0 0x7f1678003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1678004800 0x7f1678004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16900cef70 0x7f16780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16900d13e0 con 0x7f16780039b0 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f169015f890 con 0x7f1678004800 2024-06-10T00:20:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f167800b9c0 con 0x7f16900cef70 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168ffff640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16780039b0 0x7f1678003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168f7fe640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1678004800 0x7f1678004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f1694b96640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16900cef70 0x7f16780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168ffff640 1 -- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16900cef70 msgr2=0x7f16780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168ffff640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16900cef70 0x7f16780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168ffff640 1 -- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1678004800 msgr2=0x7f1678004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168ffff640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1678004800 0x7f1678004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168ffff640 1 -- 172.21.15.79:0/3803005769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1678003520 con 0x7f16780039b0 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.599+0000 7f168f7fe640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1678004800 0x7f1678004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.600+0000 7f168ffff640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16780039b0 0x7f1678003dd0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1680009ac0 tx=0x7f1678005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75af25caa52c137 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.600+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680036070 con 0x7f16780039b0 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.600+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1680031400 con 0x7f16780039b0 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.600+0000 7f168effd640 1 -- 172.21.15.79:0/3803005769 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680009690 con 0x7f16780039b0 2024-06-10T00:20:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.601+0000 7f16965f9640 1 -- 172.21.15.79:0/3803005769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16780039b0 msgr2=0x7f1678003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.601+0000 7f16965f9640 1 --2- 172.21.15.79:0/3803005769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16780039b0 0x7f1678003dd0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1680009ac0 tx=0x7f1678005830 comp rx=0 tx=0).stop 2024-06-10T00:20:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.601+0000 7f1694b96640 1 -- 172.21.15.79:0/3803005769 reap_dead start 2024-06-10T00:20:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.601+0000 7f16965f9640 1 -- 172.21.15.79:0/3803005769 shutdown_connections 2024-06-10T00:20:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.601+0000 7f16965f9640 1 -- 172.21.15.79:0/3803005769 >> 172.21.15.79:0/3803005769 conn(0x7f169009d3f0 msgr2=0x7f16900d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.601+0000 7f16965f9640 1 -- 172.21.15.79:0/3803005769 shutdown_connections 2024-06-10T00:20:18.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.601+0000 7f16965f9640 1 -- 172.21.15.79:0/3803005769 wait complete. 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.602+0000 7f16965f9640 1 Processor -- start 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.602+0000 7f16965f9640 1 -- start start 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f16965f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16780039b0 0x7f16900ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f16965f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16900b1f20 0x7f16900b9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f16965f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16900b23a0 0x7f16900b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f16965f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16900d4f00 con 0x7f16900b23a0 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f16965f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16900d2400 con 0x7f16900b1f20 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f16965f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16900d1870 con 0x7f16780039b0 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16900b23a0 0x7f16900b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16900b23a0 0x7f16900b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35148/0 (socket says 172.21.15.79:35148) 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 -- 172.21.15.79:0/2802745229 learned_addr learned my addr 172.21.15.79:0/2802745229 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f168ffff640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16780039b0 0x7f16900ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f168f7fe640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16900b1f20 0x7f16900b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 -- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16780039b0 msgr2=0x7f16900ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16780039b0 0x7f16900ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 -- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16900b1f20 msgr2=0x7f16900b9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16900b1f20 0x7f16900b9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 -- 172.21.15.79:0/2802745229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16900b0e80 con 0x7f16900b23a0 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f168ffff640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16780039b0 0x7f16900ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.603+0000 7f1694b96640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16900b23a0 0x7f16900b6ce0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f16900d3d10 tx=0x7f16880115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.604+0000 7f168cff9640 1 -- 172.21.15.79:0/2802745229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688011de0 con 0x7f16900b23a0 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.604+0000 7f168cff9640 1 -- 172.21.15.79:0/2802745229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168801b070 con 0x7f16900b23a0 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.604+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16900b1160 con 0x7f16900b23a0 2024-06-10T00:20:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.604+0000 7f168cff9640 1 -- 172.21.15.79:0/2802745229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688003990 con 0x7f16900b23a0 2024-06-10T00:20:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.604+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16900b1720 con 0x7f16900b23a0 2024-06-10T00:20:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.605+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16900b3250 con 0x7f16900b23a0 2024-06-10T00:20:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.605+0000 7f168cff9640 1 -- 172.21.15.79:0/2802745229 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1688003b30 con 0x7f16900b23a0 2024-06-10T00:20:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.606+0000 7f168cff9640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f167c06be30 0x7f167c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.606+0000 7f168cff9640 1 -- 172.21.15.79:0/2802745229 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f168808b480 con 0x7f16900b23a0 2024-06-10T00:20:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.606+0000 7f168ffff640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f167c06be30 0x7f167c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.606+0000 7f168ffff640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f167c06be30 0x7f167c06e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1680033000 tx=0x7f1680008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.610+0000 7f168cff9640 1 -- 172.21.15.79:0/2802745229 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1688003e20 con 0x7f16900b23a0 2024-06-10T00:20:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.783+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16900d04e0 con 0x7f16900b23a0 2024-06-10T00:20:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.784+0000 7f168cff9640 1 -- 172.21.15.79:0/2802745229 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+13376 (secure 0 0 0) 0x7f168805ee20 con 0x7f16900b23a0 2024-06-10T00:20:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:18.784 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:20:17.481440+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6835/2491534848":"2024-06-11T00:20:14.472771+0000","172.21.15.79:6834/2491534848":"2024-06-11T00:20:14.472771+0000","172.21.15.79:6835/1640828017":"2024-06-11T00:18:53.210236+0000","172.21.15.79:6834/1640828017":"2024-06-11T00:18:53.210236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f167c06be30 msgr2=0x7f167c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f167c06be30 0x7f167c06e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1680033000 tx=0x7f1680008030 comp rx=0 tx=0).stop 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16900b23a0 msgr2=0x7f16900b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16900b23a0 0x7f16900b6ce0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f16900d3d10 tx=0x7f16880115a0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 shutdown_connections 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f167c06be30 0x7f167c06e2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16900b23a0 0x7f16900b6ce0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16900b1f20 0x7f16900b9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 --2- 172.21.15.79:0/2802745229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16780039b0 0x7f16900ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 >> 172.21.15.79:0/2802745229 conn(0x7f169009d3f0 msgr2=0x7f1690158650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 shutdown_connections 2024-06-10T00:20:18.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.786+0000 7f16965f9640 1 -- 172.21.15.79:0/2802745229 wait complete. 2024-06-10T00:20:18.797 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-10T00:14:31.177808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-10T00:20:18.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-10T00:20:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.899+0000 7fe370322640 1 Processor -- start 2024-06-10T00:20:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.899+0000 7fe370322640 1 -- start start 2024-06-10T00:20:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe370322640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe368155320 0x7fe3680b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe370322640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 0x7fe3680d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe370322640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3680d0560 0x7fe36806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe370322640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe368155700 con 0x7fe3680d0560 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe370322640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe36815b6b0 con 0x7fe368155320 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe370322640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe36815b990 con 0x7fe3680b34e0 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e8bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3680d0560 0x7fe36806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e8bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3680d0560 0x7fe36806e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35164/0 (socket says 172.21.15.79:35164) 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e8bf640 1 -- 172.21.15.79:0/2501245700 learned_addr learned my addr 172.21.15.79:0/2501245700 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36d8bd640 1 --2- 172.21.15.79:0/2501245700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 0x7fe3680d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e0be640 1 --2- 172.21.15.79:0/2501245700 >> v2:172.21.15.117:3300/0 conn(0x7fe368155320 0x7fe3680b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e8bf640 1 -- 172.21.15.79:0/2501245700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 msgr2=0x7fe3680d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e8bf640 1 --2- 172.21.15.79:0/2501245700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 0x7fe3680d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e8bf640 1 -- 172.21.15.79:0/2501245700 >> v2:172.21.15.117:3300/0 conn(0x7fe368155320 msgr2=0x7fe3680b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e8bf640 1 --2- 172.21.15.79:0/2501245700 >> v2:172.21.15.117:3300/0 conn(0x7fe368155320 0x7fe3680b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.900+0000 7fe36e8bf640 1 -- 172.21.15.79:0/2501245700 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36815bc70 con 0x7fe3680d0560 2024-06-10T00:20:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.901+0000 7fe36e8bf640 1 --2- 172.21.15.79:0/2501245700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe36806e1f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe3680d0c60 tx=0x7fe36002c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b167e9f7788669 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.901+0000 7fe36d0bc640 1 -- 172.21.15.79:0/2501245700 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36000b2e0 con 0x7fe3680d0560 2024-06-10T00:20:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.901+0000 7fe36d0bc640 1 -- 172.21.15.79:0/2501245700 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe360009600 con 0x7fe3680d0560 2024-06-10T00:20:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.901+0000 7fe36d0bc640 1 -- 172.21.15.79:0/2501245700 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36000b480 con 0x7fe3680d0560 2024-06-10T00:20:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 -- 172.21.15.79:0/2501245700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 msgr2=0x7fe36806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 --2- 172.21.15.79:0/2501245700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe36806e1f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe3680d0c60 tx=0x7fe36002c8a0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 -- 172.21.15.79:0/2501245700 shutdown_connections 2024-06-10T00:20:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 --2- 172.21.15.79:0/2501245700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe36806e1f0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 --2- 172.21.15.79:0/2501245700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 0x7fe3680d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 --2- 172.21.15.79:0/2501245700 >> v2:172.21.15.117:3300/0 conn(0x7fe368155320 0x7fe3680b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 -- 172.21.15.79:0/2501245700 >> 172.21.15.79:0/2501245700 conn(0x7fe3680b1d10 msgr2=0x7fe3680b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 -- 172.21.15.79:0/2501245700 shutdown_connections 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.902+0000 7fe370322640 1 -- 172.21.15.79:0/2501245700 wait complete. 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.903+0000 7fe370322640 1 Processor -- start 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.903+0000 7fe370322640 1 -- start start 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe370322640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 0x7fe368152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe370322640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe368155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe370322640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe368155320 0x7fe3681ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe370322640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe36815b470 con 0x7fe3680d0560 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe370322640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe36815b2f0 con 0x7fe368155320 2024-06-10T00:20:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe370322640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe36806e730 con 0x7fe3680b34e0 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe368155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe368155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35174/0 (socket says 172.21.15.79:35174) 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 -- 172.21.15.79:0/1033773288 learned_addr learned my addr 172.21.15.79:0/1033773288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 -- 172.21.15.79:0/1033773288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 msgr2=0x7fe368152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 0x7fe368152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 -- 172.21.15.79:0/1033773288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe368155320 msgr2=0x7fe3681ef5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe368155320 0x7fe3681ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 -- 172.21.15.79:0/1033773288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3681f0120 con 0x7fe3680d0560 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe36d8bd640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe368155880 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00d800 tx=0x7fe35c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe35affd640 1 -- 172.21.15.79:0/1033773288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c018020 con 0x7fe3680d0560 2024-06-10T00:20:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe35affd640 1 -- 172.21.15.79:0/1033773288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35c0096a0 con 0x7fe3680d0560 2024-06-10T00:20:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3681f0400 con 0x7fe3680d0560 2024-06-10T00:20:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe35affd640 1 -- 172.21.15.79:0/1033773288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c009a70 con 0x7fe3680d0560 2024-06-10T00:20:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.904+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36809acf0 con 0x7fe3680d0560 2024-06-10T00:20:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.905+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3680683c0 con 0x7fe3680d0560 2024-06-10T00:20:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.906+0000 7fe35affd640 1 -- 172.21.15.79:0/1033773288 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe35c01b020 con 0x7fe3680d0560 2024-06-10T00:20:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.906+0000 7fe35affd640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe34c06be30 0x7fe34c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.906+0000 7fe35affd640 1 -- 172.21.15.79:0/1033773288 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7fe35c08afa0 con 0x7fe3680d0560 2024-06-10T00:20:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.906+0000 7fe36e0be640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe34c06be30 0x7fe34c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.907+0000 7fe36e0be640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe34c06be30 0x7fe34c06e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe364006fd0 tx=0x7fe364008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:18.911+0000 7fe35affd640 1 -- 172.21.15.79:0/1033773288 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe35c022030 con 0x7fe3680d0560 2024-06-10T00:20:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.085+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe3680cc0c0 con 0x7fe3680d0560 2024-06-10T00:20:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.086+0000 7fe35affd640 1 -- 172.21.15.79:0/1033773288 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7fe35c059b00 con 0x7fe3680d0560 2024-06-10T00:20:19.086 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe34c06be30 msgr2=0x7fe34c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe34c06be30 0x7fe34c06e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe364006fd0 tx=0x7fe364008040 comp rx=0 tx=0).stop 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 msgr2=0x7fe368155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe368155880 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00d800 tx=0x7fe35c00dcc0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 shutdown_connections 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe34c06be30 0x7fe34c06e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe368155320 0x7fe3681ef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3680d0560 0x7fe368155880 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 --2- 172.21.15.79:0/1033773288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3680b34e0 0x7fe368152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 >> 172.21.15.79:0/1033773288 conn(0x7fe3680b1d10 msgr2=0x7fe3680aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 shutdown_connections 2024-06-10T00:20:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.088+0000 7fe370322640 1 -- 172.21.15.79:0/1033773288 wait complete. 2024-06-10T00:20:19.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-06-10T00:20:19.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.199+0000 7f7fc2f1d640 1 Processor -- start 2024-06-10T00:20:19.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.199+0000 7f7fc2f1d640 1 -- start start 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.199+0000 7f7fc2f1d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7fbc0d2680 0x7f7fbc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.199+0000 7f7fc2f1d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc0d1fc0 0x7f7fbc0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.199+0000 7f7fc2f1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fbc0d2fa0 con 0x7f7fbc161fa0 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fc2f1d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7fbc0cff80 con 0x7f7fbc0d2680 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fc2f1d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc0d13e0 con 0x7f7fbc0d1fc0 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fc14ba640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7fbc161fa0 0x7f7fbc162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51734/0 (socket says 172.21.15.79:51734) 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fc14ba640 1 -- 172.21.15.79:0/2389140035 learned_addr learned my addr 172.21.15.79:0/2389140035 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957659000 0 0) 0x7f7fbc0d2fa0 con 0x7f7fbc161fa0 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fac003520 con 0x7f7fbc161fa0 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fc0cb9640 1 --2- 172.21.15.79:0/2389140035 >> v2:172.21.15.117:3300/0 conn(0x7f7fbc0d2680 0x7f7fbc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbbfff640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc0d1fc0 0x7f7fbc0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2820058588 0 0) 0x7f7fac003520 con 0x7f7fbc161fa0 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc0d1fc0 msgr2=0x7f7fbc0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc0d1fc0 0x7f7fbc0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 >> v2:172.21.15.117:3300/0 conn(0x7f7fbc0d2680 msgr2=0x7f7fbc15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 --2- 172.21.15.79:0/2389140035 >> v2:172.21.15.117:3300/0 conn(0x7f7fbc0d2680 0x7f7fbc15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc0d0ad0 con 0x7f7fbc161fa0 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f7fb40019f0 con 0x7f7fbc161fa0 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 >> v1:172.21.15.79:6789/0 conn(0x7f7fbc161fa0 legacy=0x7f7fbc162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc0d1fc0 0x7f7fac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fac003f80 0x7f7fac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac004d40 0x7f7fac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0cff80 con 0x7f7fac003f80 2024-06-10T00:20:19.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0d13e0 con 0x7f7fac004d40 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac00b9c0 con 0x7f7fbc0d1fc0 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fbbfff640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fac003f80 0x7f7fac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fc0cb9640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc0d1fc0 0x7f7fac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.200+0000 7f7fc14ba640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac004d40 0x7f7fac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbbfff640 1 -- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc0d1fc0 msgr2=0x7f7fac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbbfff640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc0d1fc0 0x7f7fac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbbfff640 1 -- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac004d40 msgr2=0x7f7fac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbbfff640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac004d40 0x7f7fac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbbfff640 1 -- 172.21.15.79:0/2389140035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac003520 con 0x7f7fac003f80 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbbfff640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fac003f80 0x7f7fac004800 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009af0 tx=0x7f7fac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943b6ac340d14a9b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8036070 con 0x7f7fac003f80 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa8031400 con 0x7f7fac003f80 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.201+0000 7f7fbb7fe640 1 -- 172.21.15.79:0/2389140035 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8009690 con 0x7f7fac003f80 2024-06-10T00:20:19.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.202+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/2389140035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fac003f80 msgr2=0x7f7fac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.202+0000 7f7fc2f1d640 1 --2- 172.21.15.79:0/2389140035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fac003f80 0x7f7fac004800 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009af0 tx=0x7f7fac005830 comp rx=0 tx=0).stop 2024-06-10T00:20:19.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.202+0000 7f7fc14ba640 1 -- 172.21.15.79:0/2389140035 reap_dead start 2024-06-10T00:20:19.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.202+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/2389140035 shutdown_connections 2024-06-10T00:20:19.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.202+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/2389140035 >> 172.21.15.79:0/2389140035 conn(0x7f7fbc09d3f0 msgr2=0x7f7fbc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:19.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.202+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/2389140035 shutdown_connections 2024-06-10T00:20:19.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.202+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/2389140035 wait complete. 2024-06-10T00:20:19.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.203+0000 7f7fc2f1d640 1 Processor -- start 2024-06-10T00:20:19.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.203+0000 7f7fc2f1d640 1 -- start start 2024-06-10T00:20:19.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc2f1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac003f80 0x7f7fbc0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc2f1d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc1528d0 0x7f7fbc0b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc2f1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fbc0b8ff0 0x7f7fbc0b9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc2f1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0d1070 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc2f1d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0d0d90 con 0x7f7fac003f80 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc2f1d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc0d2400 con 0x7f7fbc1528d0 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc14ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fbc0b8ff0 0x7f7fbc0b9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc14ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fbc0b8ff0 0x7f7fbc0b9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35186/0 (socket says 172.21.15.79:35186) 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.204+0000 7f7fc14ba640 1 -- 172.21.15.79:0/810296420 learned_addr learned my addr 172.21.15.79:0/810296420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc0cb9640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac003f80 0x7f7fbc0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fbbfff640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc1528d0 0x7f7fbc0b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc14ba640 1 -- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc1528d0 msgr2=0x7f7fbc0b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc14ba640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc1528d0 0x7f7fbc0b7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc14ba640 1 -- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac003f80 msgr2=0x7f7fbc0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc14ba640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac003f80 0x7f7fbc0c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc14ba640 1 -- 172.21.15.79:0/810296420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc0b83f0 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc0cb9640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac003f80 0x7f7fbc0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:19.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc14ba640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fbc0b8ff0 0x7f7fbc0b9470 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0d3d10 tx=0x7f7fb400a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fb97fa640 1 -- 172.21.15.79:0/810296420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400aca0 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fb97fa640 1 -- 172.21.15.79:0/810296420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb4019070 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fb97fa640 1 -- 172.21.15.79:0/810296420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40135f0 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fbc0ca100 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.205+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fbc0ca6c0 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.206+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fbc15fb70 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.206+0000 7f7fb97fa640 1 -- 172.21.15.79:0/810296420 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fb4013790 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.207+0000 7f7fb97fa640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fa006be30 0x7f7fa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.207+0000 7f7fb97fa640 1 -- 172.21.15.79:0/810296420 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f7fb408b450 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.207+0000 7f7fc0cb9640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fa006be30 0x7f7fa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.207+0000 7f7fc0cb9640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fa006be30 0x7f7fa006e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009b30 tx=0x7f7fb0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:19.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.211+0000 7f7fb97fa640 1 -- 172.21.15.79:0/810296420 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7fbc15fb70 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.453+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7f7fbc068430 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.487+0000 7f7fb97fa640 1 -- 172.21.15.79:0/810296420 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v270) ==== 170+0+0 (secure 0 0 0) 0x7f7fb4059f20 con 0x7f7fbc0b8ff0 2024-06-10T00:20:19.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.489+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fa006be30 msgr2=0x7f7fa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.489+0000 7f7fc2f1d640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fa006be30 0x7f7fa006e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009b30 tx=0x7f7fb0008040 comp rx=0 tx=0).stop 2024-06-10T00:20:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.489+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fbc0b8ff0 msgr2=0x7f7fbc0b9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.489+0000 7f7fc2f1d640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fbc0b8ff0 0x7f7fbc0b9470 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0d3d10 tx=0x7f7fb400a6a0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.490+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 shutdown_connections 2024-06-10T00:20:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.490+0000 7f7fc2f1d640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fa006be30 0x7f7fa006e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.490+0000 7f7fc2f1d640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fbc0b8ff0 0x7f7fbc0b9470 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.490+0000 7f7fc2f1d640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fbc1528d0 0x7f7fbc0b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.490+0000 7f7fc2f1d640 1 --2- 172.21.15.79:0/810296420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac003f80 0x7f7fbc0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.490+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 >> 172.21.15.79:0/810296420 conn(0x7f7fbc09d3f0 msgr2=0x7f7fbc161160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.490+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 shutdown_connections 2024-06-10T00:20:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.490+0000 7f7fc2f1d640 1 -- 172.21.15.79:0/810296420 wait complete. 2024-06-10T00:20:19.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-10T00:20:19.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.609+0000 7f7ffcd89640 1 Processor -- start 2024-06-10T00:20:19.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.609+0000 7f7ffcd89640 1 -- start start 2024-06-10T00:20:19.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ffcd89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff8155320 0x7f7ff80b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ffcd89640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff8155700 con 0x7f7ff80b34e0 2024-06-10T00:20:19.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ffcd89640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff815b6b0 con 0x7f7ff80d0730 2024-06-10T00:20:19.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ffcd89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff815b990 con 0x7f7ff8155320 2024-06-10T00:20:19.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7fedd9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7ff80b34e0 0x7f7ff80d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51746/0 (socket says 172.21.15.79:51746) 2024-06-10T00:20:19.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7fedd9b640 1 -- 172.21.15.79:0/3870282910 learned_addr learned my addr 172.21.15.79:0/3870282910 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:19.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997927468 0 0) 0x7f7ff8155700 con 0x7f7ff80b34e0 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe4003520 con 0x7f7ff80b34e0 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff659c640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff8155320 0x7f7ff80b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3026812087 0 0) 0x7f7fe4003520 con 0x7f7ff80b34e0 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff8155320 msgr2=0x7f7ff80b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff8155320 0x7f7ff80b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 >> v1:172.21.15.117:6789/0 conn(0x7f7ff80d0730 legacy=0x7f7ff806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff815bc70 con 0x7f7ff80b34e0 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f7fe0001670 con 0x7f7ff80b34e0 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 >> v1:172.21.15.79:6789/0 conn(0x7f7ff80b34e0 legacy=0x7f7ff80d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe40039e0 0x7f7fe4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff8155320 0x7f7fe4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7fe40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff815b990 con 0x7f7fe4004d40 2024-06-10T00:20:19.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe400bb50 con 0x7f7fe40039e0 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.610+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe400bd20 con 0x7f7ff8155320 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7ff6d9d640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7fe40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7ff659c640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe40039e0 0x7f7fe4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7fedd9b640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff8155320 0x7f7fe4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7ff6d9d640 1 -- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff8155320 msgr2=0x7f7fe4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7ff6d9d640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff8155320 0x7f7fe4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7ff6d9d640 1 -- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe40039e0 msgr2=0x7f7fe4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7ff6d9d640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe40039e0 0x7f7fe4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7ff6d9d640 1 -- 172.21.15.79:0/3870282910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe4003520 con 0x7f7fe4004d40 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.611+0000 7f7ff6d9d640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7fe40051c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0001e50 tx=0x7f7fe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3338be52d9a92f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0001a70 con 0x7f7fe4004d40 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff0003b70 con 0x7f7fe4004d40 2024-06-10T00:20:19.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ff5d9b640 1 -- 172.21.15.79:0/3870282910 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00050d0 con 0x7f7fe4004d40 2024-06-10T00:20:19.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ffcd89640 1 -- 172.21.15.79:0/3870282910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 msgr2=0x7f7fe40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ffcd89640 1 --2- 172.21.15.79:0/3870282910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7fe40051c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0001e50 tx=0x7f7fe4005830 comp rx=0 tx=0).stop 2024-06-10T00:20:19.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ff6d9d640 1 -- 172.21.15.79:0/3870282910 reap_dead start 2024-06-10T00:20:19.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ffcd89640 1 -- 172.21.15.79:0/3870282910 shutdown_connections 2024-06-10T00:20:19.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ffcd89640 1 -- 172.21.15.79:0/3870282910 >> 172.21.15.79:0/3870282910 conn(0x7f7ff80b1d10 msgr2=0x7f7ff80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:19.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ffcd89640 1 -- 172.21.15.79:0/3870282910 shutdown_connections 2024-06-10T00:20:19.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.612+0000 7f7ffcd89640 1 -- 172.21.15.79:0/3870282910 wait complete. 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ffcd89640 1 Processor -- start 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ffcd89640 1 -- start start 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ffcd89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7ff8157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ffcd89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff80b1280 0x7f7ff814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ffcd89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff81561e0 0x7f7ff81535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ffcd89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff815b470 con 0x7f7fe4004d40 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ffcd89640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff815b2f0 con 0x7f7ff80b1280 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ffcd89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff80b2fa0 con 0x7f7ff81561e0 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ff659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7ff8157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ff659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7ff8157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35192/0 (socket says 172.21.15.79:35192) 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.614+0000 7f7ff659c640 1 -- 172.21.15.79:0/944796951 learned_addr learned my addr 172.21.15.79:0/944796951 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ff6d9d640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff81561e0 0x7f7ff81535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7fedd9b640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff80b1280 0x7f7ff814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ff659c640 1 -- 172.21.15.79:0/944796951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff81561e0 msgr2=0x7f7ff81535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ff659c640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff81561e0 0x7f7ff81535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ff659c640 1 -- 172.21.15.79:0/944796951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff80b1280 msgr2=0x7f7ff814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ff659c640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff80b1280 0x7f7ff814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ff659c640 1 -- 172.21.15.79:0/944796951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff8155a20 con 0x7f7fe4004d40 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ff659c640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7ff8157520 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800b820 tx=0x7f7fe800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7fef7fe640 1 -- 172.21.15.79:0/944796951 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8018070 con 0x7f7fe4004d40 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7fef7fe640 1 -- 172.21.15.79:0/944796951 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe800be10 con 0x7f7fe4004d40 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff80b16e0 con 0x7f7fe4004d40 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7fef7fe640 1 -- 172.21.15.79:0/944796951 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8010c60 con 0x7f7fe4004d40 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.615+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff8157e90 con 0x7f7fe4004d40 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.616+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff80683c0 con 0x7f7fe4004d40 2024-06-10T00:20:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.617+0000 7f7fef7fe640 1 -- 172.21.15.79:0/944796951 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fe801b070 con 0x7f7fe4004d40 2024-06-10T00:20:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.617+0000 7f7fef7fe640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd806be30 0x7f7fd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.617+0000 7f7fef7fe640 1 -- 172.21.15.79:0/944796951 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f7fe808b0c0 con 0x7f7fe4004d40 2024-06-10T00:20:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.617+0000 7f7fedd9b640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd806be30 0x7f7fd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.618+0000 7f7fedd9b640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd806be30 0x7f7fd806e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0007cf0 tx=0x7f7fe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:19.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.621+0000 7f7fef7fe640 1 -- 172.21.15.79:0/944796951 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7fe8059c20 con 0x7f7fe4004d40 2024-06-10T00:20:19.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.794+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7ff80ad830 con 0x7f7fe4004d40 2024-06-10T00:20:19.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.797+0000 7f7fef7fe640 1 -- 172.21.15.79:0/944796951 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f7fe8059520 con 0x7f7fe4004d40 2024-06-10T00:20:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd806be30 msgr2=0x7f7fd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd806be30 0x7f7fd806e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0007cf0 tx=0x7f7fe0009040 comp rx=0 tx=0).stop 2024-06-10T00:20:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 msgr2=0x7f7ff8157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7ff8157520 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800b820 tx=0x7f7fe800bce0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 shutdown_connections 2024-06-10T00:20:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7fd806be30 0x7f7fd806e2f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ff81561e0 0x7f7ff81535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ff80b1280 0x7f7ff814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 --2- 172.21.15.79:0/944796951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe4004d40 0x7f7ff8157520 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 >> 172.21.15.79:0/944796951 conn(0x7f7ff80b1d10 msgr2=0x7f7ff80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 shutdown_connections 2024-06-10T00:20:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:19.799+0000 7f7ffcd89640 1 -- 172.21.15.79:0/944796951 wait complete. 2024-06-10T00:20:19.810 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:20:19.810 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:20:19.845 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:20:19.889 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:20:19.890 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:20:19.890 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:19.905 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:20:19.906 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:20:19.906 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:19.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:20:19.948 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:20:19.948 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:19.966 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:20:19.967 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:20:19.967 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:20.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:20:20.009 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-10T00:20:20.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:20.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.109+0000 7f921411d640 1 Processor -- start 2024-06-10T00:20:20.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.110+0000 7f921411d640 1 -- start start 2024-06-10T00:20:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f921411d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f920c0cd230 0x7f920c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f921411d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c0b3420 con 0x7f920c0cec50 2024-06-10T00:20:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f921411d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c0cc750 con 0x7f920c1553c0 2024-06-10T00:20:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f921411d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f920c0cca30 con 0x7f920c0cd230 2024-06-10T00:20:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f92116b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f920c0cd230 0x7f920c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f92116b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f920c0cd230 0x7f920c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35208/0 (socket says 172.21.15.79:35208) 2024-06-10T00:20:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f92116b8640 1 -- 172.21.15.79:0/2555724063 learned_addr learned my addr 172.21.15.79:0/2555724063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f92116b8640 1 -- 172.21.15.79:0/2555724063 >> v1:172.21.15.117:6789/0 conn(0x7f920c1553c0 legacy=0x7f920c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f92116b8640 1 -- 172.21.15.79:0/2555724063 >> v1:172.21.15.79:6789/0 conn(0x7f920c0cec50 legacy=0x7f920c071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.111+0000 7f92116b8640 1 -- 172.21.15.79:0/2555724063 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c0ccd10 con 0x7f920c0cd230 2024-06-10T00:20:20.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f92116b8640 1 --2- 172.21.15.79:0/2555724063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cd230 0x7f920c0b2cf0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f9208009870 tx=0x7f920802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4403edecabe4183a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:20.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f9210eb7640 1 -- 172.21.15.79:0/2555724063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208037070 con 0x7f920c0cd230 2024-06-10T00:20:20.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f9210eb7640 1 -- 172.21.15.79:0/2555724063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920802ae50 con 0x7f920c0cd230 2024-06-10T00:20:20.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f9210eb7640 1 -- 172.21.15.79:0/2555724063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208032860 con 0x7f920c0cd230 2024-06-10T00:20:20.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f921411d640 1 -- 172.21.15.79:0/2555724063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cd230 msgr2=0x7f920c0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f921411d640 1 --2- 172.21.15.79:0/2555724063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cd230 0x7f920c0b2cf0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f9208009870 tx=0x7f920802a300 comp rx=0 tx=0).stop 2024-06-10T00:20:20.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f921411d640 1 -- 172.21.15.79:0/2555724063 shutdown_connections 2024-06-10T00:20:20.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f921411d640 1 --2- 172.21.15.79:0/2555724063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cd230 0x7f920c0b2cf0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f921411d640 1 -- 172.21.15.79:0/2555724063 >> 172.21.15.79:0/2555724063 conn(0x7f920c0b19f0 msgr2=0x7f920c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:20.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f921411d640 1 -- 172.21.15.79:0/2555724063 shutdown_connections 2024-06-10T00:20:20.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.112+0000 7f921411d640 1 -- 172.21.15.79:0/2555724063 wait complete. 2024-06-10T00:20:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f921411d640 1 Processor -- start 2024-06-10T00:20:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f921411d640 1 -- start start 2024-06-10T00:20:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f921411d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f920c0cd230 0x7f920c14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f921411d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cec50 0x7f920c15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f921411d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f920c1553c0 0x7f920c15e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f921411d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f920c155920 con 0x7f920c0cec50 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f921411d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1557a0 con 0x7f920c0cd230 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f921411d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0cf0e0 con 0x7f920c1553c0 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f92116b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cec50 0x7f920c15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f92116b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cec50 0x7f920c15e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35218/0 (socket says 172.21.15.79:35218) 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.114+0000 7f92116b8640 1 -- 172.21.15.79:0/372746049 learned_addr learned my addr 172.21.15.79:0/372746049 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f92126ba640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f920c1553c0 0x7f920c15e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f9211eb9640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f920c0cd230 0x7f920c14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f92116b8640 1 -- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f920c1553c0 msgr2=0x7f920c15e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f92116b8640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f920c1553c0 0x7f920c15e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f92116b8640 1 -- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f920c0cd230 msgr2=0x7f920c14fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f92116b8640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f920c0cd230 0x7f920c14fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f92116b8640 1 -- 172.21.15.79:0/372746049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c06e560 con 0x7f920c0cec50 2024-06-10T00:20:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f9211eb9640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f920c0cd230 0x7f920c14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f92116b8640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cec50 0x7f920c15e080 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f920802a340 tx=0x7f92080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f91fe7fc640 1 -- 172.21.15.79:0/372746049 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208041020 con 0x7f920c0cec50 2024-06-10T00:20:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f91fe7fc640 1 -- 172.21.15.79:0/372746049 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920803c890 con 0x7f920c0cec50 2024-06-10T00:20:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f91fe7fc640 1 -- 172.21.15.79:0/372746049 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208037040 con 0x7f920c0cec50 2024-06-10T00:20:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c06e800 con 0x7f920c0cec50 2024-06-10T00:20:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.115+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c1511d0 con 0x7f920c0cec50 2024-06-10T00:20:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.116+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920c068430 con 0x7f920c0cec50 2024-06-10T00:20:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.117+0000 7f91fe7fc640 1 -- 172.21.15.79:0/372746049 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9208044020 con 0x7f920c0cec50 2024-06-10T00:20:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.117+0000 7f91fe7fc640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.117+0000 7f91fe7fc640 1 -- 172.21.15.79:0/372746049 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f92080ab350 con 0x7f920c0cec50 2024-06-10T00:20:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.117+0000 7f9211eb9640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.117+0000 7f9211eb9640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f91f006be30 0x7f91f006e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f920c0b1340 tx=0x7f9200009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:20.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.121+0000 7f91fe7fc640 1 -- 172.21.15.79:0/372746049 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f920804b070 con 0x7f920c0cec50 2024-06-10T00:20:20.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.330+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f920c15f930 con 0x7f920c0cec50 2024-06-10T00:20:20.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.331+0000 7f91fe7fc640 1 -- 172.21.15.79:0/372746049 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+3869 (secure 0 0 0) 0x7f9208079eb0 con 0x7f920c0cec50 2024-06-10T00:20:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:20.331 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/982473900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":982473900},{"type":"v1","addr":"172.21.15.79:6837","nonce":982473900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/794060883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":794060883},{"type":"v1","addr":"172.21.15.117:6834","nonce":794060883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1269622174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1269622174},{"type":"v1","addr":"172.21.15.117:6835","nonce":1269622174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6810,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1901103589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1901103589},{"type":"v1","addr":"172.21.15.79:6835","nonce":1901103589}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[]} 2024-06-10T00:20:20.331 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 46 2024-06-10T00:20:20.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f91f006be30 msgr2=0x7f91f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f91f006be30 0x7f91f006e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f920c0b1340 tx=0x7f9200009040 comp rx=0 tx=0).stop 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cec50 msgr2=0x7f920c15e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cec50 0x7f920c15e080 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f920802a340 tx=0x7f92080046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 shutdown_connections 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f920c1553c0 0x7f920c15e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c0cec50 0x7f920c15e080 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 --2- 172.21.15.79:0/372746049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f920c0cd230 0x7f920c14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 >> 172.21.15.79:0/372746049 conn(0x7f920c0b19f0 msgr2=0x7f920c072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 shutdown_connections 2024-06-10T00:20:20.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.333+0000 7f921411d640 1 -- 172.21.15.79:0/372746049 wait complete. 2024-06-10T00:20:20.343 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-10T00:20:20.344 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-10T00:20:20.344 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-10T00:20:20.344 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:20:20.344 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-10T00:20:20.344 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-10T00:20:20.344 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-10T00:20:20.344 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:20:20.345 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-10T00:20:20.345 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-10T00:20:20.345 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-10T00:20:20.345 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:20:20.345 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-10T00:20:20.345 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-10T00:20:20.346 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-10T00:20:20.346 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:20:20.355 INFO:tasks.ceph.mds.a:Stopped 2024-06-10T00:20:20.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-10T00:20:20.356 INFO:tasks.ceph.mds.c:Stopped 2024-06-10T00:20:20.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-10T00:20:20.357 INFO:tasks.ceph.mds.d:Stopped 2024-06-10T00:20:20.357 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-10T00:20:20.358 INFO:tasks.ceph.mds.b:Stopped 2024-06-10T00:20:20.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-10T00:20:20.399 INFO:tasks.ceph.mds.a:Started 2024-06-10T00:20:20.400 DEBUG:teuthology.parallel:result is None 2024-06-10T00:20:20.400 INFO:tasks.ceph.mds.c:Started 2024-06-10T00:20:20.400 DEBUG:teuthology.parallel:result is None 2024-06-10T00:20:20.401 INFO:tasks.ceph.mds.d:Started 2024-06-10T00:20:20.401 DEBUG:teuthology.parallel:result is None 2024-06-10T00:20:20.402 INFO:tasks.ceph.mds.b:Started 2024-06-10T00:20:20.402 DEBUG:teuthology.parallel:result is None 2024-06-10T00:20:20.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-10T00:20:20.474 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:20:20.474 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:20:20.484 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:20:20.484 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:20:20.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.511+0000 7f361de9a640 1 Processor -- start 2024-06-10T00:20:20.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.511+0000 7f361de9a640 1 -- start start 2024-06-10T00:20:20.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.511+0000 7f361de9a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36180d2680 0x7f361815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.511+0000 7f361de9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36180d0ad0 con 0x7f36180d1fc0 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.512+0000 7f361de9a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f361815f890 con 0x7f36180cef70 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.512+0000 7f361de9a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f36180d13e0 con 0x7f36180d2680 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.512+0000 7f36177fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36180d2680 0x7f361815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.512+0000 7f36177fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36180d2680 0x7f361815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35262/0 (socket says 172.21.15.79:35262) 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.512+0000 7f36177fe640 1 -- 172.21.15.79:0/4181517368 learned_addr learned my addr 172.21.15.79:0/4181517368 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.512+0000 7f36177fe640 1 -- 172.21.15.79:0/4181517368 >> v1:172.21.15.117:6789/0 conn(0x7f36180cef70 legacy=0x7f36180cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.512+0000 7f36177fe640 1 -- 172.21.15.79:0/4181517368 >> v1:172.21.15.79:6789/0 conn(0x7f36180d1fc0 legacy=0x7f36180d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.512+0000 7f36177fe640 1 -- 172.21.15.79:0/4181517368 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36180d0d90 con 0x7f36180d2680 2024-06-10T00:20:20.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f36177fe640 1 --2- 172.21.15.79:0/4181517368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2680 0x7f361815f1a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f36180d1560 tx=0x7f360802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d67efd5cfc687bc server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f36167fc640 1 -- 172.21.15.79:0/4181517368 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608037070 con 0x7f36180d2680 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f36167fc640 1 -- 172.21.15.79:0/4181517368 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3608032640 con 0x7f36180d2680 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f36167fc640 1 -- 172.21.15.79:0/4181517368 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608032a10 con 0x7f36180d2680 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f361de9a640 1 -- 172.21.15.79:0/4181517368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2680 msgr2=0x7f361815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f361de9a640 1 --2- 172.21.15.79:0/4181517368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2680 0x7f361815f1a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f36180d1560 tx=0x7f360802a2e0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f361de9a640 1 -- 172.21.15.79:0/4181517368 shutdown_connections 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f361de9a640 1 --2- 172.21.15.79:0/4181517368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d2680 0x7f361815f1a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f361de9a640 1 -- 172.21.15.79:0/4181517368 >> 172.21.15.79:0/4181517368 conn(0x7f361809d3f0 msgr2=0x7f36180d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f361de9a640 1 -- 172.21.15.79:0/4181517368 shutdown_connections 2024-06-10T00:20:20.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.513+0000 7f361de9a640 1 -- 172.21.15.79:0/4181517368 wait complete. 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.514+0000 7f361de9a640 1 Processor -- start 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f361de9a640 1 -- start start 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f361de9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36180cef70 0x7f36181f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f361de9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d1fc0 0x7f36181f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f361de9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36180d2680 0x7f361809efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f361de9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36180d4f00 con 0x7f36180d1fc0 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f361de9a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f36180d2400 con 0x7f36180cef70 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f361de9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f36180d1870 con 0x7f36180d2680 2024-06-10T00:20:20.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f3616ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d1fc0 0x7f36181f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f3616ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d1fc0 0x7f36181f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35270/0 (socket says 172.21.15.79:35270) 2024-06-10T00:20:20.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.515+0000 7f3616ffd640 1 -- 172.21.15.79:0/47421104 learned_addr learned my addr 172.21.15.79:0/47421104 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:20.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f36177fe640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36180cef70 0x7f36181f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f3617fff640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36180d2680 0x7f361809efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f3616ffd640 1 -- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36180d2680 msgr2=0x7f361809efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f3616ffd640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36180d2680 0x7f361809efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f3616ffd640 1 -- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36180cef70 msgr2=0x7f36181f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:20.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f3616ffd640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36180cef70 0x7f36181f7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f3616ffd640 1 -- 172.21.15.79:0/47421104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36181f7d40 con 0x7f36180d1fc0 2024-06-10T00:20:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f36177fe640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36180cef70 0x7f36181f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f3616ffd640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d1fc0 0x7f36181f49d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f360000c400 tx=0x7f360000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f360ffff640 1 -- 172.21.15.79:0/47421104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600017070 con 0x7f36180d1fc0 2024-06-10T00:20:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f360ffff640 1 -- 172.21.15.79:0/47421104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36000052f0 con 0x7f36180d1fc0 2024-06-10T00:20:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f360ffff640 1 -- 172.21.15.79:0/47421104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600003830 con 0x7f36180d1fc0 2024-06-10T00:20:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36180cb2c0 con 0x7f36180d1fc0 2024-06-10T00:20:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.516+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36180cb880 con 0x7f36180d1fc0 2024-06-10T00:20:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.517+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3618068430 con 0x7f36180d1fc0 2024-06-10T00:20:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.518+0000 7f360ffff640 1 -- 172.21.15.79:0/47421104 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f360001a070 con 0x7f36180d1fc0 2024-06-10T00:20:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.518+0000 7f360ffff640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35f806be30 0x7f35f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.518+0000 7f360ffff640 1 -- 172.21.15.79:0/47421104 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5421+0+0 (secure 0 0 0) 0x7f360008a050 con 0x7f36180d1fc0 2024-06-10T00:20:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.518+0000 7f36177fe640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35f806be30 0x7f35f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:20.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.519+0000 7f36177fe640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35f806be30 0x7f35f806e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3608034000 tx=0x7f360802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:20.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.522+0000 7f360ffff640 1 -- 172.21.15.79:0/47421104 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3600058bb0 con 0x7f36180d1fc0 2024-06-10T00:20:20.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-06-10T00:20:20.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:20.708+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f36180d04e0 con 0x7f36180d1fc0 2024-06-10T00:20:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.503+0000 7f360ffff640 1 -- 172.21.15.79:0/47421104 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v84) ==== 97+0+0 (secure 0 0 0) 0x7f36000584b0 con 0x7f36180d1fc0 2024-06-10T00:20:21.503 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-06-10T00:20:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35f806be30 msgr2=0x7f35f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35f806be30 0x7f35f806e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3608034000 tx=0x7f360802e000 comp rx=0 tx=0).stop 2024-06-10T00:20:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d1fc0 msgr2=0x7f36181f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d1fc0 0x7f36181f49d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f360000c400 tx=0x7f360000c8c0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 shutdown_connections 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f35f806be30 0x7f35f806e2f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36180d2680 0x7f361809efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36180d1fc0 0x7f36181f49d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 --2- 172.21.15.79:0/47421104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36180cef70 0x7f36181f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 >> 172.21.15.79:0/47421104 conn(0x7f361809d3f0 msgr2=0x7f36180c9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 shutdown_connections 2024-06-10T00:20:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.506+0000 7f361de9a640 1 -- 172.21.15.79:0/47421104 wait complete. 2024-06-10T00:20:21.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-10T00:20:21.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.619+0000 7f388bb70640 1 Processor -- start 2024-06-10T00:20:21.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.619+0000 7f388bb70640 1 -- start start 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388bb70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38840ae910 0x7f388406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388bb70640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38840cf360 0x7f38840acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388bb70640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388406d130 con 0x7f388406ea20 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388bb70640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f388406ee90 con 0x7f38840cf360 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388bb70640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f388406d410 con 0x7f38840ae910 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388a10d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38840cf360 0x7f38840acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388a10d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38840cf360 0x7f38840acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35274/0 (socket says 172.21.15.79:35274) 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388a10d640 1 -- 172.21.15.79:0/1586084657 learned_addr learned my addr 172.21.15.79:0/1586084657 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388a10d640 1 -- 172.21.15.79:0/1586084657 >> v2:172.21.15.117:3300/0 conn(0x7f38840ae910 msgr2=0x7f388406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388a10d640 1 --2- 172.21.15.79:0/1586084657 >> v2:172.21.15.117:3300/0 conn(0x7f38840ae910 0x7f388406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388a10d640 1 -- 172.21.15.79:0/1586084657 >> v1:172.21.15.117:6789/0 conn(0x7f388406ea20 legacy=0x7f38840cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:21.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.620+0000 7f388a10d640 1 -- 172.21.15.79:0/1586084657 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388406d6f0 con 0x7f38840cf360 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.621+0000 7f388a10d640 1 --2- 172.21.15.79:0/1586084657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840cf360 0x7f38840acd40 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f38840750b0 tx=0x7f387c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea281ba035be9e92 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.621+0000 7f388890a640 1 -- 172.21.15.79:0/1586084657 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c036070 con 0x7f38840cf360 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.621+0000 7f388890a640 1 -- 172.21.15.79:0/1586084657 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c031600 con 0x7f38840cf360 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.621+0000 7f388890a640 1 -- 172.21.15.79:0/1586084657 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c0319d0 con 0x7f38840cf360 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.621+0000 7f388bb70640 1 -- 172.21.15.79:0/1586084657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840cf360 msgr2=0x7f38840acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.621+0000 7f388bb70640 1 --2- 172.21.15.79:0/1586084657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840cf360 0x7f38840acd40 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f38840750b0 tx=0x7f387c02a660 comp rx=0 tx=0).stop 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.622+0000 7f388bb70640 1 -- 172.21.15.79:0/1586084657 shutdown_connections 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.622+0000 7f388bb70640 1 --2- 172.21.15.79:0/1586084657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840cf360 0x7f38840acd40 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.622+0000 7f388bb70640 1 --2- 172.21.15.79:0/1586084657 >> v2:172.21.15.117:3300/0 conn(0x7f38840ae910 0x7f388406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.622+0000 7f388bb70640 1 -- 172.21.15.79:0/1586084657 >> 172.21.15.79:0/1586084657 conn(0x7f38840b19f0 msgr2=0x7f38840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.622+0000 7f388bb70640 1 -- 172.21.15.79:0/1586084657 shutdown_connections 2024-06-10T00:20:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.622+0000 7f388bb70640 1 -- 172.21.15.79:0/1586084657 wait complete. 2024-06-10T00:20:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.623+0000 7f388bb70640 1 Processor -- start 2024-06-10T00:20:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.623+0000 7f388bb70640 1 -- start start 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.623+0000 7f388bb70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f388406ea20 0x7f388414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.623+0000 7f388bb70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840ae910 0x7f38841e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.623+0000 7f388bb70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38840cf360 0x7f38841e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388bb70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38840ad280 con 0x7f38840ae910 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388bb70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38840aecf0 con 0x7f38840cf360 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388bb70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f38840ad400 con 0x7f388406ea20 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840ae910 0x7f38841e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840ae910 0x7f38841e7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35284/0 (socket says 172.21.15.79:35284) 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 -- 172.21.15.79:0/2178123517 learned_addr learned my addr 172.21.15.79:0/2178123517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 -- 172.21.15.79:0/2178123517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f388406ea20 msgr2=0x7f388414d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f388406ea20 0x7f388414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 -- 172.21.15.79:0/2178123517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38840cf360 msgr2=0x7f38841e80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38840cf360 0x7f38841e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 -- 172.21.15.79:0/2178123517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388409c750 con 0x7f38840ae910 2024-06-10T00:20:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388910b640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840ae910 0x7f38841e7b80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f387800b410 tx=0x7f387800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f38767fc640 1 -- 172.21.15.79:0/2178123517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878015020 con 0x7f38840ae910 2024-06-10T00:20:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f38767fc640 1 -- 172.21.15.79:0/2178123517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878011830 con 0x7f38840ae910 2024-06-10T00:20:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388409ca30 con 0x7f38840ae910 2024-06-10T00:20:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f38767fc640 1 -- 172.21.15.79:0/2178123517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878011c20 con 0x7f38840ae910 2024-06-10T00:20:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.624+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388414dee0 con 0x7f38840ae910 2024-06-10T00:20:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.625+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3884068430 con 0x7f38840ae910 2024-06-10T00:20:21.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.626+0000 7f38767fc640 1 -- 172.21.15.79:0/2178123517 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3878018020 con 0x7f38840ae910 2024-06-10T00:20:21.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.626+0000 7f38767fc640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f386806be30 0x7f386806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.626+0000 7f38767fc640 1 -- 172.21.15.79:0/2178123517 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5249+0+0 (secure 0 0 0) 0x7f387808ac00 con 0x7f38840ae910 2024-06-10T00:20:21.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.626+0000 7f388990c640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f386806be30 0x7f386806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:21.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.627+0000 7f388990c640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f386806be30 0x7f386806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3880009710 tx=0x7f3880006c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.631+0000 7f38767fc640 1 -- 172.21.15.79:0/2178123517 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3878091080 con 0x7f38840ae910 2024-06-10T00:20:21.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.868+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3884071560 con 0x7f38840ae910 2024-06-10T00:20:21.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.869+0000 7f38767fc640 1 -- 172.21.15.79:0/2178123517 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f387801f020 con 0x7f38840ae910 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA==", 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:20:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow==", 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ==", 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-06-10T00:20:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw==", 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw==", 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:20:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg==", 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-06-10T00:20:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg==", 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g==", 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:20:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw==", 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw==", 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ==", 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:20:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA==", 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw==", 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA==", 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:20:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A==", 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw==", 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmQYVlARAAk+Jo8bykvpKKZY5XAPe2ZA==", 2024-06-10T00:20:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA==", 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw==", 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-10T00:20:21.882 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f386806be30 msgr2=0x7f386806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f386806be30 0x7f386806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3880009710 tx=0x7f3880006c90 comp rx=0 tx=0).stop 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840ae910 msgr2=0x7f38841e7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840ae910 0x7f38841e7b80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f387800b410 tx=0x7f387800b8d0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 shutdown_connections 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f386806be30 0x7f386806e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38840cf360 0x7f38841e80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38840ae910 0x7f38841e7b80 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 --2- 172.21.15.79:0/2178123517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f388406ea20 0x7f388414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 >> 172.21.15.79:0/2178123517 conn(0x7f38840b19f0 msgr2=0x7f3884071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:21.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 shutdown_connections 2024-06-10T00:20:21.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.871+0000 7f388bb70640 1 -- 172.21.15.79:0/2178123517 wait complete. 2024-06-10T00:20:21.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-10T00:20:21.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.984+0000 7f4d14142640 1 Processor -- start 2024-06-10T00:20:21.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d14142640 1 -- start start 2024-06-10T00:20:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d14142640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d0c15f1a0 0x7f4d0c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d14142640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d0c0cef70 0x7f4d0c0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d14142640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c15f5e0 con 0x7f4d0c0d2680 2024-06-10T00:20:21.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d14142640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c0d13e0 con 0x7f4d0c0cef70 2024-06-10T00:20:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d14142640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c0d0ad0 con 0x7f4d0c15f1a0 2024-06-10T00:20:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d126df640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d0c0cef70 0x7f4d0c0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d126df640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d0c0cef70 0x7f4d0c0cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35298/0 (socket says 172.21.15.79:35298) 2024-06-10T00:20:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.985+0000 7f4d126df640 1 -- 172.21.15.79:0/2397268310 learned_addr learned my addr 172.21.15.79:0/2397268310 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.986+0000 7f4d126df640 1 -- 172.21.15.79:0/2397268310 >> v2:172.21.15.117:3300/0 conn(0x7f4d0c15f1a0 msgr2=0x7f4d0c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.986+0000 7f4d126df640 1 --2- 172.21.15.79:0/2397268310 >> v2:172.21.15.117:3300/0 conn(0x7f4d0c15f1a0 0x7f4d0c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.986+0000 7f4d126df640 1 -- 172.21.15.79:0/2397268310 >> v1:172.21.15.117:6789/0 conn(0x7f4d0c0d2680 legacy=0x7f4d0c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:21.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.986+0000 7f4d126df640 1 -- 172.21.15.79:0/2397268310 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c15f890 con 0x7f4d0c0cef70 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.986+0000 7f4d126df640 1 --2- 172.21.15.79:0/2397268310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0cef70 0x7f4d0c0cf3c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0d1560 tx=0x7f4d0402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a281309d953b59e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.986+0000 7f4d10edc640 1 -- 172.21.15.79:0/2397268310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04037070 con 0x7f4d0c0cef70 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d10edc640 1 -- 172.21.15.79:0/2397268310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d04032440 con 0x7f4d0c0cef70 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d10edc640 1 -- 172.21.15.79:0/2397268310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04032810 con 0x7f4d0c0cef70 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d14142640 1 -- 172.21.15.79:0/2397268310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0cef70 msgr2=0x7f4d0c0cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d14142640 1 --2- 172.21.15.79:0/2397268310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0cef70 0x7f4d0c0cf3c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0d1560 tx=0x7f4d0402a210 comp rx=0 tx=0).stop 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d14142640 1 -- 172.21.15.79:0/2397268310 shutdown_connections 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d14142640 1 --2- 172.21.15.79:0/2397268310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0cef70 0x7f4d0c0cf3c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d14142640 1 --2- 172.21.15.79:0/2397268310 >> v2:172.21.15.117:3300/0 conn(0x7f4d0c15f1a0 0x7f4d0c0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d14142640 1 -- 172.21.15.79:0/2397268310 >> 172.21.15.79:0/2397268310 conn(0x7f4d0c09d3f0 msgr2=0x7f4d0c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:21.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d14142640 1 -- 172.21.15.79:0/2397268310 shutdown_connections 2024-06-10T00:20:21.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.987+0000 7f4d14142640 1 -- 172.21.15.79:0/2397268310 wait complete. 2024-06-10T00:20:21.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.988+0000 7f4d14142640 1 Processor -- start 2024-06-10T00:20:21.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.988+0000 7f4d14142640 1 -- start start 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d14142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d0c0cef70 0x7f4d0c0b9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d14142640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0d2680 0x7f4d0c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d14142640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c15f1a0 0x7f4d0c06d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d14142640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0d4f00 con 0x7f4d0c0d2680 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d14142640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0d1070 con 0x7f4d0c15f1a0 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d14142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c0d1870 con 0x7f4d0c0cef70 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d116dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0d2680 0x7f4d0c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d116dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0d2680 0x7f4d0c06d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35310/0 (socket says 172.21.15.79:35310) 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d116dd640 1 -- 172.21.15.79:0/497917415 learned_addr learned my addr 172.21.15.79:0/497917415 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d11ede640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d0c0cef70 0x7f4d0c0b9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d116dd640 1 -- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d0c0cef70 msgr2=0x7f4d0c0b9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d126df640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c15f1a0 0x7f4d0c06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:21.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d116dd640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d0c0cef70 0x7f4d0c0b9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d116dd640 1 -- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c15f1a0 msgr2=0x7f4d0c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d116dd640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c15f1a0 0x7f4d0c06d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.989+0000 7f4d116dd640 1 -- 172.21.15.79:0/497917415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c0b99a0 con 0x7f4d0c0d2680 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.990+0000 7f4d126df640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c15f1a0 0x7f4d0c06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.990+0000 7f4d11ede640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d0c0cef70 0x7f4d0c0b9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.990+0000 7f4d116dd640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0d2680 0x7f4d0c06d110 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000b440 tx=0x7f4d0000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.990+0000 7f4d0a7fc640 1 -- 172.21.15.79:0/497917415 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00015020 con 0x7f4d0c0d2680 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.990+0000 7f4d0a7fc640 1 -- 172.21.15.79:0/497917415 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d00011890 con 0x7f4d0c0d2680 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.990+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c1f4e90 con 0x7f4d0c0d2680 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.990+0000 7f4d0a7fc640 1 -- 172.21.15.79:0/497917415 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00011c80 con 0x7f4d0c0d2680 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.990+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c1f5450 con 0x7f4d0c0d2680 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.991+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c068430 con 0x7f4d0c0d2680 2024-06-10T00:20:21.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.991+0000 7f4d0a7fc640 1 -- 172.21.15.79:0/497917415 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d00018020 con 0x7f4d0c0d2680 2024-06-10T00:20:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.992+0000 7f4d0a7fc640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4cf806be30 0x7f4cf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.992+0000 7f4d0a7fc640 1 -- 172.21.15.79:0/497917415 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5249+0+0 (secure 0 0 0) 0x7f4d0008ad00 con 0x7f4d0c0d2680 2024-06-10T00:20:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.992+0000 7f4d11ede640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4cf806be30 0x7f4cf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:21.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.992+0000 7f4d11ede640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4cf806be30 0x7f4cf806e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc001dc0 tx=0x7f4cfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:21.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:21.996+0000 7f4d0a7fc640 1 -- 172.21.15.79:0/497917415 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4d0001f020 con 0x7f4d0c0d2680 2024-06-10T00:20:22.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.172+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4d0c1f5770 con 0x7f4d0c0d2680 2024-06-10T00:20:22.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.172+0000 7f4d0a7fc640 1 -- 172.21.15.79:0/497917415 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) ==== 84+0+65 (secure 0 0 0) 0x7f4d0c1f5770 con 0x7f4d0c0d2680 2024-06-10T00:20:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:22.172 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:20:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:20:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-06-10T00:20:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-06-10T00:20:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:22.173 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:20:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4cf806be30 msgr2=0x7f4cf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4cf806be30 0x7f4cf806e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc001dc0 tx=0x7f4cfc009040 comp rx=0 tx=0).stop 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0d2680 msgr2=0x7f4d0c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0d2680 0x7f4d0c06d110 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000b440 tx=0x7f4d0000b900 comp rx=0 tx=0).stop 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 shutdown_connections 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4cf806be30 0x7f4cf806e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c15f1a0 0x7f4d0c06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0d2680 0x7f4d0c06d110 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 --2- 172.21.15.79:0/497917415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d0c0cef70 0x7f4d0c0b9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 >> 172.21.15.79:0/497917415 conn(0x7f4d0c09d3f0 msgr2=0x7f4d0c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 shutdown_connections 2024-06-10T00:20:22.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.175+0000 7f4d14142640 1 -- 172.21.15.79:0/497917415 wait complete. 2024-06-10T00:20:22.185 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-10T00:20:22.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-10T00:20:22.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.289+0000 7f86cee88640 1 Processor -- start 2024-06-10T00:20:22.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.289+0000 7f86cee88640 1 -- start start 2024-06-10T00:20:22.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86cee88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c8155590 0x7f86c815b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86cee88640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86c80cf370 0x7f86c80ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86cee88640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c80acd40 con 0x7f86c815b9a0 2024-06-10T00:20:22.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86cee88640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f86c815bfe0 con 0x7f86c80cf370 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86cee88640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86c815c2c0 con 0x7f86c8155590 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86ccc24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c8155590 0x7f86c815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86cd425640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86c80cf370 0x7f86c80ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86ccc24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c8155590 0x7f86c815b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:42084/0 (socket says 172.21.15.79:42084) 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86cd425640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86c80cf370 0x7f86c80ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:44518/0 (socket says 172.21.15.79:44518) 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86ccc24640 1 -- 172.21.15.79:0/1146680271 learned_addr learned my addr 172.21.15.79:0/1146680271 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.290+0000 7f86c7fff640 1 --1- 172.21.15.79:0/1146680271 >> v1:172.21.15.117:6789/0 conn(0x7f86c815b9a0 0x7f86c80cec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:35396/0 (socket says 172.21.15.79:35396) 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.291+0000 7f86ccc24640 1 -- 172.21.15.79:0/1146680271 >> v2:172.21.15.117:3300/0 conn(0x7f86c80cf370 msgr2=0x7f86c80ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.291+0000 7f86ccc24640 1 --2- 172.21.15.79:0/1146680271 >> v2:172.21.15.117:3300/0 conn(0x7f86c80cf370 0x7f86c80ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.291+0000 7f86ccc24640 1 -- 172.21.15.79:0/1146680271 >> v1:172.21.15.117:6789/0 conn(0x7f86c815b9a0 legacy=0x7f86c80cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.291+0000 7f86ccc24640 1 -- 172.21.15.79:0/1146680271 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c80ad000 con 0x7f86c8155590 2024-06-10T00:20:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.291+0000 7f86cd425640 1 --2- 172.21.15.79:0/1146680271 >> v2:172.21.15.117:3300/0 conn(0x7f86c80cf370 0x7f86c80ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:20:22.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86ccc24640 1 --2- 172.21.15.79:0/1146680271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c8155590 0x7f86c815b460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009870 tx=0x7f86b802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f7d4fb39a15b34 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86c77fe640 1 -- 172.21.15.79:0/1146680271 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8037070 con 0x7f86c8155590 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86c77fe640 1 -- 172.21.15.79:0/1146680271 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b8032440 con 0x7f86c8155590 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86c77fe640 1 -- 172.21.15.79:0/1146680271 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8032810 con 0x7f86c8155590 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86cee88640 1 -- 172.21.15.79:0/1146680271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c8155590 msgr2=0x7f86c815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86cee88640 1 --2- 172.21.15.79:0/1146680271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c8155590 0x7f86c815b460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009870 tx=0x7f86b802a270 comp rx=0 tx=0).stop 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86cee88640 1 -- 172.21.15.79:0/1146680271 shutdown_connections 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86cee88640 1 --2- 172.21.15.79:0/1146680271 >> v2:172.21.15.117:3300/0 conn(0x7f86c80cf370 0x7f86c80ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86cee88640 1 --2- 172.21.15.79:0/1146680271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c8155590 0x7f86c815b460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86cee88640 1 -- 172.21.15.79:0/1146680271 >> 172.21.15.79:0/1146680271 conn(0x7f86c80b1980 msgr2=0x7f86c80b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86cee88640 1 -- 172.21.15.79:0/1146680271 shutdown_connections 2024-06-10T00:20:22.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.292+0000 7f86cee88640 1 -- 172.21.15.79:0/1146680271 wait complete. 2024-06-10T00:20:22.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.293+0000 7f86cee88640 1 Processor -- start 2024-06-10T00:20:22.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.294+0000 7f86cee88640 1 -- start start 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.294+0000 7f86cee88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c80cf370 0x7f86c8144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.294+0000 7f86cee88640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c8155590 0x7f86c809d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.294+0000 7f86cee88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c815b9a0 0x7f86c8159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.294+0000 7f86cee88640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f86c80add40 con 0x7f86c80cf370 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.294+0000 7f86cee88640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86c80b26d0 con 0x7f86c8155590 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.294+0000 7f86cee88640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86c80adec0 con 0x7f86c815b9a0 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c80cf370 0x7f86c8144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c80cf370 0x7f86c8144620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35322/0 (socket says 172.21.15.79:35322) 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 -- 172.21.15.79:0/96998639 learned_addr learned my addr 172.21.15.79:0/96998639 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86cd425640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c815b9a0 0x7f86c8159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86c7fff640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c8155590 0x7f86c809d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 -- 172.21.15.79:0/96998639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c815b9a0 msgr2=0x7f86c8159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c815b9a0 0x7f86c8159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 -- 172.21.15.79:0/96998639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c8155590 msgr2=0x7f86c809d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c8155590 0x7f86c809d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 -- 172.21.15.79:0/96998639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c809ac60 con 0x7f86c80cf370 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86ccc24640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c80cf370 0x7f86c8144620 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f86b8000c00 tx=0x7f86b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86c57fa640 1 -- 172.21.15.79:0/96998639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8037040 con 0x7f86c80cf370 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86c57fa640 1 -- 172.21.15.79:0/96998639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b8042070 con 0x7f86c80cf370 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86c57fa640 1 -- 172.21.15.79:0/96998639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8030880 con 0x7f86c80cf370 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c809af40 con 0x7f86c80cf370 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.295+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c809b500 con 0x7f86c80cf370 2024-06-10T00:20:22.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.296+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c8068540 con 0x7f86c80cf370 2024-06-10T00:20:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.297+0000 7f86c57fa640 1 -- 172.21.15.79:0/96998639 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86b8030a20 con 0x7f86c80cf370 2024-06-10T00:20:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.297+0000 7f86c57fa640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86b406be30 0x7f86b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.297+0000 7f86c57fa640 1 -- 172.21.15.79:0/96998639 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5249+0+0 (secure 0 0 0) 0x7f86b80ab470 con 0x7f86c80cf370 2024-06-10T00:20:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.297+0000 7f86c7fff640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86b406be30 0x7f86b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.298+0000 7f86c7fff640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86b406be30 0x7f86b406e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f86c815a940 tx=0x7f86bc000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.301+0000 7f86c57fa640 1 -- 172.21.15.79:0/96998639 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f86b8079fe0 con 0x7f86c80cf370 2024-06-10T00:20:22.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.476+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f86c815b760 con 0x7f86c80cf370 2024-06-10T00:20:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.800+0000 7f86c57fa640 1 -- 172.21.15.79:0/96998639 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) ==== 138+0+0 (secure 0 0 0) 0x7f86b807ee20 con 0x7f86c80cf370 2024-06-10T00:20:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-06-10T00:20:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.802+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86b406be30 msgr2=0x7f86b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.802+0000 7f86cee88640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86b406be30 0x7f86b406e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f86c815a940 tx=0x7f86bc000ed0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.802+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c80cf370 msgr2=0x7f86c8144620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.802+0000 7f86cee88640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c80cf370 0x7f86c8144620 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f86b8000c00 tx=0x7f86b80046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.803+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 shutdown_connections 2024-06-10T00:20:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.803+0000 7f86cee88640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f86b406be30 0x7f86b406e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.803+0000 7f86cee88640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c815b9a0 0x7f86c8159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.803+0000 7f86cee88640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c8155590 0x7f86c809d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.803+0000 7f86cee88640 1 --2- 172.21.15.79:0/96998639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c80cf370 0x7f86c8144620 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.803+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 >> 172.21.15.79:0/96998639 conn(0x7f86c80b1980 msgr2=0x7f86c80b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:22.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.804+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 shutdown_connections 2024-06-10T00:20:22.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.804+0000 7f86cee88640 1 -- 172.21.15.79:0/96998639 wait complete. 2024-06-10T00:20:22.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-10T00:20:22.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.924+0000 7f75f904d640 1 Processor -- start 2024-06-10T00:20:22.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.924+0000 7f75f904d640 1 -- start start 2024-06-10T00:20:22.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f904d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75f40d06e0 0x7f75f406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f904d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f40ae960 con 0x7f75f4159a10 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f904d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f40aec00 con 0x7f75f40acd40 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f904d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f75f40aeee0 con 0x7f75f40d06e0 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f359e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75f40d06e0 0x7f75f406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f2d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f75f4159a10 0x7f75f40b4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51782/0 (socket says 172.21.15.79:51782) 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f2d9d640 1 -- 172.21.15.79:0/3578430983 learned_addr learned my addr 172.21.15.79:0/3578430983 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f359e640 1 -- 172.21.15.79:0/3578430983 >> v1:172.21.15.117:6789/0 conn(0x7f75f40acd40 legacy=0x7f75f40cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f359e640 1 -- 172.21.15.79:0/3578430983 >> v1:172.21.15.79:6789/0 conn(0x7f75f4159a10 legacy=0x7f75f40b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f359e640 1 -- 172.21.15.79:0/3578430983 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f40af1c0 con 0x7f75f40d06e0 2024-06-10T00:20:22.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.925+0000 7f75f259c640 1 -- 172.21.15.79:0/3578430983 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 387660170 0 0) 0x7f75f40ae960 con 0x7f75f4159a10 2024-06-10T00:20:22.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.926+0000 7f75f359e640 1 --2- 172.21.15.79:0/3578430983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f406cde0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009d90 tx=0x7f75ec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee6e8c177de348 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.926+0000 7f75f259c640 1 -- 172.21.15.79:0/3578430983 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec007740 con 0x7f75f40d06e0 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.926+0000 7f75f259c640 1 -- 172.21.15.79:0/3578430983 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec0078e0 con 0x7f75f40d06e0 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.926+0000 7f75f259c640 1 -- 172.21.15.79:0/3578430983 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec007cb0 con 0x7f75f40d06e0 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.927+0000 7f75f904d640 1 -- 172.21.15.79:0/3578430983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 msgr2=0x7f75f406cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.927+0000 7f75f904d640 1 --2- 172.21.15.79:0/3578430983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f406cde0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009d90 tx=0x7f75ec02a6a0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.927+0000 7f75f904d640 1 -- 172.21.15.79:0/3578430983 shutdown_connections 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.927+0000 7f75f904d640 1 --2- 172.21.15.79:0/3578430983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f406cde0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.927+0000 7f75f904d640 1 -- 172.21.15.79:0/3578430983 >> 172.21.15.79:0/3578430983 conn(0x7f75f406b7e0 msgr2=0x7f75f406bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.927+0000 7f75f904d640 1 -- 172.21.15.79:0/3578430983 shutdown_connections 2024-06-10T00:20:22.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.927+0000 7f75f904d640 1 -- 172.21.15.79:0/3578430983 wait complete. 2024-06-10T00:20:22.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.928+0000 7f75f904d640 1 Processor -- start 2024-06-10T00:20:22.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.928+0000 7f75f904d640 1 -- start start 2024-06-10T00:20:22.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f904d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40acd40 0x7f75f40b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f904d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f41f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f904d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f4159a10 0x7f75f4147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f904d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75f415c740 con 0x7f75f40d06e0 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f904d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75f4159df0 con 0x7f75f4159a10 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f904d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75f415c8c0 con 0x7f75f40acd40 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f41f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f41f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35342/0 (socket says 172.21.15.79:35342) 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 -- 172.21.15.79:0/3806885743 learned_addr learned my addr 172.21.15.79:0/3806885743 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f359e640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f4159a10 0x7f75f4147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f2d9d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40acd40 0x7f75f40b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 -- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40acd40 msgr2=0x7f75f40b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40acd40 0x7f75f40b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 -- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f4159a10 msgr2=0x7f75f4147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f4159a10 0x7f75f4147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 -- 172.21.15.79:0/3806885743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f40b20b0 con 0x7f75f40d06e0 2024-06-10T00:20:22.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f2d9d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40acd40 0x7f75f40b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:22.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75ebfff640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f41f1340 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00c430 tx=0x7f75dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:22.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75eb7fe640 1 -- 172.21.15.79:0/3806885743 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc011790 con 0x7f75f40d06e0 2024-06-10T00:20:22.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75eb7fe640 1 -- 172.21.15.79:0/3806885743 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75dc017070 con 0x7f75f40d06e0 2024-06-10T00:20:22.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f40b1dd0 con 0x7f75f40d06e0 2024-06-10T00:20:22.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75eb7fe640 1 -- 172.21.15.79:0/3806885743 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc011bb0 con 0x7f75f40d06e0 2024-06-10T00:20:22.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.929+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f40b44b0 con 0x7f75f40d06e0 2024-06-10T00:20:22.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.930+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f40683c0 con 0x7f75f40d06e0 2024-06-10T00:20:22.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.931+0000 7f75eb7fe640 1 -- 172.21.15.79:0/3806885743 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75dc01c460 con 0x7f75f40d06e0 2024-06-10T00:20:22.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.931+0000 7f75eb7fe640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f75d406be30 0x7f75d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:22.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.931+0000 7f75eb7fe640 1 -- 172.21.15.79:0/3806885743 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5619+0+0 (secure 0 0 0) 0x7f75dc08acd0 con 0x7f75f40d06e0 2024-06-10T00:20:22.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.931+0000 7f75f2d9d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f75d406be30 0x7f75d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:22.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.932+0000 7f75f2d9d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f75d406be30 0x7f75d406e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000f60 tx=0x7f75e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:22.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:22.936+0000 7f75eb7fe640 1 -- 172.21.15.79:0/3806885743 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f75dc0596d0 con 0x7f75f40d06e0 2024-06-10T00:20:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.110+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f75f406d070 con 0x7f75f40d06e0 2024-06-10T00:20:23.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.808+0000 7f75eb7fe640 1 -- 172.21.15.79:0/3806885743 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7f75dc058fd0 con 0x7f75f40d06e0 2024-06-10T00:20:23.808 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-06-10T00:20:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f75d406be30 msgr2=0x7f75d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f75d406be30 0x7f75d406e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000f60 tx=0x7f75e4009040 comp rx=0 tx=0).stop 2024-06-10T00:20:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 msgr2=0x7f75f41f1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:23.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f41f1340 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00c430 tx=0x7f75dc00c8f0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 shutdown_connections 2024-06-10T00:20:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f75d406be30 0x7f75d406e2f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f4159a10 0x7f75f4147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75f40d06e0 0x7f75f41f1340 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 --2- 172.21.15.79:0/3806885743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40acd40 0x7f75f40b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.810+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 >> 172.21.15.79:0/3806885743 conn(0x7f75f406b7e0 msgr2=0x7f75f4158010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.811+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 shutdown_connections 2024-06-10T00:20:23.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.811+0000 7f75f904d640 1 -- 172.21.15.79:0/3806885743 wait complete. 2024-06-10T00:20:23.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-10T00:20:23.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.936+0000 7f031617e640 1 Processor -- start 2024-06-10T00:20:23.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.936+0000 7f031617e640 1 -- start start 2024-06-10T00:20:23.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.936+0000 7f031617e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f03100d08f0 0x7f03100b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.936+0000 7f031617e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f03100d0cd0 0x7f03100cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.936+0000 7f031617e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03100cf5e0 con 0x7f03100cf190 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.936+0000 7f031617e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f03100d1c80 con 0x7f03100d08f0 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.936+0000 7f031617e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f03100cf8a0 con 0x7f03100d0cd0 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.937+0000 7f030f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f03100d08f0 0x7f03100b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.937+0000 7f030f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f03100d08f0 0x7f03100b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35350/0 (socket says 172.21.15.79:35350) 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.937+0000 7f030f7fe640 1 -- 172.21.15.79:0/1453389266 learned_addr learned my addr 172.21.15.79:0/1453389266 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.937+0000 7f030effd640 1 --2- 172.21.15.79:0/1453389266 >> v2:172.21.15.117:3300/0 conn(0x7f03100d0cd0 0x7f03100cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.937+0000 7f030f7fe640 1 -- 172.21.15.79:0/1453389266 >> v2:172.21.15.117:3300/0 conn(0x7f03100d0cd0 msgr2=0x7f03100cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.937+0000 7f030f7fe640 1 --2- 172.21.15.79:0/1453389266 >> v2:172.21.15.117:3300/0 conn(0x7f03100d0cd0 0x7f03100cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.937+0000 7f030f7fe640 1 -- 172.21.15.79:0/1453389266 >> v1:172.21.15.117:6789/0 conn(0x7f03100cf190 legacy=0x7f03100d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:23.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.937+0000 7f030f7fe640 1 -- 172.21.15.79:0/1453389266 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03100cfb80 con 0x7f03100d08f0 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f030f7fe640 1 --2- 172.21.15.79:0/1453389266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100b3800 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f0300009870 tx=0x7f030002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fd4a780054412e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f030e7fc640 1 -- 172.21.15.79:0/1453389266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300037070 con 0x7f03100d08f0 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f030e7fc640 1 -- 172.21.15.79:0/1453389266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0300032440 con 0x7f03100d08f0 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f030e7fc640 1 -- 172.21.15.79:0/1453389266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300032810 con 0x7f03100d08f0 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f031617e640 1 -- 172.21.15.79:0/1453389266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 msgr2=0x7f03100b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f031617e640 1 --2- 172.21.15.79:0/1453389266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100b3800 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f0300009870 tx=0x7f030002a2a0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f031617e640 1 -- 172.21.15.79:0/1453389266 shutdown_connections 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f031617e640 1 --2- 172.21.15.79:0/1453389266 >> v2:172.21.15.117:3300/0 conn(0x7f03100d0cd0 0x7f03100cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f031617e640 1 --2- 172.21.15.79:0/1453389266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100b3800 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f031617e640 1 -- 172.21.15.79:0/1453389266 >> 172.21.15.79:0/1453389266 conn(0x7f031009d3c0 msgr2=0x7f03100d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:23.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f031617e640 1 -- 172.21.15.79:0/1453389266 shutdown_connections 2024-06-10T00:20:23.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.938+0000 7f031617e640 1 -- 172.21.15.79:0/1453389266 wait complete. 2024-06-10T00:20:23.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.939+0000 7f031617e640 1 Processor -- start 2024-06-10T00:20:23.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f031617e640 1 -- start start 2024-06-10T00:20:23.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f031617e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03100cf190 0x7f03100b8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f031617e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f031617e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03100d0cd0 0x7f03100cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f031617e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f03100b50c0 con 0x7f03100d08f0 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f031617e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03100d1ed0 con 0x7f03100d0cd0 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f031617e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03100d1180 con 0x7f03100cf190 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f030effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f030effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35360/0 (socket says 172.21.15.79:35360) 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.940+0000 7f030effd640 1 -- 172.21.15.79:0/69274272 learned_addr learned my addr 172.21.15.79:0/69274272 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f030f7fe640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03100cf190 0x7f03100b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:23.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f030ffff640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03100d0cd0 0x7f03100cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f030effd640 1 -- 172.21.15.79:0/69274272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03100cf190 msgr2=0x7f03100b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f030effd640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03100cf190 0x7f03100b8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f030effd640 1 -- 172.21.15.79:0/69274272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03100d0cd0 msgr2=0x7f03100cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f030effd640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03100d0cd0 0x7f03100cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f030effd640 1 -- 172.21.15.79:0/69274272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03100ce0c0 con 0x7f03100d08f0 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f030effd640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100cd640 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0304007e40 tx=0x7f030400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f02f7fff640 1 -- 172.21.15.79:0/69274272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304014620 con 0x7f03100d08f0 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f02f7fff640 1 -- 172.21.15.79:0/69274272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0304019070 con 0x7f03100d08f0 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03100b77a0 con 0x7f03100d08f0 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f02f7fff640 1 -- 172.21.15.79:0/69274272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304014a00 con 0x7f03100d08f0 2024-06-10T00:20:23.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.941+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03100b7d60 con 0x7f03100d08f0 2024-06-10T00:20:23.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.942+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03100683c0 con 0x7f03100d08f0 2024-06-10T00:20:23.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.943+0000 7f02f7fff640 1 -- 172.21.15.79:0/69274272 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0304014ba0 con 0x7f03100d08f0 2024-06-10T00:20:23.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.943+0000 7f02f7fff640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02fc06be30 0x7f02fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.943+0000 7f02f7fff640 1 -- 172.21.15.79:0/69274272 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6001+0+0 (secure 0 0 0) 0x7f030408b6e0 con 0x7f03100d08f0 2024-06-10T00:20:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.943+0000 7f030f7fe640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02fc06be30 0x7f02fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:23.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.944+0000 7f030f7fe640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02fc06be30 0x7f02fc06e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0300034000 tx=0x7f030002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:23.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:23.948+0000 7f02f7fff640 1 -- 172.21.15.79:0/69274272 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0304059910 con 0x7f03100d08f0 2024-06-10T00:20:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.157+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f03100d1730 con 0x7f03100d08f0 2024-06-10T00:20:24.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.821+0000 7f02f7fff640 1 -- 172.21.15.79:0/69274272 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v48) ==== 174+0+0 (secure 0 0 0) 0x7f030405dc10 con 0x7f03100d08f0 2024-06-10T00:20:24.822 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 13 and data pool 14 2024-06-10T00:20:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.838+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02fc06be30 msgr2=0x7f02fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.838+0000 7f031617e640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02fc06be30 0x7f02fc06e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0300034000 tx=0x7f030002e000 comp rx=0 tx=0).stop 2024-06-10T00:20:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.838+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 msgr2=0x7f03100cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.838+0000 7f031617e640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100cd640 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0304007e40 tx=0x7f030400e4b0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.841+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 shutdown_connections 2024-06-10T00:20:24.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.841+0000 7f031617e640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f02fc06be30 0x7f02fc06e2f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.841+0000 7f031617e640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03100d0cd0 0x7f03100cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.841+0000 7f031617e640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03100d08f0 0x7f03100cd640 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.841+0000 7f031617e640 1 --2- 172.21.15.79:0/69274272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03100cf190 0x7f03100b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.841+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 >> 172.21.15.79:0/69274272 conn(0x7f031009d3c0 msgr2=0x7f031006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:24.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.842+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 shutdown_connections 2024-06-10T00:20:24.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.843+0000 7f031617e640 1 -- 172.21.15.79:0/69274272 wait complete. 2024-06-10T00:20:24.861 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:20:24.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.963+0000 7f0cb32b3640 1 Processor -- start 2024-06-10T00:20:24.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.963+0000 7f0cb32b3640 1 -- start start 2024-06-10T00:20:24.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb32b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0cac156830 0x7f0cac071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:24.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb32b3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cac0725f0 con 0x7f0cac072130 2024-06-10T00:20:24.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb32b3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cac0728d0 con 0x7f0cac15c7f0 2024-06-10T00:20:24.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb32b3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0cac0b3090 con 0x7f0cac156830 2024-06-10T00:20:24.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb104f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0cac156830 0x7f0cac071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:24.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb084e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0cac072130 0x7f0cac0cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51796/0 (socket says 172.21.15.79:51796) 2024-06-10T00:20:24.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb084e640 1 -- 172.21.15.79:0/1139027558 learned_addr learned my addr 172.21.15.79:0/1139027558 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:24.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb104f640 1 -- 172.21.15.79:0/1139027558 >> v1:172.21.15.117:6789/0 conn(0x7f0cac15c7f0 legacy=0x7f0cac165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:24.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.964+0000 7f0cb104f640 1 -- 172.21.15.79:0/1139027558 >> v1:172.21.15.79:6789/0 conn(0x7f0cac072130 legacy=0x7f0cac0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.965+0000 7f0cb104f640 1 -- 172.21.15.79:0/1139027558 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac072bb0 con 0x7f0cac156830 2024-06-10T00:20:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.965+0000 7f0ca3fff640 1 -- 172.21.15.79:0/1139027558 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2713339816 0 0) 0x7f0cac0725f0 con 0x7f0cac072130 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.965+0000 7f0cb104f640 1 --2- 172.21.15.79:0/1139027558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac071bf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80097a0 tx=0x7f0ca802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292e1445fbb25bc6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.965+0000 7f0ca3fff640 1 -- 172.21.15.79:0/1139027558 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8037070 con 0x7f0cac156830 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.965+0000 7f0ca3fff640 1 -- 172.21.15.79:0/1139027558 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8032440 con 0x7f0cac156830 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.965+0000 7f0ca3fff640 1 -- 172.21.15.79:0/1139027558 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8032810 con 0x7f0cac156830 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.966+0000 7f0cb32b3640 1 -- 172.21.15.79:0/1139027558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 msgr2=0x7f0cac071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.966+0000 7f0cb32b3640 1 --2- 172.21.15.79:0/1139027558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac071bf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80097a0 tx=0x7f0ca802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.966+0000 7f0cb32b3640 1 -- 172.21.15.79:0/1139027558 shutdown_connections 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.966+0000 7f0cb32b3640 1 --2- 172.21.15.79:0/1139027558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac071bf0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.966+0000 7f0cb32b3640 1 -- 172.21.15.79:0/1139027558 >> 172.21.15.79:0/1139027558 conn(0x7f0cac0b19f0 msgr2=0x7f0cac0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.966+0000 7f0cb32b3640 1 -- 172.21.15.79:0/1139027558 shutdown_connections 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.966+0000 7f0cb32b3640 1 -- 172.21.15.79:0/1139027558 wait complete. 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.967+0000 7f0cb32b3640 1 Processor -- start 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.967+0000 7f0cb32b3640 1 -- start start 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb32b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cac072130 0x7f0cac06e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb32b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb32b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cac15c7f0 0x7f0cac151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb32b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac0ccf00 con 0x7f0cac156830 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb32b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac0ccd80 con 0x7f0cac072130 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb32b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0cac0cd080 con 0x7f0cac15c7f0 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac13fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35376/0 (socket says 172.21.15.79:35376) 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 -- 172.21.15.79:0/3093238150 learned_addr learned my addr 172.21.15.79:0/3093238150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb104f640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cac072130 0x7f0cac06e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 -- 172.21.15.79:0/3093238150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cac15c7f0 msgr2=0x7f0cac151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cac15c7f0 0x7f0cac151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 -- 172.21.15.79:0/3093238150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cac072130 msgr2=0x7f0cac06e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cac072130 0x7f0cac06e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 -- 172.21.15.79:0/3093238150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac06e990 con 0x7f0cac156830 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.968+0000 7f0cb084e640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac13fec0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c4d0 tx=0x7f0c9c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.969+0000 7f0ca1ffb640 1 -- 172.21.15.79:0/3093238150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c018070 con 0x7f0cac156830 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.969+0000 7f0ca1ffb640 1 -- 172.21.15.79:0/3093238150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9c007500 con 0x7f0cac156830 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.969+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac142ca0 con 0x7f0cac156830 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.969+0000 7f0ca1ffb640 1 -- 172.21.15.79:0/3093238150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c004a20 con 0x7f0cac156830 2024-06-10T00:20:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.969+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac143260 con 0x7f0cac156830 2024-06-10T00:20:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.970+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac0cf350 con 0x7f0cac156830 2024-06-10T00:20:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.970+0000 7f0ca1ffb640 1 -- 172.21.15.79:0/3093238150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c9c01b070 con 0x7f0cac156830 2024-06-10T00:20:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.971+0000 7f0ca1ffb640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0c9006be30 0x7f0c9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.971+0000 7f0ca1ffb640 1 -- 172.21.15.79:0/3093238150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f0c9c08a3d0 con 0x7f0cac156830 2024-06-10T00:20:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.971+0000 7f0cb104f640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0c9006be30 0x7f0c9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.971+0000 7f0cb104f640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0c9006be30 0x7f0c9006e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8034000 tx=0x7f0ca802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:24.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:24.975+0000 7f0ca1ffb640 1 -- 172.21.15.79:0/3093238150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0c9c058b60 con 0x7f0cac156830 2024-06-10T00:20:25.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.149+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cac143600 con 0x7f0cac156830 2024-06-10T00:20:25.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.150+0000 7f0ca1ffb640 1 -- 172.21.15.79:0/3093238150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16850 (secure 0 0 0) 0x7f0c9c058460 con 0x7f0cac156830 2024-06-10T00:20:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:25.150 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":87,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:20:24.158841+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:20:22.495363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-06-10T00:20:23.129127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:20:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0c9006be30 msgr2=0x7f0c9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0c9006be30 0x7f0c9006e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8034000 tx=0x7f0ca802e000 comp rx=0 tx=0).stop 2024-06-10T00:20:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 msgr2=0x7f0cac13fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac13fec0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c4d0 tx=0x7f0c9c00c990 comp rx=0 tx=0).stop 2024-06-10T00:20:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 shutdown_connections 2024-06-10T00:20:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0c9006be30 0x7f0c9006e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cac15c7f0 0x7f0cac151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cac156830 0x7f0cac13fec0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 --2- 172.21.15.79:0/3093238150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cac072130 0x7f0cac06e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 >> 172.21.15.79:0/3093238150 conn(0x7f0cac0b19f0 msgr2=0x7f0cac1514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 shutdown_connections 2024-06-10T00:20:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.152+0000 7f0cb32b3640 1 -- 172.21.15.79:0/3093238150 wait complete. 2024-06-10T00:20:25.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:20:25.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.263+0000 7f0f7ef32640 1 Processor -- start 2024-06-10T00:20:25.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.263+0000 7f0f7ef32640 1 -- start start 2024-06-10T00:20:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f7ef32640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0f780add50 0x7f0f78165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f7ef32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7806d130 con 0x7f0f7806ebf0 2024-06-10T00:20:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f7ef32640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7806d410 con 0x7f0f780ae910 2024-06-10T00:20:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f7ef32640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7806d6f0 con 0x7f0f780add50 2024-06-10T00:20:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f7d4cf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0f780add50 0x7f0f78165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f77fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0f7806ebf0 0x7f0f780cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51812/0 (socket says 172.21.15.79:51812) 2024-06-10T00:20:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f77fff640 1 -- 172.21.15.79:0/2827373320 learned_addr learned my addr 172.21.15.79:0/2827373320 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f7d4cf640 1 -- 172.21.15.79:0/2827373320 >> v1:172.21.15.117:6789/0 conn(0x7f0f780ae910 legacy=0x7f0f7806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f7d4cf640 1 -- 172.21.15.79:0/2827373320 >> v1:172.21.15.79:6789/0 conn(0x7f0f7806ebf0 legacy=0x7f0f780cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f7d4cf640 1 -- 172.21.15.79:0/2827373320 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7806d9d0 con 0x7f0f780add50 2024-06-10T00:20:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.264+0000 7f0f777fe640 1 -- 172.21.15.79:0/2827373320 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234774810 0 0) 0x7f0f7806d130 con 0x7f0f7806ebf0 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.265+0000 7f0f7d4cf640 1 --2- 172.21.15.79:0/2827373320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78165c30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009d90 tx=0x7f0f7002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5b4f8a181cb07a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.265+0000 7f0f777fe640 1 -- 172.21.15.79:0/2827373320 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70007740 con 0x7f0f780add50 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.265+0000 7f0f777fe640 1 -- 172.21.15.79:0/2827373320 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f700078e0 con 0x7f0f780add50 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.265+0000 7f0f777fe640 1 -- 172.21.15.79:0/2827373320 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70007cb0 con 0x7f0f780add50 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.266+0000 7f0f7ef32640 1 -- 172.21.15.79:0/2827373320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 msgr2=0x7f0f78165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.266+0000 7f0f7ef32640 1 --2- 172.21.15.79:0/2827373320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78165c30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009d90 tx=0x7f0f7002a660 comp rx=0 tx=0).stop 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.266+0000 7f0f7ef32640 1 -- 172.21.15.79:0/2827373320 shutdown_connections 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.266+0000 7f0f7ef32640 1 --2- 172.21.15.79:0/2827373320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78165c30 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.266+0000 7f0f7ef32640 1 -- 172.21.15.79:0/2827373320 >> 172.21.15.79:0/2827373320 conn(0x7f0f780b19f0 msgr2=0x7f0f780b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.266+0000 7f0f7ef32640 1 -- 172.21.15.79:0/2827373320 shutdown_connections 2024-06-10T00:20:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.266+0000 7f0f7ef32640 1 -- 172.21.15.79:0/2827373320 wait complete. 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.267+0000 7f0f7ef32640 1 Processor -- start 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.267+0000 7f0f7ef32640 1 -- start start 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7ef32640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f7806ebf0 0x7f0f7815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7ef32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7ef32640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f780ae910 0x7f0f78151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7ef32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780cf4e0 con 0x7f0f780add50 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7ef32640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780cf360 con 0x7f0f780ae910 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7ef32640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780cf660 con 0x7f0f7806ebf0 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35396/0 (socket says 172.21.15.79:35396) 2024-06-10T00:20:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 -- 172.21.15.79:0/766602105 learned_addr learned my addr 172.21.15.79:0/766602105 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7d4cf640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f780ae910 0x7f0f78151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7ccce640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f7806ebf0 0x7f0f7815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 -- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f7806ebf0 msgr2=0x7f0f7815d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f7806ebf0 0x7f0f7815d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 -- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f780ae910 msgr2=0x7f0f78151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f780ae910 0x7f0f78151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 -- 172.21.15.79:0/766602105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7809cfc0 con 0x7f0f780add50 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7ccce640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f7806ebf0 0x7f0f7815d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f7d4cf640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f780ae910 0x7f0f78151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.268+0000 7f0f77fff640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78151340 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c3f0 tx=0x7f0f6c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.269+0000 7f0f757fa640 1 -- 172.21.15.79:0/766602105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c0074e0 con 0x7f0f780add50 2024-06-10T00:20:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.269+0000 7f0f757fa640 1 -- 172.21.15.79:0/766602105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c0047e0 con 0x7f0f780add50 2024-06-10T00:20:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.269+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7809d2a0 con 0x7f0f780add50 2024-06-10T00:20:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.269+0000 7f0f757fa640 1 -- 172.21.15.79:0/766602105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c004c10 con 0x7f0f780add50 2024-06-10T00:20:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.269+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7815d050 con 0x7f0f780add50 2024-06-10T00:20:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.270+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f78068430 con 0x7f0f780add50 2024-06-10T00:20:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.270+0000 7f0f757fa640 1 -- 172.21.15.79:0/766602105 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f6c011070 con 0x7f0f780add50 2024-06-10T00:20:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.270+0000 7f0f757fa640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0f6406be30 0x7f0f6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.270+0000 7f0f757fa640 1 -- 172.21.15.79:0/766602105 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f0f6c08abc0 con 0x7f0f780add50 2024-06-10T00:20:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.271+0000 7f0f7ccce640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0f6406be30 0x7f0f6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.271+0000 7f0f7ccce640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0f6406be30 0x7f0f6406e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000f60 tx=0x7f0f68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.275+0000 7f0f757fa640 1 -- 172.21.15.79:0/766602105 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0f6c01a2b0 con 0x7f0f780add50 2024-06-10T00:20:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.453+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f7809d7c0 con 0x7f0f780add50 2024-06-10T00:20:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.454+0000 7f0f757fa640 1 -- 172.21.15.79:0/766602105 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16850 (secure 0 0 0) 0x7f0f6c059470 con 0x7f0f780add50 2024-06-10T00:20:25.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:25.454 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":87,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:20:24.158841+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:20:22.495363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-06-10T00:20:23.129127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0f6406be30 msgr2=0x7f0f6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0f6406be30 0x7f0f6406e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000f60 tx=0x7f0f68009040 comp rx=0 tx=0).stop 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 msgr2=0x7f0f78151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78151340 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c3f0 tx=0x7f0f6c00c8b0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 shutdown_connections 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f0f6406be30 0x7f0f6406e2f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f780ae910 0x7f0f78151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780add50 0x7f0f78151340 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 --2- 172.21.15.79:0/766602105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f7806ebf0 0x7f0f7815d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 >> 172.21.15.79:0/766602105 conn(0x7f0f780b19f0 msgr2=0x7f0f780719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 shutdown_connections 2024-06-10T00:20:25.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.456+0000 7f0f7ef32640 1 -- 172.21.15.79:0/766602105 wait complete. 2024-06-10T00:20:25.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-10T00:20:25.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.569+0000 7fc453984640 1 Processor -- start 2024-06-10T00:20:25.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.570+0000 7fc453984640 1 -- start start 2024-06-10T00:20:25.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.570+0000 7fc453984640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc44c0cf360 0x7fc44c0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.570+0000 7fc453984640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c0cf8a0 con 0x7fc44c0b3800 2024-06-10T00:20:25.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.570+0000 7fc453984640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c0cfb80 con 0x7fc44c0d08f0 2024-06-10T00:20:25.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.570+0000 7fc453984640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc44c0d1c80 con 0x7fc44c0cf360 2024-06-10T00:20:25.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.570+0000 7fc450f1f640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc44c0b3800 0x7fc44c0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51818/0 (socket says 172.21.15.79:51818) 2024-06-10T00:20:25.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.570+0000 7fc450f1f640 1 -- 172.21.15.79:0/2157398803 learned_addr learned my addr 172.21.15.79:0/2157398803 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277325498 0 0) 0x7fc44c0cf8a0 con 0x7fc44c0b3800 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451f21640 1 --2- 172.21.15.79:0/2157398803 >> v2:172.21.15.117:3300/0 conn(0x7fc44c0cf360 0x7fc44c0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc434003520 con 0x7fc44c0b3800 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2163372576 0 0) 0x7fc434003520 con 0x7fc44c0b3800 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 >> v2:172.21.15.117:3300/0 conn(0x7fc44c0cf360 msgr2=0x7fc44c0d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 --2- 172.21.15.79:0/2157398803 >> v2:172.21.15.117:3300/0 conn(0x7fc44c0cf360 0x7fc44c0d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 >> v1:172.21.15.117:6789/0 conn(0x7fc44c0d08f0 legacy=0x7fc44c0d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c0cfe60 con 0x7fc44c0b3800 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fc440001670 con 0x7fc44c0b3800 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451f21640 1 --2- 172.21.15.79:0/2157398803 >> v2:172.21.15.117:3300/0 conn(0x7fc44c0cf360 0x7fc44c0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 >> v1:172.21.15.79:6789/0 conn(0x7fc44c0b3800 legacy=0x7fc44c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc434003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc434004800 0x7fc434004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4340051c0 0x7fc43400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c0d1c80 con 0x7fc4340039b0 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc43400c110 con 0x7fc434004800 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc43400c310 con 0x7fc4340051c0 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451720640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc434003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc450f1f640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc434004800 0x7fc434004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451f21640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4340051c0 0x7fc43400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451720640 1 -- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4340051c0 msgr2=0x7fc43400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451720640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4340051c0 0x7fc43400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451720640 1 -- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc434004800 msgr2=0x7fc434004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451720640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc434004800 0x7fc434004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451720640 1 -- 172.21.15.79:0/2157398803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc434003520 con 0x7fc4340039b0 2024-06-10T00:20:25.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451f21640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4340051c0 0x7fc43400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.571+0000 7fc451f21640 1 -- 172.21.15.79:0/2157398803 reap_dead start 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.572+0000 7fc451720640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc434003dd0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc43c001750 tx=0x7fc434005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c653b17e2b708d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.572+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c001370 con 0x7fc4340039b0 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.572+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43c0052d0 con 0x7fc4340039b0 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.572+0000 7fc44bfff640 1 -- 172.21.15.79:0/2157398803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c02abc0 con 0x7fc4340039b0 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.573+0000 7fc453984640 1 -- 172.21.15.79:0/2157398803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 msgr2=0x7fc434003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.573+0000 7fc453984640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc434003dd0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc43c001750 tx=0x7fc434005830 comp rx=0 tx=0).stop 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.573+0000 7fc453984640 1 -- 172.21.15.79:0/2157398803 shutdown_connections 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.573+0000 7fc453984640 1 --2- 172.21.15.79:0/2157398803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc434003dd0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.573+0000 7fc453984640 1 -- 172.21.15.79:0/2157398803 >> 172.21.15.79:0/2157398803 conn(0x7fc44c09d3c0 msgr2=0x7fc44c0d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.573+0000 7fc453984640 1 -- 172.21.15.79:0/2157398803 shutdown_connections 2024-06-10T00:20:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.573+0000 7fc453984640 1 -- 172.21.15.79:0/2157398803 wait complete. 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.574+0000 7fc453984640 1 Processor -- start 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.574+0000 7fc453984640 1 -- start start 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc453984640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc44c0cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc453984640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c158c20 0x7fc44c0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc453984640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc44c0cc060 0x7fc44c06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc453984640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c0b50c0 con 0x7fc4340039b0 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc453984640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c0b3cb0 con 0x7fc44c158c20 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc453984640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc44c0b4a60 con 0x7fc44c0cc060 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc44c0cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc44c0cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35416/0 (socket says 172.21.15.79:35416) 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 -- 172.21.15.79:0/2432633774 learned_addr learned my addr 172.21.15.79:0/2432633774 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 -- 172.21.15.79:0/2432633774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc44c0cc060 msgr2=0x7fc44c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc44c0cc060 0x7fc44c06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 -- 172.21.15.79:0/2432633774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c158c20 msgr2=0x7fc44c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c158c20 0x7fc44c0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 -- 172.21.15.79:0/2432633774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c0ccdc0 con 0x7fc4340039b0 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc451720640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc44c0cd620 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc43c000c00 tx=0x7fc43c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc449ffb640 1 -- 172.21.15.79:0/2432633774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c037040 con 0x7fc4340039b0 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc449ffb640 1 -- 172.21.15.79:0/2432633774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43c005480 con 0x7fc4340039b0 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c0cd0a0 con 0x7fc4340039b0 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.575+0000 7fc449ffb640 1 -- 172.21.15.79:0/2432633774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c007a30 con 0x7fc4340039b0 2024-06-10T00:20:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.576+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c158920 con 0x7fc4340039b0 2024-06-10T00:20:25.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.577+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c0683c0 con 0x7fc4340039b0 2024-06-10T00:20:25.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.577+0000 7fc449ffb640 1 -- 172.21.15.79:0/2432633774 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc43c044020 con 0x7fc4340039b0 2024-06-10T00:20:25.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.577+0000 7fc449ffb640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc43806be60 0x7fc43806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.577+0000 7fc449ffb640 1 -- 172.21.15.79:0/2432633774 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fc43c007640 con 0x7fc4340039b0 2024-06-10T00:20:25.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.577+0000 7fc450f1f640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc43806be60 0x7fc43806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.578+0000 7fc450f1f640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc43806be60 0x7fc43806e320 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc440001050 tx=0x7fc440001b40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.582+0000 7fc449ffb640 1 -- 172.21.15.79:0/2432633774 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc43c079560 con 0x7fc4340039b0 2024-06-10T00:20:25.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.789+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc44c1590e0 con 0x7fc4340039b0 2024-06-10T00:20:25.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.826+0000 7fc449ffb640 1 -- 172.21.15.79:0/2432633774 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) ==== 118+0+0 (secure 0 0 0) 0x7fc43c078e60 con 0x7fc4340039b0 2024-06-10T00:20:25.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc43806be60 msgr2=0x7fc43806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc43806be60 0x7fc43806e320 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc440001050 tx=0x7fc440001b40 comp rx=0 tx=0).stop 2024-06-10T00:20:25.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 msgr2=0x7fc44c0cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc44c0cd620 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc43c000c00 tx=0x7fc43c001120 comp rx=0 tx=0).stop 2024-06-10T00:20:25.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 shutdown_connections 2024-06-10T00:20:25.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc43806be60 0x7fc43806e320 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc44c0cc060 0x7fc44c06c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c158c20 0x7fc44c0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 --2- 172.21.15.79:0/2432633774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4340039b0 0x7fc44c0cd620 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 >> 172.21.15.79:0/2432633774 conn(0x7fc44c09d3c0 msgr2=0x7fc44c0b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:25.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 shutdown_connections 2024-06-10T00:20:25.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.828+0000 7fc453984640 1 -- 172.21.15.79:0/2432633774 wait complete. 2024-06-10T00:20:25.838 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-10T00:20:25.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-10T00:20:25.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.941+0000 7ffb2c534640 1 Processor -- start 2024-06-10T00:20:25.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.941+0000 7ffb2c534640 1 -- start start 2024-06-10T00:20:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.942+0000 7ffb2c534640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.942+0000 7ffb2c534640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb240cf360 0x7ffb240d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.942+0000 7ffb2c534640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb240cf8a0 con 0x7ffb240d0cd0 2024-06-10T00:20:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.942+0000 7ffb2c534640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ffb240d1c80 con 0x7ffb240cf360 2024-06-10T00:20:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.942+0000 7ffb2c534640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb240cfb80 con 0x7ffb240d08f0 2024-06-10T00:20:25.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb2aad1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb240cf360 0x7ffb240d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb29acf640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ffb240d0cd0 0x7ffb240cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:35460/0 (socket says 172.21.15.79:35460) 2024-06-10T00:20:25.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb2a2d0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb29acf640 1 -- 172.21.15.79:0/3729662391 learned_addr learned my addr 172.21.15.79:0/3729662391 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb2a2d0640 1 -- 172.21.15.79:0/3729662391 >> v2:172.21.15.117:3300/0 conn(0x7ffb240cf360 msgr2=0x7ffb240d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb2a2d0640 1 --2- 172.21.15.79:0/3729662391 >> v2:172.21.15.117:3300/0 conn(0x7ffb240cf360 0x7ffb240d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb2a2d0640 1 -- 172.21.15.79:0/3729662391 >> v1:172.21.15.117:6789/0 conn(0x7ffb240d0cd0 legacy=0x7ffb240cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb2a2d0640 1 -- 172.21.15.79:0/3729662391 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb240cfe60 con 0x7ffb240d08f0 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.943+0000 7ffb2aad1640 1 --2- 172.21.15.79:0/3729662391 >> v2:172.21.15.117:3300/0 conn(0x7ffb240cf360 0x7ffb240d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.944+0000 7ffb2a2d0640 1 --2- 172.21.15.79:0/3729662391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b3800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009d90 tx=0x7ffb1402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49e54e73336ed8a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.944+0000 7ffb292ce640 1 -- 172.21.15.79:0/3729662391 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14007740 con 0x7ffb240d08f0 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.944+0000 7ffb292ce640 1 -- 172.21.15.79:0/3729662391 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140078e0 con 0x7ffb240d08f0 2024-06-10T00:20:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.944+0000 7ffb292ce640 1 -- 172.21.15.79:0/3729662391 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14007cb0 con 0x7ffb240d08f0 2024-06-10T00:20:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.945+0000 7ffb2c534640 1 -- 172.21.15.79:0/3729662391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 msgr2=0x7ffb240b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.945+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3729662391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b3800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009d90 tx=0x7ffb1402a660 comp rx=0 tx=0).stop 2024-06-10T00:20:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.945+0000 7ffb2c534640 1 -- 172.21.15.79:0/3729662391 shutdown_connections 2024-06-10T00:20:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.945+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3729662391 >> v2:172.21.15.117:3300/0 conn(0x7ffb240cf360 0x7ffb240d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.945+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3729662391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b3800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.945+0000 7ffb2c534640 1 -- 172.21.15.79:0/3729662391 >> 172.21.15.79:0/3729662391 conn(0x7ffb2409d3c0 msgr2=0x7ffb240d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.945+0000 7ffb2c534640 1 -- 172.21.15.79:0/3729662391 shutdown_connections 2024-06-10T00:20:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.945+0000 7ffb2c534640 1 -- 172.21.15.79:0/3729662391 wait complete. 2024-06-10T00:20:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.946+0000 7ffb2c534640 1 Processor -- start 2024-06-10T00:20:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.946+0000 7ffb2c534640 1 -- start start 2024-06-10T00:20:25.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2c534640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240cf360 0x7ffb2414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2c534640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2c534640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb240d0cd0 0x7ffb240b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2c534640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb240d1150 con 0x7ffb240d0cd0 2024-06-10T00:20:25.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2c534640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb240b50c0 con 0x7ffb240cf360 2024-06-10T00:20:25.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2c534640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb240b4a60 con 0x7ffb240d08f0 2024-06-10T00:20:25.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb240d0cd0 0x7ffb240b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb240d0cd0 0x7ffb240b83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35428/0 (socket says 172.21.15.79:35428) 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 -- 172.21.15.79:0/3452792307 learned_addr learned my addr 172.21.15.79:0/3452792307 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2a2d0640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240cf360 0x7ffb2414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb29acf640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 -- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 msgr2=0x7ffb240b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 -- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240cf360 msgr2=0x7ffb2414f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240cf360 0x7ffb2414f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 -- 172.21.15.79:0/3452792307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2414fa20 con 0x7ffb240d0cd0 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb29acf640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2aad1640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb240d0cd0 0x7ffb240b83b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00e900 tx=0x7ffb1c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb22ffd640 1 -- 172.21.15.79:0/3452792307 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c017070 con 0x7ffb240d0cd0 2024-06-10T00:20:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb22ffd640 1 -- 172.21.15.79:0/3452792307 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1c00ca00 con 0x7ffb240d0cd0 2024-06-10T00:20:25.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb241f5880 con 0x7ffb240d0cd0 2024-06-10T00:20:25.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb22ffd640 1 -- 172.21.15.79:0/3452792307 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c00cdb0 con 0x7ffb240d0cd0 2024-06-10T00:20:25.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.947+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb241f52c0 con 0x7ffb240d0cd0 2024-06-10T00:20:25.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.948+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb240683c0 con 0x7ffb240d0cd0 2024-06-10T00:20:25.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.949+0000 7ffb22ffd640 1 -- 172.21.15.79:0/3452792307 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb1c01a070 con 0x7ffb240d0cd0 2024-06-10T00:20:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.949+0000 7ffb22ffd640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb1006be30 0x7ffb1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.949+0000 7ffb22ffd640 1 -- 172.21.15.79:0/3452792307 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7ffb1c08aee0 con 0x7ffb240d0cd0 2024-06-10T00:20:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.949+0000 7ffb2a2d0640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb1006be30 0x7ffb1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:25.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.950+0000 7ffb2a2d0640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb1006be30 0x7ffb1006e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffb14034000 tx=0x7ffb1402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:25.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:25.954+0000 7ffb22ffd640 1 -- 172.21.15.79:0/3452792307 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffb1c059030 con 0x7ffb240d0cd0 2024-06-10T00:20:26.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.162+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ffb240b0cb0 con 0x7ffb240d0cd0 2024-06-10T00:20:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.827+0000 7ffb22ffd640 1 -- 172.21.15.79:0/3452792307 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) ==== 122+0+0 (secure 0 0 0) 0x7ffb1c05d330 con 0x7ffb240d0cd0 2024-06-10T00:20:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb1006be30 msgr2=0x7ffb1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb1006be30 0x7ffb1006e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffb14034000 tx=0x7ffb1402f000 comp rx=0 tx=0).stop 2024-06-10T00:20:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb240d0cd0 msgr2=0x7ffb240b83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb240d0cd0 0x7ffb240b83b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00e900 tx=0x7ffb1c00edc0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 shutdown_connections 2024-06-10T00:20:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb1006be30 0x7ffb1006e2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb240d0cd0 0x7ffb240b83b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240d08f0 0x7ffb240b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.829+0000 7ffb2c534640 1 --2- 172.21.15.79:0/3452792307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240cf360 0x7ffb2414f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.830+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 >> 172.21.15.79:0/3452792307 conn(0x7ffb2409d3c0 msgr2=0x7ffb240747a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.830+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 shutdown_connections 2024-06-10T00:20:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.830+0000 7ffb2c534640 1 -- 172.21.15.79:0/3452792307 wait complete. 2024-06-10T00:20:26.841 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-10T00:20:26.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:26.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.942+0000 7fa9174d2640 1 Processor -- start 2024-06-10T00:20:26.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.942+0000 7fa9174d2640 1 -- start start 2024-06-10T00:20:26.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa9174d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa910156830 0x7fa910071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:26.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa9174d2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa91015c7f0 0x7fa910165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:26.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa9174d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9100725f0 con 0x7fa910072130 2024-06-10T00:20:26.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa9174d2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa9100b3090 con 0x7fa91015c7f0 2024-06-10T00:20:26.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa9174d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa9100728d0 con 0x7fa910156830 2024-06-10T00:20:26.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa915a6f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa91015c7f0 0x7fa910165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:26.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa915a6f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa91015c7f0 0x7fa910165cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35432/0 (socket says 172.21.15.79:35432) 2024-06-10T00:20:26.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa915a6f640 1 -- 172.21.15.79:0/439168496 learned_addr learned my addr 172.21.15.79:0/439168496 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:26.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa91526e640 1 --2- 172.21.15.79:0/439168496 >> v2:172.21.15.117:3300/0 conn(0x7fa910156830 0x7fa910071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:26.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa915a6f640 1 -- 172.21.15.79:0/439168496 >> v2:172.21.15.117:3300/0 conn(0x7fa910156830 msgr2=0x7fa910071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:26.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa915a6f640 1 --2- 172.21.15.79:0/439168496 >> v2:172.21.15.117:3300/0 conn(0x7fa910156830 0x7fa910071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa915a6f640 1 -- 172.21.15.79:0/439168496 >> v1:172.21.15.117:6789/0 conn(0x7fa910072130 legacy=0x7fa9100cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:26.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.943+0000 7fa915a6f640 1 -- 172.21.15.79:0/439168496 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa910072bb0 con 0x7fa91015c7f0 2024-06-10T00:20:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.944+0000 7fa915a6f640 1 --2- 172.21.15.79:0/439168496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91015c7f0 0x7fa910165cc0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa910070cb0 tx=0x7fa90802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40eaa36355702ccd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.944+0000 7fa907fff640 1 -- 172.21.15.79:0/439168496 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908036070 con 0x7fa91015c7f0 2024-06-10T00:20:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.944+0000 7fa907fff640 1 -- 172.21.15.79:0/439168496 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa908031600 con 0x7fa91015c7f0 2024-06-10T00:20:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.944+0000 7fa907fff640 1 -- 172.21.15.79:0/439168496 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080319d0 con 0x7fa91015c7f0 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.945+0000 7fa9174d2640 1 -- 172.21.15.79:0/439168496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91015c7f0 msgr2=0x7fa910165cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.945+0000 7fa9174d2640 1 --2- 172.21.15.79:0/439168496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91015c7f0 0x7fa910165cc0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa910070cb0 tx=0x7fa90802a730 comp rx=0 tx=0).stop 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.945+0000 7fa9174d2640 1 -- 172.21.15.79:0/439168496 shutdown_connections 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.945+0000 7fa9174d2640 1 --2- 172.21.15.79:0/439168496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91015c7f0 0x7fa910165cc0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.945+0000 7fa9174d2640 1 --2- 172.21.15.79:0/439168496 >> v2:172.21.15.117:3300/0 conn(0x7fa910156830 0x7fa910071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.945+0000 7fa9174d2640 1 -- 172.21.15.79:0/439168496 >> 172.21.15.79:0/439168496 conn(0x7fa9100b19f0 msgr2=0x7fa9100b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.945+0000 7fa9174d2640 1 -- 172.21.15.79:0/439168496 shutdown_connections 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.945+0000 7fa9174d2640 1 -- 172.21.15.79:0/439168496 wait complete. 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.946+0000 7fa9174d2640 1 Processor -- start 2024-06-10T00:20:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.946+0000 7fa9174d2640 1 -- start start 2024-06-10T00:20:26.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa9174d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa910072130 0x7fa91014f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa9174d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa910156830 0x7fa9100d0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa9174d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa91015c7f0 0x7fa91014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa9174d2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100ccf00 con 0x7fa910156830 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa9174d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100ccd80 con 0x7fa910072130 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa9174d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa9100cd080 con 0x7fa91015c7f0 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa910156830 0x7fa9100d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa910156830 0x7fa9100d0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35436/0 (socket says 172.21.15.79:35436) 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 -- 172.21.15.79:0/3021031727 learned_addr learned my addr 172.21.15.79:0/3021031727 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa91526e640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa910072130 0x7fa91014f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa915a6f640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa91015c7f0 0x7fa91014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 -- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa91015c7f0 msgr2=0x7fa91014e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa91015c7f0 0x7fa91014e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 -- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa910072130 msgr2=0x7fa91014f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa910072130 0x7fa91014f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 -- 172.21.15.79:0/3021031727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91014e5b0 con 0x7fa910156830 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa91526e640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa910072130 0x7fa91014f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa914a6d640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa910156830 0x7fa9100d0740 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c430 tx=0x7fa90000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa905ffb640 1 -- 172.21.15.79:0/3021031727 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9000052d0 con 0x7fa910156830 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa905ffb640 1 -- 172.21.15.79:0/3021031727 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa900005490 con 0x7fa910156830 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa905ffb640 1 -- 172.21.15.79:0/3021031727 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900007260 con 0x7fa910156830 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.947+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91014e850 con 0x7fa910156830 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.948+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91014ee10 con 0x7fa910156830 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.949+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa910068430 con 0x7fa910156830 2024-06-10T00:20:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.949+0000 7fa905ffb640 1 -- 172.21.15.79:0/3021031727 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa900007400 con 0x7fa910156830 2024-06-10T00:20:26.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.949+0000 7fa905ffb640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa8f406be60 0x7fa8f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:26.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.950+0000 7fa91526e640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa8f406be60 0x7fa8f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:26.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.950+0000 7fa905ffb640 1 -- 172.21.15.79:0/3021031727 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fa90008a5a0 con 0x7fa910156830 2024-06-10T00:20:26.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.950+0000 7fa91526e640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa8f406be60 0x7fa8f406e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa90c006fd0 tx=0x7fa90c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:26.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:26.954+0000 7fa905ffb640 1 -- 172.21.15.79:0/3021031727 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa900058d30 con 0x7fa910156830 2024-06-10T00:20:27.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.163+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa910155140 con 0x7fa910156830 2024-06-10T00:20:27.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.163+0000 7fa905ffb640 1 -- 172.21.15.79:0/3021031727 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5189 (secure 0 0 0) 0x7fa900058630 con 0x7fa910156830 2024-06-10T00:20:27.163 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:27.163 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6885,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:26.163397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/2747696124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2747696124},{"type":"v1","addr":"172.21.15.117:6835","nonce":2747696124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6903,"qdb_cluster":[6903]},"id":6}]} 2024-06-10T00:20:27.164 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 50 2024-06-10T00:20:27.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa8f406be60 msgr2=0x7fa8f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa8f406be60 0x7fa8f406e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa90c006fd0 tx=0x7fa90c008040 comp rx=0 tx=0).stop 2024-06-10T00:20:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa910156830 msgr2=0x7fa9100d0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa910156830 0x7fa9100d0740 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c430 tx=0x7fa90000c8f0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 shutdown_connections 2024-06-10T00:20:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa8f406be60 0x7fa8f406e320 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa91015c7f0 0x7fa91014e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa910156830 0x7fa9100d0740 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 --2- 172.21.15.79:0/3021031727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa910072130 0x7fa91014f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 >> 172.21.15.79:0/3021031727 conn(0x7fa9100b19f0 msgr2=0x7fa9100ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.165+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 shutdown_connections 2024-06-10T00:20:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.166+0000 7fa9174d2640 1 -- 172.21.15.79:0/3021031727 wait complete. 2024-06-10T00:20:27.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:20:27.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-06-10T00:20:27.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.276+0000 7f13b2eb3640 1 Processor -- start 2024-06-10T00:20:27.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.276+0000 7f13b2eb3640 1 -- start start 2024-06-10T00:20:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.277+0000 7f13b2eb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac0ae910 0x7f13ac06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.277+0000 7f13b2eb3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f13ac0cf360 0x7f13ac0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.277+0000 7f13b2eb3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13ac06d130 con 0x7f13ac06ea20 2024-06-10T00:20:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.277+0000 7f13b2eb3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f13ac06ee60 con 0x7f13ac0cf360 2024-06-10T00:20:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.277+0000 7f13b2eb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f13ac06d410 con 0x7f13ac0ae910 2024-06-10T00:20:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.278+0000 7f13b1450640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f13ac0cf360 0x7f13ac0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.278+0000 7f13b1450640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f13ac0cf360 0x7f13ac0acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:44650/0 (socket says 172.21.15.79:44650) 2024-06-10T00:20:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.278+0000 7f13b1450640 1 -- 172.21.15.79:0/3147335732 learned_addr learned my addr 172.21.15.79:0/3147335732 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.278+0000 7f13b0c4f640 1 --2- 172.21.15.79:0/3147335732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac0ae910 0x7f13ac06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.278+0000 7f13b1450640 1 -- 172.21.15.79:0/3147335732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac0ae910 msgr2=0x7f13ac06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.278+0000 7f13b1450640 1 --2- 172.21.15.79:0/3147335732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac0ae910 0x7f13ac06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.278+0000 7f13b1450640 1 -- 172.21.15.79:0/3147335732 >> v1:172.21.15.117:6789/0 conn(0x7f13ac06ea20 legacy=0x7f13ac0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.278+0000 7f13b1450640 1 -- 172.21.15.79:0/3147335732 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac06d6f0 con 0x7f13ac0cf360 2024-06-10T00:20:27.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.279+0000 7f13b1450640 1 --2- 172.21.15.79:0/3147335732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 0x7f13ac0acd40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f13940098a0 tx=0x7f139402a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368c9e29b995f165 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.279+0000 7f13ab7fe640 1 -- 172.21.15.79:0/3147335732 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394037070 con 0x7f13ac0cf360 2024-06-10T00:20:27.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.279+0000 7f13ab7fe640 1 -- 172.21.15.79:0/3147335732 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1394032440 con 0x7f13ac0cf360 2024-06-10T00:20:27.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.279+0000 7f13ab7fe640 1 -- 172.21.15.79:0/3147335732 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394032810 con 0x7f13ac0cf360 2024-06-10T00:20:27.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.280+0000 7f13b2eb3640 1 -- 172.21.15.79:0/3147335732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 msgr2=0x7f13ac0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.280+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/3147335732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 0x7f13ac0acd40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f13940098a0 tx=0x7f139402a200 comp rx=0 tx=0).stop 2024-06-10T00:20:27.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.280+0000 7f13b2eb3640 1 -- 172.21.15.79:0/3147335732 shutdown_connections 2024-06-10T00:20:27.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.280+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/3147335732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 0x7f13ac0acd40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.280+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/3147335732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac0ae910 0x7f13ac06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.280+0000 7f13b2eb3640 1 -- 172.21.15.79:0/3147335732 >> 172.21.15.79:0/3147335732 conn(0x7f13ac0b19f0 msgr2=0x7f13ac0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:27.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.280+0000 7f13b2eb3640 1 -- 172.21.15.79:0/3147335732 shutdown_connections 2024-06-10T00:20:27.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.280+0000 7f13b2eb3640 1 -- 172.21.15.79:0/3147335732 wait complete. 2024-06-10T00:20:27.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.281+0000 7f13b2eb3640 1 Processor -- start 2024-06-10T00:20:27.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.281+0000 7f13b2eb3640 1 -- start start 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13b2eb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac06ea20 0x7f13ac1466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13b2eb3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac0ae910 0x7f13ac09bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13b2eb3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 0x7f13ac1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13b2eb3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac0ad280 con 0x7f13ac0ae910 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13b2eb3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac0aecf0 con 0x7f13ac0cf360 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13b2eb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f13ac0ad400 con 0x7f13ac06ea20 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac0ae910 0x7f13ac09bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac0ae910 0x7f13ac09bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35448/0 (socket says 172.21.15.79:35448) 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13abfff640 1 -- 172.21.15.79:0/1597976080 learned_addr learned my addr 172.21.15.79:0/1597976080 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13b0c4f640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac06ea20 0x7f13ac1466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13b1450640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 0x7f13ac1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13abfff640 1 -- 172.21.15.79:0/1597976080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac06ea20 msgr2=0x7f13ac1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13abfff640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac06ea20 0x7f13ac1466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13abfff640 1 -- 172.21.15.79:0/1597976080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 msgr2=0x7f13ac1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13abfff640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 0x7f13ac1535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.282+0000 7f13abfff640 1 -- 172.21.15.79:0/1597976080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac146c00 con 0x7f13ac0ae910 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.283+0000 7f13abfff640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac0ae910 0x7f13ac09bfb0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f139c00c760 tx=0x7f139c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.283+0000 7f13a97fa640 1 -- 172.21.15.79:0/1597976080 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c016020 con 0x7f13ac0ae910 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.283+0000 7f13a97fa640 1 -- 172.21.15.79:0/1597976080 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139c006d50 con 0x7f13ac0ae910 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.283+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ac09af10 con 0x7f13ac0ae910 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.283+0000 7f13a97fa640 1 -- 172.21.15.79:0/1597976080 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c003bb0 con 0x7f13ac0ae910 2024-06-10T00:20:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.283+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ac09b4d0 con 0x7f13ac0ae910 2024-06-10T00:20:27.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.284+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13ac068430 con 0x7f13ac0ae910 2024-06-10T00:20:27.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.284+0000 7f13a97fa640 1 -- 172.21.15.79:0/1597976080 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f139c00a850 con 0x7f13ac0ae910 2024-06-10T00:20:27.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.285+0000 7f13a97fa640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f138c06be30 0x7f138c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.285+0000 7f13a97fa640 1 -- 172.21.15.79:0/1597976080 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f139c08ab20 con 0x7f13ac0ae910 2024-06-10T00:20:27.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.285+0000 7f13b0c4f640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f138c06be30 0x7f138c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.285+0000 7f13b0c4f640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f138c06be30 0x7f138c06e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009b40 tx=0x7f13a4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.289+0000 7f13a97fa640 1 -- 172.21.15.79:0/1597976080 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f139c020020 con 0x7f13ac0ae910 2024-06-10T00:20:27.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.463+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13ac0d0830 con 0x7f13ac0ae910 2024-06-10T00:20:27.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.464+0000 7f13a97fa640 1 -- 172.21.15.79:0/1597976080 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16837 (secure 0 0 0) 0x7f13ac146c00 con 0x7f13ac0ae910 2024-06-10T00:20:27.464 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:27.464 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:20:25.810983+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:20:22.495363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-06-10T00:20:23.129127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f138c06be30 msgr2=0x7f138c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f138c06be30 0x7f138c06e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009b40 tx=0x7f13a4009190 comp rx=0 tx=0).stop 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac0ae910 msgr2=0x7f13ac09bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac0ae910 0x7f13ac09bfb0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f139c00c760 tx=0x7f139c00cc20 comp rx=0 tx=0).stop 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 shutdown_connections 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f138c06be30 0x7f138c06e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13ac0cf360 0x7f13ac1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac0ae910 0x7f13ac09bfb0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 --2- 172.21.15.79:0/1597976080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13ac06ea20 0x7f13ac1466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 >> 172.21.15.79:0/1597976080 conn(0x7f13ac0b19f0 msgr2=0x7f13ac0cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 shutdown_connections 2024-06-10T00:20:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.466+0000 7f13b2eb3640 1 -- 172.21.15.79:0/1597976080 wait complete. 2024-06-10T00:20:27.477 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:20:27.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:20:27.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.576+0000 7fcd5d615640 1 Processor -- start 2024-06-10T00:20:27.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.576+0000 7fcd5d615640 1 -- start start 2024-06-10T00:20:27.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd5d615640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd58072ca0 0x7fcd5806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd5d615640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58160190 0x7fcd58166be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd5d615640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd5806e320 con 0x7fcd58073080 2024-06-10T00:20:27.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd5d615640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcd580cba70 con 0x7fcd58072ca0 2024-06-10T00:20:27.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd5d615640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd580cb5e0 con 0x7fcd58160190 2024-06-10T00:20:27.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd56ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd58072ca0 0x7fcd5806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd56ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd58072ca0 0x7fcd5806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35450/0 (socket says 172.21.15.79:35450) 2024-06-10T00:20:27.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd56ffd640 1 -- 172.21.15.79:0/1711149414 learned_addr learned my addr 172.21.15.79:0/1711149414 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:27.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd577fe640 1 --2- 172.21.15.79:0/1711149414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58160190 0x7fcd58166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd56ffd640 1 -- 172.21.15.79:0/1711149414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58160190 msgr2=0x7fcd58166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:27.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.577+0000 7fcd56ffd640 1 --2- 172.21.15.79:0/1711149414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58160190 0x7fcd58166be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.578+0000 7fcd56ffd640 1 -- 172.21.15.79:0/1711149414 >> v1:172.21.15.117:6789/0 conn(0x7fcd58073080 legacy=0x7fcd5815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:27.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.578+0000 7fcd56ffd640 1 -- 172.21.15.79:0/1711149414 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd580ca9f0 con 0x7fcd58072ca0 2024-06-10T00:20:27.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.578+0000 7fcd577fe640 1 --2- 172.21.15.79:0/1711149414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58160190 0x7fcd58166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:27.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.578+0000 7fcd56ffd640 1 --2- 172.21.15.79:0/1711149414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5806dde0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fcd580cfee0 tx=0x7fcd4802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8223b80e6584af14 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.578+0000 7fcd55ffb640 1 -- 172.21.15.79:0/1711149414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48037070 con 0x7fcd58072ca0 2024-06-10T00:20:27.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.578+0000 7fcd55ffb640 1 -- 172.21.15.79:0/1711149414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48032440 con 0x7fcd58072ca0 2024-06-10T00:20:27.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.578+0000 7fcd55ffb640 1 -- 172.21.15.79:0/1711149414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48032810 con 0x7fcd58072ca0 2024-06-10T00:20:27.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.579+0000 7fcd5d615640 1 -- 172.21.15.79:0/1711149414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 msgr2=0x7fcd5806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.579+0000 7fcd5d615640 1 --2- 172.21.15.79:0/1711149414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5806dde0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fcd580cfee0 tx=0x7fcd4802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.579+0000 7fcd5d615640 1 -- 172.21.15.79:0/1711149414 shutdown_connections 2024-06-10T00:20:27.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.579+0000 7fcd5d615640 1 --2- 172.21.15.79:0/1711149414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58160190 0x7fcd58166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.579+0000 7fcd5d615640 1 --2- 172.21.15.79:0/1711149414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5806dde0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.579+0000 7fcd5d615640 1 -- 172.21.15.79:0/1711149414 >> 172.21.15.79:0/1711149414 conn(0x7fcd580b1bb0 msgr2=0x7fcd580b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:27.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.579+0000 7fcd5d615640 1 -- 172.21.15.79:0/1711149414 shutdown_connections 2024-06-10T00:20:27.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.579+0000 7fcd5d615640 1 -- 172.21.15.79:0/1711149414 wait complete. 2024-06-10T00:20:27.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.580+0000 7fcd5d615640 1 Processor -- start 2024-06-10T00:20:27.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.580+0000 7fcd5d615640 1 -- start start 2024-06-10T00:20:27.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd5d615640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd5d615640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58073080 0x7fcd580b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd5d615640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd58160190 0x7fcd581f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd5d615640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd580cb270 con 0x7fcd58072ca0 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd5d615640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd580caf90 con 0x7fcd58160190 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd5d615640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd5806f0b0 con 0x7fcd58073080 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35464/0 (socket says 172.21.15.79:35464) 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd56ffd640 1 -- 172.21.15.79:0/3770294889 learned_addr learned my addr 172.21.15.79:0/3770294889 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd577fe640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd58160190 0x7fcd581f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd567fc640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58073080 0x7fcd580b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd56ffd640 1 -- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58073080 msgr2=0x7fcd580b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd56ffd640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58073080 0x7fcd580b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd56ffd640 1 -- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd58160190 msgr2=0x7fcd581f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd56ffd640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd58160190 0x7fcd581f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd56ffd640 1 -- 172.21.15.79:0/3770294889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5815b5d0 con 0x7fcd58072ca0 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.581+0000 7fcd567fc640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58073080 0x7fcd580b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.582+0000 7fcd56ffd640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5815b090 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.582+0000 7fcd3f7fe640 1 -- 172.21.15.79:0/3770294889 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48037040 con 0x7fcd58072ca0 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.582+0000 7fcd3f7fe640 1 -- 172.21.15.79:0/3770294889 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48042070 con 0x7fcd58072ca0 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.582+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd580b2db0 con 0x7fcd58072ca0 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.582+0000 7fcd3f7fe640 1 -- 172.21.15.79:0/3770294889 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48030bb0 con 0x7fcd58072ca0 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.582+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd580b3370 con 0x7fcd58072ca0 2024-06-10T00:20:27.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.583+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd58068430 con 0x7fcd58072ca0 2024-06-10T00:20:27.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.583+0000 7fcd3f7fe640 1 -- 172.21.15.79:0/3770294889 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd48047460 con 0x7fcd58072ca0 2024-06-10T00:20:27.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.584+0000 7fcd3f7fe640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd4406be30 0x7fcd4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.584+0000 7fcd3f7fe640 1 -- 172.21.15.79:0/3770294889 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fcd480abbd0 con 0x7fcd58072ca0 2024-06-10T00:20:27.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.584+0000 7fcd567fc640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd4406be30 0x7fcd4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.584+0000 7fcd567fc640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd4406be30 0x7fcd4406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcd5815f780 tx=0x7fcd4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.588+0000 7fcd3f7fe640 1 -- 172.21.15.79:0/3770294889 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcd5815b5d0 con 0x7fcd58072ca0 2024-06-10T00:20:27.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.756+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd580b0b90 con 0x7fcd4406be30 2024-06-10T00:20:27.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.762+0000 7fcd3f7fe640 1 -- 172.21.15.79:0/3770294889 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7fcd4c055890 con 0x7fcd4406be30 2024-06-10T00:20:27.765 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:27.766 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:20:27.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd4406be30 msgr2=0x7fcd4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd4406be30 0x7fcd4406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcd5815f780 tx=0x7fcd4c009040 comp rx=0 tx=0).stop 2024-06-10T00:20:27.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 msgr2=0x7fcd5815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5815b090 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd480046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 shutdown_connections 2024-06-10T00:20:27.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd4406be30 0x7fcd4406e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd58160190 0x7fcd581f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd58073080 0x7fcd580b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 --2- 172.21.15.79:0/3770294889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd58072ca0 0x7fcd5815b090 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 >> 172.21.15.79:0/3770294889 conn(0x7fcd580b1bb0 msgr2=0x7fcd580cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:27.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 shutdown_connections 2024-06-10T00:20:27.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.765+0000 7fcd5d615640 1 -- 172.21.15.79:0/3770294889 wait complete. 2024-06-10T00:20:27.776 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-06-10T00:20:27.222349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246664,"kb_used_data":9644,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728056,"statfs":{"total":773094113280,"available":772841529344,"internally_reserved":0,"allocated":9875456,"data_stored":5134168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.421170"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840641+0000","last_change":"2024-06-10T00:20:24.835466+0000","last_active":"2024-06-10T00:20:24.840641+0000","last_peered":"2024-06-10T00:20:24.840641+0000","last_clean":"2024-06-10T00:20:24.840641+0000","last_became_active":"2024-06-10T00:20:24.835183+0000","last_became_peered":"2024-06-10T00:20:24.835183+0000","last_unstale":"2024-06-10T00:20:24.840641+0000","last_undegraded":"2024-06-10T00:20:24.840641+0000","last_fullsized":"2024-06-10T00:20:24.840641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:43.121641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815471+0000","last_change":"2024-06-10T00:20:24.840547+0000","last_active":"2024-06-10T00:20:25.815471+0000","last_peered":"2024-06-10T00:20:25.815471+0000","last_clean":"2024-06-10T00:20:25.815471+0000","last_became_active":"2024-06-10T00:20:24.840293+0000","last_became_peered":"2024-06-10T00:20:24.840293+0000","last_unstale":"2024-06-10T00:20:25.815471+0000","last_undegraded":"2024-06-10T00:20:25.815471+0000","last_fullsized":"2024-06-10T00:20:25.815471+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:32.543158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.831547+0000","last_change":"2024-06-10T00:20:24.828559+0000","last_active":"2024-06-10T00:20:24.831547+0000","last_peered":"2024-06-10T00:20:24.831547+0000","last_clean":"2024-06-10T00:20:24.831547+0000","last_became_active":"2024-06-10T00:20:24.828175+0000","last_became_peered":"2024-06-10T00:20:24.828175+0000","last_unstale":"2024-06-10T00:20:24.831547+0000","last_undegraded":"2024-06-10T00:20:24.831547+0000","last_fullsized":"2024-06-10T00:20:24.831547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:18:44.058942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853504+0000","last_change":"2024-06-10T00:20:24.850918+0000","last_active":"2024-06-10T00:20:24.853504+0000","last_peered":"2024-06-10T00:20:24.853504+0000","last_clean":"2024-06-10T00:20:24.853504+0000","last_became_active":"2024-06-10T00:20:24.850635+0000","last_became_peered":"2024-06-10T00:20:24.850635+0000","last_unstale":"2024-06-10T00:20:24.853504+0000","last_undegraded":"2024-06-10T00:20:24.853504+0000","last_fullsized":"2024-06-10T00:20:24.853504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:04:43.397893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815084+0000","last_change":"2024-06-10T00:20:24.828593+0000","last_active":"2024-06-10T00:20:25.815084+0000","last_peered":"2024-06-10T00:20:25.815084+0000","last_clean":"2024-06-10T00:20:25.815084+0000","last_became_active":"2024-06-10T00:20:24.828309+0000","last_became_peered":"2024-06-10T00:20:24.828309+0000","last_unstale":"2024-06-10T00:20:25.815084+0000","last_undegraded":"2024-06-10T00:20:25.815084+0000","last_fullsized":"2024-06-10T00:20:25.815084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:56:42.976643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.851291+0000","last_change":"2024-06-10T00:20:24.845309+0000","last_active":"2024-06-10T00:20:24.851291+0000","last_peered":"2024-06-10T00:20:24.851291+0000","last_clean":"2024-06-10T00:20:24.851291+0000","last_became_active":"2024-06-10T00:20:24.845049+0000","last_became_peered":"2024-06-10T00:20:24.845049+0000","last_unstale":"2024-06-10T00:20:24.851291+0000","last_undegraded":"2024-06-10T00:20:24.851291+0000","last_fullsized":"2024-06-10T00:20:24.851291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:10:45.128805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.824624+0000","last_change":"2024-06-10T00:20:24.819729+0000","last_active":"2024-06-10T00:20:24.824624+0000","last_peered":"2024-06-10T00:20:24.824624+0000","last_clean":"2024-06-10T00:20:24.824624+0000","last_became_active":"2024-06-10T00:20:24.819420+0000","last_became_peered":"2024-06-10T00:20:24.819420+0000","last_unstale":"2024-06-10T00:20:24.824624+0000","last_undegraded":"2024-06-10T00:20:24.824624+0000","last_fullsized":"2024-06-10T00:20:24.824624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:49:36.811442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.847456+0000","last_change":"2024-06-10T00:20:24.844936+0000","last_active":"2024-06-10T00:20:24.847456+0000","last_peered":"2024-06-10T00:20:24.847456+0000","last_clean":"2024-06-10T00:20:24.847456+0000","last_became_active":"2024-06-10T00:20:24.844464+0000","last_became_peered":"2024-06-10T00:20:24.844464+0000","last_unstale":"2024-06-10T00:20:24.847456+0000","last_undegraded":"2024-06-10T00:20:24.847456+0000","last_fullsized":"2024-06-10T00:20:24.847456+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:29:31.593107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815615+0000","last_change":"2024-06-10T00:20:24.833738+0000","last_active":"2024-06-10T00:20:25.815615+0000","last_peered":"2024-06-10T00:20:25.815615+0000","last_clean":"2024-06-10T00:20:25.815615+0000","last_became_active":"2024-06-10T00:20:24.833364+0000","last_became_peered":"2024-06-10T00:20:24.833364+0000","last_unstale":"2024-06-10T00:20:25.815615+0000","last_undegraded":"2024-06-10T00:20:25.815615+0000","last_fullsized":"2024-06-10T00:20:25.815615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:10.575502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814701+0000","last_change":"2024-06-10T00:20:24.838929+0000","last_active":"2024-06-10T00:20:25.814701+0000","last_peered":"2024-06-10T00:20:25.814701+0000","last_clean":"2024-06-10T00:20:25.814701+0000","last_became_active":"2024-06-10T00:20:24.838653+0000","last_became_peered":"2024-06-10T00:20:24.838653+0000","last_unstale":"2024-06-10T00:20:25.814701+0000","last_undegraded":"2024-06-10T00:20:25.814701+0000","last_fullsized":"2024-06-10T00:20:25.814701+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:26.671023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815465+0000","last_change":"2024-06-10T00:20:24.834541+0000","last_active":"2024-06-10T00:20:25.815465+0000","last_peered":"2024-06-10T00:20:25.815465+0000","last_clean":"2024-06-10T00:20:25.815465+0000","last_became_active":"2024-06-10T00:20:24.834231+0000","last_became_peered":"2024-06-10T00:20:24.834231+0000","last_unstale":"2024-06-10T00:20:25.815465+0000","last_undegraded":"2024-06-10T00:20:25.815465+0000","last_fullsized":"2024-06-10T00:20:25.815465+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:05:18.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814717+0000","last_change":"2024-06-10T00:20:24.831685+0000","last_active":"2024-06-10T00:20:25.814717+0000","last_peered":"2024-06-10T00:20:25.814717+0000","last_clean":"2024-06-10T00:20:25.814717+0000","last_became_active":"2024-06-10T00:20:24.831410+0000","last_became_peered":"2024-06-10T00:20:24.831410+0000","last_unstale":"2024-06-10T00:20:25.814717+0000","last_undegraded":"2024-06-10T00:20:25.814717+0000","last_fullsized":"2024-06-10T00:20:25.814717+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:02:19.609988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.846272+0000","last_change":"2024-06-10T00:20:24.842099+0000","last_active":"2024-06-10T00:20:24.846272+0000","last_peered":"2024-06-10T00:20:24.846272+0000","last_clean":"2024-06-10T00:20:24.846272+0000","last_became_active":"2024-06-10T00:20:24.841840+0000","last_became_peered":"2024-06-10T00:20:24.841840+0000","last_unstale":"2024-06-10T00:20:24.846272+0000","last_undegraded":"2024-06-10T00:20:24.846272+0000","last_fullsized":"2024-06-10T00:20:24.846272+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:22:24.874069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814886+0000","last_change":"2024-06-10T00:20:24.842613+0000","last_active":"2024-06-10T00:20:25.814886+0000","last_peered":"2024-06-10T00:20:25.814886+0000","last_clean":"2024-06-10T00:20:25.814886+0000","last_became_active":"2024-06-10T00:20:24.841722+0000","last_became_peered":"2024-06-10T00:20:24.841722+0000","last_unstale":"2024-06-10T00:20:25.814886+0000","last_undegraded":"2024-06-10T00:20:25.814886+0000","last_fullsized":"2024-06-10T00:20:25.814886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:48:32.454083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840914+0000","last_change":"2024-06-10T00:20:24.837084+0000","last_active":"2024-06-10T00:20:24.840914+0000","last_peered":"2024-06-10T00:20:24.840914+0000","last_clean":"2024-06-10T00:20:24.840914+0000","last_became_active":"2024-06-10T00:20:24.836757+0000","last_became_peered":"2024-06-10T00:20:24.836757+0000","last_unstale":"2024-06-10T00:20:24.840914+0000","last_undegraded":"2024-06-10T00:20:24.840914+0000","last_fullsized":"2024-06-10T00:20:24.840914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:27:06.327289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.842983+0000","last_change":"2024-06-10T00:20:24.832881+0000","last_active":"2024-06-10T00:20:24.842983+0000","last_peered":"2024-06-10T00:20:24.842983+0000","last_clean":"2024-06-10T00:20:24.842983+0000","last_became_active":"2024-06-10T00:20:24.832608+0000","last_became_peered":"2024-06-10T00:20:24.832608+0000","last_unstale":"2024-06-10T00:20:24.842983+0000","last_undegraded":"2024-06-10T00:20:24.842983+0000","last_fullsized":"2024-06-10T00:20:24.842983+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:32.543158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.850702+0000","last_change":"2024-06-10T00:20:24.846183+0000","last_active":"2024-06-10T00:20:24.850702+0000","last_peered":"2024-06-10T00:20:24.850702+0000","last_clean":"2024-06-10T00:20:24.850702+0000","last_became_active":"2024-06-10T00:20:24.845866+0000","last_became_peered":"2024-06-10T00:20:24.845866+0000","last_unstale":"2024-06-10T00:20:24.850702+0000","last_undegraded":"2024-06-10T00:20:24.850702+0000","last_fullsized":"2024-06-10T00:20:24.850702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:34.453387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840884+0000","last_change":"2024-06-10T00:20:24.838286+0000","last_active":"2024-06-10T00:20:24.840884+0000","last_peered":"2024-06-10T00:20:24.840884+0000","last_clean":"2024-06-10T00:20:24.840884+0000","last_became_active":"2024-06-10T00:20:24.838018+0000","last_became_peered":"2024-06-10T00:20:24.838018+0000","last_unstale":"2024-06-10T00:20:24.840884+0000","last_undegraded":"2024-06-10T00:20:24.840884+0000","last_fullsized":"2024-06-10T00:20:24.840884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:48.404062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815689+0000","last_change":"2024-06-10T00:20:24.842117+0000","last_active":"2024-06-10T00:20:25.815689+0000","last_peered":"2024-06-10T00:20:25.815689+0000","last_clean":"2024-06-10T00:20:25.815689+0000","last_became_active":"2024-06-10T00:20:24.841506+0000","last_became_peered":"2024-06-10T00:20:24.841506+0000","last_unstale":"2024-06-10T00:20:25.815689+0000","last_undegraded":"2024-06-10T00:20:25.815689+0000","last_fullsized":"2024-06-10T00:20:25.815689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:07:34.238512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.847422+0000","last_change":"2024-06-10T00:20:24.844407+0000","last_active":"2024-06-10T00:20:24.847422+0000","last_peered":"2024-06-10T00:20:24.847422+0000","last_clean":"2024-06-10T00:20:24.847422+0000","last_became_active":"2024-06-10T00:20:24.843920+0000","last_became_peered":"2024-06-10T00:20:24.843920+0000","last_unstale":"2024-06-10T00:20:24.847422+0000","last_undegraded":"2024-06-10T00:20:24.847422+0000","last_fullsized":"2024-06-10T00:20:24.847422+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:47:30.024848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814805+0000","last_change":"2024-06-10T00:20:24.821781+0000","last_active":"2024-06-10T00:20:25.814805+0000","last_peered":"2024-06-10T00:20:25.814805+0000","last_clean":"2024-06-10T00:20:25.814805+0000","last_became_active":"2024-06-10T00:20:24.821500+0000","last_became_peered":"2024-06-10T00:20:24.821500+0000","last_unstale":"2024-06-10T00:20:25.814805+0000","last_undegraded":"2024-06-10T00:20:25.814805+0000","last_fullsized":"2024-06-10T00:20:25.814805+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:16:16.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814609+0000","last_change":"2024-06-10T00:20:24.841708+0000","last_active":"2024-06-10T00:20:25.814609+0000","last_peered":"2024-06-10T00:20:25.814609+0000","last_clean":"2024-06-10T00:20:25.814609+0000","last_became_active":"2024-06-10T00:20:24.841413+0000","last_became_peered":"2024-06-10T00:20:24.841413+0000","last_unstale":"2024-06-10T00:20:25.814609+0000","last_undegraded":"2024-06-10T00:20:25.814609+0000","last_fullsized":"2024-06-10T00:20:25.814609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:29:31.593107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.843925+0000","last_change":"2024-06-10T00:20:24.842981+0000","last_active":"2024-06-10T00:20:24.843925+0000","last_peered":"2024-06-10T00:20:24.843925+0000","last_clean":"2024-06-10T00:20:24.843925+0000","last_became_active":"2024-06-10T00:20:24.842690+0000","last_became_peered":"2024-06-10T00:20:24.842690+0000","last_unstale":"2024-06-10T00:20:24.843925+0000","last_undegraded":"2024-06-10T00:20:24.843925+0000","last_fullsized":"2024-06-10T00:20:24.843925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:48:32.454083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.831766+0000","last_change":"2024-06-10T00:20:24.828487+0000","last_active":"2024-06-10T00:20:24.831766+0000","last_peered":"2024-06-10T00:20:24.831766+0000","last_clean":"2024-06-10T00:20:24.831766+0000","last_became_active":"2024-06-10T00:20:24.828125+0000","last_became_peered":"2024-06-10T00:20:24.828125+0000","last_unstale":"2024-06-10T00:20:24.831766+0000","last_undegraded":"2024-06-10T00:20:24.831766+0000","last_fullsized":"2024-06-10T00:20:24.831766+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:48.483601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815778+0000","last_change":"2024-06-10T00:20:24.837058+0000","last_active":"2024-06-10T00:20:25.815778+0000","last_peered":"2024-06-10T00:20:25.815778+0000","last_clean":"2024-06-10T00:20:25.815778+0000","last_became_active":"2024-06-10T00:20:24.836778+0000","last_became_peered":"2024-06-10T00:20:24.836778+0000","last_unstale":"2024-06-10T00:20:25.815778+0000","last_undegraded":"2024-06-10T00:20:25.815778+0000","last_fullsized":"2024-06-10T00:20:25.815778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:34:10.381026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814991+0000","last_change":"2024-06-10T00:20:24.842438+0000","last_active":"2024-06-10T00:20:25.814991+0000","last_peered":"2024-06-10T00:20:25.814991+0000","last_clean":"2024-06-10T00:20:25.814991+0000","last_became_active":"2024-06-10T00:20:24.841922+0000","last_became_peered":"2024-06-10T00:20:24.841922+0000","last_unstale":"2024-06-10T00:20:25.814991+0000","last_undegraded":"2024-06-10T00:20:25.814991+0000","last_fullsized":"2024-06-10T00:20:25.814991+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:04:43.397893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814702+0000","last_change":"2024-06-10T00:20:24.835997+0000","last_active":"2024-06-10T00:20:25.814702+0000","last_peered":"2024-06-10T00:20:25.814702+0000","last_clean":"2024-06-10T00:20:25.814702+0000","last_became_active":"2024-06-10T00:20:24.835727+0000","last_became_peered":"2024-06-10T00:20:24.835727+0000","last_unstale":"2024-06-10T00:20:25.814702+0000","last_undegraded":"2024-06-10T00:20:25.814702+0000","last_fullsized":"2024-06-10T00:20:25.814702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:37:00.939793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853418+0000","last_change":"2024-06-10T00:20:24.849045+0000","last_active":"2024-06-10T00:20:24.853418+0000","last_peered":"2024-06-10T00:20:24.853418+0000","last_clean":"2024-06-10T00:20:24.853418+0000","last_became_active":"2024-06-10T00:20:24.848658+0000","last_became_peered":"2024-06-10T00:20:24.848658+0000","last_unstale":"2024-06-10T00:20:24.853418+0000","last_undegraded":"2024-06-10T00:20:24.853418+0000","last_fullsized":"2024-06-10T00:20:24.853418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:48:32.454083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.833463+0000","last_change":"2024-06-10T00:20:24.830270+0000","last_active":"2024-06-10T00:20:24.833463+0000","last_peered":"2024-06-10T00:20:24.833463+0000","last_clean":"2024-06-10T00:20:24.833463+0000","last_became_active":"2024-06-10T00:20:24.829770+0000","last_became_peered":"2024-06-10T00:20:24.829770+0000","last_unstale":"2024-06-10T00:20:24.833463+0000","last_undegraded":"2024-06-10T00:20:24.833463+0000","last_fullsized":"2024-06-10T00:20:24.833463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:56:19.337651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814916+0000","last_change":"2024-06-10T00:20:24.833002+0000","last_active":"2024-06-10T00:20:25.814916+0000","last_peered":"2024-06-10T00:20:25.814916+0000","last_clean":"2024-06-10T00:20:25.814916+0000","last_became_active":"2024-06-10T00:20:24.832613+0000","last_became_peered":"2024-06-10T00:20:24.832613+0000","last_unstale":"2024-06-10T00:20:25.814916+0000","last_undegraded":"2024-06-10T00:20:25.814916+0000","last_fullsized":"2024-06-10T00:20:25.814916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:36:16.140350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814702+0000","last_change":"2024-06-10T00:20:24.841534+0000","last_active":"2024-06-10T00:20:25.814702+0000","last_peered":"2024-06-10T00:20:25.814702+0000","last_clean":"2024-06-10T00:20:25.814702+0000","last_became_active":"2024-06-10T00:20:24.841239+0000","last_became_peered":"2024-06-10T00:20:24.841239+0000","last_unstale":"2024-06-10T00:20:25.814702+0000","last_undegraded":"2024-06-10T00:20:25.814702+0000","last_fullsized":"2024-06-10T00:20:25.814702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:48.404062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.843332+0000","last_change":"2024-06-10T00:20:24.837535+0000","last_active":"2024-06-10T00:20:24.843332+0000","last_peered":"2024-06-10T00:20:24.843332+0000","last_clean":"2024-06-10T00:20:24.843332+0000","last_became_active":"2024-06-10T00:20:24.831551+0000","last_became_peered":"2024-06-10T00:20:24.831551+0000","last_unstale":"2024-06-10T00:20:24.843332+0000","last_undegraded":"2024-06-10T00:20:24.843332+0000","last_fullsized":"2024-06-10T00:20:24.843332+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:56:19.337651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.843411+0000","last_change":"2024-06-10T00:20:24.837754+0000","last_active":"2024-06-10T00:20:24.843411+0000","last_peered":"2024-06-10T00:20:24.843411+0000","last_clean":"2024-06-10T00:20:24.843411+0000","last_became_active":"2024-06-10T00:20:24.833514+0000","last_became_peered":"2024-06-10T00:20:24.833514+0000","last_unstale":"2024-06-10T00:20:24.843411+0000","last_undegraded":"2024-06-10T00:20:24.843411+0000","last_fullsized":"2024-06-10T00:20:24.843411+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:28.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"87'4","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.847415+0000","last_change":"2024-06-10T00:20:23.829851+0000","last_active":"2024-06-10T00:20:24.847415+0000","last_peered":"2024-06-10T00:20:24.847415+0000","last_clean":"2024-06-10T00:20:24.847415+0000","last_became_active":"2024-06-10T00:20:23.829513+0000","last_became_peered":"2024-06-10T00:20:23.829513+0000","last_unstale":"2024-06-10T00:20:24.847415+0000","last_undegraded":"2024-06-10T00:20:24.847415+0000","last_fullsized":"2024-06-10T00:20:24.847415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:28:27.707374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.844949+0000","last_change":"2024-06-10T00:20:24.836832+0000","last_active":"2024-06-10T00:20:24.844949+0000","last_peered":"2024-06-10T00:20:24.844949+0000","last_clean":"2024-06-10T00:20:24.844949+0000","last_became_active":"2024-06-10T00:20:24.833406+0000","last_became_peered":"2024-06-10T00:20:24.833406+0000","last_unstale":"2024-06-10T00:20:24.844949+0000","last_undegraded":"2024-06-10T00:20:24.844949+0000","last_fullsized":"2024-06-10T00:20:24.844949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:34:10.381026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815212+0000","last_change":"2024-06-10T00:20:23.830532+0000","last_active":"2024-06-10T00:20:25.815212+0000","last_peered":"2024-06-10T00:20:25.815212+0000","last_clean":"2024-06-10T00:20:25.815212+0000","last_became_active":"2024-06-10T00:20:23.830233+0000","last_became_peered":"2024-06-10T00:20:23.830233+0000","last_unstale":"2024-06-10T00:20:25.815212+0000","last_undegraded":"2024-06-10T00:20:25.815212+0000","last_fullsized":"2024-06-10T00:20:25.815212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:57:44.266601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840637+0000","last_change":"2024-06-10T00:20:24.838882+0000","last_active":"2024-06-10T00:20:24.840637+0000","last_peered":"2024-06-10T00:20:24.840637+0000","last_clean":"2024-06-10T00:20:24.840637+0000","last_became_active":"2024-06-10T00:20:24.838639+0000","last_became_peered":"2024-06-10T00:20:24.838639+0000","last_unstale":"2024-06-10T00:20:24.840637+0000","last_undegraded":"2024-06-10T00:20:24.840637+0000","last_fullsized":"2024-06-10T00:20:24.840637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:28.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.837607+0000","last_change":"2024-06-10T00:20:23.831486+0000","last_active":"2024-06-10T00:20:24.837607+0000","last_peered":"2024-06-10T00:20:24.837607+0000","last_clean":"2024-06-10T00:20:24.837607+0000","last_became_active":"2024-06-10T00:20:23.831223+0000","last_became_peered":"2024-06-10T00:20:23.831223+0000","last_unstale":"2024-06-10T00:20:24.837607+0000","last_undegraded":"2024-06-10T00:20:24.837607+0000","last_fullsized":"2024-06-10T00:20:24.837607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:43:05.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.846310+0000","last_change":"2024-06-10T00:20:24.841273+0000","last_active":"2024-06-10T00:20:24.846310+0000","last_peered":"2024-06-10T00:20:24.846310+0000","last_clean":"2024-06-10T00:20:24.846310+0000","last_became_active":"2024-06-10T00:20:24.841024+0000","last_became_peered":"2024-06-10T00:20:24.841024+0000","last_unstale":"2024-06-10T00:20:24.846310+0000","last_undegraded":"2024-06-10T00:20:24.846310+0000","last_fullsized":"2024-06-10T00:20:24.846310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:37:22.691456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853650+0000","last_change":"2024-06-10T00:20:23.833915+0000","last_active":"2024-06-10T00:20:24.853650+0000","last_peered":"2024-06-10T00:20:24.853650+0000","last_clean":"2024-06-10T00:20:24.853650+0000","last_became_active":"2024-06-10T00:20:23.833374+0000","last_became_peered":"2024-06-10T00:20:23.833374+0000","last_unstale":"2024-06-10T00:20:24.853650+0000","last_undegraded":"2024-06-10T00:20:24.853650+0000","last_fullsized":"2024-06-10T00:20:24.853650+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:58:41.246212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.850728+0000","last_change":"2024-06-10T00:20:24.846310+0000","last_active":"2024-06-10T00:20:24.850728+0000","last_peered":"2024-06-10T00:20:24.850728+0000","last_clean":"2024-06-10T00:20:24.850728+0000","last_became_active":"2024-06-10T00:20:24.843846+0000","last_became_peered":"2024-06-10T00:20:24.843846+0000","last_unstale":"2024-06-10T00:20:24.850728+0000","last_undegraded":"2024-06-10T00:20:24.850728+0000","last_fullsized":"2024-06-10T00:20:24.850728+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:16:16.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815198+0000","last_change":"2024-06-10T00:20:23.831530+0000","last_active":"2024-06-10T00:20:25.815198+0000","last_peered":"2024-06-10T00:20:25.815198+0000","last_clean":"2024-06-10T00:20:25.815198+0000","last_became_active":"2024-06-10T00:20:23.831226+0000","last_became_peered":"2024-06-10T00:20:23.831226+0000","last_unstale":"2024-06-10T00:20:25.815198+0000","last_undegraded":"2024-06-10T00:20:25.815198+0000","last_fullsized":"2024-06-10T00:20:25.815198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:21:00.707248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.835091+0000","last_change":"2024-06-10T00:20:24.829569+0000","last_active":"2024-06-10T00:20:24.835091+0000","last_peered":"2024-06-10T00:20:24.835091+0000","last_clean":"2024-06-10T00:20:24.835091+0000","last_became_active":"2024-06-10T00:20:24.829292+0000","last_became_peered":"2024-06-10T00:20:24.829292+0000","last_unstale":"2024-06-10T00:20:24.835091+0000","last_undegraded":"2024-06-10T00:20:24.835091+0000","last_fullsized":"2024-06-10T00:20:24.835091+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:10:24.518193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.851997+0000","last_change":"2024-06-10T00:20:23.829696+0000","last_active":"2024-06-10T00:20:24.851997+0000","last_peered":"2024-06-10T00:20:24.851997+0000","last_clean":"2024-06-10T00:20:24.851997+0000","last_became_active":"2024-06-10T00:20:23.829426+0000","last_became_peered":"2024-06-10T00:20:23.829426+0000","last_unstale":"2024-06-10T00:20:24.851997+0000","last_undegraded":"2024-06-10T00:20:24.851997+0000","last_fullsized":"2024-06-10T00:20:24.851997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:28:27.707374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.851249+0000","last_change":"2024-06-10T00:20:24.845287+0000","last_active":"2024-06-10T00:20:24.851249+0000","last_peered":"2024-06-10T00:20:24.851249+0000","last_clean":"2024-06-10T00:20:24.851249+0000","last_became_active":"2024-06-10T00:20:24.844958+0000","last_became_peered":"2024-06-10T00:20:24.844958+0000","last_unstale":"2024-06-10T00:20:24.851249+0000","last_undegraded":"2024-06-10T00:20:24.851249+0000","last_fullsized":"2024-06-10T00:20:24.851249+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:20:33.736293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.817977+0000","last_change":"2024-06-10T00:20:23.826271+0000","last_active":"2024-06-10T00:20:24.817977+0000","last_peered":"2024-06-10T00:20:24.817977+0000","last_clean":"2024-06-10T00:20:24.817977+0000","last_became_active":"2024-06-10T00:20:23.825914+0000","last_became_peered":"2024-06-10T00:20:23.825914+0000","last_unstale":"2024-06-10T00:20:24.817977+0000","last_undegraded":"2024-06-10T00:20:24.817977+0000","last_fullsized":"2024-06-10T00:20:24.817977+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:07:33.236562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853456+0000","last_change":"2024-06-10T00:20:24.850245+0000","last_active":"2024-06-10T00:20:24.853456+0000","last_peered":"2024-06-10T00:20:24.853456+0000","last_clean":"2024-06-10T00:20:24.853456+0000","last_became_active":"2024-06-10T00:20:24.849989+0000","last_became_peered":"2024-06-10T00:20:24.849989+0000","last_unstale":"2024-06-10T00:20:24.853456+0000","last_undegraded":"2024-06-10T00:20:24.853456+0000","last_fullsized":"2024-06-10T00:20:24.853456+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:36:16.140350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.813778+0000","last_change":"2024-06-10T00:20:23.833612+0000","last_active":"2024-06-10T00:20:24.813778+0000","last_peered":"2024-06-10T00:20:24.813778+0000","last_clean":"2024-06-10T00:20:24.813778+0000","last_became_active":"2024-06-10T00:20:23.833312+0000","last_became_peered":"2024-06-10T00:20:23.833312+0000","last_unstale":"2024-06-10T00:20:24.813778+0000","last_undegraded":"2024-06-10T00:20:24.813778+0000","last_fullsized":"2024-06-10T00:20:24.813778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:42.119692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815883+0000","last_change":"2024-06-10T00:20:24.819444+0000","last_active":"2024-06-10T00:20:25.815883+0000","last_peered":"2024-06-10T00:20:25.815883+0000","last_clean":"2024-06-10T00:20:25.815883+0000","last_became_active":"2024-06-10T00:20:24.819135+0000","last_became_peered":"2024-06-10T00:20:24.819135+0000","last_unstale":"2024-06-10T00:20:25.815883+0000","last_undegraded":"2024-06-10T00:20:25.815883+0000","last_fullsized":"2024-06-10T00:20:25.815883+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:30:21.654210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815890+0000","last_change":"2024-06-10T00:20:23.832744+0000","last_active":"2024-06-10T00:20:25.815890+0000","last_peered":"2024-06-10T00:20:25.815890+0000","last_clean":"2024-06-10T00:20:25.815890+0000","last_became_active":"2024-06-10T00:20:23.832456+0000","last_became_peered":"2024-06-10T00:20:23.832456+0000","last_unstale":"2024-06-10T00:20:25.815890+0000","last_undegraded":"2024-06-10T00:20:25.815890+0000","last_fullsized":"2024-06-10T00:20:25.815890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:09.573552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.826643+0000","last_change":"2024-06-10T00:20:24.821610+0000","last_active":"2024-06-10T00:20:24.826643+0000","last_peered":"2024-06-10T00:20:24.826643+0000","last_clean":"2024-06-10T00:20:24.826643+0000","last_became_active":"2024-06-10T00:20:24.821343+0000","last_became_peered":"2024-06-10T00:20:24.821343+0000","last_unstale":"2024-06-10T00:20:24.826643+0000","last_undegraded":"2024-06-10T00:20:24.826643+0000","last_fullsized":"2024-06-10T00:20:24.826643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:23:20.121538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.818048+0000","last_change":"2024-06-10T00:20:23.831252+0000","last_active":"2024-06-10T00:20:24.818048+0000","last_peered":"2024-06-10T00:20:24.818048+0000","last_clean":"2024-06-10T00:20:24.818048+0000","last_became_active":"2024-06-10T00:20:23.830972+0000","last_became_peered":"2024-06-10T00:20:23.830972+0000","last_unstale":"2024-06-10T00:20:24.818048+0000","last_undegraded":"2024-06-10T00:20:24.818048+0000","last_fullsized":"2024-06-10T00:20:24.818048+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:30:20.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840860+0000","last_change":"2024-06-10T00:20:24.836278+0000","last_active":"2024-06-10T00:20:24.840860+0000","last_peered":"2024-06-10T00:20:24.840860+0000","last_clean":"2024-06-10T00:20:24.840860+0000","last_became_active":"2024-06-10T00:20:24.836025+0000","last_became_peered":"2024-06-10T00:20:24.836025+0000","last_unstale":"2024-06-10T00:20:24.840860+0000","last_undegraded":"2024-06-10T00:20:24.840860+0000","last_fullsized":"2024-06-10T00:20:24.840860+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:31:15.375988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815806+0000","last_change":"2024-06-10T00:20:23.828555+0000","last_active":"2024-06-10T00:20:25.815806+0000","last_peered":"2024-06-10T00:20:25.815806+0000","last_clean":"2024-06-10T00:20:25.815806+0000","last_became_active":"2024-06-10T00:20:23.828275+0000","last_became_peered":"2024-06-10T00:20:23.828275+0000","last_unstale":"2024-06-10T00:20:25.815806+0000","last_undegraded":"2024-06-10T00:20:25.815806+0000","last_fullsized":"2024-06-10T00:20:25.815806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:36:27.144269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853541+0000","last_change":"2024-06-10T00:20:24.852319+0000","last_active":"2024-06-10T00:20:24.853541+0000","last_peered":"2024-06-10T00:20:24.853541+0000","last_clean":"2024-06-10T00:20:24.853541+0000","last_became_active":"2024-06-10T00:20:24.852055+0000","last_became_peered":"2024-06-10T00:20:24.852055+0000","last_unstale":"2024-06-10T00:20:24.853541+0000","last_undegraded":"2024-06-10T00:20:24.853541+0000","last_fullsized":"2024-06-10T00:20:24.853541+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:06:42.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.850972+0000","last_change":"2024-06-10T00:20:23.833625+0000","last_active":"2024-06-10T00:20:24.850972+0000","last_peered":"2024-06-10T00:20:24.850972+0000","last_clean":"2024-06-10T00:20:24.850972+0000","last_became_active":"2024-06-10T00:20:23.833277+0000","last_became_peered":"2024-06-10T00:20:23.833277+0000","last_unstale":"2024-06-10T00:20:24.850972+0000","last_undegraded":"2024-06-10T00:20:24.850972+0000","last_fullsized":"2024-06-10T00:20:24.850972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:31:14.374039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.847424+0000","last_change":"2024-06-10T00:20:24.844705+0000","last_active":"2024-06-10T00:20:24.847424+0000","last_peered":"2024-06-10T00:20:24.847424+0000","last_clean":"2024-06-10T00:20:24.847424+0000","last_became_active":"2024-06-10T00:20:24.844125+0000","last_became_peered":"2024-06-10T00:20:24.844125+0000","last_unstale":"2024-06-10T00:20:24.847424+0000","last_undegraded":"2024-06-10T00:20:24.847424+0000","last_fullsized":"2024-06-10T00:20:24.847424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:10:24.518193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.846248+0000","last_change":"2024-06-10T00:20:23.834949+0000","last_active":"2024-06-10T00:20:24.846248+0000","last_peered":"2024-06-10T00:20:24.846248+0000","last_clean":"2024-06-10T00:20:24.846248+0000","last_became_active":"2024-06-10T00:20:23.834597+0000","last_became_peered":"2024-06-10T00:20:23.834597+0000","last_unstale":"2024-06-10T00:20:24.846248+0000","last_undegraded":"2024-06-10T00:20:24.846248+0000","last_fullsized":"2024-06-10T00:20:24.846248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:49:49.573834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814980+0000","last_change":"2024-06-10T00:20:24.828696+0000","last_active":"2024-06-10T00:20:25.814980+0000","last_peered":"2024-06-10T00:20:25.814980+0000","last_clean":"2024-06-10T00:20:25.814980+0000","last_became_active":"2024-06-10T00:20:24.828229+0000","last_became_peered":"2024-06-10T00:20:24.828229+0000","last_unstale":"2024-06-10T00:20:25.814980+0000","last_undegraded":"2024-06-10T00:20:25.814980+0000","last_fullsized":"2024-06-10T00:20:25.814980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:06:42.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.824979+0000","last_change":"2024-06-10T00:20:23.833777+0000","last_active":"2024-06-10T00:20:24.824979+0000","last_peered":"2024-06-10T00:20:24.824979+0000","last_clean":"2024-06-10T00:20:24.824979+0000","last_became_active":"2024-06-10T00:20:23.833467+0000","last_became_peered":"2024-06-10T00:20:23.833467+0000","last_unstale":"2024-06-10T00:20:24.824979+0000","last_undegraded":"2024-06-10T00:20:24.824979+0000","last_fullsized":"2024-06-10T00:20:24.824979+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:42.119692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814503+0000","last_change":"2024-06-10T00:20:24.844822+0000","last_active":"2024-06-10T00:20:25.814503+0000","last_peered":"2024-06-10T00:20:25.814503+0000","last_clean":"2024-06-10T00:20:25.814503+0000","last_became_active":"2024-06-10T00:20:24.844493+0000","last_became_peered":"2024-06-10T00:20:24.844493+0000","last_unstale":"2024-06-10T00:20:25.814503+0000","last_undegraded":"2024-06-10T00:20:25.814503+0000","last_fullsized":"2024-06-10T00:20:25.814503+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:54:44.628734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.838857+0000","last_change":"2024-06-10T00:20:23.822220+0000","last_active":"2024-06-10T00:20:24.838857+0000","last_peered":"2024-06-10T00:20:24.838857+0000","last_clean":"2024-06-10T00:20:24.838857+0000","last_became_active":"2024-06-10T00:20:23.821825+0000","last_became_peered":"2024-06-10T00:20:23.821825+0000","last_unstale":"2024-06-10T00:20:24.838857+0000","last_undegraded":"2024-06-10T00:20:24.838857+0000","last_fullsized":"2024-06-10T00:20:24.838857+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:58:41.246212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814663+0000","last_change":"2024-06-10T00:20:24.836183+0000","last_active":"2024-06-10T00:20:25.814663+0000","last_peered":"2024-06-10T00:20:25.814663+0000","last_clean":"2024-06-10T00:20:25.814663+0000","last_became_active":"2024-06-10T00:20:24.835914+0000","last_became_peered":"2024-06-10T00:20:24.835914+0000","last_unstale":"2024-06-10T00:20:25.814663+0000","last_undegraded":"2024-06-10T00:20:25.814663+0000","last_fullsized":"2024-06-10T00:20:25.814663+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:50:10.262261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853669+0000","last_change":"2024-06-10T00:20:23.830764+0000","last_active":"2024-06-10T00:20:24.853669+0000","last_peered":"2024-06-10T00:20:24.853669+0000","last_clean":"2024-06-10T00:20:24.853669+0000","last_became_active":"2024-06-10T00:20:23.830493+0000","last_became_peered":"2024-06-10T00:20:23.830493+0000","last_unstale":"2024-06-10T00:20:24.853669+0000","last_undegraded":"2024-06-10T00:20:24.853669+0000","last_fullsized":"2024-06-10T00:20:24.853669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:05:46.733445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.842888+0000","last_change":"2024-06-10T00:20:24.837197+0000","last_active":"2024-06-10T00:20:24.842888+0000","last_peered":"2024-06-10T00:20:24.842888+0000","last_clean":"2024-06-10T00:20:24.842888+0000","last_became_active":"2024-06-10T00:20:24.833868+0000","last_became_peered":"2024-06-10T00:20:24.833868+0000","last_unstale":"2024-06-10T00:20:24.842888+0000","last_undegraded":"2024-06-10T00:20:24.842888+0000","last_fullsized":"2024-06-10T00:20:24.842888+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:23:20.121538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"87'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840115+0000","last_change":"2024-06-10T00:20:23.831817+0000","last_active":"2024-06-10T00:20:24.840115+0000","last_peered":"2024-06-10T00:20:24.840115+0000","last_clean":"2024-06-10T00:20:24.840115+0000","last_became_active":"2024-06-10T00:20:23.831079+0000","last_became_peered":"2024-06-10T00:20:23.831079+0000","last_unstale":"2024-06-10T00:20:24.840115+0000","last_undegraded":"2024-06-10T00:20:24.840115+0000","last_fullsized":"2024-06-10T00:20:24.840115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:05:46.733445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.838295+0000","last_change":"2024-06-10T00:20:24.832254+0000","last_active":"2024-06-10T00:20:24.838295+0000","last_peered":"2024-06-10T00:20:24.838295+0000","last_clean":"2024-06-10T00:20:24.838295+0000","last_became_active":"2024-06-10T00:20:24.831926+0000","last_became_peered":"2024-06-10T00:20:24.831926+0000","last_unstale":"2024-06-10T00:20:24.838295+0000","last_undegraded":"2024-06-10T00:20:24.838295+0000","last_fullsized":"2024-06-10T00:20:24.838295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:29:31.593107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.836599+0000","last_change":"2024-06-10T00:20:23.830673+0000","last_active":"2024-06-10T00:20:24.836599+0000","last_peered":"2024-06-10T00:20:24.836599+0000","last_clean":"2024-06-10T00:20:24.836599+0000","last_became_active":"2024-06-10T00:20:23.830398+0000","last_became_peered":"2024-06-10T00:20:23.830398+0000","last_unstale":"2024-06-10T00:20:24.836599+0000","last_undegraded":"2024-06-10T00:20:24.836599+0000","last_fullsized":"2024-06-10T00:20:24.836599+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:47.402113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815548+0000","last_change":"2024-06-10T00:20:24.830246+0000","last_active":"2024-06-10T00:20:25.815548+0000","last_peered":"2024-06-10T00:20:25.815548+0000","last_clean":"2024-06-10T00:20:25.815548+0000","last_became_active":"2024-06-10T00:20:24.829734+0000","last_became_peered":"2024-06-10T00:20:24.829734+0000","last_unstale":"2024-06-10T00:20:25.815548+0000","last_undegraded":"2024-06-10T00:20:25.815548+0000","last_fullsized":"2024-06-10T00:20:25.815548+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:39:50.051226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815916+0000","last_change":"2024-06-10T00:20:23.833888+0000","last_active":"2024-06-10T00:20:25.815916+0000","last_peered":"2024-06-10T00:20:25.815916+0000","last_clean":"2024-06-10T00:20:25.815916+0000","last_became_active":"2024-06-10T00:20:23.833407+0000","last_became_peered":"2024-06-10T00:20:23.833407+0000","last_unstale":"2024-06-10T00:20:25.815916+0000","last_undegraded":"2024-06-10T00:20:25.815916+0000","last_fullsized":"2024-06-10T00:20:25.815916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:05:49.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.850737+0000","last_change":"2024-06-10T00:20:24.845887+0000","last_active":"2024-06-10T00:20:24.850737+0000","last_peered":"2024-06-10T00:20:24.850737+0000","last_clean":"2024-06-10T00:20:24.850737+0000","last_became_active":"2024-06-10T00:20:24.845601+0000","last_became_peered":"2024-06-10T00:20:24.845601+0000","last_unstale":"2024-06-10T00:20:24.850737+0000","last_undegraded":"2024-06-10T00:20:24.850737+0000","last_fullsized":"2024-06-10T00:20:24.850737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:04:28.915205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815400+0000","last_change":"2024-06-10T00:20:23.828934+0000","last_active":"2024-06-10T00:20:25.815400+0000","last_peered":"2024-06-10T00:20:25.815400+0000","last_clean":"2024-06-10T00:20:25.815400+0000","last_became_active":"2024-06-10T00:20:23.828258+0000","last_became_peered":"2024-06-10T00:20:23.828258+0000","last_unstale":"2024-06-10T00:20:25.815400+0000","last_undegraded":"2024-06-10T00:20:25.815400+0000","last_fullsized":"2024-06-10T00:20:25.815400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:56:41.974694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814743+0000","last_change":"2024-06-10T00:20:24.838329+0000","last_active":"2024-06-10T00:20:25.814743+0000","last_peered":"2024-06-10T00:20:25.814743+0000","last_clean":"2024-06-10T00:20:25.814743+0000","last_became_active":"2024-06-10T00:20:24.838050+0000","last_became_peered":"2024-06-10T00:20:24.838050+0000","last_unstale":"2024-06-10T00:20:25.814743+0000","last_undegraded":"2024-06-10T00:20:25.814743+0000","last_fullsized":"2024-06-10T00:20:25.814743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:49:50.575784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814579+0000","last_change":"2024-06-10T00:20:23.822063+0000","last_active":"2024-06-10T00:20:25.814579+0000","last_peered":"2024-06-10T00:20:25.814579+0000","last_clean":"2024-06-10T00:20:25.814579+0000","last_became_active":"2024-06-10T00:20:23.821811+0000","last_became_peered":"2024-06-10T00:20:23.821811+0000","last_unstale":"2024-06-10T00:20:25.814579+0000","last_undegraded":"2024-06-10T00:20:25.814579+0000","last_fullsized":"2024-06-10T00:20:25.814579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:46:46.562123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815315+0000","last_change":"2024-06-10T00:20:24.851813+0000","last_active":"2024-06-10T00:20:25.815315+0000","last_peered":"2024-06-10T00:20:25.815315+0000","last_clean":"2024-06-10T00:20:25.815315+0000","last_became_active":"2024-06-10T00:20:24.851464+0000","last_became_peered":"2024-06-10T00:20:24.851464+0000","last_unstale":"2024-06-10T00:20:25.815315+0000","last_undegraded":"2024-06-10T00:20:25.815315+0000","last_fullsized":"2024-06-10T00:20:25.815315+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:43:06.031349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815131+0000","last_change":"2024-06-10T00:20:23.828097+0000","last_active":"2024-06-10T00:20:25.815131+0000","last_peered":"2024-06-10T00:20:25.815131+0000","last_clean":"2024-06-10T00:20:25.815131+0000","last_became_active":"2024-06-10T00:20:23.827724+0000","last_became_peered":"2024-06-10T00:20:23.827724+0000","last_unstale":"2024-06-10T00:20:25.815131+0000","last_undegraded":"2024-06-10T00:20:25.815131+0000","last_fullsized":"2024-06-10T00:20:25.815131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:05:17.409003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.842778+0000","last_change":"2024-06-10T00:20:24.832646+0000","last_active":"2024-06-10T00:20:24.842778+0000","last_peered":"2024-06-10T00:20:24.842778+0000","last_clean":"2024-06-10T00:20:24.842778+0000","last_became_active":"2024-06-10T00:20:24.832380+0000","last_became_peered":"2024-06-10T00:20:24.832380+0000","last_unstale":"2024-06-10T00:20:24.842778+0000","last_undegraded":"2024-06-10T00:20:24.842778+0000","last_fullsized":"2024-06-10T00:20:24.842778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:43:06.031349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814447+0000","last_change":"2024-06-10T00:20:23.828355+0000","last_active":"2024-06-10T00:20:25.814447+0000","last_peered":"2024-06-10T00:20:25.814447+0000","last_clean":"2024-06-10T00:20:25.814447+0000","last_became_active":"2024-06-10T00:20:23.828010+0000","last_became_peered":"2024-06-10T00:20:23.828010+0000","last_unstale":"2024-06-10T00:20:25.814447+0000","last_undegraded":"2024-06-10T00:20:25.814447+0000","last_fullsized":"2024-06-10T00:20:25.814447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:25:08.785840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.835006+0000","last_change":"2024-06-10T00:20:24.828303+0000","last_active":"2024-06-10T00:20:24.835006+0000","last_peered":"2024-06-10T00:20:24.835006+0000","last_clean":"2024-06-10T00:20:24.835006+0000","last_became_active":"2024-06-10T00:20:24.827972+0000","last_became_peered":"2024-06-10T00:20:24.827972+0000","last_unstale":"2024-06-10T00:20:24.835006+0000","last_undegraded":"2024-06-10T00:20:24.835006+0000","last_fullsized":"2024-06-10T00:20:24.835006+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:47:30.024848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.839544+0000","last_change":"2024-06-10T00:20:23.834010+0000","last_active":"2024-06-10T00:20:24.839544+0000","last_peered":"2024-06-10T00:20:24.839544+0000","last_clean":"2024-06-10T00:20:24.839544+0000","last_became_active":"2024-06-10T00:20:23.833260+0000","last_became_peered":"2024-06-10T00:20:23.833260+0000","last_unstale":"2024-06-10T00:20:24.839544+0000","last_undegraded":"2024-06-10T00:20:24.839544+0000","last_fullsized":"2024-06-10T00:20:24.839544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:31.541208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.845004+0000","last_change":"2024-06-10T00:20:24.840539+0000","last_active":"2024-06-10T00:20:24.845004+0000","last_peered":"2024-06-10T00:20:24.845004+0000","last_clean":"2024-06-10T00:20:24.845004+0000","last_became_active":"2024-06-10T00:20:24.840275+0000","last_became_peered":"2024-06-10T00:20:24.840275+0000","last_unstale":"2024-06-10T00:20:24.845004+0000","last_undegraded":"2024-06-10T00:20:24.845004+0000","last_fullsized":"2024-06-10T00:20:24.845004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:08:44.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815405+0000","last_change":"2024-06-10T00:20:23.828250+0000","last_active":"2024-06-10T00:20:25.815405+0000","last_peered":"2024-06-10T00:20:25.815405+0000","last_clean":"2024-06-10T00:20:25.815405+0000","last_became_active":"2024-06-10T00:20:23.827673+0000","last_became_peered":"2024-06-10T00:20:23.827673+0000","last_unstale":"2024-06-10T00:20:25.815405+0000","last_undegraded":"2024-06-10T00:20:25.815405+0000","last_fullsized":"2024-06-10T00:20:25.815405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:31:32.619599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.842862+0000","last_change":"2024-06-10T00:20:24.833418+0000","last_active":"2024-06-10T00:20:24.842862+0000","last_peered":"2024-06-10T00:20:24.842862+0000","last_clean":"2024-06-10T00:20:24.842862+0000","last_became_active":"2024-06-10T00:20:24.833061+0000","last_became_peered":"2024-06-10T00:20:24.833061+0000","last_unstale":"2024-06-10T00:20:24.842862+0000","last_undegraded":"2024-06-10T00:20:24.842862+0000","last_fullsized":"2024-06-10T00:20:24.842862+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:49:36.811442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.816013+0000","last_change":"2024-06-10T00:20:23.828501+0000","last_active":"2024-06-10T00:20:25.816013+0000","last_peered":"2024-06-10T00:20:25.816013+0000","last_clean":"2024-06-10T00:20:25.816013+0000","last_became_active":"2024-06-10T00:20:23.827896+0000","last_became_peered":"2024-06-10T00:20:23.827896+0000","last_unstale":"2024-06-10T00:20:25.816013+0000","last_undegraded":"2024-06-10T00:20:25.816013+0000","last_fullsized":"2024-06-10T00:20:25.816013+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:02:30.253271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815778+0000","last_change":"2024-06-10T00:20:24.835998+0000","last_active":"2024-06-10T00:20:25.815778+0000","last_peered":"2024-06-10T00:20:25.815778+0000","last_clean":"2024-06-10T00:20:25.815778+0000","last_became_active":"2024-06-10T00:20:24.835730+0000","last_became_peered":"2024-06-10T00:20:24.835730+0000","last_unstale":"2024-06-10T00:20:25.815778+0000","last_undegraded":"2024-06-10T00:20:25.815778+0000","last_fullsized":"2024-06-10T00:20:25.815778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:49:36.811442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.822897+0000","last_change":"2024-06-10T00:20:23.829032+0000","last_active":"2024-06-10T00:20:24.822897+0000","last_peered":"2024-06-10T00:20:24.822897+0000","last_clean":"2024-06-10T00:20:24.822897+0000","last_became_active":"2024-06-10T00:20:23.828764+0000","last_became_peered":"2024-06-10T00:20:23.828764+0000","last_unstale":"2024-06-10T00:20:24.822897+0000","last_undegraded":"2024-06-10T00:20:24.822897+0000","last_fullsized":"2024-06-10T00:20:24.822897+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:26.152974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814463+0000","last_change":"2024-06-10T00:20:24.833680+0000","last_active":"2024-06-10T00:20:25.814463+0000","last_peered":"2024-06-10T00:20:25.814463+0000","last_clean":"2024-06-10T00:20:25.814463+0000","last_became_active":"2024-06-10T00:20:24.833405+0000","last_became_peered":"2024-06-10T00:20:24.833405+0000","last_unstale":"2024-06-10T00:20:25.814463+0000","last_undegraded":"2024-06-10T00:20:25.814463+0000","last_fullsized":"2024-06-10T00:20:25.814463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:53:00.157014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.826600+0000","last_change":"2024-06-10T00:20:23.833808+0000","last_active":"2024-06-10T00:20:24.826600+0000","last_peered":"2024-06-10T00:20:24.826600+0000","last_clean":"2024-06-10T00:20:24.826600+0000","last_became_active":"2024-06-10T00:20:23.833453+0000","last_became_peered":"2024-06-10T00:20:23.833453+0000","last_unstale":"2024-06-10T00:20:24.826600+0000","last_undegraded":"2024-06-10T00:20:24.826600+0000","last_fullsized":"2024-06-10T00:20:24.826600+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:47.402113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.841421+0000","last_change":"2024-06-10T00:20:24.840569+0000","last_active":"2024-06-10T00:20:24.841421+0000","last_peered":"2024-06-10T00:20:24.841421+0000","last_clean":"2024-06-10T00:20:24.841421+0000","last_became_active":"2024-06-10T00:20:24.839357+0000","last_became_peered":"2024-06-10T00:20:24.839357+0000","last_unstale":"2024-06-10T00:20:24.841421+0000","last_undegraded":"2024-06-10T00:20:24.841421+0000","last_fullsized":"2024-06-10T00:20:24.841421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:49:50.575784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815514+0000","last_change":"2024-06-10T00:20:23.827220+0000","last_active":"2024-06-10T00:20:25.815514+0000","last_peered":"2024-06-10T00:20:25.815514+0000","last_clean":"2024-06-10T00:20:25.815514+0000","last_became_active":"2024-06-10T00:20:23.826220+0000","last_became_peered":"2024-06-10T00:20:23.826220+0000","last_unstale":"2024-06-10T00:20:25.815514+0000","last_undegraded":"2024-06-10T00:20:25.815514+0000","last_fullsized":"2024-06-10T00:20:25.815514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:39:49.049276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.843910+0000","last_change":"2024-06-10T00:20:24.842296+0000","last_active":"2024-06-10T00:20:24.843910+0000","last_peered":"2024-06-10T00:20:24.843910+0000","last_clean":"2024-06-10T00:20:24.843910+0000","last_became_active":"2024-06-10T00:20:24.842030+0000","last_became_peered":"2024-06-10T00:20:24.842030+0000","last_unstale":"2024-06-10T00:20:24.843910+0000","last_undegraded":"2024-06-10T00:20:24.843910+0000","last_fullsized":"2024-06-10T00:20:24.843910+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:16:16.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.822936+0000","last_change":"2024-06-10T00:20:23.829177+0000","last_active":"2024-06-10T00:20:24.822936+0000","last_peered":"2024-06-10T00:20:24.822936+0000","last_clean":"2024-06-10T00:20:24.822936+0000","last_became_active":"2024-06-10T00:20:23.828904+0000","last_became_peered":"2024-06-10T00:20:23.828904+0000","last_unstale":"2024-06-10T00:20:24.822936+0000","last_undegraded":"2024-06-10T00:20:24.822936+0000","last_fullsized":"2024-06-10T00:20:24.822936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:22:23.872120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.829579+0000","last_change":"2024-06-10T00:20:24.828626+0000","last_active":"2024-06-10T00:20:24.829579+0000","last_peered":"2024-06-10T00:20:24.829579+0000","last_clean":"2024-06-10T00:20:24.829579+0000","last_became_active":"2024-06-10T00:20:24.828032+0000","last_became_peered":"2024-06-10T00:20:24.828032+0000","last_unstale":"2024-06-10T00:20:24.829579+0000","last_undegraded":"2024-06-10T00:20:24.829579+0000","last_fullsized":"2024-06-10T00:20:24.829579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:49:50.575784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.813786+0000","last_change":"2024-06-10T00:20:23.834956+0000","last_active":"2024-06-10T00:20:24.813786+0000","last_peered":"2024-06-10T00:20:24.813786+0000","last_clean":"2024-06-10T00:20:24.813786+0000","last_became_active":"2024-06-10T00:20:23.834680+0000","last_became_peered":"2024-06-10T00:20:23.834680+0000","last_unstale":"2024-06-10T00:20:24.813786+0000","last_undegraded":"2024-06-10T00:20:24.813786+0000","last_fullsized":"2024-06-10T00:20:24.813786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:31:14.374039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.826395+0000","last_change":"2024-06-10T00:20:24.820193+0000","last_active":"2024-06-10T00:20:24.826395+0000","last_peered":"2024-06-10T00:20:24.826395+0000","last_clean":"2024-06-10T00:20:24.826395+0000","last_became_active":"2024-06-10T00:20:24.819424+0000","last_became_peered":"2024-06-10T00:20:24.819424+0000","last_unstale":"2024-06-10T00:20:24.826395+0000","last_undegraded":"2024-06-10T00:20:24.826395+0000","last_fullsized":"2024-06-10T00:20:24.826395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:34:10.381026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.839274+0000","last_change":"2024-06-10T00:20:23.828377+0000","last_active":"2024-06-10T00:20:24.839274+0000","last_peered":"2024-06-10T00:20:24.839274+0000","last_clean":"2024-06-10T00:20:24.839274+0000","last_became_active":"2024-06-10T00:20:23.828088+0000","last_became_peered":"2024-06-10T00:20:23.828088+0000","last_unstale":"2024-06-10T00:20:24.839274+0000","last_undegraded":"2024-06-10T00:20:24.839274+0000","last_fullsized":"2024-06-10T00:20:24.839274+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:26.152974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":290,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.813846+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:20:24.813846+0000","last_peered":"2024-06-10T00:20:24.813846+0000","last_clean":"2024-06-10T00:20:24.813846+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:20:24.813846+0000","last_undegraded":"2024-06-10T00:20:24.813846+0000","last_fullsized":"2024-06-10T00:20:24.813846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1675264,"data_stored":1081491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1093632,"data_stored":493283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":497759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1093632,"data_stored":497919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1073152,"data_stored":491067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":497759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":491137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1691648,"data_stored":1083753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:20:27.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:20:27.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.915+0000 7fead7e58640 1 Processor -- start 2024-06-10T00:20:27.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.916+0000 7fead7e58640 1 -- start start 2024-06-10T00:20:27.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.916+0000 7fead7e58640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fead015f1a0 0x7fead00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.916+0000 7fead7e58640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fead00cef70 0x7fead00cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.916+0000 7fead7e58640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead015f5e0 con 0x7fead00d2680 2024-06-10T00:20:27.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.916+0000 7fead7e58640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fead00d13e0 con 0x7fead00cef70 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.916+0000 7fead7e58640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fead00d0ad0 con 0x7fead015f1a0 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead63f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fead00cef70 0x7fead00cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead5bf4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fead00d2680 0x7fead00d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51834/0 (socket says 172.21.15.79:51834) 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead5bf4640 1 -- 172.21.15.79:0/1376126795 learned_addr learned my addr 172.21.15.79:0/1376126795 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead53f3640 1 --2- 172.21.15.79:0/1376126795 >> v2:172.21.15.117:3300/0 conn(0x7fead015f1a0 0x7fead00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead63f5640 1 -- 172.21.15.79:0/1376126795 >> v2:172.21.15.117:3300/0 conn(0x7fead015f1a0 msgr2=0x7fead00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead63f5640 1 --2- 172.21.15.79:0/1376126795 >> v2:172.21.15.117:3300/0 conn(0x7fead015f1a0 0x7fead00d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead63f5640 1 -- 172.21.15.79:0/1376126795 >> v1:172.21.15.79:6789/0 conn(0x7fead00d2680 legacy=0x7fead00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead63f5640 1 -- 172.21.15.79:0/1376126795 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead015f890 con 0x7fead00cef70 2024-06-10T00:20:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.917+0000 7fead4bf2640 1 -- 172.21.15.79:0/1376126795 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184644580 0 0) 0x7fead015f5e0 con 0x7fead00d2680 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead63f5640 1 --2- 172.21.15.79:0/1376126795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead00cef70 0x7fead00cf3c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fead00d1560 tx=0x7feac802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b43b06564d7483c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead4bf2640 1 -- 172.21.15.79:0/1376126795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8007740 con 0x7fead00cef70 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead4bf2640 1 -- 172.21.15.79:0/1376126795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac80078e0 con 0x7fead00cef70 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead4bf2640 1 -- 172.21.15.79:0/1376126795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8007cb0 con 0x7fead00cef70 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead7e58640 1 -- 172.21.15.79:0/1376126795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead00cef70 msgr2=0x7fead00cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead7e58640 1 --2- 172.21.15.79:0/1376126795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead00cef70 0x7fead00cf3c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fead00d1560 tx=0x7feac802a660 comp rx=0 tx=0).stop 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead7e58640 1 -- 172.21.15.79:0/1376126795 shutdown_connections 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead7e58640 1 --2- 172.21.15.79:0/1376126795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead00cef70 0x7fead00cf3c0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead7e58640 1 --2- 172.21.15.79:0/1376126795 >> v2:172.21.15.117:3300/0 conn(0x7fead015f1a0 0x7fead00d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead7e58640 1 -- 172.21.15.79:0/1376126795 >> 172.21.15.79:0/1376126795 conn(0x7fead009d3f0 msgr2=0x7fead00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:27.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead7e58640 1 -- 172.21.15.79:0/1376126795 shutdown_connections 2024-06-10T00:20:27.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.918+0000 7fead7e58640 1 -- 172.21.15.79:0/1376126795 wait complete. 2024-06-10T00:20:27.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.919+0000 7fead7e58640 1 Processor -- start 2024-06-10T00:20:27.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead7e58640 1 -- start start 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead7e58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cef70 0x7fead0159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead7e58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead00d2680 0x7fead00a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead7e58640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead015f1a0 0x7fead009de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead7e58640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fead00d4f00 con 0x7fead015f1a0 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead7e58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fead00d1070 con 0x7fead00d2680 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead7e58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fead00d1870 con 0x7fead00cef70 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead63f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead015f1a0 0x7fead009de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead63f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead015f1a0 0x7fead009de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35486/0 (socket says 172.21.15.79:35486) 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.920+0000 7fead63f5640 1 -- 172.21.15.79:0/3782019822 learned_addr learned my addr 172.21.15.79:0/3782019822 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead5bf4640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cef70 0x7fead0159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead53f3640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead00d2680 0x7fead00a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead63f5640 1 -- 172.21.15.79:0/3782019822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cef70 msgr2=0x7fead0159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead63f5640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cef70 0x7fead0159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead63f5640 1 -- 172.21.15.79:0/3782019822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead00d2680 msgr2=0x7fead00a0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead63f5640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead00d2680 0x7fead00a0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead63f5640 1 -- 172.21.15.79:0/3782019822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead015e0f0 con 0x7fead015f1a0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead63f5640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead015f1a0 0x7fead009de60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7feac802ac50 tx=0x7feac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7feac67fc640 1 -- 172.21.15.79:0/3782019822 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac803f070 con 0x7fead015f1a0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7feac67fc640 1 -- 172.21.15.79:0/3782019822 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac8031bc0 con 0x7fead015f1a0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7feac67fc640 1 -- 172.21.15.79:0/3782019822 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8044460 con 0x7fead015f1a0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead015e3d0 con 0x7fead015f1a0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.921+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead015b440 con 0x7fead015f1a0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.922+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead015e8f0 con 0x7fead015f1a0 2024-06-10T00:20:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.923+0000 7feac67fc640 1 -- 172.21.15.79:0/3782019822 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feac8007790 con 0x7fead015f1a0 2024-06-10T00:20:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.923+0000 7feac67fc640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feab406be30 0x7feab406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.923+0000 7feac67fc640 1 -- 172.21.15.79:0/3782019822 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7feac80ac760 con 0x7fead015f1a0 2024-06-10T00:20:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.923+0000 7fead5bf4640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feab406be30 0x7feab406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.923+0000 7fead5bf4640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feab406be30 0x7feab406e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feacc000f60 tx=0x7feacc007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:27.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:27.927+0000 7feac67fc640 1 -- 172.21.15.79:0/3782019822 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7feac807b010 con 0x7fead015f1a0 2024-06-10T00:20:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.100+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fead0068430 con 0x7feab406be30 2024-06-10T00:20:28.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.106+0000 7feac67fc640 1 -- 172.21.15.79:0/3782019822 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7fead0068430 con 0x7feab406be30 2024-06-10T00:20:28.109 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:28.110 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:20:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feab406be30 msgr2=0x7feab406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feab406be30 0x7feab406e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feacc000f60 tx=0x7feacc007b50 comp rx=0 tx=0).stop 2024-06-10T00:20:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead015f1a0 msgr2=0x7fead009de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead015f1a0 0x7fead009de60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7feac802ac50 tx=0x7feac8004a40 comp rx=0 tx=0).stop 2024-06-10T00:20:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 shutdown_connections 2024-06-10T00:20:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feab406be30 0x7feab406e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead015f1a0 0x7fead009de60 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead00d2680 0x7fead00a0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 --2- 172.21.15.79:0/3782019822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cef70 0x7fead0159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 >> 172.21.15.79:0/3782019822 conn(0x7fead009d3f0 msgr2=0x7fead00c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 shutdown_connections 2024-06-10T00:20:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.109+0000 7fead7e58640 1 -- 172.21.15.79:0/3782019822 wait complete. 2024-06-10T00:20:28.121 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-06-10T00:20:27.222349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246664,"kb_used_data":9644,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728056,"statfs":{"total":773094113280,"available":772841529344,"internally_reserved":0,"allocated":9875456,"data_stored":5134168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.421170"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840641+0000","last_change":"2024-06-10T00:20:24.835466+0000","last_active":"2024-06-10T00:20:24.840641+0000","last_peered":"2024-06-10T00:20:24.840641+0000","last_clean":"2024-06-10T00:20:24.840641+0000","last_became_active":"2024-06-10T00:20:24.835183+0000","last_became_peered":"2024-06-10T00:20:24.835183+0000","last_unstale":"2024-06-10T00:20:24.840641+0000","last_undegraded":"2024-06-10T00:20:24.840641+0000","last_fullsized":"2024-06-10T00:20:24.840641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:43.121641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815471+0000","last_change":"2024-06-10T00:20:24.840547+0000","last_active":"2024-06-10T00:20:25.815471+0000","last_peered":"2024-06-10T00:20:25.815471+0000","last_clean":"2024-06-10T00:20:25.815471+0000","last_became_active":"2024-06-10T00:20:24.840293+0000","last_became_peered":"2024-06-10T00:20:24.840293+0000","last_unstale":"2024-06-10T00:20:25.815471+0000","last_undegraded":"2024-06-10T00:20:25.815471+0000","last_fullsized":"2024-06-10T00:20:25.815471+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:32.543158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.831547+0000","last_change":"2024-06-10T00:20:24.828559+0000","last_active":"2024-06-10T00:20:24.831547+0000","last_peered":"2024-06-10T00:20:24.831547+0000","last_clean":"2024-06-10T00:20:24.831547+0000","last_became_active":"2024-06-10T00:20:24.828175+0000","last_became_peered":"2024-06-10T00:20:24.828175+0000","last_unstale":"2024-06-10T00:20:24.831547+0000","last_undegraded":"2024-06-10T00:20:24.831547+0000","last_fullsized":"2024-06-10T00:20:24.831547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:18:44.058942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853504+0000","last_change":"2024-06-10T00:20:24.850918+0000","last_active":"2024-06-10T00:20:24.853504+0000","last_peered":"2024-06-10T00:20:24.853504+0000","last_clean":"2024-06-10T00:20:24.853504+0000","last_became_active":"2024-06-10T00:20:24.850635+0000","last_became_peered":"2024-06-10T00:20:24.850635+0000","last_unstale":"2024-06-10T00:20:24.853504+0000","last_undegraded":"2024-06-10T00:20:24.853504+0000","last_fullsized":"2024-06-10T00:20:24.853504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:04:43.397893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815084+0000","last_change":"2024-06-10T00:20:24.828593+0000","last_active":"2024-06-10T00:20:25.815084+0000","last_peered":"2024-06-10T00:20:25.815084+0000","last_clean":"2024-06-10T00:20:25.815084+0000","last_became_active":"2024-06-10T00:20:24.828309+0000","last_became_peered":"2024-06-10T00:20:24.828309+0000","last_unstale":"2024-06-10T00:20:25.815084+0000","last_undegraded":"2024-06-10T00:20:25.815084+0000","last_fullsized":"2024-06-10T00:20:25.815084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:56:42.976643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.851291+0000","last_change":"2024-06-10T00:20:24.845309+0000","last_active":"2024-06-10T00:20:24.851291+0000","last_peered":"2024-06-10T00:20:24.851291+0000","last_clean":"2024-06-10T00:20:24.851291+0000","last_became_active":"2024-06-10T00:20:24.845049+0000","last_became_peered":"2024-06-10T00:20:24.845049+0000","last_unstale":"2024-06-10T00:20:24.851291+0000","last_undegraded":"2024-06-10T00:20:24.851291+0000","last_fullsized":"2024-06-10T00:20:24.851291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:10:45.128805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.824624+0000","last_change":"2024-06-10T00:20:24.819729+0000","last_active":"2024-06-10T00:20:24.824624+0000","last_peered":"2024-06-10T00:20:24.824624+0000","last_clean":"2024-06-10T00:20:24.824624+0000","last_became_active":"2024-06-10T00:20:24.819420+0000","last_became_peered":"2024-06-10T00:20:24.819420+0000","last_unstale":"2024-06-10T00:20:24.824624+0000","last_undegraded":"2024-06-10T00:20:24.824624+0000","last_fullsized":"2024-06-10T00:20:24.824624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:49:36.811442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.847456+0000","last_change":"2024-06-10T00:20:24.844936+0000","last_active":"2024-06-10T00:20:24.847456+0000","last_peered":"2024-06-10T00:20:24.847456+0000","last_clean":"2024-06-10T00:20:24.847456+0000","last_became_active":"2024-06-10T00:20:24.844464+0000","last_became_peered":"2024-06-10T00:20:24.844464+0000","last_unstale":"2024-06-10T00:20:24.847456+0000","last_undegraded":"2024-06-10T00:20:24.847456+0000","last_fullsized":"2024-06-10T00:20:24.847456+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:29:31.593107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815615+0000","last_change":"2024-06-10T00:20:24.833738+0000","last_active":"2024-06-10T00:20:25.815615+0000","last_peered":"2024-06-10T00:20:25.815615+0000","last_clean":"2024-06-10T00:20:25.815615+0000","last_became_active":"2024-06-10T00:20:24.833364+0000","last_became_peered":"2024-06-10T00:20:24.833364+0000","last_unstale":"2024-06-10T00:20:25.815615+0000","last_undegraded":"2024-06-10T00:20:25.815615+0000","last_fullsized":"2024-06-10T00:20:25.815615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:10.575502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814701+0000","last_change":"2024-06-10T00:20:24.838929+0000","last_active":"2024-06-10T00:20:25.814701+0000","last_peered":"2024-06-10T00:20:25.814701+0000","last_clean":"2024-06-10T00:20:25.814701+0000","last_became_active":"2024-06-10T00:20:24.838653+0000","last_became_peered":"2024-06-10T00:20:24.838653+0000","last_unstale":"2024-06-10T00:20:25.814701+0000","last_undegraded":"2024-06-10T00:20:25.814701+0000","last_fullsized":"2024-06-10T00:20:25.814701+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:06:26.671023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815465+0000","last_change":"2024-06-10T00:20:24.834541+0000","last_active":"2024-06-10T00:20:25.815465+0000","last_peered":"2024-06-10T00:20:25.815465+0000","last_clean":"2024-06-10T00:20:25.815465+0000","last_became_active":"2024-06-10T00:20:24.834231+0000","last_became_peered":"2024-06-10T00:20:24.834231+0000","last_unstale":"2024-06-10T00:20:25.815465+0000","last_undegraded":"2024-06-10T00:20:25.815465+0000","last_fullsized":"2024-06-10T00:20:25.815465+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:05:18.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814717+0000","last_change":"2024-06-10T00:20:24.831685+0000","last_active":"2024-06-10T00:20:25.814717+0000","last_peered":"2024-06-10T00:20:25.814717+0000","last_clean":"2024-06-10T00:20:25.814717+0000","last_became_active":"2024-06-10T00:20:24.831410+0000","last_became_peered":"2024-06-10T00:20:24.831410+0000","last_unstale":"2024-06-10T00:20:25.814717+0000","last_undegraded":"2024-06-10T00:20:25.814717+0000","last_fullsized":"2024-06-10T00:20:25.814717+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:02:19.609988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.846272+0000","last_change":"2024-06-10T00:20:24.842099+0000","last_active":"2024-06-10T00:20:24.846272+0000","last_peered":"2024-06-10T00:20:24.846272+0000","last_clean":"2024-06-10T00:20:24.846272+0000","last_became_active":"2024-06-10T00:20:24.841840+0000","last_became_peered":"2024-06-10T00:20:24.841840+0000","last_unstale":"2024-06-10T00:20:24.846272+0000","last_undegraded":"2024-06-10T00:20:24.846272+0000","last_fullsized":"2024-06-10T00:20:24.846272+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:22:24.874069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814886+0000","last_change":"2024-06-10T00:20:24.842613+0000","last_active":"2024-06-10T00:20:25.814886+0000","last_peered":"2024-06-10T00:20:25.814886+0000","last_clean":"2024-06-10T00:20:25.814886+0000","last_became_active":"2024-06-10T00:20:24.841722+0000","last_became_peered":"2024-06-10T00:20:24.841722+0000","last_unstale":"2024-06-10T00:20:25.814886+0000","last_undegraded":"2024-06-10T00:20:25.814886+0000","last_fullsized":"2024-06-10T00:20:25.814886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:48:32.454083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840914+0000","last_change":"2024-06-10T00:20:24.837084+0000","last_active":"2024-06-10T00:20:24.840914+0000","last_peered":"2024-06-10T00:20:24.840914+0000","last_clean":"2024-06-10T00:20:24.840914+0000","last_became_active":"2024-06-10T00:20:24.836757+0000","last_became_peered":"2024-06-10T00:20:24.836757+0000","last_unstale":"2024-06-10T00:20:24.840914+0000","last_undegraded":"2024-06-10T00:20:24.840914+0000","last_fullsized":"2024-06-10T00:20:24.840914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:27:06.327289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.842983+0000","last_change":"2024-06-10T00:20:24.832881+0000","last_active":"2024-06-10T00:20:24.842983+0000","last_peered":"2024-06-10T00:20:24.842983+0000","last_clean":"2024-06-10T00:20:24.842983+0000","last_became_active":"2024-06-10T00:20:24.832608+0000","last_became_peered":"2024-06-10T00:20:24.832608+0000","last_unstale":"2024-06-10T00:20:24.842983+0000","last_undegraded":"2024-06-10T00:20:24.842983+0000","last_fullsized":"2024-06-10T00:20:24.842983+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:32.543158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.850702+0000","last_change":"2024-06-10T00:20:24.846183+0000","last_active":"2024-06-10T00:20:24.850702+0000","last_peered":"2024-06-10T00:20:24.850702+0000","last_clean":"2024-06-10T00:20:24.850702+0000","last_became_active":"2024-06-10T00:20:24.845866+0000","last_became_peered":"2024-06-10T00:20:24.845866+0000","last_unstale":"2024-06-10T00:20:24.850702+0000","last_undegraded":"2024-06-10T00:20:24.850702+0000","last_fullsized":"2024-06-10T00:20:24.850702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:34.453387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840884+0000","last_change":"2024-06-10T00:20:24.838286+0000","last_active":"2024-06-10T00:20:24.840884+0000","last_peered":"2024-06-10T00:20:24.840884+0000","last_clean":"2024-06-10T00:20:24.840884+0000","last_became_active":"2024-06-10T00:20:24.838018+0000","last_became_peered":"2024-06-10T00:20:24.838018+0000","last_unstale":"2024-06-10T00:20:24.840884+0000","last_undegraded":"2024-06-10T00:20:24.840884+0000","last_fullsized":"2024-06-10T00:20:24.840884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:48.404062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815689+0000","last_change":"2024-06-10T00:20:24.842117+0000","last_active":"2024-06-10T00:20:25.815689+0000","last_peered":"2024-06-10T00:20:25.815689+0000","last_clean":"2024-06-10T00:20:25.815689+0000","last_became_active":"2024-06-10T00:20:24.841506+0000","last_became_peered":"2024-06-10T00:20:24.841506+0000","last_unstale":"2024-06-10T00:20:25.815689+0000","last_undegraded":"2024-06-10T00:20:25.815689+0000","last_fullsized":"2024-06-10T00:20:25.815689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:07:34.238512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.847422+0000","last_change":"2024-06-10T00:20:24.844407+0000","last_active":"2024-06-10T00:20:24.847422+0000","last_peered":"2024-06-10T00:20:24.847422+0000","last_clean":"2024-06-10T00:20:24.847422+0000","last_became_active":"2024-06-10T00:20:24.843920+0000","last_became_peered":"2024-06-10T00:20:24.843920+0000","last_unstale":"2024-06-10T00:20:24.847422+0000","last_undegraded":"2024-06-10T00:20:24.847422+0000","last_fullsized":"2024-06-10T00:20:24.847422+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:47:30.024848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814805+0000","last_change":"2024-06-10T00:20:24.821781+0000","last_active":"2024-06-10T00:20:25.814805+0000","last_peered":"2024-06-10T00:20:25.814805+0000","last_clean":"2024-06-10T00:20:25.814805+0000","last_became_active":"2024-06-10T00:20:24.821500+0000","last_became_peered":"2024-06-10T00:20:24.821500+0000","last_unstale":"2024-06-10T00:20:25.814805+0000","last_undegraded":"2024-06-10T00:20:25.814805+0000","last_fullsized":"2024-06-10T00:20:25.814805+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:16:16.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814609+0000","last_change":"2024-06-10T00:20:24.841708+0000","last_active":"2024-06-10T00:20:25.814609+0000","last_peered":"2024-06-10T00:20:25.814609+0000","last_clean":"2024-06-10T00:20:25.814609+0000","last_became_active":"2024-06-10T00:20:24.841413+0000","last_became_peered":"2024-06-10T00:20:24.841413+0000","last_unstale":"2024-06-10T00:20:25.814609+0000","last_undegraded":"2024-06-10T00:20:25.814609+0000","last_fullsized":"2024-06-10T00:20:25.814609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:29:31.593107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.843925+0000","last_change":"2024-06-10T00:20:24.842981+0000","last_active":"2024-06-10T00:20:24.843925+0000","last_peered":"2024-06-10T00:20:24.843925+0000","last_clean":"2024-06-10T00:20:24.843925+0000","last_became_active":"2024-06-10T00:20:24.842690+0000","last_became_peered":"2024-06-10T00:20:24.842690+0000","last_unstale":"2024-06-10T00:20:24.843925+0000","last_undegraded":"2024-06-10T00:20:24.843925+0000","last_fullsized":"2024-06-10T00:20:24.843925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:48:32.454083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.831766+0000","last_change":"2024-06-10T00:20:24.828487+0000","last_active":"2024-06-10T00:20:24.831766+0000","last_peered":"2024-06-10T00:20:24.831766+0000","last_clean":"2024-06-10T00:20:24.831766+0000","last_became_active":"2024-06-10T00:20:24.828125+0000","last_became_peered":"2024-06-10T00:20:24.828125+0000","last_unstale":"2024-06-10T00:20:24.831766+0000","last_undegraded":"2024-06-10T00:20:24.831766+0000","last_fullsized":"2024-06-10T00:20:24.831766+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:45:48.483601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815778+0000","last_change":"2024-06-10T00:20:24.837058+0000","last_active":"2024-06-10T00:20:25.815778+0000","last_peered":"2024-06-10T00:20:25.815778+0000","last_clean":"2024-06-10T00:20:25.815778+0000","last_became_active":"2024-06-10T00:20:24.836778+0000","last_became_peered":"2024-06-10T00:20:24.836778+0000","last_unstale":"2024-06-10T00:20:25.815778+0000","last_undegraded":"2024-06-10T00:20:25.815778+0000","last_fullsized":"2024-06-10T00:20:25.815778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:34:10.381026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814991+0000","last_change":"2024-06-10T00:20:24.842438+0000","last_active":"2024-06-10T00:20:25.814991+0000","last_peered":"2024-06-10T00:20:25.814991+0000","last_clean":"2024-06-10T00:20:25.814991+0000","last_became_active":"2024-06-10T00:20:24.841922+0000","last_became_peered":"2024-06-10T00:20:24.841922+0000","last_unstale":"2024-06-10T00:20:25.814991+0000","last_undegraded":"2024-06-10T00:20:25.814991+0000","last_fullsized":"2024-06-10T00:20:25.814991+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:04:43.397893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814702+0000","last_change":"2024-06-10T00:20:24.835997+0000","last_active":"2024-06-10T00:20:25.814702+0000","last_peered":"2024-06-10T00:20:25.814702+0000","last_clean":"2024-06-10T00:20:25.814702+0000","last_became_active":"2024-06-10T00:20:24.835727+0000","last_became_peered":"2024-06-10T00:20:24.835727+0000","last_unstale":"2024-06-10T00:20:25.814702+0000","last_undegraded":"2024-06-10T00:20:25.814702+0000","last_fullsized":"2024-06-10T00:20:25.814702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:37:00.939793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853418+0000","last_change":"2024-06-10T00:20:24.849045+0000","last_active":"2024-06-10T00:20:24.853418+0000","last_peered":"2024-06-10T00:20:24.853418+0000","last_clean":"2024-06-10T00:20:24.853418+0000","last_became_active":"2024-06-10T00:20:24.848658+0000","last_became_peered":"2024-06-10T00:20:24.848658+0000","last_unstale":"2024-06-10T00:20:24.853418+0000","last_undegraded":"2024-06-10T00:20:24.853418+0000","last_fullsized":"2024-06-10T00:20:24.853418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:48:32.454083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.833463+0000","last_change":"2024-06-10T00:20:24.830270+0000","last_active":"2024-06-10T00:20:24.833463+0000","last_peered":"2024-06-10T00:20:24.833463+0000","last_clean":"2024-06-10T00:20:24.833463+0000","last_became_active":"2024-06-10T00:20:24.829770+0000","last_became_peered":"2024-06-10T00:20:24.829770+0000","last_unstale":"2024-06-10T00:20:24.833463+0000","last_undegraded":"2024-06-10T00:20:24.833463+0000","last_fullsized":"2024-06-10T00:20:24.833463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:56:19.337651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814916+0000","last_change":"2024-06-10T00:20:24.833002+0000","last_active":"2024-06-10T00:20:25.814916+0000","last_peered":"2024-06-10T00:20:25.814916+0000","last_clean":"2024-06-10T00:20:25.814916+0000","last_became_active":"2024-06-10T00:20:24.832613+0000","last_became_peered":"2024-06-10T00:20:24.832613+0000","last_unstale":"2024-06-10T00:20:25.814916+0000","last_undegraded":"2024-06-10T00:20:25.814916+0000","last_fullsized":"2024-06-10T00:20:25.814916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:36:16.140350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814702+0000","last_change":"2024-06-10T00:20:24.841534+0000","last_active":"2024-06-10T00:20:25.814702+0000","last_peered":"2024-06-10T00:20:25.814702+0000","last_clean":"2024-06-10T00:20:25.814702+0000","last_became_active":"2024-06-10T00:20:24.841239+0000","last_became_peered":"2024-06-10T00:20:24.841239+0000","last_unstale":"2024-06-10T00:20:25.814702+0000","last_undegraded":"2024-06-10T00:20:25.814702+0000","last_fullsized":"2024-06-10T00:20:25.814702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:48.404062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.843332+0000","last_change":"2024-06-10T00:20:24.837535+0000","last_active":"2024-06-10T00:20:24.843332+0000","last_peered":"2024-06-10T00:20:24.843332+0000","last_clean":"2024-06-10T00:20:24.843332+0000","last_became_active":"2024-06-10T00:20:24.831551+0000","last_became_peered":"2024-06-10T00:20:24.831551+0000","last_unstale":"2024-06-10T00:20:24.843332+0000","last_undegraded":"2024-06-10T00:20:24.843332+0000","last_fullsized":"2024-06-10T00:20:24.843332+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:56:19.337651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.843411+0000","last_change":"2024-06-10T00:20:24.837754+0000","last_active":"2024-06-10T00:20:24.843411+0000","last_peered":"2024-06-10T00:20:24.843411+0000","last_clean":"2024-06-10T00:20:24.843411+0000","last_became_active":"2024-06-10T00:20:24.833514+0000","last_became_peered":"2024-06-10T00:20:24.833514+0000","last_unstale":"2024-06-10T00:20:24.843411+0000","last_undegraded":"2024-06-10T00:20:24.843411+0000","last_fullsized":"2024-06-10T00:20:24.843411+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:28.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"87'4","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.847415+0000","last_change":"2024-06-10T00:20:23.829851+0000","last_active":"2024-06-10T00:20:24.847415+0000","last_peered":"2024-06-10T00:20:24.847415+0000","last_clean":"2024-06-10T00:20:24.847415+0000","last_became_active":"2024-06-10T00:20:23.829513+0000","last_became_peered":"2024-06-10T00:20:23.829513+0000","last_unstale":"2024-06-10T00:20:24.847415+0000","last_undegraded":"2024-06-10T00:20:24.847415+0000","last_fullsized":"2024-06-10T00:20:24.847415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:28:27.707374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.844949+0000","last_change":"2024-06-10T00:20:24.836832+0000","last_active":"2024-06-10T00:20:24.844949+0000","last_peered":"2024-06-10T00:20:24.844949+0000","last_clean":"2024-06-10T00:20:24.844949+0000","last_became_active":"2024-06-10T00:20:24.833406+0000","last_became_peered":"2024-06-10T00:20:24.833406+0000","last_unstale":"2024-06-10T00:20:24.844949+0000","last_undegraded":"2024-06-10T00:20:24.844949+0000","last_fullsized":"2024-06-10T00:20:24.844949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:34:10.381026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815212+0000","last_change":"2024-06-10T00:20:23.830532+0000","last_active":"2024-06-10T00:20:25.815212+0000","last_peered":"2024-06-10T00:20:25.815212+0000","last_clean":"2024-06-10T00:20:25.815212+0000","last_became_active":"2024-06-10T00:20:23.830233+0000","last_became_peered":"2024-06-10T00:20:23.830233+0000","last_unstale":"2024-06-10T00:20:25.815212+0000","last_undegraded":"2024-06-10T00:20:25.815212+0000","last_fullsized":"2024-06-10T00:20:25.815212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:57:44.266601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840637+0000","last_change":"2024-06-10T00:20:24.838882+0000","last_active":"2024-06-10T00:20:24.840637+0000","last_peered":"2024-06-10T00:20:24.840637+0000","last_clean":"2024-06-10T00:20:24.840637+0000","last_became_active":"2024-06-10T00:20:24.838639+0000","last_became_peered":"2024-06-10T00:20:24.838639+0000","last_unstale":"2024-06-10T00:20:24.840637+0000","last_undegraded":"2024-06-10T00:20:24.840637+0000","last_fullsized":"2024-06-10T00:20:24.840637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:12:28.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.837607+0000","last_change":"2024-06-10T00:20:23.831486+0000","last_active":"2024-06-10T00:20:24.837607+0000","last_peered":"2024-06-10T00:20:24.837607+0000","last_clean":"2024-06-10T00:20:24.837607+0000","last_became_active":"2024-06-10T00:20:23.831223+0000","last_became_peered":"2024-06-10T00:20:23.831223+0000","last_unstale":"2024-06-10T00:20:24.837607+0000","last_undegraded":"2024-06-10T00:20:24.837607+0000","last_fullsized":"2024-06-10T00:20:24.837607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:43:05.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.846310+0000","last_change":"2024-06-10T00:20:24.841273+0000","last_active":"2024-06-10T00:20:24.846310+0000","last_peered":"2024-06-10T00:20:24.846310+0000","last_clean":"2024-06-10T00:20:24.846310+0000","last_became_active":"2024-06-10T00:20:24.841024+0000","last_became_peered":"2024-06-10T00:20:24.841024+0000","last_unstale":"2024-06-10T00:20:24.846310+0000","last_undegraded":"2024-06-10T00:20:24.846310+0000","last_fullsized":"2024-06-10T00:20:24.846310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:37:22.691456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853650+0000","last_change":"2024-06-10T00:20:23.833915+0000","last_active":"2024-06-10T00:20:24.853650+0000","last_peered":"2024-06-10T00:20:24.853650+0000","last_clean":"2024-06-10T00:20:24.853650+0000","last_became_active":"2024-06-10T00:20:23.833374+0000","last_became_peered":"2024-06-10T00:20:23.833374+0000","last_unstale":"2024-06-10T00:20:24.853650+0000","last_undegraded":"2024-06-10T00:20:24.853650+0000","last_fullsized":"2024-06-10T00:20:24.853650+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:58:41.246212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.850728+0000","last_change":"2024-06-10T00:20:24.846310+0000","last_active":"2024-06-10T00:20:24.850728+0000","last_peered":"2024-06-10T00:20:24.850728+0000","last_clean":"2024-06-10T00:20:24.850728+0000","last_became_active":"2024-06-10T00:20:24.843846+0000","last_became_peered":"2024-06-10T00:20:24.843846+0000","last_unstale":"2024-06-10T00:20:24.850728+0000","last_undegraded":"2024-06-10T00:20:24.850728+0000","last_fullsized":"2024-06-10T00:20:24.850728+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:16:16.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815198+0000","last_change":"2024-06-10T00:20:23.831530+0000","last_active":"2024-06-10T00:20:25.815198+0000","last_peered":"2024-06-10T00:20:25.815198+0000","last_clean":"2024-06-10T00:20:25.815198+0000","last_became_active":"2024-06-10T00:20:23.831226+0000","last_became_peered":"2024-06-10T00:20:23.831226+0000","last_unstale":"2024-06-10T00:20:25.815198+0000","last_undegraded":"2024-06-10T00:20:25.815198+0000","last_fullsized":"2024-06-10T00:20:25.815198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:21:00.707248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.835091+0000","last_change":"2024-06-10T00:20:24.829569+0000","last_active":"2024-06-10T00:20:24.835091+0000","last_peered":"2024-06-10T00:20:24.835091+0000","last_clean":"2024-06-10T00:20:24.835091+0000","last_became_active":"2024-06-10T00:20:24.829292+0000","last_became_peered":"2024-06-10T00:20:24.829292+0000","last_unstale":"2024-06-10T00:20:24.835091+0000","last_undegraded":"2024-06-10T00:20:24.835091+0000","last_fullsized":"2024-06-10T00:20:24.835091+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:10:24.518193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.851997+0000","last_change":"2024-06-10T00:20:23.829696+0000","last_active":"2024-06-10T00:20:24.851997+0000","last_peered":"2024-06-10T00:20:24.851997+0000","last_clean":"2024-06-10T00:20:24.851997+0000","last_became_active":"2024-06-10T00:20:23.829426+0000","last_became_peered":"2024-06-10T00:20:23.829426+0000","last_unstale":"2024-06-10T00:20:24.851997+0000","last_undegraded":"2024-06-10T00:20:24.851997+0000","last_fullsized":"2024-06-10T00:20:24.851997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:28:27.707374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.851249+0000","last_change":"2024-06-10T00:20:24.845287+0000","last_active":"2024-06-10T00:20:24.851249+0000","last_peered":"2024-06-10T00:20:24.851249+0000","last_clean":"2024-06-10T00:20:24.851249+0000","last_became_active":"2024-06-10T00:20:24.844958+0000","last_became_peered":"2024-06-10T00:20:24.844958+0000","last_unstale":"2024-06-10T00:20:24.851249+0000","last_undegraded":"2024-06-10T00:20:24.851249+0000","last_fullsized":"2024-06-10T00:20:24.851249+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:20:33.736293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.817977+0000","last_change":"2024-06-10T00:20:23.826271+0000","last_active":"2024-06-10T00:20:24.817977+0000","last_peered":"2024-06-10T00:20:24.817977+0000","last_clean":"2024-06-10T00:20:24.817977+0000","last_became_active":"2024-06-10T00:20:23.825914+0000","last_became_peered":"2024-06-10T00:20:23.825914+0000","last_unstale":"2024-06-10T00:20:24.817977+0000","last_undegraded":"2024-06-10T00:20:24.817977+0000","last_fullsized":"2024-06-10T00:20:24.817977+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:07:33.236562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853456+0000","last_change":"2024-06-10T00:20:24.850245+0000","last_active":"2024-06-10T00:20:24.853456+0000","last_peered":"2024-06-10T00:20:24.853456+0000","last_clean":"2024-06-10T00:20:24.853456+0000","last_became_active":"2024-06-10T00:20:24.849989+0000","last_became_peered":"2024-06-10T00:20:24.849989+0000","last_unstale":"2024-06-10T00:20:24.853456+0000","last_undegraded":"2024-06-10T00:20:24.853456+0000","last_fullsized":"2024-06-10T00:20:24.853456+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:36:16.140350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.813778+0000","last_change":"2024-06-10T00:20:23.833612+0000","last_active":"2024-06-10T00:20:24.813778+0000","last_peered":"2024-06-10T00:20:24.813778+0000","last_clean":"2024-06-10T00:20:24.813778+0000","last_became_active":"2024-06-10T00:20:23.833312+0000","last_became_peered":"2024-06-10T00:20:23.833312+0000","last_unstale":"2024-06-10T00:20:24.813778+0000","last_undegraded":"2024-06-10T00:20:24.813778+0000","last_fullsized":"2024-06-10T00:20:24.813778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:42.119692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815883+0000","last_change":"2024-06-10T00:20:24.819444+0000","last_active":"2024-06-10T00:20:25.815883+0000","last_peered":"2024-06-10T00:20:25.815883+0000","last_clean":"2024-06-10T00:20:25.815883+0000","last_became_active":"2024-06-10T00:20:24.819135+0000","last_became_peered":"2024-06-10T00:20:24.819135+0000","last_unstale":"2024-06-10T00:20:25.815883+0000","last_undegraded":"2024-06-10T00:20:25.815883+0000","last_fullsized":"2024-06-10T00:20:25.815883+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:30:21.654210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815890+0000","last_change":"2024-06-10T00:20:23.832744+0000","last_active":"2024-06-10T00:20:25.815890+0000","last_peered":"2024-06-10T00:20:25.815890+0000","last_clean":"2024-06-10T00:20:25.815890+0000","last_became_active":"2024-06-10T00:20:23.832456+0000","last_became_peered":"2024-06-10T00:20:23.832456+0000","last_unstale":"2024-06-10T00:20:25.815890+0000","last_undegraded":"2024-06-10T00:20:25.815890+0000","last_fullsized":"2024-06-10T00:20:25.815890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:45:09.573552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.826643+0000","last_change":"2024-06-10T00:20:24.821610+0000","last_active":"2024-06-10T00:20:24.826643+0000","last_peered":"2024-06-10T00:20:24.826643+0000","last_clean":"2024-06-10T00:20:24.826643+0000","last_became_active":"2024-06-10T00:20:24.821343+0000","last_became_peered":"2024-06-10T00:20:24.821343+0000","last_unstale":"2024-06-10T00:20:24.826643+0000","last_undegraded":"2024-06-10T00:20:24.826643+0000","last_fullsized":"2024-06-10T00:20:24.826643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:23:20.121538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.818048+0000","last_change":"2024-06-10T00:20:23.831252+0000","last_active":"2024-06-10T00:20:24.818048+0000","last_peered":"2024-06-10T00:20:24.818048+0000","last_clean":"2024-06-10T00:20:24.818048+0000","last_became_active":"2024-06-10T00:20:23.830972+0000","last_became_peered":"2024-06-10T00:20:23.830972+0000","last_unstale":"2024-06-10T00:20:24.818048+0000","last_undegraded":"2024-06-10T00:20:24.818048+0000","last_fullsized":"2024-06-10T00:20:24.818048+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:30:20.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840860+0000","last_change":"2024-06-10T00:20:24.836278+0000","last_active":"2024-06-10T00:20:24.840860+0000","last_peered":"2024-06-10T00:20:24.840860+0000","last_clean":"2024-06-10T00:20:24.840860+0000","last_became_active":"2024-06-10T00:20:24.836025+0000","last_became_peered":"2024-06-10T00:20:24.836025+0000","last_unstale":"2024-06-10T00:20:24.840860+0000","last_undegraded":"2024-06-10T00:20:24.840860+0000","last_fullsized":"2024-06-10T00:20:24.840860+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:31:15.375988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815806+0000","last_change":"2024-06-10T00:20:23.828555+0000","last_active":"2024-06-10T00:20:25.815806+0000","last_peered":"2024-06-10T00:20:25.815806+0000","last_clean":"2024-06-10T00:20:25.815806+0000","last_became_active":"2024-06-10T00:20:23.828275+0000","last_became_peered":"2024-06-10T00:20:23.828275+0000","last_unstale":"2024-06-10T00:20:25.815806+0000","last_undegraded":"2024-06-10T00:20:25.815806+0000","last_fullsized":"2024-06-10T00:20:25.815806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:36:27.144269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853541+0000","last_change":"2024-06-10T00:20:24.852319+0000","last_active":"2024-06-10T00:20:24.853541+0000","last_peered":"2024-06-10T00:20:24.853541+0000","last_clean":"2024-06-10T00:20:24.853541+0000","last_became_active":"2024-06-10T00:20:24.852055+0000","last_became_peered":"2024-06-10T00:20:24.852055+0000","last_unstale":"2024-06-10T00:20:24.853541+0000","last_undegraded":"2024-06-10T00:20:24.853541+0000","last_fullsized":"2024-06-10T00:20:24.853541+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:06:42.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.850972+0000","last_change":"2024-06-10T00:20:23.833625+0000","last_active":"2024-06-10T00:20:24.850972+0000","last_peered":"2024-06-10T00:20:24.850972+0000","last_clean":"2024-06-10T00:20:24.850972+0000","last_became_active":"2024-06-10T00:20:23.833277+0000","last_became_peered":"2024-06-10T00:20:23.833277+0000","last_unstale":"2024-06-10T00:20:24.850972+0000","last_undegraded":"2024-06-10T00:20:24.850972+0000","last_fullsized":"2024-06-10T00:20:24.850972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:31:14.374039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.847424+0000","last_change":"2024-06-10T00:20:24.844705+0000","last_active":"2024-06-10T00:20:24.847424+0000","last_peered":"2024-06-10T00:20:24.847424+0000","last_clean":"2024-06-10T00:20:24.847424+0000","last_became_active":"2024-06-10T00:20:24.844125+0000","last_became_peered":"2024-06-10T00:20:24.844125+0000","last_unstale":"2024-06-10T00:20:24.847424+0000","last_undegraded":"2024-06-10T00:20:24.847424+0000","last_fullsized":"2024-06-10T00:20:24.847424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:10:24.518193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.846248+0000","last_change":"2024-06-10T00:20:23.834949+0000","last_active":"2024-06-10T00:20:24.846248+0000","last_peered":"2024-06-10T00:20:24.846248+0000","last_clean":"2024-06-10T00:20:24.846248+0000","last_became_active":"2024-06-10T00:20:23.834597+0000","last_became_peered":"2024-06-10T00:20:23.834597+0000","last_unstale":"2024-06-10T00:20:24.846248+0000","last_undegraded":"2024-06-10T00:20:24.846248+0000","last_fullsized":"2024-06-10T00:20:24.846248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:49:49.573834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814980+0000","last_change":"2024-06-10T00:20:24.828696+0000","last_active":"2024-06-10T00:20:25.814980+0000","last_peered":"2024-06-10T00:20:25.814980+0000","last_clean":"2024-06-10T00:20:25.814980+0000","last_became_active":"2024-06-10T00:20:24.828229+0000","last_became_peered":"2024-06-10T00:20:24.828229+0000","last_unstale":"2024-06-10T00:20:25.814980+0000","last_undegraded":"2024-06-10T00:20:25.814980+0000","last_fullsized":"2024-06-10T00:20:25.814980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:06:42.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.824979+0000","last_change":"2024-06-10T00:20:23.833777+0000","last_active":"2024-06-10T00:20:24.824979+0000","last_peered":"2024-06-10T00:20:24.824979+0000","last_clean":"2024-06-10T00:20:24.824979+0000","last_became_active":"2024-06-10T00:20:23.833467+0000","last_became_peered":"2024-06-10T00:20:23.833467+0000","last_unstale":"2024-06-10T00:20:24.824979+0000","last_undegraded":"2024-06-10T00:20:24.824979+0000","last_fullsized":"2024-06-10T00:20:24.824979+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:07:42.119692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814503+0000","last_change":"2024-06-10T00:20:24.844822+0000","last_active":"2024-06-10T00:20:25.814503+0000","last_peered":"2024-06-10T00:20:25.814503+0000","last_clean":"2024-06-10T00:20:25.814503+0000","last_became_active":"2024-06-10T00:20:24.844493+0000","last_became_peered":"2024-06-10T00:20:24.844493+0000","last_unstale":"2024-06-10T00:20:25.814503+0000","last_undegraded":"2024-06-10T00:20:25.814503+0000","last_fullsized":"2024-06-10T00:20:25.814503+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:54:44.628734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.838857+0000","last_change":"2024-06-10T00:20:23.822220+0000","last_active":"2024-06-10T00:20:24.838857+0000","last_peered":"2024-06-10T00:20:24.838857+0000","last_clean":"2024-06-10T00:20:24.838857+0000","last_became_active":"2024-06-10T00:20:23.821825+0000","last_became_peered":"2024-06-10T00:20:23.821825+0000","last_unstale":"2024-06-10T00:20:24.838857+0000","last_undegraded":"2024-06-10T00:20:24.838857+0000","last_fullsized":"2024-06-10T00:20:24.838857+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:58:41.246212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814663+0000","last_change":"2024-06-10T00:20:24.836183+0000","last_active":"2024-06-10T00:20:25.814663+0000","last_peered":"2024-06-10T00:20:25.814663+0000","last_clean":"2024-06-10T00:20:25.814663+0000","last_became_active":"2024-06-10T00:20:24.835914+0000","last_became_peered":"2024-06-10T00:20:24.835914+0000","last_unstale":"2024-06-10T00:20:25.814663+0000","last_undegraded":"2024-06-10T00:20:25.814663+0000","last_fullsized":"2024-06-10T00:20:25.814663+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:50:10.262261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.853669+0000","last_change":"2024-06-10T00:20:23.830764+0000","last_active":"2024-06-10T00:20:24.853669+0000","last_peered":"2024-06-10T00:20:24.853669+0000","last_clean":"2024-06-10T00:20:24.853669+0000","last_became_active":"2024-06-10T00:20:23.830493+0000","last_became_peered":"2024-06-10T00:20:23.830493+0000","last_unstale":"2024-06-10T00:20:24.853669+0000","last_undegraded":"2024-06-10T00:20:24.853669+0000","last_fullsized":"2024-06-10T00:20:24.853669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:05:46.733445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.842888+0000","last_change":"2024-06-10T00:20:24.837197+0000","last_active":"2024-06-10T00:20:24.842888+0000","last_peered":"2024-06-10T00:20:24.842888+0000","last_clean":"2024-06-10T00:20:24.842888+0000","last_became_active":"2024-06-10T00:20:24.833868+0000","last_became_peered":"2024-06-10T00:20:24.833868+0000","last_unstale":"2024-06-10T00:20:24.842888+0000","last_undegraded":"2024-06-10T00:20:24.842888+0000","last_fullsized":"2024-06-10T00:20:24.842888+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:23:20.121538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"87'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.840115+0000","last_change":"2024-06-10T00:20:23.831817+0000","last_active":"2024-06-10T00:20:24.840115+0000","last_peered":"2024-06-10T00:20:24.840115+0000","last_clean":"2024-06-10T00:20:24.840115+0000","last_became_active":"2024-06-10T00:20:23.831079+0000","last_became_peered":"2024-06-10T00:20:23.831079+0000","last_unstale":"2024-06-10T00:20:24.840115+0000","last_undegraded":"2024-06-10T00:20:24.840115+0000","last_fullsized":"2024-06-10T00:20:24.840115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:05:46.733445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.838295+0000","last_change":"2024-06-10T00:20:24.832254+0000","last_active":"2024-06-10T00:20:24.838295+0000","last_peered":"2024-06-10T00:20:24.838295+0000","last_clean":"2024-06-10T00:20:24.838295+0000","last_became_active":"2024-06-10T00:20:24.831926+0000","last_became_peered":"2024-06-10T00:20:24.831926+0000","last_unstale":"2024-06-10T00:20:24.838295+0000","last_undegraded":"2024-06-10T00:20:24.838295+0000","last_fullsized":"2024-06-10T00:20:24.838295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:29:31.593107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.836599+0000","last_change":"2024-06-10T00:20:23.830673+0000","last_active":"2024-06-10T00:20:24.836599+0000","last_peered":"2024-06-10T00:20:24.836599+0000","last_clean":"2024-06-10T00:20:24.836599+0000","last_became_active":"2024-06-10T00:20:23.830398+0000","last_became_peered":"2024-06-10T00:20:23.830398+0000","last_unstale":"2024-06-10T00:20:24.836599+0000","last_undegraded":"2024-06-10T00:20:24.836599+0000","last_fullsized":"2024-06-10T00:20:24.836599+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:47.402113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815548+0000","last_change":"2024-06-10T00:20:24.830246+0000","last_active":"2024-06-10T00:20:25.815548+0000","last_peered":"2024-06-10T00:20:25.815548+0000","last_clean":"2024-06-10T00:20:25.815548+0000","last_became_active":"2024-06-10T00:20:24.829734+0000","last_became_peered":"2024-06-10T00:20:24.829734+0000","last_unstale":"2024-06-10T00:20:25.815548+0000","last_undegraded":"2024-06-10T00:20:25.815548+0000","last_fullsized":"2024-06-10T00:20:25.815548+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:39:50.051226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815916+0000","last_change":"2024-06-10T00:20:23.833888+0000","last_active":"2024-06-10T00:20:25.815916+0000","last_peered":"2024-06-10T00:20:25.815916+0000","last_clean":"2024-06-10T00:20:25.815916+0000","last_became_active":"2024-06-10T00:20:23.833407+0000","last_became_peered":"2024-06-10T00:20:23.833407+0000","last_unstale":"2024-06-10T00:20:25.815916+0000","last_undegraded":"2024-06-10T00:20:25.815916+0000","last_fullsized":"2024-06-10T00:20:25.815916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:05:49.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.850737+0000","last_change":"2024-06-10T00:20:24.845887+0000","last_active":"2024-06-10T00:20:24.850737+0000","last_peered":"2024-06-10T00:20:24.850737+0000","last_clean":"2024-06-10T00:20:24.850737+0000","last_became_active":"2024-06-10T00:20:24.845601+0000","last_became_peered":"2024-06-10T00:20:24.845601+0000","last_unstale":"2024-06-10T00:20:24.850737+0000","last_undegraded":"2024-06-10T00:20:24.850737+0000","last_fullsized":"2024-06-10T00:20:24.850737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:04:28.915205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815400+0000","last_change":"2024-06-10T00:20:23.828934+0000","last_active":"2024-06-10T00:20:25.815400+0000","last_peered":"2024-06-10T00:20:25.815400+0000","last_clean":"2024-06-10T00:20:25.815400+0000","last_became_active":"2024-06-10T00:20:23.828258+0000","last_became_peered":"2024-06-10T00:20:23.828258+0000","last_unstale":"2024-06-10T00:20:25.815400+0000","last_undegraded":"2024-06-10T00:20:25.815400+0000","last_fullsized":"2024-06-10T00:20:25.815400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:56:41.974694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814743+0000","last_change":"2024-06-10T00:20:24.838329+0000","last_active":"2024-06-10T00:20:25.814743+0000","last_peered":"2024-06-10T00:20:25.814743+0000","last_clean":"2024-06-10T00:20:25.814743+0000","last_became_active":"2024-06-10T00:20:24.838050+0000","last_became_peered":"2024-06-10T00:20:24.838050+0000","last_unstale":"2024-06-10T00:20:25.814743+0000","last_undegraded":"2024-06-10T00:20:25.814743+0000","last_fullsized":"2024-06-10T00:20:25.814743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:49:50.575784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814579+0000","last_change":"2024-06-10T00:20:23.822063+0000","last_active":"2024-06-10T00:20:25.814579+0000","last_peered":"2024-06-10T00:20:25.814579+0000","last_clean":"2024-06-10T00:20:25.814579+0000","last_became_active":"2024-06-10T00:20:23.821811+0000","last_became_peered":"2024-06-10T00:20:23.821811+0000","last_unstale":"2024-06-10T00:20:25.814579+0000","last_undegraded":"2024-06-10T00:20:25.814579+0000","last_fullsized":"2024-06-10T00:20:25.814579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:46:46.562123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815315+0000","last_change":"2024-06-10T00:20:24.851813+0000","last_active":"2024-06-10T00:20:25.815315+0000","last_peered":"2024-06-10T00:20:25.815315+0000","last_clean":"2024-06-10T00:20:25.815315+0000","last_became_active":"2024-06-10T00:20:24.851464+0000","last_became_peered":"2024-06-10T00:20:24.851464+0000","last_unstale":"2024-06-10T00:20:25.815315+0000","last_undegraded":"2024-06-10T00:20:25.815315+0000","last_fullsized":"2024-06-10T00:20:25.815315+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:43:06.031349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815131+0000","last_change":"2024-06-10T00:20:23.828097+0000","last_active":"2024-06-10T00:20:25.815131+0000","last_peered":"2024-06-10T00:20:25.815131+0000","last_clean":"2024-06-10T00:20:25.815131+0000","last_became_active":"2024-06-10T00:20:23.827724+0000","last_became_peered":"2024-06-10T00:20:23.827724+0000","last_unstale":"2024-06-10T00:20:25.815131+0000","last_undegraded":"2024-06-10T00:20:25.815131+0000","last_fullsized":"2024-06-10T00:20:25.815131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:05:17.409003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.842778+0000","last_change":"2024-06-10T00:20:24.832646+0000","last_active":"2024-06-10T00:20:24.842778+0000","last_peered":"2024-06-10T00:20:24.842778+0000","last_clean":"2024-06-10T00:20:24.842778+0000","last_became_active":"2024-06-10T00:20:24.832380+0000","last_became_peered":"2024-06-10T00:20:24.832380+0000","last_unstale":"2024-06-10T00:20:24.842778+0000","last_undegraded":"2024-06-10T00:20:24.842778+0000","last_fullsized":"2024-06-10T00:20:24.842778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:43:06.031349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814447+0000","last_change":"2024-06-10T00:20:23.828355+0000","last_active":"2024-06-10T00:20:25.814447+0000","last_peered":"2024-06-10T00:20:25.814447+0000","last_clean":"2024-06-10T00:20:25.814447+0000","last_became_active":"2024-06-10T00:20:23.828010+0000","last_became_peered":"2024-06-10T00:20:23.828010+0000","last_unstale":"2024-06-10T00:20:25.814447+0000","last_undegraded":"2024-06-10T00:20:25.814447+0000","last_fullsized":"2024-06-10T00:20:25.814447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:25:08.785840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.835006+0000","last_change":"2024-06-10T00:20:24.828303+0000","last_active":"2024-06-10T00:20:24.835006+0000","last_peered":"2024-06-10T00:20:24.835006+0000","last_clean":"2024-06-10T00:20:24.835006+0000","last_became_active":"2024-06-10T00:20:24.827972+0000","last_became_peered":"2024-06-10T00:20:24.827972+0000","last_unstale":"2024-06-10T00:20:24.835006+0000","last_undegraded":"2024-06-10T00:20:24.835006+0000","last_fullsized":"2024-06-10T00:20:24.835006+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:47:30.024848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.839544+0000","last_change":"2024-06-10T00:20:23.834010+0000","last_active":"2024-06-10T00:20:24.839544+0000","last_peered":"2024-06-10T00:20:24.839544+0000","last_clean":"2024-06-10T00:20:24.839544+0000","last_became_active":"2024-06-10T00:20:23.833260+0000","last_became_peered":"2024-06-10T00:20:23.833260+0000","last_unstale":"2024-06-10T00:20:24.839544+0000","last_undegraded":"2024-06-10T00:20:24.839544+0000","last_fullsized":"2024-06-10T00:20:24.839544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:31.541208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.845004+0000","last_change":"2024-06-10T00:20:24.840539+0000","last_active":"2024-06-10T00:20:24.845004+0000","last_peered":"2024-06-10T00:20:24.845004+0000","last_clean":"2024-06-10T00:20:24.845004+0000","last_became_active":"2024-06-10T00:20:24.840275+0000","last_became_peered":"2024-06-10T00:20:24.840275+0000","last_unstale":"2024-06-10T00:20:24.845004+0000","last_undegraded":"2024-06-10T00:20:24.845004+0000","last_fullsized":"2024-06-10T00:20:24.845004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:08:44.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815405+0000","last_change":"2024-06-10T00:20:23.828250+0000","last_active":"2024-06-10T00:20:25.815405+0000","last_peered":"2024-06-10T00:20:25.815405+0000","last_clean":"2024-06-10T00:20:25.815405+0000","last_became_active":"2024-06-10T00:20:23.827673+0000","last_became_peered":"2024-06-10T00:20:23.827673+0000","last_unstale":"2024-06-10T00:20:25.815405+0000","last_undegraded":"2024-06-10T00:20:25.815405+0000","last_fullsized":"2024-06-10T00:20:25.815405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:31:32.619599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.842862+0000","last_change":"2024-06-10T00:20:24.833418+0000","last_active":"2024-06-10T00:20:24.842862+0000","last_peered":"2024-06-10T00:20:24.842862+0000","last_clean":"2024-06-10T00:20:24.842862+0000","last_became_active":"2024-06-10T00:20:24.833061+0000","last_became_peered":"2024-06-10T00:20:24.833061+0000","last_unstale":"2024-06-10T00:20:24.842862+0000","last_undegraded":"2024-06-10T00:20:24.842862+0000","last_fullsized":"2024-06-10T00:20:24.842862+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:49:36.811442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.816013+0000","last_change":"2024-06-10T00:20:23.828501+0000","last_active":"2024-06-10T00:20:25.816013+0000","last_peered":"2024-06-10T00:20:25.816013+0000","last_clean":"2024-06-10T00:20:25.816013+0000","last_became_active":"2024-06-10T00:20:23.827896+0000","last_became_peered":"2024-06-10T00:20:23.827896+0000","last_unstale":"2024-06-10T00:20:25.816013+0000","last_undegraded":"2024-06-10T00:20:25.816013+0000","last_fullsized":"2024-06-10T00:20:25.816013+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:02:30.253271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815778+0000","last_change":"2024-06-10T00:20:24.835998+0000","last_active":"2024-06-10T00:20:25.815778+0000","last_peered":"2024-06-10T00:20:25.815778+0000","last_clean":"2024-06-10T00:20:25.815778+0000","last_became_active":"2024-06-10T00:20:24.835730+0000","last_became_peered":"2024-06-10T00:20:24.835730+0000","last_unstale":"2024-06-10T00:20:25.815778+0000","last_undegraded":"2024-06-10T00:20:25.815778+0000","last_fullsized":"2024-06-10T00:20:25.815778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:49:36.811442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.822897+0000","last_change":"2024-06-10T00:20:23.829032+0000","last_active":"2024-06-10T00:20:24.822897+0000","last_peered":"2024-06-10T00:20:24.822897+0000","last_clean":"2024-06-10T00:20:24.822897+0000","last_became_active":"2024-06-10T00:20:23.828764+0000","last_became_peered":"2024-06-10T00:20:23.828764+0000","last_unstale":"2024-06-10T00:20:24.822897+0000","last_undegraded":"2024-06-10T00:20:24.822897+0000","last_fullsized":"2024-06-10T00:20:24.822897+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:26.152974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.814463+0000","last_change":"2024-06-10T00:20:24.833680+0000","last_active":"2024-06-10T00:20:25.814463+0000","last_peered":"2024-06-10T00:20:25.814463+0000","last_clean":"2024-06-10T00:20:25.814463+0000","last_became_active":"2024-06-10T00:20:24.833405+0000","last_became_peered":"2024-06-10T00:20:24.833405+0000","last_unstale":"2024-06-10T00:20:25.814463+0000","last_undegraded":"2024-06-10T00:20:25.814463+0000","last_fullsized":"2024-06-10T00:20:25.814463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:53:00.157014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.826600+0000","last_change":"2024-06-10T00:20:23.833808+0000","last_active":"2024-06-10T00:20:24.826600+0000","last_peered":"2024-06-10T00:20:24.826600+0000","last_clean":"2024-06-10T00:20:24.826600+0000","last_became_active":"2024-06-10T00:20:23.833453+0000","last_became_peered":"2024-06-10T00:20:23.833453+0000","last_unstale":"2024-06-10T00:20:24.826600+0000","last_undegraded":"2024-06-10T00:20:24.826600+0000","last_fullsized":"2024-06-10T00:20:24.826600+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:47.402113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.841421+0000","last_change":"2024-06-10T00:20:24.840569+0000","last_active":"2024-06-10T00:20:24.841421+0000","last_peered":"2024-06-10T00:20:24.841421+0000","last_clean":"2024-06-10T00:20:24.841421+0000","last_became_active":"2024-06-10T00:20:24.839357+0000","last_became_peered":"2024-06-10T00:20:24.839357+0000","last_unstale":"2024-06-10T00:20:24.841421+0000","last_undegraded":"2024-06-10T00:20:24.841421+0000","last_fullsized":"2024-06-10T00:20:24.841421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:49:50.575784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-10T00:20:25.815514+0000","last_change":"2024-06-10T00:20:23.827220+0000","last_active":"2024-06-10T00:20:25.815514+0000","last_peered":"2024-06-10T00:20:25.815514+0000","last_clean":"2024-06-10T00:20:25.815514+0000","last_became_active":"2024-06-10T00:20:23.826220+0000","last_became_peered":"2024-06-10T00:20:23.826220+0000","last_unstale":"2024-06-10T00:20:25.815514+0000","last_undegraded":"2024-06-10T00:20:25.815514+0000","last_fullsized":"2024-06-10T00:20:25.815514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:39:49.049276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.843910+0000","last_change":"2024-06-10T00:20:24.842296+0000","last_active":"2024-06-10T00:20:24.843910+0000","last_peered":"2024-06-10T00:20:24.843910+0000","last_clean":"2024-06-10T00:20:24.843910+0000","last_became_active":"2024-06-10T00:20:24.842030+0000","last_became_peered":"2024-06-10T00:20:24.842030+0000","last_unstale":"2024-06-10T00:20:24.843910+0000","last_undegraded":"2024-06-10T00:20:24.843910+0000","last_fullsized":"2024-06-10T00:20:24.843910+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:16:16.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.822936+0000","last_change":"2024-06-10T00:20:23.829177+0000","last_active":"2024-06-10T00:20:24.822936+0000","last_peered":"2024-06-10T00:20:24.822936+0000","last_clean":"2024-06-10T00:20:24.822936+0000","last_became_active":"2024-06-10T00:20:23.828904+0000","last_became_peered":"2024-06-10T00:20:23.828904+0000","last_unstale":"2024-06-10T00:20:24.822936+0000","last_undegraded":"2024-06-10T00:20:24.822936+0000","last_fullsized":"2024-06-10T00:20:24.822936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:22:23.872120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.829579+0000","last_change":"2024-06-10T00:20:24.828626+0000","last_active":"2024-06-10T00:20:24.829579+0000","last_peered":"2024-06-10T00:20:24.829579+0000","last_clean":"2024-06-10T00:20:24.829579+0000","last_became_active":"2024-06-10T00:20:24.828032+0000","last_became_peered":"2024-06-10T00:20:24.828032+0000","last_unstale":"2024-06-10T00:20:24.829579+0000","last_undegraded":"2024-06-10T00:20:24.829579+0000","last_fullsized":"2024-06-10T00:20:24.829579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:49:50.575784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.813786+0000","last_change":"2024-06-10T00:20:23.834956+0000","last_active":"2024-06-10T00:20:24.813786+0000","last_peered":"2024-06-10T00:20:24.813786+0000","last_clean":"2024-06-10T00:20:24.813786+0000","last_became_active":"2024-06-10T00:20:23.834680+0000","last_became_peered":"2024-06-10T00:20:23.834680+0000","last_unstale":"2024-06-10T00:20:24.813786+0000","last_undegraded":"2024-06-10T00:20:24.813786+0000","last_fullsized":"2024-06-10T00:20:24.813786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:31:14.374039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.826395+0000","last_change":"2024-06-10T00:20:24.820193+0000","last_active":"2024-06-10T00:20:24.826395+0000","last_peered":"2024-06-10T00:20:24.826395+0000","last_clean":"2024-06-10T00:20:24.826395+0000","last_became_active":"2024-06-10T00:20:24.819424+0000","last_became_peered":"2024-06-10T00:20:24.819424+0000","last_unstale":"2024-06-10T00:20:24.826395+0000","last_undegraded":"2024-06-10T00:20:24.826395+0000","last_fullsized":"2024-06-10T00:20:24.826395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:23.801099+0000","last_clean_scrub_stamp":"2024-06-10T00:20:23.801099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:34:10.381026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.839274+0000","last_change":"2024-06-10T00:20:23.828377+0000","last_active":"2024-06-10T00:20:24.839274+0000","last_peered":"2024-06-10T00:20:24.839274+0000","last_clean":"2024-06-10T00:20:24.839274+0000","last_became_active":"2024-06-10T00:20:23.828088+0000","last_became_peered":"2024-06-10T00:20:23.828088+0000","last_unstale":"2024-06-10T00:20:24.839274+0000","last_undegraded":"2024-06-10T00:20:24.839274+0000","last_fullsized":"2024-06-10T00:20:24.839274+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:20:22.799149+0000","last_clean_scrub_stamp":"2024-06-10T00:20:22.799149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:01:26.152974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":290,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-06-10T00:20:24.813846+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:20:24.813846+0000","last_peered":"2024-06-10T00:20:24.813846+0000","last_clean":"2024-06-10T00:20:24.813846+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:20:24.813846+0000","last_undegraded":"2024-06-10T00:20:24.813846+0000","last_fullsized":"2024-06-10T00:20:24.813846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1675264,"data_stored":1081491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1093632,"data_stored":493283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":497759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1093632,"data_stored":497919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1073152,"data_stored":491067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":497759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":491137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1691648,"data_stored":1083753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:20:28.124 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:20:28.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-10T00:20:28.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.268+0000 7fbc7dd9d640 1 Processor -- start 2024-06-10T00:20:28.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.268+0000 7fbc7dd9d640 1 -- start start 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc7dd9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc781589e0 0x7fbc7815f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc7dd9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7815ea40 0x7fbc780cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc7dd9d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc78158dc0 con 0x7fbc780d0510 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc7dd9d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbc780721b0 con 0x7fbc781589e0 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc7dd9d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc78072490 con 0x7fbc7815ea40 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc77fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbc780d0510 0x7fbc7806def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42322/0 (socket says 172.21.15.79:42322) 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc77fff640 1 -- 172.21.15.79:0/487079800 learned_addr learned my addr 172.21.15.79:0/487079800 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc777fe640 1 --2- 172.21.15.79:0/487079800 >> v2:172.21.15.117:3300/0 conn(0x7fbc781589e0 0x7fbc7815f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc76ffd640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7815ea40 0x7fbc780cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159589540 0 0) 0x7fbc78158dc0 con 0x7fbc780d0510 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc64003520 con 0x7fbc780d0510 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1665860818 0 0) 0x7fbc64003520 con 0x7fbc780d0510 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7815ea40 msgr2=0x7fbc780cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7815ea40 0x7fbc780cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 >> v2:172.21.15.117:3300/0 conn(0x7fbc781589e0 msgr2=0x7fbc7815f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 --2- 172.21.15.79:0/487079800 >> v2:172.21.15.117:3300/0 conn(0x7fbc781589e0 0x7fbc7815f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc78072770 con 0x7fbc780d0510 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fbc700019f0 con 0x7fbc780d0510 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 >> v1:172.21.15.79:6789/0 conn(0x7fbc780d0510 legacy=0x7fbc7806def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc640039b0 0x7fbc64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7815ea40 0x7fbc64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc64004d40 0x7fbc640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc780721b0 con 0x7fbc64004d40 2024-06-10T00:20:28.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc78072490 con 0x7fbc640039b0 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6400b9c0 con 0x7fbc7815ea40 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.269+0000 7fbc77fff640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc64004d40 0x7fbc640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.270+0000 7fbc777fe640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc640039b0 0x7fbc64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.270+0000 7fbc76ffd640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7815ea40 0x7fbc64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.270+0000 7fbc77fff640 1 -- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7815ea40 msgr2=0x7fbc64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.270+0000 7fbc77fff640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7815ea40 0x7fbc64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.270+0000 7fbc77fff640 1 -- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc640039b0 msgr2=0x7fbc64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.270+0000 7fbc77fff640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc640039b0 0x7fbc64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.270+0000 7fbc77fff640 1 -- 172.21.15.79:0/487079800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc64003520 con 0x7fbc64004d40 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.270+0000 7fbc77fff640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc64004d40 0x7fbc640051c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000a880 tx=0x7fbc64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eac188c4e505569 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7000a4a0 con 0x7fbc64004d40 2024-06-10T00:20:28.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7002f070 con 0x7fbc64004d40 2024-06-10T00:20:28.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc767fc640 1 -- 172.21.15.79:0/487079800 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7002bd00 con 0x7fbc64004d40 2024-06-10T00:20:28.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/487079800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc64004d40 msgr2=0x7fbc640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc7dd9d640 1 --2- 172.21.15.79:0/487079800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc64004d40 0x7fbc640051c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000a880 tx=0x7fbc64005830 comp rx=0 tx=0).stop 2024-06-10T00:20:28.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc77fff640 1 -- 172.21.15.79:0/487079800 reap_dead start 2024-06-10T00:20:28.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/487079800 shutdown_connections 2024-06-10T00:20:28.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/487079800 >> 172.21.15.79:0/487079800 conn(0x7fbc7806b7e0 msgr2=0x7fbc7806bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:28.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/487079800 shutdown_connections 2024-06-10T00:20:28.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.271+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/487079800 wait complete. 2024-06-10T00:20:28.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.272+0000 7fbc7dd9d640 1 Processor -- start 2024-06-10T00:20:28.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc7dd9d640 1 -- start start 2024-06-10T00:20:28.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc7dd9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc64004d40 0x7fbc7809c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc7dd9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc781464e0 0x7fbc7809aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc7dd9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78146960 0x7fbc78159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc7dd9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7815f7b0 con 0x7fbc78146960 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc7dd9d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc78072d30 con 0x7fbc781464e0 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc7dd9d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc78073250 con 0x7fbc64004d40 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc77fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78146960 0x7fbc78159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc77fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78146960 0x7fbc78159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48422/0 (socket says 172.21.15.79:48422) 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.273+0000 7fbc77fff640 1 -- 172.21.15.79:0/887435703 learned_addr learned my addr 172.21.15.79:0/887435703 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc777fe640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc64004d40 0x7fbc7809c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc76ffd640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc781464e0 0x7fbc7809aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc77fff640 1 -- 172.21.15.79:0/887435703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc64004d40 msgr2=0x7fbc7809c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc77fff640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc64004d40 0x7fbc7809c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc77fff640 1 -- 172.21.15.79:0/887435703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc781464e0 msgr2=0x7fbc7809aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc77fff640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc781464e0 0x7fbc7809aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc77fff640 1 -- 172.21.15.79:0/887435703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7809b4f0 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc77fff640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78146960 0x7fbc78159460 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbc7002b550 tx=0x7fbc78072940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc6ffff640 1 -- 172.21.15.79:0/887435703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70044070 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc6ffff640 1 -- 172.21.15.79:0/887435703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc70034470 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7809b7d0 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc6ffff640 1 -- 172.21.15.79:0/887435703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7000a4a0 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.274+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc7809bd90 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.275+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc780683c0 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.275+0000 7fbc6ffff640 1 -- 172.21.15.79:0/887435703 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc70047070 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.276+0000 7fbc6ffff640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc5806bd70 0x7fbc5806e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.276+0000 7fbc6ffff640 1 -- 172.21.15.79:0/887435703 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fbc700aaeb0 con 0x7fbc78146960 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.276+0000 7fbc777fe640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc5806bd70 0x7fbc5806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.276+0000 7fbc777fe640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc5806bd70 0x7fbc5806e230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009c40 tx=0x7fbc68009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:28.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.280+0000 7fbc6ffff640 1 -- 172.21.15.79:0/887435703 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc70079700 con 0x7fbc78146960 2024-06-10T00:20:28.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.520+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbc78071bc0 con 0x7fbc78146960 2024-06-10T00:20:28.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.522+0000 7fbc6ffff640 1 -- 172.21.15.79:0/887435703 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fbc70079000 con 0x7fbc78146960 2024-06-10T00:20:28.522 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-06-10T00:20:28.522 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:20:28.522 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-06-10T00:20:28.523 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-06-10T00:20:28.523 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-10T00:20:28.523 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc5806bd70 msgr2=0x7fbc5806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc5806bd70 0x7fbc5806e230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009c40 tx=0x7fbc68009190 comp rx=0 tx=0).stop 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78146960 msgr2=0x7fbc78159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78146960 0x7fbc78159460 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbc7002b550 tx=0x7fbc78072940 comp rx=0 tx=0).stop 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 shutdown_connections 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc5806bd70 0x7fbc5806e230 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78146960 0x7fbc78159460 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc781464e0 0x7fbc7809aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 --2- 172.21.15.79:0/887435703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc64004d40 0x7fbc7809c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 >> 172.21.15.79:0/887435703 conn(0x7fbc7806b7e0 msgr2=0x7fbc7815b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 shutdown_connections 2024-06-10T00:20:28.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.524+0000 7fbc7dd9d640 1 -- 172.21.15.79:0/887435703 wait complete. 2024-06-10T00:20:28.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:28.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.633+0000 7f5e4b64d640 1 Processor -- start 2024-06-10T00:20:28.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.634+0000 7f5e4b64d640 1 -- start start 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.634+0000 7f5e4b64d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 0x7f5e440cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.634+0000 7f5e4b64d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4415f5e0 con 0x7f5e4415f1a0 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.634+0000 7f5e4b64d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e440d2450 con 0x7f5e440d2680 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.634+0000 7f5e4b64d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5e440d13e0 con 0x7f5e440d1fc0 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e48be8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5e4415f1a0 0x7f5e440cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42328/0 (socket says 172.21.15.79:42328) 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e48be8640 1 -- 172.21.15.79:0/3883874459 learned_addr learned my addr 172.21.15.79:0/3883874459 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e49bea640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 0x7f5e440cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1691751971 0 0) 0x7f5e4415f5e0 con 0x7f5e4415f1a0 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e2c003520 con 0x7f5e4415f1a0 2024-06-10T00:20:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1115399100 0 0) 0x7f5e2c003520 con 0x7f5e4415f1a0 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 msgr2=0x7f5e440cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 0x7f5e440cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 >> v1:172.21.15.117:6789/0 conn(0x7f5e440d2680 legacy=0x7f5e440d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e440d0ad0 con 0x7f5e4415f1a0 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f5e38001670 con 0x7f5e4415f1a0 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 >> v1:172.21.15.79:6789/0 conn(0x7f5e4415f1a0 legacy=0x7f5e440cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 0x7f5e2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2c004d40 0x7f5e2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e440d13e0 con 0x7f5e2c0039e0 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c00ba70 con 0x7f5e2c004d40 2024-06-10T00:20:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c00bc70 con 0x7f5e440d1fc0 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e493e9640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e48be8640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 0x7f5e2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e49bea640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2c004d40 0x7f5e2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e493e9640 1 -- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 msgr2=0x7f5e2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e493e9640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 0x7f5e2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e493e9640 1 -- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2c004d40 msgr2=0x7f5e2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e493e9640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2c004d40 0x7f5e2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e493e9640 1 -- 172.21.15.79:0/3883874459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c003520 con 0x7f5e2c0039e0 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.635+0000 7f5e48be8640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440d1fc0 0x7f5e2c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.636+0000 7f5e493e9640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e2c003e00 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c001720 tx=0x7f5e2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b912f661b392295c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.636+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c001370 con 0x7f5e2c0039e0 2024-06-10T00:20:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.636+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0052d0 con 0x7f5e2c0039e0 2024-06-10T00:20:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.636+0000 7f5e43fff640 1 -- 172.21.15.79:0/3883874459 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c02abc0 con 0x7f5e2c0039e0 2024-06-10T00:20:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.637+0000 7f5e4b64d640 1 -- 172.21.15.79:0/3883874459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 msgr2=0x7f5e2c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.637+0000 7f5e4b64d640 1 --2- 172.21.15.79:0/3883874459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e2c003e00 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c001720 tx=0x7f5e2c005830 comp rx=0 tx=0).stop 2024-06-10T00:20:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.637+0000 7f5e49bea640 1 -- 172.21.15.79:0/3883874459 reap_dead start 2024-06-10T00:20:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.637+0000 7f5e4b64d640 1 -- 172.21.15.79:0/3883874459 shutdown_connections 2024-06-10T00:20:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.637+0000 7f5e4b64d640 1 -- 172.21.15.79:0/3883874459 >> 172.21.15.79:0/3883874459 conn(0x7f5e4409d3f0 msgr2=0x7f5e440d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.637+0000 7f5e4b64d640 1 -- 172.21.15.79:0/3883874459 shutdown_connections 2024-06-10T00:20:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.637+0000 7f5e4b64d640 1 -- 172.21.15.79:0/3883874459 wait complete. 2024-06-10T00:20:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.638+0000 7f5e4b64d640 1 Processor -- start 2024-06-10T00:20:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.638+0000 7f5e4b64d640 1 -- start start 2024-06-10T00:20:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e4b64d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e440cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e4b64d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440cdf00 0x7f5e4415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e4b64d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e440cb190 0x7f5e440cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e4b64d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e440d1070 con 0x7f5e2c0039e0 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e4b64d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e440d0d90 con 0x7f5e440cb190 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e4b64d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5e440d4f00 con 0x7f5e440cdf00 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e440cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e440cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48446/0 (socket says 172.21.15.79:48446) 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 -- 172.21.15.79:0/1435631715 learned_addr learned my addr 172.21.15.79:0/1435631715 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 -- 172.21.15.79:0/1435631715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440cdf00 msgr2=0x7f5e4415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440cdf00 0x7f5e4415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 -- 172.21.15.79:0/1435631715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e440cb190 msgr2=0x7f5e440cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e440cb190 0x7f5e440cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 -- 172.21.15.79:0/1435631715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4415ce70 con 0x7f5e2c0039e0 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e493e9640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e440cd3f0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c02a570 tx=0x7f5e3c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e41ffb640 1 -- 172.21.15.79:0/1435631715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c037040 con 0x7f5e2c0039e0 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e41ffb640 1 -- 172.21.15.79:0/1435631715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c005480 con 0x7f5e2c0039e0 2024-06-10T00:20:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.639+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4415d150 con 0x7f5e2c0039e0 2024-06-10T00:20:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.640+0000 7f5e41ffb640 1 -- 172.21.15.79:0/1435631715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c001370 con 0x7f5e2c0039e0 2024-06-10T00:20:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.640+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4415d710 con 0x7f5e2c0039e0 2024-06-10T00:20:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.641+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e44068430 con 0x7f5e2c0039e0 2024-06-10T00:20:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.641+0000 7f5e41ffb640 1 -- 172.21.15.79:0/1435631715 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e3c044020 con 0x7f5e2c0039e0 2024-06-10T00:20:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.641+0000 7f5e41ffb640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5e3006be30 0x7f5e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.642+0000 7f5e41ffb640 1 -- 172.21.15.79:0/1435631715 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f5e3c007640 con 0x7f5e2c0039e0 2024-06-10T00:20:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.642+0000 7f5e48be8640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5e3006be30 0x7f5e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.642+0000 7f5e48be8640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5e3006be30 0x7f5e3006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5e38000fb0 tx=0x7f5e38001b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:28.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.646+0000 7f5e41ffb640 1 -- 172.21.15.79:0/1435631715 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5e3c0796f0 con 0x7f5e2c0039e0 2024-06-10T00:20:28.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.855+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e440d04e0 con 0x7f5e2c0039e0 2024-06-10T00:20:28.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.856+0000 7f5e41ffb640 1 -- 172.21.15.79:0/1435631715 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5189 (secure 0 0 0) 0x7f5e3c078ff0 con 0x7f5e2c0039e0 2024-06-10T00:20:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:28.856 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6885,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:26.163397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/2747696124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2747696124},{"type":"v1","addr":"172.21.15.117:6835","nonce":2747696124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6903,"qdb_cluster":[6903]},"id":6}]} 2024-06-10T00:20:28.857 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 50 2024-06-10T00:20:28.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.857+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5e3006be30 msgr2=0x7f5e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5e3006be30 0x7f5e3006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5e38000fb0 tx=0x7f5e38001b80 comp rx=0 tx=0).stop 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 msgr2=0x7f5e440cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e440cd3f0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c02a570 tx=0x7f5e3c001120 comp rx=0 tx=0).stop 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 shutdown_connections 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5e3006be30 0x7f5e3006e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e440cb190 0x7f5e440cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440cdf00 0x7f5e4415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 --2- 172.21.15.79:0/1435631715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e2c0039e0 0x7f5e440cd3f0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 >> 172.21.15.79:0/1435631715 conn(0x7f5e4409d3f0 msgr2=0x7f5e441615f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 shutdown_connections 2024-06-10T00:20:28.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:28.858+0000 7f5e4b64d640 1 -- 172.21.15.79:0/1435631715 wait complete. 2024-06-10T00:20:29.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:20:24.159187+0000', 'modified': '2024-06-10T00:20:26.163397+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6903}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6903': {'gid': 6903, 'name': 'b', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6835/2747696124', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6833', 'nonce': 2747696124}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 2747696124}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6903, 'qdb_cluster': [6903]} 2024-06-10T00:20:29.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:20:29.272 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-10T00:20:29.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.374+0000 7f4aa9efc640 1 Processor -- start 2024-06-10T00:20:29.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.374+0000 7f4aa9efc640 1 -- start start 2024-06-10T00:20:29.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa9efc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa9efc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4aa40cf190 0x7f4aa40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa9efc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa40cf640 con 0x7f4aa40ae910 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa9efc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4aa406d130 con 0x7f4aa40cf190 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa9efc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa406d410 con 0x7f4aa406ebf0 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa2ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4aa40cf190 0x7f4aa40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa37fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4aa40ae910 0x7f4aa406e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:55116/0 (socket says 172.21.15.79:55116) 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa37fe640 1 -- 172.21.15.79:0/1572871435 learned_addr learned my addr 172.21.15.79:0/1572871435 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.375+0000 7f4aa2ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:59692/0 (socket says 172.21.15.79:59692) 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.376+0000 7f4aa27fc640 1 -- 172.21.15.79:0/1572871435 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357062811 0 0) 0x7f4aa40cf640 con 0x7f4aa40ae910 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.376+0000 7f4aa27fc640 1 -- 172.21.15.79:0/1572871435 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a8c003520 con 0x7f4aa40ae910 2024-06-10T00:20:29.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.376+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/1572871435 >> v2:172.21.15.117:3300/0 conn(0x7f4aa40cf190 msgr2=0x7f4aa40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.376+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/1572871435 >> v2:172.21.15.117:3300/0 conn(0x7f4aa40cf190 0x7f4aa40acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.376+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/1572871435 >> v1:172.21.15.117:6789/0 conn(0x7f4aa40ae910 legacy=0x7f4aa406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.376+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/1572871435 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa406d6f0 con 0x7f4aa406ebf0 2024-06-10T00:20:29.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.376+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/1572871435 >> v2:172.21.15.117:3300/0 conn(0x7f4aa40cf190 0x7f4aa40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:20:29.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/1572871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40cec50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a980097d0 tx=0x7f4a9802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66e494bcb662e5a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa27fc640 1 -- 172.21.15.79:0/1572871435 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98037070 con 0x7f4aa406ebf0 2024-06-10T00:20:29.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa27fc640 1 -- 172.21.15.79:0/1572871435 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9802ae40 con 0x7f4aa406ebf0 2024-06-10T00:20:29.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa27fc640 1 -- 172.21.15.79:0/1572871435 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98032640 con 0x7f4aa406ebf0 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa9efc640 1 -- 172.21.15.79:0/1572871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 msgr2=0x7f4aa40cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/1572871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40cec50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a980097d0 tx=0x7f4a9802a130 comp rx=0 tx=0).stop 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa9efc640 1 -- 172.21.15.79:0/1572871435 shutdown_connections 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/1572871435 >> v2:172.21.15.117:3300/0 conn(0x7f4aa40cf190 0x7f4aa40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/1572871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40cec50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa9efc640 1 -- 172.21.15.79:0/1572871435 >> 172.21.15.79:0/1572871435 conn(0x7f4aa40b19f0 msgr2=0x7f4aa40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa9efc640 1 -- 172.21.15.79:0/1572871435 shutdown_connections 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.377+0000 7f4aa9efc640 1 -- 172.21.15.79:0/1572871435 wait complete. 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.378+0000 7f4aa9efc640 1 Processor -- start 2024-06-10T00:20:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.379+0000 7f4aa9efc640 1 -- start start 2024-06-10T00:20:29.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.379+0000 7f4aa9efc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.379+0000 7f4aa9efc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa40ae910 0x7f4aa4151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.379+0000 7f4aa9efc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40cf190 0x7f4aa4151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.379+0000 7f4aa9efc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa40ad280 con 0x7f4aa40ae910 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.379+0000 7f4aa9efc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa40aecf0 con 0x7f4aa40cf190 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.379+0000 7f4aa9efc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa40ad400 con 0x7f4aa406ebf0 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.379+0000 7f4aa2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa40ae910 0x7f4aa4151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa40ae910 0x7f4aa4151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48462/0 (socket says 172.21.15.79:48462) 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/2416567671 learned_addr learned my addr 172.21.15.79:0/2416567671 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40cf190 0x7f4aa4151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 msgr2=0x7f4aa40d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40cf190 msgr2=0x7f4aa4151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40cf190 0x7f4aa4151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/2416567671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa409abb0 con 0x7f4aa40ae910 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40cf190 0x7f4aa4151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa40ae910 0x7f4aa4151340 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4a98000c00 tx=0x7f4a980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4a8bfff640 1 -- 172.21.15.79:0/2416567671 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98041070 con 0x7f4aa40ae910 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4a8bfff640 1 -- 172.21.15.79:0/2416567671 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9803c460 con 0x7f4aa40ae910 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa9efc640 1 -- 172.21.15.79:0/2416567671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa409ae90 con 0x7f4aa40ae910 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4a8bfff640 1 -- 172.21.15.79:0/2416567671 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98037040 con 0x7f4aa40ae910 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.380+0000 7f4aa9efc640 1 -- 172.21.15.79:0/2416567671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa409b450 con 0x7f4aa40ae910 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.382+0000 7f4a8bfff640 1 -- 172.21.15.79:0/2416567671 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a98044070 con 0x7f4aa40ae910 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.382+0000 7f4a8bfff640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a9006be30 0x7f4a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.382+0000 7f4a8bfff640 1 -- 172.21.15.79:0/2416567671 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f4a980ab3c0 con 0x7f4aa40ae910 2024-06-10T00:20:29.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.382+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a9006be30 0x7f4a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.383+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a9006be30 0x7f4a9006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4a940012e0 tx=0x7f4a94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.383+0000 7f4aacc0a740 1 Processor -- start 2024-06-10T00:20:29.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.383+0000 7f4aacc0a740 1 -- start start 2024-06-10T00:20:29.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988be510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 0x55bf988bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9888e960 0x55bf98892170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf987f7740 con 0x55bf9888e960 2024-06-10T00:20:29.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bf98795a80 con 0x55bf988bc0e0 2024-06-10T00:20:29.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bf987f3700 con 0x55bf988bbd00 2024-06-10T00:20:29.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9888e960 0x55bf98892170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9888e960 0x55bf98892170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48472/0 (socket says 172.21.15.79:48472) 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 -- 172.21.15.79:0/539448383 learned_addr learned my addr 172.21.15.79:0/539448383 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 0x55bf988bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 -- 172.21.15.79:0/539448383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 msgr2=0x55bf988be510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988be510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 -- 172.21.15.79:0/539448383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 msgr2=0x55bf988bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 0x55bf988bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 -- 172.21.15.79:0/539448383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf987c0fb0 con 0x55bf9888e960 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9888e960 0x55bf98892170 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009ac0 tx=0x7f4a9c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e4315e7b3c6581 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.384+0000 7f4a897fa640 1 -- 172.21.15.79:0/539448383 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c018070 con 0x55bf9888e960 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4a897fa640 1 -- 172.21.15.79:0/539448383 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c010ce0 con 0x55bf9888e960 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4a897fa640 1 -- 172.21.15.79:0/539448383 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c00f040 con 0x55bf9888e960 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 -- 172.21.15.79:0/539448383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9888e960 msgr2=0x55bf98892170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9888e960 0x55bf98892170 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009ac0 tx=0x7f4a9c009190 comp rx=0 tx=0).stop 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 -- 172.21.15.79:0/539448383 shutdown_connections 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf9888e960 0x55bf98892170 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 0x55bf988bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/539448383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988be510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 -- 172.21.15.79:0/539448383 >> 172.21.15.79:0/539448383 conn(0x55bf98890bd0 msgr2=0x55bf988d9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:29.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 -- 172.21.15.79:0/539448383 shutdown_connections 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.385+0000 7f4aacc0a740 1 -- 172.21.15.79:0/539448383 wait complete. 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.386+0000 7f4aacc0a740 1 -- start start 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.386+0000 7f4aacc0a740 1 Processor -- start 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 0x55bf988b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf98893d80 con 0x55bf988bc0e0 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bf98780c30 con 0x55bf988b42a0 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bf98894060 con 0x55bf988bbd00 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 10 client.0 _ll_register_callbacks cb 0x55bf987b27f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:29.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988dceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988dceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48484/0 (socket says 172.21.15.79:48484) 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/1526158120 learned_addr learned my addr 172.21.15.79:0/1526158120 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 0x55bf988b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 msgr2=0x55bf988b9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988b9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 msgr2=0x55bf988b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 0x55bf988b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 -- 172.21.15.79:0/1526158120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf9850b2d0 con 0x55bf988bc0e0 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 0x55bf988b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988dceb0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f4a98079420 tx=0x7f4a98006ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a68fd83fc15898d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4a827fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4a827fc640 1 -- 172.21.15.79:0/1526158120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9804b040 con 0x55bf988bc0e0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4a827fc640 1 -- 172.21.15.79:0/1526158120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f4a98081c30 con 0x55bf988bc0e0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1526158120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a9c010ce0 con 0x55bf988bc0e0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4a827fc640 1 -- 172.21.15.79:0/1526158120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4a980820c0 con 0x55bf988bc0e0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 10 client.7014 fetch_fsmap learned FSMap version 50 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.387+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1526158120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55bf985d56b0 con 0x55bf988bc0e0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4a827fc640 1 -- 172.21.15.79:0/1526158120 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c010ce0 con 0x55bf988bc0e0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4a827fc640 1 -- 172.21.15.79:0/1526158120 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 50) ==== 3494+0+0 (secure 0 0 0) 0x7f4a9804e060 con 0x55bf988bc0e0 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4aacc0a740 10 client.7014 fetch_fsmap finished waiting for FSMap version 50 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4aacc0a740 10 client.7014 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-10T00:20:29.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4aacc0a740 20 client.7014 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] conn(0x55bf988b7a40 0x55bf988b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4aacc0a740 4 client.7014 mds_command: new command op to 6903 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1526158120 --> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf98804e70 con 0x55bf988b7a40 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] conn(0x55bf988b7a40 0x55bf988b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4a827fc640 10 client.7014 ms_handle_connect on v2:172.21.15.117:6833/2747696124 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.388+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] conn(0x55bf988b7a40 0x55bf988b7e20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bed319c32f374df1 server_cookie=f1e415e723275407 in_seq=0 out_seq=0 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4a827fc640 1 -- 172.21.15.79:0/1526158120 <== mds.0 v2:172.21.15.117:6833/2747696124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bf98804e70 con 0x55bf988b7a40 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4a827fc640 10 client.7014 handle_command_reply: tid=0 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 client.7014 shutdown 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1526158120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 msgr2=0x55bf988dceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988dceb0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f4a98079420 tx=0x7f4a98006ed0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1526158120 shutdown_connections 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] conn(0x55bf988b7a40 0x55bf988b7e20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 0x55bf988b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4a827fc640 0 client.7014 ms_handle_reset on v2:172.21.15.117:6833/2747696124 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988dceb0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1526158120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988b9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1526158120 >> 172.21.15.79:0/1526158120 conn(0x55bf9888e960 msgr2=0x55bf988bb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1526158120 shutdown_connections 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1526158120 wait complete. 2024-06-10T00:20:29.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.389+0000 7f4aacc0a740 20 client.7014 trim_cache size 0 max 16384 2024-06-10T00:20:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.408+0000 7f4aacc0a740 1 Processor -- start 2024-06-10T00:20:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.408+0000 7f4aacc0a740 1 -- start start 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 0x55bf9888a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf9888d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41fdb80 con 0x55bf988bc0e0 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa409c8c0 con 0x55bf988b42a0 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa41fd530 con 0x55bf988bbd00 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988bafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48494/0 (socket says 172.21.15.79:48494) 2024-06-10T00:20:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 -- 172.21.15.79:0/3637684678 learned_addr learned my addr 172.21.15.79:0/3637684678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 -- 172.21.15.79:0/3637684678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 msgr2=0x55bf9888d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/3637684678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf9888d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 -- 172.21.15.79:0/3637684678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 msgr2=0x55bf9888a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/3637684678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 0x55bf9888a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 -- 172.21.15.79:0/3637684678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf988d91c0 con 0x55bf988bc0e0 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4aa3fff640 1 --2- 172.21.15.79:0/3637684678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988bafe0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009a90 tx=0x7f4a9c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b3619f48cfdef3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4a88ff9640 1 -- 172.21.15.79:0/3637684678 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c02c070 con 0x55bf988bc0e0 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4a88ff9640 1 -- 172.21.15.79:0/3637684678 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c010d00 con 0x55bf988bc0e0 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.409+0000 7f4a88ff9640 1 -- 172.21.15.79:0/3637684678 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c018040 con 0x55bf988bc0e0 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 -- 172.21.15.79:0/3637684678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 msgr2=0x55bf988bafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/3637684678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988bafe0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009a90 tx=0x7f4a9c015000 comp rx=0 tx=0).stop 2024-06-10T00:20:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 -- 172.21.15.79:0/3637684678 shutdown_connections 2024-06-10T00:20:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/3637684678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988bc0e0 0x55bf988bafe0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/3637684678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf9888d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/3637684678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988b42a0 0x55bf9888a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 -- 172.21.15.79:0/3637684678 >> 172.21.15.79:0/3637684678 conn(0x55bf9888e960 msgr2=0x55bf988b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 -- 172.21.15.79:0/3637684678 shutdown_connections 2024-06-10T00:20:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 -- 172.21.15.79:0/3637684678 wait complete. 2024-06-10T00:20:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.410+0000 7f4aacc0a740 1 -- start start 2024-06-10T00:20:29.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aacc0a740 1 Processor -- start 2024-06-10T00:20:29.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988b42a0 0x55bf98958950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aacc0a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 0x55bf988bb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf98893d80 con 0x55bf988b42a0 2024-06-10T00:20:29.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bf988b4c60 con 0x55bf988bc0e0 2024-06-10T00:20:29.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aacc0a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bf988b6a10 con 0x55bf988bbd00 2024-06-10T00:20:29.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aacc0a740 10 client.0 _ll_register_callbacks cb 0x7f4a980790d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aa37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988b42a0 0x55bf98958950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aa37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988b42a0 0x55bf98958950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48502/0 (socket says 172.21.15.79:48502) 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.411+0000 7f4aa37fe640 1 -- 172.21.15.79:0/1353975056 learned_addr learned my addr 172.21.15.79:0/1353975056 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aa37fe640 1 -- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 msgr2=0x55bf988bafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988bafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aa37fe640 1 -- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 msgr2=0x55bf988bb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 0x55bf988bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aa37fe640 1 -- 172.21.15.79:0/1353975056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf988ec300 con 0x55bf988b42a0 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aa37fe640 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988b42a0 0x55bf98958950 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4a94007220 tx=0x7f4a94001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af556c89653e7d49 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4a827fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4a827fc640 1 -- 172.21.15.79:0/1353975056 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94023630 con 0x55bf988b42a0 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4a827fc640 1 -- 172.21.15.79:0/1353975056 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f4a940237d0 con 0x55bf988b42a0 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1353975056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a9c010d00 con 0x55bf988b42a0 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4a827fc640 1 -- 172.21.15.79:0/1353975056 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4a94004b60 con 0x55bf988b42a0 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 10 client.7020 fetch_fsmap learned FSMap version 50 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1353975056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55bf988dc350 con 0x55bf988b42a0 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4a827fc640 1 -- 172.21.15.79:0/1353975056 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c010d00 con 0x55bf988b42a0 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4a827fc640 1 -- 172.21.15.79:0/1353975056 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 50) ==== 3494+0+0 (secure 0 0 0) 0x7f4a940239d0 con 0x55bf988b42a0 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 10 client.7020 fetch_fsmap finished waiting for FSMap version 50 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 10 client.7020 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 20 client.7020 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] conn(0x55bf988b0ff0 0x55bf988fcf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 4 client.7020 mds_command: new command op to 6903 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.412+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1353975056 --> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] -- command(tid 0: {"prefix": "status"}) -- 0x55bf988bfad0 con 0x55bf988b0ff0 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] conn(0x55bf988b0ff0 0x55bf988fcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4a827fc640 10 client.7020 ms_handle_connect on v2:172.21.15.117:6833/2747696124 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aa2ffd640 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] conn(0x55bf988b0ff0 0x55bf988fcf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e234ee327c2347 server_cookie=9be726a25998bdef in_seq=0 out_seq=0 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4a827fc640 1 -- 172.21.15.79:0/1353975056 <== mds.0 v2:172.21.15.117:6833/2747696124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55bf988bfad0 con 0x55bf988b0ff0 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4a827fc640 10 client.7020 handle_command_reply: tid=0 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 client.7020 shutdown 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1353975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988b42a0 msgr2=0x55bf98958950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988b42a0 0x55bf98958950 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4a94007220 tx=0x7f4a94001250 comp rx=0 tx=0).stop 2024-06-10T00:20:29.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1353975056 shutdown_connections 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:6833/2747696124,v1:172.21.15.117:6835/2747696124] conn(0x55bf988b0ff0 0x55bf988fcf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bf988bc0e0 0x55bf988bb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bf988bbd00 0x55bf988bafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 --2- 172.21.15.79:0/1353975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf988b42a0 0x55bf98958950 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4a827fc640 0 client.7020 ms_handle_reset on v2:172.21.15.117:6833/2747696124 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1353975056 >> 172.21.15.79:0/1353975056 conn(0x55bf9888e960 msgr2=0x55bf988ba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1353975056 shutdown_connections 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.413+0000 7f4aacc0a740 1 -- 172.21.15.79:0/1353975056 wait complete. 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aacc0a740 20 client.7020 trim_cache size 0 max 16384 2024-06-10T00:20:29.421 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6903, 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.5920851010000003, 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 50, 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 88, 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 88, 2024-06-10T00:20:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 8.9279037300000006 2024-06-10T00:20:29.423 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:29.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 -- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a9006be30 msgr2=0x7f4a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a9006be30 0x7f4a9006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4a940012e0 tx=0x7f4a94009040 comp rx=0 tx=0).stop 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 -- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa40ae910 msgr2=0x7f4aa4151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa40ae910 0x7f4aa4151340 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4a98000c00 tx=0x7f4a980046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 -- 172.21.15.79:0/2416567671 shutdown_connections 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4a9006be30 0x7f4a9006e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40cf190 0x7f4aa4151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa40ae910 0x7f4aa4151340 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 --2- 172.21.15.79:0/2416567671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa406ebf0 0x7f4aa40d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 -- 172.21.15.79:0/2416567671 >> 172.21.15.79:0/2416567671 conn(0x7f4aa40b19f0 msgr2=0x7f4aa40cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 -- 172.21.15.79:0/2416567671 shutdown_connections 2024-06-10T00:20:29.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.414+0000 7f4aa9efc640 1 -- 172.21.15.79:0/2416567671 wait complete. 2024-06-10T00:20:29.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:20:29.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.524+0000 7ffb2574f640 1 Processor -- start 2024-06-10T00:20:29.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.525+0000 7ffb2574f640 1 -- start start 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb2574f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb200d1fc0 0x7ffb200cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb2574f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb2015f5e0 con 0x7ffb2015f1a0 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb2574f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb200d0ad0 con 0x7ffb200d2680 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb2574f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ffb200d13e0 con 0x7ffb200d1fc0 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1e7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffb2015f1a0 0x7ffb200cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42336/0 (socket says 172.21.15.79:42336) 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1e7fc640 1 -- 172.21.15.79:0/1382840698 learned_addr learned my addr 172.21.15.79:0/1382840698 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1f7fe640 1 --2- 172.21.15.79:0/1382840698 >> v2:172.21.15.117:3300/0 conn(0x7ffb200d1fc0 0x7ffb200cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6861378 0 0) 0x7ffb2015f5e0 con 0x7ffb2015f1a0 2024-06-10T00:20:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb0c003520 con 0x7ffb2015f1a0 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 114603247 0 0) 0x7ffb0c003520 con 0x7ffb2015f1a0 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 >> v2:172.21.15.117:3300/0 conn(0x7ffb200d1fc0 msgr2=0x7ffb200cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 --2- 172.21.15.79:0/1382840698 >> v2:172.21.15.117:3300/0 conn(0x7ffb200d1fc0 0x7ffb200cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 >> v1:172.21.15.117:6789/0 conn(0x7ffb200d2680 legacy=0x7ffb200d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2015f890 con 0x7ffb2015f1a0 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7ffb08001670 con 0x7ffb2015f1a0 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 >> v1:172.21.15.79:6789/0 conn(0x7ffb2015f1a0 legacy=0x7ffb200cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0039b0 0x7ffb0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c004800 0x7ffb0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200d13e0 con 0x7ffb0c0051c0 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c00c060 con 0x7ffb0c004800 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0c00c260 con 0x7ffb0c0039b0 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1f7fe640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1effd640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0039b0 0x7ffb0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.526+0000 7ffb1e7fc640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c004800 0x7ffb0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1f7fe640 1 -- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0039b0 msgr2=0x7ffb0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1f7fe640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0039b0 0x7ffb0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1f7fe640 1 -- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c004800 msgr2=0x7ffb0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1f7fe640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c004800 0x7ffb0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1f7fe640 1 -- 172.21.15.79:0/1382840698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0c003520 con 0x7ffb0c0051c0 2024-06-10T00:20:29.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1e7fc640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c004800 0x7ffb0c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1effd640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0039b0 0x7ffb0c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1f7fe640 1 -- 172.21.15.79:0/1382840698 reap_dead start 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1f7fe640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb0c00b9c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009ac0 tx=0x7ffb0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95e2945c45a9229 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18009690 con 0x7ffb0c0051c0 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb18004020 con 0x7ffb0c0051c0 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.527+0000 7ffb1dffb640 1 -- 172.21.15.79:0/1382840698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18004410 con 0x7ffb0c0051c0 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.528+0000 7ffb2574f640 1 -- 172.21.15.79:0/1382840698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 msgr2=0x7ffb0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.528+0000 7ffb2574f640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb0c00b9c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009ac0 tx=0x7ffb0c005830 comp rx=0 tx=0).stop 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.528+0000 7ffb2574f640 1 -- 172.21.15.79:0/1382840698 shutdown_connections 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.528+0000 7ffb2574f640 1 --2- 172.21.15.79:0/1382840698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb0c00b9c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.528+0000 7ffb2574f640 1 -- 172.21.15.79:0/1382840698 >> 172.21.15.79:0/1382840698 conn(0x7ffb2009d3f0 msgr2=0x7ffb200d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:29.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.528+0000 7ffb2574f640 1 -- 172.21.15.79:0/1382840698 shutdown_connections 2024-06-10T00:20:29.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.528+0000 7ffb2574f640 1 -- 172.21.15.79:0/1382840698 wait complete. 2024-06-10T00:20:29.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.529+0000 7ffb2574f640 1 Processor -- start 2024-06-10T00:20:29.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.529+0000 7ffb2574f640 1 -- start start 2024-06-10T00:20:29.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb2574f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb2015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb2574f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb200cd830 0x7ffb2009f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb2574f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb200b94a0 0x7ffb2009fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb2574f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200d2410 con 0x7ffb0c0051c0 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb2574f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200d1070 con 0x7ffb200b94a0 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb2574f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb200d4f00 con 0x7ffb200cd830 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb2015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb2015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48510/0 (socket says 172.21.15.79:48510) 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1effd640 1 -- 172.21.15.79:0/861332757 learned_addr learned my addr 172.21.15.79:0/861332757 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1e7fc640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb200cd830 0x7ffb2009f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1f7fe640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb200b94a0 0x7ffb2009fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1effd640 1 -- 172.21.15.79:0/861332757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb200cd830 msgr2=0x7ffb2009f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1effd640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb200cd830 0x7ffb2009f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1effd640 1 -- 172.21.15.79:0/861332757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb200b94a0 msgr2=0x7ffb2009fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1effd640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb200b94a0 0x7ffb2009fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.530+0000 7ffb1effd640 1 -- 172.21.15.79:0/861332757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb200cdd10 con 0x7ffb0c0051c0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.531+0000 7ffb1effd640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb2015a5a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000e8f0 tx=0x7ffb1000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.531+0000 7ffb177fe640 1 -- 172.21.15.79:0/861332757 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10003b80 con 0x7ffb0c0051c0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.531+0000 7ffb177fe640 1 -- 172.21.15.79:0/861332757 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb10018070 con 0x7ffb0c0051c0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.531+0000 7ffb177fe640 1 -- 172.21.15.79:0/861332757 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb100050d0 con 0x7ffb0c0051c0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.531+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb200cdff0 con 0x7ffb0c0051c0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.531+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2009ebf0 con 0x7ffb0c0051c0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.532+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb20068430 con 0x7ffb0c0051c0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.532+0000 7ffb177fe640 1 -- 172.21.15.79:0/861332757 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb10005270 con 0x7ffb0c0051c0 2024-06-10T00:20:29.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.533+0000 7ffb177fe640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb0006be30 0x7ffb0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:29.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.533+0000 7ffb177fe640 1 -- 172.21.15.79:0/861332757 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7ffb1008afe0 con 0x7ffb0c0051c0 2024-06-10T00:20:29.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.533+0000 7ffb1e7fc640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb0006be30 0x7ffb0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:29.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.533+0000 7ffb1e7fc640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb0006be30 0x7ffb0006e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffb2009e840 tx=0x7ffb08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:29.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.537+0000 7ffb177fe640 1 -- 172.21.15.79:0/861332757 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffb1001a310 con 0x7ffb0c0051c0 2024-06-10T00:20:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.751+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffb200d04e0 con 0x7ffb0c0051c0 2024-06-10T00:20:29.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.751+0000 7ffb177fe640 1 -- 172.21.15.79:0/861332757 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) ==== 53+0+73 (secure 0 0 0) 0x7ffb10059800 con 0x7ffb0c0051c0 2024-06-10T00:20:29.752 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:20:29.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb0006be30 msgr2=0x7ffb0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb0006be30 0x7ffb0006e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffb2009e840 tx=0x7ffb08009040 comp rx=0 tx=0).stop 2024-06-10T00:20:29.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 msgr2=0x7ffb2015a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb2015a5a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000e8f0 tx=0x7ffb1000edb0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 shutdown_connections 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ffb0006be30 0x7ffb0006e2f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb200b94a0 0x7ffb2009fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb200cd830 0x7ffb2009f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 --2- 172.21.15.79:0/861332757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb0c0051c0 0x7ffb2015a5a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 >> 172.21.15.79:0/861332757 conn(0x7ffb2009d3f0 msgr2=0x7ffb200c7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 shutdown_connections 2024-06-10T00:20:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29.753+0000 7ffb2574f640 1 -- 172.21.15.79:0/861332757 wait complete. 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:20:29.765 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:29.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:29.766 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42414sec preferred_lft 42414sec 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:29.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:29.784 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:20:29.846 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:20:29.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:29.848 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:20:29.904 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:20:29.904 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:20:29.904 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:20:29.905 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:20:29.905 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:20:29.905 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:20:29.905 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:20:29.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:20:29.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:20:29.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:20:29.905 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:20:29.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:20:30.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:20:30.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.030 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:20:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:20:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:20:30.046 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:30.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:20:30.110 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:20:30.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:20:30.111 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:30.165 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:30.166 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:20:30.166 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:30.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:20:30.285 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:20:30.342 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:20:30.342 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:20:30.342 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:20:30.342 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:20:30.342 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:20:30.342 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:20:30.342 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:20:30.342 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:20:30.343 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:30.345 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:30.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.345 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:20:30.397 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:20:30.397 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:20:30.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:20:30.463 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:20:30.519 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:20:30.519 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:20:30.519 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:20:30.519 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:20:30.519 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:20:30.520 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:30.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:30.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.522 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:20:30.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:20:30.519+0000 7fbb72dec480 -1 init, newargv = 0x55e53e4554b0 newargc=15 2024-06-10T00:20:30.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[64705]: starting ceph client 2024-06-10T00:20:30.524 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[64705]: starting fuse 2024-06-10T00:20:30.538 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:20:30.539 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:20:30.539 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:20:30.656 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.64705.asok 2024-06-10T00:20:30.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:20:30.667 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.64705.asok 2024-06-10T00:20:30.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.64705.asok status 2024-06-10T00:20:30.801 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:30.801 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:20:30.801 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:20:30.801 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:20:30.801 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "64705", 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7035, 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 7035 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:30.802 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4200093372 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4200093372 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.7035 192.168.0.1:0/4200093372", 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/4200093372", 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 50, 2024-06-10T00:20:30.803 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 88, 2024-06-10T00:20:30.804 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:20:30.804 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:20:30.804 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:20:30.804 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:30.804 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-06-10T00:20:30.804+0000 7f404b308640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:20:30.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.810 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:20:30.810 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:30.825 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:20:30.826 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:30.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:30.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.892 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-06-10T00:20:30.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:30.954 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-06-10T00:20:31.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:31.013 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-06-10T00:20:31.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:31.071 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-06-10T00:20:31.131 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:20:31.131 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:20:31.131 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:20:31.131 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:31.131 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-06-10T00:20:31.131 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:20:31.237 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-06-10T00:20:31.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:20:31.246 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:20:31.247 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:31.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:20:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.441+0000 7f87781f9640 1 Processor -- start 2024-06-10T00:20:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.441+0000 7f87781f9640 1 -- start start 2024-06-10T00:20:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f87781f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f877015a870 0x7f877006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f87781f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877006e390 con 0x7f87700af3d0 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f87781f9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877015ac50 con 0x7f87700aef70 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f87781f9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f877006cdb0 con 0x7f877015a870 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f8775f95640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f877015a870 0x7f877006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f8776796640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f87700af3d0 0x7f87700cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42350/0 (socket says 172.21.15.79:42350) 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f8776796640 1 -- 172.21.15.79:0/682805066 learned_addr learned my addr 172.21.15.79:0/682805066 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f8775f95640 1 -- 172.21.15.79:0/682805066 >> v1:172.21.15.117:6789/0 conn(0x7f87700aef70 legacy=0x7f87700b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f8775f95640 1 -- 172.21.15.79:0/682805066 >> v1:172.21.15.79:6789/0 conn(0x7f87700af3d0 legacy=0x7f87700cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.442+0000 7f8775f95640 1 -- 172.21.15.79:0/682805066 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877006d090 con 0x7f877015a870 2024-06-10T00:20:31.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f8775f95640 1 --2- 172.21.15.79:0/682805066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f877015a870 0x7f877006de50 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f876c0097a0 tx=0x7f876c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b1a7384dedaebe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:31.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f8774f93640 1 -- 172.21.15.79:0/682805066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c037070 con 0x7f877015a870 2024-06-10T00:20:31.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f8774f93640 1 -- 172.21.15.79:0/682805066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c032440 con 0x7f877015a870 2024-06-10T00:20:31.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f8774f93640 1 -- 172.21.15.79:0/682805066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c032810 con 0x7f877015a870 2024-06-10T00:20:31.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f87781f9640 1 -- 172.21.15.79:0/682805066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f877015a870 msgr2=0x7f877006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f87781f9640 1 --2- 172.21.15.79:0/682805066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f877015a870 0x7f877006de50 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f876c0097a0 tx=0x7f876c02a1a0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f87781f9640 1 -- 172.21.15.79:0/682805066 shutdown_connections 2024-06-10T00:20:31.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f87781f9640 1 --2- 172.21.15.79:0/682805066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f877015a870 0x7f877006de50 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.443+0000 7f87781f9640 1 -- 172.21.15.79:0/682805066 >> 172.21.15.79:0/682805066 conn(0x7f87700b19f0 msgr2=0x7f87700b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:31.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.444+0000 7f87781f9640 1 -- 172.21.15.79:0/682805066 shutdown_connections 2024-06-10T00:20:31.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.444+0000 7f87781f9640 1 -- 172.21.15.79:0/682805066 wait complete. 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.445+0000 7f87781f9640 1 Processor -- start 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.445+0000 7f87781f9640 1 -- start start 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.445+0000 7f87781f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87700aef70 0x7f8770143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.445+0000 7f87781f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87700af3d0 0x7f877014da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.445+0000 7f87781f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f877015a870 0x7f87701686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.445+0000 7f87781f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f877006d930 con 0x7f87700aef70 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.445+0000 7f87781f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f877006d650 con 0x7f87700af3d0 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.445+0000 7f87781f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87700b2e40 con 0x7f877015a870 2024-06-10T00:20:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87700aef70 0x7f8770143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87700aef70 0x7f8770143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48532/0 (socket says 172.21.15.79:48532) 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 -- 172.21.15.79:0/2342653469 learned_addr learned my addr 172.21.15.79:0/2342653469 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 -- 172.21.15.79:0/2342653469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f877015a870 msgr2=0x7f87701686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f877015a870 0x7f87701686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 -- 172.21.15.79:0/2342653469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87700af3d0 msgr2=0x7f877014da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87700af3d0 0x7f877014da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 -- 172.21.15.79:0/2342653469 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877014ca90 con 0x7f87700aef70 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f8775f95640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87700aef70 0x7f8770143e90 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f876c0098c0 tx=0x7f876c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f87667fc640 1 -- 172.21.15.79:0/2342653469 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c037040 con 0x7f87700aef70 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f87667fc640 1 -- 172.21.15.79:0/2342653469 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c030770 con 0x7f87700aef70 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877014cd70 con 0x7f87700aef70 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f87667fc640 1 -- 172.21.15.79:0/2342653469 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c030b40 con 0x7f87700aef70 2024-06-10T00:20:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.446+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877014d330 con 0x7f87700aef70 2024-06-10T00:20:31.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.447+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8770068430 con 0x7f87700aef70 2024-06-10T00:20:31.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.448+0000 7f87667fc640 1 -- 172.21.15.79:0/2342653469 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f876c044020 con 0x7f87700aef70 2024-06-10T00:20:31.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.448+0000 7f87667fc640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f875406be30 0x7f875406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.448+0000 7f87667fc640 1 -- 172.21.15.79:0/2342653469 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f876c0ab480 con 0x7f87700aef70 2024-06-10T00:20:31.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.448+0000 7f8775794640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f875406be30 0x7f875406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.449+0000 7f8775794640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f875406be30 0x7f875406e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8760000f60 tx=0x7f87600079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:31.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.452+0000 7f87667fc640 1 -- 172.21.15.79:0/2342653469 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f876c032e20 con 0x7f87700aef70 2024-06-10T00:20:31.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.637+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f87700b2650 con 0x7f87700aef70 2024-06-10T00:20:31.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.638+0000 7f87667fc640 1 -- 172.21.15.79:0/2342653469 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) ==== 80+0+0 (secure 0 0 0) 0x7f876c079d30 con 0x7f87700aef70 2024-06-10T00:20:31.638 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:20:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.639+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f875406be30 msgr2=0x7f875406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.639+0000 7f87781f9640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f875406be30 0x7f875406e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8760000f60 tx=0x7f87600079b0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.639+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87700aef70 msgr2=0x7f8770143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.639+0000 7f87781f9640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87700aef70 0x7f8770143e90 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f876c0098c0 tx=0x7f876c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.640+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 shutdown_connections 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.640+0000 7f87781f9640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f875406be30 0x7f875406e2f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.640+0000 7f87781f9640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f877015a870 0x7f87701686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.640+0000 7f87781f9640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87700af3d0 0x7f877014da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.640+0000 7f87781f9640 1 --2- 172.21.15.79:0/2342653469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87700aef70 0x7f8770143e90 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.640+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 >> 172.21.15.79:0/2342653469 conn(0x7f87700b19f0 msgr2=0x7f8770159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.640+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 shutdown_connections 2024-06-10T00:20:31.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.640+0000 7f87781f9640 1 -- 172.21.15.79:0/2342653469 wait complete. 2024-06-10T00:20:31.651 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:20:31.651 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:20:31.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:20:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.808+0000 7f76a9e9e640 1 Processor -- start 2024-06-10T00:20:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.808+0000 7f76a9e9e640 1 -- start start 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a9e9e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f76a40aef70 0x7f76a40b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a9e9e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a415ac50 con 0x7f76a40af3b0 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a9e9e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a406cdb0 con 0x7f76a415a870 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a9e9e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f76a406d090 con 0x7f76a40aef70 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f76a40af3b0 0x7f76a40cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42356/0 (socket says 172.21.15.79:42356) 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a3fff640 1 -- 172.21.15.79:0/1900804869 learned_addr learned my addr 172.21.15.79:0/1900804869 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f769bfff640 1 --2- 172.21.15.79:0/1900804869 >> v2:172.21.15.117:3300/0 conn(0x7f76a40aef70 0x7f76a40b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523782070 0 0) 0x7f76a415ac50 con 0x7f76a40af3b0 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7690003520 con 0x7f76a40af3b0 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2589010844 0 0) 0x7f7690003520 con 0x7f76a40af3b0 2024-06-10T00:20:31.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 >> v2:172.21.15.117:3300/0 conn(0x7f76a40aef70 msgr2=0x7f76a40b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 --2- 172.21.15.79:0/1900804869 >> v2:172.21.15.117:3300/0 conn(0x7f76a40aef70 0x7f76a40b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 >> v1:172.21.15.117:6789/0 conn(0x7f76a415a870 legacy=0x7f76a406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a406d370 con 0x7f76a40af3b0 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f769c0019f0 con 0x7f76a40af3b0 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 >> v1:172.21.15.79:6789/0 conn(0x7f76a40af3b0 legacy=0x7f76a40cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f7690003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76900043b0 0x7f7690004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7690005120 0x7f769000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76a406d090 con 0x7f76900039b0 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f769000c060 con 0x7f7690005120 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.809+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f769000c260 con 0x7f76900043b0 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a37fe640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f7690003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a3fff640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7690005120 0x7f769000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f769bfff640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76900043b0 0x7f7690004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a37fe640 1 -- 172.21.15.79:0/1900804869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76900043b0 msgr2=0x7f7690004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a37fe640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76900043b0 0x7f7690004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a37fe640 1 -- 172.21.15.79:0/1900804869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7690005120 msgr2=0x7f769000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a37fe640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7690005120 0x7f769000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a37fe640 1 -- 172.21.15.79:0/1900804869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7690003520 con 0x7f76900039b0 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a3fff640 1 -- 172.21.15.79:0/1900804869 reap_dead start 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.810+0000 7f76a37fe640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f7690003d90 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7694001860 tx=0x7f7690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556151287aaa8d62 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694037070 con 0x7f76900039b0 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769402abf0 con 0x7f76900039b0 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a2ffd640 1 -- 172.21.15.79:0/1900804869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694001430 con 0x7f76900039b0 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a9e9e640 1 -- 172.21.15.79:0/1900804869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 msgr2=0x7f7690003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a9e9e640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f7690003d90 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7694001860 tx=0x7f7690005830 comp rx=0 tx=0).stop 2024-06-10T00:20:31.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a9e9e640 1 -- 172.21.15.79:0/1900804869 shutdown_connections 2024-06-10T00:20:31.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a9e9e640 1 --2- 172.21.15.79:0/1900804869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f7690003d90 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a9e9e640 1 -- 172.21.15.79:0/1900804869 >> 172.21.15.79:0/1900804869 conn(0x7f76a40b19f0 msgr2=0x7f76a40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:31.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a9e9e640 1 -- 172.21.15.79:0/1900804869 shutdown_connections 2024-06-10T00:20:31.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.811+0000 7f76a9e9e640 1 -- 172.21.15.79:0/1900804869 wait complete. 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.812+0000 7f76a9e9e640 1 Processor -- start 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.812+0000 7f76a9e9e640 1 -- start start 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a9e9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f76a4071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a9e9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76a41e4160 0x7f76a4151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a9e9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76a413d7a0 0x7f76a4151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a9e9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40b2e40 con 0x7f76900039b0 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a9e9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f76a406d930 con 0x7f76a41e4160 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a9e9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f76a40b2fc0 con 0x7f76a413d7a0 2024-06-10T00:20:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f76a4071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f76a4071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48548/0 (socket says 172.21.15.79:48548) 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a37fe640 1 -- 172.21.15.79:0/293245543 learned_addr learned my addr 172.21.15.79:0/293245543 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f769bfff640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76a41e4160 0x7f76a4151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a3fff640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76a413d7a0 0x7f76a4151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a37fe640 1 -- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76a413d7a0 msgr2=0x7f76a4151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a37fe640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76a413d7a0 0x7f76a4151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a37fe640 1 -- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76a41e4160 msgr2=0x7f76a4151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a37fe640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76a41e4160 0x7f76a4151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a37fe640 1 -- 172.21.15.79:0/293245543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4071f80 con 0x7f76900039b0 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.813+0000 7f76a3fff640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76a413d7a0 0x7f76a4151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.814+0000 7f76a37fe640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f76a4071a40 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7694001980 tx=0x7f7694001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.814+0000 7f76a0ff9640 1 -- 172.21.15.79:0/293245543 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694037050 con 0x7f76900039b0 2024-06-10T00:20:31.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.814+0000 7f76a0ff9640 1 -- 172.21.15.79:0/293245543 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7694043070 con 0x7f76900039b0 2024-06-10T00:20:31.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.814+0000 7f76a0ff9640 1 -- 172.21.15.79:0/293245543 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694001430 con 0x7f76900039b0 2024-06-10T00:20:31.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.814+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a41e45f0 con 0x7f76900039b0 2024-06-10T00:20:31.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.814+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a413e0b0 con 0x7f76900039b0 2024-06-10T00:20:31.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.815+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a4068430 con 0x7f76900039b0 2024-06-10T00:20:31.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.815+0000 7f76a0ff9640 1 -- 172.21.15.79:0/293245543 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f769403e870 con 0x7f76900039b0 2024-06-10T00:20:31.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.816+0000 7f76a0ff9640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f768406be30 0x7f768406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:31.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.816+0000 7f76a0ff9640 1 -- 172.21.15.79:0/293245543 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f76940ab860 con 0x7f76900039b0 2024-06-10T00:20:31.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.816+0000 7f769bfff640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f768406be30 0x7f768406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:31.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.816+0000 7f769bfff640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f768406be30 0x7f768406e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f76a40cd670 tx=0x7f768c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:31.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:31.820+0000 7f76a0ff9640 1 -- 172.21.15.79:0/293245543 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7694079be0 con 0x7f76900039b0 2024-06-10T00:20:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.009+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76a4072740 con 0x7f76900039b0 2024-06-10T00:20:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.009+0000 7f76a0ff9640 1 -- 172.21.15.79:0/293245543 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) ==== 80+0+0 (secure 0 0 0) 0x7f769407dee0 con 0x7f76900039b0 2024-06-10T00:20:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:20:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f768406be30 msgr2=0x7f768406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f768406be30 0x7f768406e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f76a40cd670 tx=0x7f768c008040 comp rx=0 tx=0).stop 2024-06-10T00:20:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 msgr2=0x7f76a4071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f76a4071a40 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7694001980 tx=0x7f7694001230 comp rx=0 tx=0).stop 2024-06-10T00:20:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 shutdown_connections 2024-06-10T00:20:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f768406be30 0x7f768406e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76a413d7a0 0x7f76a4151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76a41e4160 0x7f76a4151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 --2- 172.21.15.79:0/293245543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76900039b0 0x7f76a4071a40 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 >> 172.21.15.79:0/293245543 conn(0x7f76a40b19f0 msgr2=0x7f76a4158550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 shutdown_connections 2024-06-10T00:20:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.011+0000 7f76a9e9e640 1 -- 172.21.15.79:0/293245543 wait complete. 2024-06-10T00:20:32.023 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:20:32.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:32.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:32.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[64705]: fuse finished with error 0 and tester_r 0 2024-06-10T00:20:32.048 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:20:32.109 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:20:32.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:32.110 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:20:32.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:32.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.265+0000 7fec52b16640 1 Processor -- start 2024-06-10T00:20:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.265+0000 7fec52b16640 1 -- start start 2024-06-10T00:20:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec52b16640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0cc6d0 0x7fec4c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec52b16640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec4c0720e0 0x7fec4c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec52b16640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec4c0ccff0 con 0x7fec4c071c60 2024-06-10T00:20:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec52b16640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fec4c072550 con 0x7fec4c0720e0 2024-06-10T00:20:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec52b16640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c072820 con 0x7fec4c0cc6d0 2024-06-10T00:20:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec510b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec4c0720e0 0x7fec4c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec43fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fec4c071c60 0x7fec4c0b36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42360/0 (socket says 172.21.15.79:42360) 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec43fff640 1 -- 172.21.15.79:0/1982562315 learned_addr learned my addr 172.21.15.79:0/1982562315 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec508b2640 1 --2- 172.21.15.79:0/1982562315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0cc6d0 0x7fec4c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec510b3640 1 -- 172.21.15.79:0/1982562315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0cc6d0 msgr2=0x7fec4c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec510b3640 1 --2- 172.21.15.79:0/1982562315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0cc6d0 0x7fec4c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec510b3640 1 -- 172.21.15.79:0/1982562315 >> v1:172.21.15.79:6789/0 conn(0x7fec4c071c60 legacy=0x7fec4c0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec510b3640 1 -- 172.21.15.79:0/1982562315 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c072b00 con 0x7fec4c0720e0 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec437fe640 1 -- 172.21.15.79:0/1982562315 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965384944 0 0) 0x7fec4c0ccff0 con 0x7fec4c071c60 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.266+0000 7fec508b2640 1 --2- 172.21.15.79:0/1982562315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0cc6d0 0x7fec4c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec510b3640 1 --2- 172.21.15.79:0/1982562315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c0720e0 0x7fec4c0b3dd0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fec44009d90 tx=0x7fec4402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed5f22f84cb1e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec437fe640 1 -- 172.21.15.79:0/1982562315 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44007740 con 0x7fec4c0720e0 2024-06-10T00:20:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec437fe640 1 -- 172.21.15.79:0/1982562315 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec440078e0 con 0x7fec4c0720e0 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec437fe640 1 -- 172.21.15.79:0/1982562315 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44007cb0 con 0x7fec4c0720e0 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec52b16640 1 -- 172.21.15.79:0/1982562315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c0720e0 msgr2=0x7fec4c0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec52b16640 1 --2- 172.21.15.79:0/1982562315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c0720e0 0x7fec4c0b3dd0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fec44009d90 tx=0x7fec4402a660 comp rx=0 tx=0).stop 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec52b16640 1 -- 172.21.15.79:0/1982562315 shutdown_connections 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec52b16640 1 --2- 172.21.15.79:0/1982562315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c0720e0 0x7fec4c0b3dd0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec52b16640 1 --2- 172.21.15.79:0/1982562315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0cc6d0 0x7fec4c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.267+0000 7fec52b16640 1 -- 172.21.15.79:0/1982562315 >> 172.21.15.79:0/1982562315 conn(0x7fec4c0b19f0 msgr2=0x7fec4c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.268+0000 7fec52b16640 1 -- 172.21.15.79:0/1982562315 shutdown_connections 2024-06-10T00:20:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.268+0000 7fec52b16640 1 -- 172.21.15.79:0/1982562315 wait complete. 2024-06-10T00:20:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.269+0000 7fec52b16640 1 Processor -- start 2024-06-10T00:20:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.269+0000 7fec52b16640 1 -- start start 2024-06-10T00:20:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.269+0000 7fec52b16640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c071c60 0x7fec4c1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec52b16640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0720e0 0x7fec4c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec52b16640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec4c0cc6d0 0x7fec4c0afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec52b16640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c15c890 con 0x7fec4c071c60 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec52b16640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0b31a0 con 0x7fec4c0cc6d0 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec52b16640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c159f60 con 0x7fec4c0720e0 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c071c60 0x7fec4c1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c071c60 0x7fec4c1477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48570/0 (socket says 172.21.15.79:48570) 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 -- 172.21.15.79:0/1220879382 learned_addr learned my addr 172.21.15.79:0/1220879382 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 -- 172.21.15.79:0/1220879382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0720e0 msgr2=0x7fec4c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0720e0 0x7fec4c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 -- 172.21.15.79:0/1220879382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec4c0cc6d0 msgr2=0x7fec4c0afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec4c0cc6d0 0x7fec4c0afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 -- 172.21.15.79:0/1220879382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c154f30 con 0x7fec4c071c60 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec508b2640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c071c60 0x7fec4c1477d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c820 tx=0x7fec4800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec417fa640 1 -- 172.21.15.79:0/1220879382 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48015070 con 0x7fec4c071c60 2024-06-10T00:20:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec417fa640 1 -- 172.21.15.79:0/1220879382 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec480079d0 con 0x7fec4c071c60 2024-06-10T00:20:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c1551d0 con 0x7fec4c071c60 2024-06-10T00:20:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec417fa640 1 -- 172.21.15.79:0/1220879382 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48007d80 con 0x7fec4c071c60 2024-06-10T00:20:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.270+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c155790 con 0x7fec4c071c60 2024-06-10T00:20:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.271+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec4c15d530 con 0x7fec4c071c60 2024-06-10T00:20:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.272+0000 7fec417fa640 1 -- 172.21.15.79:0/1220879382 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec48018070 con 0x7fec4c071c60 2024-06-10T00:20:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.272+0000 7fec417fa640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fec3806be30 0x7fec3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.272+0000 7fec417fa640 1 -- 172.21.15.79:0/1220879382 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7fec4808af30 con 0x7fec4c071c60 2024-06-10T00:20:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.272+0000 7fec43fff640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fec3806be30 0x7fec3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.273+0000 7fec43fff640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fec3806be30 0x7fec3806e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec3c007fd0 tx=0x7fec3c007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:32.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.276+0000 7fec417fa640 1 -- 172.21.15.79:0/1220879382 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fec4c15d530 con 0x7fec4c071c60 2024-06-10T00:20:32.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.486+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec4c068430 con 0x7fec4c071c60 2024-06-10T00:20:32.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.487+0000 7fec417fa640 1 -- 172.21.15.79:0/1220879382 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5189 (secure 0 0 0) 0x7fec480596c0 con 0x7fec4c071c60 2024-06-10T00:20:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:32.488 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6885,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:26.163397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/2747696124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2747696124},{"type":"v1","addr":"172.21.15.117:6835","nonce":2747696124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6903,"qdb_cluster":[6903]},"id":6}]} 2024-06-10T00:20:32.488 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 50 2024-06-10T00:20:32.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fec3806be30 msgr2=0x7fec3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fec3806be30 0x7fec3806e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec3c007fd0 tx=0x7fec3c007920 comp rx=0 tx=0).stop 2024-06-10T00:20:32.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c071c60 msgr2=0x7fec4c1477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c071c60 0x7fec4c1477d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c820 tx=0x7fec4800cce0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 shutdown_connections 2024-06-10T00:20:32.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fec3806be30 0x7fec3806e2f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec4c0cc6d0 0x7fec4c0afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec4c0720e0 0x7fec4c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 --2- 172.21.15.79:0/1220879382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4c071c60 0x7fec4c1477d0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 >> 172.21.15.79:0/1220879382 conn(0x7fec4c0b19f0 msgr2=0x7fec4c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:32.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 shutdown_connections 2024-06-10T00:20:32.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.489+0000 7fec52b16640 1 -- 172.21.15.79:0/1220879382 wait complete. 2024-06-10T00:20:32.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-06-10T00:20:32.639 INFO:teuthology.orchestra.run.smithi117.stdout:{"return_code":0} 2024-06-10T00:20:32.639 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:20:32.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:20:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.740+0000 7f57d862a640 1 Processor -- start 2024-06-10T00:20:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.740+0000 7f57d862a640 1 -- start start 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d862a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57d00aef70 0x7f57d00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d862a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57d00af3b0 0x7f57d00b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d862a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d015ac50 con 0x7f57d015a870 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d862a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f57d00b4fe0 con 0x7f57d00af3b0 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d862a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f57d006cdb0 con 0x7f57d00aef70 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d6bc7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57d00af3b0 0x7f57d00b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d63c6640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f57d015a870 0x7f57d006de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42374/0 (socket says 172.21.15.79:42374) 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d63c6640 1 -- 172.21.15.79:0/1519474472 learned_addr learned my addr 172.21.15.79:0/1519474472 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d5bc5640 1 --2- 172.21.15.79:0/1519474472 >> v2:172.21.15.117:3300/0 conn(0x7f57d00aef70 0x7f57d00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d6bc7640 1 -- 172.21.15.79:0/1519474472 >> v2:172.21.15.117:3300/0 conn(0x7f57d00aef70 msgr2=0x7f57d00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d6bc7640 1 --2- 172.21.15.79:0/1519474472 >> v2:172.21.15.117:3300/0 conn(0x7f57d00aef70 0x7f57d00b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d6bc7640 1 -- 172.21.15.79:0/1519474472 >> v1:172.21.15.79:6789/0 conn(0x7f57d015a870 legacy=0x7f57d006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d6bc7640 1 -- 172.21.15.79:0/1519474472 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d006d090 con 0x7f57d00af3b0 2024-06-10T00:20:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d53c4640 1 -- 172.21.15.79:0/1519474472 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004675342 0 0) 0x7f57d015ac50 con 0x7f57d015a870 2024-06-10T00:20:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.741+0000 7f57d5bc5640 1 --2- 172.21.15.79:0/1519474472 >> v2:172.21.15.117:3300/0 conn(0x7f57d00aef70 0x7f57d00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:32.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.742+0000 7f57d6bc7640 1 --2- 172.21.15.79:0/1519474472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d00af3b0 0x7f57d00b4aa0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f57d00b4070 tx=0x7f57c802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789030ef22ba77a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:32.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.742+0000 7f57d53c4640 1 -- 172.21.15.79:0/1519474472 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8007740 con 0x7f57d00af3b0 2024-06-10T00:20:32.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.742+0000 7f57d53c4640 1 -- 172.21.15.79:0/1519474472 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c80078e0 con 0x7f57d00af3b0 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.742+0000 7f57d53c4640 1 -- 172.21.15.79:0/1519474472 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8007cb0 con 0x7f57d00af3b0 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.743+0000 7f57d862a640 1 -- 172.21.15.79:0/1519474472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d00af3b0 msgr2=0x7f57d00b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.743+0000 7f57d862a640 1 --2- 172.21.15.79:0/1519474472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d00af3b0 0x7f57d00b4aa0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f57d00b4070 tx=0x7f57c802a5f0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.743+0000 7f57d862a640 1 -- 172.21.15.79:0/1519474472 shutdown_connections 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.743+0000 7f57d862a640 1 --2- 172.21.15.79:0/1519474472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d00af3b0 0x7f57d00b4aa0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.743+0000 7f57d862a640 1 --2- 172.21.15.79:0/1519474472 >> v2:172.21.15.117:3300/0 conn(0x7f57d00aef70 0x7f57d00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.743+0000 7f57d862a640 1 -- 172.21.15.79:0/1519474472 >> 172.21.15.79:0/1519474472 conn(0x7f57d00b19f0 msgr2=0x7f57d00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.743+0000 7f57d862a640 1 -- 172.21.15.79:0/1519474472 shutdown_connections 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.743+0000 7f57d862a640 1 -- 172.21.15.79:0/1519474472 wait complete. 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.744+0000 7f57d862a640 1 Processor -- start 2024-06-10T00:20:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.744+0000 7f57d862a640 1 -- start start 2024-06-10T00:20:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d862a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d00aef70 0x7f57d01503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d862a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57d00af3b0 0x7f57d0152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d862a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d015a870 0x7f57d01f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d862a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f57d006d930 con 0x7f57d015a870 2024-06-10T00:20:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d862a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57d006d650 con 0x7f57d00aef70 2024-06-10T00:20:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d862a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57d00b2e40 con 0x7f57d00af3b0 2024-06-10T00:20:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d015a870 0x7f57d01f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d015a870 0x7f57d01f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48584/0 (socket says 172.21.15.79:48584) 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 -- 172.21.15.79:0/3588508424 learned_addr learned my addr 172.21.15.79:0/3588508424 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d63c6640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d00aef70 0x7f57d01503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d5bc5640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57d00af3b0 0x7f57d0152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 -- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57d00af3b0 msgr2=0x7f57d0152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57d00af3b0 0x7f57d0152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 -- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d00aef70 msgr2=0x7f57d01503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d00aef70 0x7f57d01503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 -- 172.21.15.79:0/3588508424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d0150b10 con 0x7f57d015a870 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d5bc5640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57d00af3b0 0x7f57d0152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d6bc7640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d015a870 0x7f57d01f57b0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009e80 tx=0x7f57c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57c6ffd640 1 -- 172.21.15.79:0/3588508424 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8040070 con 0x7f57d015a870 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57c6ffd640 1 -- 172.21.15.79:0/3588508424 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c8031c40 con 0x7f57d015a870 2024-06-10T00:20:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d00ad290 con 0x7f57d015a870 2024-06-10T00:20:32.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57c6ffd640 1 -- 172.21.15.79:0/3588508424 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8003b90 con 0x7f57d015a870 2024-06-10T00:20:32.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.745+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d00ad850 con 0x7f57d015a870 2024-06-10T00:20:32.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.746+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d0068430 con 0x7f57d015a870 2024-06-10T00:20:32.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.747+0000 7f57c6ffd640 1 -- 172.21.15.79:0/3588508424 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57c8039040 con 0x7f57d015a870 2024-06-10T00:20:32.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.747+0000 7f57c6ffd640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57b406be30 0x7f57b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:32.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.747+0000 7f57c6ffd640 1 -- 172.21.15.79:0/3588508424 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6101+0+0 (secure 0 0 0) 0x7f57c80ac340 con 0x7f57d015a870 2024-06-10T00:20:32.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.747+0000 7f57d63c6640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57b406be30 0x7f57b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:32.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.747+0000 7f57d63c6640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57b406be30 0x7f57b406e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57c0000f60 tx=0x7f57c0007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.751+0000 7f57c6ffd640 1 -- 172.21.15.79:0/3588508424 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f57c807ab60 con 0x7f57d015a870 2024-06-10T00:20:32.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.965+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f57d00b2650 con 0x7f57d015a870 2024-06-10T00:20:32.966 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:20:32.965+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:20:32.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.967+0000 7f57c6ffd640 1 -- 172.21.15.79:0/3588508424 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) ==== 161+0+0 (secure 0 0 0) 0x7f57c807a460 con 0x7f57d015a870 2024-06-10T00:20:32.967 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:20:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57b406be30 msgr2=0x7f57b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57b406be30 0x7f57b406e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57c0000f60 tx=0x7f57c0007c00 comp rx=0 tx=0).stop 2024-06-10T00:20:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d015a870 msgr2=0x7f57d01f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d015a870 0x7f57d01f57b0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009e80 tx=0x7f57c8004a40 comp rx=0 tx=0).stop 2024-06-10T00:20:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 shutdown_connections 2024-06-10T00:20:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57b406be30 0x7f57b406e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d015a870 0x7f57d01f57b0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57d00af3b0 0x7f57d0152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.969+0000 7f57d862a640 1 --2- 172.21.15.79:0/3588508424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d00aef70 0x7f57d01503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.970+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 >> 172.21.15.79:0/3588508424 conn(0x7f57d00b19f0 msgr2=0x7f57d00b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.970+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 shutdown_connections 2024-06-10T00:20:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:32.970+0000 7f57d862a640 1 -- 172.21.15.79:0/3588508424 wait complete. 2024-06-10T00:20:32.973 INFO:tasks.ceph.mds.b.smithi117.stderr: -3431> 2024-06-10T00:20:30.804+0000 7f404b308640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:20:32.981 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-06-10T00:20:33.001 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:20:33.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fe461af40 1 Processor -- start 2024-06-10T00:20:33.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fe461af40 1 -- start start 2024-06-10T00:20:33.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fe461af40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe027d80 0x5630fe050bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fe461af40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe0ff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fe461af40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe0fe320 0x5630fe0f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fe461af40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630fdfcde30 con 0x5630fe0f82b0 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fe461af40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5630fdfd1e70 con 0x5630fe0fe320 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fe461af40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5630fe053a80 con 0x5630fe027d80 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe0ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe0ff240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48600/0 (socket says 172.21.15.79:48600) 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.023+0000 7f1fdbfff640 1 -- 172.21.15.79:0/602740128 learned_addr learned my addr 172.21.15.79:0/602740128 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe14aa640 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe027d80 0x5630fe050bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe1cab640 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe0fe320 0x5630fe0f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdbfff640 1 -- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe027d80 msgr2=0x5630fe050bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdbfff640 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe027d80 0x5630fe050bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdbfff640 1 -- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe0fe320 msgr2=0x5630fe0f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdbfff640 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe0fe320 0x5630fe0f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdbfff640 1 -- 172.21.15.79:0/602740128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fe1005f0 con 0x5630fe0f82b0 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe14aa640 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe027d80 0x5630fe050bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe1cab640 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe0fe320 0x5630fe0f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdbfff640 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe0ff240 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00b450 tx=0x7f1fcc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06a9cc10d0ad4f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdb7fe640 1 -- 172.21.15.79:0/602740128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc008070 con 0x5630fe0f82b0 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdb7fe640 1 -- 172.21.15.79:0/602740128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc00d5c0 con 0x5630fe0f82b0 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fdb7fe640 1 -- 172.21.15.79:0/602740128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00d9d0 con 0x5630fe0f82b0 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe461af40 1 -- 172.21.15.79:0/602740128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 msgr2=0x5630fe0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe461af40 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe0ff240 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00b450 tx=0x7f1fcc00b910 comp rx=0 tx=0).stop 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe461af40 1 -- 172.21.15.79:0/602740128 shutdown_connections 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe461af40 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe0fe320 0x5630fe0f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe461af40 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe0ff240 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe461af40 1 --2- 172.21.15.79:0/602740128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe027d80 0x5630fe050bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.024+0000 7f1fe461af40 1 -- 172.21.15.79:0/602740128 >> 172.21.15.79:0/602740128 conn(0x5630fe0251c0 msgr2=0x5630fe0255a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.025+0000 7f1fe461af40 1 -- 172.21.15.79:0/602740128 shutdown_connections 2024-06-10T00:20:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.025+0000 7f1fe461af40 1 -- 172.21.15.79:0/602740128 wait complete. 2024-06-10T00:20:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.025+0000 7f1fe461af40 1 Processor -- start 2024-06-10T00:20:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.025+0000 7f1fe461af40 1 -- start start 2024-06-10T00:20:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fe461af40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe027d80 0x5630fe0ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fe461af40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe024250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fe461af40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe0fe320 0x5630fe024790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fe461af40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630fe0f6de0 con 0x5630fe0f82b0 2024-06-10T00:20:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fe461af40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5630fe100af0 con 0x5630fe027d80 2024-06-10T00:20:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fe461af40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5630fe0f7230 con 0x5630fe0fe320 2024-06-10T00:20:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe024250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe024250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48604/0 (socket says 172.21.15.79:48604) 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 -- 172.21.15.79:0/2279043536 learned_addr learned my addr 172.21.15.79:0/2279043536 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fe14aa640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe027d80 0x5630fe0ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fe1cab640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe0fe320 0x5630fe024790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 -- 172.21.15.79:0/2279043536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe0fe320 msgr2=0x5630fe024790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630fe0fe320 0x5630fe024790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 -- 172.21.15.79:0/2279043536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe027d80 msgr2=0x5630fe0ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630fe027d80 0x5630fe0ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 -- 172.21.15.79:0/2279043536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fe0f54b0 con 0x5630fe0f82b0 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fdbfff640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe024250 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00f000 tx=0x7f1fcc000f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.026+0000 7f1fda7fc640 1 -- 172.21.15.79:0/2279043536 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc001a40 con 0x5630fe0f82b0 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.027+0000 7f1fda7fc640 1 -- 172.21.15.79:0/2279043536 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc010a40 con 0x5630fe0f82b0 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.027+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630fe054350 con 0x5630fe0f82b0 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.027+0000 7f1fda7fc640 1 -- 172.21.15.79:0/2279043536 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc010e30 con 0x5630fe0f82b0 2024-06-10T00:20:33.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.027+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630fe06d300 con 0x5630fe0f82b0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.028+0000 7f1fda7fc640 1 -- 172.21.15.79:0/2279043536 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fcc017030 con 0x5630fe0f82b0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.028+0000 7f1fda7fc640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1fc406a9b0 0x7f1fc406ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.028+0000 7f1fda7fc640 1 -- 172.21.15.79:0/2279043536 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f1fcc08c210 con 0x5630fe0f82b0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.028+0000 7f1fe14aa640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1fc406a9b0 0x7f1fc406ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.028+0000 7f1fe461af40 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5630fe06b0d0 0x5630fe06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.029+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x5630fe06b9f0 con 0x5630fe06b0d0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.029+0000 7f1fe1cab640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5630fe06b0d0 0x5630fe06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.029+0000 7f1fe14aa640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1fc406a9b0 0x7f1fc406ce70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4056000 tx=0x7f1fd4050000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.029+0000 7f1fe1cab640 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5630fe06b0d0 0x5630fe06b4b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe1cab640 1 -- 172.21.15.79:0/2279043536 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v89'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1fdc003950 con 0x5630fe06b0d0 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5630fe06b0d0 msgr2=0x5630fe06b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5630fe06b0d0 0x5630fe06b4b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1fc406a9b0 msgr2=0x7f1fc406ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1fc406a9b0 0x7f1fc406ce70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4056000 tx=0x7f1fd4050000 comp rx=0 tx=0).stop 2024-06-10T00:20:33.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 msgr2=0x5630fe024250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 --2- 172.21.15.79:0/2279043536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630fe0f82b0 0x5630fe024250 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00f000 tx=0x7f1fcc000f10 comp rx=0 tx=0).stop 2024-06-10T00:20:33.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe1cab640 1 -- 172.21.15.79:0/2279043536 reap_dead start 2024-06-10T00:20:33.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 shutdown_connections 2024-06-10T00:20:33.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 >> 172.21.15.79:0/2279043536 conn(0x5630fe0251c0 msgr2=0x5630fe0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 shutdown_connections 2024-06-10T00:20:33.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.030+0000 7f1fe461af40 1 -- 172.21.15.79:0/2279043536 wait complete. 2024-06-10T00:20:33.035 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-06-10T00:20:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.115+0000 7f5593167280 1 -- start start 2024-06-10T00:20:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.115+0000 7f5593167280 1 Processor -- start 2024-06-10T00:20:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5593167280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f3b2c00 0x559b6f42a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5593167280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f3b3800 0x559b6f42ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5593167280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b6f3b3c00 0x559b6f42b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5593167280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b70184180 con 0x559b6f3b2c00 2024-06-10T00:20:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5593167280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b70184300 con 0x559b6f3b3800 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5593167280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b70184480 con 0x559b6f3b3c00 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f3b2c00 0x559b6f42a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f3b2c00 0x559b6f42a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48620/0 (socket says 172.21.15.79:48620) 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 -- 172.21.15.79:0/4221799593 learned_addr learned my addr 172.21.15.79:0/4221799593 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 -- 172.21.15.79:0/4221799593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b6f3b3c00 msgr2=0x559b6f42b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 --2- 172.21.15.79:0/4221799593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b6f3b3c00 0x559b6f42b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591112640 1 --2- 172.21.15.79:0/4221799593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f3b3800 0x559b6f42ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 -- 172.21.15.79:0/4221799593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f3b3800 msgr2=0x559b6f42ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 --2- 172.21.15.79:0/4221799593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f3b3800 0x559b6f42ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 -- 172.21.15.79:0/4221799593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b6f3e8780 con 0x559b6f3b2c00 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.116+0000 7f5591913640 1 --2- 172.21.15.79:0/4221799593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f3b2c00 0x559b6f42a580 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x559b701cd320 tx=0x559b7014df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419e5b29006d9ec2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f558f10e640 1 -- 172.21.15.79:0/4221799593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b6f3d8680 con 0x559b6f3b2c00 2024-06-10T00:20:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f558f10e640 1 -- 172.21.15.79:0/4221799593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b6f3defc0 con 0x559b6f3b2c00 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f558f10e640 1 -- 172.21.15.79:0/4221799593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b6f3d8b60 con 0x559b6f3b2c00 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f5593167280 1 -- 172.21.15.79:0/4221799593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b6f3e83c0 con 0x559b6f3b2c00 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f5593167280 1 -- 172.21.15.79:0/4221799593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559b6f3e9680 con 0x559b6f3b2c00 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f5593167280 4 waiting for MDS map... 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f558f10e640 1 -- 172.21.15.79:0/4221799593 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x559b70270600 con 0x559b6f3b2c00 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f558f10e640 1 -- 172.21.15.79:0/4221799593 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 2885+0+0 (secure 0 0 0) 0x559b6f40d180 con 0x559b6f3b2c00 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f5593167280 4 Got MDS map 51 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f5593167280 10 main: JournalTool::main 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f5593167280 4 main: JournalTool: connecting to RADOS... 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.117+0000 7f5593167280 1 Processor -- start 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5593167280 1 -- start start 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5593167280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 0x559b6f42b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5593167280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5593167280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 0x559b6f42c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5593167280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b70184600 con 0x559b70273800 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5593167280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b70184780 con 0x559b70273400 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5593167280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b70184900 con 0x559b70273c00 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48630/0 (socket says 172.21.15.79:48630) 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591913640 1 -- 172.21.15.79:0/810772386 learned_addr learned my addr 172.21.15.79:0/810772386 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5592114640 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 0x559b6f42b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591112640 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 0x559b6f42c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591913640 1 -- 172.21.15.79:0/810772386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 msgr2=0x559b6f42c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591913640 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 0x559b6f42c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591913640 1 -- 172.21.15.79:0/810772386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 msgr2=0x559b6f42b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591913640 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 0x559b6f42b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.118+0000 7f5591913640 1 -- 172.21.15.79:0/810772386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b6f3e94a0 con 0x559b70273800 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5591913640 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42bb80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x559b7029e6c0 tx=0x559b7013f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9ff1d77501b7a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f558d10a640 1 -- 172.21.15.79:0/810772386 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b6f3d8820 con 0x559b70273800 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f558d10a640 1 -- 172.21.15.79:0/810772386 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b6f3dee00 con 0x559b70273800 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f558d10a640 1 -- 172.21.15.79:0/810772386 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b6f3d8680 con 0x559b70273800 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 -- 172.21.15.79:0/810772386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 msgr2=0x559b6f42bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42bb80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x559b7029e6c0 tx=0x559b7013f380 comp rx=0 tx=0).stop 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 -- 172.21.15.79:0/810772386 shutdown_connections 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 0x559b6f42c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42bb80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 --2- 172.21.15.79:0/810772386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 0x559b6f42b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 -- 172.21.15.79:0/810772386 >> 172.21.15.79:0/810772386 conn(0x559b70273000 msgr2=0x559b6f4a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 -- 172.21.15.79:0/810772386 shutdown_connections 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.119+0000 7f5593167280 1 -- 172.21.15.79:0/810772386 wait complete. 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5593167280 1 Processor -- start 2024-06-10T00:20:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5593167280 1 -- start start 2024-06-10T00:20:33.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5593167280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 0x559b6f42d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5593167280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5593167280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 0x559b6f42c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5593167280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b70185b00 con 0x559b70273800 2024-06-10T00:20:33.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5593167280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b70185980 con 0x559b70273400 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5593167280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b70184600 con 0x559b70273c00 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5591913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5591913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48644/0 (socket says 172.21.15.79:48644) 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5591913640 1 -- 172.21.15.79:0/3090562278 learned_addr learned my addr 172.21.15.79:0/3090562278 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5591112640 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 0x559b6f42c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.120+0000 7f5592114640 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 0x559b6f42d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5591913640 1 -- 172.21.15.79:0/3090562278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 msgr2=0x559b6f42c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5591913640 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 0x559b6f42c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5591913640 1 -- 172.21.15.79:0/3090562278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 msgr2=0x559b6f42d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5591913640 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 0x559b6f42d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5591913640 1 -- 172.21.15.79:0/3090562278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b6f3e8780 con 0x559b70273800 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5591913640 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42cc00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x559b7029f380 tx=0x559b7029ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f558b907640 1 -- 172.21.15.79:0/3090562278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b6f3d8b60 con 0x559b70273800 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f558b907640 1 -- 172.21.15.79:0/3090562278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b6f3dec40 con 0x559b70273800 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5593167280 1 -- 172.21.15.79:0/3090562278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b6f3e83c0 con 0x559b70273800 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f558b907640 1 -- 172.21.15.79:0/3090562278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b6f3d84e0 con 0x559b70273800 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5593167280 1 -- 172.21.15.79:0/3090562278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b6f3e8000 con 0x559b70273800 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.121+0000 7f5593167280 4 main: JournalTool: resolving pool 13 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.122+0000 7f558b907640 1 -- 172.21.15.79:0/3090562278 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x559b7026ec00 con 0x559b70273800 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.122+0000 7f558b907640 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x559b7026d000 0x559b6f42d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.122+0000 7f558b907640 1 -- 172.21.15.79:0/3090562278 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x559b701a6600 con 0x559b70273800 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.122+0000 7f5593167280 4 main: JournalTool: creating IoCtx.. 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.122+0000 7f5592114640 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x559b7026d000 0x559b6f42d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.122+0000 7f5593167280 4 main: Executing for rank 0 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.123+0000 7f5592114640 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x559b7026d000 0x559b6f42d700 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x559b7013c8a0 tx=0x559b6f742000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.123+0000 7f5593167280 1 -- start start 2024-06-10T00:20:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.123+0000 7f5593167280 1 Processor -- start 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5593167280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f78e400 0x559b6f42c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5593167280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f78e800 0x559b6f42bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5593167280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b6f78ec00 0x559b6f42b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5593167280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b70184900 con 0x559b6f78e800 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5593167280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b70185680 con 0x559b6f78e400 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5593167280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b70184a80 con 0x559b6f78ec00 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f78e800 0x559b6f42bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f78e800 0x559b6f42bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48658/0 (socket says 172.21.15.79:48658) 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 -- 172.21.15.79:0/3216771635 learned_addr learned my addr 172.21.15.79:0/3216771635 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5592114640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f78e400 0x559b6f42c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591112640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b6f78ec00 0x559b6f42b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b6f78ec00 msgr2=0x559b6f42b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b6f78ec00 0x559b6f42b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f78e400 msgr2=0x559b6f42c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f78e400 0x559b6f42c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b6f3e8960 con 0x559b6f78e800 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5591913640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f78e800 0x559b6f42bb80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x559b7033d350 tx=0x559b6f79c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd86c5d4c0389be server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5588901640 1 -- 172.21.15.79:0/3216771635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b6f6beb60 con 0x559b6f78e800 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5588901640 1 -- 172.21.15.79:0/3216771635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b6f3de1c0 con 0x559b6f78e800 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.124+0000 7f5588901640 1 -- 172.21.15.79:0/3216771635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b6f6bed00 con 0x559b6f78e800 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b6f3e9680 con 0x559b6f78e800 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559b6f3e94a0 con 0x559b6f78e800 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5593167280 4 waiting for MDS map... 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5588901640 1 -- 172.21.15.79:0/3216771635 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x559b6f79e400 con 0x559b6f78e800 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5588901640 1 -- 172.21.15.79:0/3216771635 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 2885+0+0 (secure 0 0 0) 0x559b6f40d500 con 0x559b6f78e800 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5593167280 4 Got MDS map 51 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x559b6f78f000 0x559b6f7b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89) -- 0x559b6f7a6800 con 0x559b6f78f000 2024-06-10T00:20:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5592114640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x559b6f78f000 0x559b6f7b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.125+0000 7f5592114640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x559b6f78f000 0x559b6f7b2000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=f1c136c0c0e260e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.127+0000 7f5592114640 1 -- 172.21.15.79:0/3216771635 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x559b6f4aa000 con 0x559b6f78f000 2024-06-10T00:20:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.128+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x559b6f7a6c00 0x559b6f7b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.128+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:2 13.14 13:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89) -- 0x559b6f7a7000 con 0x559b6f7a6c00 2024-06-10T00:20:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.128+0000 7f5591112640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x559b6f7a6c00 0x559b6f7b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.128+0000 7f5591112640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x559b6f7a6c00 0x559b6f7b2580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=4f1b72a9e99f882 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.130+0000 7f5591112640 1 -- 172.21.15.79:0/3216771635 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x559b6f4aa500 con 0x559b6f7a6c00 2024-06-10T00:20:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.130+0000 7f55870fe640 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:3 13.14 13:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e89) -- 0x559b7018d400 con 0x559b6f7a6c00 2024-06-10T00:20:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.130+0000 7f55870fe640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x559b7018d000 0x559b6f7b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.130+0000 7f55870fe640 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:4 13.1b 13:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e89) -- 0x559b7018c800 con 0x559b7018d000 2024-06-10T00:20:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.130+0000 7f5592114640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x559b7018d000 0x559b6f7b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.130+0000 7f5591112640 1 -- 172.21.15.79:0/3216771635 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv16 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x559b6f4aa500 con 0x559b6f7a6c00 2024-06-10T00:20:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.131+0000 7f5592114640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x559b7018d000 0x559b6f7b4680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=cc261e0404641b0d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.131+0000 7f5592114640 1 -- 172.21.15.79:0/3216771635 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa000 con 0x559b7018d000 2024-06-10T00:20:33.136 INFO:teuthology.orchestra.run.smithi079.stdout:old journal was 4208695~2030 2024-06-10T00:20:33.136 INFO:teuthology.orchestra.run.smithi079.stdout:new journal start will be 8388608 (4177883 bytes past old end) 2024-06-10T00:20:33.136 INFO:teuthology.orchestra.run.smithi079.stdout:writing journal head 2024-06-10T00:20:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.131+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:5 13.14 13:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x559b6f7a7400 con 0x559b6f7a6c00 2024-06-10T00:20:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5591112640 1 -- 172.21.15.79:0/3216771635 <== osd.0 v2:172.21.15.79:6824/709635793 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v89'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa500 con 0x559b6f7a6c00 2024-06-10T00:20:33.137 INFO:teuthology.orchestra.run.smithi079.stdout:writing EResetJournal entry 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:6 13.1b 13:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x559b6f7a7800 con 0x559b7018d000 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x559b6f7a7c00 0x559b6f7b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:7 13.b 13:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x559b6f7a7000 con 0x559b6f7a7c00 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:8 13.1f 13:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x559b7018cc00 con 0x559b6f78f000 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x559b6f7a6800 0x559b6f7b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:9 13.1a 13:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x559b6f7a7800 con 0x559b6f7a6800 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:10 13.1e 13:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x559b7018c800 con 0x559b7018d000 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x559b7026dc00 0x559b6f7b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:11 13.1d 13:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x559b6f7ca000 con 0x559b7026dc00 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5591112640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x559b6f7a6800 0x559b6f7b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5591913640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x559b6f7a7c00 0x559b6f7b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5592114640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x559b7026dc00 0x559b6f7b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.132+0000 7f5591112640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x559b6f7a6800 0x559b6f7b3080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=8a8c15bf3ba15fde server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.133+0000 7f5592114640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x559b7026dc00 0x559b6f7b3600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=5b2e0a526a989779 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.133+0000 7f5591913640 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x559b6f7a7c00 0x559b6f7b2b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=de32040c528b0585 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.133+0000 7f5592114640 1 -- 172.21.15.79:0/3216771635 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== osd_op_reply(6 200.00000002 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa000 con 0x559b7018d000 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.133+0000 7f5592114640 1 -- 172.21.15.79:0/3216771635 <== osd.4 v2:172.21.15.117:6824/279504764 3 ==== osd_op_reply(10 200.00000006 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa000 con 0x559b7018d000 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.133+0000 7f5592114640 1 -- 172.21.15.79:0/3216771635 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(8 200.00000004 [delete] v89'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa000 con 0x559b6f78f000 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.135+0000 7f5591112640 1 -- 172.21.15.79:0/3216771635 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(9 200.00000005 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa500 con 0x559b6f7a6800 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.135+0000 7f5591913640 1 -- 172.21.15.79:0/3216771635 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(7 200.00000003 [delete] v89'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa780 con 0x559b6f7a7c00 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.135+0000 7f55870fe640 1 -- 172.21.15.79:0/3216771635 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:12 13.1b 13:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x559b6f7d2000 con 0x559b7018d000 2024-06-10T00:20:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.138+0000 7f5592114640 1 -- 172.21.15.79:0/3216771635 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(11 200.00000007 [delete] v89'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa000 con 0x559b7026dc00 2024-06-10T00:20:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5592114640 1 -- 172.21.15.79:0/3216771635 <== osd.4 v2:172.21.15.117:6824/279504764 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v89'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x559b6f4aa000 con 0x559b7018d000 2024-06-10T00:20:33.141 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-06-10T00:20:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x559b6f7a6c00 msgr2=0x559b6f7b2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x559b6f7a6c00 0x559b6f7b2580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x559b6f7a6800 msgr2=0x559b6f7b3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x559b6f7a6800 0x559b6f7b3080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x559b7018d000 msgr2=0x559b6f7b4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x559b7018d000 0x559b6f7b4680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x559b6f7a7c00 msgr2=0x559b6f7b2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x559b6f7a7c00 0x559b6f7b2b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x559b6f78f000 msgr2=0x559b6f7b2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x559b6f78f000 0x559b6f7b2000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x559b7026dc00 msgr2=0x559b6f7b3600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x559b7026dc00 0x559b6f7b3600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f78e800 msgr2=0x559b6f42bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3216771635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f78e800 0x559b6f42bb80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x559b7033d350 tx=0x559b6f79c0c0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5591112640 1 -- 172.21.15.79:0/3216771635 reap_dead start 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 shutdown_connections 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5591112640 1 -- 172.21.15.79:0/3216771635 reap_dead start 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 >> 172.21.15.79:0/3216771635 conn(0x559b6f78e000 msgr2=0x559b6f4a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 shutdown_connections 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3216771635 wait complete. 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x559b7026d000 msgr2=0x559b6f42d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x559b7026d000 0x559b6f42d700 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x559b7013c8a0 tx=0x559b6f742000 comp rx=0 tx=0).stop 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 msgr2=0x559b6f42cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42cc00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x559b7029f380 tx=0x559b7029ad20 comp rx=0 tx=0).stop 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3090562278 shutdown_connections 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x559b7026d000 0x559b6f42d700 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b70273c00 0x559b6f42c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b70273800 0x559b6f42cc00 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 --2- 172.21.15.79:0/3090562278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b70273400 0x559b6f42d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3090562278 >> 172.21.15.79:0/3090562278 conn(0x559b70273000 msgr2=0x559b6f4a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3090562278 shutdown_connections 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.141+0000 7f5593167280 1 -- 172.21.15.79:0/3090562278 wait complete. 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 -- 172.21.15.79:0/4221799593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f3b2c00 msgr2=0x559b6f42a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 --2- 172.21.15.79:0/4221799593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f3b2c00 0x559b6f42a580 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x559b701cd320 tx=0x559b7014df20 comp rx=0 tx=0).stop 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 -- 172.21.15.79:0/4221799593 shutdown_connections 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 --2- 172.21.15.79:0/4221799593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b6f3b3c00 0x559b6f42b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 --2- 172.21.15.79:0/4221799593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b6f3b3800 0x559b6f42ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 --2- 172.21.15.79:0/4221799593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b6f3b2c00 0x559b6f42a580 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 -- 172.21.15.79:0/4221799593 >> 172.21.15.79:0/4221799593 conn(0x559b6f3b3000 msgr2=0x559b6f4a4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 -- 172.21.15.79:0/4221799593 shutdown_connections 2024-06-10T00:20:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.142+0000 7f5593167280 1 -- 172.21.15.79:0/4221799593 wait complete. 2024-06-10T00:20:33.147 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.111886, result: old journal was 4208695~2030 new journal start will be 8388608 (4177883 bytes past old end) writing journal head writing EResetJournal entry done 2024-06-10T00:20:33.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-06-10T00:20:33.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.289+0000 7f879de8c640 1 Processor -- start 2024-06-10T00:20:33.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.289+0000 7f879de8c640 1 -- start start 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f879de8c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87980b3800 0x7f87980cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f879de8c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87980cf190 0x7f87980d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f879de8c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87980cf600 con 0x7f87980d08f0 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f879de8c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f87980d1c80 con 0x7f87980cf190 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f879de8c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f87980b3cb0 con 0x7f87980b3800 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f8797fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87980cf190 0x7f87980d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f87977fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f87980d08f0 0x7f87980d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42402/0 (socket says 172.21.15.79:42402) 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f8797fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87980cf190 0x7f87980d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48666/0 (socket says 172.21.15.79:48666) 2024-06-10T00:20:33.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f87977fe640 1 -- 172.21.15.79:0/4133286272 learned_addr learned my addr 172.21.15.79:0/4133286272 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.290+0000 7f878ffff640 1 --2- 172.21.15.79:0/4133286272 >> v2:172.21.15.117:3300/0 conn(0x7f87980b3800 0x7f87980cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8797fff640 1 -- 172.21.15.79:0/4133286272 >> v2:172.21.15.117:3300/0 conn(0x7f87980b3800 msgr2=0x7f87980cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8797fff640 1 --2- 172.21.15.79:0/4133286272 >> v2:172.21.15.117:3300/0 conn(0x7f87980b3800 0x7f87980cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8797fff640 1 -- 172.21.15.79:0/4133286272 >> v1:172.21.15.79:6789/0 conn(0x7f87980d08f0 legacy=0x7f87980d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8797fff640 1 -- 172.21.15.79:0/4133286272 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87980cf8a0 con 0x7f87980cf190 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8796ffd640 1 -- 172.21.15.79:0/4133286272 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884269168 0 0) 0x7f87980cf600 con 0x7f87980d08f0 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8797fff640 1 --2- 172.21.15.79:0/4133286272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980cf190 0x7f87980d23f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8790009d90 tx=0x7f879002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6245d069a1d5e80b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8796ffd640 1 -- 172.21.15.79:0/4133286272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790007740 con 0x7f87980cf190 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8796ffd640 1 -- 172.21.15.79:0/4133286272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87900078e0 con 0x7f87980cf190 2024-06-10T00:20:33.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.291+0000 7f8796ffd640 1 -- 172.21.15.79:0/4133286272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790007cb0 con 0x7f87980cf190 2024-06-10T00:20:33.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.292+0000 7f879de8c640 1 -- 172.21.15.79:0/4133286272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980cf190 msgr2=0x7f87980d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.292+0000 7f879de8c640 1 --2- 172.21.15.79:0/4133286272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980cf190 0x7f87980d23f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8790009d90 tx=0x7f879002a6a0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.292+0000 7f879de8c640 1 -- 172.21.15.79:0/4133286272 shutdown_connections 2024-06-10T00:20:33.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.292+0000 7f879de8c640 1 --2- 172.21.15.79:0/4133286272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980cf190 0x7f87980d23f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.292+0000 7f879de8c640 1 --2- 172.21.15.79:0/4133286272 >> v2:172.21.15.117:3300/0 conn(0x7f87980b3800 0x7f87980cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.292+0000 7f879de8c640 1 -- 172.21.15.79:0/4133286272 >> 172.21.15.79:0/4133286272 conn(0x7f879809d3c0 msgr2=0x7f87980d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.292+0000 7f879de8c640 1 -- 172.21.15.79:0/4133286272 shutdown_connections 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.292+0000 7f879de8c640 1 -- 172.21.15.79:0/4133286272 wait complete. 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.293+0000 7f879de8c640 1 Processor -- start 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.293+0000 7f879de8c640 1 -- start start 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f879de8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980b3800 0x7f87981554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f879de8c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87980cf190 0x7f87981f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f879de8c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87980d08f0 0x7f87980b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f879de8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f87980d1ed0 con 0x7f87980b3800 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f879de8c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f87980cfe60 con 0x7f87980cf190 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f879de8c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87980b50c0 con 0x7f87980d08f0 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980b3800 0x7f87981554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980b3800 0x7f87981554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48674/0 (socket says 172.21.15.79:48674) 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 -- 172.21.15.79:0/654866434 learned_addr learned my addr 172.21.15.79:0/654866434 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:33.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f878ffff640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87980cf190 0x7f87981f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f8797fff640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87980d08f0 0x7f87980b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 -- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87980d08f0 msgr2=0x7f87980b87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87980d08f0 0x7f87980b87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 -- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87980cf190 msgr2=0x7f87981f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87980cf190 0x7f87981f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 -- 172.21.15.79:0/654866434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87980cc9e0 con 0x7f87980b3800 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f878ffff640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87980cf190 0x7f87981f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f8797fff640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87980d08f0 0x7f87980b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.294+0000 7f87977fe640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980b3800 0x7f87981554d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f878800c460 tx=0x7f878800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.295+0000 7f8794ff9640 1 -- 172.21.15.79:0/654866434 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8788018070 con 0x7f87980b3800 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.295+0000 7f8794ff9640 1 -- 172.21.15.79:0/654866434 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8788007500 con 0x7f87980b3800 2024-06-10T00:20:33.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.295+0000 7f8794ff9640 1 -- 172.21.15.79:0/654866434 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8788004a20 con 0x7f87980b3800 2024-06-10T00:20:33.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.295+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87980ccc80 con 0x7f87980b3800 2024-06-10T00:20:33.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.295+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87980cd520 con 0x7f87980b3800 2024-06-10T00:20:33.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.296+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87980cd720 con 0x7f87980b3800 2024-06-10T00:20:33.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.296+0000 7f8794ff9640 1 -- 172.21.15.79:0/654866434 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f878801b070 con 0x7f87980b3800 2024-06-10T00:20:33.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.297+0000 7f8794ff9640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f877806be30 0x7f877806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.297+0000 7f8794ff9640 1 -- 172.21.15.79:0/654866434 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f878808a2f0 con 0x7f87980b3800 2024-06-10T00:20:33.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.297+0000 7f878ffff640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f877806be30 0x7f877806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.297+0000 7f878ffff640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f877806be30 0x7f877806e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f87980c7cb0 tx=0x7f8780008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.301+0000 7f8794ff9640 1 -- 172.21.15.79:0/654866434 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f87980cd720 con 0x7f87980b3800 2024-06-10T00:20:33.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.514+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f87980683c0 con 0x7f87980b3800 2024-06-10T00:20:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.823+0000 7f8794ff9640 1 -- 172.21.15.79:0/654866434 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v52) ==== 162+0+0 (secure 0 0 0) 0x7f8788058ac0 con 0x7f87980b3800 2024-06-10T00:20:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-06-10T00:20:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f877806be30 msgr2=0x7f877806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f877806be30 0x7f877806e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f87980c7cb0 tx=0x7f8780008040 comp rx=0 tx=0).stop 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980b3800 msgr2=0x7f87981554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980b3800 0x7f87981554d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f878800c460 tx=0x7f878800c920 comp rx=0 tx=0).stop 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 shutdown_connections 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f877806be30 0x7f877806e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87980d08f0 0x7f87980b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87980cf190 0x7f87981f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 --2- 172.21.15.79:0/654866434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87980b3800 0x7f87981554d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 >> 172.21.15.79:0/654866434 conn(0x7f879809d3c0 msgr2=0x7f87980b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 shutdown_connections 2024-06-10T00:20:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.826+0000 7f879de8c640 1 -- 172.21.15.79:0/654866434 wait complete. 2024-06-10T00:20:33.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.938+0000 7fbaba1ce640 1 Processor -- start 2024-06-10T00:20:33.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.938+0000 7fbaba1ce640 1 -- start start 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbaba1ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40d1fc0 0x7fbab40cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbaba1ce640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbab415f5e0 con 0x7fbab415f1a0 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbaba1ce640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbab40d2450 con 0x7fbab40d2680 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbaba1ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbab40d13e0 con 0x7fbab40d1fc0 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab2ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbab415f1a0 0x7fbab40cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42406/0 (socket says 172.21.15.79:42406) 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab2ffd640 1 -- 172.21.15.79:0/3406994680 learned_addr learned my addr 172.21.15.79:0/3406994680 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647643022 0 0) 0x7fbab415f5e0 con 0x7fbab415f1a0 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba9c003520 con 0x7fbab415f1a0 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab3fff640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40d1fc0 0x7fbab40cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1327511759 0 0) 0x7fba9c003520 con 0x7fbab415f1a0 2024-06-10T00:20:33.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40d1fc0 msgr2=0x7fbab40cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40d1fc0 0x7fbab40cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 >> v1:172.21.15.117:6789/0 conn(0x7fbab40d2680 legacy=0x7fbab40d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab40d0ad0 con 0x7fbab415f1a0 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fbaa8001670 con 0x7fbab415f1a0 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 >> v1:172.21.15.79:6789/0 conn(0x7fbab415f1a0 legacy=0x7fbab40cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.939+0000 7fbab27fc640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba9c0039e0 0x7fba9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab27fc640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40d1fc0 0x7fba9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab27fc640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c004d40 0x7fba9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbab40d13e0 con 0x7fba9c0039e0 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c00ba70 con 0x7fba9c004d40 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba9c00bc70 con 0x7fbab40d1fc0 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab37fe640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba9c0039e0 0x7fba9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab2ffd640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40d1fc0 0x7fba9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab3fff640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c004d40 0x7fba9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab37fe640 1 -- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40d1fc0 msgr2=0x7fba9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab37fe640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40d1fc0 0x7fba9c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab37fe640 1 -- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c004d40 msgr2=0x7fba9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab37fe640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c004d40 0x7fba9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab37fe640 1 -- 172.21.15.79:0/3406994680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c003520 con 0x7fba9c0039e0 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.940+0000 7fbab3fff640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c004d40 0x7fba9c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbab37fe640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba9c0039e0 0x7fba9c003e00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001720 tx=0x7fba9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f99c726535ca6b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4001370 con 0x7fba9c0039e0 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa40052d0 con 0x7fba9c0039e0 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbab27fc640 1 -- 172.21.15.79:0/3406994680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa402abc0 con 0x7fba9c0039e0 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbaba1ce640 1 -- 172.21.15.79:0/3406994680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba9c0039e0 msgr2=0x7fba9c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbaba1ce640 1 --2- 172.21.15.79:0/3406994680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba9c0039e0 0x7fba9c003e00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001720 tx=0x7fba9c005830 comp rx=0 tx=0).stop 2024-06-10T00:20:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbab3fff640 1 -- 172.21.15.79:0/3406994680 reap_dead start 2024-06-10T00:20:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbaba1ce640 1 -- 172.21.15.79:0/3406994680 shutdown_connections 2024-06-10T00:20:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbaba1ce640 1 -- 172.21.15.79:0/3406994680 >> 172.21.15.79:0/3406994680 conn(0x7fbab409d3f0 msgr2=0x7fbab40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbaba1ce640 1 -- 172.21.15.79:0/3406994680 shutdown_connections 2024-06-10T00:20:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.941+0000 7fbaba1ce640 1 -- 172.21.15.79:0/3406994680 wait complete. 2024-06-10T00:20:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.942+0000 7fbaba1ce640 1 Processor -- start 2024-06-10T00:20:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbaba1ce640 1 -- start start 2024-06-10T00:20:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbaba1ce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c0039e0 0x7fbab40c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbaba1ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40ca500 0x7fbab40b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbaba1ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab415d770 0x7fbab415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbaba1ce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbab40d1070 con 0x7fbab415d770 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbaba1ce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbab40d0d90 con 0x7fba9c0039e0 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbaba1ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbab40d4f00 con 0x7fbab40ca500 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab415d770 0x7fbab415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.943+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab415d770 0x7fbab415dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48688/0 (socket says 172.21.15.79:48688) 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbab3fff640 1 -- 172.21.15.79:0/1784344724 learned_addr learned my addr 172.21.15.79:0/1784344724 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbab3fff640 1 -- 172.21.15.79:0/1784344724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40ca500 msgr2=0x7fbab40b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbab3fff640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40ca500 0x7fbab40b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbab3fff640 1 -- 172.21.15.79:0/1784344724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c0039e0 msgr2=0x7fbab40c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbab3fff640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c0039e0 0x7fbab40c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbab3fff640 1 -- 172.21.15.79:0/1784344724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab415c1c0 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbab3fff640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab415d770 0x7fbab415dbf0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fbab408caa0 tx=0x7fbaac010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fba9bfff640 1 -- 172.21.15.79:0/1784344724 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac010da0 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fba9bfff640 1 -- 172.21.15.79:0/1784344724 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaac003990 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab41f7e30 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fba9bfff640 1 -- 172.21.15.79:0/1784344724 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac003d80 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.944+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab41f83f0 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.945+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab4068430 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.946+0000 7fba9bfff640 1 -- 172.21.15.79:0/1784344724 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaac01e030 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.946+0000 7fba9bfff640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbaa006be30 0x7fbaa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.946+0000 7fbab37fe640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbaa006be30 0x7fbaa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.946+0000 7fba9bfff640 1 -- 172.21.15.79:0/1784344724 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fbaac08b680 con 0x7fbab415d770 2024-06-10T00:20:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.946+0000 7fbab37fe640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbaa006be30 0x7fbaa006e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4032000 tx=0x7fbaa402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:33.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:33.950+0000 7fba9bfff640 1 -- 172.21.15.79:0/1784344724 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbaac025020 con 0x7fbab415d770 2024-06-10T00:20:34.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.160+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbab40d04e0 con 0x7fbab415d770 2024-06-10T00:20:34.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.161+0000 7fba9bfff640 1 -- 172.21.15.79:0/1784344724 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5183 (secure 0 0 0) 0x7fbaac059ee0 con 0x7fbab415d770 2024-06-10T00:20:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:34.161 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:33.823613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":52,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-06-10T00:20:34.162 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 52 2024-06-10T00:20:34.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbaa006be30 msgr2=0x7fbaa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbaa006be30 0x7fbaa006e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4032000 tx=0x7fbaa402c000 comp rx=0 tx=0).stop 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab415d770 msgr2=0x7fbab415dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab415d770 0x7fbab415dbf0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fbab408caa0 tx=0x7fbaac010590 comp rx=0 tx=0).stop 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 shutdown_connections 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbaa006be30 0x7fbaa006e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab415d770 0x7fbab415dbf0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40ca500 0x7fbab40b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 --2- 172.21.15.79:0/1784344724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba9c0039e0 0x7fbab40c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 >> 172.21.15.79:0/1784344724 conn(0x7fbab409d3f0 msgr2=0x7fbab415fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 shutdown_connections 2024-06-10T00:20:34.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:34.163+0000 7fbaba1ce640 1 -- 172.21.15.79:0/1784344724 wait complete. 2024-06-10T00:20:34.576 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:20:24.159187+0000', 'modified': '2024-06-10T00:20:33.823613+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6885}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6885': {'gid': 6885, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6836/1800410806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 1800410806}, {'type': 'v1', 'addr': '172.21.15.79:6836', 'nonce': 1800410806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:20:34.577 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6885:up:replay 2024-06-10T00:20:35.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:35.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.688+0000 7f9cb64b3640 1 Processor -- start 2024-06-10T00:20:35.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.688+0000 7f9cb64b3640 1 -- start start 2024-06-10T00:20:35.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.689+0000 7f9cb64b3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9cb0158770 0x7f9cb006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:35.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.689+0000 7f9cb64b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158b50 0x7f9cb006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.689+0000 7f9cb64b3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb006e670 con 0x7f9cb006d9b0 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.689+0000 7f9cb64b3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb006e950 con 0x7f9cb0158770 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.689+0000 7f9cb64b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb006ec30 con 0x7f9cb0158b50 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.689+0000 7f9cb4a50640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9cb006d9b0 0x7f9cb006de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42408/0 (socket says 172.21.15.79:42408) 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.689+0000 7f9cb4a50640 1 -- 172.21.15.79:0/1519949440 learned_addr learned my addr 172.21.15.79:0/1519949440 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caf7fe640 1 --2- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158b50 0x7f9cb006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caffff640 1 --2- 172.21.15.79:0/1519949440 >> v2:172.21.15.117:3300/0 conn(0x7f9cb0158770 0x7f9cb006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caeffd640 1 -- 172.21.15.79:0/1519949440 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2405921267 0 0) 0x7f9cb006e670 con 0x7f9cb006d9b0 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caeffd640 1 -- 172.21.15.79:0/1519949440 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c98003520 con 0x7f9cb006d9b0 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caeffd640 1 -- 172.21.15.79:0/1519949440 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2671571527 0 0) 0x7f9c98003520 con 0x7f9cb006d9b0 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caffff640 1 -- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158b50 msgr2=0x7f9cb006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:35.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caffff640 1 --2- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158b50 0x7f9cb006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caffff640 1 -- 172.21.15.79:0/1519949440 >> v1:172.21.15.79:6789/0 conn(0x7f9cb006d9b0 legacy=0x7f9cb006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:35.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caffff640 1 -- 172.21.15.79:0/1519949440 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb00ae890 con 0x7f9cb0158770 2024-06-10T00:20:35.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.690+0000 7f9caf7fe640 1 --2- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158b50 0x7f9cb006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:20:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.691+0000 7f9caffff640 1 --2- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb0158770 0x7f9cb006c3d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00097a0 tx=0x7f9ca002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c62003afa73f979 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.691+0000 7f9caeffd640 1 -- 172.21.15.79:0/1519949440 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0037070 con 0x7f9cb0158770 2024-06-10T00:20:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.691+0000 7f9caeffd640 1 -- 172.21.15.79:0/1519949440 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca002ab10 con 0x7f9cb0158770 2024-06-10T00:20:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.691+0000 7f9caeffd640 1 -- 172.21.15.79:0/1519949440 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80019f0 con 0x7f9cb0158770 2024-06-10T00:20:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.691+0000 7f9cb64b3640 1 -- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb0158770 msgr2=0x7f9cb006c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.691+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb0158770 0x7f9cb006c3d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00097a0 tx=0x7f9ca002a080 comp rx=0 tx=0).stop 2024-06-10T00:20:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.692+0000 7f9cb64b3640 1 -- 172.21.15.79:0/1519949440 shutdown_connections 2024-06-10T00:20:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.692+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158b50 0x7f9cb006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.692+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/1519949440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb0158770 0x7f9cb006c3d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.692+0000 7f9cb64b3640 1 -- 172.21.15.79:0/1519949440 >> 172.21.15.79:0/1519949440 conn(0x7f9cb0071950 msgr2=0x7f9cb0071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:35.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.692+0000 7f9cb64b3640 1 -- 172.21.15.79:0/1519949440 shutdown_connections 2024-06-10T00:20:35.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.692+0000 7f9cb64b3640 1 -- 172.21.15.79:0/1519949440 wait complete. 2024-06-10T00:20:35.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.693+0000 7f9cb64b3640 1 Processor -- start 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.693+0000 7f9cb64b3640 1 -- start start 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb64b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb006d9b0 0x7f9cb01540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb64b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158770 0x7f9cb0160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb64b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb0158b50 0x7f9cb01607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb64b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00aef30 con 0x7f9cb0158b50 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb64b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00aedb0 con 0x7f9cb006d9b0 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb64b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb00af0b0 con 0x7f9cb0158770 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb0158b50 0x7f9cb01607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb0158b50 0x7f9cb01607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48692/0 (socket says 172.21.15.79:48692) 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 -- 172.21.15.79:0/3860592326 learned_addr learned my addr 172.21.15.79:0/3860592326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 -- 172.21.15.79:0/3860592326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158770 msgr2=0x7f9cb0160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158770 0x7f9cb0160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 -- 172.21.15.79:0/3860592326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb006d9b0 msgr2=0x7f9cb01540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9caffff640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb006d9b0 0x7f9cb01540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb006d9b0 0x7f9cb01540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 -- 172.21.15.79:0/3860592326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb015ab60 con 0x7f9cb0158b50 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb4a50640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb0158b50 0x7f9cb01607c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8001560 tx=0x7f9ca800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cacff9640 1 -- 172.21.15.79:0/3860592326 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8017070 con 0x7f9cb0158b50 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cacff9640 1 -- 172.21.15.79:0/3860592326 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca800ce50 con 0x7f9cb0158b50 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb00cdec0 con 0x7f9cb0158b50 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cacff9640 1 -- 172.21.15.79:0/3860592326 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8012640 con 0x7f9cb0158b50 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.694+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb00ce480 con 0x7f9cb0158b50 2024-06-10T00:20:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.695+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb0162d90 con 0x7f9cb0158b50 2024-06-10T00:20:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.696+0000 7f9cacff9640 1 -- 172.21.15.79:0/3860592326 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ca801a070 con 0x7f9cb0158b50 2024-06-10T00:20:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.696+0000 7f9cacff9640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9c9c06be60 0x7f9c9c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.697+0000 7f9caffff640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9c9c06be60 0x7f9c9c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.697+0000 7f9cacff9640 1 -- 172.21.15.79:0/3860592326 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f9ca808aff0 con 0x7f9cb0158b50 2024-06-10T00:20:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.697+0000 7f9caffff640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9c9c06be60 0x7f9c9c06e320 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0034000 tx=0x7f9ca002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:35.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.701+0000 7f9cacff9640 1 -- 172.21.15.79:0/3860592326 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9cb0162d90 con 0x7f9cb0158b50 2024-06-10T00:20:35.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.911+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cb00ce680 con 0x7f9cb0158b50 2024-06-10T00:20:35.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.911+0000 7f9cacff9640 1 -- 172.21.15.79:0/3860592326 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5183 (secure 0 0 0) 0x7f9cb00ce680 con 0x7f9cb0158b50 2024-06-10T00:20:35.912 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:35.912 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:34.828568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":52,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-06-10T00:20:35.912 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 54 2024-06-10T00:20:35.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9c9c06be60 msgr2=0x7f9c9c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:35.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9c9c06be60 0x7f9c9c06e320 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0034000 tx=0x7f9ca002e000 comp rx=0 tx=0).stop 2024-06-10T00:20:35.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb0158b50 msgr2=0x7f9cb01607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:35.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb0158b50 0x7f9cb01607c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8001560 tx=0x7f9ca800a430 comp rx=0 tx=0).stop 2024-06-10T00:20:35.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 shutdown_connections 2024-06-10T00:20:35.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9c9c06be60 0x7f9c9c06e320 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb0158b50 0x7f9cb01607c0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cb0158770 0x7f9cb0160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 --2- 172.21.15.79:0/3860592326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cb006d9b0 0x7f9cb01540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:35.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 >> 172.21.15.79:0/3860592326 conn(0x7f9cb0071950 msgr2=0x7f9cb006b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:35.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.913+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 shutdown_connections 2024-06-10T00:20:35.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:35.914+0000 7f9cb64b3640 1 -- 172.21.15.79:0/3860592326 wait complete. 2024-06-10T00:20:36.327 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:20:24.159187+0000', 'modified': '2024-06-10T00:20:34.828568+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6885}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6885': {'gid': 6885, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:rejoin', 'state_seq': 6, 'addr': '172.21.15.79:6836/1800410806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 1800410806}, {'type': 'v1', 'addr': '172.21.15.79:6836', 'nonce': 1800410806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:20:36.327 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6885:up:rejoin 2024-06-10T00:20:37.328 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:20:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.439+0000 7f9ead88c640 1 Processor -- start 2024-06-10T00:20:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.439+0000 7f9ead88c640 1 -- start start 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.439+0000 7f9ead88c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ea80d2680 0x7f9ea815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.439+0000 7f9ead88c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea80d0ad0 con 0x7f9ea80cef70 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.439+0000 7f9ead88c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea815f890 con 0x7f9ea80d1fc0 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.439+0000 7f9ead88c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea80d13e0 con 0x7f9ea80d2680 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9ea80cef70 0x7f9ea80cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42412/0 (socket says 172.21.15.79:42412) 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea77fe640 1 -- 172.21.15.79:0/2072794589 learned_addr learned my addr 172.21.15.79:0/2072794589 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea6ffd640 1 --2- 172.21.15.79:0/2072794589 >> v2:172.21.15.117:3300/0 conn(0x7f9ea80d2680 0x7f9ea815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405190929 0 0) 0x7f9ea80d0ad0 con 0x7f9ea80cef70 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e90003520 con 0x7f9ea80cef70 2024-06-10T00:20:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1894640642 0 0) 0x7f9e90003520 con 0x7f9ea80cef70 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 >> v2:172.21.15.117:3300/0 conn(0x7f9ea80d2680 msgr2=0x7f9ea815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 --2- 172.21.15.79:0/2072794589 >> v2:172.21.15.117:3300/0 conn(0x7f9ea80d2680 0x7f9ea815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 >> v1:172.21.15.117:6789/0 conn(0x7f9ea80d1fc0 legacy=0x7f9ea80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea80d0d90 con 0x7f9ea80cef70 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f9ea0001670 con 0x7f9ea80cef70 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 >> v1:172.21.15.79:6789/0 conn(0x7f9ea80cef70 legacy=0x7f9ea80cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e900039b0 0x7f9e90003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9e90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e900051c0 0x7f9e9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80d13e0 con 0x7f9e90004800 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9000c090 con 0x7f9e900039b0 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9000c290 con 0x7f9e900051c0 2024-06-10T00:20:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea67fc640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9e90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea6ffd640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e900039b0 0x7f9e90003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.440+0000 7f9ea77fe640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e900051c0 0x7f9e9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea67fc640 1 -- 172.21.15.79:0/2072794589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e900051c0 msgr2=0x7f9e9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea67fc640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e900051c0 0x7f9e9000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea67fc640 1 -- 172.21.15.79:0/2072794589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e900039b0 msgr2=0x7f9e90003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea67fc640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e900039b0 0x7f9e90003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea67fc640 1 -- 172.21.15.79:0/2072794589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e90003520 con 0x7f9e90004800 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea77fe640 1 -- 172.21.15.79:0/2072794589 reap_dead start 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea67fc640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9e90004c80 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c001750 tx=0x7f9e90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fbf395347c4d0e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c001370 con 0x7f9e90004800 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c0052d0 con 0x7f9e90004800 2024-06-10T00:20:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.441+0000 7f9ea5ffb640 1 -- 172.21.15.79:0/2072794589 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c02abc0 con 0x7f9e90004800 2024-06-10T00:20:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.442+0000 7f9ead88c640 1 -- 172.21.15.79:0/2072794589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 msgr2=0x7f9e90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.442+0000 7f9ead88c640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9e90004c80 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c001750 tx=0x7f9e90005830 comp rx=0 tx=0).stop 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.442+0000 7f9ead88c640 1 -- 172.21.15.79:0/2072794589 shutdown_connections 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.442+0000 7f9ead88c640 1 --2- 172.21.15.79:0/2072794589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9e90004c80 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.442+0000 7f9ead88c640 1 -- 172.21.15.79:0/2072794589 >> 172.21.15.79:0/2072794589 conn(0x7f9ea809d3f0 msgr2=0x7f9ea80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.442+0000 7f9ead88c640 1 -- 172.21.15.79:0/2072794589 shutdown_connections 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.442+0000 7f9ead88c640 1 -- 172.21.15.79:0/2072794589 wait complete. 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.443+0000 7f9ead88c640 1 Processor -- start 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.443+0000 7f9ead88c640 1 -- start start 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ead88c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9ea815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ead88c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ea815cab0 0x7f9ea815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ead88c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ea815e130 0x7f9ea81f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ead88c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80d4f00 con 0x7f9e90004800 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ead88c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80d2400 con 0x7f9ea815cab0 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ead88c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea80d1870 con 0x7f9ea815e130 2024-06-10T00:20:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ea6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9ea815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ea6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9ea815c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48710/0 (socket says 172.21.15.79:48710) 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ea6ffd640 1 -- 172.21.15.79:0/4292069288 learned_addr learned my addr 172.21.15.79:0/4292069288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ea67fc640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ea815cab0 0x7f9ea815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ea77fe640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ea815e130 0x7f9ea81f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.444+0000 7f9ea6ffd640 1 -- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ea815e130 msgr2=0x7f9ea81f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9ea6ffd640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ea815e130 0x7f9ea81f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9ea6ffd640 1 -- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ea815cab0 msgr2=0x7f9ea815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9ea6ffd640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ea815cab0 0x7f9ea815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9ea6ffd640 1 -- 172.21.15.79:0/4292069288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea815b510 con 0x7f9e90004800 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9ea77fe640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ea815e130 0x7f9ea81f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9ea6ffd640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9ea815c570 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9e98011e30 tx=0x7f9e9800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9e8ffff640 1 -- 172.21.15.79:0/4292069288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98015630 con 0x7f9e90004800 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9e8ffff640 1 -- 172.21.15.79:0/4292069288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e980157d0 con 0x7f9e90004800 2024-06-10T00:20:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea815b7b0 con 0x7f9e90004800 2024-06-10T00:20:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9e8ffff640 1 -- 172.21.15.79:0/4292069288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98015ba0 con 0x7f9e90004800 2024-06-10T00:20:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.445+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea815bd70 con 0x7f9e90004800 2024-06-10T00:20:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.446+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea815e540 con 0x7f9e90004800 2024-06-10T00:20:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.446+0000 7f9e8ffff640 1 -- 172.21.15.79:0/4292069288 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e9801d400 con 0x7f9e90004800 2024-06-10T00:20:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.447+0000 7f9e8ffff640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e9406be30 0x7f9e9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.447+0000 7f9e8ffff640 1 -- 172.21.15.79:0/4292069288 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f9e9808c2a0 con 0x7f9e90004800 2024-06-10T00:20:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.447+0000 7f9ea67fc640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e9406be30 0x7f9e9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.448+0000 7f9ea67fc640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e9406be30 0x7f9e9406e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c001750 tx=0x7f9e9c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.452+0000 7f9e8ffff640 1 -- 172.21.15.79:0/4292069288 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9ea815e540 con 0x7f9e90004800 2024-06-10T00:20:37.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.660+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ea8068430 con 0x7f9e90004800 2024-06-10T00:20:37.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.660+0000 7f9e8ffff640 1 -- 172.21.15.79:0/4292069288 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5190 (secure 0 0 0) 0x7f9e98019030 con 0x7f9e90004800 2024-06-10T00:20:37.660 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:20:37.660 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:36.827985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":7,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":6}]} 2024-06-10T00:20:37.660 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 55 2024-06-10T00:20:37.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e9406be30 msgr2=0x7f9e9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:37.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e9406be30 0x7f9e9406e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c001750 tx=0x7f9e9c02e000 comp rx=0 tx=0).stop 2024-06-10T00:20:37.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 msgr2=0x7f9ea815c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:37.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9ea815c570 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9e98011e30 tx=0x7f9e9800f580 comp rx=0 tx=0).stop 2024-06-10T00:20:37.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 shutdown_connections 2024-06-10T00:20:37.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9e9406be30 0x7f9e9406e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ea815e130 0x7f9ea81f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ea815cab0 0x7f9ea815dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 --2- 172.21.15.79:0/4292069288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e90004800 0x7f9ea815c570 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:37.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 >> 172.21.15.79:0/4292069288 conn(0x7f9ea809d3f0 msgr2=0x7f9ea80d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:37.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 shutdown_connections 2024-06-10T00:20:37.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:37.662+0000 7f9ead88c640 1 -- 172.21.15.79:0/4292069288 wait complete. 2024-06-10T00:20:38.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:20:24.159187+0000', 'modified': '2024-06-10T00:20:36.827985+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6885}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6885': {'gid': 6885, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.79:6836/1800410806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 1800410806}, {'type': 'v1', 'addr': '172.21.15.79:6836', 'nonce': 1800410806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6885, 'qdb_cluster': [6885]} 2024-06-10T00:20:38.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:20:38.075 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:20:38.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.176+0000 7f1fa07e3640 1 Processor -- start 2024-06-10T00:20:38.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.176+0000 7f1fa07e3640 1 -- start start 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1fa07e3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f980cd230 0x7f1f980b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1fa07e3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f980b3420 con 0x7f1f981553c0 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1fa07e3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f980cc750 con 0x7f1f980cec50 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1fa07e3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1f980cca30 con 0x7f1f980cd230 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9e57f640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1f981553c0 0x7f1f9815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56618/0 (socket says 172.21.15.79:56618) 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9e57f640 1 -- 172.21.15.79:0/2706790901 learned_addr learned my addr 172.21.15.79:0/2706790901 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24081390 0 0) 0x7f1f980b3420 con 0x7f1f981553c0 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f84003520 con 0x7f1f981553c0 2024-06-10T00:20:38.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/2706790901 >> v2:172.21.15.117:3300/0 conn(0x7f1f980cd230 0x7f1f980b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2737539315 0 0) 0x7f1f84003520 con 0x7f1f981553c0 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 >> v2:172.21.15.117:3300/0 conn(0x7f1f980cd230 msgr2=0x7f1f980b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 --2- 172.21.15.79:0/2706790901 >> v2:172.21.15.117:3300/0 conn(0x7f1f980cd230 0x7f1f980b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 >> v1:172.21.15.117:6789/0 conn(0x7f1f980cec50 legacy=0x7f1f98071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f980ccd10 con 0x7f1f981553c0 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f1f94001670 con 0x7f1f981553c0 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.177+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 >> v1:172.21.15.79:6789/0 conn(0x7f1f981553c0 legacy=0x7f1f9815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9d57d640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840039b0 0x7f1f84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9d57d640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f84004800 0x7f1f84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9d57d640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f840051c0 0x7f1f8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f980cca30 con 0x7f1f840051c0 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8400c110 con 0x7f1f84004800 2024-06-10T00:20:38.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8400c310 con 0x7f1f840039b0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f840051c0 0x7f1f8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840039b0 0x7f1f84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f84004800 0x7f1f84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9ed80640 1 -- 172.21.15.79:0/2706790901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840039b0 msgr2=0x7f1f84003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840039b0 0x7f1f84003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9ed80640 1 -- 172.21.15.79:0/2706790901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f84004800 msgr2=0x7f1f84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f84004800 0x7f1f84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.178+0000 7f1f9ed80640 1 -- 172.21.15.79:0/2706790901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f84003520 con 0x7f1f840051c0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1f9ed80640 1 -- 172.21.15.79:0/2706790901 reap_dead start 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f840051c0 0x7f1f8400b9c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1f90001e50 tx=0x7f1f84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5204899e08ae0a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90001a70 con 0x7f1f840051c0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f90003970 con 0x7f1f840051c0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1f9d57d640 1 -- 172.21.15.79:0/2706790901 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90003d60 con 0x7f1f840051c0 2024-06-10T00:20:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1fa07e3640 1 -- 172.21.15.79:0/2706790901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f840051c0 msgr2=0x7f1f8400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1fa07e3640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f840051c0 0x7f1f8400b9c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1f90001e50 tx=0x7f1f84005830 comp rx=0 tx=0).stop 2024-06-10T00:20:38.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1fa07e3640 1 -- 172.21.15.79:0/2706790901 shutdown_connections 2024-06-10T00:20:38.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1fa07e3640 1 --2- 172.21.15.79:0/2706790901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f840051c0 0x7f1f8400b9c0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1fa07e3640 1 -- 172.21.15.79:0/2706790901 >> 172.21.15.79:0/2706790901 conn(0x7f1f980b19f0 msgr2=0x7f1f980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:38.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1fa07e3640 1 -- 172.21.15.79:0/2706790901 shutdown_connections 2024-06-10T00:20:38.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.179+0000 7f1fa07e3640 1 -- 172.21.15.79:0/2706790901 wait complete. 2024-06-10T00:20:38.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1fa07e3640 1 Processor -- start 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1fa07e3640 1 -- start start 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1fa07e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840051c0 0x7f1f9815f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1fa07e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9815f600 0x7f1f98153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1fa07e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f98154130 0x7f1f981545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1fa07e3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98155920 con 0x7f1f9815f600 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1fa07e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981557a0 con 0x7f1f98154130 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1fa07e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f980b2cf0 con 0x7f1f840051c0 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1f9dd7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9815f600 0x7f1f98153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1f9dd7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9815f600 0x7f1f98153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54520/0 (socket says 172.21.15.79:54520) 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.181+0000 7f1f9dd7e640 1 -- 172.21.15.79:0/662790912 learned_addr learned my addr 172.21.15.79:0/662790912 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840051c0 0x7f1f9815f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f9dd7e640 1 -- 172.21.15.79:0/662790912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840051c0 msgr2=0x7f1f9815f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840051c0 0x7f1f9815f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f9dd7e640 1 -- 172.21.15.79:0/662790912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f98154130 msgr2=0x7f1f981545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f98154130 0x7f1f981545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f98154130 0x7f1f981545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f9dd7e640 1 -- 172.21.15.79:0/662790912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9809c4a0 con 0x7f1f9815f600 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9815f600 0x7f1f98153bf0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b820 tx=0x7f1f8800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f8effd640 1 -- 172.21.15.79:0/662790912 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88018070 con 0x7f1f9815f600 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f8effd640 1 -- 172.21.15.79:0/662790912 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8800be10 con 0x7f1f9815f600 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1fa07e3640 1 -- 172.21.15.79:0/662790912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9809c740 con 0x7f1f9815f600 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1f8effd640 1 -- 172.21.15.79:0/662790912 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88010c60 con 0x7f1f9815f600 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.182+0000 7f1fa07e3640 1 -- 172.21.15.79:0/662790912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9809cd00 con 0x7f1f9815f600 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.184+0000 7f1f8effd640 1 -- 172.21.15.79:0/662790912 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f8801b070 con 0x7f1f9815f600 2024-06-10T00:20:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.184+0000 7f1f8effd640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.184+0000 7f1f8effd640 1 -- 172.21.15.79:0/662790912 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f1f8808b750 con 0x7f1f9815f600 2024-06-10T00:20:38.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.184+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.184+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1f940014f0 tx=0x7f1f94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.185+0000 7f1fa35cd740 1 Processor -- start 2024-06-10T00:20:38.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.185+0000 7f1fa35cd740 1 -- start start 2024-06-10T00:20:38.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb293960 0x55b0cb299990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2df660 0x55b0cb2dfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b0cb1fc740 con 0x55b0cb293960 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b0cb19aa80 con 0x55b0cb2df660 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b0cb1f8700 con 0x55b0cb2c3700 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb293960 0x55b0cb299990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb293960 0x55b0cb299990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54524/0 (socket says 172.21.15.79:54524) 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 -- 172.21.15.79:0/4141575603 learned_addr learned my addr 172.21.15.79:0/4141575603 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2df660 0x55b0cb2dfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 -- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 msgr2=0x55b0cb2c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 -- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2df660 msgr2=0x55b0cb2dfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2df660 0x55b0cb2dfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 -- 172.21.15.79:0/4141575603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cb1c5fb0 con 0x55b0cb293960 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2df660 0x55b0cb2dfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb293960 0x55b0cb299990 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000c00 tx=0x7f1f88059490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f510cdaef01fcf19 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f7bfff640 1 -- 172.21.15.79:0/4141575603 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88022040 con 0x55b0cb293960 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f7bfff640 1 -- 172.21.15.79:0/4141575603 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f88062400 con 0x55b0cb293960 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.186+0000 7f1f7bfff640 1 -- 172.21.15.79:0/4141575603 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88060070 con 0x55b0cb293960 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4141575603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb293960 msgr2=0x55b0cb299990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb293960 0x55b0cb299990 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000c00 tx=0x7f1f88059490 comp rx=0 tx=0).stop 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4141575603 shutdown_connections 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2df660 0x55b0cb2dfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb293960 0x55b0cb299990 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/4141575603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4141575603 >> 172.21.15.79:0/4141575603 conn(0x55b0cb295bd0 msgr2=0x55b0cb2de510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:38.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4141575603 shutdown_connections 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4141575603 wait complete. 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.187+0000 7f1fa35cd740 1 -- start start 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.188+0000 7f1fa35cd740 1 Processor -- start 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.188+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2c3700 0x55b0cb2be730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.188+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 0x55b0cb2c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.188+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.188+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b0cb299ed0 con 0x55b0cb2d6250 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b0cb185c30 con 0x55b0cb2c3700 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b0cb299500 con 0x55b0cb2df660 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1fa35cd740 10 client.0 _ll_register_callbacks cb 0x55b0cb1b77f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54532/0 (socket says 172.21.15.79:54532) 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 -- 172.21.15.79:0/738413979 learned_addr learned my addr 172.21.15.79:0/738413979 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2c3700 0x55b0cb2be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 0x55b0cb2c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 -- 172.21.15.79:0/738413979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 msgr2=0x55b0cb2c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 0x55b0cb2c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 -- 172.21.15.79:0/738413979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2c3700 msgr2=0x55b0cb2be730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2c3700 0x55b0cb2be730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 -- 172.21.15.79:0/738413979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0caf102d0 con 0x55b0cb2d6250 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c5520 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f1f9002a920 tx=0x7f1f90001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3108cc9db0928d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f797fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f797fa640 1 -- 172.21.15.79:0/738413979 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90042060 con 0x55b0cb2d6250 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f797fa640 1 -- 172.21.15.79:0/738413979 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f1f90006b50 con 0x55b0cb2d6250 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1fa35cd740 1 -- 172.21.15.79:0/738413979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f88062400 con 0x55b0cb2d6250 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f797fa640 1 -- 172.21.15.79:0/738413979 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1f90048050 con 0x55b0cb2d6250 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1fa35cd740 10 client.7143 fetch_fsmap learned FSMap version 55 2024-06-10T00:20:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1fa35cd740 1 -- 172.21.15.79:0/738413979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55b0cafda6b0 con 0x55b0cb2d6250 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.189+0000 7f1f797fa640 1 -- 172.21.15.79:0/738413979 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f88062400 con 0x55b0cb2d6250 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1f797fa640 1 -- 172.21.15.79:0/738413979 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f1f9004b020 con 0x55b0cb2d6250 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1fa35cd740 10 client.7143 fetch_fsmap finished waiting for FSMap version 55 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1fa35cd740 10 client.7143 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1fa35cd740 20 client.7143 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55b0cb2f6410 0x55b0cb2f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1fa35cd740 4 client.7143 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1fa35cd740 1 -- 172.21.15.79:0/738413979 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0cb209e70 con 0x55b0cb2f6410 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55b0cb2f6410 0x55b0cb2f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1f797fa640 10 client.7143 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.190+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55b0cb2f6410 0x55b0cb2f67f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b47a86fedea5ac9 server_cookie=c1f43648886221e5 in_seq=0 out_seq=0 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1f797fa640 1 -- 172.21.15.79:0/738413979 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b0cb209e70 con 0x55b0cb2f6410 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1f797fa640 10 client.7143 handle_command_reply: tid=0 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 client.7143 shutdown 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 -- 172.21.15.79:0/738413979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2d6250 msgr2=0x55b0cb2c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c5520 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f1f9002a920 tx=0x7f1f90001510 comp rx=0 tx=0).stop 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 -- 172.21.15.79:0/738413979 shutdown_connections 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55b0cb2f6410 0x55b0cb2f67f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c5520 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 0x55b0cb2c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/738413979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2c3700 0x55b0cb2be730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1f797fa640 0 client.7143 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 -- 172.21.15.79:0/738413979 >> 172.21.15.79:0/738413979 conn(0x55b0cb293960 msgr2=0x55b0cb2deda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 -- 172.21.15.79:0/738413979 shutdown_connections 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 1 -- 172.21.15.79:0/738413979 wait complete. 2024-06-10T00:20:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.191+0000 7f1fa35cd740 20 client.7143 trim_cache size 0 max 16384 2024-06-10T00:20:38.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.210+0000 7f1fa35cd740 1 Processor -- start 2024-06-10T00:20:38.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.210+0000 7f1fa35cd740 1 -- start start 2024-06-10T00:20:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.210+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.210+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 0x55b0cb3066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.210+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2df660 0x55b0cb306bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.210+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981fc180 con 0x55b0cb2df660 2024-06-10T00:20:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.210+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981fb4c0 con 0x55b0cb2d6250 2024-06-10T00:20:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.210+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f981fbb10 con 0x55b0cb2c3700 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2df660 0x55b0cb306bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2df660 0x55b0cb306bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54536/0 (socket says 172.21.15.79:54536) 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 -- 172.21.15.79:0/4208119359 learned_addr learned my addr 172.21.15.79:0/4208119359 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 0x55b0cb3066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 -- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 msgr2=0x55b0cb2bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 -- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 msgr2=0x55b0cb3066b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 0x55b0cb3066b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 -- 172.21.15.79:0/4208119359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cb2bf790 con 0x55b0cb2df660 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 0x55b0cb3066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f9ed80640 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2df660 0x55b0cb306bf0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f1f9002a920 tx=0x7f1f9003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136ff3e8682cd04c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f7b7fe640 1 -- 172.21.15.79:0/4208119359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90052070 con 0x55b0cb2df660 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f7b7fe640 1 -- 172.21.15.79:0/4208119359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f90036040 con 0x55b0cb2df660 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.211+0000 7f1f7b7fe640 1 -- 172.21.15.79:0/4208119359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90005020 con 0x55b0cb2df660 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4208119359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2df660 msgr2=0x55b0cb306bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2df660 0x55b0cb306bf0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f1f9002a920 tx=0x7f1f9003b000 comp rx=0 tx=0).stop 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4208119359 shutdown_connections 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2df660 0x55b0cb306bf0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 0x55b0cb3066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/4208119359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2c3700 0x55b0cb2bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4208119359 >> 172.21.15.79:0/4208119359 conn(0x55b0cb293960 msgr2=0x55b0cb28f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4208119359 shutdown_connections 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 -- 172.21.15.79:0/4208119359 wait complete. 2024-06-10T00:20:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 -- start start 2024-06-10T00:20:38.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.212+0000 7f1fa35cd740 1 Processor -- start 2024-06-10T00:20:38.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2c3700 0x55b0cb2e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1fa35cd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 0x55b0cb2dc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b0cb2c5e70 con 0x55b0cb2c3700 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b0cb2c43f0 con 0x55b0cb2d6250 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1fa35cd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b0cb2d5780 con 0x55b0cb2df660 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1fa35cd740 10 client.0 _ll_register_callbacks cb 0x7f1f840043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1f9e57f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2c3700 0x55b0cb2e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1f9e57f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2c3700 0x55b0cb2e1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54542/0 (socket says 172.21.15.79:54542) 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.213+0000 7f1f9e57f640 1 -- 172.21.15.79:0/188485750 learned_addr learned my addr 172.21.15.79:0/188485750 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f9e57f640 1 -- 172.21.15.79:0/188485750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 msgr2=0x55b0cb2dc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 0x55b0cb2dc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f9e57f640 1 -- 172.21.15.79:0/188485750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 msgr2=0x55b0cb2c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f9e57f640 1 -- 172.21.15.79:0/188485750 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0cb2de4e0 con 0x55b0cb2c3700 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f9e57f640 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2c3700 0x55b0cb2e1a20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1f94007030 tx=0x7f1f980cc920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdc8fd0935cfb88 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f797fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f797fa640 1 -- 172.21.15.79:0/188485750 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94031060 con 0x55b0cb2c3700 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f797fa640 1 -- 172.21.15.79:0/188485750 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f1f940228d0 con 0x55b0cb2c3700 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 1 -- 172.21.15.79:0/188485750 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f90036040 con 0x55b0cb2c3700 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f797fa640 1 -- 172.21.15.79:0/188485750 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1f94037050 con 0x55b0cb2c3700 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 10 client.7149 fetch_fsmap learned FSMap version 55 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 1 -- 172.21.15.79:0/188485750 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55b0cb298ad0 con 0x55b0cb2c3700 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f797fa640 1 -- 172.21.15.79:0/188485750 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f90036040 con 0x55b0cb2c3700 2024-06-10T00:20:38.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f797fa640 1 -- 172.21.15.79:0/188485750 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f1f9403a020 con 0x55b0cb2c3700 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 10 client.7149 fetch_fsmap finished waiting for FSMap version 55 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 10 client.7149 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 20 client.7149 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55b0cb297170 0x55b0cb297550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 4 client.7149 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1fa35cd740 1 -- 172.21.15.79:0/188485750 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "status"}) -- 0x55b0cb2041c0 con 0x55b0cb297170 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.214+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55b0cb297170 0x55b0cb297550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1f797fa640 10 client.7149 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1f9dd7e640 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55b0cb297170 0x55b0cb297550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3036ac9dea5f77 server_cookie=30721379e0f1c442 in_seq=0 out_seq=0 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1f797fa640 1 -- 172.21.15.79:0/188485750 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55b0cb2041c0 con 0x55b0cb297170 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1f797fa640 10 client.7149 handle_command_reply: tid=0 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 client.7149 shutdown 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 -- 172.21.15.79:0/188485750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2c3700 msgr2=0x55b0cb2e1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2c3700 0x55b0cb2e1a20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1f94007030 tx=0x7f1f980cc920 comp rx=0 tx=0).stop 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 -- 172.21.15.79:0/188485750 shutdown_connections 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55b0cb297170 0x55b0cb297550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b0cb2df660 0x55b0cb2dc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0cb2d6250 0x55b0cb2c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 --2- 172.21.15.79:0/188485750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0cb2c3700 0x55b0cb2e1a20 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1f797fa640 0 client.7149 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 -- 172.21.15.79:0/188485750 >> 172.21.15.79:0/188485750 conn(0x55b0cb293960 msgr2=0x55b0cb292970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 -- 172.21.15.79:0/188485750 shutdown_connections 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 1 -- 172.21.15.79:0/188485750 wait complete. 2024-06-10T00:20:38.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.215+0000 7f1fa35cd740 20 client.7149 trim_cache size 0 max 16384 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6885, 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3905927560000002, 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 55, 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 89, 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 89, 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 17.73895778 2024-06-10T00:20:38.223 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:38.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 -- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1f7c06be30 msgr2=0x7f1f7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1f940014f0 tx=0x7f1f94009040 comp rx=0 tx=0).stop 2024-06-10T00:20:38.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 -- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9815f600 msgr2=0x7f1f98153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9815f600 0x7f1f98153bf0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b820 tx=0x7f1f8800bce0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 -- 172.21.15.79:0/662790912 shutdown_connections 2024-06-10T00:20:38.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f98154130 0x7f1f981545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9815f600 0x7f1f98153bf0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 --2- 172.21.15.79:0/662790912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f840051c0 0x7f1f9815f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 -- 172.21.15.79:0/662790912 >> 172.21.15.79:0/662790912 conn(0x7f1f980b19f0 msgr2=0x7f1f980ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:38.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 -- 172.21.15.79:0/662790912 shutdown_connections 2024-06-10T00:20:38.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.216+0000 7f1fa07e3640 1 -- 172.21.15.79:0/662790912 wait complete. 2024-06-10T00:20:38.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:20:38.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.325+0000 7f7d51238640 1 Processor -- start 2024-06-10T00:20:38.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.325+0000 7f7d51238640 1 -- start start 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d51238640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d4c0cc6d0 0x7f7d4c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d51238640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d4c072110 0x7f7d4c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d51238640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d4c0ccff0 con 0x7f7d4c071c60 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d51238640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4c072820 con 0x7f7d4c072110 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d51238640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4c072b00 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d4b59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d4c072110 0x7f7d4c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d4b59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d4c072110 0x7f7d4c0b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54554/0 (socket says 172.21.15.79:54554) 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d4b59e640 1 -- 172.21.15.79:0/1770912839 learned_addr learned my addr 172.21.15.79:0/1770912839 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d4ad9d640 1 --2- 172.21.15.79:0/1770912839 >> v2:172.21.15.117:3300/0 conn(0x7f7d4c0cc6d0 0x7f7d4c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d4b59e640 1 -- 172.21.15.79:0/1770912839 >> v2:172.21.15.117:3300/0 conn(0x7f7d4c0cc6d0 msgr2=0x7f7d4c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d4b59e640 1 --2- 172.21.15.79:0/1770912839 >> v2:172.21.15.117:3300/0 conn(0x7f7d4c0cc6d0 0x7f7d4c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d4b59e640 1 -- 172.21.15.79:0/1770912839 >> v1:172.21.15.117:6789/0 conn(0x7f7d4c071c60 legacy=0x7f7d4c0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:38.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.326+0000 7f7d4b59e640 1 -- 172.21.15.79:0/1770912839 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c072de0 con 0x7f7d4c072110 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.327+0000 7f7d4b59e640 1 --2- 172.21.15.79:0/1770912839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c072110 0x7f7d4c0b3dd0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c09e090 tx=0x7f7d4402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7d5e65e38de78c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.327+0000 7f7d4a59c640 1 -- 172.21.15.79:0/1770912839 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44036070 con 0x7f7d4c072110 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.327+0000 7f7d4a59c640 1 -- 172.21.15.79:0/1770912839 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d44031600 con 0x7f7d4c072110 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.327+0000 7f7d4a59c640 1 -- 172.21.15.79:0/1770912839 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440319d0 con 0x7f7d4c072110 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.327+0000 7f7d51238640 1 -- 172.21.15.79:0/1770912839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c072110 msgr2=0x7f7d4c0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.327+0000 7f7d51238640 1 --2- 172.21.15.79:0/1770912839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c072110 0x7f7d4c0b3dd0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c09e090 tx=0x7f7d4402a6f0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.328+0000 7f7d51238640 1 -- 172.21.15.79:0/1770912839 shutdown_connections 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.328+0000 7f7d51238640 1 --2- 172.21.15.79:0/1770912839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c072110 0x7f7d4c0b3dd0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.328+0000 7f7d51238640 1 --2- 172.21.15.79:0/1770912839 >> v2:172.21.15.117:3300/0 conn(0x7f7d4c0cc6d0 0x7f7d4c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.328+0000 7f7d51238640 1 -- 172.21.15.79:0/1770912839 >> 172.21.15.79:0/1770912839 conn(0x7f7d4c0b19f0 msgr2=0x7f7d4c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:38.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.328+0000 7f7d51238640 1 -- 172.21.15.79:0/1770912839 shutdown_connections 2024-06-10T00:20:38.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.328+0000 7f7d51238640 1 -- 172.21.15.79:0/1770912839 wait complete. 2024-06-10T00:20:38.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.329+0000 7f7d51238640 1 Processor -- start 2024-06-10T00:20:38.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.329+0000 7f7d51238640 1 -- start start 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d51238640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d4c071c60 0x7f7d4c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d51238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4c072110 0x7f7d4c155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d51238640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c0cc6d0 0x7f7d4c1500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d51238640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c15c890 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d51238640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c072540 con 0x7f7d4c071c60 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d51238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4c159f60 con 0x7f7d4c072110 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c0cc6d0 0x7f7d4c1500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c0cc6d0 0x7f7d4c1500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54566/0 (socket says 172.21.15.79:54566) 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 -- 172.21.15.79:0/1297293230 learned_addr learned my addr 172.21.15.79:0/1297293230 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:38.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 -- 172.21.15.79:0/1297293230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4c072110 msgr2=0x7f7d4c155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4c072110 0x7f7d4c155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 -- 172.21.15.79:0/1297293230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d4c071c60 msgr2=0x7f7d4c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d4c071c60 0x7f7d4c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 -- 172.21.15.79:0/1297293230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c15bcc0 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d4b59e640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c0cc6d0 0x7f7d4c1500e0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009f40 tx=0x7f7d44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d437fe640 1 -- 172.21.15.79:0/1297293230 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44036050 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d437fe640 1 -- 172.21.15.79:0/1297293230 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d44042070 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4c15bfa0 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d437fe640 1 -- 172.21.15.79:0/1297293230 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44009510 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.330+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4c15c560 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.331+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c068430 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.332+0000 7f7d437fe640 1 -- 172.21.15.79:0/1297293230 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d44007bd0 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.332+0000 7f7d437fe640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.332+0000 7f7d437fe640 1 -- 172.21.15.79:0/1297293230 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f7d440abe50 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.332+0000 7f7d4ad9d640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:38.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.333+0000 7f7d4ad9d640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0098f0 tx=0x7f7d3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:38.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.337+0000 7f7d437fe640 1 -- 172.21.15.79:0/1297293230 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7d4403a360 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.546+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7d4c068ad0 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.546+0000 7f7d437fe640 1 -- 172.21.15.79:0/1297293230 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) ==== 53+0+73 (secure 0 0 0) 0x7f7d4407a6b0 con 0x7f7d4c0cc6d0 2024-06-10T00:20:38.546 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:20:38.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7d2c06be30 msgr2=0x7f7d2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0098f0 tx=0x7f7d3c008040 comp rx=0 tx=0).stop 2024-06-10T00:20:38.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c0cc6d0 msgr2=0x7f7d4c1500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:38.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c0cc6d0 0x7f7d4c1500e0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009f40 tx=0x7f7d44004a40 comp rx=0 tx=0).stop 2024-06-10T00:20:38.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 shutdown_connections 2024-06-10T00:20:38.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d4c0cc6d0 0x7f7d4c1500e0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4c072110 0x7f7d4c155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 --2- 172.21.15.79:0/1297293230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d4c071c60 0x7f7d4c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 >> 172.21.15.79:0/1297293230 conn(0x7f7d4c0b19f0 msgr2=0x7f7d4c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 shutdown_connections 2024-06-10T00:20:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38.548+0000 7f7d51238640 1 -- 172.21.15.79:0/1297293230 wait complete. 2024-06-10T00:20:38.558 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:20:38.558 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:20:38.558 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:20:38.558 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:20:38.559 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:38.559 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:20:38.559 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:20:38.559 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:20:38.559 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:38.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:38.559 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42406sec preferred_lft 42406sec 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:20:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:20:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:20:38.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:38.578 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:20:38.639 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:20:38.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:38.640 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:20:38.696 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:20:38.696 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:20:38.697 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:20:38.697 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:20:38.697 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:20:38.697 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:20:38.697 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:20:38.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:20:38.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:20:38.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:20:38.697 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:20:38.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:20:38.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:20:38.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:38.822 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:20:38.837 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:20:38.838 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:20:38.838 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:38.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:38.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:20:38.903 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:20:38.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:20:38.903 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:38.959 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:20:38.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:20:38.959 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:39.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:20:39.080 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:20:39.136 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:20:39.136 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:20:39.136 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:20:39.136 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:20:39.136 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:20:39.136 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:20:39.136 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:20:39.136 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:20:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:39.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:39.139 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:20:39.194 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:20:39.194 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:20:39.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:20:39.260 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:20:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:20:39.317 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:20:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:20:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:20:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:20:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:20:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:20:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:20:39.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:39.319 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:20:39.319 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:20:39.318+0000 7fdca7f1e480 -1 init, newargv = 0x55c281653830 newargc=15 2024-06-10T00:20:39.319 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[65776]: starting ceph client 2024-06-10T00:20:39.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[65776]: starting fuse 2024-06-10T00:20:39.335 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:20:39.335 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:20:39.336 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:20:39.337 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:20:39.452 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.65776.asok 2024-06-10T00:20:39.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:20:39.463 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.65776.asok 2024-06-10T00:20:39.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:39.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.65776.asok status 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "65776", 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:20:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7161, 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 7161 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1999497181 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:20:39.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1999497181 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.7161 192.168.0.1:0/1999497181", 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/1999497181", 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 55, 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 89, 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:20:39.600 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:39.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:39.606 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:20:39.606 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:39.622 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:20:39.622 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:39.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:39.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:20:39.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:39.687 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-06-10T00:20:39.745 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:20:39.746+0000 7fc6fb17c640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-06-10T00:20:39.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:20:39.747 INFO:teuthology.orchestra.run.smithi079.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-06-10T00:20:39.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:39.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-06-10T00:20:39.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.892+0000 7f07ede4c640 1 Processor -- start 2024-06-10T00:20:39.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.892+0000 7f07ede4c640 1 -- start start 2024-06-10T00:20:39.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07ede4c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07e8155590 0x7f07e815b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07ede4c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 0x7f07e80cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07ede4c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07e80cf1a0 0x7f07e815eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07ede4c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f07e80acd40 con 0x7f07e8155590 2024-06-10T00:20:39.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07ede4c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f07e815bfe0 con 0x7f07e80cf1a0 2024-06-10T00:20:39.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07ede4c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07e815c2c0 con 0x7f07e815b9a0 2024-06-10T00:20:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07e77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07e8155590 0x7f07e815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07e77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07e8155590 0x7f07e815b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54582/0 (socket says 172.21.15.79:54582) 2024-06-10T00:20:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.893+0000 7f07e77fe640 1 -- 172.21.15.79:0/1835143842 learned_addr learned my addr 172.21.15.79:0/1835143842 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e77fe640 1 -- 172.21.15.79:0/1835143842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 msgr2=0x7f07e80cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e77fe640 1 --2- 172.21.15.79:0/1835143842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 0x7f07e80cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e77fe640 1 -- 172.21.15.79:0/1835143842 >> v2:172.21.15.117:3300/0 conn(0x7f07e80cf1a0 msgr2=0x7f07e815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e77fe640 1 --2- 172.21.15.79:0/1835143842 >> v2:172.21.15.117:3300/0 conn(0x7f07e80cf1a0 0x7f07e815eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e77fe640 1 -- 172.21.15.79:0/1835143842 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e80ad000 con 0x7f07e8155590 2024-06-10T00:20:39.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e77fe640 1 --2- 172.21.15.79:0/1835143842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e8155590 0x7f07e815b460 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f07e80af4f0 tx=0x7f07d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb95f8ab579d67dd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:39.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e67fc640 1 -- 172.21.15.79:0/1835143842 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8037070 con 0x7f07e8155590 2024-06-10T00:20:39.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e67fc640 1 -- 172.21.15.79:0/1835143842 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d8032440 con 0x7f07e8155590 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.894+0000 7f07e67fc640 1 -- 172.21.15.79:0/1835143842 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8032810 con 0x7f07e8155590 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 -- 172.21.15.79:0/1835143842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e8155590 msgr2=0x7f07e815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 --2- 172.21.15.79:0/1835143842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e8155590 0x7f07e815b460 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f07e80af4f0 tx=0x7f07d802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 -- 172.21.15.79:0/1835143842 shutdown_connections 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 --2- 172.21.15.79:0/1835143842 >> v2:172.21.15.117:3300/0 conn(0x7f07e80cf1a0 0x7f07e815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 --2- 172.21.15.79:0/1835143842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 0x7f07e80cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 --2- 172.21.15.79:0/1835143842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e8155590 0x7f07e815b460 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 -- 172.21.15.79:0/1835143842 >> 172.21.15.79:0/1835143842 conn(0x7f07e80b1980 msgr2=0x7f07e80b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 -- 172.21.15.79:0/1835143842 shutdown_connections 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.895+0000 7f07ede4c640 1 -- 172.21.15.79:0/1835143842 wait complete. 2024-06-10T00:20:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.896+0000 7f07ede4c640 1 Processor -- start 2024-06-10T00:20:39.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.896+0000 7f07ede4c640 1 -- start start 2024-06-10T00:20:39.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07ede4c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e80cf1a0 0x7f07e809b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07ede4c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e8155590 0x7f07e8151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07ede4c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 0x7f07e81e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07ede4c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07e815efe0 con 0x7f07e80cf1a0 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07ede4c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07e80b26d0 con 0x7f07e8155590 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07ede4c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07e815f160 con 0x7f07e815b9a0 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e80cf1a0 0x7f07e809b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e80cf1a0 0x7f07e809b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54598/0 (socket says 172.21.15.79:54598) 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e77fe640 1 -- 172.21.15.79:0/3596093054 learned_addr learned my addr 172.21.15.79:0/3596093054 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e77fe640 1 -- 172.21.15.79:0/3596093054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 msgr2=0x7f07e81e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e8155590 0x7f07e8151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e7fff640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 0x7f07e81e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e77fe640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 0x7f07e81e4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e77fe640 1 -- 172.21.15.79:0/3596093054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e8155590 msgr2=0x7f07e8151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e77fe640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e8155590 0x7f07e8151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.897+0000 7f07e77fe640 1 -- 172.21.15.79:0/3596093054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e809cb80 con 0x7f07e80cf1a0 2024-06-10T00:20:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.898+0000 7f07e77fe640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e80cf1a0 0x7f07e809b3e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.898+0000 7f07cffff640 1 -- 172.21.15.79:0/3596093054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8041070 con 0x7f07e80cf1a0 2024-06-10T00:20:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.898+0000 7f07cffff640 1 -- 172.21.15.79:0/3596093054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d803c870 con 0x7f07e80cf1a0 2024-06-10T00:20:39.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.898+0000 7f07ede4c640 1 -- 172.21.15.79:0/3596093054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e809bae0 con 0x7f07e80cf1a0 2024-06-10T00:20:39.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.898+0000 7f07cffff640 1 -- 172.21.15.79:0/3596093054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8037040 con 0x7f07e80cf1a0 2024-06-10T00:20:39.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.898+0000 7f07ede4c640 1 -- 172.21.15.79:0/3596093054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e809c0a0 con 0x7f07e80cf1a0 2024-06-10T00:20:39.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.899+0000 7f07cffff640 1 -- 172.21.15.79:0/3596093054 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07d8044070 con 0x7f07e80cf1a0 2024-06-10T00:20:39.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.900+0000 7f07cffff640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07d406be30 0x7f07d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.900+0000 7f07cffff640 1 -- 172.21.15.79:0/3596093054 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f07d80abda0 con 0x7f07e80cf1a0 2024-06-10T00:20:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.900+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07d406be30 0x7f07d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.900+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07d406be30 0x7f07d406e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f07e81540b0 tx=0x7f07dc0072f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.901+0000 7f07f0c31740 1 Processor -- start 2024-06-10T00:20:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.901+0000 7f07f0c31740 1 -- start start 2024-06-10T00:20:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.901+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e69c90 0x5559a9e6da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.901+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e419a0 0x5559a9e6a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.901+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e6ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.901+0000 7f07f0c31740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5559a9e09cd0 con 0x5559a9e419a0 2024-06-10T00:20:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.901+0000 7f07f0c31740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5559a9da5ab0 con 0x5559a9e69c90 2024-06-10T00:20:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.901+0000 7f07f0c31740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5559a9d43c30 con 0x5559a9e6a5b0 2024-06-10T00:20:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e419a0 0x5559a9e6a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e419a0 0x5559a9e6a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54608/0 (socket says 172.21.15.79:54608) 2024-06-10T00:20:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 -- 172.21.15.79:0/2616301924 learned_addr learned my addr 172.21.15.79:0/2616301924 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e77fe640 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e69c90 0x5559a9e6da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e7fff640 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e6ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 -- 172.21.15.79:0/2616301924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 msgr2=0x5559a9e6ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e6ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 -- 172.21.15.79:0/2616301924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e69c90 msgr2=0x5559a9e6da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e69c90 0x5559a9e6da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 -- 172.21.15.79:0/2616301924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a9d6c970 con 0x5559a9e419a0 2024-06-10T00:20:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e419a0 0x5559a9e6a070 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00cf90 tx=0x7f07dc00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300b72b53f027be6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07cd7fa640 1 -- 172.21.15.79:0/2616301924 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc023070 con 0x5559a9e419a0 2024-06-10T00:20:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07cd7fa640 1 -- 172.21.15.79:0/2616301924 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc011820 con 0x5559a9e419a0 2024-06-10T00:20:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.902+0000 7f07cd7fa640 1 -- 172.21.15.79:0/2616301924 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc011bf0 con 0x5559a9e419a0 2024-06-10T00:20:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 -- 172.21.15.79:0/2616301924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e419a0 msgr2=0x5559a9e6a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e419a0 0x5559a9e6a070 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00cf90 tx=0x7f07dc00f000 comp rx=0 tx=0).stop 2024-06-10T00:20:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 -- 172.21.15.79:0/2616301924 shutdown_connections 2024-06-10T00:20:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e6ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e419a0 0x5559a9e6a070 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2616301924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e69c90 0x5559a9e6da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 -- 172.21.15.79:0/2616301924 >> 172.21.15.79:0/2616301924 conn(0x5559a9e3f5a0 msgr2=0x5559a9e87e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 -- 172.21.15.79:0/2616301924 shutdown_connections 2024-06-10T00:20:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 -- 172.21.15.79:0/2616301924 wait complete. 2024-06-10T00:20:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.903+0000 7f07f0c31740 1 -- start start 2024-06-10T00:20:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07f0c31740 1 Processor -- start 2024-06-10T00:20:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e69c90 0x5559a9e87dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e89740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 0x5559a9e62200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07f0c31740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5559a9d2edd0 con 0x5559a9e69c90 2024-06-10T00:20:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07f0c31740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5559a9da1a70 con 0x5559a9e89c80 2024-06-10T00:20:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07f0c31740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5559a9e3d8f0 con 0x5559a9e6a5b0 2024-06-10T00:20:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07f0c31740 10 client.0 _ll_register_callbacks cb 0x5559a9d60a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e69c90 0x5559a9e87dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e69c90 0x5559a9e87dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54618/0 (socket says 172.21.15.79:54618) 2024-06-10T00:20:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.904+0000 7f07e77fe640 1 -- 172.21.15.79:0/2574108674 learned_addr learned my addr 172.21.15.79:0/2574108674 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e89740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e7fff640 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 0x5559a9e62200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e77fe640 1 -- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 msgr2=0x5559a9e89740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e77fe640 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e89740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e77fe640 1 -- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 msgr2=0x5559a9e62200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e77fe640 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 0x5559a9e62200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e77fe640 1 -- 172.21.15.79:0/2574108674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a9b857b0 con 0x5559a9e69c90 2024-06-10T00:20:39.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e89740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:39.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e77fe640 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e69c90 0x5559a9e87dc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f07d80aa180 tx=0x7f07d807a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312f0b534a65b663 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:39.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:39.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07c67fc640 1 -- 172.21.15.79:0/2574108674 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d804b040 con 0x5559a9e69c90 2024-06-10T00:20:39.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07c67fc640 1 -- 172.21.15.79:0/2574108674 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f07d8082770 con 0x5559a9e69c90 2024-06-10T00:20:39.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 1 -- 172.21.15.79:0/2574108674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07dc011820 con 0x5559a9e69c90 2024-06-10T00:20:39.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07c67fc640 1 -- 172.21.15.79:0/2574108674 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f07d80783e0 con 0x5559a9e69c90 2024-06-10T00:20:39.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 10 client.7173 fetch_fsmap learned FSMap version 55 2024-06-10T00:20:39.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 1 -- 172.21.15.79:0/2574108674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5559a9be5f40 con 0x5559a9e69c90 2024-06-10T00:20:39.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07c67fc640 1 -- 172.21.15.79:0/2574108674 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc011820 con 0x5559a9e69c90 2024-06-10T00:20:39.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07c67fc640 1 -- 172.21.15.79:0/2574108674 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f07d8079470 con 0x5559a9e69c90 2024-06-10T00:20:39.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 10 client.7173 fetch_fsmap finished waiting for FSMap version 55 2024-06-10T00:20:39.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 10 client.7173 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:20:39.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 20 client.7173 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:39.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5559a9e62c10 0x5559a9e603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 4 client.7173 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:20:39.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07f0c31740 1 -- 172.21.15.79:0/2574108674 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559a9db31e0 con 0x5559a9e62c10 2024-06-10T00:20:39.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.905+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5559a9e62c10 0x5559a9e603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.906+0000 7f07c67fc640 10 client.7173 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:39.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.906+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5559a9e62c10 0x5559a9e603e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f2e0b88f338cf03 server_cookie=3eb9dae2bcbc3242 in_seq=0 out_seq=0 2024-06-10T00:20:39.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.906+0000 7f07c67fc640 1 -- 172.21.15.79:0/2574108674 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5559a9db31e0 con 0x5559a9e62c10 2024-06-10T00:20:39.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.906+0000 7f07c67fc640 10 client.7173 handle_command_reply: tid=0 2024-06-10T00:20:39.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.906+0000 7f07f0c31740 1 client.7173 shutdown 2024-06-10T00:20:39.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.906+0000 7f07f0c31740 1 -- 172.21.15.79:0/2574108674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e69c90 msgr2=0x5559a9e87dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.906+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e69c90 0x5559a9e87dc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f07d80aa180 tx=0x7f07d807a130 comp rx=0 tx=0).stop 2024-06-10T00:20:39.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 1 -- 172.21.15.79:0/2574108674 shutdown_connections 2024-06-10T00:20:39.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5559a9e62c10 0x5559a9e603e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 0x5559a9e62200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e6a5b0 0x5559a9e89740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07c67fc640 0 client.7173 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:39.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2574108674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e69c90 0x5559a9e87dc0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 1 -- 172.21.15.79:0/2574108674 >> 172.21.15.79:0/2574108674 conn(0x5559a9e419a0 msgr2=0x5559a9e43090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:39.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 1 -- 172.21.15.79:0/2574108674 shutdown_connections 2024-06-10T00:20:39.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 1 -- 172.21.15.79:0/2574108674 wait complete. 2024-06-10T00:20:39.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.907+0000 7f07f0c31740 20 client.7173 trim_cache size 0 max 16384 2024-06-10T00:20:39.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.925+0000 7f07f0c31740 1 Processor -- start 2024-06-10T00:20:39.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.925+0000 7f07f0c31740 1 -- start start 2024-06-10T00:20:39.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9e40b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e6a5b0 0x5559a9e89650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 0x5559a9e3c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07f0c31740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81fcb50 con 0x5559a9e6a5b0 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07f0c31740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07e806e3a0 con 0x5559a9e89c80 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07f0c31740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07e80719f0 con 0x5559a9e69c90 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e6a5b0 0x5559a9e89650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e6a5b0 0x5559a9e89650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54632/0 (socket says 172.21.15.79:54632) 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 -- 172.21.15.79:0/1537563468 learned_addr learned my addr 172.21.15.79:0/1537563468 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e7fff640 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 0x5559a9e3c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e77fe640 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9e40b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 -- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 msgr2=0x5559a9e40b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9e40b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 -- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 msgr2=0x5559a9e3c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 0x5559a9e3c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 -- 172.21.15.79:0/1537563468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a9a790a0 con 0x5559a9e6a5b0 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e77fe640 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9e40b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e6a5b0 0x5559a9e89650 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f07dc013cc0 tx=0x7f07dc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f9093393b469ca server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07ccff9640 1 -- 172.21.15.79:0/1537563468 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc023040 con 0x5559a9e6a5b0 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07ccff9640 1 -- 172.21.15.79:0/1537563468 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc011a50 con 0x5559a9e6a5b0 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.926+0000 7f07ccff9640 1 -- 172.21.15.79:0/1537563468 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc011e00 con 0x5559a9e6a5b0 2024-06-10T00:20:39.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 -- 172.21.15.79:0/1537563468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e6a5b0 msgr2=0x5559a9e89650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e6a5b0 0x5559a9e89650 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f07dc013cc0 tx=0x7f07dc011000 comp rx=0 tx=0).stop 2024-06-10T00:20:39.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 -- 172.21.15.79:0/1537563468 shutdown_connections 2024-06-10T00:20:39.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e89c80 0x5559a9e3c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e6a5b0 0x5559a9e89650 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 --2- 172.21.15.79:0/1537563468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9e40b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 -- 172.21.15.79:0/1537563468 >> 172.21.15.79:0/1537563468 conn(0x5559a9e419a0 msgr2=0x5559a9e633d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:39.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 -- 172.21.15.79:0/1537563468 shutdown_connections 2024-06-10T00:20:39.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.927+0000 7f07f0c31740 1 -- 172.21.15.79:0/1537563468 wait complete. 2024-06-10T00:20:39.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.928+0000 7f07f0c31740 1 -- start start 2024-06-10T00:20:39.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.928+0000 7f07f0c31740 1 Processor -- start 2024-06-10T00:20:39.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.928+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9f0a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.928+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e6a5b0 0x5559a9e64cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07f0c31740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e89c80 0x5559a9e9e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07f0c31740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5559a9e38ff0 con 0x5559a9e89c80 2024-06-10T00:20:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07f0c31740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8072040 con 0x5559a9e6a5b0 2024-06-10T00:20:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07f0c31740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5559a9e3d570 con 0x5559a9e69c90 2024-06-10T00:20:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07f0c31740 10 client.0 _ll_register_callbacks cb 0x7f07d807a7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e89c80 0x5559a9e9e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e89c80 0x5559a9e9e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54638/0 (socket says 172.21.15.79:54638) 2024-06-10T00:20:39.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 -- 172.21.15.79:0/2409996386 learned_addr learned my addr 172.21.15.79:0/2409996386 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:39.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e77fe640 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9f0a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e6ffd640 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e6a5b0 0x5559a9e64cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 -- 172.21.15.79:0/2409996386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 msgr2=0x5559a9f0a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9f0a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 -- 172.21.15.79:0/2409996386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e6a5b0 msgr2=0x5559a9e64cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:39.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e6a5b0 0x5559a9e64cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 -- 172.21.15.79:0/2409996386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a9e87660 con 0x5559a9e89c80 2024-06-10T00:20:39.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07e7fff640 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e89c80 0x5559a9e9e4a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x5559a9e44bc0 tx=0x7f07e0012760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47eda7a2677becda server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:39.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:39.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07c67fc640 1 -- 172.21.15.79:0/2409996386 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e001b070 con 0x5559a9e89c80 2024-06-10T00:20:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07c67fc640 1 -- 172.21.15.79:0/2409996386 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f07e0015660 con 0x5559a9e89c80 2024-06-10T00:20:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07f0c31740 1 -- 172.21.15.79:0/2409996386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07dc011a50 con 0x5559a9e89c80 2024-06-10T00:20:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07c67fc640 1 -- 172.21.15.79:0/2409996386 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f07e0025050 con 0x5559a9e89c80 2024-06-10T00:20:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07f0c31740 10 client.7179 fetch_fsmap learned FSMap version 55 2024-06-10T00:20:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.929+0000 7f07f0c31740 1 -- 172.21.15.79:0/2409996386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5559a9e65210 con 0x5559a9e89c80 2024-06-10T00:20:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07c67fc640 1 -- 172.21.15.79:0/2409996386 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc011a50 con 0x5559a9e89c80 2024-06-10T00:20:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07c67fc640 1 -- 172.21.15.79:0/2409996386 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f07e0028020 con 0x5559a9e89c80 2024-06-10T00:20:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07f0c31740 10 client.7179 fetch_fsmap finished waiting for FSMap version 55 2024-06-10T00:20:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07f0c31740 10 client.7179 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:20:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07f0c31740 20 client.7179 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5559a9e9e9e0 0x5559a9ea5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07f0c31740 4 client.7179 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-06-10T00:20:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07f0c31740 1 -- 172.21.15.79:0/2409996386 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) -- 0x5559a9e641e0 con 0x5559a9e9e9e0 2024-06-10T00:20:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07e77fe640 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5559a9e9e9e0 0x5559a9ea5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07c67fc640 10 client.7179 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.930+0000 7f07e77fe640 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5559a9e9e9e0 0x5559a9ea5820 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0d53f223d0bf98 server_cookie=f2fd21d2c57e8b60 in_seq=0 out_seq=0 2024-06-10T00:20:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07c67fc640 1 -- 172.21.15.79:0/2409996386 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5559a9e641e0 con 0x5559a9e9e9e0 2024-06-10T00:20:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07c67fc640 10 client.7179 handle_command_reply: tid=0 2024-06-10T00:20:39.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 client.7179 shutdown 2024-06-10T00:20:39.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 -- 172.21.15.79:0/2409996386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e89c80 msgr2=0x5559a9e9e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e89c80 0x5559a9e9e4a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x5559a9e44bc0 tx=0x7f07e0012760 comp rx=0 tx=0).stop 2024-06-10T00:20:39.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 -- 172.21.15.79:0/2409996386 shutdown_connections 2024-06-10T00:20:39.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5559a9e9e9e0 0x5559a9ea5820 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5559a9e89c80 0x5559a9e9e4a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559a9e6a5b0 0x5559a9e64cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 --2- 172.21.15.79:0/2409996386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5559a9e69c90 0x5559a9f0a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07c67fc640 0 client.7179 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:39.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 -- 172.21.15.79:0/2409996386 >> 172.21.15.79:0/2409996386 conn(0x5559a9e419a0 msgr2=0x5559a9e410e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:39.949 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:20:39.931+0000 7fc6fb17c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 ap=1 f(v0 m2024-06-10T00:20:31.012057+0000 1=1+0) n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x56011f4e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-06-10T00:20:31.012057+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-06-10T00:20:39.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 -- 172.21.15.79:0/2409996386 shutdown_connections 2024-06-10T00:20:39.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 1 -- 172.21.15.79:0/2409996386 wait complete. 2024-06-10T00:20:39.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07f0c31740 20 client.7179 trim_cache size 0 max 16384 2024-06-10T00:20:39.951 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:20:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "40f19821-7e03-4795-a6ea-6eb66302fc1e", 2024-06-10T00:20:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:20:39.951 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:39.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 -- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07d406be30 msgr2=0x7f07d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07d406be30 0x7f07d406e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f07e81540b0 tx=0x7f07dc0072f0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 -- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e80cf1a0 msgr2=0x7f07e809b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:39.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e80cf1a0 0x7f07e809b3e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d80046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 -- 172.21.15.79:0/3596093054 shutdown_connections 2024-06-10T00:20:39.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07d406be30 0x7f07d406e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e815b9a0 0x7f07e81e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e8155590 0x7f07e8151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 --2- 172.21.15.79:0/3596093054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e80cf1a0 0x7f07e809b3e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:39.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.931+0000 7f07ede4c640 1 -- 172.21.15.79:0/3596093054 >> 172.21.15.79:0/3596093054 conn(0x7f07e80b1980 msgr2=0x7f07e80ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:39.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.932+0000 7f07ede4c640 1 -- 172.21.15.79:0/3596093054 shutdown_connections 2024-06-10T00:20:39.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:39.932+0000 7f07ede4c640 1 -- 172.21.15.79:0/3596093054 wait complete. 2024-06-10T00:20:39.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:20:39.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-06-10T00:20:40.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.059+0000 7fd3b3afc640 1 Processor -- start 2024-06-10T00:20:40.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.059+0000 7fd3b3afc640 1 -- start start 2024-06-10T00:20:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b3afc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3ac0b3bf0 0x7fd3ac06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b3afc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac06d500 0x7fd3ac071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b3afc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3ac155000 con 0x7fd3ac154c20 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b3afc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd3ac06dd30 con 0x7fd3ac0b3bf0 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b3afc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ac06e010 con 0x7fd3ac06d500 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b1898640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd3ac154c20 0x7fd3ac0b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56630/0 (socket says 172.21.15.79:56630) 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b1898640 1 -- 172.21.15.79:0/467985648 learned_addr learned my addr 172.21.15.79:0/467985648 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b1097640 1 --2- 172.21.15.79:0/467985648 >> v2:172.21.15.117:3300/0 conn(0x7fd3ac0b3bf0 0x7fd3ac06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b2099640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac06d500 0x7fd3ac071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124042373 0 0) 0x7fd3ac155000 con 0x7fd3ac154c20 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd398003520 con 0x7fd3ac154c20 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2534685848 0 0) 0x7fd398003520 con 0x7fd3ac154c20 2024-06-10T00:20:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac06d500 msgr2=0x7fd3ac071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac06d500 0x7fd3ac071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 >> v2:172.21.15.117:3300/0 conn(0x7fd3ac0b3bf0 msgr2=0x7fd3ac06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 --2- 172.21.15.79:0/467985648 >> v2:172.21.15.117:3300/0 conn(0x7fd3ac0b3bf0 0x7fd3ac06cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ac06e2f0 con 0x7fd3ac154c20 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fd3a8001670 con 0x7fd3ac154c20 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 >> v1:172.21.15.79:6789/0 conn(0x7fd3ac154c20 legacy=0x7fd3ac0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3980039b0 0x7fd398003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac06d500 0x7fd398004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac06dd30 con 0x7fd398004d40 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac06e010 con 0x7fd3980039b0 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd39800b9c0 con 0x7fd3ac06d500 2024-06-10T00:20:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b2099640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b1097640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac06d500 0x7fd398004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.060+0000 7fd3b1898640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3980039b0 0x7fd398003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.061+0000 7fd3b2099640 1 -- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac06d500 msgr2=0x7fd398004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.061+0000 7fd3b2099640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac06d500 0x7fd398004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.061+0000 7fd3b2099640 1 -- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3980039b0 msgr2=0x7fd398003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.061+0000 7fd3b2099640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3980039b0 0x7fd398003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.061+0000 7fd3b2099640 1 -- 172.21.15.79:0/467985648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd398003520 con 0x7fd398004d40 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.061+0000 7fd3b2099640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3980051c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009fc0 tx=0x7fd398005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca7d6880b4cf08a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.061+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4009c10 con 0x7fd398004d40 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a4036070 con 0x7fd398004d40 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b0896640 1 -- 172.21.15.79:0/467985648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4031880 con 0x7fd398004d40 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b3afc640 1 -- 172.21.15.79:0/467985648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 msgr2=0x7fd3980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b3afc640 1 --2- 172.21.15.79:0/467985648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3980051c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009fc0 tx=0x7fd398005830 comp rx=0 tx=0).stop 2024-06-10T00:20:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b2099640 1 -- 172.21.15.79:0/467985648 reap_dead start 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b3afc640 1 -- 172.21.15.79:0/467985648 shutdown_connections 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b3afc640 1 -- 172.21.15.79:0/467985648 >> 172.21.15.79:0/467985648 conn(0x7fd3ac0b1d10 msgr2=0x7fd3ac0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b3afc640 1 -- 172.21.15.79:0/467985648 shutdown_connections 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.062+0000 7fd3b3afc640 1 -- 172.21.15.79:0/467985648 wait complete. 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.063+0000 7fd3b3afc640 1 Processor -- start 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.063+0000 7fd3b3afc640 1 -- start start 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b3afc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3ac1ef360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b3afc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac1f3150 0x7fd3ac1f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b3afc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac140210 0x7fd3ac1406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b3afc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac0d0020 con 0x7fd398004d40 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b3afc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac06d9b0 con 0x7fd3ac140210 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b3afc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ac0d01a0 con 0x7fd3ac1f3150 2024-06-10T00:20:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1898640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3ac1ef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1898640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3ac1ef360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54656/0 (socket says 172.21.15.79:54656) 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1898640 1 -- 172.21.15.79:0/1634700851 learned_addr learned my addr 172.21.15.79:0/1634700851 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac1f3150 0x7fd3ac1f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b2099640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac140210 0x7fd3ac1406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1898640 1 -- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac1f3150 msgr2=0x7fd3ac1f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1898640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac1f3150 0x7fd3ac1f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1898640 1 -- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac140210 msgr2=0x7fd3ac1406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1898640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac140210 0x7fd3ac1406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b1898640 1 -- 172.21.15.79:0/1634700851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ac141fe0 con 0x7fd398004d40 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.064+0000 7fd3b2099640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac140210 0x7fd3ac1406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.065+0000 7fd3b1898640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3ac1ef360 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80073a0 tx=0x7fd3a80077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.065+0000 7fd3a27fc640 1 -- 172.21.15.79:0/1634700851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a801a070 con 0x7fd398004d40 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.065+0000 7fd3a27fc640 1 -- 172.21.15.79:0/1634700851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a800f960 con 0x7fd398004d40 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.065+0000 7fd3b3afc640 1 -- 172.21.15.79:0/1634700851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3ac140f40 con 0x7fd398004d40 2024-06-10T00:20:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.065+0000 7fd3a27fc640 1 -- 172.21.15.79:0/1634700851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800fd50 con 0x7fd398004d40 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.065+0000 7fd3b3afc640 1 -- 172.21.15.79:0/1634700851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3ac141500 con 0x7fd398004d40 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.066+0000 7fd3a27fc640 1 -- 172.21.15.79:0/1634700851 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3a801d070 con 0x7fd398004d40 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.067+0000 7fd3a27fc640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd39006bda0 0x7fd39006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.067+0000 7fd3a27fc640 1 -- 172.21.15.79:0/1634700851 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fd3a808a9c0 con 0x7fd398004d40 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.067+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd39006bda0 0x7fd39006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.067+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd39006bda0 0x7fd39006e260 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac1f4230 tx=0x7fd39c00a2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.068+0000 7fd3b6808740 1 Processor -- start 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.068+0000 7fd3b6808740 1 -- start start 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.068+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834f46120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.068+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f46660 0x55a834f46aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.068+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f70f70 0x55a834f713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.068+0000 7fd3b6808740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a834e6b7e0 con 0x55a834f46660 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.068+0000 7fd3b6808740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a834ea9e80 con 0x55a834f6de60 2024-06-10T00:20:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.068+0000 7fd3b6808740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a834e47700 con 0x55a834f70f70 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f46660 0x55a834f46aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f46660 0x55a834f46aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54662/0 (socket says 172.21.15.79:54662) 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 -- 172.21.15.79:0/1351372341 learned_addr learned my addr 172.21.15.79:0/1351372341 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 -- 172.21.15.79:0/1351372341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f70f70 msgr2=0x55a834f713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1351372341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f70f70 0x55a834f713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 -- 172.21.15.79:0/1351372341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 msgr2=0x55a834f46120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1351372341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834f46120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 -- 172.21.15.79:0/1351372341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a834e66dd0 con 0x55a834f46660 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1351372341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f46660 0x55a834f46aa0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0040f0 tx=0x7fd39c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f05e4ddfbd430d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd38f7fe640 1 -- 172.21.15.79:0/1351372341 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c00b040 con 0x55a834f46660 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd38f7fe640 1 -- 172.21.15.79:0/1351372341 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39c003d90 con 0x55a834f46660 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.069+0000 7fd38f7fe640 1 -- 172.21.15.79:0/1351372341 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c021620 con 0x55a834f46660 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 -- 172.21.15.79:0/1351372341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f46660 msgr2=0x55a834f46aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1351372341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f46660 0x55a834f46aa0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0040f0 tx=0x7fd39c017000 comp rx=0 tx=0).stop 2024-06-10T00:20:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 -- 172.21.15.79:0/1351372341 shutdown_connections 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1351372341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f70f70 0x55a834f713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1351372341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f46660 0x55a834f46aa0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1351372341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834f46120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 -- 172.21.15.79:0/1351372341 >> 172.21.15.79:0/1351372341 conn(0x55a834f43410 msgr2=0x55a834f8bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 -- 172.21.15.79:0/1351372341 shutdown_connections 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 -- 172.21.15.79:0/1351372341 wait complete. 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 -- start start 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.070+0000 7fd3b6808740 1 Processor -- start 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f6de60 0x55a834f68160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f8e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f8ede0 0x55a834f40110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b6808740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a834e32640 con 0x55a834f70f70 2024-06-10T00:20:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b6808740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a834ea5e40 con 0x55a834f8ede0 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b6808740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a834f411a0 con 0x55a834f6de60 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b6808740 10 client.0 _ll_register_callbacks cb 0x55a834e64430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b1097640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f8e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b1097640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f8e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54668/0 (socket says 172.21.15.79:54668) 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.071+0000 7fd3b1097640 1 -- 172.21.15.79:0/3849754162 learned_addr learned my addr 172.21.15.79:0/3849754162 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b2099640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f8ede0 0x55a834f40110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1898640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f6de60 0x55a834f68160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1097640 1 -- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f6de60 msgr2=0x55a834f68160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1097640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f6de60 0x55a834f68160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1097640 1 -- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f8ede0 msgr2=0x55a834f40110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1097640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f8ede0 0x55a834f40110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1097640 1 -- 172.21.15.79:0/3849754162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a834c877d0 con 0x55a834f70f70 2024-06-10T00:20:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b2099640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f8ede0 0x55a834f40110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1898640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f6de60 0x55a834f68160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1097640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f8e8a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd39c006bd0 tx=0x7fd39c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9da551c72b2e18 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd38cff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd38cff9640 1 -- 172.21.15.79:0/3849754162 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c021960 con 0x55a834f70f70 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd38cff9640 1 -- 172.21.15.79:0/3849754162 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fd39c021b00 con 0x55a834f70f70 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 1 -- 172.21.15.79:0/3849754162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd39c003d90 con 0x55a834f70f70 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd38cff9640 1 -- 172.21.15.79:0/3849754162 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fd39c03c050 con 0x55a834f70f70 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 10 client.7191 fetch_fsmap learned FSMap version 55 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 1 -- 172.21.15.79:0/3849754162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55a834bbd3f0 con 0x55a834f70f70 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd38cff9640 1 -- 172.21.15.79:0/3849754162 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39c003d90 con 0x55a834f70f70 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd38cff9640 1 -- 172.21.15.79:0/3849754162 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7fd39c03f020 con 0x55a834f70f70 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 10 client.7191 fetch_fsmap finished waiting for FSMap version 55 2024-06-10T00:20:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 10 client.7191 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 20 client.7191 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55a834fa0240 0x55a834f8d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 4 client.7191 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b6808740 1 -- 172.21.15.79:0/3849754162 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a834eb75b0 con 0x55a834fa0240 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.072+0000 7fd3b1898640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55a834fa0240 0x55a834f8d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.073+0000 7fd3b1898640 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55a834fa0240 0x55a834f8d0a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c9d5edd4d261dd server_cookie=64ad2debb8907816 in_seq=0 out_seq=0 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.073+0000 7fd38cff9640 10 client.7191 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.073+0000 7fd38cff9640 1 -- 172.21.15.79:0/3849754162 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a834eb75b0 con 0x55a834fa0240 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.073+0000 7fd38cff9640 10 client.7191 handle_command_reply: tid=0 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.073+0000 7fd3b6808740 1 client.7191 shutdown 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.073+0000 7fd3b6808740 1 -- 172.21.15.79:0/3849754162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 msgr2=0x55a834f8e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.073+0000 7fd3b6808740 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f8e8a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd39c006bd0 tx=0x7fd39c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 1 -- 172.21.15.79:0/3849754162 shutdown_connections 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55a834fa0240 0x55a834f8d0a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f8ede0 0x55a834f40110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f8e8a0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd38cff9640 0 client.7191 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 1 --2- 172.21.15.79:0/3849754162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f6de60 0x55a834f68160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 1 -- 172.21.15.79:0/3849754162 >> 172.21.15.79:0/3849754162 conn(0x55a834f46660 msgr2=0x55a834f45bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 1 -- 172.21.15.79:0/3849754162 shutdown_connections 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 1 -- 172.21.15.79:0/3849754162 wait complete. 2024-06-10T00:20:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.074+0000 7fd3b6808740 20 client.7191 trim_cache size 0 max 16384 2024-06-10T00:20:40.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b6808740 1 Processor -- start 2024-06-10T00:20:40.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b6808740 1 -- start start 2024-06-10T00:20:40.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834fb3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f70f70 0x55a834f81cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f8ede0 0x55a834f82230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b6808740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac1fd100 con 0x55a834f8ede0 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b6808740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac1fc1a0 con 0x55a834f6de60 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b6808740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ac1fb500 con 0x55a834f70f70 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b2099640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f8ede0 0x55a834f82230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b2099640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f8ede0 0x55a834f82230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54672/0 (socket says 172.21.15.79:54672) 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.092+0000 7fd3b2099640 1 -- 172.21.15.79:0/4044210332 learned_addr learned my addr 172.21.15.79:0/4044210332 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd3b2099640 1 -- 172.21.15.79:0/4044210332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f70f70 msgr2=0x55a834f81cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd3b2099640 1 --2- 172.21.15.79:0/4044210332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f70f70 0x55a834f81cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd3b2099640 1 -- 172.21.15.79:0/4044210332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 msgr2=0x55a834fb3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd3b2099640 1 --2- 172.21.15.79:0/4044210332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834fb3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd3b2099640 1 -- 172.21.15.79:0/4044210332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a834f40480 con 0x55a834f8ede0 2024-06-10T00:20:40.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd3b2099640 1 --2- 172.21.15.79:0/4044210332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f8ede0 0x55a834f82230 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4033040 tx=0x7fd3a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd5f1a06e7dbeac server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:40.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd38effd640 1 -- 172.21.15.79:0/4044210332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4003c50 con 0x55a834f8ede0 2024-06-10T00:20:40.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd38effd640 1 -- 172.21.15.79:0/4044210332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a4036070 con 0x55a834f8ede0 2024-06-10T00:20:40.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd38effd640 1 -- 172.21.15.79:0/4044210332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4004040 con 0x55a834f8ede0 2024-06-10T00:20:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd3b6808740 1 -- 172.21.15.79:0/4044210332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f8ede0 msgr2=0x55a834f82230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.093+0000 7fd3b6808740 1 --2- 172.21.15.79:0/4044210332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f8ede0 0x55a834f82230 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4033040 tx=0x7fd3a4004a40 comp rx=0 tx=0).stop 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 -- 172.21.15.79:0/4044210332 shutdown_connections 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 --2- 172.21.15.79:0/4044210332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f8ede0 0x55a834f82230 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 --2- 172.21.15.79:0/4044210332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f70f70 0x55a834f81cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 --2- 172.21.15.79:0/4044210332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834fb3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 -- 172.21.15.79:0/4044210332 >> 172.21.15.79:0/4044210332 conn(0x55a834f46660 msgr2=0x55a834f6e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 -- 172.21.15.79:0/4044210332 shutdown_connections 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 -- 172.21.15.79:0/4044210332 wait complete. 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 -- start start 2024-06-10T00:20:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.094+0000 7fd3b6808740 1 Processor -- start 2024-06-10T00:20:40.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834fb2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f81cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b6808740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f8ede0 0x55a834f82230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b6808740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac1fbb50 con 0x55a834f70f70 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b6808740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a834f68820 con 0x55a834f6de60 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b6808740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a834f66cb0 con 0x55a834f8ede0 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b6808740 10 client.0 _ll_register_callbacks cb 0x7fd39c00ae40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1097640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f81cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1097640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f81cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54682/0 (socket says 172.21.15.79:54682) 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1097640 1 -- 172.21.15.79:0/1291201309 learned_addr learned my addr 172.21.15.79:0/1291201309 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b2099640 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f8ede0 0x55a834f82230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1898640 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834fb2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1097640 1 -- 172.21.15.79:0/1291201309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f8ede0 msgr2=0x55a834f82230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f8ede0 0x55a834f82230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1097640 1 -- 172.21.15.79:0/1291201309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 msgr2=0x55a834fb2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834fb2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.095+0000 7fd3b1097640 1 -- 172.21.15.79:0/1291201309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a834b7d0f0 con 0x55a834f70f70 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b1097640 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f81cf0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd39c003ec0 tx=0x7fd39c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a264d9988fd1a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd38cff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd38cff9640 1 -- 172.21.15.79:0/1291201309 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c02d040 con 0x55a834f70f70 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd38cff9640 1 -- 172.21.15.79:0/1291201309 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fd39c041c80 con 0x55a834f70f70 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 1 -- 172.21.15.79:0/1291201309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a4036070 con 0x55a834f70f70 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd38cff9640 1 -- 172.21.15.79:0/1291201309 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fd39c005990 con 0x55a834f70f70 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 10 client.7197 fetch_fsmap learned FSMap version 55 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 1 -- 172.21.15.79:0/1291201309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55a834e70560 con 0x55a834f70f70 2024-06-10T00:20:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd38cff9640 1 -- 172.21.15.79:0/1291201309 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a4036070 con 0x55a834f70f70 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd38cff9640 1 -- 172.21.15.79:0/1291201309 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7fd39c048050 con 0x55a834f70f70 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 10 client.7197 fetch_fsmap finished waiting for FSMap version 55 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 10 client.7197 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 20 client.7197 populate_metadata read hostname 'smithi079' 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55a83500a590 0x55a834f6a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 4 client.7197 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b6808740 1 -- 172.21.15.79:0/1291201309 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a834eb1900 con 0x55a83500a590 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.096+0000 7fd3b1898640 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55a83500a590 0x55a834f6a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd38cff9640 10 client.7197 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b1898640 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55a83500a590 0x55a834f6a840 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d14b6674153c60b4 server_cookie=52dc30b9a0965db6 in_seq=0 out_seq=0 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd38cff9640 1 -- 172.21.15.79:0/1291201309 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+256 (crc 0 0 0) 0x55a834eb1900 con 0x55a83500a590 2024-06-10T00:20:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd38cff9640 10 client.7197 handle_command_reply: tid=0 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 client.7197 shutdown 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 -- 172.21.15.79:0/1291201309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 msgr2=0x55a834f81cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f81cf0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd39c003ec0 tx=0x7fd39c01a000 comp rx=0 tx=0).stop 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 -- 172.21.15.79:0/1291201309 shutdown_connections 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55a83500a590 0x55a834f6a840 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a834f8ede0 0x55a834f82230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd38cff9640 0 client.7197 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a834f70f70 0x55a834f81cf0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 --2- 172.21.15.79:0/1291201309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a834f6de60 0x55a834fb2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 -- 172.21.15.79:0/1291201309 >> 172.21.15.79:0/1291201309 conn(0x55a834f46660 msgr2=0x55a834fa0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 -- 172.21.15.79:0/1291201309 shutdown_connections 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 1 -- 172.21.15.79:0/1291201309 wait complete. 2024-06-10T00:20:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.097+0000 7fd3b6808740 20 client.7197 trim_cache size 0 max 16384 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout: "40f19821-7e03-4795-a6ea-6eb66302fc1e": { 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir", 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "40f19821-7e03-4795-a6ea-6eb66302fc1e", 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive" 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:40.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:20:40.156 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 -- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd39006bda0 msgr2=0x7fd39006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd39006bda0 0x7fd39006e260 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac1f4230 tx=0x7fd39c00a2a0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 -- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 msgr2=0x7fd3ac1ef360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3ac1ef360 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80073a0 tx=0x7fd3a80077a0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 -- 172.21.15.79:0/1634700851 shutdown_connections 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd39006bda0 0x7fd39006e260 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac140210 0x7fd3ac1406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac1f3150 0x7fd3ac1f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 --2- 172.21.15.79:0/1634700851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd398004d40 0x7fd3ac1ef360 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:20:40.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 -- 172.21.15.79:0/1634700851 >> 172.21.15.79:0/1634700851 conn(0x7fd3ac0b1d10 msgr2=0x7fd3ac1515b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:20:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 -- 172.21.15.79:0/1634700851 shutdown_connections 2024-06-10T00:20:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:20:40.098+0000 7fd3b3afc640 1 -- 172.21.15.79:0/1634700851 wait complete. 2024-06-10T00:20:40.158 INFO:tasks.cephfs.filesystem:scrub status for tag:40f19821-7e03-4795-a6ea-6eb66302fc1e - {'path': '/dir', 'tag': '40f19821-7e03-4795-a6ea-6eb66302fc1e', 'options': 'recursive'} 2024-06-10T00:20:40.802 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:20:40.803+0000 7fc6ff184640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:20:43.847 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:20:43.847+0000 7f522c39e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-10T00:20:44.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:20:44.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:21:10.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:10.160 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-06-10T00:21:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.274+0000 7f79e4eb3640 1 Processor -- start 2024-06-10T00:21:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.274+0000 7f79e4eb3640 1 -- start start 2024-06-10T00:21:10.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79e4eb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00b3800 0x7f79e00cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79e4eb3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f79e00cf190 0x7f79e00d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79e4eb3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e00b3c80 con 0x7f79e00d08f0 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79e4eb3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f79e00d1c80 con 0x7f79e00cf190 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79e4eb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f79e00cf620 con 0x7f79e00b3800 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79ded9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f79e00cf190 0x7f79e00d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79ded9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f79e00cf190 0x7f79e00d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60044/0 (socket says 172.21.15.79:60044) 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79ded9d640 1 -- 172.21.15.79:0/3769022389 learned_addr learned my addr 172.21.15.79:0/3769022389 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79ded9d640 1 -- 172.21.15.79:0/3769022389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00b3800 msgr2=0x7f79e00cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79ded9d640 1 --2- 172.21.15.79:0/3769022389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00b3800 0x7f79e00cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79ded9d640 1 -- 172.21.15.79:0/3769022389 >> v1:172.21.15.117:6789/0 conn(0x7f79e00d08f0 legacy=0x7f79e00d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.275+0000 7f79ded9d640 1 -- 172.21.15.79:0/3769022389 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e00cf8a0 con 0x7f79e00cf190 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79ded9d640 1 --2- 172.21.15.79:0/3769022389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e00d23f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009e50 tx=0x7f79d802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404bb739d4a6abab server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79ddd9b640 1 -- 172.21.15.79:0/3769022389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8036070 con 0x7f79e00cf190 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79ddd9b640 1 -- 172.21.15.79:0/3769022389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d8031600 con 0x7f79e00cf190 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79ddd9b640 1 -- 172.21.15.79:0/3769022389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d80319d0 con 0x7f79e00cf190 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79e4eb3640 1 -- 172.21.15.79:0/3769022389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 msgr2=0x7f79e00d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/3769022389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e00d23f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009e50 tx=0x7f79d802a6c0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79e4eb3640 1 -- 172.21.15.79:0/3769022389 shutdown_connections 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/3769022389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e00d23f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/3769022389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00b3800 0x7f79e00cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.276+0000 7f79e4eb3640 1 -- 172.21.15.79:0/3769022389 >> 172.21.15.79:0/3769022389 conn(0x7f79e009d3c0 msgr2=0x7f79e00d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.277+0000 7f79e4eb3640 1 -- 172.21.15.79:0/3769022389 shutdown_connections 2024-06-10T00:21:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.277+0000 7f79e4eb3640 1 -- 172.21.15.79:0/3769022389 wait complete. 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.278+0000 7f79e4eb3640 1 Processor -- start 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.278+0000 7f79e4eb3640 1 -- start start 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79e4eb3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e00b3800 0x7f79e014e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79e4eb3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e0150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79e4eb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00d08f0 0x7f79e006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79e4eb3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00d1ed0 con 0x7f79e00cf190 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79e4eb3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00cfe60 con 0x7f79e00b3800 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79e4eb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f79e00b50c0 con 0x7f79e00d08f0 2024-06-10T00:21:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e0150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e0150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60046/0 (socket says 172.21.15.79:60046) 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 -- 172.21.15.79:0/716879206 learned_addr learned my addr 172.21.15.79:0/716879206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79de59c640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e00b3800 0x7f79e014e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79ded9d640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00d08f0 0x7f79e006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 -- 172.21.15.79:0/716879206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00d08f0 msgr2=0x7f79e006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00d08f0 0x7f79e006c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 -- 172.21.15.79:0/716879206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e00b3800 msgr2=0x7f79e014e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e00b3800 0x7f79e014e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 -- 172.21.15.79:0/716879206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e0151730 con 0x7f79e00cf190 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d7fff640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e0150e30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f79c800b410 tx=0x7f79c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d6ffd640 1 -- 172.21.15.79:0/716879206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8015020 con 0x7f79e00cf190 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d6ffd640 1 -- 172.21.15.79:0/716879206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c8011850 con 0x7f79e00cf190 2024-06-10T00:21:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79e4eb3640 1 -- 172.21.15.79:0/716879206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e0151a10 con 0x7f79e00cf190 2024-06-10T00:21:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79d6ffd640 1 -- 172.21.15.79:0/716879206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8011c40 con 0x7f79e00cf190 2024-06-10T00:21:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.279+0000 7f79e4eb3640 1 -- 172.21.15.79:0/716879206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e014ee40 con 0x7f79e00cf190 2024-06-10T00:21:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.281+0000 7f79d6ffd640 1 -- 172.21.15.79:0/716879206 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79c8018020 con 0x7f79e00cf190 2024-06-10T00:21:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.281+0000 7f79d6ffd640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f79c006be30 0x7f79c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.281+0000 7f79d6ffd640 1 -- 172.21.15.79:0/716879206 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f79c808af50 con 0x7f79e00cf190 2024-06-10T00:21:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.281+0000 7f79de59c640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f79c006be30 0x7f79c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.282+0000 7f79de59c640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f79c006be30 0x7f79c006e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f79d0004ea0 tx=0x7f79d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.283+0000 7f79e7bc1740 1 Processor -- start 2024-06-10T00:21:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.283+0000 7f79e7bc1740 1 -- start start 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.283+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ffdaf0 0x55dcb7fda120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.283+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fd51a0 0x55dcb7fda660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.283+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7fdc6d0 0x55dcb7fdaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.283+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dcb7eff7e0 con 0x55dcb7fd51a0 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.283+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dcb7f3de80 con 0x55dcb7fdc6d0 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.283+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dcb7edb700 con 0x55dcb7ffdaf0 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fd51a0 0x55dcb7fda660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fd51a0 0x55dcb7fda660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60054/0 (socket says 172.21.15.79:60054) 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 -- 172.21.15.79:0/2944628371 learned_addr learned my addr 172.21.15.79:0/2944628371 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79de59c640 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ffdaf0 0x55dcb7fda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79ded9d640 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7fdc6d0 0x55dcb7fdaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 -- 172.21.15.79:0/2944628371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ffdaf0 msgr2=0x55dcb7fda120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ffdaf0 0x55dcb7fda120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 -- 172.21.15.79:0/2944628371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7fdc6d0 msgr2=0x55dcb7fdaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7fdc6d0 0x55dcb7fdaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 -- 172.21.15.79:0/2944628371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcb7efadd0 con 0x55dcb7fd51a0 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79d7fff640 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fd51a0 0x55dcb7fda660 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f79c80616d0 tx=0x7f79c8059850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6321430cacee750a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79bffff640 1 -- 172.21.15.79:0/2944628371 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c80570c0 con 0x55dcb7fd51a0 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79bffff640 1 -- 172.21.15.79:0/2944628371 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c805d110 con 0x55dcb7fd51a0 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.284+0000 7f79bffff640 1 -- 172.21.15.79:0/2944628371 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8055690 con 0x55dcb7fd51a0 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 -- 172.21.15.79:0/2944628371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fd51a0 msgr2=0x55dcb7fda660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fd51a0 0x55dcb7fda660 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f79c80616d0 tx=0x7f79c8059850 comp rx=0 tx=0).stop 2024-06-10T00:21:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 -- 172.21.15.79:0/2944628371 shutdown_connections 2024-06-10T00:21:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7fdc6d0 0x55dcb7fdaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fd51a0 0x55dcb7fda660 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/2944628371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ffdaf0 0x55dcb7fda120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 -- 172.21.15.79:0/2944628371 >> 172.21.15.79:0/2944628371 conn(0x55dcb7fd7410 msgr2=0x55dcb801ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 -- 172.21.15.79:0/2944628371 shutdown_connections 2024-06-10T00:21:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.285+0000 7f79e7bc1740 1 -- 172.21.15.79:0/2944628371 wait complete. 2024-06-10T00:21:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.286+0000 7f79e7bc1740 1 -- start start 2024-06-10T00:21:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.286+0000 7f79e7bc1740 1 Processor -- start 2024-06-10T00:21:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ff6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7ff5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 0x55dcb8000060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dcb7ec6640 con 0x55dcb7fe8730 2024-06-10T00:21:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dcb7f39e40 con 0x55dcb7ffdaf0 2024-06-10T00:21:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dcb7fd8be0 con 0x55dcb802fc30 2024-06-10T00:21:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 10 client.0 _ll_register_callbacks cb 0x55dcb7ef8430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7ff5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7ff5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60070/0 (socket says 172.21.15.79:60070) 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 -- 172.21.15.79:0/1937702905 learned_addr learned my addr 172.21.15.79:0/1937702905 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79ded9d640 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 0x55dcb8000060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79de59c640 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ff6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 -- 172.21.15.79:0/1937702905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 msgr2=0x55dcb8000060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 0x55dcb8000060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 -- 172.21.15.79:0/1937702905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 msgr2=0x55dcb7ff6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ff6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 -- 172.21.15.79:0/1937702905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcb7d1b7d0 con 0x55dcb7fe8730 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79d7fff640 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7ff5580 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f79c800bdd0 tx=0x7f79c8004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9125bf5d45d889f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79bd7fa640 1 -- 172.21.15.79:0/1937702905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8086030 con 0x55dcb7fe8730 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79bd7fa640 1 -- 172.21.15.79:0/1937702905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f79c8057320 con 0x55dcb7fe8730 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 1 -- 172.21.15.79:0/1937702905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79c805d110 con 0x55dcb7fe8730 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79bd7fa640 1 -- 172.21.15.79:0/1937702905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f79c80552c0 con 0x55dcb7fe8730 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.287+0000 7f79e7bc1740 10 client.7209 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79e7bc1740 1 -- 172.21.15.79:0/1937702905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55dcb7c513f0 con 0x55dcb7fe8730 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79bd7fa640 1 -- 172.21.15.79:0/1937702905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c805d110 con 0x55dcb7fe8730 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79bd7fa640 1 -- 172.21.15.79:0/1937702905 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7f79c8055690 con 0x55dcb7fe8730 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79e7bc1740 10 client.7209 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79e7bc1740 10 client.7209 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79e7bc1740 20 client.7209 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55dcb7ffdfa0 0x55dcb7ffe3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79e7bc1740 4 client.7209 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79e7bc1740 1 -- 172.21.15.79:0/1937702905 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcb7f4b5b0 con 0x55dcb7ffdfa0 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79de59c640 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55dcb7ffdfa0 0x55dcb7ffe3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79bd7fa640 10 client.7209 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.288+0000 7f79de59c640 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55dcb7ffdfa0 0x55dcb7ffe3d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fc782b6c791dd56 server_cookie=9207d42a37d73379 in_seq=0 out_seq=0 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79bd7fa640 1 -- 172.21.15.79:0/1937702905 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55dcb7f4b5b0 con 0x55dcb7ffdfa0 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79bd7fa640 10 client.7209 handle_command_reply: tid=0 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 client.7209 shutdown 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 -- 172.21.15.79:0/1937702905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 msgr2=0x55dcb7ff5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7ff5580 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f79c800bdd0 tx=0x7f79c8004710 comp rx=0 tx=0).stop 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 -- 172.21.15.79:0/1937702905 shutdown_connections 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55dcb7ffdfa0 0x55dcb7ffe3d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 0x55dcb8000060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7ff5580 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79bd7fa640 0 client.7209 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/1937702905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ff6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 -- 172.21.15.79:0/1937702905 >> 172.21.15.79:0/1937702905 conn(0x55dcb7fdc6d0 msgr2=0x55dcb8023440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 -- 172.21.15.79:0/1937702905 shutdown_connections 2024-06-10T00:21:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 1 -- 172.21.15.79:0/1937702905 wait complete. 2024-06-10T00:21:10.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.289+0000 7f79e7bc1740 20 client.7209 trim_cache size 0 max 16384 2024-06-10T00:21:10.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.307+0000 7f79e7bc1740 1 Processor -- start 2024-06-10T00:21:10.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.307+0000 7f79e7bc1740 1 -- start start 2024-06-10T00:21:10.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7fdaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb8032450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 0x55dcb8032990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f79e02010c0 con 0x55dcb7fe8730 2024-06-10T00:21:10.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79e02000e0 con 0x55dcb7ffdaf0 2024-06-10T00:21:10.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f79e00c92e0 con 0x55dcb802fc30 2024-06-10T00:21:10.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7fdaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7fdaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60078/0 (socket says 172.21.15.79:60078) 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 -- 172.21.15.79:0/3305231430 learned_addr learned my addr 172.21.15.79:0/3305231430 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 -- 172.21.15.79:0/3305231430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 msgr2=0x55dcb8032990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 --2- 172.21.15.79:0/3305231430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 0x55dcb8032990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 -- 172.21.15.79:0/3305231430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 msgr2=0x55dcb8032450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 --2- 172.21.15.79:0/3305231430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb8032450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 -- 172.21.15.79:0/3305231430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcb7c110f0 con 0x55dcb7fe8730 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.308+0000 7f79de59c640 1 --2- 172.21.15.79:0/3305231430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7fdaf20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x55dcb7ec6790 tx=0x7f79d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28c25ba13d47e39 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79bf7fe640 1 -- 172.21.15.79:0/3305231430 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d000ed40 con 0x55dcb7fe8730 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79bf7fe640 1 -- 172.21.15.79:0/3305231430 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d0007020 con 0x55dcb7fe8730 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79bf7fe640 1 -- 172.21.15.79:0/3305231430 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d00071d0 con 0x55dcb7fe8730 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 -- 172.21.15.79:0/3305231430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 msgr2=0x55dcb7fdaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/3305231430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7fdaf20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x55dcb7ec6790 tx=0x7f79d0014000 comp rx=0 tx=0).stop 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 -- 172.21.15.79:0/3305231430 shutdown_connections 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/3305231430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb802fc30 0x55dcb8032990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/3305231430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb8032450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/3305231430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb7fe8730 0x55dcb7fdaf20 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 -- 172.21.15.79:0/3305231430 >> 172.21.15.79:0/3305231430 conn(0x55dcb7fdc6d0 msgr2=0x55dcb7fd0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 -- 172.21.15.79:0/3305231430 shutdown_connections 2024-06-10T00:21:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.309+0000 7f79e7bc1740 1 -- 172.21.15.79:0/3305231430 wait complete. 2024-06-10T00:21:10.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.310+0000 7f79e7bc1740 1 -- start start 2024-06-10T00:21:10.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.310+0000 7f79e7bc1740 1 Processor -- start 2024-06-10T00:21:10.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ffac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb802fc30 0x55dcb8032450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ff39b0 0x55dcb8032990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dcb7fd5cc0 con 0x55dcb802fc30 2024-06-10T00:21:10.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79e01ffaf0 con 0x55dcb7ffdaf0 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dcb7ff3830 con 0x55dcb7ff39b0 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 10 client.0 _ll_register_callbacks cb 0x7f79c8059720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb802fc30 0x55dcb8032450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb802fc30 0x55dcb8032450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60080/0 (socket says 172.21.15.79:60080) 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 -- 172.21.15.79:0/33985875 learned_addr learned my addr 172.21.15.79:0/33985875 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79ded9d640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ff39b0 0x55dcb8032990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79de59c640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ffac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 -- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ff39b0 msgr2=0x55dcb8032990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ff39b0 0x55dcb8032990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 -- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 msgr2=0x55dcb7ffac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ffac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 -- 172.21.15.79:0/33985875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcb7f04560 con 0x55dcb802fc30 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79ded9d640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ff39b0 0x55dcb8032990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79de59c640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ffac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79d7fff640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb802fc30 0x55dcb8032450 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f79c80892f0 tx=0x7f79c8089170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8284257d59641e8d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79bd7fa640 1 -- 172.21.15.79:0/33985875 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8086020 con 0x55dcb802fc30 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79bd7fa640 1 -- 172.21.15.79:0/33985875 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f79c8055690 con 0x55dcb802fc30 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 1 -- 172.21.15.79:0/33985875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d0007020 con 0x55dcb802fc30 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79bd7fa640 1 -- 172.21.15.79:0/33985875 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f79c8058470 con 0x55dcb802fc30 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 10 client.7215 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.311+0000 7f79e7bc1740 1 -- 172.21.15.79:0/33985875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55dcb7fd45b0 con 0x55dcb802fc30 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79bd7fa640 1 -- 172.21.15.79:0/33985875 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d0007020 con 0x55dcb802fc30 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79bd7fa640 1 -- 172.21.15.79:0/33985875 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7f79c8058610 con 0x55dcb802fc30 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 10 client.7215 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 10 client.7215 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:10.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 20 client.7215 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55dcb7fd4110 0x55dcb8015d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 4 client.7215 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 1 -- 172.21.15.79:0/33985875 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dcb7f45900 con 0x55dcb7fd4110 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79de59c640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55dcb7fd4110 0x55dcb8015d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79bd7fa640 10 client.7215 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79de59c640 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55dcb7fd4110 0x55dcb8015d70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc88fe3f39ca9ad server_cookie=360f58167a83b4c1 in_seq=0 out_seq=0 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79bd7fa640 1 -- 172.21.15.79:0/33985875 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dcb7f45900 con 0x55dcb7fd4110 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79bd7fa640 10 client.7215 handle_command_reply: tid=0 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 1 client.7215 shutdown 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 1 -- 172.21.15.79:0/33985875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb802fc30 msgr2=0x55dcb8032450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.312+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb802fc30 0x55dcb8032450 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f79c80892f0 tx=0x7f79c8089170 comp rx=0 tx=0).stop 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 1 -- 172.21.15.79:0/33985875 shutdown_connections 2024-06-10T00:21:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55dcb7fd4110 0x55dcb8015d70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dcb7ff39b0 0x55dcb8032990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dcb802fc30 0x55dcb8032450 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 1 --2- 172.21.15.79:0/33985875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dcb7ffdaf0 0x55dcb7ffac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79bd7fa640 0 client.7215 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 1 -- 172.21.15.79:0/33985875 >> 172.21.15.79:0/33985875 conn(0x55dcb7fdc6d0 msgr2=0x55dcb7fff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 1 -- 172.21.15.79:0/33985875 shutdown_connections 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 1 -- 172.21.15.79:0/33985875 wait complete. 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e7bc1740 20 client.7215 trim_cache size 0 max 16384 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:21:10.319 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:21:10.320 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:21:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:21:10.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 -- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f79c006be30 msgr2=0x7f79c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f79c006be30 0x7f79c006e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f79d0004ea0 tx=0x7f79d0009040 comp rx=0 tx=0).stop 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 -- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 msgr2=0x7f79e0150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e0150e30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f79c800b410 tx=0x7f79c800b8d0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 -- 172.21.15.79:0/716879206 shutdown_connections 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f79c006be30 0x7f79c006e2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e00d08f0 0x7f79e006c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e00cf190 0x7f79e0150e30 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 --2- 172.21.15.79:0/716879206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e00b3800 0x7f79e014e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 -- 172.21.15.79:0/716879206 >> 172.21.15.79:0/716879206 conn(0x7f79e009d3c0 msgr2=0x7f79e00d23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 -- 172.21.15.79:0/716879206 shutdown_connections 2024-06-10T00:21:10.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.313+0000 7f79e4eb3640 1 -- 172.21.15.79:0/716879206 wait complete. 2024-06-10T00:21:10.323 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:21:10.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:21:10.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.422+0000 7fbb3599e640 1 Processor -- start 2024-06-10T00:21:10.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.422+0000 7fbb3599e640 1 -- start start 2024-06-10T00:21:10.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb3599e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb3009aa10 0x7fbb3009aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb3599e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c550 0x7fbb3015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb3599e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb3015cf20 con 0x7fbb30159d80 2024-06-10T00:21:10.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb3599e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbb300b50c0 con 0x7fbb3009aa10 2024-06-10T00:21:10.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb3599e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3015d1a0 con 0x7fbb3015c550 2024-06-10T00:21:10.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb267fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb3009aa10 0x7fbb3009aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb267fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb3009aa10 0x7fbb3009aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60092/0 (socket says 172.21.15.79:60092) 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb267fc640 1 -- 172.21.15.79:0/3497806682 learned_addr learned my addr 172.21.15.79:0/3497806682 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.423+0000 7fbb2effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbb30159d80 0x7fbb300d2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54824/0 (socket says 172.21.15.79:54824) 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.424+0000 7fbb2f7fe640 1 --2- 172.21.15.79:0/3497806682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c550 0x7fbb3015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.424+0000 7fbb267fc640 1 -- 172.21.15.79:0/3497806682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c550 msgr2=0x7fbb3015c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.424+0000 7fbb267fc640 1 --2- 172.21.15.79:0/3497806682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c550 0x7fbb3015c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.424+0000 7fbb267fc640 1 -- 172.21.15.79:0/3497806682 >> v1:172.21.15.79:6789/0 conn(0x7fbb30159d80 legacy=0x7fbb300d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.424+0000 7fbb267fc640 1 -- 172.21.15.79:0/3497806682 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3015d480 con 0x7fbb3009aa10 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.424+0000 7fbb2e7fc640 1 -- 172.21.15.79:0/3497806682 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272240368 0 0) 0x7fbb20001110 con 0x7fbb30159d80 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.424+0000 7fbb267fc640 1 --2- 172.21.15.79:0/3497806682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb3009aa10 0x7fbb3009aec0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fbb180098a0 tx=0x7fbb1802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7529f7eb5800ed00 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb2e7fc640 1 -- 172.21.15.79:0/3497806682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18037070 con 0x7fbb3009aa10 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb2e7fc640 1 -- 172.21.15.79:0/3497806682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb18032440 con 0x7fbb3009aa10 2024-06-10T00:21:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb2e7fc640 1 -- 172.21.15.79:0/3497806682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18032810 con 0x7fbb3009aa10 2024-06-10T00:21:10.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb3599e640 1 -- 172.21.15.79:0/3497806682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb3009aa10 msgr2=0x7fbb3009aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb3599e640 1 --2- 172.21.15.79:0/3497806682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb3009aa10 0x7fbb3009aec0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fbb180098a0 tx=0x7fbb1802a200 comp rx=0 tx=0).stop 2024-06-10T00:21:10.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb3599e640 1 -- 172.21.15.79:0/3497806682 shutdown_connections 2024-06-10T00:21:10.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb3599e640 1 --2- 172.21.15.79:0/3497806682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c550 0x7fbb3015c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb3599e640 1 --2- 172.21.15.79:0/3497806682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb3009aa10 0x7fbb3009aec0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb3599e640 1 -- 172.21.15.79:0/3497806682 >> 172.21.15.79:0/3497806682 conn(0x7fbb300b7270 msgr2=0x7fbb300b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb3599e640 1 -- 172.21.15.79:0/3497806682 shutdown_connections 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.425+0000 7fbb3599e640 1 -- 172.21.15.79:0/3497806682 wait complete. 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.426+0000 7fbb3599e640 1 Processor -- start 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb3599e640 1 -- start start 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb3599e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3009aa10 0x7fbb301f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb3599e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb3015c550 0x7fbb301e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb3599e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb301e5530 0x7fbb300af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb3599e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300d2160 con 0x7fbb301e5530 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb3599e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300d1e80 con 0x7fbb3015c550 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb3599e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbb300b1d20 con 0x7fbb3009aa10 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb301e5530 0x7fbb300af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb301e5530 0x7fbb300af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60096/0 (socket says 172.21.15.79:60096) 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.427+0000 7fbb2f7fe640 1 -- 172.21.15.79:0/1324764597 learned_addr learned my addr 172.21.15.79:0/1324764597 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2effd640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3009aa10 0x7fbb301f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb267fc640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb3015c550 0x7fbb301e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2f7fe640 1 -- 172.21.15.79:0/1324764597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3009aa10 msgr2=0x7fbb301f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2f7fe640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3009aa10 0x7fbb301f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2f7fe640 1 -- 172.21.15.79:0/1324764597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb3015c550 msgr2=0x7fbb301e4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2f7fe640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb3015c550 0x7fbb301e4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2f7fe640 1 -- 172.21.15.79:0/1324764597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb300b0380 con 0x7fbb301e5530 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2f7fe640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb301e5530 0x7fbb300af650 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800cc30 tx=0x7fbb2800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2cff9640 1 -- 172.21.15.79:0/1324764597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800ce40 con 0x7fbb301e5530 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2cff9640 1 -- 172.21.15.79:0/1324764597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb28003990 con 0x7fbb301e5530 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb300b0660 con 0x7fbb301e5530 2024-06-10T00:21:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb2cff9640 1 -- 172.21.15.79:0/1324764597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb28003d40 con 0x7fbb301e5530 2024-06-10T00:21:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.428+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb300b0c20 con 0x7fbb301e5530 2024-06-10T00:21:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.429+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb30068ad0 con 0x7fbb301e5530 2024-06-10T00:21:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.430+0000 7fbb2cff9640 1 -- 172.21.15.79:0/1324764597 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb28003ee0 con 0x7fbb301e5530 2024-06-10T00:21:10.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.430+0000 7fbb2cff9640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb1006be60 0x7fbb1006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.430+0000 7fbb2cff9640 1 -- 172.21.15.79:0/1324764597 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fbb2808b510 con 0x7fbb301e5530 2024-06-10T00:21:10.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.430+0000 7fbb2effd640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb1006be60 0x7fbb1006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.430+0000 7fbb2effd640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb1006be60 0x7fbb1006e320 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbb20000f60 tx=0x7fbb20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.434+0000 7fbb2cff9640 1 -- 172.21.15.79:0/1324764597 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbb28014030 con 0x7fbb301e5530 2024-06-10T00:21:10.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.644+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb300b1b00 con 0x7fbb301e5530 2024-06-10T00:21:10.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.645+0000 7fbb2cff9640 1 -- 172.21.15.79:0/1324764597 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5190 (secure 0 0 0) 0x7fbb28059c50 con 0x7fbb301e5530 2024-06-10T00:21:10.644 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:10.645 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:43.828708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":9,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":6}]} 2024-06-10T00:21:10.645 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb1006be60 msgr2=0x7fbb1006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb1006be60 0x7fbb1006e320 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbb20000f60 tx=0x7fbb20009040 comp rx=0 tx=0).stop 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb301e5530 msgr2=0x7fbb300af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb301e5530 0x7fbb300af650 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800cc30 tx=0x7fbb2800a5c0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 shutdown_connections 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbb1006be60 0x7fbb1006e320 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb301e5530 0x7fbb300af650 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb3015c550 0x7fbb301e4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 --2- 172.21.15.79:0/1324764597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3009aa10 0x7fbb301f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 >> 172.21.15.79:0/1324764597 conn(0x7fbb300b7270 msgr2=0x7fbb300706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 shutdown_connections 2024-06-10T00:21:10.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.647+0000 7fbb3599e640 1 -- 172.21.15.79:0/1324764597 wait complete. 2024-06-10T00:21:10.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-06-10T00:21:10.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.758+0000 7f896de6b640 1 Processor -- start 2024-06-10T00:21:10.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.758+0000 7f896de6b640 1 -- start start 2024-06-10T00:21:10.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.759+0000 7f896de6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 0x7f89680d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.759+0000 7f896de6b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f896806e1f0 0x7f896806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.759+0000 7f896de6b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8968155700 con 0x7f8968155320 2024-06-10T00:21:10.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.759+0000 7f896de6b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f89680d09c0 con 0x7f896806e1f0 2024-06-10T00:21:10.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.759+0000 7f896de6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f896815b6b0 con 0x7f89680d0020 2024-06-10T00:21:10.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.759+0000 7f89677fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8968155320 0x7f89680b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54834/0 (socket says 172.21.15.79:54834) 2024-06-10T00:21:10.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.759+0000 7f89677fe640 1 -- 172.21.15.79:0/216039415 learned_addr learned my addr 172.21.15.79:0/216039415 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f8967fff640 1 --2- 172.21.15.79:0/216039415 >> v2:172.21.15.117:3300/0 conn(0x7f896806e1f0 0x7f896806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989480899 0 0) 0x7f8968155700 con 0x7f8968155320 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8950003520 con 0x7f8968155320 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f8966ffd640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 0x7f89680d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2265045738 0 0) 0x7f8950003520 con 0x7f8968155320 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 msgr2=0x7f89680d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 0x7f89680d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 >> v2:172.21.15.117:3300/0 conn(0x7f896806e1f0 msgr2=0x7f896806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 --2- 172.21.15.79:0/216039415 >> v2:172.21.15.117:3300/0 conn(0x7f896806e1f0 0x7f896806e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896815b990 con 0x7f8968155320 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f8958001670 con 0x7f8968155320 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 >> v1:172.21.15.79:6789/0 conn(0x7f8968155320 legacy=0x7f89680b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f8950003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8950004800 0x7f8950004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 0x7f89500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f896815b6b0 con 0x7f89500039b0 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f895000b9c0 con 0x7f8950004800 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f895000bb40 con 0x7f89680d0020 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89677fe640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f8950003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f8966ffd640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8950004800 0x7f8950004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f8967fff640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 0x7f89500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89677fe640 1 -- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 msgr2=0x7f89500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89677fe640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 0x7f89500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89677fe640 1 -- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8950004800 msgr2=0x7f8950004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89677fe640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8950004800 0x7f8950004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f89677fe640 1 -- 172.21.15.79:0/216039415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8950003520 con 0x7f89500039b0 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.760+0000 7f8967fff640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680d0020 0x7f89500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.761+0000 7f89677fe640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f8950003dd0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f895800c240 tx=0x7f8950005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b696826bcfb3e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.761+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895802e070 con 0x7f89500039b0 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.761+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8958005af0 con 0x7f89500039b0 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.761+0000 7f89667fc640 1 -- 172.21.15.79:0/216039415 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958007d30 con 0x7f89500039b0 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.762+0000 7f896de6b640 1 -- 172.21.15.79:0/216039415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 msgr2=0x7f8950003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.762+0000 7f896de6b640 1 --2- 172.21.15.79:0/216039415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f8950003dd0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f895800c240 tx=0x7f8950005830 comp rx=0 tx=0).stop 2024-06-10T00:21:10.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.762+0000 7f8967fff640 1 -- 172.21.15.79:0/216039415 reap_dead start 2024-06-10T00:21:10.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.762+0000 7f896de6b640 1 -- 172.21.15.79:0/216039415 shutdown_connections 2024-06-10T00:21:10.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.762+0000 7f896de6b640 1 -- 172.21.15.79:0/216039415 >> 172.21.15.79:0/216039415 conn(0x7f89680b1d10 msgr2=0x7f89680b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.762+0000 7f896de6b640 1 -- 172.21.15.79:0/216039415 shutdown_connections 2024-06-10T00:21:10.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.762+0000 7f896de6b640 1 -- 172.21.15.79:0/216039415 wait complete. 2024-06-10T00:21:10.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.763+0000 7f896de6b640 1 Processor -- start 2024-06-10T00:21:10.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.763+0000 7f896de6b640 1 -- start start 2024-06-10T00:21:10.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f896de6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f89680cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f896de6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8968149030 0x7f89680cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f896de6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680ce140 0x7f8968159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f896de6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f896806ebc0 con 0x7f89500039b0 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f896de6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f896815bf50 con 0x7f8968149030 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f896de6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f89680cce70 con 0x7f89680ce140 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f89680cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f89680cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60118/0 (socket says 172.21.15.79:60118) 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 -- 172.21.15.79:0/947580482 learned_addr learned my addr 172.21.15.79:0/947580482 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f8966ffd640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8968149030 0x7f89680cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f8967fff640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680ce140 0x7f8968159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 -- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680ce140 msgr2=0x7f8968159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680ce140 0x7f8968159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 -- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8968149030 msgr2=0x7f89680cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8968149030 0x7f89680cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 -- 172.21.15.79:0/947580482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89680ce6a0 con 0x7f89500039b0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f8967fff640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680ce140 0x7f8968159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f89677fe640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f89680cd300 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f895802ae30 tx=0x7f896815bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.764+0000 7f894ffff640 1 -- 172.21.15.79:0/947580482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958042070 con 0x7f89500039b0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.765+0000 7f894ffff640 1 -- 172.21.15.79:0/947580482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8958007480 con 0x7f89500039b0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.765+0000 7f894ffff640 1 -- 172.21.15.79:0/947580482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958007d30 con 0x7f89500039b0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.765+0000 7f896de6b640 1 -- 172.21.15.79:0/947580482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89680cc820 con 0x7f89500039b0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.765+0000 7f896de6b640 1 -- 172.21.15.79:0/947580482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89680cd840 con 0x7f89500039b0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.766+0000 7f894ffff640 1 -- 172.21.15.79:0/947580482 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8958045070 con 0x7f89500039b0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.766+0000 7f894ffff640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f895406be30 0x7f895406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.767+0000 7f894ffff640 1 -- 172.21.15.79:0/947580482 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f89580ab9c0 con 0x7f89500039b0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.767+0000 7f8966ffd640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f895406be30 0x7f895406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.767+0000 7f8966ffd640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f895406be30 0x7f895406e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f89681f4e80 tx=0x7f895c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.767+0000 7f8970b78740 1 Processor -- start 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8970b78740 1 -- start start 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8970b78740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c37020 0x5609b9be99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8970b78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c1a140 0x5609b9c194c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8970b78740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c19a00 0x5609b9bee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8970b78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5609b9b52d80 con 0x5609b9c1a140 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8970b78740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5609b9af02f0 con 0x5609b9c19a00 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8970b78740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5609b9b4ed40 con 0x5609b9c37020 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8966ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c1a140 0x5609b9c194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8966ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c1a140 0x5609b9c194c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60126/0 (socket says 172.21.15.79:60126) 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.768+0000 7f8966ffd640 1 -- 172.21.15.79:0/498481682 learned_addr learned my addr 172.21.15.79:0/498481682 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f89677fe640 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c37020 0x5609b9be99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f8967fff640 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c19a00 0x5609b9bee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f8966ffd640 1 -- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c37020 msgr2=0x5609b9be99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f8966ffd640 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c37020 0x5609b9be99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f8966ffd640 1 -- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c19a00 msgr2=0x5609b9bee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f8966ffd640 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c19a00 0x5609b9bee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f8966ffd640 1 -- 172.21.15.79:0/498481682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b99327c0 con 0x5609b9c1a140 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f89677fe640 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c37020 0x5609b9be99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f8966ffd640 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c1a140 0x5609b9c194c0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f895c014e40 tx=0x7f895c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35f5f52075c3f11 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f894d7fa640 1 -- 172.21.15.79:0/498481682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0096d0 con 0x5609b9c1a140 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f894d7fa640 1 -- 172.21.15.79:0/498481682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c029070 con 0x5609b9c1a140 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.769+0000 7f894d7fa640 1 -- 172.21.15.79:0/498481682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c014e70 con 0x5609b9c1a140 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 -- 172.21.15.79:0/498481682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c1a140 msgr2=0x5609b9c194c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c1a140 0x5609b9c194c0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f895c014e40 tx=0x7f895c017000 comp rx=0 tx=0).stop 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 -- 172.21.15.79:0/498481682 shutdown_connections 2024-06-10T00:21:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c19a00 0x5609b9bee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c1a140 0x5609b9c194c0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 --2- 172.21.15.79:0/498481682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c37020 0x5609b9be99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 -- 172.21.15.79:0/498481682 >> 172.21.15.79:0/498481682 conn(0x5609b9bebc20 msgr2=0x5609b9c344c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 -- 172.21.15.79:0/498481682 shutdown_connections 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 -- 172.21.15.79:0/498481682 wait complete. 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 -- start start 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.770+0000 7f8970b78740 1 Processor -- start 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8970b78740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c06ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8970b78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8970b78740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c0a630 0x5609b9bee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8970b78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5609b9beddd0 con 0x5609b9c37020 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8970b78740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5609b9aedda0 con 0x5609b9c0a630 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8970b78740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5609b9bed1c0 con 0x5609b9c1a140 2024-06-10T00:21:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8970b78740 10 client.0 _ll_register_callbacks cb 0x5609b9865ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8966ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8966ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60138/0 (socket says 172.21.15.79:60138) 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8966ffd640 1 -- 172.21.15.79:0/1190085980 learned_addr learned my addr 172.21.15.79:0/1190085980 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8967fff640 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c0a630 0x5609b9bee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f89677fe640 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c06ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8966ffd640 1 -- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 msgr2=0x5609b9c06ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8966ffd640 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c06ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8966ffd640 1 -- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c0a630 msgr2=0x5609b9bee6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8966ffd640 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c0a630 0x5609b9bee6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8966ffd640 1 -- 172.21.15.79:0/1190085980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b9992f50 con 0x5609b9c37020 2024-06-10T00:21:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.771+0000 7f8967fff640 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c0a630 0x5609b9bee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8966ffd640 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1ce10 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f895c008010 tx=0x7f895c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9989094d0161804a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f89467fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f89467fc640 1 -- 172.21.15.79:0/1190085980 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c006240 con 0x5609b9c37020 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f89467fc640 1 -- 172.21.15.79:0/1190085980 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f895c0063e0 con 0x5609b9c37020 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 1 -- 172.21.15.79:0/1190085980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f895c029070 con 0x5609b9c37020 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f89467fc640 1 -- 172.21.15.79:0/1190085980 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f895c03e050 con 0x5609b9c37020 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 10 client.7236 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 1 -- 172.21.15.79:0/1190085980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x5609b98260b0 con 0x5609b9c37020 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f89467fc640 1 -- 172.21.15.79:0/1190085980 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c029070 con 0x5609b9c37020 2024-06-10T00:21:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f89467fc640 1 -- 172.21.15.79:0/1190085980 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7f895c041020 con 0x5609b9c37020 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 10 client.7236 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 10 client.7236 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 20 client.7236 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5609b9c07f90 0x5609b9c32740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 4 client.7236 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f8970b78740 1 -- 172.21.15.79:0/1190085980 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609b9b604b0 con 0x5609b9c07f90 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.772+0000 7f89677fe640 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5609b9c07f90 0x5609b9c32740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f89467fc640 10 client.7236 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f89677fe640 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5609b9c07f90 0x5609b9c32740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329551eb0815a61d server_cookie=13d70aecc6c0c583 in_seq=0 out_seq=0 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f89467fc640 1 -- 172.21.15.79:0/1190085980 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5609b9b604b0 con 0x5609b9c07f90 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f89467fc640 10 client.7236 handle_command_reply: tid=0 2024-06-10T00:21:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 client.7236 shutdown 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 -- 172.21.15.79:0/1190085980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 msgr2=0x5609b9c1ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1ce10 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f895c008010 tx=0x7f895c004730 comp rx=0 tx=0).stop 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 -- 172.21.15.79:0/1190085980 shutdown_connections 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5609b9c07f90 0x5609b9c32740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c0a630 0x5609b9bee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1ce10 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f89467fc640 0 client.7236 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 --2- 172.21.15.79:0/1190085980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c06ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.773+0000 7f8970b78740 1 -- 172.21.15.79:0/1190085980 >> 172.21.15.79:0/1190085980 conn(0x5609b9c19a00 msgr2=0x5609b9be8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.774+0000 7f8970b78740 1 -- 172.21.15.79:0/1190085980 shutdown_connections 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.774+0000 7f8970b78740 1 -- 172.21.15.79:0/1190085980 wait complete. 2024-06-10T00:21:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.774+0000 7f8970b78740 20 client.7236 trim_cache size 0 max 16384 2024-06-10T00:21:10.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.787+0000 7f8970b78740 1 Processor -- start 2024-06-10T00:21:10.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.787+0000 7f8970b78740 1 -- start start 2024-06-10T00:21:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8970b78740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c0a630 0x5609b9c33640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8970b78740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c1a140 0x5609b9bec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8970b78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8970b78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89681fe310 con 0x5609b9c37020 2024-06-10T00:21:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8970b78740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f89680ae1d0 con 0x5609b9c1a140 2024-06-10T00:21:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8970b78740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f89681fdcf0 con 0x5609b9c0a630 2024-06-10T00:21:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8967fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8967fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60150/0 (socket says 172.21.15.79:60150) 2024-06-10T00:21:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8967fff640 1 -- 172.21.15.79:0/3344155962 learned_addr learned my addr 172.21.15.79:0/3344155962 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8966ffd640 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c1a140 0x5609b9bec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f89677fe640 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c0a630 0x5609b9c33640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8967fff640 1 -- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c0a630 msgr2=0x5609b9c33640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8967fff640 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c0a630 0x5609b9c33640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8967fff640 1 -- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c1a140 msgr2=0x5609b9bec8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8967fff640 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c1a140 0x5609b9bec8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8967fff640 1 -- 172.21.15.79:0/3344155962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b9c2c100 con 0x5609b9c37020 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.788+0000 7f8966ffd640 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c1a140 0x5609b9bec8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8967fff640 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1cd80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f8960003ad0 tx=0x7f8960009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cbd33e8605681e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f894cff9640 1 -- 172.21.15.79:0/3344155962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896001b070 con 0x5609b9c37020 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f894cff9640 1 -- 172.21.15.79:0/3344155962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8960017640 con 0x5609b9c37020 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f894cff9640 1 -- 172.21.15.79:0/3344155962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960017a10 con 0x5609b9c37020 2024-06-10T00:21:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 -- 172.21.15.79:0/3344155962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 msgr2=0x5609b9c1cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1cd80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f8960003ad0 tx=0x7f8960009750 comp rx=0 tx=0).stop 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 -- 172.21.15.79:0/3344155962 shutdown_connections 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c37020 0x5609b9c1cd80 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c1a140 0x5609b9bec8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 --2- 172.21.15.79:0/3344155962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c0a630 0x5609b9c33640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 -- 172.21.15.79:0/3344155962 >> 172.21.15.79:0/3344155962 conn(0x5609b9c19a00 msgr2=0x5609b9bef430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 -- 172.21.15.79:0/3344155962 shutdown_connections 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.789+0000 7f8970b78740 1 -- 172.21.15.79:0/3344155962 wait complete. 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.790+0000 7f8970b78740 1 -- start start 2024-06-10T00:21:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.790+0000 7f8970b78740 1 Processor -- start 2024-06-10T00:21:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c0a630 0x5609b9c14a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c14fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c37020 0x5609b9c15960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5609b9c07e10 con 0x5609b9c0a630 2024-06-10T00:21:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5609b9c489d0 con 0x5609b9c37020 2024-06-10T00:21:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5609b9c083a0 con 0x5609b9c1a140 2024-06-10T00:21:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 10 client.0 _ll_register_callbacks cb 0x7f895c014cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c0a630 0x5609b9c14a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c0a630 0x5609b9c14a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60164/0 (socket says 172.21.15.79:60164) 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 -- 172.21.15.79:0/1869675134 learned_addr learned my addr 172.21.15.79:0/1869675134 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8966ffd640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c14fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8967fff640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c37020 0x5609b9c15960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 -- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 msgr2=0x5609b9c14fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c14fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 -- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c37020 msgr2=0x5609b9c15960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c37020 0x5609b9c15960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 -- 172.21.15.79:0/1869675134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b9c05f50 con 0x5609b9c0a630 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8966ffd640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c14fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8967fff640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c37020 0x5609b9c15960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89677fe640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c0a630 0x5609b9c14a60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f89580760a0 tx=0x7f8958076010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27b6a451f10bacd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89467fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89467fc640 1 -- 172.21.15.79:0/1869675134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895804c040 con 0x5609b9c0a630 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89467fc640 1 -- 172.21.15.79:0/1869675134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f89580762b0 con 0x5609b9c0a630 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 1 -- 172.21.15.79:0/1869675134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8960017640 con 0x5609b9c0a630 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f89467fc640 1 -- 172.21.15.79:0/1869675134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f895807dff0 con 0x5609b9c0a630 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.791+0000 7f8970b78740 10 client.7242 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 -- 172.21.15.79:0/1869675134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x5609b9c167b0 con 0x5609b9c0a630 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f89467fc640 1 -- 172.21.15.79:0/1869675134 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8960017640 con 0x5609b9c0a630 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f89467fc640 1 -- 172.21.15.79:0/1869675134 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7f8958079090 con 0x5609b9c0a630 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 10 client.7242 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 10 client.7242 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:21:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 20 client.7242 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5609b9c16280 0x5609b9c378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 4 client.7242 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 -- 172.21.15.79:0/1869675134 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x5609b9c2c750 con 0x5609b9c16280 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8966ffd640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5609b9c16280 0x5609b9c378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f89467fc640 10 client.7242 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8966ffd640 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5609b9c16280 0x5609b9c378e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27961a0c40b8575f server_cookie=bb6415ba620f84d1 in_seq=0 out_seq=0 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f89467fc640 1 -- 172.21.15.79:0/1869675134 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+419 (crc 0 0 0) 0x5609b9c2c750 con 0x5609b9c16280 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f89467fc640 10 client.7242 handle_command_reply: tid=0 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 client.7242 shutdown 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 -- 172.21.15.79:0/1869675134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c0a630 msgr2=0x5609b9c14a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c0a630 0x5609b9c14a60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f89580760a0 tx=0x7f8958076010 comp rx=0 tx=0).stop 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 -- 172.21.15.79:0/1869675134 shutdown_connections 2024-06-10T00:21:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5609b9c16280 0x5609b9c378e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609b9c37020 0x5609b9c15960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f89467fc640 0 client.7242 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5609b9c1a140 0x5609b9c14fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 --2- 172.21.15.79:0/1869675134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609b9c0a630 0x5609b9c14a60 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.792+0000 7f8970b78740 1 -- 172.21.15.79:0/1869675134 >> 172.21.15.79:0/1869675134 conn(0x5609b9c19a00 msgr2=0x5609b9c32c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f8970b78740 1 -- 172.21.15.79:0/1869675134 shutdown_connections 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f8970b78740 1 -- 172.21.15.79:0/1869675134 wait complete. 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f8970b78740 20 client.7242 trim_cache size 0 max 16384 2024-06-10T00:21:10.800 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "dir_frag", 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 596804368, 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627776, 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "frag": "*", 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir" 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "backtrace", 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 3380871353, 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-06-10T00:21:10.801 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/testdir/hardlink" 2024-06-10T00:21:10.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:21:10.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:21:10.802 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "backtrace", 2024-06-10T00:21:10.802 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4266965711, 2024-06-10T00:21:10.802 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627776, 2024-06-10T00:21:10.802 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir" 2024-06-10T00:21:10.802 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:21:10.802 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 -- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f895406be30 msgr2=0x7f895406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f895406be30 0x7f895406e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f89681f4e80 tx=0x7f895c008040 comp rx=0 tx=0).stop 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 -- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 msgr2=0x7f89680cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f89680cd300 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f895802ae30 tx=0x7f896815bb60 comp rx=0 tx=0).stop 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 -- 172.21.15.79:0/947580482 shutdown_connections 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f895406be30 0x7f895406e2f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89680ce140 0x7f8968159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8968149030 0x7f89680cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 --2- 172.21.15.79:0/947580482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89500039b0 0x7f89680cd300 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 -- 172.21.15.79:0/947580482 >> 172.21.15.79:0/947580482 conn(0x7f89680b1d10 msgr2=0x7f8968072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 -- 172.21.15.79:0/947580482 shutdown_connections 2024-06-10T00:21:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.793+0000 7f896de6b640 1 -- 172.21.15.79:0/947580482 wait complete. 2024-06-10T00:21:10.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-10T00:21:10.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.904+0000 7f333604d640 1 Processor -- start 2024-06-10T00:21:10.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.904+0000 7f333604d640 1 -- start start 2024-06-10T00:21:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.904+0000 7f333604d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f333015f1a0 0x7f33300d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.904+0000 7f333604d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333015f5e0 con 0x7f33300cef70 2024-06-10T00:21:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.904+0000 7f333604d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33300d0ad0 con 0x7f33300d2680 2024-06-10T00:21:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.904+0000 7f333604d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f33300d13e0 con 0x7f333015f1a0 2024-06-10T00:21:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.905+0000 7f3327fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f333015f1a0 0x7f33300d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.905+0000 7f332ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f33300cef70 0x7f33300cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54842/0 (socket says 172.21.15.79:54842) 2024-06-10T00:21:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.905+0000 7f332ffff640 1 -- 172.21.15.79:0/1442254968 learned_addr learned my addr 172.21.15.79:0/1442254968 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.905+0000 7f3327fff640 1 -- 172.21.15.79:0/1442254968 >> v1:172.21.15.117:6789/0 conn(0x7f33300d2680 legacy=0x7f33300d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.905+0000 7f3327fff640 1 -- 172.21.15.79:0/1442254968 >> v1:172.21.15.79:6789/0 conn(0x7f33300cef70 legacy=0x7f33300cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.905+0000 7f332effd640 1 -- 172.21.15.79:0/1442254968 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665381670 0 0) 0x7f333015f5e0 con 0x7f33300cef70 2024-06-10T00:21:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.905+0000 7f3327fff640 1 -- 172.21.15.79:0/1442254968 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333015f890 con 0x7f333015f1a0 2024-06-10T00:21:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f3327fff640 1 --2- 172.21.15.79:0/1442254968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33300d1fc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f33180097a0 tx=0x7f331802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35060e976d6451e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f332effd640 1 -- 172.21.15.79:0/1442254968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3318037070 con 0x7f333015f1a0 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f332effd640 1 -- 172.21.15.79:0/1442254968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3318032440 con 0x7f333015f1a0 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f332effd640 1 -- 172.21.15.79:0/1442254968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3318032810 con 0x7f333015f1a0 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f333604d640 1 -- 172.21.15.79:0/1442254968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 msgr2=0x7f33300d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f333604d640 1 --2- 172.21.15.79:0/1442254968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33300d1fc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f33180097a0 tx=0x7f331802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f333604d640 1 -- 172.21.15.79:0/1442254968 shutdown_connections 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f333604d640 1 --2- 172.21.15.79:0/1442254968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33300d1fc0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f333604d640 1 -- 172.21.15.79:0/1442254968 >> 172.21.15.79:0/1442254968 conn(0x7f333009d3f0 msgr2=0x7f33300d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.906+0000 7f333604d640 1 -- 172.21.15.79:0/1442254968 shutdown_connections 2024-06-10T00:21:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.907+0000 7f333604d640 1 -- 172.21.15.79:0/1442254968 wait complete. 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f333604d640 1 Processor -- start 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f333604d640 1 -- start start 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f333604d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33300cef70 0x7f33300a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f333604d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33300d2680 0x7f33300b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f333604d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33301f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f333604d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33300d4f00 con 0x7f333015f1a0 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f333604d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33300d1070 con 0x7f33300cef70 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f333604d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f33300d1870 con 0x7f33300d2680 2024-06-10T00:21:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f332ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33301f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f332ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33301f7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60184/0 (socket says 172.21.15.79:60184) 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.908+0000 7f332ffff640 1 -- 172.21.15.79:0/2329798376 learned_addr learned my addr 172.21.15.79:0/2329798376 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332f7fe640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33300cef70 0x7f33300a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f3327fff640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33300d2680 0x7f33300b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332ffff640 1 -- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33300d2680 msgr2=0x7f33300b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332ffff640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33300d2680 0x7f33300b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332ffff640 1 -- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33300cef70 msgr2=0x7f33300a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332ffff640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33300cef70 0x7f33300a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332ffff640 1 -- 172.21.15.79:0/2329798376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33300b7610 con 0x7f333015f1a0 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332f7fe640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33300cef70 0x7f33300a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332ffff640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33301f7c20 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f332800c7e0 tx=0x7f332800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332cff9640 1 -- 172.21.15.79:0/2329798376 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328018070 con 0x7f333015f1a0 2024-06-10T00:21:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332cff9640 1 -- 172.21.15.79:0/2329798376 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332800a640 con 0x7f333015f1a0 2024-06-10T00:21:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33300b78f0 con 0x7f333015f1a0 2024-06-10T00:21:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f332cff9640 1 -- 172.21.15.79:0/2329798376 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332800aa30 con 0x7f333015f1a0 2024-06-10T00:21:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.909+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33300b7eb0 con 0x7f333015f1a0 2024-06-10T00:21:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.910+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3330068430 con 0x7f333015f1a0 2024-06-10T00:21:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.911+0000 7f332cff9640 1 -- 172.21.15.79:0/2329798376 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f332801b070 con 0x7f333015f1a0 2024-06-10T00:21:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.911+0000 7f332cff9640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f331006be30 0x7f331006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:10.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.911+0000 7f332cff9640 1 -- 172.21.15.79:0/2329798376 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f332808a5f0 con 0x7f333015f1a0 2024-06-10T00:21:10.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.911+0000 7f332f7fe640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f331006be30 0x7f331006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:10.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.911+0000 7f332f7fe640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f331006be30 0x7f331006e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3320003eb0 tx=0x7f3320009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:10.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:10.915+0000 7f332cff9640 1 -- 172.21.15.79:0/2329798376 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3328058e50 con 0x7f333015f1a0 2024-06-10T00:21:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.127+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f33300d04e0 con 0x7f333015f1a0 2024-06-10T00:21:11.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.127+0000 7f332cff9640 1 -- 172.21.15.79:0/2329798376 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f3328058750 con 0x7f333015f1a0 2024-06-10T00:21:11.270 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:11.270 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-06-10T00:21:11.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f331006be30 msgr2=0x7f331006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f331006be30 0x7f331006e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3320003eb0 tx=0x7f3320009040 comp rx=0 tx=0).stop 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 msgr2=0x7f33301f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33301f7c20 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f332800c7e0 tx=0x7f332800cca0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 shutdown_connections 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f331006be30 0x7f331006e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f333015f1a0 0x7f33301f7c20 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33300d2680 0x7f33300b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 --2- 172.21.15.79:0/2329798376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33300cef70 0x7f33300a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 >> 172.21.15.79:0/2329798376 conn(0x7f333009d3f0 msgr2=0x7f333015d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 shutdown_connections 2024-06-10T00:21:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.129+0000 7f333604d640 1 -- 172.21.15.79:0/2329798376 wait complete. 2024-06-10T00:21:11.273 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-06-10T00:21:11.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:11.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-06-10T00:21:11.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.379+0000 7ff869493640 1 Processor -- start 2024-06-10T00:21:11.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.379+0000 7ff869493640 1 -- start start 2024-06-10T00:21:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.379+0000 7ff869493640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8641619d0 0x7ff8640b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff869493640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8640d0ac0 0x7ff8640d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff869493640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff864161db0 con 0x7ff8640b5050 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff869493640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff8640d1450 con 0x7ff8641619d0 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff869493640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff8640d1c80 con 0x7ff8640d0ac0 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff862ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8641619d0 0x7ff8640b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff8627fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff8640b5050 0x7ff8640d49d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54852/0 (socket says 172.21.15.79:54852) 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff862ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8641619d0 0x7ff8640b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60190/0 (socket says 172.21.15.79:60190) 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff8627fc640 1 -- 172.21.15.79:0/2259603105 learned_addr learned my addr 172.21.15.79:0/2259603105 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff862ffd640 1 -- 172.21.15.79:0/2259603105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8640d0ac0 msgr2=0x7ff8640d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff862ffd640 1 --2- 172.21.15.79:0/2259603105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8640d0ac0 0x7ff8640d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff862ffd640 1 -- 172.21.15.79:0/2259603105 >> v1:172.21.15.79:6789/0 conn(0x7ff8640b5050 legacy=0x7ff8640d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff862ffd640 1 -- 172.21.15.79:0/2259603105 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8640cf930 con 0x7ff8641619d0 2024-06-10T00:21:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.380+0000 7ff861ffb640 1 -- 172.21.15.79:0/2259603105 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758247658 0 0) 0x7ff864161db0 con 0x7ff8640b5050 2024-06-10T00:21:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff862ffd640 1 --2- 172.21.15.79:0/2259603105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8641619d0 0x7ff8640b6f00 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff8540097a0 tx=0x7ff85402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5066fb1df0d6ec server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff861ffb640 1 -- 172.21.15.79:0/2259603105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854037070 con 0x7ff8641619d0 2024-06-10T00:21:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff861ffb640 1 -- 172.21.15.79:0/2259603105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff854032440 con 0x7ff8641619d0 2024-06-10T00:21:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff861ffb640 1 -- 172.21.15.79:0/2259603105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854032810 con 0x7ff8641619d0 2024-06-10T00:21:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff869493640 1 -- 172.21.15.79:0/2259603105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8641619d0 msgr2=0x7ff8640b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff869493640 1 --2- 172.21.15.79:0/2259603105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8641619d0 0x7ff8640b6f00 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff8540097a0 tx=0x7ff85402a180 comp rx=0 tx=0).stop 2024-06-10T00:21:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff869493640 1 -- 172.21.15.79:0/2259603105 shutdown_connections 2024-06-10T00:21:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff869493640 1 --2- 172.21.15.79:0/2259603105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8640d0ac0 0x7ff8640d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff869493640 1 --2- 172.21.15.79:0/2259603105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8641619d0 0x7ff8640b6f00 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff869493640 1 -- 172.21.15.79:0/2259603105 >> 172.21.15.79:0/2259603105 conn(0x7ff86409d3f0 msgr2=0x7ff8640d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff869493640 1 -- 172.21.15.79:0/2259603105 shutdown_connections 2024-06-10T00:21:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.381+0000 7ff869493640 1 -- 172.21.15.79:0/2259603105 wait complete. 2024-06-10T00:21:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff869493640 1 Processor -- start 2024-06-10T00:21:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff869493640 1 -- start start 2024-06-10T00:21:11.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff869493640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8640b5050 0x7ff8640c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff869493640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8640d0ac0 0x7ff8641551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff869493640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8641619d0 0x7ff8640ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff869493640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff8640d1ed0 con 0x7ff8640b5050 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff869493640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8640cfef0 con 0x7ff8640d0ac0 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff869493640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff8640d23f0 con 0x7ff8641619d0 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff862ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8640b5050 0x7ff8640c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff862ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8640b5050 0x7ff8640c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60204/0 (socket says 172.21.15.79:60204) 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.383+0000 7ff862ffd640 1 -- 172.21.15.79:0/3597490059 learned_addr learned my addr 172.21.15.79:0/3597490059 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff8637fe640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8641619d0 0x7ff8640ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff8627fc640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8640d0ac0 0x7ff8641551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff862ffd640 1 -- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8641619d0 msgr2=0x7ff8640ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff862ffd640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8641619d0 0x7ff8640ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff862ffd640 1 -- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8640d0ac0 msgr2=0x7ff8641551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff862ffd640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8640d0ac0 0x7ff8641551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff862ffd640 1 -- 172.21.15.79:0/3597490059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8640c8800 con 0x7ff8640b5050 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff8637fe640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8641619d0 0x7ff8640ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff8627fc640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8640d0ac0 0x7ff8641551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff862ffd640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8640b5050 0x7ff8640c92a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff854035040 tx=0x7ff8540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff84b7fe640 1 -- 172.21.15.79:0/3597490059 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854037040 con 0x7ff8640b5050 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff84b7fe640 1 -- 172.21.15.79:0/3597490059 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff854004250 con 0x7ff8640b5050 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff869493640 1 -- 172.21.15.79:0/3597490059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8640cde50 con 0x7ff8640b5050 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff84b7fe640 1 -- 172.21.15.79:0/3597490059 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854032e20 con 0x7ff8640b5050 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.384+0000 7ff869493640 1 -- 172.21.15.79:0/3597490059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8640c8d80 con 0x7ff8640b5050 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.386+0000 7ff84b7fe640 1 -- 172.21.15.79:0/3597490059 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff854030770 con 0x7ff8640b5050 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.386+0000 7ff84b7fe640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff85006be30 0x7ff85006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.386+0000 7ff84b7fe640 1 -- 172.21.15.79:0/3597490059 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7ff8540ac2e0 con 0x7ff8640b5050 2024-06-10T00:21:11.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.386+0000 7ff8627fc640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff85006be30 0x7ff85006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.386+0000 7ff8627fc640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff85006be30 0x7ff85006e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff8641f7890 tx=0x7ff858009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.387+0000 7ff86c1a0740 1 Processor -- start 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.387+0000 7ff86c1a0740 1 -- start start 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d535aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d5355f70 0x5605d535b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d535d4a0 0x5605d535b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5605d52bea70 con 0x5605d535d4a0 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5605d525cca0 con 0x5605d5355f70 2024-06-10T00:21:11.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5605d52baa30 con 0x5605d537e8c0 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8637fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d535d4a0 0x5605d535b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8637fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d535d4a0 0x5605d535b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60220/0 (socket says 172.21.15.79:60220) 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8637fe640 1 -- 172.21.15.79:0/2735948176 learned_addr learned my addr 172.21.15.79:0/2735948176 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff862ffd640 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d535aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8627fc640 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d5355f70 0x5605d535b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8637fe640 1 -- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 msgr2=0x5605d535aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8637fe640 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d535aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8637fe640 1 -- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d5355f70 msgr2=0x5605d535b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8637fe640 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d5355f70 0x5605d535b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8637fe640 1 -- 172.21.15.79:0/2735948176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d5287eb0 con 0x5605d535d4a0 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff862ffd640 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d535aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.388+0000 7ff8627fc640 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d5355f70 0x5605d535b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff8637fe640 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d535d4a0 0x5605d535b970 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff85c007f30 tx=0x7ff85c00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2624c054550b3eb4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff848ff9640 1 -- 172.21.15.79:0/2735948176 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c014070 con 0x5605d535d4a0 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff848ff9640 1 -- 172.21.15.79:0/2735948176 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85c00f850 con 0x5605d535d4a0 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff848ff9640 1 -- 172.21.15.79:0/2735948176 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00fc20 con 0x5605d535d4a0 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff86c1a0740 1 -- 172.21.15.79:0/2735948176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d535d4a0 msgr2=0x5605d535b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d535d4a0 0x5605d535b970 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff85c007f30 tx=0x7ff85c00c750 comp rx=0 tx=0).stop 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff86c1a0740 1 -- 172.21.15.79:0/2735948176 shutdown_connections 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d535d4a0 0x5605d535b970 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d5355f70 0x5605d535b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/2735948176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d535aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff86c1a0740 1 -- 172.21.15.79:0/2735948176 >> 172.21.15.79:0/2735948176 conn(0x5605d53581e0 msgr2=0x5605d53a0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.389+0000 7ff86c1a0740 1 -- 172.21.15.79:0/2735948176 shutdown_connections 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.390+0000 7ff86c1a0740 1 -- 172.21.15.79:0/2735948176 wait complete. 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.390+0000 7ff86c1a0740 1 -- start start 2024-06-10T00:21:11.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.390+0000 7ff86c1a0740 1 Processor -- start 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d537e8c0 0x5605d53749a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53775f0 0x5605d535ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d53779d0 0x5605d535b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5605d53599b0 con 0x5605d53775f0 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5605d5247e50 con 0x5605d537e8c0 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5605d537eca0 con 0x5605d53779d0 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff86c1a0740 10 client.0 _ll_register_callbacks cb 0x5605d4fd1c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53775f0 0x5605d535ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53775f0 0x5605d535ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60236/0 (socket says 172.21.15.79:60236) 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 -- 172.21.15.79:0/1650507644 learned_addr learned my addr 172.21.15.79:0/1650507644 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff862ffd640 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d537e8c0 0x5605d53749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8637fe640 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d53779d0 0x5605d535b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 -- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d53779d0 msgr2=0x5605d535b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d53779d0 0x5605d535b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 -- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d537e8c0 msgr2=0x5605d53749a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d537e8c0 0x5605d53749a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 -- 172.21.15.79:0/1650507644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d509a7e0 con 0x5605d53775f0 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8637fe640 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d53779d0 0x5605d535b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff8627fc640 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53775f0 0x5605d535ac90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff858000f60 tx=0x7ff858000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694e3dcf7a40c0be server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.391+0000 7ff841ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff841ffb640 1 -- 172.21.15.79:0/1650507644 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858026060 con 0x5605d53775f0 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff841ffb640 1 -- 172.21.15.79:0/1650507644 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7ff858021c70 con 0x5605d53775f0 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1650507644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff85c00f850 con 0x5605d53775f0 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff841ffb640 1 -- 172.21.15.79:0/1650507644 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff8580013d0 con 0x5605d53775f0 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 10 client.7266 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:11.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1650507644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x5605d50faf70 con 0x5605d53775f0 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff841ffb640 1 -- 172.21.15.79:0/1650507644 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85c00f850 con 0x5605d53775f0 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff841ffb640 1 -- 172.21.15.79:0/1650507644 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7ff858012410 con 0x5605d53775f0 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 10 client.7266 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 10 client.7266 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 20 client.7266 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5605d53b1660 0x5605d53b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 4 client.7266 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1650507644 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605d52cc1a0 con 0x5605d53b1660 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff862ffd640 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5605d53b1660 0x5605d53b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff841ffb640 10 client.7266 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.392+0000 7ff862ffd640 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5605d53b1660 0x5605d53b1ac0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c10ee9a66feb8a9 server_cookie=1f37e2ec9f47412f in_seq=0 out_seq=0 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff841ffb640 1 -- 172.21.15.79:0/1650507644 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5605d52cc1a0 con 0x5605d53b1660 2024-06-10T00:21:11.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff841ffb640 10 client.7266 handle_command_reply: tid=0 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 client.7266 shutdown 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1650507644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53775f0 msgr2=0x5605d535ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53775f0 0x5605d535ac90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff858000f60 tx=0x7ff858000ed0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1650507644 shutdown_connections 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5605d53b1660 0x5605d53b1ac0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d53779d0 0x5605d535b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53775f0 0x5605d535ac90 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff841ffb640 0 client.7266 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1650507644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d537e8c0 0x5605d53749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1650507644 >> 172.21.15.79:0/1650507644 conn(0x5605d535d4a0 msgr2=0x5605d5359e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1650507644 shutdown_connections 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1650507644 wait complete. 2024-06-10T00:21:11.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.393+0000 7ff86c1a0740 20 client.7266 trim_cache size 0 max 16384 2024-06-10T00:21:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.411+0000 7ff86c1a0740 1 Processor -- start 2024-06-10T00:21:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.411+0000 7ff86c1a0740 1 -- start start 2024-06-10T00:21:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d53769d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d537e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53c5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff864200db0 con 0x5605d53779d0 2024-06-10T00:21:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8641ffe50 con 0x5605d53775f0 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff8640cc010 con 0x5605d537e8c0 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8627fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d537e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8627fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d537e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60250/0 (socket says 172.21.15.79:60250) 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8627fc640 1 -- 172.21.15.79:0/3856677420 learned_addr learned my addr 172.21.15.79:0/3856677420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8637fe640 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff862ffd640 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d53769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8627fc640 1 -- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 msgr2=0x5605d53c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8627fc640 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8627fc640 1 -- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 msgr2=0x5605d53769d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8627fc640 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d53769d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff8627fc640 1 -- 172.21.15.79:0/3856677420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d4f92170 con 0x5605d53779d0 2024-06-10T00:21:11.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.412+0000 7ff862ffd640 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d53769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff8627fc640 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d537e0e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff85800dfe0 tx=0x7ff85801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c24b813ecd1dd7d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff843fff640 1 -- 172.21.15.79:0/3856677420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858012960 con 0x5605d53779d0 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff843fff640 1 -- 172.21.15.79:0/3856677420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff858012b00 con 0x5605d53779d0 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff843fff640 1 -- 172.21.15.79:0/3856677420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858012cb0 con 0x5605d53779d0 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 -- 172.21.15.79:0/3856677420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 msgr2=0x5605d537e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d537e0e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff85800dfe0 tx=0x7ff85801e000 comp rx=0 tx=0).stop 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 -- 172.21.15.79:0/3856677420 shutdown_connections 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d537e0e0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/3856677420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d53769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 -- 172.21.15.79:0/3856677420 >> 172.21.15.79:0/3856677420 conn(0x5605d535d4a0 msgr2=0x5605d53747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 -- 172.21.15.79:0/3856677420 shutdown_connections 2024-06-10T00:21:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.413+0000 7ff86c1a0740 1 -- 172.21.15.79:0/3856677420 wait complete. 2024-06-10T00:21:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.414+0000 7ff86c1a0740 1 -- start start 2024-06-10T00:21:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.414+0000 7ff86c1a0740 1 Processor -- start 2024-06-10T00:21:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d541ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d535b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53a1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5605d53a4210 con 0x5605d53779d0 2024-06-10T00:21:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8640cc660 con 0x5605d53775f0 2024-06-10T00:21:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5605d535bed0 con 0x5605d537e8c0 2024-06-10T00:21:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 10 client.0 _ll_register_callbacks cb 0x7ff858001e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d535b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d535b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60252/0 (socket says 172.21.15.79:60252) 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 -- 172.21.15.79:0/1018219962 learned_addr learned my addr 172.21.15.79:0/1018219962 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff862ffd640 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d541ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8637fe640 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 -- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 msgr2=0x5605d53a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 -- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 msgr2=0x5605d541ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d541ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 -- 172.21.15.79:0/1018219962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d535b700 con 0x5605d53779d0 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8637fe640 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff8627fc640 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d535b1c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff858001050 tx=0x7ff858007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46313a39fb07d15d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff841ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff841ffb640 1 -- 172.21.15.79:0/1018219962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85803d060 con 0x5605d53779d0 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff841ffb640 1 -- 172.21.15.79:0/1018219962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7ff858026a00 con 0x5605d53779d0 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1018219962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff858012b00 con 0x5605d53779d0 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff841ffb640 1 -- 172.21.15.79:0/1018219962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff858012590 con 0x5605d53779d0 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 10 client.7272 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.415+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1018219962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x5605d53a08a0 con 0x5605d53779d0 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff841ffb640 1 -- 172.21.15.79:0/1018219962 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff858012b00 con 0x5605d53779d0 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff841ffb640 1 -- 172.21.15.79:0/1018219962 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7ff858026c00 con 0x5605d53779d0 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff86c1a0740 10 client.7272 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff86c1a0740 10 client.7272 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff86c1a0740 20 client.7272 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5605d53506f0 0x5605d537c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff86c1a0740 4 client.7272 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-06-10T00:21:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1018219962 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x5605d52c64f0 con 0x5605d53506f0 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff862ffd640 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5605d53506f0 0x5605d537c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff841ffb640 10 client.7272 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.416+0000 7ff862ffd640 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5605d53506f0 0x5605d537c920 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bb5e4c956a7ff4b server_cookie=a234238d11462154 in_seq=0 out_seq=0 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff841ffb640 1 -- 172.21.15.79:0/1018219962 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5605d52c64f0 con 0x5605d53506f0 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff841ffb640 10 client.7272 handle_command_reply: tid=0 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 client.7272 shutdown 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1018219962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 msgr2=0x5605d535b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d535b1c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff858001050 tx=0x7ff858007000 comp rx=0 tx=0).stop 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1018219962 shutdown_connections 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x5605d53506f0 0x5605d537c920 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5605d537e8c0 0x5605d53a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605d53779d0 0x5605d535b1c0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 --2- 172.21.15.79:0/1018219962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605d53775f0 0x5605d541ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff841ffb640 0 client.7272 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1018219962 >> 172.21.15.79:0/1018219962 conn(0x5605d535d4a0 msgr2=0x5605d53a1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1018219962 shutdown_connections 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 1 -- 172.21.15.79:0/1018219962 wait complete. 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff86c1a0740 20 client.7272 trim_cache size 0 max 16384 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "55e4b669-029c-4daa-9bca-b4c89e6e17c4", 2024-06-10T00:21:11.424 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:21:11.425 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:21:11.425 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:21:11.417+0000 7fc6fb17c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 pv16 ap=3 DIRTYPARENT f(v0 m2024-06-10T00:20:31.012057+0000 1=1+0)->f(v1 m2024-06-10T00:20:31.012057+0000) n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1)->n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x56011f4e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-06-10T00:20:31.012057+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff869493640 1 -- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff85006be30 msgr2=0x7ff85006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff869493640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff85006be30 0x7ff85006e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff8641f7890 tx=0x7ff858009040 comp rx=0 tx=0).stop 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff869493640 1 -- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8640b5050 msgr2=0x7ff8640c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.417+0000 7ff869493640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8640b5050 0x7ff8640c92a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff854035040 tx=0x7ff8540046c0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.418+0000 7ff869493640 1 -- 172.21.15.79:0/3597490059 shutdown_connections 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.418+0000 7ff869493640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff85006be30 0x7ff85006e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.418+0000 7ff869493640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8641619d0 0x7ff8640ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.418+0000 7ff869493640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8640d0ac0 0x7ff8641551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.418+0000 7ff869493640 1 --2- 172.21.15.79:0/3597490059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8640b5050 0x7ff8640c92a0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.418+0000 7ff869493640 1 -- 172.21.15.79:0/3597490059 >> 172.21.15.79:0/3597490059 conn(0x7ff86409d3f0 msgr2=0x7ff86406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.418+0000 7ff869493640 1 -- 172.21.15.79:0/3597490059 shutdown_connections 2024-06-10T00:21:11.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.418+0000 7ff869493640 1 -- 172.21.15.79:0/3597490059 wait complete. 2024-06-10T00:21:11.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:11.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-06-10T00:21:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.530+0000 7f7243231640 1 Processor -- start 2024-06-10T00:21:11.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.530+0000 7f7243231640 1 -- start start 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f7243231640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f723c154c20 0x7f723c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f7243231640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f723c0b3a20 0x7f723c06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f7243231640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f723c155000 con 0x7f723c06d500 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f7243231640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f723c06dd30 con 0x7f723c154c20 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f7243231640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f723c06e010 con 0x7f723c0b3a20 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f7240fcd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f723c154c20 0x7f723c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f7240fcd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f723c154c20 0x7f723c0b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60262/0 (socket says 172.21.15.79:60262) 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f7240fcd640 1 -- 172.21.15.79:0/262219751 learned_addr learned my addr 172.21.15.79:0/262219751 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.531+0000 7f723bfff640 1 --2- 172.21.15.79:0/262219751 >> v2:172.21.15.117:3300/0 conn(0x7f723c0b3a20 0x7f723c06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.532+0000 7f7240fcd640 1 -- 172.21.15.79:0/262219751 >> v2:172.21.15.117:3300/0 conn(0x7f723c0b3a20 msgr2=0x7f723c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.532+0000 7f7240fcd640 1 --2- 172.21.15.79:0/262219751 >> v2:172.21.15.117:3300/0 conn(0x7f723c0b3a20 0x7f723c06cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.532+0000 7f7240fcd640 1 -- 172.21.15.79:0/262219751 >> v1:172.21.15.117:6789/0 conn(0x7f723c06d500 legacy=0x7f723c15e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.532+0000 7f7240fcd640 1 -- 172.21.15.79:0/262219751 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c06e2f0 con 0x7f723c154c20 2024-06-10T00:21:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.532+0000 7f7240fcd640 1 --2- 172.21.15.79:0/262219751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c0b34e0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f723c0cf710 tx=0x7f722c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27963166ccb26708 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.532+0000 7f723b7fe640 1 -- 172.21.15.79:0/262219751 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c037070 con 0x7f723c154c20 2024-06-10T00:21:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.532+0000 7f723b7fe640 1 -- 172.21.15.79:0/262219751 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c032440 con 0x7f723c154c20 2024-06-10T00:21:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.532+0000 7f723b7fe640 1 -- 172.21.15.79:0/262219751 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c032810 con 0x7f723c154c20 2024-06-10T00:21:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.533+0000 7f7243231640 1 -- 172.21.15.79:0/262219751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 msgr2=0x7f723c0b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.533+0000 7f7243231640 1 --2- 172.21.15.79:0/262219751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c0b34e0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f723c0cf710 tx=0x7f722c02a230 comp rx=0 tx=0).stop 2024-06-10T00:21:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.533+0000 7f7243231640 1 -- 172.21.15.79:0/262219751 shutdown_connections 2024-06-10T00:21:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.533+0000 7f7243231640 1 --2- 172.21.15.79:0/262219751 >> v2:172.21.15.117:3300/0 conn(0x7f723c0b3a20 0x7f723c06cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.533+0000 7f7243231640 1 --2- 172.21.15.79:0/262219751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c0b34e0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.533+0000 7f7243231640 1 -- 172.21.15.79:0/262219751 >> 172.21.15.79:0/262219751 conn(0x7f723c0b1d10 msgr2=0x7f723c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.533+0000 7f7243231640 1 -- 172.21.15.79:0/262219751 shutdown_connections 2024-06-10T00:21:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.533+0000 7f7243231640 1 -- 172.21.15.79:0/262219751 wait complete. 2024-06-10T00:21:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.534+0000 7f7243231640 1 Processor -- start 2024-06-10T00:21:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.534+0000 7f7243231640 1 -- start start 2024-06-10T00:21:11.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f7243231640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723c06d500 0x7f723c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f7243231640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c0b3a20 0x7f723c153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f7243231640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c1f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f7243231640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f723c06daf0 con 0x7f723c154c20 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f7243231640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f723c06d970 con 0x7f723c0b3a20 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f7243231640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f723c072560 con 0x7f723c06d500 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f72417ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c1f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f72417ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c1f4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60274/0 (socket says 172.21.15.79:60274) 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f72417ce640 1 -- 172.21.15.79:0/1898811842 learned_addr learned my addr 172.21.15.79:0/1898811842 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f723bfff640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c0b3a20 0x7f723c153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723c06d500 0x7f723c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f72417ce640 1 -- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723c06d500 msgr2=0x7f723c14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.535+0000 7f72417ce640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723c06d500 0x7f723c14d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f72417ce640 1 -- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c0b3a20 msgr2=0x7f723c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f72417ce640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c0b3a20 0x7f723c153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f72417ce640 1 -- 172.21.15.79:0/1898811842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c150b90 con 0x7f723c154c20 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723c06d500 0x7f723c14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f72417ce640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c1f4f10 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f723400c780 tx=0x7f723400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f72397fa640 1 -- 172.21.15.79:0/1898811842 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234004b60 con 0x7f723c154c20 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f72397fa640 1 -- 172.21.15.79:0/1898811842 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7234004d00 con 0x7f723c154c20 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f7243231640 1 -- 172.21.15.79:0/1898811842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c1f5d60 con 0x7f723c154c20 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f72397fa640 1 -- 172.21.15.79:0/1898811842 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723400aa90 con 0x7f723c154c20 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.536+0000 7f7243231640 1 -- 172.21.15.79:0/1898811842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c152650 con 0x7f723c154c20 2024-06-10T00:21:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.537+0000 7f72397fa640 1 -- 172.21.15.79:0/1898811842 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f723400ac30 con 0x7f723c154c20 2024-06-10T00:21:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.538+0000 7f72397fa640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f722806be30 0x7f722806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.538+0000 7f72397fa640 1 -- 172.21.15.79:0/1898811842 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f723408b4d0 con 0x7f723c154c20 2024-06-10T00:21:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.538+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f722806be30 0x7f722806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.538+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f722806be30 0x7f722806e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f722c034000 tx=0x7f722c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.539+0000 7f7246018740 1 Processor -- start 2024-06-10T00:21:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.539+0000 7f7246018740 1 -- start start 2024-06-10T00:21:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7246018740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b0ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7246018740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b0e91a0 0x55f42b0ee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7246018740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b0f06d0 0x55f42b0eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7246018740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f42b0137e0 con 0x55f42b111af0 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7246018740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f42b051e80 con 0x55f42b0f06d0 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7246018740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f42afef700 con 0x55f42b0e91a0 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b0ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b0ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60288/0 (socket says 172.21.15.79:60288) 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 -- 172.21.15.79:0/1865176100 learned_addr learned my addr 172.21.15.79:0/1865176100 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 -- 172.21.15.79:0/1865176100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b0e91a0 msgr2=0x55f42b0ee660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1865176100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b0e91a0 0x55f42b0ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 -- 172.21.15.79:0/1865176100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b0f06d0 msgr2=0x55f42b0eeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1865176100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b0f06d0 0x55f42b0eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 -- 172.21.15.79:0/1865176100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42b00edd0 con 0x55f42b111af0 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1865176100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b0ee120 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f722c02a270 tx=0x7f722c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a036e729682b7e61 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f72227fc640 1 -- 172.21.15.79:0/1865176100 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c037040 con 0x55f42b111af0 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f72227fc640 1 -- 172.21.15.79:0/1865176100 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c03e660 con 0x55f42b111af0 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.540+0000 7f72227fc640 1 -- 172.21.15.79:0/1865176100 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c03ea10 con 0x55f42b111af0 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 -- 172.21.15.79:0/1865176100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 msgr2=0x55f42b0ee120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 --2- 172.21.15.79:0/1865176100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b0ee120 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f722c02a270 tx=0x7f722c02c000 comp rx=0 tx=0).stop 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 -- 172.21.15.79:0/1865176100 shutdown_connections 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 --2- 172.21.15.79:0/1865176100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b0f06d0 0x55f42b0eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 --2- 172.21.15.79:0/1865176100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b0e91a0 0x55f42b0ee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 --2- 172.21.15.79:0/1865176100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b0ee120 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 -- 172.21.15.79:0/1865176100 >> 172.21.15.79:0/1865176100 conn(0x55f42b0eb410 msgr2=0x55f42b133f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 -- 172.21.15.79:0/1865176100 shutdown_connections 2024-06-10T00:21:11.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.541+0000 7f7246018740 1 -- 172.21.15.79:0/1865176100 wait complete. 2024-06-10T00:21:11.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.542+0000 7f7246018740 1 -- start start 2024-06-10T00:21:11.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.542+0000 7f7246018740 1 Processor -- start 2024-06-10T00:21:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b111af0 0x55f42b115e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b10e8c0 0x55f42b116f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b1130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f42afda640 con 0x55f42b117490 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f42b04de40 con 0x55f42b10e8c0 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f42b0ecbe0 con 0x55f42b111af0 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 10 client.0 _ll_register_callbacks cb 0x55f42b00c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b1130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b1130b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60298/0 (socket says 172.21.15.79:60298) 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 -- 172.21.15.79:0/1506971449 learned_addr learned my addr 172.21.15.79:0/1506971449 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b111af0 0x55f42b115e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f723bfff640 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b10e8c0 0x55f42b116f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 -- 172.21.15.79:0/1506971449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b111af0 msgr2=0x55f42b115e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b111af0 0x55f42b115e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 -- 172.21.15.79:0/1506971449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b10e8c0 msgr2=0x55f42b116f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b10e8c0 0x55f42b116f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 -- 172.21.15.79:0/1506971449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42ae2f7d0 con 0x55f42b117490 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f72417ce640 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b1130b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f7234059530 tx=0x7f7234059ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b363a7f9d9ed3c1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f721b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f721b7fe640 1 -- 172.21.15.79:0/1506971449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234062180 con 0x55f42b117490 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f721b7fe640 1 -- 172.21.15.79:0/1506971449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f7234059800 con 0x55f42b117490 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 1 -- 172.21.15.79:0/1506971449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f722c03e660 con 0x55f42b117490 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f721b7fe640 1 -- 172.21.15.79:0/1506971449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7234076050 con 0x55f42b117490 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 10 client.7284 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f7246018740 1 -- 172.21.15.79:0/1506971449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55f42ad653f0 con 0x55f42b117490 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.543+0000 7f721b7fe640 1 -- 172.21.15.79:0/1506971449 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c03e660 con 0x55f42b117490 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f721b7fe640 1 -- 172.21.15.79:0/1506971449 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7f7234023060 con 0x55f42b117490 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f7246018740 10 client.7284 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:11.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f7246018740 10 client.7284 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f7246018740 20 client.7284 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f7246018740 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55f42b113ac0 0x55f42b11af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f7246018740 4 client.7284 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f7246018740 1 -- 172.21.15.79:0/1506971449 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f42b05f5b0 con 0x55f42b113ac0 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55f42b113ac0 0x55f42b11af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f721b7fe640 10 client.7284 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f7240fcd640 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55f42b113ac0 0x55f42b11af10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc164558e3eff88f server_cookie=8d4e6e25fb0ba579 in_seq=0 out_seq=0 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f721b7fe640 1 -- 172.21.15.79:0/1506971449 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f42b05f5b0 con 0x55f42b113ac0 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.544+0000 7f721b7fe640 10 client.7284 handle_command_reply: tid=0 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 client.7284 shutdown 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 -- 172.21.15.79:0/1506971449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 msgr2=0x55f42b1130b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b1130b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f7234059530 tx=0x7f7234059ca0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 -- 172.21.15.79:0/1506971449 shutdown_connections 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55f42b113ac0 0x55f42b11af10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b1130b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f721b7fe640 0 client.7284 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b10e8c0 0x55f42b116f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 --2- 172.21.15.79:0/1506971449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b111af0 0x55f42b115e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 -- 172.21.15.79:0/1506971449 >> 172.21.15.79:0/1506971449 conn(0x55f42b0f06d0 msgr2=0x55f42b110170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 -- 172.21.15.79:0/1506971449 shutdown_connections 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 1 -- 172.21.15.79:0/1506971449 wait complete. 2024-06-10T00:21:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.545+0000 7f7246018740 20 client.7284 trim_cache size 0 max 16384 2024-06-10T00:21:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.563+0000 7f7246018740 1 Processor -- start 2024-06-10T00:21:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.563+0000 7f7246018740 1 -- start start 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7246018740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 0x55f42b119b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7246018740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b110170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7246018740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b117490 0x55f42b1106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7246018740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1fec90 con 0x55f42b111af0 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7246018740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f723c0b1280 con 0x55f42b117490 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7246018740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f723c148a90 con 0x55f42b10e8c0 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60304/0 (socket says 172.21.15.79:60304) 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 -- 172.21.15.79:0/3611823921 learned_addr learned my addr 172.21.15.79:0/3611823921 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 -- 172.21.15.79:0/3611823921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 msgr2=0x55f42b119b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 --2- 172.21.15.79:0/3611823921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 0x55f42b119b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 -- 172.21.15.79:0/3611823921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b117490 msgr2=0x55f42b1106b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 --2- 172.21.15.79:0/3611823921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b117490 0x55f42b1106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 -- 172.21.15.79:0/3611823921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42ad250f0 con 0x55f42b111af0 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f723bfff640 1 --2- 172.21.15.79:0/3611823921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b110170 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7230006fd0 tx=0x7f7230007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b721af58ac7a03c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7221ffb640 1 -- 172.21.15.79:0/3611823921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230019070 con 0x55f42b111af0 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7221ffb640 1 -- 172.21.15.79:0/3611823921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7230004240 con 0x55f42b111af0 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.564+0000 7f7221ffb640 1 -- 172.21.15.79:0/3611823921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230012750 con 0x55f42b111af0 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 -- 172.21.15.79:0/3611823921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 msgr2=0x55f42b110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 --2- 172.21.15.79:0/3611823921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b110170 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7230006fd0 tx=0x7f7230007d70 comp rx=0 tx=0).stop 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 -- 172.21.15.79:0/3611823921 shutdown_connections 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 --2- 172.21.15.79:0/3611823921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b117490 0x55f42b1106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 --2- 172.21.15.79:0/3611823921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b111af0 0x55f42b110170 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 --2- 172.21.15.79:0/3611823921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 0x55f42b119b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 -- 172.21.15.79:0/3611823921 >> 172.21.15.79:0/3611823921 conn(0x55f42b0f06d0 msgr2=0x55f42b1151e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 -- 172.21.15.79:0/3611823921 shutdown_connections 2024-06-10T00:21:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 -- 172.21.15.79:0/3611823921 wait complete. 2024-06-10T00:21:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.565+0000 7f7246018740 1 -- start start 2024-06-10T00:21:11.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f7246018740 1 Processor -- start 2024-06-10T00:21:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f7246018740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 0x55f42b1b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f7246018740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b111af0 0x55f42b0e8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f7246018740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b0e8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f7246018740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f723c0b0c30 con 0x55f42b117490 2024-06-10T00:21:11.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f7246018740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f42b115e00 con 0x55f42b111af0 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f7246018740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f42b11be00 con 0x55f42b10e8c0 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f7246018740 10 client.0 _ll_register_callbacks cb 0x7f7234059120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f72417ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b0e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f72417ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b0e8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60314/0 (socket says 172.21.15.79:60314) 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f72417ce640 1 -- 172.21.15.79:0/2635552336 learned_addr learned my addr 172.21.15.79:0/2635552336 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.566+0000 7f723bfff640 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b111af0 0x55f42b0e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7240fcd640 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 0x55f42b1b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f72417ce640 1 -- 172.21.15.79:0/2635552336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 msgr2=0x55f42b1b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f72417ce640 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 0x55f42b1b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f72417ce640 1 -- 172.21.15.79:0/2635552336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b111af0 msgr2=0x55f42b0e8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f72417ce640 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b111af0 0x55f42b0e8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f72417ce640 1 -- 172.21.15.79:0/2635552336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42b018560 con 0x55f42b117490 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f72417ce640 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b0e8650 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f7234061c50 tx=0x7f7234011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1342de5dc91eb695 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f721b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f721b7fe640 1 -- 172.21.15.79:0/2635552336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723407d020 con 0x55f42b117490 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f721b7fe640 1 -- 172.21.15.79:0/2635552336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f7234089460 con 0x55f42b117490 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 1 -- 172.21.15.79:0/2635552336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7230004240 con 0x55f42b117490 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f721b7fe640 1 -- 172.21.15.79:0/2635552336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f72340896a0 con 0x55f42b117490 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 10 client.7290 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 1 -- 172.21.15.79:0/2635552336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55f42b10d060 con 0x55f42b117490 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f721b7fe640 1 -- 172.21.15.79:0/2635552336 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7230004240 con 0x55f42b117490 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f721b7fe640 1 -- 172.21.15.79:0/2635552336 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7f7234061cf0 con 0x55f42b117490 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 10 client.7290 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 10 client.7290 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 20 client.7290 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55f42b1339b0 0x55f42b11afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 4 client.7290 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.567+0000 7f7246018740 1 -- 172.21.15.79:0/2635552336 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f42b059900 con 0x55f42b1339b0 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7240fcd640 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55f42b1339b0 0x55f42b11afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f721b7fe640 10 client.7290 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7240fcd640 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55f42b1339b0 0x55f42b11afb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22b47a1a62d1d21 server_cookie=73ef5abc7ea06f27 in_seq=0 out_seq=0 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f721b7fe640 1 -- 172.21.15.79:0/2635552336 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x55f42b059900 con 0x55f42b1339b0 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f721b7fe640 10 client.7290 handle_command_reply: tid=0 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 client.7290 shutdown 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 -- 172.21.15.79:0/2635552336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 msgr2=0x55f42b0e8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b0e8650 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f7234061c50 tx=0x7f7234011000 comp rx=0 tx=0).stop 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 -- 172.21.15.79:0/2635552336 shutdown_connections 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55f42b1339b0 0x55f42b11afb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f42b117490 0x55f42b0e8650 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42b111af0 0x55f42b0e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f721b7fe640 0 client.7290 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 --2- 172.21.15.79:0/2635552336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f42b10e8c0 0x55f42b1b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 -- 172.21.15.79:0/2635552336 >> 172.21.15.79:0/2635552336 conn(0x55f42b0f06d0 msgr2=0x55f42b119930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 -- 172.21.15.79:0/2635552336 shutdown_connections 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 1 -- 172.21.15.79:0/2635552336 wait complete. 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.568+0000 7f7246018740 20 client.7290 trim_cache size 0 max 16384 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:21:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:21:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "55e4b669-029c-4daa-9bca-b4c89e6e17c4": { 2024-06-10T00:21:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir", 2024-06-10T00:21:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "55e4b669-029c-4daa-9bca-b4c89e6e17c4", 2024-06-10T00:21:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-06-10T00:21:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:21:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:21:11.576 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 -- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f722806be30 msgr2=0x7f722806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f722806be30 0x7f722806e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f722c034000 tx=0x7f722c02e000 comp rx=0 tx=0).stop 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 -- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 msgr2=0x7f723c1f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c1f4f10 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f723400c780 tx=0x7f723400cc40 comp rx=0 tx=0).stop 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 -- 172.21.15.79:0/1898811842 shutdown_connections 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f722806be30 0x7f722806e2f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f723c154c20 0x7f723c1f4f10 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c0b3a20 0x7f723c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 --2- 172.21.15.79:0/1898811842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723c06d500 0x7f723c14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:11.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 -- 172.21.15.79:0/1898811842 >> 172.21.15.79:0/1898811842 conn(0x7f723c0b1d10 msgr2=0x7f723c09d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:11.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 -- 172.21.15.79:0/1898811842 shutdown_connections 2024-06-10T00:21:11.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:11.569+0000 7f7243231640 1 -- 172.21.15.79:0/1898811842 wait complete. 2024-06-10T00:21:11.579 INFO:tasks.cephfs.filesystem:scrub status for tag:55e4b669-029c-4daa-9bca-b4c89e6e17c4 - {'path': '/dir', 'tag': '55e4b669-029c-4daa-9bca-b4c89e6e17c4', 'options': 'recursive,repair'} 2024-06-10T00:21:14.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:21:14.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:21:41.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:41.580 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-06-10T00:21:41.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.693+0000 7fd9004d4640 1 Processor -- start 2024-06-10T00:21:41.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.693+0000 7fd9004d4640 1 -- start start 2024-06-10T00:21:41.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd9004d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f80b3bf0 0x7fd8f806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd9004d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8f806d500 0x7fd8f8071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd9004d4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f8155000 con 0x7fd8f8154c20 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd9004d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f806dd30 con 0x7fd8f806d500 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd9004d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f806e010 con 0x7fd8f80b3bf0 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fea71640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8f806d500 0x7fd8f8071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fea71640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8f806d500 0x7fd8f8071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41000/0 (socket says 172.21.15.79:41000) 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fea71640 1 -- 172.21.15.79:0/1588583981 learned_addr learned my addr 172.21.15.79:0/1588583981 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/1588583981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f80b3bf0 0x7fd8f806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fea71640 1 -- 172.21.15.79:0/1588583981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f80b3bf0 msgr2=0x7fd8f806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fea71640 1 --2- 172.21.15.79:0/1588583981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f80b3bf0 0x7fd8f806cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fea71640 1 -- 172.21.15.79:0/1588583981 >> v1:172.21.15.117:6789/0 conn(0x7fd8f8154c20 legacy=0x7fd8f80b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fea71640 1 -- 172.21.15.79:0/1588583981 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f806e2f0 con 0x7fd8f806d500 2024-06-10T00:21:41.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.694+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/1588583981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f80b3bf0 0x7fd8f806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:41.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.695+0000 7fd8fea71640 1 --2- 172.21.15.79:0/1588583981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f8071550 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000d150 tx=0x7fd8f002c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec2e41e3f1511b7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.695+0000 7fd8fd26e640 1 -- 172.21.15.79:0/1588583981 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000b2e0 con 0x7fd8f806d500 2024-06-10T00:21:41.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.695+0000 7fd8fd26e640 1 -- 172.21.15.79:0/1588583981 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f0009600 con 0x7fd8f806d500 2024-06-10T00:21:41.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.695+0000 7fd8fd26e640 1 -- 172.21.15.79:0/1588583981 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000b480 con 0x7fd8f806d500 2024-06-10T00:21:41.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.696+0000 7fd9004d4640 1 -- 172.21.15.79:0/1588583981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 msgr2=0x7fd8f8071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.696+0000 7fd9004d4640 1 --2- 172.21.15.79:0/1588583981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f8071550 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000d150 tx=0x7fd8f002c8e0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.696+0000 7fd9004d4640 1 -- 172.21.15.79:0/1588583981 shutdown_connections 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.696+0000 7fd9004d4640 1 --2- 172.21.15.79:0/1588583981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f8071550 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.696+0000 7fd9004d4640 1 --2- 172.21.15.79:0/1588583981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f80b3bf0 0x7fd8f806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.696+0000 7fd9004d4640 1 -- 172.21.15.79:0/1588583981 >> 172.21.15.79:0/1588583981 conn(0x7fd8f80b1d10 msgr2=0x7fd8f80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.696+0000 7fd9004d4640 1 -- 172.21.15.79:0/1588583981 shutdown_connections 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.696+0000 7fd9004d4640 1 -- 172.21.15.79:0/1588583981 wait complete. 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.697+0000 7fd9004d4640 1 Processor -- start 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.697+0000 7fd9004d4640 1 -- start start 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd9004d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f81f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd9004d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8f80b3bf0 0x7fd8f80afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd9004d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f8154c20 0x7fd8f814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd9004d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f80d0020 con 0x7fd8f806d500 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd9004d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f806d9b0 con 0x7fd8f80b3bf0 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd9004d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f80d01a0 con 0x7fd8f8154c20 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f81f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f81f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41002/0 (socket says 172.21.15.79:41002) 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 -- 172.21.15.79:0/2617565753 learned_addr learned my addr 172.21.15.79:0/2617565753 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fea71640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f8154c20 0x7fd8f814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8f80b3bf0 0x7fd8f80afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 -- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f8154c20 msgr2=0x7fd8f814ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f8154c20 0x7fd8f814ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 -- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8f80b3bf0 msgr2=0x7fd8f80afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8f80b3bf0 0x7fd8f80afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 -- 172.21.15.79:0/2617565753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f80b0780 con 0x7fd8f806d500 2024-06-10T00:21:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8f80b3bf0 0x7fd8f80afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8fe270640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f81f0660 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400b3f0 tx=0x7fd8f400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8eeffd640 1 -- 172.21.15.79:0/2617565753 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4015020 con 0x7fd8f806d500 2024-06-10T00:21:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.698+0000 7fd8eeffd640 1 -- 172.21.15.79:0/2617565753 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f4011830 con 0x7fd8f806d500 2024-06-10T00:21:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.699+0000 7fd9004d4640 1 -- 172.21.15.79:0/2617565753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f80b0a60 con 0x7fd8f806d500 2024-06-10T00:21:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.699+0000 7fd8eeffd640 1 -- 172.21.15.79:0/2617565753 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4011c20 con 0x7fd8f806d500 2024-06-10T00:21:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.699+0000 7fd9004d4640 1 -- 172.21.15.79:0/2617565753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f80b1020 con 0x7fd8f806d500 2024-06-10T00:21:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.700+0000 7fd8eeffd640 1 -- 172.21.15.79:0/2617565753 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8f4018020 con 0x7fd8f806d500 2024-06-10T00:21:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.700+0000 7fd8eeffd640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.701+0000 7fd8eeffd640 1 -- 172.21.15.79:0/2617565753 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fd8f408b070 con 0x7fd8f806d500 2024-06-10T00:21:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.701+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.701+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8006fd0 tx=0x7fd8e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.702+0000 7fd9031e7740 1 Processor -- start 2024-06-10T00:21:41.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.702+0000 7fd9031e7740 1 -- start start 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783953af0 0x564783930120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56478392b1a0 0x564783930660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5647839326d0 0x564783930ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd9031e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5647838557e0 con 0x56478392b1a0 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd9031e7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564783893e80 con 0x564783953af0 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd9031e7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x564783831700 con 0x5647839326d0 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56478392b1a0 0x564783930660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56478392b1a0 0x564783930660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41008/0 (socket says 172.21.15.79:41008) 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 -- 172.21.15.79:0/696800588 learned_addr learned my addr 172.21.15.79:0/696800588 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 -- 172.21.15.79:0/696800588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5647839326d0 msgr2=0x564783930ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/696800588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5647839326d0 0x564783930ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 -- 172.21.15.79:0/696800588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783953af0 msgr2=0x564783930120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/696800588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783953af0 0x564783930120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 -- 172.21.15.79:0/696800588 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564783850dd0 con 0x56478392b1a0 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/696800588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56478392b1a0 0x564783930660 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800db60 tx=0x7fd8e8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a39ab0a57328f8f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8dbfff640 1 -- 172.21.15.79:0/696800588 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8019050 con 0x56478392b1a0 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8dbfff640 1 -- 172.21.15.79:0/696800588 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8023070 con 0x56478392b1a0 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.703+0000 7fd8dbfff640 1 -- 172.21.15.79:0/696800588 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8012c90 con 0x56478392b1a0 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 -- 172.21.15.79:0/696800588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56478392b1a0 msgr2=0x564783930660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 --2- 172.21.15.79:0/696800588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56478392b1a0 0x564783930660 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800db60 tx=0x7fd8e8010000 comp rx=0 tx=0).stop 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 -- 172.21.15.79:0/696800588 shutdown_connections 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 --2- 172.21.15.79:0/696800588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5647839326d0 0x564783930ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 --2- 172.21.15.79:0/696800588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56478392b1a0 0x564783930660 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 --2- 172.21.15.79:0/696800588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783953af0 0x564783930120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 -- 172.21.15.79:0/696800588 >> 172.21.15.79:0/696800588 conn(0x56478392d410 msgr2=0x564783975f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 -- 172.21.15.79:0/696800588 shutdown_connections 2024-06-10T00:21:41.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.704+0000 7fd9031e7740 1 -- 172.21.15.79:0/696800588 wait complete. 2024-06-10T00:21:41.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.705+0000 7fd9031e7740 1 -- start start 2024-06-10T00:21:41.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.705+0000 7fd9031e7740 1 Processor -- start 2024-06-10T00:21:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x564783950270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783958150 0x564783985a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783950910 0x56478397c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd9031e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56478381c640 con 0x564783953af0 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd9031e7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56478388fe40 con 0x564783950910 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd9031e7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56478392ebe0 con 0x564783958150 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd9031e7740 10 client.0 _ll_register_callbacks cb 0x56478384e430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x564783950270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x564783950270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41022/0 (socket says 172.21.15.79:41022) 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 -- 172.21.15.79:0/478790277 learned_addr learned my addr 172.21.15.79:0/478790277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783958150 0x564783985a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fea71640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783950910 0x56478397c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 -- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783958150 msgr2=0x564783985a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783958150 0x564783985a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 -- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783950910 msgr2=0x56478397c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783950910 0x56478397c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 -- 172.21.15.79:0/478790277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647836717d0 con 0x564783953af0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783958150 0x564783985a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fea71640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783950910 0x56478397c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8fe270640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x564783950270 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40554e0 tx=0x7fd8f40590d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84227d4fd8542f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.706+0000 7fd8d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd8d97fa640 1 -- 172.21.15.79:0/478790277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4071070 con 0x564783953af0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd8d97fa640 1 -- 172.21.15.79:0/478790277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fd8f405d170 con 0x564783953af0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 1 -- 172.21.15.79:0/478790277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e8023070 con 0x564783953af0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd8d97fa640 1 -- 172.21.15.79:0/478790277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd8f4055740 con 0x564783953af0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 10 client.7302 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 1 -- 172.21.15.79:0/478790277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x5647835a73f0 con 0x564783953af0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd8d97fa640 1 -- 172.21.15.79:0/478790277 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8023070 con 0x564783953af0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd8d97fa640 1 -- 172.21.15.79:0/478790277 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7fd8f4058520 con 0x564783953af0 2024-06-10T00:21:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 10 client.7302 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 10 client.7302 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 20 client.7302 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x564783956370 0x564783953fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 4 client.7302 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd9031e7740 1 -- 172.21.15.79:0/478790277 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647838a15b0 con 0x564783956370 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x564783956370 0x564783953fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd8d97fa640 10 client.7302 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.707+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x564783956370 0x564783953fa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b050416608d1c8f server_cookie=91bdce05c14d00c6 in_seq=0 out_seq=0 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd8d97fa640 1 -- 172.21.15.79:0/478790277 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5647838a15b0 con 0x564783956370 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd8d97fa640 10 client.7302 handle_command_reply: tid=0 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 client.7302 shutdown 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 -- 172.21.15.79:0/478790277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 msgr2=0x564783950270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x564783950270 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40554e0 tx=0x7fd8f40590d0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 -- 172.21.15.79:0/478790277 shutdown_connections 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x564783956370 0x564783953fa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783950910 0x56478397c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783958150 0x564783985a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 --2- 172.21.15.79:0/478790277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x564783950270 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd8d97fa640 0 client.7302 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 -- 172.21.15.79:0/478790277 >> 172.21.15.79:0/478790277 conn(0x5647839326d0 msgr2=0x564783952aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 -- 172.21.15.79:0/478790277 shutdown_connections 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 1 -- 172.21.15.79:0/478790277 wait complete. 2024-06-10T00:21:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.708+0000 7fd9031e7740 20 client.7302 trim_cache size 0 max 16384 2024-06-10T00:21:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.727+0000 7fd9031e7740 1 Processor -- start 2024-06-10T00:21:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.727+0000 7fd9031e7740 1 -- start start 2024-06-10T00:21:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.727+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 0x5647839570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.727+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783953af0 0x5647839575f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.727+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783958150 0x564783954f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.727+0000 7fd9031e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81fcb80 con 0x564783958150 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.727+0000 7fd9031e7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81fbbd0 con 0x564783953af0 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.727+0000 7fd9031e7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f80adbd0 con 0x564783950910 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783958150 0x564783954f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783958150 0x564783954f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41032/0 (socket says 172.21.15.79:41032) 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 -- 172.21.15.79:0/820751347 learned_addr learned my addr 172.21.15.79:0/820751347 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 -- 172.21.15.79:0/820751347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 msgr2=0x5647839570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fe270640 1 --2- 172.21.15.79:0/820751347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 0x5647839570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 --2- 172.21.15.79:0/820751347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 0x5647839570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 -- 172.21.15.79:0/820751347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783953af0 msgr2=0x5647839575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 --2- 172.21.15.79:0/820751347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783953af0 0x5647839575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 -- 172.21.15.79:0/820751347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647835670f0 con 0x564783958150 2024-06-10T00:21:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8fea71640 1 --2- 172.21.15.79:0/820751347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783958150 0x564783954f70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd8f002ced0 tx=0x7fd8f002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23b474cbaa17536 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8db7fe640 1 -- 172.21.15.79:0/820751347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0046680 con 0x564783958150 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8db7fe640 1 -- 172.21.15.79:0/820751347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f0046820 con 0x564783958150 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.728+0000 7fd8db7fe640 1 -- 172.21.15.79:0/820751347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0046bd0 con 0x564783958150 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 -- 172.21.15.79:0/820751347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783958150 msgr2=0x564783954f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 --2- 172.21.15.79:0/820751347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783958150 0x564783954f70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd8f002ced0 tx=0x7fd8f002f000 comp rx=0 tx=0).stop 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 -- 172.21.15.79:0/820751347 shutdown_connections 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 --2- 172.21.15.79:0/820751347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783958150 0x564783954f70 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 --2- 172.21.15.79:0/820751347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783953af0 0x5647839575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 --2- 172.21.15.79:0/820751347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 0x5647839570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 -- 172.21.15.79:0/820751347 >> 172.21.15.79:0/820751347 conn(0x5647839326d0 msgr2=0x56478397d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 -- 172.21.15.79:0/820751347 shutdown_connections 2024-06-10T00:21:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 -- 172.21.15.79:0/820751347 wait complete. 2024-06-10T00:21:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 -- start start 2024-06-10T00:21:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.729+0000 7fd9031e7740 1 Processor -- start 2024-06-10T00:21:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.730+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 0x5647839574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.730+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x5647839790b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.730+0000 7fd9031e7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783958150 0x56478397a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.730+0000 7fd9031e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56478397e0a0 con 0x564783953af0 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.730+0000 7fd9031e7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81fb620 con 0x564783958150 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.730+0000 7fd9031e7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5647839766b0 con 0x564783950910 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.730+0000 7fd9031e7740 10 client.0 _ll_register_callbacks cb 0x7fd8f4017330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.730+0000 7fd8fda6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x5647839790b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fda6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x5647839790b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41044/0 (socket says 172.21.15.79:41044) 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fda6f640 1 -- 172.21.15.79:0/1557197413 learned_addr learned my addr 172.21.15.79:0/1557197413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fea71640 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783958150 0x56478397a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fe270640 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 0x5647839574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fda6f640 1 -- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 msgr2=0x5647839574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 0x5647839574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fda6f640 1 -- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783958150 msgr2=0x56478397a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783958150 0x56478397a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fda6f640 1 -- 172.21.15.79:0/1557197413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56478385a560 con 0x564783953af0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fea71640 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783958150 0x56478397a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8fda6f640 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x5647839790b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8008010 tx=0x7fd8e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bd80aa2b9fe0c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8d97fa640 1 -- 172.21.15.79:0/1557197413 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8038020 con 0x564783953af0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8d97fa640 1 -- 172.21.15.79:0/1557197413 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fd8e8012da0 con 0x564783953af0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd9031e7740 1 -- 172.21.15.79:0/1557197413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8f0046820 con 0x564783953af0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8d97fa640 1 -- 172.21.15.79:0/1557197413 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd8e8042050 con 0x564783953af0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd9031e7740 10 client.7308 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd9031e7740 1 -- 172.21.15.79:0/1557197413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x564783985070 con 0x564783953af0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8d97fa640 1 -- 172.21.15.79:0/1557197413 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f0046820 con 0x564783953af0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd8d97fa640 1 -- 172.21.15.79:0/1557197413 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7fd8e8045020 con 0x564783953af0 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd9031e7740 10 client.7308 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd9031e7740 10 client.7308 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.731+0000 7fd9031e7740 20 client.7308 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x564783985590 0x5647839dcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 4 client.7308 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 -- 172.21.15.79:0/1557197413 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56478389b900 con 0x564783985590 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd8fe270640 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x564783985590 0x5647839dcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd8d97fa640 10 client.7308 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd8fe270640 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x564783985590 0x5647839dcf10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b02ac48a4ef2716e server_cookie=973c04bb6dc7b75f in_seq=0 out_seq=0 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd8d97fa640 1 -- 172.21.15.79:0/1557197413 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56478389b900 con 0x564783985590 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd8d97fa640 10 client.7308 handle_command_reply: tid=0 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 client.7308 shutdown 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 -- 172.21.15.79:0/1557197413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 msgr2=0x5647839790b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x5647839790b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8008010 tx=0x7fd8e8004730 comp rx=0 tx=0).stop 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 -- 172.21.15.79:0/1557197413 shutdown_connections 2024-06-10T00:21:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x564783985590 0x5647839dcf10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564783958150 0x56478397a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564783953af0 0x5647839790b0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 --2- 172.21.15.79:0/1557197413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x564783950910 0x5647839574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd8d97fa640 0 client.7308 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 -- 172.21.15.79:0/1557197413 >> 172.21.15.79:0/1557197413 conn(0x5647839326d0 msgr2=0x56478395e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 -- 172.21.15.79:0/1557197413 shutdown_connections 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.732+0000 7fd9031e7740 1 -- 172.21.15.79:0/1557197413 wait complete. 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9031e7740 20 client.7308 trim_cache size 0 max 16384 2024-06-10T00:21:41.738 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:21:41.739 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:21:41.739 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:21:41.739 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:21:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 -- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd8dc06be30 msgr2=0x7fd8dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8006fd0 tx=0x7fd8e8008040 comp rx=0 tx=0).stop 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 -- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 msgr2=0x7fd8f81f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f81f0660 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400b3f0 tx=0x7fd8f400b8b0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 -- 172.21.15.79:0/2617565753 shutdown_connections 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8f8154c20 0x7fd8f814ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8f80b3bf0 0x7fd8f80afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 --2- 172.21.15.79:0/2617565753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8f806d500 0x7fd8f81f0660 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 -- 172.21.15.79:0/2617565753 >> 172.21.15.79:0/2617565753 conn(0x7fd8f80b1d10 msgr2=0x7fd8f81519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 -- 172.21.15.79:0/2617565753 shutdown_connections 2024-06-10T00:21:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.733+0000 7fd9004d4640 1 -- 172.21.15.79:0/2617565753 wait complete. 2024-06-10T00:21:41.743 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:21:41.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:21:41.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.843+0000 7fe2ccb1d640 1 Processor -- start 2024-06-10T00:21:41.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.843+0000 7fe2ccb1d640 1 -- start start 2024-06-10T00:21:41.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2ccb1d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 0x7fe2c80cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2ccb1d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c815ac50 con 0x7fe2c80aef70 2024-06-10T00:21:41.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2ccb1d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c806cdb0 con 0x7fe2c815a870 2024-06-10T00:21:41.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2ccb1d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c806d090 con 0x7fe2c80af3b0 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2bffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe2c80aef70 0x7fe2c80b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60232/0 (socket says 172.21.15.79:60232) 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2bffff640 1 -- 172.21.15.79:0/3099522485 learned_addr learned my addr 172.21.15.79:0/3099522485 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c6d9d640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 0x7fe2c80cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730094865 0 0) 0x7fe2c815ac50 con 0x7fe2c80aef70 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b4003520 con 0x7fe2c80aef70 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 710205891 0 0) 0x7fe2b4003520 con 0x7fe2c80aef70 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 msgr2=0x7fe2c80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 0x7fe2c80cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 >> v1:172.21.15.117:6789/0 conn(0x7fe2c815a870 legacy=0x7fe2c806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c806d370 con 0x7fe2c80aef70 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fe2b0001670 con 0x7fe2c80aef70 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c6d9d640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 0x7fe2c80cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:21:41.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 >> v1:172.21.15.79:6789/0 conn(0x7fe2c80aef70 legacy=0x7fe2c80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 0x7fe2b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4004d40 0x7fe2b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c806d090 con 0x7fe2b40039e0 2024-06-10T00:21:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b400bac0 con 0x7fe2b4004d40 2024-06-10T00:21:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.844+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b400bcc0 con 0x7fe2c80af3b0 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c659c640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2bffff640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 0x7fe2b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c6d9d640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4004d40 0x7fe2b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c659c640 1 -- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 msgr2=0x7fe2b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c659c640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c80af3b0 0x7fe2b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c659c640 1 -- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4004d40 msgr2=0x7fe2b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c659c640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4004d40 0x7fe2b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c659c640 1 -- 172.21.15.79:0/3099522485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b4003520 con 0x7fe2b40039e0 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c6d9d640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4004d40 0x7fe2b40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.845+0000 7fe2c659c640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2b4003dc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8001860 tx=0x7fe2b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b70192c4b50151 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8037070 con 0x7fe2b40039e0 2024-06-10T00:21:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b802ac30 con 0x7fe2b40039e0 2024-06-10T00:21:41.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2c5d9b640 1 -- 172.21.15.79:0/3099522485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8001430 con 0x7fe2b40039e0 2024-06-10T00:21:41.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/3099522485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 msgr2=0x7fe2b4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2ccb1d640 1 --2- 172.21.15.79:0/3099522485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2b4003dc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8001860 tx=0x7fe2b4005830 comp rx=0 tx=0).stop 2024-06-10T00:21:41.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2c6d9d640 1 -- 172.21.15.79:0/3099522485 reap_dead start 2024-06-10T00:21:41.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/3099522485 shutdown_connections 2024-06-10T00:21:41.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/3099522485 >> 172.21.15.79:0/3099522485 conn(0x7fe2c80b19f0 msgr2=0x7fe2c80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:41.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/3099522485 shutdown_connections 2024-06-10T00:21:41.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.846+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/3099522485 wait complete. 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2ccb1d640 1 Processor -- start 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2ccb1d640 1 -- start start 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2ccb1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2c80c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2ccb1d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c815da20 0x7fe2c80b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2ccb1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80ae950 0x7fe2c80b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2ccb1d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c80b2e40 con 0x7fe2b40039e0 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2ccb1d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c806d930 con 0x7fe2c80ae950 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2ccb1d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c80b2fc0 con 0x7fe2c815da20 2024-06-10T00:21:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2c659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2c80c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2c659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2c80c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41066/0 (socket says 172.21.15.79:41066) 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.848+0000 7fe2c659c640 1 -- 172.21.15.79:0/2996906022 learned_addr learned my addr 172.21.15.79:0/2996906022 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2bffff640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c815da20 0x7fe2c80b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2c6d9d640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80ae950 0x7fe2c80b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2c659c640 1 -- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c815da20 msgr2=0x7fe2c80b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2c659c640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c815da20 0x7fe2c80b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2c659c640 1 -- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80ae950 msgr2=0x7fe2c80b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2c659c640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80ae950 0x7fe2c80b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2c659c640 1 -- 172.21.15.79:0/2996906022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c80c9770 con 0x7fe2b40039e0 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2c6d9d640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80ae950 0x7fe2c80b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2c659c640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2c80c9070 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8001980 tx=0x7fe2b8001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2beffd640 1 -- 172.21.15.79:0/2996906022 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8040020 con 0x7fe2b40039e0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2beffd640 1 -- 172.21.15.79:0/2996906022 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b8005270 con 0x7fe2b40039e0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c80c9a50 con 0x7fe2b40039e0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2beffd640 1 -- 172.21.15.79:0/2996906022 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8037040 con 0x7fe2b40039e0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.849+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c80ca010 con 0x7fe2b40039e0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.850+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c8068430 con 0x7fe2b40039e0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.851+0000 7fe2beffd640 1 -- 172.21.15.79:0/2996906022 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2b8043020 con 0x7fe2b40039e0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.851+0000 7fe2beffd640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2a806be60 0x7fe2a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.851+0000 7fe2beffd640 1 -- 172.21.15.79:0/2996906022 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fe2b80aad90 con 0x7fe2b40039e0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.851+0000 7fe2bffff640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2a806be60 0x7fe2a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:41.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.851+0000 7fe2bffff640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2a806be60 0x7fe2a806e320 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8150a60 tx=0x7fe2b0001090 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:41.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:41.855+0000 7fe2beffd640 1 -- 172.21.15.79:0/2996906022 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe2b804a030 con 0x7fe2b40039e0 2024-06-10T00:21:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.064+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2c80b2650 con 0x7fe2b40039e0 2024-06-10T00:21:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.064+0000 7fe2beffd640 1 -- 172.21.15.79:0/2996906022 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5190 (secure 0 0 0) 0x7fe2b8078f30 con 0x7fe2b40039e0 2024-06-10T00:21:42.064 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:42.065 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:43.828708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":9,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":6}]} 2024-06-10T00:21:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2024-06-10T00:21:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2a806be60 msgr2=0x7fe2a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2a806be60 0x7fe2a806e320 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8150a60 tx=0x7fe2b0001090 comp rx=0 tx=0).stop 2024-06-10T00:21:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 msgr2=0x7fe2c80c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2c80c9070 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8001980 tx=0x7fe2b8001230 comp rx=0 tx=0).stop 2024-06-10T00:21:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 shutdown_connections 2024-06-10T00:21:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2a806be60 0x7fe2a806e320 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80ae950 0x7fe2c80b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c815da20 0x7fe2c80b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 --2- 172.21.15.79:0/2996906022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b40039e0 0x7fe2c80c9070 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 >> 172.21.15.79:0/2996906022 conn(0x7fe2c80b19f0 msgr2=0x7fe2c815eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 shutdown_connections 2024-06-10T00:21:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.066+0000 7fe2ccb1d640 1 -- 172.21.15.79:0/2996906022 wait complete. 2024-06-10T00:21:42.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-06-10T00:21:42.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.376+0000 7f8787ef7640 1 Processor -- start 2024-06-10T00:21:42.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.377+0000 7f8787ef7640 1 -- start start 2024-06-10T00:21:42.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.377+0000 7f8787ef7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87800d0020 0x7f87800d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.377+0000 7f8787ef7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8780155700 con 0x7f8780155320 2024-06-10T00:21:42.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.377+0000 7f8787ef7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878015b6b0 con 0x7f878006e1f0 2024-06-10T00:21:42.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.377+0000 7f8787ef7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f87800d09c0 con 0x7f87800d0020 2024-06-10T00:21:42.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.378+0000 7f8785492640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87800d0020 0x7f87800d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.378+0000 7f8785c93640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8780155320 0x7f87800b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60242/0 (socket says 172.21.15.79:60242) 2024-06-10T00:21:42.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.378+0000 7f8785492640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87800d0020 0x7f87800d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41076/0 (socket says 172.21.15.79:41076) 2024-06-10T00:21:42.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.378+0000 7f8785c93640 1 -- 172.21.15.79:0/2743575711 learned_addr learned my addr 172.21.15.79:0/2743575711 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:42.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.378+0000 7f8785492640 1 -- 172.21.15.79:0/2743575711 >> v1:172.21.15.117:6789/0 conn(0x7f878006e1f0 legacy=0x7f878006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.378+0000 7f8785492640 1 -- 172.21.15.79:0/2743575711 >> v1:172.21.15.79:6789/0 conn(0x7f8780155320 legacy=0x7f87800b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.378+0000 7f8785492640 1 -- 172.21.15.79:0/2743575711 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878015b990 con 0x7f87800d0020 2024-06-10T00:21:42.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8785492640 1 --2- 172.21.15.79:0/2743575711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f87800d0480 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f87700097a0 tx=0x7f877002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f0ffda22993651 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8784c91640 1 -- 172.21.15.79:0/2743575711 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770037070 con 0x7f87800d0020 2024-06-10T00:21:42.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8784c91640 1 -- 172.21.15.79:0/2743575711 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770032440 con 0x7f87800d0020 2024-06-10T00:21:42.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8784c91640 1 -- 172.21.15.79:0/2743575711 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770032810 con 0x7f87800d0020 2024-06-10T00:21:42.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8787ef7640 1 -- 172.21.15.79:0/2743575711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 msgr2=0x7f87800d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8787ef7640 1 --2- 172.21.15.79:0/2743575711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f87800d0480 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f87700097a0 tx=0x7f877002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8787ef7640 1 -- 172.21.15.79:0/2743575711 shutdown_connections 2024-06-10T00:21:42.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8787ef7640 1 --2- 172.21.15.79:0/2743575711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f87800d0480 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8787ef7640 1 -- 172.21.15.79:0/2743575711 >> 172.21.15.79:0/2743575711 conn(0x7f87800b1d10 msgr2=0x7f87800b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8787ef7640 1 -- 172.21.15.79:0/2743575711 shutdown_connections 2024-06-10T00:21:42.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.379+0000 7f8787ef7640 1 -- 172.21.15.79:0/2743575711 wait complete. 2024-06-10T00:21:42.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.380+0000 7f8787ef7640 1 Processor -- start 2024-06-10T00:21:42.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8787ef7640 1 -- start start 2024-06-10T00:21:42.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8787ef7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878006e1f0 0x7f8780150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8787ef7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f8780152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8787ef7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8780155320 0x7f878015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8787ef7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f878015bf50 con 0x7f87800d0020 2024-06-10T00:21:42.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8787ef7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f878015b2f0 con 0x7f8780155320 2024-06-10T00:21:42.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8787ef7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f878015b470 con 0x7f878006e1f0 2024-06-10T00:21:42.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8785492640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f8780152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8785492640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f8780152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41088/0 (socket says 172.21.15.79:41088) 2024-06-10T00:21:42.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.381+0000 7f8785492640 1 -- 172.21.15.79:0/2119431533 learned_addr learned my addr 172.21.15.79:0/2119431533 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8785492640 1 -- 172.21.15.79:0/2119431533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878006e1f0 msgr2=0x7f8780150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8786494640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8780155320 0x7f878015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8785492640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878006e1f0 0x7f8780150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8785492640 1 -- 172.21.15.79:0/2119431533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8780155320 msgr2=0x7f878015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8785492640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8780155320 0x7f878015c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8785492640 1 -- 172.21.15.79:0/2119431533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780150550 con 0x7f87800d0020 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8785492640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f8780152d40 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8770000c00 tx=0x7f87700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f87767fc640 1 -- 172.21.15.79:0/2119431533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770037040 con 0x7f87800d0020 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f87767fc640 1 -- 172.21.15.79:0/2119431533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770042070 con 0x7f87800d0020 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f87767fc640 1 -- 172.21.15.79:0/2119431533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770030a70 con 0x7f87800d0020 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8787ef7640 1 -- 172.21.15.79:0/2119431533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87800cf1a0 con 0x7f87800d0020 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.382+0000 7f8787ef7640 1 -- 172.21.15.79:0/2119431533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87800cd870 con 0x7f87800d0020 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.383+0000 7f87767fc640 1 -- 172.21.15.79:0/2119431533 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8770030c10 con 0x7f87800d0020 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.384+0000 7f87767fc640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f876406be30 0x7f876406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.384+0000 7f87767fc640 1 -- 172.21.15.79:0/2119431533 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f87700abb70 con 0x7f87800d0020 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.384+0000 7f8785c93640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f876406be30 0x7f876406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.384+0000 7f8785c93640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f876406be30 0x7f876406e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f877c000f60 tx=0x7f877c007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.385+0000 7f878abfd740 1 Processor -- start 2024-06-10T00:21:42.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.385+0000 7f878abfd740 1 -- start start 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f878abfd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 0x55bac29a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f878abfd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f878abfd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29d0a00 0x55bac29a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f878abfd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bac2909d80 con 0x55bac29d1140 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f878abfd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bac28a72f0 con 0x55bac29d0a00 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f878abfd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bac2905d40 con 0x55bac29ee020 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41092/0 (socket says 172.21.15.79:41092) 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 -- 172.21.15.79:0/1563228065 learned_addr learned my addr 172.21.15.79:0/1563228065 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 -- 172.21.15.79:0/1563228065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 msgr2=0x55bac29a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 --2- 172.21.15.79:0/1563228065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 0x55bac29a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 -- 172.21.15.79:0/1563228065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29d0a00 msgr2=0x55bac29a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8786494640 1 --2- 172.21.15.79:0/1563228065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29d0a00 0x55bac29a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 --2- 172.21.15.79:0/1563228065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29d0a00 0x55bac29a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 -- 172.21.15.79:0/1563228065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac26e97c0 con 0x55bac29d1140 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f8785492640 1 --2- 172.21.15.79:0/1563228065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d04c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8770006f60 tx=0x7f87700797d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c85054cf02ba6e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f87637fe640 1 -- 172.21.15.79:0/1563228065 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770079bd0 con 0x55bac29d1140 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f87637fe640 1 -- 172.21.15.79:0/1563228065 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770091030 con 0x55bac29d1140 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.386+0000 7f87637fe640 1 -- 172.21.15.79:0/1563228065 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877007df80 con 0x55bac29d1140 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 -- 172.21.15.79:0/1563228065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 msgr2=0x55bac29d04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 --2- 172.21.15.79:0/1563228065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d04c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8770006f60 tx=0x7f87700797d0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 -- 172.21.15.79:0/1563228065 shutdown_connections 2024-06-10T00:21:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 --2- 172.21.15.79:0/1563228065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29d0a00 0x55bac29a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 --2- 172.21.15.79:0/1563228065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d04c0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 --2- 172.21.15.79:0/1563228065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 0x55bac29a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 -- 172.21.15.79:0/1563228065 >> 172.21.15.79:0/1563228065 conn(0x55bac29a2c20 msgr2=0x55bac29eb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 -- 172.21.15.79:0/1563228065 shutdown_connections 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.387+0000 7f878abfd740 1 -- 172.21.15.79:0/1563228065 wait complete. 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.388+0000 7f878abfd740 1 -- start start 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.388+0000 7f878abfd740 1 Processor -- start 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac29cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29fc5c0 0x55bac29ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bac29a4dd0 con 0x55bac29d1140 2024-06-10T00:21:42.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bac28a4da0 con 0x55bac29ee020 2024-06-10T00:21:42.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bac29a41c0 con 0x55bac29fc5c0 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 10 client.0 _ll_register_callbacks cb 0x55bac261cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41104/0 (socket says 172.21.15.79:41104) 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 -- 172.21.15.79:0/301010279 learned_addr learned my addr 172.21.15.79:0/301010279 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8786494640 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29fc5c0 0x55bac29ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785492640 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac29cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 -- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29fc5c0 msgr2=0x55bac29ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29fc5c0 0x55bac29ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 -- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 msgr2=0x55bac29cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac29cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 -- 172.21.15.79:0/301010279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac2749f50 con 0x55bac29d1140 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785492640 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac29cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8785c93640 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d35e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f877c0074d0 tx=0x7f877c016450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0a908b030754c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8760ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8760ff9640 1 -- 172.21.15.79:0/301010279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c016ac0 con 0x55bac29d1140 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8760ff9640 1 -- 172.21.15.79:0/301010279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f877c016c60 con 0x55bac29d1140 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 1 -- 172.21.15.79:0/301010279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8770091030 con 0x55bac29d1140 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f8760ff9640 1 -- 172.21.15.79:0/301010279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f877c016e60 con 0x55bac29d1140 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 10 client.7329 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.389+0000 7f878abfd740 1 -- 172.21.15.79:0/301010279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55bac25dd0b0 con 0x55bac29d1140 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f8760ff9640 1 -- 172.21.15.79:0/301010279 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770091030 con 0x55bac29d1140 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f8760ff9640 1 -- 172.21.15.79:0/301010279 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7f877c012440 con 0x55bac29d1140 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f878abfd740 10 client.7329 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f878abfd740 10 client.7329 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f878abfd740 20 client.7329 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f878abfd740 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55bac29d1c80 0x55bac29e30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f878abfd740 4 client.7329 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f878abfd740 1 -- 172.21.15.79:0/301010279 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bac29174b0 con 0x55bac29d1c80 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f8785492640 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55bac29d1c80 0x55bac29e30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f8760ff9640 10 client.7329 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.390+0000 7f8785492640 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55bac29d1c80 0x55bac29e30c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e60d7c9b6a0241 server_cookie=2900924e2508e1e7 in_seq=0 out_seq=0 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f8760ff9640 1 -- 172.21.15.79:0/301010279 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bac29174b0 con 0x55bac29d1c80 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f8760ff9640 10 client.7329 handle_command_reply: tid=0 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 client.7329 shutdown 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 -- 172.21.15.79:0/301010279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 msgr2=0x55bac29d35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d35e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f877c0074d0 tx=0x7f877c016450 comp rx=0 tx=0).stop 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 -- 172.21.15.79:0/301010279 shutdown_connections 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55bac29d1c80 0x55bac29e30c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29fc5c0 0x55bac29ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac29cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 --2- 172.21.15.79:0/301010279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29d35e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f8760ff9640 0 client.7329 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:42.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 -- 172.21.15.79:0/301010279 >> 172.21.15.79:0/301010279 conn(0x55bac29d0a00 msgr2=0x55bac29a51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 -- 172.21.15.79:0/301010279 shutdown_connections 2024-06-10T00:21:42.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 1 -- 172.21.15.79:0/301010279 wait complete. 2024-06-10T00:21:42.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.391+0000 7f878abfd740 20 client.7329 trim_cache size 0 max 16384 2024-06-10T00:21:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.405+0000 7f878abfd740 1 Processor -- start 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.405+0000 7f878abfd740 1 -- start start 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.405+0000 7f878abfd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29e3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.405+0000 7f878abfd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 0x55bac2a0f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.405+0000 7f878abfd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29fc5c0 0x55bac29ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.405+0000 7f878abfd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f87801fe160 con 0x55bac29d1140 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.405+0000 7f878abfd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f878006da70 con 0x55bac29fc5c0 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.405+0000 7f878abfd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87801fdb40 con 0x55bac29ee020 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29e3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41116/0 (socket says 172.21.15.79:41116) 2024-06-10T00:21:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 -- 172.21.15.79:0/2345495647 learned_addr learned my addr 172.21.15.79:0/2345495647 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 -- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 msgr2=0x55bac2a0f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785492640 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 0x55bac2a0f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8786494640 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29fc5c0 0x55bac29ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 0x55bac2a0f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 -- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29fc5c0 msgr2=0x55bac29ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29fc5c0 0x55bac29ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 -- 172.21.15.79:0/2345495647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac29a29a0 con 0x55bac29d1140 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785492640 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 0x55bac2a0f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8786494640 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29fc5c0 0x55bac29ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8785c93640 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29e3420 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f877c012700 tx=0x7f877c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82dbf323e101c488 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8762ffd640 1 -- 172.21.15.79:0/2345495647 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c016cc0 con 0x55bac29d1140 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8762ffd640 1 -- 172.21.15.79:0/2345495647 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c012990 con 0x55bac29d1140 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.406+0000 7f8762ffd640 1 -- 172.21.15.79:0/2345495647 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c012d60 con 0x55bac29d1140 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 -- 172.21.15.79:0/2345495647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 msgr2=0x55bac29e3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29e3420 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f877c012700 tx=0x7f877c01b000 comp rx=0 tx=0).stop 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 -- 172.21.15.79:0/2345495647 shutdown_connections 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29fc5c0 0x55bac29ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29ee020 0x55bac2a0f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 --2- 172.21.15.79:0/2345495647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29d1140 0x55bac29e3420 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 -- 172.21.15.79:0/2345495647 >> 172.21.15.79:0/2345495647 conn(0x55bac29d0a00 msgr2=0x55bac29a61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 -- 172.21.15.79:0/2345495647 shutdown_connections 2024-06-10T00:21:42.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 -- 172.21.15.79:0/2345495647 wait complete. 2024-06-10T00:21:42.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 -- start start 2024-06-10T00:21:42.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.407+0000 7f878abfd740 1 Processor -- start 2024-06-10T00:21:42.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f878abfd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29d1140 0x55bac29e4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f878abfd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac2a640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f878abfd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29fc5c0 0x55bac29e1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f878abfd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bac29d1b00 con 0x55bac29fc5c0 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f878abfd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bac29e3a80 con 0x55bac29ee020 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f878abfd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bac29d2120 con 0x55bac29d1140 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f878abfd740 10 client.0 _ll_register_callbacks cb 0x7f877c0012a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f8786494640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29fc5c0 0x55bac29e1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f8786494640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29fc5c0 0x55bac29e1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41124/0 (socket says 172.21.15.79:41124) 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f8786494640 1 -- 172.21.15.79:0/3322741923 learned_addr learned my addr 172.21.15.79:0/3322741923 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f8785492640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac2a640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.408+0000 7f8785c93640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29d1140 0x55bac29e4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8786494640 1 -- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29d1140 msgr2=0x55bac29e4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8786494640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29d1140 0x55bac29e4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8786494640 1 -- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 msgr2=0x55bac2a640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8786494640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac2a640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8786494640 1 -- 172.21.15.79:0/3322741923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac29fbbb0 con 0x55bac29fc5c0 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8785c93640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29d1140 0x55bac29e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8785492640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac2a640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8786494640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29fc5c0 0x55bac29e1580 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8778011590 tx=0x7f8778011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd0878f13a86de0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8760ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8760ff9640 1 -- 172.21.15.79:0/3322741923 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778018030 con 0x55bac29fc5c0 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8760ff9640 1 -- 172.21.15.79:0/3322741923 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f877800d040 con 0x55bac29fc5c0 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 1 -- 172.21.15.79:0/3322741923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f877c012990 con 0x55bac29fc5c0 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8760ff9640 1 -- 172.21.15.79:0/3322741923 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f8778003970 con 0x55bac29fc5c0 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 10 client.7335 fetch_fsmap learned FSMap version 56 2024-06-10T00:21:42.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 1 -- 172.21.15.79:0/3322741923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55bac29e4620 con 0x55bac29fc5c0 2024-06-10T00:21:42.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8760ff9640 1 -- 172.21.15.79:0/3322741923 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c012990 con 0x55bac29fc5c0 2024-06-10T00:21:42.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8760ff9640 1 -- 172.21.15.79:0/3322741923 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) ==== 3494+0+0 (secure 0 0 0) 0x7f8778026080 con 0x55bac29fc5c0 2024-06-10T00:21:42.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 10 client.7335 fetch_fsmap finished waiting for FSMap version 56 2024-06-10T00:21:42.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 10 client.7335 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:21:42.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 20 client.7335 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:42.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55bac2a0e870 0x55bac29ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 4 client.7335 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-06-10T00:21:42.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f878abfd740 1 -- 172.21.15.79:0/3322741923 --> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55bac2911800 con 0x55bac2a0e870 2024-06-10T00:21:42.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.409+0000 7f8785c93640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55bac2a0e870 0x55bac29ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f8760ff9640 10 client.7335 ms_handle_connect on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:42.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f8785c93640 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55bac2a0e870 0x55bac29ccad0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7910d9769e2bdb5 server_cookie=cdd7ffd2085bcc56 in_seq=0 out_seq=0 2024-06-10T00:21:42.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f8760ff9640 1 -- 172.21.15.79:0/3322741923 <== mds.0 v2:172.21.15.79:6834/1800410806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+144 (crc 0 0 0) 0x55bac2911800 con 0x55bac2a0e870 2024-06-10T00:21:42.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f8760ff9640 10 client.7335 handle_command_reply: tid=0 2024-06-10T00:21:42.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 client.7335 shutdown 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 -- 172.21.15.79:0/3322741923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29fc5c0 msgr2=0x55bac29e1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29fc5c0 0x55bac29e1580 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8778011590 tx=0x7f8778011a50 comp rx=0 tx=0).stop 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 -- 172.21.15.79:0/3322741923 shutdown_connections 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.79:6834/1800410806,v1:172.21.15.79:6836/1800410806] conn(0x55bac2a0e870 0x55bac29ccad0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bac29fc5c0 0x55bac29e1580 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bac29ee020 0x55bac2a640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 --2- 172.21.15.79:0/3322741923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bac29d1140 0x55bac29e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 -- 172.21.15.79:0/3322741923 >> 172.21.15.79:0/3322741923 conn(0x55bac29d0a00 msgr2=0x55bac299f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f8760ff9640 0 client.7335 ms_handle_reset on v2:172.21.15.79:6834/1800410806 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 -- 172.21.15.79:0/3322741923 shutdown_connections 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 1 -- 172.21.15.79:0/3322741923 wait complete. 2024-06-10T00:21:42.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.410+0000 7f878abfd740 20 client.7335 trim_cache size 0 max 16384 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "damage_type": "backtrace", 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 3380871353, 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 1099511627777, 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/testdir/hardlink" 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:21:42.422 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:21:42.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 -- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f876406be30 msgr2=0x7f876406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f876406be30 0x7f876406e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f877c000f60 tx=0x7f877c007a80 comp rx=0 tx=0).stop 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 -- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 msgr2=0x7f8780152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f8780152d40 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8770000c00 tx=0x7f87700046c0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 -- 172.21.15.79:0/2119431533 shutdown_connections 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f876406be30 0x7f876406e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8780155320 0x7f878015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87800d0020 0x7f8780152d40 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 --2- 172.21.15.79:0/2119431533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878006e1f0 0x7f8780150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 -- 172.21.15.79:0/2119431533 >> 172.21.15.79:0/2119431533 conn(0x7f87800b1d10 msgr2=0x7f8780159170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 -- 172.21.15.79:0/2119431533 shutdown_connections 2024-06-10T00:21:42.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.411+0000 7f8787ef7640 1 -- 172.21.15.79:0/2119431533 wait complete. 2024-06-10T00:21:42.425 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:21:42.425 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:21:42.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:21:42.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.580+0000 7f4224ded640 1 Processor -- start 2024-06-10T00:21:42.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.580+0000 7f4224ded640 1 -- start start 2024-06-10T00:21:42.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.581+0000 7f4224ded640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220162190 0x7f42200d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.581+0000 7f4224ded640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f422006d050 0x7f4220162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.581+0000 7f4224ded640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4220162ca0 con 0x7f4220161320 2024-06-10T00:21:42.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.581+0000 7f4224ded640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f422006db10 con 0x7f422006d050 2024-06-10T00:21:42.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.581+0000 7f4224ded640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f42200d0570 con 0x7f4220162190 2024-06-10T00:21:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.581+0000 7f421dd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f422006d050 0x7f4220162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.581+0000 7f421dd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f422006d050 0x7f4220162570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41136/0 (socket says 172.21.15.79:41136) 2024-06-10T00:21:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.581+0000 7f421dd9b640 1 -- 172.21.15.79:0/886408906 learned_addr learned my addr 172.21.15.79:0/886408906 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421e59c640 1 --2- 172.21.15.79:0/886408906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220162190 0x7f42200d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421dd9b640 1 -- 172.21.15.79:0/886408906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220162190 msgr2=0x7f42200d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421dd9b640 1 --2- 172.21.15.79:0/886408906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220162190 0x7f42200d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421dd9b640 1 -- 172.21.15.79:0/886408906 >> v1:172.21.15.117:6789/0 conn(0x7f4220161320 legacy=0x7f422006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421dd9b640 1 -- 172.21.15.79:0/886408906 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422006dd60 con 0x7f422006d050 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421e59c640 1 --2- 172.21.15.79:0/886408906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220162190 0x7f42200d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421dd9b640 1 --2- 172.21.15.79:0/886408906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422006d050 0x7f4220162570 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4208009870 tx=0x7f420802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dd908d2905afe0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421d59a640 1 -- 172.21.15.79:0/886408906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208037070 con 0x7f422006d050 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421d59a640 1 -- 172.21.15.79:0/886408906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4208032440 con 0x7f422006d050 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.582+0000 7f421d59a640 1 -- 172.21.15.79:0/886408906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208032810 con 0x7f422006d050 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.583+0000 7f4224ded640 1 -- 172.21.15.79:0/886408906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422006d050 msgr2=0x7f4220162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.583+0000 7f4224ded640 1 --2- 172.21.15.79:0/886408906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422006d050 0x7f4220162570 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4208009870 tx=0x7f420802a1c0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.583+0000 7f4224ded640 1 -- 172.21.15.79:0/886408906 shutdown_connections 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.583+0000 7f4224ded640 1 --2- 172.21.15.79:0/886408906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422006d050 0x7f4220162570 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.583+0000 7f4224ded640 1 --2- 172.21.15.79:0/886408906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220162190 0x7f42200d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.583+0000 7f4224ded640 1 -- 172.21.15.79:0/886408906 >> 172.21.15.79:0/886408906 conn(0x7f422009d3c0 msgr2=0x7f42200d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.583+0000 7f4224ded640 1 -- 172.21.15.79:0/886408906 shutdown_connections 2024-06-10T00:21:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.583+0000 7f4224ded640 1 -- 172.21.15.79:0/886408906 wait complete. 2024-06-10T00:21:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.584+0000 7f4224ded640 1 Processor -- start 2024-06-10T00:21:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.584+0000 7f4224ded640 1 -- start start 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f4224ded640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f422006d050 0x7f422015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f4224ded640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220161320 0x7f42200cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f4224ded640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4220162190 0x7f42200b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f4224ded640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42200d2d50 con 0x7f4220162190 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f4224ded640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f42201617b0 con 0x7f4220161320 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f4224ded640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f422009f230 con 0x7f422006d050 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4220162190 0x7f42200b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4220162190 0x7f42200b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41146/0 (socket says 172.21.15.79:41146) 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421ed9d640 1 -- 172.21.15.79:0/936737558 learned_addr learned my addr 172.21.15.79:0/936737558 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421e59c640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f422006d050 0x7f422015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421dd9b640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220161320 0x7f42200cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421ed9d640 1 -- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f422006d050 msgr2=0x7f422015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421ed9d640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f422006d050 0x7f422015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421ed9d640 1 -- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220161320 msgr2=0x7f42200cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421ed9d640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220161320 0x7f42200cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.585+0000 7f421ed9d640 1 -- 172.21.15.79:0/936737558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42200cc090 con 0x7f4220162190 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.586+0000 7f421e59c640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f422006d050 0x7f422015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.586+0000 7f421dd9b640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220161320 0x7f42200cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.586+0000 7f421ed9d640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4220162190 0x7f42200b3b70 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4218001eb0 tx=0x7f421800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.586+0000 7f4216ffd640 1 -- 172.21.15.79:0/936737558 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4218017070 con 0x7f4220162190 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.586+0000 7f4216ffd640 1 -- 172.21.15.79:0/936737558 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42180052d0 con 0x7f4220162190 2024-06-10T00:21:42.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.586+0000 7f4216ffd640 1 -- 172.21.15.79:0/936737558 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4218003810 con 0x7f4220162190 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.586+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42200cc370 con 0x7f4220162190 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.586+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f422015ede0 con 0x7f4220162190 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.587+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4220068ad0 con 0x7f4220162190 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.587+0000 7f4216ffd640 1 -- 172.21.15.79:0/936737558 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f421801a070 con 0x7f4220162190 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.588+0000 7f4216ffd640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f420006be30 0x7f420006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.588+0000 7f4216ffd640 1 -- 172.21.15.79:0/936737558 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f421808a470 con 0x7f4220162190 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.588+0000 7f421e59c640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f420006be30 0x7f420006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.588+0000 7f421e59c640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f420006be30 0x7f420006e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4210007f40 tx=0x7f4210007490 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.592+0000 7f4216ffd640 1 -- 172.21.15.79:0/936737558 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4218058bd0 con 0x7f4220162190 2024-06-10T00:21:42.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.780+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f42200d1760 con 0x7f4220162190 2024-06-10T00:21:42.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.780+0000 7f4216ffd640 1 -- 172.21.15.79:0/936737558 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v91) ==== 80+0+124 (secure 0 0 0) 0x7f42180584d0 con 0x7f4220162190 2024-06-10T00:21:42.780 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.117:6835/2747696124 2024-06-11T00:20:32.967295+0000 2024-06-10T00:21:42.780 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.117:6833/2747696124 2024-06-11T00:20:32.967295+0000 2024-06-10T00:21:42.780 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f420006be30 msgr2=0x7f420006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f420006be30 0x7f420006e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4210007f40 tx=0x7f4210007490 comp rx=0 tx=0).stop 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4220162190 msgr2=0x7f42200b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4220162190 0x7f42200b3b70 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4218001eb0 tx=0x7f421800c890 comp rx=0 tx=0).stop 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 shutdown_connections 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f420006be30 0x7f420006e2f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4220162190 0x7f42200b3b70 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220161320 0x7f42200cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 --2- 172.21.15.79:0/936737558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f422006d050 0x7f422015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 >> 172.21.15.79:0/936737558 conn(0x7f422009d3c0 msgr2=0x7f42200cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 shutdown_connections 2024-06-10T00:21:42.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.782+0000 7f4224ded640 1 -- 172.21.15.79:0/936737558 wait complete. 2024-06-10T00:21:42.792 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:21:42.792 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:21:42.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:21:42.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.948+0000 7f3310cd6640 1 Processor -- start 2024-06-10T00:21:42.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.948+0000 7f3310cd6640 1 -- start start 2024-06-10T00:21:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.949+0000 7f3310cd6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f330c0d2680 0x7f330c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.949+0000 7f3310cd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d1fc0 0x7f330c0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.949+0000 7f3310cd6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f330c0d2fa0 con 0x7f330c161fa0 2024-06-10T00:21:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.949+0000 7f3310cd6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0cff80 con 0x7f330c0d2680 2024-06-10T00:21:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.949+0000 7f3310cd6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f330c0d13e0 con 0x7f330c0d1fc0 2024-06-10T00:21:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f330a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f330c0d2680 0x7f330c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f3309d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d1fc0 0x7f330c0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f330a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f330c0d2680 0x7f330c15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:41492/0 (socket says 172.21.15.79:41492) 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f3309d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d1fc0 0x7f330c0d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:58838/0 (socket says 172.21.15.79:58838) 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f330a59c640 1 -- 172.21.15.79:0/3622036084 learned_addr learned my addr 172.21.15.79:0/3622036084 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f330ad9d640 1 --1- 172.21.15.79:0/3622036084 >> v1:172.21.15.117:6789/0 conn(0x7f330c161fa0 0x7f330c162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:56672/0 (socket says 172.21.15.79:56672) 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f3309d9b640 1 -- 172.21.15.79:0/3622036084 >> v2:172.21.15.117:3300/0 conn(0x7f330c0d2680 msgr2=0x7f330c15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f3309d9b640 1 --2- 172.21.15.79:0/3622036084 >> v2:172.21.15.117:3300/0 conn(0x7f330c0d2680 0x7f330c15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f3309d9b640 1 -- 172.21.15.79:0/3622036084 >> v1:172.21.15.117:6789/0 conn(0x7f330c161fa0 legacy=0x7f330c162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.950+0000 7f3309d9b640 1 -- 172.21.15.79:0/3622036084 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0d0ad0 con 0x7f330c0d1fc0 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3309d9b640 1 --2- 172.21.15.79:0/3622036084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d1fc0 0x7f330c0d2a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33000097a0 tx=0x7f330002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ce796d3dd28eb0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f330959a640 1 -- 172.21.15.79:0/3622036084 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300037070 con 0x7f330c0d1fc0 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f330959a640 1 -- 172.21.15.79:0/3622036084 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300032440 con 0x7f330c0d1fc0 2024-06-10T00:21:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f330959a640 1 -- 172.21.15.79:0/3622036084 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300032810 con 0x7f330c0d1fc0 2024-06-10T00:21:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3310cd6640 1 -- 172.21.15.79:0/3622036084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d1fc0 msgr2=0x7f330c0d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3310cd6640 1 --2- 172.21.15.79:0/3622036084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d1fc0 0x7f330c0d2a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33000097a0 tx=0x7f330002a180 comp rx=0 tx=0).stop 2024-06-10T00:21:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3310cd6640 1 -- 172.21.15.79:0/3622036084 shutdown_connections 2024-06-10T00:21:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3310cd6640 1 --2- 172.21.15.79:0/3622036084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d1fc0 0x7f330c0d2a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3310cd6640 1 --2- 172.21.15.79:0/3622036084 >> v2:172.21.15.117:3300/0 conn(0x7f330c0d2680 0x7f330c15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3310cd6640 1 -- 172.21.15.79:0/3622036084 >> 172.21.15.79:0/3622036084 conn(0x7f330c09d3f0 msgr2=0x7f330c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3310cd6640 1 -- 172.21.15.79:0/3622036084 shutdown_connections 2024-06-10T00:21:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.951+0000 7f3310cd6640 1 -- 172.21.15.79:0/3622036084 wait complete. 2024-06-10T00:21:42.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.953+0000 7f3310cd6640 1 Processor -- start 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.953+0000 7f3310cd6640 1 -- start start 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.953+0000 7f3310cd6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c0d1fc0 0x7f330c151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.953+0000 7f3310cd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d2680 0x7f330c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.953+0000 7f3310cd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c161fa0 0x7f330c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.953+0000 7f3310cd6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f330c0d1070 con 0x7f330c161fa0 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.953+0000 7f3310cd6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f330c0d0d90 con 0x7f330c0d1fc0 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.953+0000 7f3310cd6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f330c0d2400 con 0x7f330c0d2680 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c161fa0 0x7f330c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c161fa0 0x7f330c06d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41158/0 (socket says 172.21.15.79:41158) 2024-06-10T00:21:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 -- 172.21.15.79:0/4168690729 learned_addr learned my addr 172.21.15.79:0/4168690729 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f3309d9b640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d2680 0x7f330c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330a59c640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c0d1fc0 0x7f330c151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 -- 172.21.15.79:0/4168690729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d2680 msgr2=0x7f330c15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d2680 0x7f330c15e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 -- 172.21.15.79:0/4168690729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c0d1fc0 msgr2=0x7f330c151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c0d1fc0 0x7f330c151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 -- 172.21.15.79:0/4168690729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0cb500 con 0x7f330c161fa0 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f330ad9d640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c161fa0 0x7f330c06d110 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f330400c730 tx=0x7f330400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f32faffd640 1 -- 172.21.15.79:0/4168690729 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304017070 con 0x7f330c161fa0 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f32faffd640 1 -- 172.21.15.79:0/4168690729 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330400ce40 con 0x7f330c161fa0 2024-06-10T00:21:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c0cb7e0 con 0x7f330c161fa0 2024-06-10T00:21:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f32faffd640 1 -- 172.21.15.79:0/4168690729 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330400a840 con 0x7f330c161fa0 2024-06-10T00:21:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.954+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c0cbda0 con 0x7f330c161fa0 2024-06-10T00:21:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.955+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330c068430 con 0x7f330c161fa0 2024-06-10T00:21:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.956+0000 7f32faffd640 1 -- 172.21.15.79:0/4168690729 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f330401a070 con 0x7f330c161fa0 2024-06-10T00:21:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.956+0000 7f32faffd640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32ec06be30 0x7f32ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.956+0000 7f330a59c640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32ec06be30 0x7f32ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.956+0000 7f32faffd640 1 -- 172.21.15.79:0/4168690729 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7f330408a570 con 0x7f330c161fa0 2024-06-10T00:21:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.957+0000 7f330a59c640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32ec06be30 0x7f32ec06e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f330c1f5960 tx=0x7f32fc009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:42.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:42.961+0000 7f32faffd640 1 -- 172.21.15.79:0/4168690729 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3304058690 con 0x7f330c161fa0 2024-06-10T00:21:43.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.148+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f330c15f5d0 con 0x7f330c161fa0 2024-06-10T00:21:43.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.149+0000 7f32faffd640 1 -- 172.21.15.79:0/4168690729 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v91) ==== 80+0+124 (secure 0 0 0) 0x7f330405c990 con 0x7f330c161fa0 2024-06-10T00:21:43.148 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.117:6835/2747696124 2024-06-11T00:20:32.967295+0000 2024-06-10T00:21:43.148 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.117:6833/2747696124 2024-06-11T00:20:32.967295+0000 2024-06-10T00:21:43.149 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-06-10T00:21:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32ec06be30 msgr2=0x7f32ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32ec06be30 0x7f32ec06e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f330c1f5960 tx=0x7f32fc009240 comp rx=0 tx=0).stop 2024-06-10T00:21:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c161fa0 msgr2=0x7f330c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c161fa0 0x7f330c06d110 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f330400c730 tx=0x7f330400cbf0 comp rx=0 tx=0).stop 2024-06-10T00:21:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 shutdown_connections 2024-06-10T00:21:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f32ec06be30 0x7f32ec06e2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c161fa0 0x7f330c06d110 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c0d2680 0x7f330c15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 --2- 172.21.15.79:0/4168690729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c0d1fc0 0x7f330c151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.150+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 >> 172.21.15.79:0/4168690729 conn(0x7f330c09d3f0 msgr2=0x7f330c0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.151+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 shutdown_connections 2024-06-10T00:21:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:43.151+0000 7f3310cd6640 1 -- 172.21.15.79:0/4168690729 wait complete. 2024-06-10T00:21:43.161 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:21:43.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:43.161 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:21:43.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[65776]: fuse finished with error 0 and tester_r 0 2024-06-10T00:21:43.186 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:21:44.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:21:44.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:21:49.287 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:21:49.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:49.288 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:21:49.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:21:49.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.458+0000 7fd7ef76a640 1 Processor -- start 2024-06-10T00:21:49.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.458+0000 7fd7ef76a640 1 -- start start 2024-06-10T00:21:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7ef76a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 0x7fd7e80b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7ef76a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e80b3420 con 0x7fd7e81553c0 2024-06-10T00:21:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7ef76a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e80cc750 con 0x7fd7e80cec50 2024-06-10T00:21:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7ef76a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e80cca30 con 0x7fd7e80cd230 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7ed506640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd7e81553c0 0x7fd7e815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34638/0 (socket says 172.21.15.79:34638) 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7ed506640 1 -- 172.21.15.79:0/765783503 learned_addr learned my addr 172.21.15.79:0/765783503 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193973929 0 0) 0x7fd7e80b3420 con 0x7fd7e81553c0 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d4003520 con 0x7fd7e81553c0 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 0x7fd7e80b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227843797 0 0) 0x7fd7d4003520 con 0x7fd7e81553c0 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 msgr2=0x7fd7e80b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 0x7fd7e80b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 >> v1:172.21.15.117:6789/0 conn(0x7fd7e80cec50 legacy=0x7fd7e8071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e80ccd10 con 0x7fd7e81553c0 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fd7e4001670 con 0x7fd7e81553c0 2024-06-10T00:21:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 0x7fd7e80b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 >> v1:172.21.15.79:6789/0 conn(0x7fd7e81553c0 legacy=0x7fd7e815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d40039e0 0x7fd7d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7d4004800 0x7fd7d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 0x7fd7d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e80cca30 con 0x7fd7d4004800 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d400bac0 con 0x7fd7d40039e0 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.459+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d400bcc0 con 0x7fd7e80cd230 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.460+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7d4004800 0x7fd7d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.460+0000 7fd7edd07640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 0x7fd7d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.460+0000 7fd7ed506640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d40039e0 0x7fd7d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.460+0000 7fd7ecd05640 1 -- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 msgr2=0x7fd7d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.460+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e80cd230 0x7fd7d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.460+0000 7fd7ecd05640 1 -- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d40039e0 msgr2=0x7fd7d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.460+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d40039e0 0x7fd7d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.460+0000 7fd7ecd05640 1 -- 172.21.15.79:0/765783503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d4003520 con 0x7fd7d4004800 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7d4004800 0x7fd7d4004c80 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0098a0 tx=0x7fd7d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800213c690ba99ba server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00f040 con 0x7fd7d4004800 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7dc02ace0 con 0x7fd7d4004800 2024-06-10T00:21:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7dbfff640 1 -- 172.21.15.79:0/765783503 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc004250 con 0x7fd7d4004800 2024-06-10T00:21:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7ef76a640 1 -- 172.21.15.79:0/765783503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7d4004800 msgr2=0x7fd7d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7ef76a640 1 --2- 172.21.15.79:0/765783503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7d4004800 0x7fd7d4004c80 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0098a0 tx=0x7fd7d4005830 comp rx=0 tx=0).stop 2024-06-10T00:21:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7edd07640 1 -- 172.21.15.79:0/765783503 reap_dead start 2024-06-10T00:21:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7ef76a640 1 -- 172.21.15.79:0/765783503 shutdown_connections 2024-06-10T00:21:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7ef76a640 1 -- 172.21.15.79:0/765783503 >> 172.21.15.79:0/765783503 conn(0x7fd7e80b19f0 msgr2=0x7fd7e80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7ef76a640 1 -- 172.21.15.79:0/765783503 shutdown_connections 2024-06-10T00:21:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.461+0000 7fd7ef76a640 1 -- 172.21.15.79:0/765783503 wait complete. 2024-06-10T00:21:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.463+0000 7fd7ef76a640 1 Processor -- start 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.463+0000 7fd7ef76a640 1 -- start start 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.463+0000 7fd7ef76a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d4004800 0x7fd7e809b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.463+0000 7fd7ef76a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e8147660 0x7fd7e809c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.463+0000 7fd7ef76a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e8159eb0 0x7fd7e815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.463+0000 7fd7ef76a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8155920 con 0x7fd7e8147660 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.463+0000 7fd7ef76a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81557a0 con 0x7fd7d4004800 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.463+0000 7fd7ef76a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e80b2cf0 con 0x7fd7e8159eb0 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e8147660 0x7fd7e809c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e8147660 0x7fd7e809c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41666/0 (socket says 172.21.15.79:41666) 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 -- 172.21.15.79:0/327534587 learned_addr learned my addr 172.21.15.79:0/327534587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ed506640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d4004800 0x7fd7e809b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7edd07640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e8159eb0 0x7fd7e815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 -- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e8159eb0 msgr2=0x7fd7e815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e8159eb0 0x7fd7e815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 -- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d4004800 msgr2=0x7fd7e809b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d4004800 0x7fd7e809b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 -- 172.21.15.79:0/327534587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e815c650 con 0x7fd7e8147660 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ed506640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d4004800 0x7fd7e809b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7edd07640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e8159eb0 0x7fd7e815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ecd05640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e8147660 0x7fd7e809c710 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc034040 tx=0x7fd7dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7d9ffb640 1 -- 172.21.15.79:0/327534587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc041070 con 0x7fd7e8147660 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7d9ffb640 1 -- 172.21.15.79:0/327534587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7dc00f000 con 0x7fd7e8147660 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e809ba70 con 0x7fd7e8147660 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7d9ffb640 1 -- 172.21.15.79:0/327534587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc003c50 con 0x7fd7e8147660 2024-06-10T00:21:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.464+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e80711d0 con 0x7fd7e8147660 2024-06-10T00:21:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.465+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e80b4260 con 0x7fd7e8147660 2024-06-10T00:21:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.466+0000 7fd7d9ffb640 1 -- 172.21.15.79:0/327534587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7dc044070 con 0x7fd7e8147660 2024-06-10T00:21:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.466+0000 7fd7d9ffb640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be60 0x7fd7cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.466+0000 7fd7d9ffb640 1 -- 172.21.15.79:0/327534587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fd7dc0ab820 con 0x7fd7e8147660 2024-06-10T00:21:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.466+0000 7fd7ed506640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be60 0x7fd7cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.467+0000 7fd7ed506640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be60 0x7fd7cc06e320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4001470 tx=0x7fd7e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.471+0000 7fd7d9ffb640 1 -- 172.21.15.79:0/327534587 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd7e80b4260 con 0x7fd7e8147660 2024-06-10T00:21:49.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.678+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7e80cbd60 con 0x7fd7e8147660 2024-06-10T00:21:49.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.678+0000 7fd7d9ffb640 1 -- 172.21.15.79:0/327534587 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5190 (secure 0 0 0) 0x7fd7dc079f80 con 0x7fd7e8147660 2024-06-10T00:21:49.678 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:49.678 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:20:43.828708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":9,"addr":"172.21.15.79:6836/1800410806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1800410806},{"type":"v1","addr":"172.21.15.79:6836","nonce":1800410806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":6}]} 2024-06-10T00:21:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2024-06-10T00:21:49.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.680+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be60 msgr2=0x7fd7cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.680+0000 7fd7ef76a640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be60 0x7fd7cc06e320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4001470 tx=0x7fd7e4009040 comp rx=0 tx=0).stop 2024-06-10T00:21:49.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.680+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e8147660 msgr2=0x7fd7e809c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.680+0000 7fd7ef76a640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e8147660 0x7fd7e809c710 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc034040 tx=0x7fd7dc004730 comp rx=0 tx=0).stop 2024-06-10T00:21:49.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.681+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 shutdown_connections 2024-06-10T00:21:49.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.681+0000 7fd7ef76a640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd7cc06be60 0x7fd7cc06e320 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.681+0000 7fd7ef76a640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e8159eb0 0x7fd7e815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.681+0000 7fd7ef76a640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e8147660 0x7fd7e809c710 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.681+0000 7fd7ef76a640 1 --2- 172.21.15.79:0/327534587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7d4004800 0x7fd7e809b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.681+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 >> 172.21.15.79:0/327534587 conn(0x7fd7e80b19f0 msgr2=0x7fd7e80adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.681+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 shutdown_connections 2024-06-10T00:21:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.681+0000 7fd7ef76a640 1 -- 172.21.15.79:0/327534587 wait complete. 2024-06-10T00:21:49.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-06-10T00:21:49.815 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0} 2024-06-10T00:21:49.815 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:21:49.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:21:49.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.916+0000 7fe139bd5640 1 Processor -- start 2024-06-10T00:21:49.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.916+0000 7fe139bd5640 1 -- start start 2024-06-10T00:21:49.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe139bd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1341553c0 0x7fe1340cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe139bd5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1340b3170 con 0x7fe1340cec50 2024-06-10T00:21:49.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe139bd5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1340b3420 con 0x7fe1340b2cf0 2024-06-10T00:21:49.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe139bd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1340cc750 con 0x7fe1341553c0 2024-06-10T00:21:49.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe133fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe1340cec50 0x7fe134071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34640/0 (socket says 172.21.15.79:34640) 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe133fff640 1 -- 172.21.15.79:0/4013361885 learned_addr learned my addr 172.21.15.79:0/4013361885 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1337fe640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1341553c0 0x7fe1340cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 209252818 0 0) 0x7fe1340b3170 con 0x7fe1340cec50 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe11c003520 con 0x7fe1340cec50 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2356087015 0 0) 0x7fe11c003520 con 0x7fe1340cec50 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1341553c0 msgr2=0x7fe1340cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1327fc640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1341553c0 0x7fe1340cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 >> v1:172.21.15.117:6789/0 conn(0x7fe1340b2cf0 legacy=0x7fe13415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1340cca30 con 0x7fe1340cec50 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.917+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fe12c0019f0 con 0x7fe1340cec50 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 >> v1:172.21.15.79:6789/0 conn(0x7fe1340cec50 legacy=0x7fe134071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe1327fc640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1341553c0 0x7fe11c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe1327fc640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c003f20 0x7fe11c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe1327fc640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c004d40 0x7fe11c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1340cc750 con 0x7fe11c004d40 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c00ba20 con 0x7fe11c003f20 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe11c00de30 con 0x7fe1341553c0 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe133fff640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c004d40 0x7fe11c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe1337fe640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1341553c0 0x7fe11c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe132ffd640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c003f20 0x7fe11c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe133fff640 1 -- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1341553c0 msgr2=0x7fe11c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe133fff640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1341553c0 0x7fe11c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe133fff640 1 -- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c003f20 msgr2=0x7fe11c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe133fff640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c003f20 0x7fe11c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.918+0000 7fe133fff640 1 -- 172.21.15.79:0/4013361885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c003520 con 0x7fe11c004d40 2024-06-10T00:21:49.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe133fff640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c004d40 0x7fe11c0051c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00a860 tx=0x7fe11c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3c4a23ad5eee95 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:49.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00a480 con 0x7fe11c004d40 2024-06-10T00:21:49.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12c02f070 con 0x7fe11c004d40 2024-06-10T00:21:49.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe1327fc640 1 -- 172.21.15.79:0/4013361885 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c02bcf0 con 0x7fe11c004d40 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe139bd5640 1 -- 172.21.15.79:0/4013361885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c004d40 msgr2=0x7fe11c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe139bd5640 1 --2- 172.21.15.79:0/4013361885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe11c004d40 0x7fe11c0051c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00a860 tx=0x7fe11c005830 comp rx=0 tx=0).stop 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe133fff640 1 -- 172.21.15.79:0/4013361885 reap_dead start 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe139bd5640 1 -- 172.21.15.79:0/4013361885 shutdown_connections 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe139bd5640 1 -- 172.21.15.79:0/4013361885 >> 172.21.15.79:0/4013361885 conn(0x7fe1340b19f0 msgr2=0x7fe1340b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe139bd5640 1 -- 172.21.15.79:0/4013361885 shutdown_connections 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.919+0000 7fe139bd5640 1 -- 172.21.15.79:0/4013361885 wait complete. 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.921+0000 7fe139bd5640 1 Processor -- start 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.921+0000 7fe139bd5640 1 -- start start 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.921+0000 7fe139bd5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c004d40 0x7fe13415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.921+0000 7fe139bd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13409c730 0x7fe13415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.921+0000 7fe139bd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13414a360 0x7fe13414a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.921+0000 7fe139bd5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1341557a0 con 0x7fe13414a360 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.921+0000 7fe139bd5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1340b3700 con 0x7fe11c004d40 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.921+0000 7fe139bd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe134155920 con 0x7fe13409c730 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13414a360 0x7fe13414a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13414a360 0x7fe13414a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41692/0 (socket says 172.21.15.79:41692) 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 -- 172.21.15.79:0/2385866663 learned_addr learned my addr 172.21.15.79:0/2385866663 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe132ffd640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13409c730 0x7fe13415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe1337fe640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c004d40 0x7fe13415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 -- 172.21.15.79:0/2385866663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13409c730 msgr2=0x7fe13415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13409c730 0x7fe13415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 -- 172.21.15.79:0/2385866663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c004d40 msgr2=0x7fe13415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c004d40 0x7fe13415ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 -- 172.21.15.79:0/2385866663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13415e6b0 con 0x7fe13414a360 2024-06-10T00:21:49.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe133fff640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13414a360 0x7fe13414a7e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe12c000f80 tx=0x7fe1340ccc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe11bfff640 1 -- 172.21.15.79:0/2385866663 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00a480 con 0x7fe13414a360 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe11bfff640 1 -- 172.21.15.79:0/2385866663 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12c004b60 con 0x7fe13414a360 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13415bcc0 con 0x7fe13414a360 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe11bfff640 1 -- 172.21.15.79:0/2385866663 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c001fd0 con 0x7fe13414a360 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.922+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13415c280 con 0x7fe13414a360 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.923+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe134067d20 con 0x7fe13414a360 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.924+0000 7fe11bfff640 1 -- 172.21.15.79:0/2385866663 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe12c034470 con 0x7fe13414a360 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.924+0000 7fe11bfff640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe12006be30 0x7fe12006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.924+0000 7fe11bfff640 1 -- 172.21.15.79:0/2385866663 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6303+0+0 (secure 0 0 0) 0x7fe12c0ab3b0 con 0x7fe13414a360 2024-06-10T00:21:49.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.924+0000 7fe1337fe640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe12006be30 0x7fe12006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:49.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.925+0000 7fe1337fe640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe12006be30 0x7fe12006e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe1340ceb00 tx=0x7fe124009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:49.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:49.928+0000 7fe11bfff640 1 -- 172.21.15.79:0/2385866663 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe134067d20 con 0x7fe13414a360 2024-06-10T00:21:50.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.146+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe134068430 con 0x7fe13414a360 2024-06-10T00:21:50.146 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:21:50.146+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:21:50.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.148+0000 7fe11bfff640 1 -- 172.21.15.79:0/2385866663 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7fe12c0794f0 con 0x7fe13414a360 2024-06-10T00:21:50.147 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:21:50.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe12006be30 msgr2=0x7fe12006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe12006be30 0x7fe12006e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe1340ceb00 tx=0x7fe124009190 comp rx=0 tx=0).stop 2024-06-10T00:21:50.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13414a360 msgr2=0x7fe13414a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13414a360 0x7fe13414a7e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe12c000f80 tx=0x7fe1340ccc00 comp rx=0 tx=0).stop 2024-06-10T00:21:50.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 shutdown_connections 2024-06-10T00:21:50.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe12006be30 0x7fe12006e2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13414a360 0x7fe13414a7e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13409c730 0x7fe13415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 --2- 172.21.15.79:0/2385866663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c004d40 0x7fe13415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.150+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 >> 172.21.15.79:0/2385866663 conn(0x7fe1340b19f0 msgr2=0x7fe13415ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.151+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 shutdown_connections 2024-06-10T00:21:50.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.151+0000 7fe139bd5640 1 -- 172.21.15.79:0/2385866663 wait complete. 2024-06-10T00:21:50.153 INFO:tasks.ceph.mds.a.smithi079.stderr: -4340> 2024-06-10T00:20:39.746+0000 7fc6fb17c640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-06-10T00:21:50.153 INFO:tasks.ceph.mds.a.smithi079.stderr: -4140> 2024-06-10T00:20:39.931+0000 7fc6fb17c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 ap=1 f(v0 m2024-06-10T00:20:31.012057+0000 1=1+0) n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x56011f4e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-06-10T00:20:31.012057+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-06-10T00:21:50.154 INFO:tasks.ceph.mds.a.smithi079.stderr: -4045> 2024-06-10T00:20:40.803+0000 7fc6ff184640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:21:50.155 INFO:tasks.ceph.mds.a.smithi079.stderr: -2399> 2024-06-10T00:21:11.417+0000 7fc6fb17c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 pv16 ap=3 DIRTYPARENT f(v0 m2024-06-10T00:20:31.012057+0000 1=1+0)->f(v1 m2024-06-10T00:20:31.012057+0000) n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1)->n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x56011f4e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-06-10T00:20:31.012057+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-06-10T00:20:31.130174+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-06-10T00:21:50.163 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-06-10T00:21:50.182 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:21:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.202+0000 7f94a8b2d740 1 -- start start 2024-06-10T00:21:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.202+0000 7f94a8b2d740 1 Processor -- start 2024-06-10T00:21:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0186c4c00 0x55d018740580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0186c5800 0x55d018740b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0186c5c00 0x55d018741080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d0194ae600 con 0x55d0186c4c00 2024-06-10T00:21:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d0194ae480 con 0x55d0186c5c00 2024-06-10T00:21:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d0194ae300 con 0x55d0186c5800 2024-06-10T00:21:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0186c4c00 0x55d018740580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0186c4c00 0x55d018740580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41726/0 (socket says 172.21.15.79:41726) 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3328876473 learned_addr learned my addr 172.21.15.79:0/3328876473 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a635d640 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0186c5800 0x55d018740b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a735f640 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0186c5c00 0x55d018741080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3328876473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0186c5800 msgr2=0x55d018740b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0186c5800 0x55d018740b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3328876473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0186c5c00 msgr2=0x55d018741080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0186c5c00 0x55d018741080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3328876473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0186f1680 con 0x55d0186c4c00 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.203+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0186c4c00 0x55d018740580 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x55d0194eb140 tx=0x55d019464960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b42d4aed42c23c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a4359640 1 -- 172.21.15.79:0/3328876473 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0186ea9c0 con 0x55d0186c4c00 2024-06-10T00:21:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a4359640 1 -- 172.21.15.79:0/3328876473 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d01870cc40 con 0x55d0186c4c00 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a4359640 1 -- 172.21.15.79:0/3328876473 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0186ea680 con 0x55d0186c4c00 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3328876473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0186f14a0 con 0x55d0186c4c00 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3328876473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d0186f1a40 con 0x55d0186c4c00 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a8b2d740 4 waiting for MDS map... 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a4359640 1 -- 172.21.15.79:0/3328876473 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x55d0195a4600 con 0x55d0186c4c00 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a4359640 1 -- 172.21.15.79:0/3328876473 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 57) ==== 2885+0+0 (secure 0 0 0) 0x55d01871d180 con 0x55d0186c4c00 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a8b2d740 4 Got MDS map 57 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a8b2d740 4 datascan.main: Using metadata pool output 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a8b2d740 4 datascan.main: connecting to RADOS... 2024-06-10T00:21:50.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.204+0000 7f94a8b2d740 1 Processor -- start 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a8b2d740 1 -- start start 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa000 0x55d018741600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa400 0x55d018741b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa800 0x55d018742100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d0194ae180 con 0x55d0195fa000 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d018724480 con 0x55d0195fa400 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d018724900 con 0x55d0195fa800 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a735f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa000 0x55d018741600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a735f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa000 0x55d018741600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41736/0 (socket says 172.21.15.79:41736) 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a735f640 1 -- 172.21.15.79:0/1324937903 learned_addr learned my addr 172.21.15.79:0/1324937903 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa400 0x55d018741b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a635d640 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa800 0x55d018742100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a735f640 1 -- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa800 msgr2=0x55d018742100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a735f640 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa800 0x55d018742100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a735f640 1 -- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa400 msgr2=0x55d018741b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a735f640 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa400 0x55d018741b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a735f640 1 -- 172.21.15.79:0/1324937903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0186f1860 con 0x55d0195fa000 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.205+0000 7f94a635d640 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa800 0x55d018742100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a735f640 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa000 0x55d018741600 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x55d0195b4f30 tx=0x55d0195b8d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e832fb08b535aa45 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a2355640 1 -- 172.21.15.79:0/1324937903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0186ea9c0 con 0x55d0195fa000 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a2355640 1 -- 172.21.15.79:0/1324937903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d01870ca80 con 0x55d0195fa000 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a2355640 1 -- 172.21.15.79:0/1324937903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0186ea680 con 0x55d0195fa000 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 -- 172.21.15.79:0/1324937903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa000 msgr2=0x55d018741600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa000 0x55d018741600 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x55d0195b4f30 tx=0x55d0195b8d80 comp rx=0 tx=0).stop 2024-06-10T00:21:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 -- 172.21.15.79:0/1324937903 shutdown_connections 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa800 0x55d018742100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa400 0x55d018741b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/1324937903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa000 0x55d018741600 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 -- 172.21.15.79:0/1324937903 >> 172.21.15.79:0/1324937903 conn(0x55d0194b1c00 msgr2=0x55d01944c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 -- 172.21.15.79:0/1324937903 shutdown_connections 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.206+0000 7f94a8b2d740 1 -- 172.21.15.79:0/1324937903 wait complete. 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a8b2d740 1 Processor -- start 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a8b2d740 1 -- start start 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa000 0x55d018743180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa400 0x55d018742c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a8b2d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa800 0x55d018742680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d0194af380 con 0x55d0195fa400 2024-06-10T00:21:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d0194ae180 con 0x55d0195fa800 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a8b2d740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d0194af500 con 0x55d0195fa000 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a6b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa400 0x55d018742c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a6b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa400 0x55d018742c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41746/0 (socket says 172.21.15.79:41746) 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 learned_addr learned my addr 172.21.15.79:0/3234651912 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa000 0x55d018743180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.207+0000 7f94a635d640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa800 0x55d018742680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa000 msgr2=0x55d018743180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0195fa000 0x55d018743180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa800 msgr2=0x55d018742680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa800 0x55d018742680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0186f12c0 con 0x55d0195fa400 2024-06-10T00:21:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a635d640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0195fa800 0x55d018742680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa400 0x55d018742c00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x55d0194ebf20 tx=0x55d019465f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a0b52640 1 -- 172.21.15.79:0/3234651912 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0186eab60 con 0x55d0195fa400 2024-06-10T00:21:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a0b52640 1 -- 172.21.15.79:0/3234651912 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d01870d340 con 0x55d0195fa400 2024-06-10T00:21:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0186f10e0 con 0x55d0195fa400 2024-06-10T00:21:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a0b52640 1 -- 172.21.15.79:0/3234651912 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d0186ea820 con 0x55d0195fa400 2024-06-10T00:21:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0186f03c0 con 0x55d0195fa400 2024-06-10T00:21:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.208+0000 7f94a8b2d740 4 datascan.init: resolving metadata pool 13 2024-06-10T00:21:50.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.209+0000 7f94a0b52640 1 -- 172.21.15.79:0/3234651912 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55d01960ac00 con 0x55d0195fa400 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.209+0000 7f94a0b52640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55d01960d000 0x55d018743700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.209+0000 7f94a0b52640 1 -- 172.21.15.79:0/3234651912 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x55d019601200 con 0x55d0195fa400 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55d01960d000 0x55d018743700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a8b2d740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a8b2d740 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a8b2d740 4 datascan.main: opening data pool 'cephfs_data' 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55d0195fac00 0x55d018742100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d0195fb000 con 0x55d0195fac00 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a635d640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55d0195fac00 0x55d018742100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55d01960d000 0x55d018743700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55d0195b4f30 tx=0x55d0195b8c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.210+0000 7f94a635d640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55d0195fac00 0x55d018742100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.212+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== osd_op_reply(1 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d0195fac00 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.212+0000 7f94a1b54640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55d01960d400 0x55d018a60000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.212+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:2 14.20 14:04000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d01960d800 con 0x55d01960d400 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.212+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55d01960d400 0x55d018a60000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.212+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55d01960d400 0x55d018a60000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.214+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(2 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.214+0000 7f94a2355640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55d018a58000 0x55d018a60580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.214+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:3 14.10 14:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a58400 con 0x55d018a58000 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.215+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55d018a58000 0x55d018a60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.215+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55d018a58000 0x55d018a60580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(3 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58000 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:4 14.30 14:0c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d01960dc00 con 0x55d01960d400 2024-06-10T00:21:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== osd_op_reply(4 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:5 14.8 14:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a58800 con 0x55d01960d400 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 3 ==== osd_op_reply(5 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a1b54640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55d01960d800 0x55d018a60b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:6 14.28 14:14000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d01960dc00 con 0x55d01960d800 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a635d640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55d01960d800 0x55d018a60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.217+0000 7f94a635d640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55d01960d800 0x55d018a60b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.218+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== osd_op_reply(6 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d01960d800 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.218+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:7 14.18 14:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a58800 con 0x55d018a58000 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.218+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== osd_op_reply(7 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58000 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.218+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:8 14.38 14:1c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d0195fbc00 con 0x55d018a58000 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.218+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.1 v2:172.21.15.79:6808/15559294 3 ==== osd_op_reply(8 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58000 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.218+0000 7f94a2355640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55d01960dc00 0x55d018a61600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.218+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:9 14.4 14:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d0195fb000 con 0x55d01960dc00 2024-06-10T00:21:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.219+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55d01960dc00 0x55d018a61600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.219+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55d01960dc00 0x55d018a61600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.221+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(9 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960dc00 2024-06-10T00:21:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.221+0000 7f94a1b54640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55d018a58c00 0x55d018a61080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.221+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:10 14.24 14:24000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59000 con 0x55d018a58c00 2024-06-10T00:21:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.221+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55d018a58c00 0x55d018a61080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.222+0000 7f94a6b5e640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55d018a58c00 0x55d018a61080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.224+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(10 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.224+0000 7f94a2355640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55d018a59c00 0x55d018a61b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.224+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:11 14.14 14:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80000 con 0x55d018a59c00 2024-06-10T00:21:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.224+0000 7f94a635d640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55d018a59c00 0x55d018a61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.224+0000 7f94a635d640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55d018a59c00 0x55d018a61b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.224+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(11 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.224+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:12 14.34 14:2c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59400 con 0x55d0195fac00 2024-06-10T00:21:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.2 v2:172.21.15.79:6816/3079975341 2 ==== osd_op_reply(12 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d0195fac00 2024-06-10T00:21:50.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:13 14.c 14:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80400 con 0x55d01960d400 2024-06-10T00:21:50.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 4 ==== osd_op_reply(13 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:14 14.2c 14:34000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59800 con 0x55d018a58000 2024-06-10T00:21:50.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.1 v2:172.21.15.79:6808/15559294 4 ==== osd_op_reply(14 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58000 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:15 14.1c 14:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80800 con 0x55d01960d400 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 5 ==== osd_op_reply(15 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a1b54640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55d018a58400 0x55d018a62100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.225+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:16 14.3c 14:3c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a58800 con 0x55d018a58400 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.226+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55d018a58400 0x55d018a62100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.226+0000 7f94a735f640 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55d018a58400 0x55d018a62100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.226+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(16 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d018a58400 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.226+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:17 14.2 14:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80c00 con 0x55d01960dc00 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.227+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(17 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960dc00 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.227+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:18 14.22 14:44000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59000 con 0x55d018a59c00 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.227+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== osd_op_reply(18 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.227+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:19 14.12 14:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81000 con 0x55d0195fac00 2024-06-10T00:21:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.227+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.2 v2:172.21.15.79:6816/3079975341 3 ==== osd_op_reply(19 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d0195fac00 2024-06-10T00:21:50.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.227+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:20 14.32 14:4c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d0195fbc00 con 0x55d018a59c00 2024-06-10T00:21:50.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.227+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 3 ==== osd_op_reply(20 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.227+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:21 14.a 14:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80000 con 0x55d018a58c00 2024-06-10T00:21:50.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.228+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 2 ==== osd_op_reply(21 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.228+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:22 14.2a 14:54000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d01960cc00 con 0x55d018a59c00 2024-06-10T00:21:50.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.228+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 4 ==== osd_op_reply(22 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.228+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:23 14.1a 14:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59400 con 0x55d01960d400 2024-06-10T00:21:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.228+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 6 ==== osd_op_reply(23 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.228+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:24 14.3a 14:5c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80400 con 0x55d01960d400 2024-06-10T00:21:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.229+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 7 ==== osd_op_reply(24 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.229+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:25 14.6 14:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59000 con 0x55d01960d400 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.229+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 8 ==== osd_op_reply(25 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.229+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:26 14.26 14:64000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80800 con 0x55d018a59c00 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.229+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 5 ==== osd_op_reply(26 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.229+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:27 14.16 14:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a58800 con 0x55d01960d800 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.229+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== osd_op_reply(27 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d01960d800 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.229+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:28 14.36 14:6c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80c00 con 0x55d0195fac00 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.230+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.2 v2:172.21.15.79:6816/3079975341 4 ==== osd_op_reply(28 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d0195fac00 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.230+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:29 14.e 14:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59800 con 0x55d018a59c00 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.230+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 6 ==== osd_op_reply(29 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.230+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:30 14.2e 14:74000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81400 con 0x55d01960d800 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.230+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.3 v2:172.21.15.79:6800/4145020298 3 ==== osd_op_reply(30 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d01960d800 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.230+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:31 14.1e 14:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d0195fb000 con 0x55d018a58400 2024-06-10T00:21:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.230+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.7 v2:172.21.15.117:6816/2099086267 2 ==== osd_op_reply(31 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d018a58400 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.230+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:32 14.3e 14:7c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81800 con 0x55d018a58c00 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.231+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 3 ==== osd_op_reply(32 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.231+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:33 14.1 14:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81000 con 0x55d01960d800 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.231+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.3 v2:172.21.15.79:6800/4145020298 4 ==== osd_op_reply(33 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d01960d800 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.231+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:34 14.21 14:84000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81c00 con 0x55d018a58c00 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.231+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 4 ==== osd_op_reply(34 [pgnls start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.231+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:35 14.11 14:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80800 con 0x55d018a59c00 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.232+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 7 ==== osd_op_reply(35 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.232+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:36 14.31 14:8c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80c00 con 0x55d018a58000 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.232+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.1 v2:172.21.15.79:6808/15559294 5 ==== osd_op_reply(36 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58000 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.232+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:37 14.9 14:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d01960cc00 con 0x55d018a58c00 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.232+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 5 ==== osd_op_reply(37 [pgnls start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.232+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:38 14.29 14:94000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81400 con 0x55d01960dc00 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.232+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.6 v2:172.21.15.117:6808/1306883621 3 ==== osd_op_reply(38 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960dc00 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.232+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:39 14.19 14:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d0195fbc00 con 0x55d01960dc00 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.233+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.6 v2:172.21.15.117:6808/1306883621 4 ==== osd_op_reply(39 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960dc00 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.233+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:40 14.39 14:9c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81000 con 0x55d018a58400 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.233+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.7 v2:172.21.15.117:6816/2099086267 3 ==== osd_op_reply(40 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d018a58400 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.233+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:41 14.5 14:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d0195fb000 con 0x55d01960d400 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.233+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 9 ==== osd_op_reply(41 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.233+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:42 14.25 14:a4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a58800 con 0x55d0195fac00 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.234+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.2 v2:172.21.15.79:6816/3079975341 5 ==== osd_op_reply(42 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d0195fac00 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.234+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:43 14.15 14:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d0195fbc00 con 0x55d018a58400 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.234+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.7 v2:172.21.15.117:6816/2099086267 4 ==== osd_op_reply(43 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d018a58400 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.234+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:44 14.35 14:ac000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59800 con 0x55d018a59c00 2024-06-10T00:21:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.234+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 8 ==== osd_op_reply(44 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.234+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:45 14.d 14:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80400 con 0x55d01960dc00 2024-06-10T00:21:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.235+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.6 v2:172.21.15.117:6808/1306883621 5 ==== osd_op_reply(45 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960dc00 2024-06-10T00:21:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.235+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:46 14.2d 14:b4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a94000 con 0x55d018a59c00 2024-06-10T00:21:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.235+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 9 ==== osd_op_reply(46 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.235+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:47 14.1d 14:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81400 con 0x55d01960d400 2024-06-10T00:21:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.235+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 10 ==== osd_op_reply(47 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.235+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:48 14.3d 14:bc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a94400 con 0x55d01960d800 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.235+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.3 v2:172.21.15.79:6800/4145020298 5 ==== osd_op_reply(48 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d01960d800 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.235+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:49 14.3 14:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59400 con 0x55d01960d400 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.236+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 11 ==== osd_op_reply(49 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.236+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:50 14.23 14:c4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a94800 con 0x55d018a58400 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.236+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.7 v2:172.21.15.117:6816/2099086267 5 ==== osd_op_reply(50 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d018a58400 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.236+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:51 14.13 14:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59000 con 0x55d0195fac00 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.236+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.2 v2:172.21.15.79:6816/3079975341 6 ==== osd_op_reply(51 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d0195fac00 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.236+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:52 14.33 14:cc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a94c00 con 0x55d0195fac00 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.237+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.2 v2:172.21.15.79:6816/3079975341 7 ==== osd_op_reply(52 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d0195fac00 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.237+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:53 14.b 14:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a58800 con 0x55d01960d400 2024-06-10T00:21:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.237+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 12 ==== osd_op_reply(53 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.237+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:54 14.2b 14:d4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a95000 con 0x55d018a59c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.237+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 10 ==== osd_op_reply(54 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.237+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:55 14.1b 14:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59800 con 0x55d018a58400 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.237+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.7 v2:172.21.15.117:6816/2099086267 6 ==== osd_op_reply(55 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d018a58400 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.237+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:56 14.3b 14:dc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a95400 con 0x55d018a59c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.238+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 11 ==== osd_op_reply(56 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.238+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:57 14.7 14:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a59000 con 0x55d018a58c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.238+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 6 ==== osd_op_reply(57 [pgnls start_epoch 92 out=81b] v88'6 uv6 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.238+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:58 14.7 14:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x55d018a94000 con 0x55d018a58c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.238+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 7 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.238+0000 7f94a8b2d740 10 datascan.operator(): handling object 1099511627777.0 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.238+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:59 14.7 14:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55d018a94400 con 0x55d018a58c00 2024-06-10T00:21:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.240+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 8 ==== osd_op_reply(59 10000000001.00000000 [call] v92'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.240+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:60 14.27 14:e4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a94800 con 0x55d018a58c00 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.240+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.5 v2:172.21.15.117:6800/419453692 9 ==== osd_op_reply(60 [pgnls start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58c00 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.240+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:61 14.17 14:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80800 con 0x55d018a58000 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.240+0000 7f94a6b5e640 1 -- 172.21.15.79:0/3234651912 <== osd.1 v2:172.21.15.79:6808/15559294 6 ==== osd_op_reply(61 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838780 con 0x55d018a58000 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.240+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:62 14.37 14:ec000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a95800 con 0x55d018a59c00 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.241+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.4 v2:172.21.15.117:6824/279504764 12 ==== osd_op_reply(62 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d018a59c00 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.241+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:63 14.f 14:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a81000 con 0x55d018a58400 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.241+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.7 v2:172.21.15.117:6816/2099086267 7 ==== osd_op_reply(63 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d018a58400 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.241+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:64 14.2f 14:f4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a95c00 con 0x55d01960d400 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.241+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 13 ==== osd_op_reply(64 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.241+0000 7f94a2355640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:65 14.1f 14:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a80400 con 0x55d01960d400 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a735f640 1 -- 172.21.15.79:0/3234651912 <== osd.0 v2:172.21.15.79:6824/709635793 14 ==== osd_op_reply(65 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838500 con 0x55d01960d400 2024-06-10T00:21:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a1b54640 1 -- 172.21.15.79:0/3234651912 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:66 14.3f 14:fc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x55d018a94000 con 0x55d01960d800 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 <== osd.3 v2:172.21.15.79:6800/4145020298 6 ==== osd_op_reply(66 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d018838000 con 0x55d01960d800 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55d01960d400 msgr2=0x55d018a60000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55d01960d400 0x55d018a60000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55d018a58000 msgr2=0x55d018a60580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55d018a58000 0x55d018a60580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55d0195fac00 msgr2=0x55d018742100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55d0195fac00 0x55d018742100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55d01960d800 msgr2=0x55d018a60b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55d01960d800 0x55d018a60b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 reap_dead start 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55d018a59c00 msgr2=0x55d018a61b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55d018a59c00 0x55d018a61b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55d018a58c00 msgr2=0x55d018a61080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 reap_dead start 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55d018a58c00 0x55d018a61080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55d01960dc00 msgr2=0x55d018a61600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55d01960dc00 0x55d018a61600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55d018a58400 msgr2=0x55d018a62100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55d018a58400 0x55d018a62100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55d01960d000 msgr2=0x55d018743700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55d01960d000 0x55d018743700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55d0195b4f30 tx=0x55d0195b8c00 comp rx=0 tx=0).stop 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa400 msgr2=0x55d018742c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3234651912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0195fa400 0x55d018742c00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x55d0194ebf20 tx=0x55d019465f20 comp rx=0 tx=0).stop 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a635d640 1 -- 172.21.15.79:0/3234651912 reap_dead start 2024-06-10T00:21:50.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 shutdown_connections 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 >> 172.21.15.79:0/3234651912 conn(0x55d0194b1c00 msgr2=0x55d01944c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 shutdown_connections 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.242+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3234651912 wait complete. 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3328876473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0186c4c00 msgr2=0x55d018740580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0186c4c00 0x55d018740580 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x55d0194eb140 tx=0x55d019464960 comp rx=0 tx=0).stop 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3328876473 shutdown_connections 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0186c5c00 0x55d018741080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0186c5800 0x55d018740b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 --2- 172.21.15.79:0/3328876473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0186c4c00 0x55d018740580 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3328876473 >> 172.21.15.79:0/3328876473 conn(0x55d0186c5000 msgr2=0x55d01944d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3328876473 shutdown_connections 2024-06-10T00:21:50.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.243+0000 7f94a8b2d740 1 -- 172.21.15.79:0/3328876473 wait complete. 2024-06-10T00:21:50.250 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.087788, result: 2024-06-10T00:21:50.251 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-06-10T00:21:50.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.330+0000 7f1f40c0c740 1 -- start start 2024-06-10T00:21:50.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.330+0000 7f1f40c0c740 1 Processor -- start 2024-06-10T00:21:50.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bb6e6c00 0x5621bb763b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bb6e7800 0x5621bb763600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bb6e7c00 0x5621bb763080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5621bb85a180 con 0x5621bb6e7800 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5621bb746900 con 0x5621bb6e6c00 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5621bb746480 con 0x5621bb6e7c00 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bb6e7800 0x5621bb763600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bb6e7800 0x5621bb763600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41760/0 (socket says 172.21.15.79:41760) 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1360278770 learned_addr learned my addr 172.21.15.79:0/1360278770 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bb6e7c00 0x5621bb763080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bb6e6c00 0x5621bb763b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1360278770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bb6e7c00 msgr2=0x5621bb763080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bb6e7c00 0x5621bb763080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1360278770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bb6e6c00 msgr2=0x5621bb763b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bb6e6c00 0x5621bb763b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1360278770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bb713680 con 0x5621bb6e7800 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bb6e7800 0x5621bb763600 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x5621bc503c50 tx=0x5621bc48a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455ab94ef90e4b93 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3c077640 1 -- 172.21.15.79:0/1360278770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5621bb70c680 con 0x5621bb6e7800 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3c077640 1 -- 172.21.15.79:0/1360278770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5621bb72e1c0 con 0x5621bb6e7800 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f3c077640 1 -- 172.21.15.79:0/1360278770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5621bb70cb60 con 0x5621bb6e7800 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1360278770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621bb713860 con 0x5621bb6e7800 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1360278770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5621bb7132c0 con 0x5621bb6e7800 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.331+0000 7f1f40c0c740 4 waiting for MDS map... 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.332+0000 7f1f3c077640 1 -- 172.21.15.79:0/1360278770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x5621bc5b8600 con 0x5621bb6e7800 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.332+0000 7f1f3c077640 1 -- 172.21.15.79:0/1360278770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 57) ==== 2885+0+0 (secure 0 0 0) 0x5621bb73f180 con 0x5621bb6e7800 2024-06-10T00:21:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.332+0000 7f1f40c0c740 4 Got MDS map 57 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.332+0000 7f1f40c0c740 4 datascan.main: Using metadata pool output 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.332+0000 7f1f40c0c740 4 datascan.main: connecting to RADOS... 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.332+0000 7f1f40c0c740 1 Processor -- start 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.332+0000 7f1f40c0c740 1 -- start start 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bb800 0x5621bb762580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bbc00 0x5621bb764100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5621bb746180 con 0x5621bc5bb400 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5621bb85ad80 con 0x5621bc5bbc00 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5621bb85af00 con 0x5621bc5bb800 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41770/0 (socket says 172.21.15.79:41770) 2024-06-10T00:21:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 -- 172.21.15.79:0/2090991950 learned_addr learned my addr 172.21.15.79:0/2090991950 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bb800 0x5621bb762580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bbc00 0x5621bb764100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 -- 172.21.15.79:0/2090991950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bb800 msgr2=0x5621bb762580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bb800 0x5621bb762580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 -- 172.21.15.79:0/2090991950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bbc00 msgr2=0x5621bb764100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bbc00 0x5621bb764100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 -- 172.21.15.79:0/2090991950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bb7134a0 con 0x5621bc5bb400 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x5621bc503200 tx=0x5621bc486720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ff1ecdb682c575 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3a073640 1 -- 172.21.15.79:0/2090991950 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5621bb70c9c0 con 0x5621bc5bb400 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3a073640 1 -- 172.21.15.79:0/2090991950 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5621bb72ee00 con 0x5621bc5bb400 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.333+0000 7f1f3a073640 1 -- 172.21.15.79:0/2090991950 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5621bb70c680 con 0x5621bc5bb400 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 -- 172.21.15.79:0/2090991950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 msgr2=0x5621bb762b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x5621bc503200 tx=0x5621bc486720 comp rx=0 tx=0).stop 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 -- 172.21.15.79:0/2090991950 shutdown_connections 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bbc00 0x5621bb764100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bb800 0x5621bb762580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/2090991950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 -- 172.21.15.79:0/2090991950 >> 172.21.15.79:0/2090991950 conn(0x5621bc5bb000 msgr2=0x5621bb7d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 -- 172.21.15.79:0/2090991950 shutdown_connections 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 -- 172.21.15.79:0/2090991950 wait complete. 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 Processor -- start 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.334+0000 7f1f40c0c740 1 -- start start 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bb800 0x5621bb762580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f40c0c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bbc00 0x5621bb764100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5621bb85b200 con 0x5621bc5bb400 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5621bb85b080 con 0x5621bc5bb800 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f40c0c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5621bb85b380 con 0x5621bc5bbc00 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3f07d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3f07d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41780/0 (socket says 172.21.15.79:41780) 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 learned_addr learned my addr 172.21.15.79:0/1713119761 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bb800 0x5621bb762580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bbc00 0x5621bb764100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bbc00 msgr2=0x5621bb764100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bc5bbc00 0x5621bb764100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bb800 msgr2=0x5621bb762580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bc5bb800 0x5621bb762580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.335+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bb713680 con 0x5621bc5bb400 2024-06-10T00:21:50.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.336+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x5621bc503380 tx=0x5621bc4865a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.336+0000 7f1f38870640 1 -- 172.21.15.79:0/1713119761 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5621bb70cb60 con 0x5621bc5bb400 2024-06-10T00:21:50.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.336+0000 7f1f38870640 1 -- 172.21.15.79:0/1713119761 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5621bb72ec40 con 0x5621bc5bb400 2024-06-10T00:21:50.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.336+0000 7f1f38870640 1 -- 172.21.15.79:0/1713119761 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5621bb70c4e0 con 0x5621bc5bb400 2024-06-10T00:21:50.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.336+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621bb713860 con 0x5621bc5bb400 2024-06-10T00:21:50.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.336+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621bb7130e0 con 0x5621bc5bb400 2024-06-10T00:21:50.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.336+0000 7f1f40c0c740 4 datascan.init: resolving metadata pool 13 2024-06-10T00:21:50.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f38870640 1 -- 172.21.15.79:0/1713119761 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5621bc4b6c00 con 0x5621bc5bb400 2024-06-10T00:21:50.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f38870640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5621bba5a000 0x5621bba60000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f38870640 1 -- 172.21.15.79:0/1713119761 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x5621bc63c600 con 0x5621bc5bb400 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f40c0c740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f40c0c740 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f40c0c740 4 datascan.main: opening data pool 'cephfs_data' 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5621bba5a000 0x5621bba60000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5621bba5a400 0x5621bb764680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5a800 con 0x5621bba5a400 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.337+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5621bba5a400 0x5621bb764680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.338+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5621bba5a000 0x5621bba60000 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x5621bc488f00 tx=0x5621bb9f0ae0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.338+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5621bba5a400 0x5621bb764680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.338+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv24 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.338+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5621bba5ac00 0x5621bb764c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.338+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:2 13.1f 13:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5b000 con 0x5621bba5ac00 2024-06-10T00:21:50.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.338+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5621bba5ac00 0x5621bb764c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.339+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5621bba5ac00 0x5621bb764c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.339+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.339+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5621bba5b400 0x5621bb765180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.339+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:3 14.0 14:00000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7e000 con 0x5621bba5b400 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.339+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5621bba5b400 0x5621bb765180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.339+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5621bba5b400 0x5621bb765180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.340+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.340+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:4 14.20 14:04000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7f800 con 0x5621bba5a400 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.340+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.340+0000 7f1f3a073640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5621bba7fc00 0x5621bba60580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.340+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:5 14.10 14:08000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80000 con 0x5621bba7fc00 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.340+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5621bba7fc00 0x5621bba60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.340+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5621bba7fc00 0x5621bba60580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:6 14.30 14:0c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80800 con 0x5621bba5a400 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 3 ==== osd_op_reply(6 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:7 14.8 14:10000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80400 con 0x5621bba5a400 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 4 ==== osd_op_reply(7 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f39872640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5621bba80c00 0x5621bba60b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:8 14.28 14:14000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7f800 con 0x5621bba80c00 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5621bba80c00 0x5621bba60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.341+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5621bba80c00 0x5621bba60b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:9 14.18 14:18000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80000 con 0x5621bba7fc00 2024-06-10T00:21:50.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:10 14.38 14:1c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5a800 con 0x5621bba7fc00 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:11 14.4 14:20000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80800 con 0x5621bba5ac00 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f39872640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5621bc5ba800 0x5621bba61080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.342+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:12 14.24 14:24000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81400 con 0x5621bc5ba800 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.343+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5621bc5ba800 0x5621bba61080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.343+0000 7f1f3e87c640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5621bc5ba800 0x5621bba61080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.343+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(12 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.343+0000 7f1f3a073640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5621bba81000 0x5621bba61b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.343+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:13 14.14 14:28000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a000 con 0x5621bba81000 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.344+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5621bba81000 0x5621bba61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.344+0000 7f1f3e07b640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5621bba81000 0x5621bba61b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.344+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.344+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:14 14.34 14:2c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81800 con 0x5621bba5b400 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.344+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 2 ==== osd_op_reply(14 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.344+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:15 14.c 14:30000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a400 con 0x5621bba5a400 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.345+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 5 ==== osd_op_reply(15 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.345+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:16 14.2c 14:34000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81c00 con 0x5621bba7fc00 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.345+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 4 ==== osd_op_reply(16 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.345+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:17 14.1c 14:38000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a800 con 0x5621bba5a400 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.345+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.345+0000 7f1f39872640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5621bba9a000 0x5621bba61600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.345+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:18 14.3c 14:3c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80400 con 0x5621bba9a000 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.345+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5621bba9a000 0x5621bba61600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.346+0000 7f1f3f07d640 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5621bba9a000 0x5621bba61600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.346+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.346+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:19 14.2 14:40000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9ac00 con 0x5621bba5ac00 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.346+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.346+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:20 14.22 14:44000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80000 con 0x5621bba81000 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.346+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.347+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:21 14.12 14:48000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80800 con 0x5621bba5b400 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.347+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 3 ==== osd_op_reply(21 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.347+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:22 14.32 14:4c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81c00 con 0x5621bba81000 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.347+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.347+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:23 14.a 14:50000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80400 con 0x5621bc5ba800 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.348+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 2 ==== osd_op_reply(23 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.348+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:24 14.2a 14:54000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5a800 con 0x5621bba81000 2024-06-10T00:21:50.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.348+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.348+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:25 14.1a 14:58000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7f800 con 0x5621bba5a400 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.348+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.348+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:26 14.3a 14:5c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a400 con 0x5621bba5a400 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.348+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 8 ==== osd_op_reply(26 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.348+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:27 14.6 14:60000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5b000 con 0x5621bba5a400 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.349+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 9 ==== osd_op_reply(27 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.349+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:28 14.26 14:64000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b000 con 0x5621bba81000 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.349+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.349+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:29 14.16 14:68000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bc4cb400 con 0x5621bba80c00 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.349+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.349+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:30 14.36 14:6c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81400 con 0x5621bba5b400 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.349+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 4 ==== osd_op_reply(30 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.349+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:31 14.e 14:70000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a800 con 0x5621bba81000 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.350+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 6 ==== osd_op_reply(31 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.350+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:32 14.2e 14:74000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81800 con 0x5621bba80c00 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.350+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 3 ==== osd_op_reply(32 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.350+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:33 14.1e 14:78000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5a800 con 0x5621bba9a000 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.351+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 2 ==== osd_op_reply(33 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.351+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:34 14.3e 14:7c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80800 con 0x5621bc5ba800 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.351+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.351+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:35 14.1 14:80000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5b000 con 0x5621bba80c00 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.351+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.351+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:36 14.21 14:84000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7e000 con 0x5621bc5ba800 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.352+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.352+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:37 14.11 14:88000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7f800 con 0x5621bba81000 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.352+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.352+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:38 14.31 14:8c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a400 con 0x5621bba7fc00 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.352+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 5 ==== osd_op_reply(38 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.352+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:39 14.9 14:90000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80000 con 0x5621bc5ba800 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.353+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.353+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:40 14.29 14:94000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b400 con 0x5621bba5ac00 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.353+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.353+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:41 14.19 14:98000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81c00 con 0x5621bba5ac00 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.354+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.354+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:42 14.39 14:9c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b800 con 0x5621bba9a000 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.354+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 3 ==== osd_op_reply(42 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.354+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:43 14.5 14:a0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81800 con 0x5621bba5a400 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.354+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 10 ==== osd_op_reply(43 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.354+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:44 14.25 14:a4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9bc00 con 0x5621bba5b400 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.355+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.355+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:45 14.15 14:a8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7e000 con 0x5621bba9a000 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.355+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 4 ==== osd_op_reply(45 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.355+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:46 14.35 14:ac000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80400 con 0x5621bba81000 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.355+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.355+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:47 14.d 14:b0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9ac00 con 0x5621bba5ac00 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.355+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 6 ==== osd_op_reply(47 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:48 14.2d 14:b4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81400 con 0x5621bba81000 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:49 14.1d 14:b8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b400 con 0x5621bba5a400 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 11 ==== osd_op_reply(49 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:50 14.3d 14:bc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80800 con 0x5621bba80c00 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 5 ==== osd_op_reply(50 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:51 14.3 14:c0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5a800 con 0x5621bba5a400 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 12 ==== osd_op_reply(51 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.356+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:52 14.23 14:c4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80000 con 0x5621bba9a000 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.357+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 5 ==== osd_op_reply(52 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.357+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:53 14.13 14:c8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5b000 con 0x5621bba5b400 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.357+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 6 ==== osd_op_reply(53 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.357+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:54 14.33 14:cc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b000 con 0x5621bba5b400 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.357+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 7 ==== osd_op_reply(54 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.357+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:55 14.b 14:d0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bc4cb400 con 0x5621bba5a400 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.358+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 13 ==== osd_op_reply(55 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.358+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:56 14.2b 14:d4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a800 con 0x5621bba81000 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.358+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 10 ==== osd_op_reply(56 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.358+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:57 14.1b 14:d8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8000 con 0x5621bba9a000 2024-06-10T00:21:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.358+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 6 ==== osd_op_reply(57 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.358+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:58 14.3b 14:dc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a400 con 0x5621bba81000 2024-06-10T00:21:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.359+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 11 ==== osd_op_reply(58 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.359+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:59 14.7 14:e0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8400 con 0x5621bc5ba800 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.359+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 6 ==== osd_op_reply(59 [pgnls-filter start_epoch 92 out=81b] v92'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.359+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:60 14.0 14:00000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7e400 con 0x5621bba5b400 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.359+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 8 ==== osd_op_reply(60 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.359+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:61 14.20 14:04000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8800 con 0x5621bba5a400 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 14 ==== osd_op_reply(61 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:62 14.10 14:08000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b400 con 0x5621bba7fc00 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 6 ==== osd_op_reply(62 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:63 14.30 14:0c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8c00 con 0x5621bba5a400 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 15 ==== osd_op_reply(63 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:64 14.8 14:10000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81800 con 0x5621bba5a400 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 16 ==== osd_op_reply(64 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:65 14.28 14:14000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9000 con 0x5621bba80c00 2024-06-10T00:21:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.360+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:66 14.18 14:18000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80400 con 0x5621bba7fc00 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.361+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 7 ==== osd_op_reply(66 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.361+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:67 14.38 14:1c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9400 con 0x5621bba7fc00 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.361+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 8 ==== osd_op_reply(67 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.361+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:68 14.4 14:20000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81400 con 0x5621bba5ac00 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.361+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.361+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:69 14.24 14:24000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9800 con 0x5621bc5ba800 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.362+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 7 ==== osd_op_reply(69 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.362+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:70 14.14 14:28000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7f800 con 0x5621bba81000 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.362+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 12 ==== osd_op_reply(70 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.362+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:71 14.34 14:2c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9c00 con 0x5621bba5b400 2024-06-10T00:21:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.363+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 9 ==== osd_op_reply(71 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.363+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:72 14.c 14:30000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9bc00 con 0x5621bba5a400 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.363+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 17 ==== osd_op_reply(72 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.363+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:73 14.2c 14:34000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8400 con 0x5621bba7fc00 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.363+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 9 ==== osd_op_reply(73 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.363+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:74 14.1c 14:38000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b000 con 0x5621bba5a400 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.363+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 18 ==== osd_op_reply(74 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.363+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:75 14.3c 14:3c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9800 con 0x5621bba9a000 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.364+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 7 ==== osd_op_reply(75 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.364+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:76 14.2 14:40000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a800 con 0x5621bba5ac00 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.364+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.364+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:77 14.22 14:44000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81800 con 0x5621bba81000 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.364+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 13 ==== osd_op_reply(77 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.364+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:78 14.12 14:48000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a400 con 0x5621bba5b400 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.365+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 10 ==== osd_op_reply(78 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.365+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:79 14.32 14:4c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80400 con 0x5621bba81000 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.365+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.365+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:80 14.a 14:50000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b400 con 0x5621bc5ba800 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.365+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 8 ==== osd_op_reply(80 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.365+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:81 14.2a 14:54000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81c00 con 0x5621bba81000 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.366+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 15 ==== osd_op_reply(81 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.366+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:82 14.1a 14:58000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7e400 con 0x5621bba5a400 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.366+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 19 ==== osd_op_reply(82 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.366+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:83 14.3a 14:5c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80800 con 0x5621bba5a400 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.366+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 20 ==== osd_op_reply(83 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.366+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:84 14.6 14:60000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7e000 con 0x5621bba5a400 2024-06-10T00:21:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.366+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 21 ==== osd_op_reply(84 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.366+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:85 14.26 14:64000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80000 con 0x5621bba81000 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.367+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 16 ==== osd_op_reply(85 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.367+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:86 14.16 14:68000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bc4cb400 con 0x5621bba80c00 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.367+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 7 ==== osd_op_reply(86 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.367+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:87 14.36 14:6c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b800 con 0x5621bba5b400 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.367+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 11 ==== osd_op_reply(87 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.367+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:88 14.e 14:70000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5b000 con 0x5621bba81000 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.368+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 17 ==== osd_op_reply(88 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.368+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:89 14.2e 14:74000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9ac00 con 0x5621bba80c00 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.368+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 8 ==== osd_op_reply(89 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.368+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:90 14.1e 14:78000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5a800 con 0x5621bba9a000 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.368+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 8 ==== osd_op_reply(90 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.368+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:91 14.3e 14:7c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9400 con 0x5621bc5ba800 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.369+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 9 ==== osd_op_reply(91 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.369+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:92 14.1 14:80000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8800 con 0x5621bba80c00 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.369+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 9 ==== osd_op_reply(92 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.369+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:93 14.21 14:84000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8400 con 0x5621bc5ba800 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.369+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 10 ==== osd_op_reply(93 [pgnls-filter start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.369+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:94 14.11 14:88000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8c00 con 0x5621bba81000 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.369+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 18 ==== osd_op_reply(94 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.370+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:95 14.31 14:8c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81800 con 0x5621bba7fc00 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.370+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 10 ==== osd_op_reply(95 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.370+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:96 14.9 14:90000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8000 con 0x5621bc5ba800 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.370+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 11 ==== osd_op_reply(96 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.370+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:97 14.29 14:94000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80400 con 0x5621bba5ac00 2024-06-10T00:21:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.370+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 9 ==== osd_op_reply(97 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.370+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:98 14.19 14:98000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9c00 con 0x5621bba5ac00 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.371+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 10 ==== osd_op_reply(98 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.371+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:99 14.39 14:9c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81c00 con 0x5621bba9a000 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.371+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 9 ==== osd_op_reply(99 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.371+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:100 14.5 14:a0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9400 con 0x5621bba5a400 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.371+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 22 ==== osd_op_reply(100 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.371+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:101 14.25 14:a4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80800 con 0x5621bba5b400 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.372+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 12 ==== osd_op_reply(101 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.372+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:102 14.15 14:a8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8400 con 0x5621bba9a000 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.372+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 10 ==== osd_op_reply(102 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.372+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:103 14.35 14:ac000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7f800 con 0x5621bba81000 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.372+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 19 ==== osd_op_reply(103 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.372+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:104 14.d 14:b0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8000 con 0x5621bba5ac00 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.372+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 11 ==== osd_op_reply(104 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.372+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:105 14.2d 14:b4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7e400 con 0x5621bba81000 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.373+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 20 ==== osd_op_reply(105 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.373+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:106 14.1d 14:b8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba5a800 con 0x5621bba5a400 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.373+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 23 ==== osd_op_reply(106 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.373+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:107 14.3d 14:bc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9bc00 con 0x5621bba80c00 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.373+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 10 ==== osd_op_reply(107 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.373+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:108 14.3 14:c0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a400 con 0x5621bba5a400 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.373+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 24 ==== osd_op_reply(108 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.373+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:109 14.23 14:c4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b000 con 0x5621bba9a000 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.374+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 11 ==== osd_op_reply(109 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.374+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:110 14.13 14:c8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b400 con 0x5621bba5b400 2024-06-10T00:21:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.374+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 13 ==== osd_op_reply(110 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.374+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:111 14.33 14:cc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9000 con 0x5621bba5b400 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.374+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.2 v2:172.21.15.79:6816/3079975341 14 ==== osd_op_reply(111 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bba5b400 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.374+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:112 14.b 14:d0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b800 con 0x5621bba5a400 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.375+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 25 ==== osd_op_reply(112 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.375+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:113 14.2b 14:d4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9800 con 0x5621bba81000 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.375+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 21 ==== osd_op_reply(113 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.375+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:114 14.1b 14:d8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a800 con 0x5621bba9a000 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.375+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 12 ==== osd_op_reply(114 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.375+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:115 14.3b 14:dc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8800 con 0x5621bba81000 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.376+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 22 ==== osd_op_reply(115 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.376+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:116 14.7 14:e0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9ac00 con 0x5621bc5ba800 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.376+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 12 ==== osd_op_reply(116 [pgnls-filter start_epoch 92 out=81b] v92'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.376+0000 7f1f40c0c740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.376+0000 7f1f40c0c740 10 datascan.operator(): handling object 10000000001.0 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.376+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:117 14.7 14:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7ec00 con 0x5621bc5ba800 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 13 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) ==== 416+0+157 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f40c0c740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f40c0c740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f40c0c740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:118 13.10 13:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7f000 con 0x5621bba7fc00 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 11 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) ==== 164+0+59 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f40c0c740 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5621bba7f400 con 0x5621bba5ac00 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.6 v2:172.21.15.117:6808/1306883621 12 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv9 ondisk = 0) ==== 154+0+520 (crc 0 0 0) 0x5621bc474500 con 0x5621bba5ac00 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.377+0000 7f1f40c0c740 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-06-10T00:21:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 20 datascan.get_frag_of: frag is * 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:120 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa9c00 con 0x5621bba7fc00 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 12 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 10 datascan.find_or_create_dirfrag: read_version = 17 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:121 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8400 con 0x5621bba7fc00 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 13 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 20 datascan.read_dentry: file_head not found in result 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.378+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:122 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x5621bbaa8000 con 0x5621bba7fc00 2024-06-10T00:21:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.379+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 14 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v92'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.379+0000 7f1f40c0c740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.379+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:123 14.27 14:e4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba80400 con 0x5621bc5ba800 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.379+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 <== osd.5 v2:172.21.15.117:6800/419453692 14 ==== osd_op_reply(123 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474780 con 0x5621bc5ba800 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.379+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:124 14.17 14:e8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bc4cb400 con 0x5621bba7fc00 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.380+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.1 v2:172.21.15.79:6808/15559294 15 ==== osd_op_reply(124 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba7fc00 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.380+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:125 14.37 14:ec000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9bc00 con 0x5621bba81000 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.380+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.4 v2:172.21.15.117:6824/279504764 23 ==== osd_op_reply(125 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba81000 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.380+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:126 14.f 14:f0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba81400 con 0x5621bba9a000 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.380+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.7 v2:172.21.15.117:6816/2099086267 13 ==== osd_op_reply(126 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba9a000 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.380+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:127 14.2f 14:f4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b000 con 0x5621bba5a400 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 26 ==== osd_op_reply(127 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f39872640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:128 14.1f 14:f8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9b800 con 0x5621bba5a400 2024-06-10T00:21:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f3e07b640 1 -- 172.21.15.79:0/1713119761 <== osd.0 v2:172.21.15.79:6824/709635793 27 ==== osd_op_reply(128 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474000 con 0x5621bba5a400 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f3a073640 1 -- 172.21.15.79:0/1713119761 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:129 14.3f 14:fc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5621bba9a800 con 0x5621bba80c00 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f3f07d640 1 -- 172.21.15.79:0/1713119761 <== osd.3 v2:172.21.15.79:6800/4145020298 11 ==== osd_op_reply(129 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5621bc474500 con 0x5621bba80c00 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5621bba5a400 msgr2=0x5621bb764680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5621bba5a400 0x5621bb764680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5621bba7fc00 msgr2=0x5621bba60580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5621bba7fc00 0x5621bba60580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5621bba5b400 msgr2=0x5621bb765180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5621bba5b400 0x5621bb765180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5621bba80c00 msgr2=0x5621bba60b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5621bba80c00 0x5621bba60b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 reap_dead start 2024-06-10T00:21:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5621bba81000 msgr2=0x5621bba61b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5621bba81000 0x5621bba61b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5621bc5ba800 msgr2=0x5621bba61080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5621bc5ba800 0x5621bba61080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5621bba5ac00 msgr2=0x5621bb764c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5621bba5ac00 0x5621bb764c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5621bba9a000 msgr2=0x5621bba61600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5621bba9a000 0x5621bba61600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f3e87c640 1 -- 172.21.15.79:0/1713119761 reap_dead start 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5621bba5a000 msgr2=0x5621bba60000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5621bba5a000 0x5621bba60000 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x5621bc488f00 tx=0x5621bb9f0ae0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 msgr2=0x5621bb762b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x5621bc503380 tx=0x5621bc4865a0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 shutdown_connections 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5621bba5a000 0x5621bba60000 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1713119761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bc5bb400 0x5621bb762b00 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.381+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 >> 172.21.15.79:0/1713119761 conn(0x5621bc5bb000 msgr2=0x5621bb7d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 shutdown_connections 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1713119761 wait complete. 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1360278770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bb6e7800 msgr2=0x5621bb763600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bb6e7800 0x5621bb763600 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x5621bc503c50 tx=0x5621bc48a120 comp rx=0 tx=0).stop 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1360278770 shutdown_connections 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5621bb6e7c00 0x5621bb763080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621bb6e7800 0x5621bb763600 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 --2- 172.21.15.79:0/1360278770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621bb6e6c00 0x5621bb763b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1360278770 >> 172.21.15.79:0/1360278770 conn(0x5621bb6e7000 msgr2=0x5621bb7d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1360278770 shutdown_connections 2024-06-10T00:21:50.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.382+0000 7f1f40c0c740 1 -- 172.21.15.79:0/1360278770 wait complete. 2024-06-10T00:21:50.400 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.149273, result: 2024-06-10T00:21:50.400 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-06-10T00:21:50.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.463+0000 7fcac8a16740 1 -- start start 2024-06-10T00:21:50.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.463+0000 7fcac8a16740 1 Processor -- start 2024-06-10T00:21:50.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d91cac00 0x5564d9247b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d91cb800 0x5564d9247600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d91cbc00 0x5564d9247080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac8a16740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564d9fba180 con 0x5564d91cac00 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac8a16740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564d922a900 con 0x5564d91cb800 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac8a16740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5564d922a480 con 0x5564d91cbc00 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac66a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d91cac00 0x5564d9247b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac66a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d91cac00 0x5564d9247b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41798/0 (socket says 172.21.15.79:41798) 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac66a0640 1 -- 172.21.15.79:0/3533973762 learned_addr learned my addr 172.21.15.79:0/3533973762 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d91cb800 0x5564d9247600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d91cbc00 0x5564d9247080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac66a0640 1 -- 172.21.15.79:0/3533973762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d91cbc00 msgr2=0x5564d9247080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac66a0640 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d91cbc00 0x5564d9247080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac66a0640 1 -- 172.21.15.79:0/3533973762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d91cb800 msgr2=0x5564d9247600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac66a0640 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d91cb800 0x5564d9247600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.464+0000 7fcac66a0640 1 -- 172.21.15.79:0/3533973762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d91f7680 con 0x5564d91cac00 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac66a0640 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d91cac00 0x5564d9247b80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x5564d9ff5c50 tx=0x5564d9f6c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa5c22026412c4b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac3e9b640 1 -- 172.21.15.79:0/3533973762 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564d91f0680 con 0x5564d91cac00 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac3e9b640 1 -- 172.21.15.79:0/3533973762 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5564d92121c0 con 0x5564d91cac00 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac3e9b640 1 -- 172.21.15.79:0/3533973762 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564d91f0b60 con 0x5564d91cac00 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac8a16740 1 -- 172.21.15.79:0/3533973762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d91f7860 con 0x5564d91cac00 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac8a16740 1 -- 172.21.15.79:0/3533973762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5564d91f72c0 con 0x5564d91cac00 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac8a16740 4 waiting for MDS map... 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac3e9b640 1 -- 172.21.15.79:0/3533973762 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x5564d9fa4600 con 0x5564d91cac00 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac3e9b640 1 -- 172.21.15.79:0/3533973762 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 57) ==== 2885+0+0 (secure 0 0 0) 0x5564d9223180 con 0x5564d91cac00 2024-06-10T00:21:50.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac8a16740 4 Got MDS map 57 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac8a16740 4 datascan.main: Using metadata pool output 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.465+0000 7fcac8a16740 4 datascan.main: connecting to RADOS... 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac8a16740 1 Processor -- start 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac8a16740 1 -- start start 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09b400 0x5564d9246b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 0x5564d9246580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09bc00 0x5564d9248100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac8a16740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564d922a180 con 0x5564da09bc00 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac8a16740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564d9fbad80 con 0x5564da09b800 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac8a16740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5564d9fbaf00 con 0x5564da09b400 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac5e9f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09bc00 0x5564d9248100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac5e9f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09bc00 0x5564d9248100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41810/0 (socket says 172.21.15.79:41810) 2024-06-10T00:21:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2581911718 learned_addr learned my addr 172.21.15.79:0/2581911718 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac66a0640 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 0x5564d9246580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.466+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09b400 0x5564d9246b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09b400 msgr2=0x5564d9246b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09b400 0x5564d9246b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 msgr2=0x5564d9246580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 0x5564d9246580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2581911718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d91f74a0 con 0x5564da09bc00 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09b400 0x5564d9246b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09bc00 0x5564d9248100 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x5564d9ff51d0 tx=0x5564d9f6a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d8b94bed78d199 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac1e97640 1 -- 172.21.15.79:0/2581911718 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564d91f09c0 con 0x5564da09bc00 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac1e97640 1 -- 172.21.15.79:0/2581911718 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5564d9212e00 con 0x5564da09bc00 2024-06-10T00:21:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac1e97640 1 -- 172.21.15.79:0/2581911718 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564d91f0680 con 0x5564da09bc00 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 -- 172.21.15.79:0/2581911718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09bc00 msgr2=0x5564d9248100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09bc00 0x5564d9248100 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x5564d9ff51d0 tx=0x5564d9f6a6c0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 -- 172.21.15.79:0/2581911718 shutdown_connections 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09bc00 0x5564d9248100 secure :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x5564d9ff51d0 tx=0x5564d9f6a6c0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 0x5564d9246580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2581911718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09b400 0x5564d9246b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 -- 172.21.15.79:0/2581911718 >> 172.21.15.79:0/2581911718 conn(0x5564da09b000 msgr2=0x5564d9f55000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 -- 172.21.15.79:0/2581911718 shutdown_connections 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.467+0000 7fcac8a16740 1 -- 172.21.15.79:0/2581911718 wait complete. 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac8a16740 1 Processor -- start 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac8a16740 1 -- start start 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09b400 0x5564d9246b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 0x5564d9246580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac8a16740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09bc00 0x5564d9248680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac8a16740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564d9fbb200 con 0x5564da09b400 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac8a16740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564d9fbb080 con 0x5564da09b800 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac8a16740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5564d9fbb380 con 0x5564da09bc00 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac6ea1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09b400 0x5564d9246b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac6ea1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09b400 0x5564d9246b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41824/0 (socket says 172.21.15.79:41824) 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.468+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 learned_addr learned my addr 172.21.15.79:0/2152784825 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac66a0640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 0x5564d9246580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09bc00 0x5564d9248680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09bc00 msgr2=0x5564d9248680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564da09bc00 0x5564d9248680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 msgr2=0x5564d9246580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564da09b800 0x5564d9246580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d91f7680 con 0x5564da09b400 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09b400 0x5564d9246b00 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x5564da0b57d0 tx=0x5564da0bb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac0694640 1 -- 172.21.15.79:0/2152784825 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564d91f09c0 con 0x5564da09b400 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac0694640 1 -- 172.21.15.79:0/2152784825 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5564d9212540 con 0x5564da09b400 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564d91f7860 con 0x5564da09b400 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac0694640 1 -- 172.21.15.79:0/2152784825 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564d91f0680 con 0x5564da09b400 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d91f70e0 con 0x5564da09b400 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.469+0000 7fcac8a16740 4 datascan.init: resolving metadata pool 13 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.470+0000 7fcac0694640 1 -- 172.21.15.79:0/2152784825 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5564d9fa6c00 con 0x5564da09b400 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.470+0000 7fcac0694640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5564d9fd8c00 0x5564d9554000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac0694640 1 -- 172.21.15.79:0/2152784825 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x5564da120a00 con 0x5564da09b400 2024-06-10T00:21:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac66a0640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5564d9fd8c00 0x5564d9554000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac8a16740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-06-10T00:21:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac8a16740 4 datascan.main: resolving metadata pool 13 2024-06-10T00:21:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5564d9fbd400 0x5564d9248c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbd000 con 0x5564d9fbd400 2024-06-10T00:21:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5564d9fbd400 0x5564d9248c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac66a0640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5564d9fd8c00 0x5564d9554000 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5564da0b4120 tx=0x5564d9f6aa80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.471+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5564d9fbd400 0x5564d9248c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(1 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5564d9fbd000 0x5564d9248100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:2 13.10 13:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566000 con 0x5564d9fbd000 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5564d9fbd000 0x5564d9248100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5564d9fbd000 0x5564d9248100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(2 [pgnls start_epoch 92 out=177b] v92'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5564d9566000 0x5564d9554580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:3 13.8 13:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567400 con 0x5564d9566000 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.472+0000 7fcac66a0640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5564d9566000 0x5564d9554580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.473+0000 7fcac66a0640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5564d9566000 0x5564d9554580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.473+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== osd_op_reply(3 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566000 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.473+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:4 13.18 13:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567400 con 0x5564d9fbd400 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.473+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 2 ==== osd_op_reply(4 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.473+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5564d9567400 0x5564d9554b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.473+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:5 13.4 13:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566400 con 0x5564d9567400 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.473+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5564d9567400 0x5564d9554b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.474+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5564d9567400 0x5564d9554b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.474+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(5 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.474+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5564d9566400 0x5564d9555080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.474+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:6 13.14 13:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566800 con 0x5564d9566400 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.474+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5564d9566400 0x5564d9555080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.474+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5564d9566400 0x5564d9555080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.475+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(6 [pgnls start_epoch 92 out=149b] v91'27 uv27 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x5564d933e500 con 0x5564d9566400 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.475+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:7 13.c 13:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566800 con 0x5564d9fbd000 2024-06-10T00:21:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.475+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== osd_op_reply(7 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.475+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:8 13.1c 13:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566800 con 0x5564d9567400 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.475+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(8 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.475+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5564d9566800 0x5564d9555600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.475+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:9 13.2 13:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566c00 con 0x5564d9566800 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.475+0000 7fcac66a0640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5564d9566800 0x5564d9555600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.476+0000 7fcac66a0640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5564d9566800 0x5564d9555600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.476+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(9 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566800 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.476+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:10 13.12 13:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566c00 con 0x5564d9566400 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.476+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== osd_op_reply(10 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9566400 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.476+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:11 13.a 13:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566c00 con 0x5564d9566000 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.477+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.2 v2:172.21.15.79:6816/3079975341 2 ==== osd_op_reply(11 [pgnls start_epoch 92 out=81b] v91'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566000 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.477+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:12 13.1a 13:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9566c00 con 0x5564d9fbd000 2024-06-10T00:21:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.477+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 3 ==== osd_op_reply(12 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.477+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5564d9566c00 0x5564d9555b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.477+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:13 13.6 13:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567800 con 0x5564d9566c00 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.477+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5564d9566c00 0x5564d9555b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.477+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5564d9566c00 0x5564d9555b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.478+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(13 [pgnls start_epoch 92 out=77b] v91'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.478+0000 7fcac5e9f640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5564d9567800 0x5564d9556680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.478+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:14 13.16 13:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9567800 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.478+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5564d9567800 0x5564d9556680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.478+0000 7fcac6ea1640 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5564d9567800 0x5564d9556680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.478+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== osd_op_reply(14 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9567800 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.478+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:15 13.e 13:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9fbd400 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.479+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 3 ==== osd_op_reply(15 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.479+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:16 13.1e 13:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566c00 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.479+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== osd_op_reply(16 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.479+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:17 13.1 13:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9567400 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.479+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 3 ==== osd_op_reply(17 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.479+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:18 13.11 13:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9fbd000 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.479+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 4 ==== osd_op_reply(18 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.479+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:19 13.9 13:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566800 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.480+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.5 v2:172.21.15.117:6800/419453692 2 ==== osd_op_reply(19 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566800 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.480+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:20 13.19 13:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9567800 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.480+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== osd_op_reply(20 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9567800 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.480+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:21 13.5 13:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566c00 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.480+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 3 ==== osd_op_reply(21 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.480+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:22 13.15 13:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566c00 2024-06-10T00:21:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.480+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 4 ==== osd_op_reply(22 [pgnls start_epoch 92 out=97b] v91'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.480+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:23 13.d 13:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566c00 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.481+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 5 ==== osd_op_reply(23 [pgnls start_epoch 92 out=74b] v87'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.481+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:24 13.1d 13:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9fbd400 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.481+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 4 ==== osd_op_reply(24 [pgnls start_epoch 92 out=73b] v91'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.481+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:25 13.3 13:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566400 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.481+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.0 v2:172.21.15.79:6824/709635793 3 ==== osd_op_reply(25 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9566400 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.481+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:26 13.13 13:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9fbd400 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.482+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 5 ==== osd_op_reply(26 [pgnls start_epoch 92 out=98b] v91'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.482+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:27 13.b 13:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566800 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.482+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.5 v2:172.21.15.117:6800/419453692 3 ==== osd_op_reply(27 [pgnls start_epoch 92 out=76b] v91'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566800 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.482+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:28 13.1b 13:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566c00 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.482+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 6 ==== osd_op_reply(28 [pgnls start_epoch 92 out=73b] v91'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.483+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:29 13.7 13:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9fbd400 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.483+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 6 ==== osd_op_reply(29 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.483+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:30 13.17 13:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566800 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.483+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.5 v2:172.21.15.117:6800/419453692 4 ==== osd_op_reply(30 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566800 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.483+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:31 13.f 13:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9567400 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.483+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 4 ==== osd_op_reply(31 [pgnls start_epoch 92 out=73b] v87'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.483+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:32 13.1f 13:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9567400 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 5 ==== osd_op_reply(32 [pgnls start_epoch 92 out=101b] v91'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:33 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbcc00 con 0x5564d9fbd000 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:34 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbc800 con 0x5564d9fbd000 2024-06-10T00:21:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.484+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:35 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a000 con 0x5564d9fbd000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 20 datascan.scan_links: injected ino detected 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:36 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a400 con 0x5564d9fbd000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:37 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a800 con 0x5564d9fbd000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-06-10T00:21:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:38 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958ac00 con 0x5564d9566400 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.0 v2:172.21.15.79:6824/709635793 4 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9566400 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.485+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:39 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958b000 con 0x5564d9567400 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:40 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958b400 con 0x5564d9566000 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.2 v2:172.21.15.79:6816/3079975341 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566000 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-06-10T00:21:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:41 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a000 con 0x5564d9fbd400 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 7 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.486+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:42 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a400 con 0x5564d9566c00 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:43 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958b800 con 0x5564d9fbd400 2024-06-10T00:21:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 8 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:44 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958bc00 con 0x5564d9fbd400 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 9 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 200.00000002 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.487+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:45 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbcc00 con 0x5564d9fbd400 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 10 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac8a16740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:46 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbc800 con 0x5564d9567400 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 7 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) ==== 154+0+1041 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:47 13.0 13:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd400 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 11 ==== osd_op_reply(47 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.488+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:48 13.10 13:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd000 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.489+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 10 ==== osd_op_reply(48 [pgnls start_epoch 92 out=177b] v92'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.489+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:49 13.8 13:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566000 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.489+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.2 v2:172.21.15.79:6816/3079975341 4 ==== osd_op_reply(49 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566000 2024-06-10T00:21:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.489+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:50 13.18 13:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.489+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 12 ==== osd_op_reply(50 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.489+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:51 13.4 13:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9567400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.490+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 8 ==== osd_op_reply(51 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.490+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:52 13.14 13:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.490+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.0 v2:172.21.15.79:6824/709635793 5 ==== osd_op_reply(52 [pgnls start_epoch 92 out=149b] v91'27 uv27 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x5564d933e500 con 0x5564d9566400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.490+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:53 13.c 13:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd000 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.490+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 11 ==== osd_op_reply(53 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.490+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:54 13.1c 13:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9567400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.491+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 9 ==== osd_op_reply(54 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.491+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:55 13.2 13:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566800 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.491+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.5 v2:172.21.15.117:6800/419453692 5 ==== osd_op_reply(55 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566800 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.491+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:56 13.12 13:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566400 2024-06-10T00:21:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.491+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.0 v2:172.21.15.79:6824/709635793 6 ==== osd_op_reply(56 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9566400 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.491+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:57 13.a 13:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566000 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.491+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.2 v2:172.21.15.79:6816/3079975341 5 ==== osd_op_reply(57 [pgnls start_epoch 92 out=81b] v91'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566000 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.491+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:58 13.1a 13:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd000 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.492+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 12 ==== osd_op_reply(58 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.492+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:59 13.6 13:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566c00 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.492+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 8 ==== osd_op_reply(59 [pgnls start_epoch 92 out=77b] v91'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.492+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:60 13.16 13:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9567800 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.492+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.3 v2:172.21.15.79:6800/4145020298 3 ==== osd_op_reply(60 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9567800 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.492+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:61 13.e 13:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd400 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.492+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 13 ==== osd_op_reply(61 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.492+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:62 13.1e 13:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566c00 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.493+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 9 ==== osd_op_reply(62 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.493+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:63 13.1 13:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9567400 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.493+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 10 ==== osd_op_reply(63 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.493+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:64 13.11 13:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd000 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.493+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 13 ==== osd_op_reply(64 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.493+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:65 13.9 13:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566800 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.494+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.5 v2:172.21.15.117:6800/419453692 6 ==== osd_op_reply(65 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566800 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.494+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:66 13.19 13:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9567800 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.494+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.3 v2:172.21.15.79:6800/4145020298 4 ==== osd_op_reply(66 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9567800 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.494+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:67 13.5 13:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566c00 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.494+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 10 ==== osd_op_reply(67 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.494+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:68 13.15 13:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566c00 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.494+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 11 ==== osd_op_reply(68 [pgnls start_epoch 92 out=97b] v91'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.494+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:69 13.d 13:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566c00 2024-06-10T00:21:50.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.495+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 12 ==== osd_op_reply(69 [pgnls start_epoch 92 out=74b] v87'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.495+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:70 13.1d 13:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd400 2024-06-10T00:21:50.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.495+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 14 ==== osd_op_reply(70 [pgnls start_epoch 92 out=73b] v91'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.495+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:71 13.3 13:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566400 2024-06-10T00:21:50.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.495+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.0 v2:172.21.15.79:6824/709635793 7 ==== osd_op_reply(71 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e500 con 0x5564d9566400 2024-06-10T00:21:50.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.495+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:72 13.13 13:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd400 2024-06-10T00:21:50.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.495+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 15 ==== osd_op_reply(72 [pgnls start_epoch 92 out=98b] v91'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.495+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:73 13.b 13:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566800 2024-06-10T00:21:50.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.496+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.5 v2:172.21.15.117:6800/419453692 7 ==== osd_op_reply(73 [pgnls start_epoch 92 out=76b] v91'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566800 2024-06-10T00:21:50.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.496+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:74 13.1b 13:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566c00 2024-06-10T00:21:50.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.496+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 13 ==== osd_op_reply(74 [pgnls start_epoch 92 out=73b] v91'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.496+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:75 13.7 13:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd400 2024-06-10T00:21:50.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.496+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 16 ==== osd_op_reply(75 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.496+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:76 13.17 13:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9566800 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.497+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.5 v2:172.21.15.117:6800/419453692 8 ==== osd_op_reply(76 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566800 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.497+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:77 13.f 13:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9567400 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.497+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 11 ==== osd_op_reply(77 [pgnls start_epoch 92 out=73b] v87'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.497+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:78 13.1f 13:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9567400 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.497+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 12 ==== osd_op_reply(78 [pgnls start_epoch 92 out=101b] v91'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.497+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.497+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:79 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbcc00 con 0x5564d9fbd000 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.497+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 14 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:80 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958b000 con 0x5564d9fbd000 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 15 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:81 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a000 con 0x5564d9fbd000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 16 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 20 datascan.scan_links: injected ino detected 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:82 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a400 con 0x5564d9fbd000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 17 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:83 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958b800 con 0x5564d9fbd000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 18 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-06-10T00:21:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.498+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:84 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958bc00 con 0x5564d9566400 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.0 v2:172.21.15.79:6824/709635793 8 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e500 con 0x5564d9566400 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:85 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9567400 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 13 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:86 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a800 con 0x5564d9566000 2024-06-10T00:21:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac66a0640 1 -- 172.21.15.79:0/2152784825 <== osd.2 v2:172.21.15.79:6816/3079975341 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x5564d933e780 con 0x5564d9566000 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.499+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:87 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958ac00 con 0x5564d9fbd400 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 17 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:88 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958b000 con 0x5564d9566c00 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 14 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-06-10T00:21:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.500+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a000 con 0x5564d9fbd400 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 18 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:90 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a400 con 0x5564d9fbd400 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 19 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 200.00000002 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.501+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:91 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbcc00 con 0x5564d9fbd400 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 20 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:92 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbc800 con 0x5564d9567400 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.6 v2:172.21.15.117:6808/1306883621 14 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) ==== 154+0+1041 (crc 0 0 0) 0x5564d933e000 con 0x5564d9567400 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:93 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9fbcc00 con 0x5564d9fbd000 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 19 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.502+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:94 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x5564d958ac00 con 0x5564d9fbd000 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.503+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 20 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v92'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.503+0000 7fcac8a16740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.503+0000 7fcac8a16740 10 datascan.scan_links: processing 1 injected_inos 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.503+0000 7fcac8a16740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.503+0000 7fcac8a16740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.503+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:95 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958b000 con 0x5564d9fbd000 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.504+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 21 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.504+0000 7fcac8a16740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.504+0000 7fcac8a16740 20 datascan.scan_links: first is now 2 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.504+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:96 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a000 con 0x5564d9fbd000 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.505+0000 7fcac6ea1640 1 -- 172.21.15.79:0/2152784825 <== osd.1 v2:172.21.15.79:6808/15559294 22 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v92'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5564d933e500 con 0x5564d9fbd000 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.505+0000 7fcac8a16740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-06-10T00:21:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.505+0000 7fcac8a16740 10 datascan.scan_links: updating inotable 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.505+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:97 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d958a400 con 0x5564d9fbd400 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.505+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 21 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.505+0000 7fcac8a16740 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.505+0000 7fcac8a16740 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.505+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:98 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567c00 con 0x5564d9fbd400 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.7 v2:172.21.15.117:6816/2099086267 22 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v92'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x5564d933e000 con 0x5564d9fbd400 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 10 datascan.scan_links: updating snaptable 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:99 13.d 13:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) -- 0x5564d9567000 con 0x5564d9566c00 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 <== osd.4 v2:172.21.15.117:6824/279504764 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x5564d933e000 con 0x5564d9566c00 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5564d9566400 msgr2=0x5564d9555080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x5564d9566400 0x5564d9555080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5564d9fbd000 msgr2=0x5564d9248100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x5564d9fbd000 0x5564d9248100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5564d9566000 msgr2=0x5564d9554580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5564d9566000 0x5564d9554580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5564d9567800 msgr2=0x5564d9556680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x5564d9567800 0x5564d9556680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 reap_dead start 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5564d9566c00 msgr2=0x5564d9555b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x5564d9566c00 0x5564d9555b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 reap_dead start 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5564d9566800 msgr2=0x5564d9555600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x5564d9566800 0x5564d9555600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5564d9567400 msgr2=0x5564d9554b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x5564d9567400 0x5564d9554b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5564d9fbd400 msgr2=0x5564d9248c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x5564d9fbd400 0x5564d9248c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5564d9fd8c00 msgr2=0x5564d9554000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x5564d9fd8c00 0x5564d9554000 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5564da0b4120 tx=0x5564d9f6aa80 comp rx=0 tx=0).stop 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09b400 msgr2=0x5564d9246b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 --2- 172.21.15.79:0/2152784825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564da09b400 0x5564d9246b00 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x5564da0b57d0 tx=0x5564da0bb800 comp rx=0 tx=0).stop 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac5e9f640 1 -- 172.21.15.79:0/2152784825 reap_dead start 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 shutdown_connections 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 >> 172.21.15.79:0/2152784825 conn(0x5564da09b000 msgr2=0x5564d9f55000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 shutdown_connections 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.507+0000 7fcac8a16740 1 -- 172.21.15.79:0/2152784825 wait complete. 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 -- 172.21.15.79:0/3533973762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d91cac00 msgr2=0x5564d9247b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d91cac00 0x5564d9247b80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x5564d9ff5c50 tx=0x5564d9f6c840 comp rx=0 tx=0).stop 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 -- 172.21.15.79:0/3533973762 shutdown_connections 2024-06-10T00:21:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5564d91cbc00 0x5564d9247080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564d91cb800 0x5564d9247600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 --2- 172.21.15.79:0/3533973762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d91cac00 0x5564d9247b80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 -- 172.21.15.79:0/3533973762 >> 172.21.15.79:0/3533973762 conn(0x5564d91cb000 msgr2=0x5564d9f54800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 -- 172.21.15.79:0/3533973762 shutdown_connections 2024-06-10T00:21:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.508+0000 7fcac8a16740 1 -- 172.21.15.79:0/3533973762 wait complete. 2024-06-10T00:21:50.530 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.130075, result: 2024-06-10T00:21:50.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-06-10T00:21:50.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.662+0000 7f5dac516640 1 Processor -- start 2024-06-10T00:21:50.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.662+0000 7f5dac516640 1 -- start start 2024-06-10T00:21:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.663+0000 7f5dac516640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5da41474f0 0x7f5da40b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.663+0000 7f5dac516640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da40b5a40 con 0x7f5da406e560 2024-06-10T00:21:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.663+0000 7f5dac516640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da4072ae0 con 0x7f5da41449b0 2024-06-10T00:21:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.663+0000 7f5dac516640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5da40b6050 con 0x7f5da41474f0 2024-06-10T00:21:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.663+0000 7f5da9ab1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5da41474f0 0x7f5da40b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.663+0000 7f5daaab3640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5da406e560 0x7f5da4161d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34664/0 (socket says 172.21.15.79:34664) 2024-06-10T00:21:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.663+0000 7f5daaab3640 1 -- 172.21.15.79:0/749131151 learned_addr learned my addr 172.21.15.79:0/749131151 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.664+0000 7f5da9ab1640 1 -- 172.21.15.79:0/749131151 >> v1:172.21.15.117:6789/0 conn(0x7f5da41449b0 legacy=0x7f5da406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.664+0000 7f5da9ab1640 1 -- 172.21.15.79:0/749131151 >> v1:172.21.15.79:6789/0 conn(0x7f5da406e560 legacy=0x7f5da4161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.664+0000 7f5da92b0640 1 -- 172.21.15.79:0/749131151 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232341038 0 0) 0x7f5da40b5a40 con 0x7f5da406e560 2024-06-10T00:21:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.664+0000 7f5da9ab1640 1 -- 172.21.15.79:0/749131151 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da4072dc0 con 0x7f5da41474f0 2024-06-10T00:21:50.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.664+0000 7f5da9ab1640 1 --2- 172.21.15.79:0/749131151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da40b3fe0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5d980097a0 tx=0x7f5d9802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879750831ff2a57e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5da92b0640 1 -- 172.21.15.79:0/749131151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98037070 con 0x7f5da41474f0 2024-06-10T00:21:50.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5da92b0640 1 -- 172.21.15.79:0/749131151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d98032440 con 0x7f5da41474f0 2024-06-10T00:21:50.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5da92b0640 1 -- 172.21.15.79:0/749131151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98032810 con 0x7f5da41474f0 2024-06-10T00:21:50.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5dac516640 1 -- 172.21.15.79:0/749131151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 msgr2=0x7f5da40b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5dac516640 1 --2- 172.21.15.79:0/749131151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da40b3fe0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5d980097a0 tx=0x7f5d9802a1a0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5dac516640 1 -- 172.21.15.79:0/749131151 shutdown_connections 2024-06-10T00:21:50.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5dac516640 1 --2- 172.21.15.79:0/749131151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da40b3fe0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5dac516640 1 -- 172.21.15.79:0/749131151 >> 172.21.15.79:0/749131151 conn(0x7f5da40b2a00 msgr2=0x7f5da40b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:50.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5dac516640 1 -- 172.21.15.79:0/749131151 shutdown_connections 2024-06-10T00:21:50.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.665+0000 7f5dac516640 1 -- 172.21.15.79:0/749131151 wait complete. 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.666+0000 7f5dac516640 1 Processor -- start 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.666+0000 7f5dac516640 1 -- start start 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5dac516640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5da406e560 0x7f5da4142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5dac516640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5da41449b0 0x7f5da4142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5dac516640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da4144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5dac516640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5da406ea10 con 0x7f5da41474f0 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5dac516640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5da40730a0 con 0x7f5da406e560 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5dac516640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5da406eb90 con 0x7f5da41449b0 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5daaab3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da4144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5daaab3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da4144e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41842/0 (socket says 172.21.15.79:41842) 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5daaab3640 1 -- 172.21.15.79:0/871948255 learned_addr learned my addr 172.21.15.79:0/871948255 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.667+0000 7f5daa2b2640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5da406e560 0x7f5da4142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5da9ab1640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5da41449b0 0x7f5da4142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5daaab3640 1 -- 172.21.15.79:0/871948255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5da41449b0 msgr2=0x7f5da4142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5daaab3640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5da41449b0 0x7f5da4142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5daaab3640 1 -- 172.21.15.79:0/871948255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5da406e560 msgr2=0x7f5da4142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5daaab3640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5da406e560 0x7f5da4142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5daaab3640 1 -- 172.21.15.79:0/871948255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da415e7f0 con 0x7f5da41474f0 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5daaab3640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da4144e20 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c700 tx=0x7f5d9400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5da2ffd640 1 -- 172.21.15.79:0/871948255 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94018070 con 0x7f5da41474f0 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5da2ffd640 1 -- 172.21.15.79:0/871948255 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9400ce10 con 0x7f5da41474f0 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da41434e0 con 0x7f5da41474f0 2024-06-10T00:21:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5da2ffd640 1 -- 172.21.15.79:0/871948255 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9400a860 con 0x7f5da41474f0 2024-06-10T00:21:50.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.668+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da4143aa0 con 0x7f5da41474f0 2024-06-10T00:21:50.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.669+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da40683c0 con 0x7f5da41474f0 2024-06-10T00:21:50.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.670+0000 7f5da2ffd640 1 -- 172.21.15.79:0/871948255 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d9401b070 con 0x7f5da41474f0 2024-06-10T00:21:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.670+0000 7f5da2ffd640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d9006be30 0x7f5d9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.670+0000 7f5da2ffd640 1 -- 172.21.15.79:0/871948255 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f5d9408a6a0 con 0x7f5da41474f0 2024-06-10T00:21:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.670+0000 7f5daa2b2640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d9006be30 0x7f5d9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.670+0000 7f5daa2b2640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d9006be30 0x7f5d9006e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c000f60 tx=0x7f5d9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:50.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.674+0000 7f5da2ffd640 1 -- 172.21.15.79:0/871948255 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5d94058d90 con 0x7f5da41474f0 2024-06-10T00:21:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:50.886+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f5da40b32a0 con 0x7f5da41474f0 2024-06-10T00:21:51.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.149+0000 7f5da2ffd640 1 -- 172.21.15.79:0/871948255 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v58) ==== 162+0+0 (secure 0 0 0) 0x7f5d94058690 con 0x7f5da41474f0 2024-06-10T00:21:51.149 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-06-10T00:21:51.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.151+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d9006be30 msgr2=0x7f5d9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.151+0000 7f5dac516640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d9006be30 0x7f5d9006e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c000f60 tx=0x7f5d9c009040 comp rx=0 tx=0).stop 2024-06-10T00:21:51.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.151+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 msgr2=0x7f5da4144e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.151+0000 7f5dac516640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da4144e20 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c700 tx=0x7f5d9400cbc0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.152+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 shutdown_connections 2024-06-10T00:21:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.152+0000 7f5dac516640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5d9006be30 0x7f5d9006e2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.152+0000 7f5dac516640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5da41474f0 0x7f5da4144e20 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.152+0000 7f5dac516640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5da41449b0 0x7f5da4142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.152+0000 7f5dac516640 1 --2- 172.21.15.79:0/871948255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5da406e560 0x7f5da4142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.152+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 >> 172.21.15.79:0/871948255 conn(0x7f5da40b2a00 msgr2=0x7f5da40b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.152+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 shutdown_connections 2024-06-10T00:21:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.152+0000 7f5dac516640 1 -- 172.21.15.79:0/871948255 wait complete. 2024-06-10T00:21:51.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:21:51.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.267+0000 7f9384e38640 1 Processor -- start 2024-06-10T00:21:51.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.267+0000 7f9384e38640 1 -- start start 2024-06-10T00:21:51.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.268+0000 7f9384e38640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93800d1fc0 0x7f93800cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:51.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.268+0000 7f9384e38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938015f5e0 con 0x7f93800d2680 2024-06-10T00:21:51.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.268+0000 7f9384e38640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93800d0ad0 con 0x7f938015f1a0 2024-06-10T00:21:51.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.268+0000 7f9384e38640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f93800d13e0 con 0x7f93800d1fc0 2024-06-10T00:21:51.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.268+0000 7f937e59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f93800d2680 0x7f93800d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34674/0 (socket says 172.21.15.79:34674) 2024-06-10T00:21:51.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.268+0000 7f937e59c640 1 -- 172.21.15.79:0/658452766 learned_addr learned my addr 172.21.15.79:0/658452766 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:51.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.268+0000 7f937ed9d640 1 --2- 172.21.15.79:0/658452766 >> v2:172.21.15.79:3300/0 conn(0x7f93800d1fc0 0x7f93800cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:51.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.268+0000 7f937d59a640 1 -- 172.21.15.79:0/658452766 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979003103 0 0) 0x7f938015f5e0 con 0x7f93800d2680 2024-06-10T00:21:51.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.269+0000 7f937d59a640 1 -- 172.21.15.79:0/658452766 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9368003520 con 0x7f93800d2680 2024-06-10T00:21:51.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.269+0000 7f937ed9d640 1 -- 172.21.15.79:0/658452766 >> v1:172.21.15.117:6789/0 conn(0x7f938015f1a0 legacy=0x7f93800cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.269+0000 7f937ed9d640 1 -- 172.21.15.79:0/658452766 >> v1:172.21.15.79:6789/0 conn(0x7f93800d2680 legacy=0x7f93800d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.269+0000 7f937ed9d640 1 -- 172.21.15.79:0/658452766 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938015f890 con 0x7f93800d1fc0 2024-06-10T00:21:51.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.269+0000 7f937ed9d640 1 --2- 172.21.15.79:0/658452766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800cf680 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9378009d90 tx=0x7f937802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f46547367c64d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:51.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.269+0000 7f937d59a640 1 -- 172.21.15.79:0/658452766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378007740 con 0x7f93800d1fc0 2024-06-10T00:21:51.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.269+0000 7f937d59a640 1 -- 172.21.15.79:0/658452766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93780078e0 con 0x7f93800d1fc0 2024-06-10T00:21:51.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.269+0000 7f937d59a640 1 -- 172.21.15.79:0/658452766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378007cb0 con 0x7f93800d1fc0 2024-06-10T00:21:51.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.270+0000 7f9384e38640 1 -- 172.21.15.79:0/658452766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 msgr2=0x7f93800cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.270+0000 7f9384e38640 1 --2- 172.21.15.79:0/658452766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800cf680 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9378009d90 tx=0x7f937802a6f0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.270+0000 7f9384e38640 1 -- 172.21.15.79:0/658452766 shutdown_connections 2024-06-10T00:21:51.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.270+0000 7f9384e38640 1 --2- 172.21.15.79:0/658452766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800cf680 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.270+0000 7f9384e38640 1 -- 172.21.15.79:0/658452766 >> 172.21.15.79:0/658452766 conn(0x7f938009d3f0 msgr2=0x7f93800d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:51.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.270+0000 7f9384e38640 1 -- 172.21.15.79:0/658452766 shutdown_connections 2024-06-10T00:21:51.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.270+0000 7f9384e38640 1 -- 172.21.15.79:0/658452766 wait complete. 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.271+0000 7f9384e38640 1 Processor -- start 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.271+0000 7f9384e38640 1 -- start start 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f9384e38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f9384e38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93800d2680 0x7f93800ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f9384e38640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015f1a0 0x7f93801f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f9384e38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93800d2410 con 0x7f93800d1fc0 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f9384e38640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93800d1070 con 0x7f93800d2680 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f9384e38640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93800d4f00 con 0x7f938015f1a0 2024-06-10T00:21:51.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41850/0 (socket says 172.21.15.79:41850) 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937e59c640 1 -- 172.21.15.79:0/3919514806 learned_addr learned my addr 172.21.15.79:0/3919514806 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937dd9b640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93800d2680 0x7f93800ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937ed9d640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015f1a0 0x7f93801f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937e59c640 1 -- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015f1a0 msgr2=0x7f93801f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937e59c640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015f1a0 0x7f93801f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937e59c640 1 -- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93800d2680 msgr2=0x7f93800ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937e59c640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93800d2680 0x7f93800ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.272+0000 7f937e59c640 1 -- 172.21.15.79:0/3919514806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93800cd0e0 con 0x7f93800d1fc0 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.273+0000 7f937ed9d640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015f1a0 0x7f93801f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.273+0000 7f937e59c640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800c9c80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f937000c530 tx=0x7f937000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.273+0000 7f936effd640 1 -- 172.21.15.79:0/3919514806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370017070 con 0x7f93800d1fc0 2024-06-10T00:21:51.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.273+0000 7f936effd640 1 -- 172.21.15.79:0/3919514806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9370005ce0 con 0x7f93800d1fc0 2024-06-10T00:21:51.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.273+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93800cd360 con 0x7f93800d1fc0 2024-06-10T00:21:51.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.273+0000 7f936effd640 1 -- 172.21.15.79:0/3919514806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93700072b0 con 0x7f93800d1fc0 2024-06-10T00:21:51.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.273+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93800cd920 con 0x7f93800d1fc0 2024-06-10T00:21:51.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.274+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9380068430 con 0x7f93800d1fc0 2024-06-10T00:21:51.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.274+0000 7f936effd640 1 -- 172.21.15.79:0/3919514806 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f937001a070 con 0x7f93800d1fc0 2024-06-10T00:21:51.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.275+0000 7f936effd640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936006be30 0x7f936006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:51.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.275+0000 7f937dd9b640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936006be30 0x7f936006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:51.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.275+0000 7f936effd640 1 -- 172.21.15.79:0/3919514806 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f937008a480 con 0x7f93800d1fc0 2024-06-10T00:21:51.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.275+0000 7f937dd9b640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936006be30 0x7f936006e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9380155430 tx=0x7f9374009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:51.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.279+0000 7f936effd640 1 -- 172.21.15.79:0/3919514806 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f93800cd0e0 con 0x7f93800d1fc0 2024-06-10T00:21:51.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.493+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93800d04e0 con 0x7f93800d1fc0 2024-06-10T00:21:51.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.493+0000 7f936effd640 1 -- 172.21.15.79:0/3919514806 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5183 (secure 0 0 0) 0x7f93700585f0 con 0x7f93800d1fc0 2024-06-10T00:21:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:51.493 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:21:51.152559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6836/2006151468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2006151468},{"type":"v1","addr":"172.21.15.79:6836","nonce":2006151468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-06-10T00:21:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 59 2024-06-10T00:21:51.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936006be30 msgr2=0x7f936006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936006be30 0x7f936006e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9380155430 tx=0x7f9374009040 comp rx=0 tx=0).stop 2024-06-10T00:21:51.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 msgr2=0x7f93800c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:51.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800c9c80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f937000c530 tx=0x7f937000c9f0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 shutdown_connections 2024-06-10T00:21:51.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936006be30 0x7f936006e2f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015f1a0 0x7f93801f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93800d2680 0x7f93800ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 --2- 172.21.15.79:0/3919514806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800d1fc0 0x7f93800c9c80 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:51.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 >> 172.21.15.79:0/3919514806 conn(0x7f938009d3f0 msgr2=0x7f93800b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:51.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 shutdown_connections 2024-06-10T00:21:51.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:51.495+0000 7f9384e38640 1 -- 172.21.15.79:0/3919514806 wait complete. 2024-06-10T00:21:51.908 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:20:24.159187+0000', 'modified': '2024-06-10T00:21:51.152559+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6836/2006151468', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2006151468}, {'type': 'v1', 'addr': '172.21.15.79:6836', 'nonce': 2006151468}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:21:51.908 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7365:up:replay 2024-06-10T00:21:52.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:21:53.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.020+0000 7f6e42361640 1 Processor -- start 2024-06-10T00:21:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.020+0000 7f6e42361640 1 -- start start 2024-06-10T00:21:53.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e42361640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6e3c0cd230 0x7f6e3c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e42361640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 0x7f6e3c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e42361640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c0b3420 con 0x7f6e3c1553c0 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e42361640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c0cc750 con 0x7f6e3c0cd230 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e42361640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c0cca30 con 0x7f6e3c0cec50 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e3bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6e3c1553c0 0x7f6e3c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34680/0 (socket says 172.21.15.79:34680) 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e3bfff640 1 -- 172.21.15.79:0/675779225 learned_addr learned my addr 172.21.15.79:0/675779225 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620265005 0 0) 0x7f6e3c0b3420 con 0x7f6e3c1553c0 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e24003520 con 0x7f6e3c1553c0 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e408fe640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 0x7f6e3c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.021+0000 7f6e3b7fe640 1 --2- 172.21.15.79:0/675779225 >> v2:172.21.15.117:3300/0 conn(0x7f6e3c0cd230 0x7f6e3c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2654093965 0 0) 0x7f6e24003520 con 0x7f6e3c1553c0 2024-06-10T00:21:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 msgr2=0x7f6e3c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 0x7f6e3c0cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 >> v2:172.21.15.117:3300/0 conn(0x7f6e3c0cd230 msgr2=0x7f6e3c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 --2- 172.21.15.79:0/675779225 >> v2:172.21.15.117:3300/0 conn(0x7f6e3c0cd230 0x7f6e3c0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c0ccd10 con 0x7f6e3c1553c0 2024-06-10T00:21:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f6e2c001670 con 0x7f6e3c1553c0 2024-06-10T00:21:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 >> v1:172.21.15.79:6789/0 conn(0x7f6e3c1553c0 legacy=0x7f6e3c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 0x7f6e240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e24003f30 0x7f6e24004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24004d40 0x7f6e240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c0cc750 con 0x7f6e24003f30 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c0cca30 con 0x7f6e24004d40 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2400ba10 con 0x7f6e3c0cec50 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3b7fe640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e24003f30 0x7f6e24004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e408fe640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24004d40 0x7f6e240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3bfff640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 0x7f6e240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3b7fe640 1 -- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 msgr2=0x7f6e240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3b7fe640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 0x7f6e240039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3b7fe640 1 -- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24004d40 msgr2=0x7f6e240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3b7fe640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24004d40 0x7f6e240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3b7fe640 1 -- 172.21.15.79:0/675779225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e24003520 con 0x7f6e24003f30 2024-06-10T00:21:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.022+0000 7f6e3bfff640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c0cec50 0x7f6e240039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.023+0000 7f6e3b7fe640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e24003f30 0x7f6e24004800 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000ba30 tx=0x7f6e24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab46d112bfafccc server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.023+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30030070 con 0x7f6e24003f30 2024-06-10T00:21:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.023+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e3002ae10 con 0x7f6e24003f30 2024-06-10T00:21:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.023+0000 7f6e3affd640 1 -- 172.21.15.79:0/675779225 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000b600 con 0x7f6e24003f30 2024-06-10T00:21:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.023+0000 7f6e42361640 1 -- 172.21.15.79:0/675779225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e24003f30 msgr2=0x7f6e24004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.023+0000 7f6e42361640 1 --2- 172.21.15.79:0/675779225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e24003f30 0x7f6e24004800 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000ba30 tx=0x7f6e24005830 comp rx=0 tx=0).stop 2024-06-10T00:21:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.023+0000 7f6e408fe640 1 -- 172.21.15.79:0/675779225 reap_dead start 2024-06-10T00:21:53.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.024+0000 7f6e42361640 1 -- 172.21.15.79:0/675779225 shutdown_connections 2024-06-10T00:21:53.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.024+0000 7f6e42361640 1 -- 172.21.15.79:0/675779225 >> 172.21.15.79:0/675779225 conn(0x7f6e3c0b19f0 msgr2=0x7f6e3c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:53.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.024+0000 7f6e42361640 1 -- 172.21.15.79:0/675779225 shutdown_connections 2024-06-10T00:21:53.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.024+0000 7f6e42361640 1 -- 172.21.15.79:0/675779225 wait complete. 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.025+0000 7f6e42361640 1 Processor -- start 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.025+0000 7f6e42361640 1 -- start start 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e42361640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24003f30 0x7f6e3c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e42361640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3c15beb0 0x7f6e3c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e42361640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c1544b0 0x7f6e3c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e42361640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c155920 con 0x7f6e3c15beb0 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e42361640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1557a0 con 0x7f6e24003f30 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e42361640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c0cf0e0 con 0x7f6e3c1544b0 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3c15beb0 0x7f6e3c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3c15beb0 0x7f6e3c15a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41868/0 (socket says 172.21.15.79:41868) 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 -- 172.21.15.79:0/19073060 learned_addr learned my addr 172.21.15.79:0/19073060 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e408fe640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c1544b0 0x7f6e3c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3bfff640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24003f30 0x7f6e3c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 -- 172.21.15.79:0/19073060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c1544b0 msgr2=0x7f6e3c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c1544b0 0x7f6e3c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 -- 172.21.15.79:0/19073060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24003f30 msgr2=0x7f6e3c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24003f30 0x7f6e3c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 -- 172.21.15.79:0/19073060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c15c310 con 0x7f6e3c15beb0 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e3b7fe640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3c15beb0 0x7f6e3c15a120 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000bb50 tx=0x7f6e30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e38ff9640 1 -- 172.21.15.79:0/19073060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30042030 con 0x7f6e3c15beb0 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e38ff9640 1 -- 172.21.15.79:0/19073060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e3002ac10 con 0x7f6e3c15beb0 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e38ff9640 1 -- 172.21.15.79:0/19073060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000b600 con 0x7f6e3c15beb0 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.026+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c15c5c0 con 0x7f6e3c15beb0 2024-06-10T00:21:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.027+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c15cb60 con 0x7f6e3c15beb0 2024-06-10T00:21:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.028+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c068430 con 0x7f6e3c15beb0 2024-06-10T00:21:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.028+0000 7f6e38ff9640 1 -- 172.21.15.79:0/19073060 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e30045070 con 0x7f6e3c15beb0 2024-06-10T00:21:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.028+0000 7f6e38ff9640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6e2806be30 0x7f6e2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.029+0000 7f6e38ff9640 1 -- 172.21.15.79:0/19073060 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f6e300ab740 con 0x7f6e3c15beb0 2024-06-10T00:21:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.029+0000 7f6e3bfff640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6e2806be30 0x7f6e2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.029+0000 7f6e3bfff640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6e2806be30 0x7f6e2806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c000fb0 tx=0x7f6e2c007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.033+0000 7f6e38ff9640 1 -- 172.21.15.79:0/19073060 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6e30079760 con 0x7f6e3c15beb0 2024-06-10T00:21:53.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.243+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e3c0ce9b0 con 0x7f6e3c15beb0 2024-06-10T00:21:53.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.244+0000 7f6e38ff9640 1 -- 172.21.15.79:0/19073060 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5183 (secure 0 0 0) 0x7f6e3007da60 con 0x7f6e3c15beb0 2024-06-10T00:21:53.244 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:53.244 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:21:52.164473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":59,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6836/2006151468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2006151468},{"type":"v1","addr":"172.21.15.79:6836","nonce":2006151468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-06-10T00:21:53.244 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2024-06-10T00:21:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6e2806be30 msgr2=0x7f6e2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6e2806be30 0x7f6e2806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c000fb0 tx=0x7f6e2c007040 comp rx=0 tx=0).stop 2024-06-10T00:21:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3c15beb0 msgr2=0x7f6e3c15a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3c15beb0 0x7f6e3c15a120 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000bb50 tx=0x7f6e30004730 comp rx=0 tx=0).stop 2024-06-10T00:21:53.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 shutdown_connections 2024-06-10T00:21:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6e2806be30 0x7f6e2806e2f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e3c1544b0 0x7f6e3c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3c15beb0 0x7f6e3c15a120 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 --2- 172.21.15.79:0/19073060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e24003f30 0x7f6e3c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 >> 172.21.15.79:0/19073060 conn(0x7f6e3c0b19f0 msgr2=0x7f6e3c06cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 shutdown_connections 2024-06-10T00:21:53.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:53.246+0000 7f6e42361640 1 -- 172.21.15.79:0/19073060 wait complete. 2024-06-10T00:21:53.661 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:20:24.159187+0000', 'modified': '2024-06-10T00:21:52.164473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6836/2006151468', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2006151468}, {'type': 'v1', 'addr': '172.21.15.79:6836', 'nonce': 2006151468}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:21:53.661 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7365:up:rejoin 2024-06-10T00:21:54.661 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:21:54.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.774+0000 7f57a4012640 1 Processor -- start 2024-06-10T00:21:54.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.774+0000 7f57a4012640 1 -- start start 2024-06-10T00:21:54.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.775+0000 7f57a4012640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f579c15f1a0 0x7f579c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:54.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.775+0000 7f57a4012640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f579c0cef70 0x7f579c0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:54.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.775+0000 7f57a4012640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c15f5e0 con 0x7f579c0d2680 2024-06-10T00:21:54.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.775+0000 7f57a4012640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f579c0d13e0 con 0x7f579c0cef70 2024-06-10T00:21:54.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.775+0000 7f57a4012640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f579c0d0ad0 con 0x7f579c15f1a0 2024-06-10T00:21:54.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.775+0000 7f57a25af640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f579c0cef70 0x7f579c0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:54.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.775+0000 7f57a1dae640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f579c0d2680 0x7f579c0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34692/0 (socket says 172.21.15.79:34692) 2024-06-10T00:21:54.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.775+0000 7f57a1dae640 1 -- 172.21.15.79:0/1000315374 learned_addr learned my addr 172.21.15.79:0/1000315374 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:54.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.776+0000 7f57a15ad640 1 --2- 172.21.15.79:0/1000315374 >> v2:172.21.15.117:3300/0 conn(0x7f579c15f1a0 0x7f579c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:54.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.776+0000 7f57a25af640 1 -- 172.21.15.79:0/1000315374 >> v2:172.21.15.117:3300/0 conn(0x7f579c15f1a0 msgr2=0x7f579c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:54.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.776+0000 7f57a25af640 1 --2- 172.21.15.79:0/1000315374 >> v2:172.21.15.117:3300/0 conn(0x7f579c15f1a0 0x7f579c0d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.776+0000 7f57a25af640 1 -- 172.21.15.79:0/1000315374 >> v1:172.21.15.79:6789/0 conn(0x7f579c0d2680 legacy=0x7f579c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:54.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.776+0000 7f57a0dac640 1 -- 172.21.15.79:0/1000315374 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107806798 0 0) 0x7f579c15f5e0 con 0x7f579c0d2680 2024-06-10T00:21:54.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.776+0000 7f57a25af640 1 -- 172.21.15.79:0/1000315374 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c15f890 con 0x7f579c0cef70 2024-06-10T00:21:54.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.776+0000 7f57a25af640 1 --2- 172.21.15.79:0/1000315374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0cf3c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f579c0d1560 tx=0x7f579402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a9c2bb19bb731 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:54.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a0dac640 1 -- 172.21.15.79:0/1000315374 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794037070 con 0x7f579c0cef70 2024-06-10T00:21:54.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a0dac640 1 -- 172.21.15.79:0/1000315374 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5794032440 con 0x7f579c0cef70 2024-06-10T00:21:54.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a0dac640 1 -- 172.21.15.79:0/1000315374 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794032810 con 0x7f579c0cef70 2024-06-10T00:21:54.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a4012640 1 -- 172.21.15.79:0/1000315374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 msgr2=0x7f579c0cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:54.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a4012640 1 --2- 172.21.15.79:0/1000315374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0cf3c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f579c0d1560 tx=0x7f579402a1a0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a4012640 1 -- 172.21.15.79:0/1000315374 shutdown_connections 2024-06-10T00:21:54.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a4012640 1 --2- 172.21.15.79:0/1000315374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0cf3c0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a4012640 1 --2- 172.21.15.79:0/1000315374 >> v2:172.21.15.117:3300/0 conn(0x7f579c15f1a0 0x7f579c0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a4012640 1 -- 172.21.15.79:0/1000315374 >> 172.21.15.79:0/1000315374 conn(0x7f579c09d3f0 msgr2=0x7f579c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:54.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a4012640 1 -- 172.21.15.79:0/1000315374 shutdown_connections 2024-06-10T00:21:54.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.777+0000 7f57a4012640 1 -- 172.21.15.79:0/1000315374 wait complete. 2024-06-10T00:21:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.778+0000 7f57a4012640 1 Processor -- start 2024-06-10T00:21:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a4012640 1 -- start start 2024-06-10T00:21:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a4012640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a4012640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c0d2680 0x7f579c0b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a4012640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c15f1a0 0x7f579c150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a4012640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f579c0d4f00 con 0x7f579c0cef70 2024-06-10T00:21:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a4012640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f579c0d1070 con 0x7f579c15f1a0 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a4012640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f579c0d1870 con 0x7f579c0d2680 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a1dae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a1dae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41890/0 (socket says 172.21.15.79:41890) 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a1dae640 1 -- 172.21.15.79:0/4105692266 learned_addr learned my addr 172.21.15.79:0/4105692266 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a25af640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c15f1a0 0x7f579c150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.779+0000 7f57a15ad640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c0d2680 0x7f579c0b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a1dae640 1 -- 172.21.15.79:0/4105692266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c0d2680 msgr2=0x7f579c0b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a1dae640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c0d2680 0x7f579c0b9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a1dae640 1 -- 172.21.15.79:0/4105692266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c15f1a0 msgr2=0x7f579c150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a1dae640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c15f1a0 0x7f579c150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a1dae640 1 -- 172.21.15.79:0/4105692266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c0b6220 con 0x7f579c0cef70 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a1dae640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0b5bb0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f578c00c8c0 tx=0x7f578c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f579a7fc640 1 -- 172.21.15.79:0/4105692266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c018070 con 0x7f579c0cef70 2024-06-10T00:21:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f579a7fc640 1 -- 172.21.15.79:0/4105692266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578c00a640 con 0x7f579c0cef70 2024-06-10T00:21:54.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f579a7fc640 1 -- 172.21.15.79:0/4105692266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c00aa30 con 0x7f579c0cef70 2024-06-10T00:21:54.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c0b6500 con 0x7f579c0cef70 2024-06-10T00:21:54.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.780+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c0b6ac0 con 0x7f579c0cef70 2024-06-10T00:21:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.781+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f579c068430 con 0x7f579c0cef70 2024-06-10T00:21:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.782+0000 7f579a7fc640 1 -- 172.21.15.79:0/4105692266 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f578c01b070 con 0x7f579c0cef70 2024-06-10T00:21:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.782+0000 7f579a7fc640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f578806be30 0x7f578806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.782+0000 7f579a7fc640 1 -- 172.21.15.79:0/4105692266 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f578c08a790 con 0x7f579c0cef70 2024-06-10T00:21:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.782+0000 7f57a15ad640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f578806be30 0x7f578806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.783+0000 7f57a15ad640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f578806be30 0x7f578806e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f579c15a680 tx=0x7f5790008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:54.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.786+0000 7f579a7fc640 1 -- 172.21.15.79:0/4105692266 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f578c058f20 con 0x7f579c0cef70 2024-06-10T00:21:54.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.995+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f579c0ce580 con 0x7f579c0cef70 2024-06-10T00:21:54.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.995+0000 7f579a7fc640 1 -- 172.21.15.79:0/4105692266 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5190 (secure 0 0 0) 0x7f578c058820 con 0x7f579c0cef70 2024-06-10T00:21:54.995 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:21:54.995 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:21:54.167947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6836/2006151468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2006151468},{"type":"v1","addr":"172.21.15.79:6836","nonce":2006151468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-06-10T00:21:54.995 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 62 2024-06-10T00:21:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f578806be30 msgr2=0x7f578806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f578806be30 0x7f578806e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f579c15a680 tx=0x7f5790008040 comp rx=0 tx=0).stop 2024-06-10T00:21:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 msgr2=0x7f579c0b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0b5bb0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f578c00c8c0 tx=0x7f578c00cd80 comp rx=0 tx=0).stop 2024-06-10T00:21:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 shutdown_connections 2024-06-10T00:21:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f578806be30 0x7f578806e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c15f1a0 0x7f579c150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c0d2680 0x7f579c0b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 --2- 172.21.15.79:0/4105692266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c0cef70 0x7f579c0b5bb0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:54.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 >> 172.21.15.79:0/4105692266 conn(0x7f579c09d3f0 msgr2=0x7f579c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:54.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 shutdown_connections 2024-06-10T00:21:54.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:54.997+0000 7f57a4012640 1 -- 172.21.15.79:0/4105692266 wait complete. 2024-06-10T00:21:55.410 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:20:24.159187+0000', 'modified': '2024-06-10T00:21:54.167947+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6836/2006151468', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2006151468}, {'type': 'v1', 'addr': '172.21.15.79:6836', 'nonce': 2006151468}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7365, 'qdb_cluster': [7365]} 2024-06-10T00:21:55.410 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:21:55.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:21:55.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.512+0000 7f06f5c9a640 1 Processor -- start 2024-06-10T00:21:55.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.512+0000 7f06f5c9a640 1 -- start start 2024-06-10T00:21:55.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06f5c9a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06f00aef70 0x7f06f00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06f5c9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f015ac50 con 0x7f06f00af3b0 2024-06-10T00:21:55.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06f5c9a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f006cdb0 con 0x7f06f015a870 2024-06-10T00:21:55.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06f5c9a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f06f006d090 con 0x7f06f00aef70 2024-06-10T00:21:55.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06effff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f06f00af3b0 0x7f06f00cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34698/0 (socket says 172.21.15.79:34698) 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06effff640 1 -- 172.21.15.79:0/1623868504 learned_addr learned my addr 172.21.15.79:0/1623868504 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06eeffd640 1 --2- 172.21.15.79:0/1623868504 >> v2:172.21.15.117:3300/0 conn(0x7f06f00aef70 0x7f06f00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3243349195 0 0) 0x7f06f015ac50 con 0x7f06f00af3b0 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06d8003520 con 0x7f06f00af3b0 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 377774919 0 0) 0x7f06d8003520 con 0x7f06f00af3b0 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 >> v2:172.21.15.117:3300/0 conn(0x7f06f00aef70 msgr2=0x7f06f00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 --2- 172.21.15.79:0/1623868504 >> v2:172.21.15.117:3300/0 conn(0x7f06f00aef70 0x7f06f00b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 >> v1:172.21.15.117:6789/0 conn(0x7f06f015a870 legacy=0x7f06f006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f006d370 con 0x7f06f00af3b0 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f06e80019f0 con 0x7f06f00af3b0 2024-06-10T00:21:55.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.513+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 >> v1:172.21.15.79:6789/0 conn(0x7f06f00af3b0 legacy=0x7f06f00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06ee7fc640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80039b0 0x7f06d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06ee7fc640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d8004800 0x7f06d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06ee7fc640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d80051c0 0x7f06d80079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06f006d090 con 0x7f06d80051c0 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8008140 con 0x7f06d8004800 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06d8008340 con 0x7f06d80039b0 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06effff640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d80051c0 0x7f06d80079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80039b0 0x7f06d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06eeffd640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d8004800 0x7f06d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06effff640 1 -- 172.21.15.79:0/1623868504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80039b0 msgr2=0x7f06d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06effff640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80039b0 0x7f06d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06effff640 1 -- 172.21.15.79:0/1623868504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d8004800 msgr2=0x7f06d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06effff640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d8004800 0x7f06d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.514+0000 7f06effff640 1 -- 172.21.15.79:0/1623868504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d8003520 con 0x7f06d80051c0 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06effff640 1 -- 172.21.15.79:0/1623868504 reap_dead start 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06effff640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d80051c0 0x7f06d80079a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f06e800a8d0 tx=0x7f06d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffccb7cdb37a1d9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e800a4a0 con 0x7f06d80051c0 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e802f070 con 0x7f06d80051c0 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06ee7fc640 1 -- 172.21.15.79:0/1623868504 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e802bcb0 con 0x7f06d80051c0 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06f5c9a640 1 -- 172.21.15.79:0/1623868504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d80051c0 msgr2=0x7f06d80079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06f5c9a640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d80051c0 0x7f06d80079a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f06e800a8d0 tx=0x7f06d8005830 comp rx=0 tx=0).stop 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06f5c9a640 1 -- 172.21.15.79:0/1623868504 shutdown_connections 2024-06-10T00:21:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06f5c9a640 1 --2- 172.21.15.79:0/1623868504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d80051c0 0x7f06d80079a0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06f5c9a640 1 -- 172.21.15.79:0/1623868504 >> 172.21.15.79:0/1623868504 conn(0x7f06f00b19f0 msgr2=0x7f06f00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:55.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06f5c9a640 1 -- 172.21.15.79:0/1623868504 shutdown_connections 2024-06-10T00:21:55.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.515+0000 7f06f5c9a640 1 -- 172.21.15.79:0/1623868504 wait complete. 2024-06-10T00:21:55.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.517+0000 7f06f5c9a640 1 Processor -- start 2024-06-10T00:21:55.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.517+0000 7f06f5c9a640 1 -- start start 2024-06-10T00:21:55.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.517+0000 7f06f5c9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80051c0 0x7f06f013e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.517+0000 7f06f5c9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06f015af60 0x7f06f009ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.517+0000 7f06f5c9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f015c8a0 0x7f06f00adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.517+0000 7f06f5c9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06f00b2e40 con 0x7f06f015c8a0 2024-06-10T00:21:55.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.517+0000 7f06f5c9a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06f006d930 con 0x7f06f015af60 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.517+0000 7f06f5c9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06f00b2fc0 con 0x7f06d80051c0 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f015c8a0 0x7f06f00adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f015c8a0 0x7f06f00adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41906/0 (socket says 172.21.15.79:41906) 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 -- 172.21.15.79:0/3508246696 learned_addr learned my addr 172.21.15.79:0/3508246696 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80051c0 0x7f06f013e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06eeffd640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06f015af60 0x7f06f009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 -- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80051c0 msgr2=0x7f06f013e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80051c0 0x7f06f013e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 -- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06f015af60 msgr2=0x7f06f009ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06f015af60 0x7f06f009ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 -- 172.21.15.79:0/3508246696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f01f35a0 con 0x7f06f015c8a0 2024-06-10T00:21:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06eeffd640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06f015af60 0x7f06f009ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06effff640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f015c8a0 0x7f06f00adec0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f06e8000f80 tx=0x7f06e8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06d7fff640 1 -- 172.21.15.79:0/3508246696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e802b850 con 0x7f06f015c8a0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06d7fff640 1 -- 172.21.15.79:0/3508246696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e802b9f0 con 0x7f06f015c8a0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06f5c9a640 1 -- 172.21.15.79:0/3508246696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f01f3880 con 0x7f06f015c8a0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06d7fff640 1 -- 172.21.15.79:0/3508246696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e802bda0 con 0x7f06f015c8a0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.518+0000 7f06f5c9a640 1 -- 172.21.15.79:0/3508246696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f01f3e40 con 0x7f06f015c8a0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.520+0000 7f06d7fff640 1 -- 172.21.15.79:0/3508246696 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06e8034470 con 0x7f06f015c8a0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.520+0000 7f06d7fff640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06dc06be60 0x7f06dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.520+0000 7f06d7fff640 1 -- 172.21.15.79:0/3508246696 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f06e80ab1d0 con 0x7f06f015c8a0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.520+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06dc06be60 0x7f06dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.521+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06dc06be60 0x7f06dc06e320 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f06e0000c00 tx=0x7f06e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.521+0000 7f06f89a1740 1 Processor -- start 2024-06-10T00:21:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.521+0000 7f06f89a1740 1 -- start start 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b3d00 0x55e53c0b6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c086960 0x55e53c08a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06f89a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e53bfef740 con 0x55e53c0b3d00 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06f89a1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e53bf8da80 con 0x55e53c0b40e0 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06f89a1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e53bfeb700 con 0x55e53c086960 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b3d00 0x55e53c0b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b3d00 0x55e53c0b6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41908/0 (socket says 172.21.15.79:41908) 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 -- 172.21.15.79:0/1884371015 learned_addr learned my addr 172.21.15.79:0/1884371015 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06eeffd640 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06effff640 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c086960 0x55e53c08a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 -- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c086960 msgr2=0x55e53c08a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c086960 0x55e53c08a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 -- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 msgr2=0x55e53c0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 -- 172.21.15.79:0/1884371015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e53bfb8fb0 con 0x55e53c0b3d00 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06eeffd640 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06effff640 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c086960 0x55e53c08a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.522+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b3d00 0x55e53c0b6510 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f06e0001050 tx=0x7f06e0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af3dfaf95f8235d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06d57fa640 1 -- 172.21.15.79:0/1884371015 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0028070 con 0x55e53c0b3d00 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06d57fa640 1 -- 172.21.15.79:0/1884371015 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e00159f0 con 0x55e53c0b3d00 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06d57fa640 1 -- 172.21.15.79:0/1884371015 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0015da0 con 0x55e53c0b3d00 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 -- 172.21.15.79:0/1884371015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b3d00 msgr2=0x55e53c0b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b3d00 0x55e53c0b6510 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f06e0001050 tx=0x7f06e0014000 comp rx=0 tx=0).stop 2024-06-10T00:21:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 -- 172.21.15.79:0/1884371015 shutdown_connections 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c086960 0x55e53c08a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1884371015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b3d00 0x55e53c0b6510 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 -- 172.21.15.79:0/1884371015 >> 172.21.15.79:0/1884371015 conn(0x55e53c088bd0 msgr2=0x55e53c0d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 -- 172.21.15.79:0/1884371015 shutdown_connections 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.523+0000 7f06f89a1740 1 -- 172.21.15.79:0/1884371015 wait complete. 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.524+0000 7f06f89a1740 1 -- start start 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.524+0000 7f06f89a1740 1 Processor -- start 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0c9260 0x55e53c0d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06f89a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e53c08bd80 con 0x55e53c0c9260 2024-06-10T00:21:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06f89a1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e53bf78c30 con 0x55e53c0b40e0 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06f89a1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e53c08c060 con 0x55e53c0b3d00 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06f89a1740 10 client.0 _ll_register_callbacks cb 0x55e53bfaa7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0c9260 0x55e53c0d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0c9260 0x55e53c0d3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41922/0 (socket says 172.21.15.79:41922) 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 -- 172.21.15.79:0/2985914649 learned_addr learned my addr 172.21.15.79:0/2985914649 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06eeffd640 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 -- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 msgr2=0x55e53c0aa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0aa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 -- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 msgr2=0x55e53c0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 -- 172.21.15.79:0/2985914649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e53bd032d0 con 0x55e53c0c9260 2024-06-10T00:21:55.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06eeffd640 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06effff640 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0c9260 0x55e53c0d3860 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f06e80a93f0 tx=0x7f06e8032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da49e9ccec04eca8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06ce7fc640 1 -- 172.21.15.79:0/2985914649 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e807d580 con 0x55e53c0c9260 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06ce7fc640 1 -- 172.21.15.79:0/2985914649 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f06e8075840 con 0x55e53c0c9260 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.525+0000 7f06f89a1740 1 -- 172.21.15.79:0/2985914649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e00159f0 con 0x55e53c0c9260 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06ce7fc640 1 -- 172.21.15.79:0/2985914649 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f06e80a9050 con 0x55e53c0c9260 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06f89a1740 10 client.7449 fetch_fsmap learned FSMap version 62 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06f89a1740 1 -- 172.21.15.79:0/2985914649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55e53bdcd6b0 con 0x55e53c0c9260 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06ce7fc640 1 -- 172.21.15.79:0/2985914649 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e00159f0 con 0x55e53c0c9260 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06ce7fc640 1 -- 172.21.15.79:0/2985914649 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7f06e8048030 con 0x55e53c0c9260 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06f89a1740 10 client.7449 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:21:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06f89a1740 10 client.7449 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06f89a1740 20 client.7449 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06f89a1740 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55e53c0cd6d0 0x55e53c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06f89a1740 4 client.7449 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06f89a1740 1 -- 172.21.15.79:0/2985914649 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e53bffce70 con 0x55e53c0cd6d0 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55e53c0cd6d0 0x55e53c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06ce7fc640 10 client.7449 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.526+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55e53c0cd6d0 0x55e53c0cdab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d28446fc8aae100 server_cookie=ab9f7a0c379028c in_seq=0 out_seq=0 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06ce7fc640 1 -- 172.21.15.79:0/2985914649 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e53bffce70 con 0x55e53c0cd6d0 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06ce7fc640 10 client.7449 handle_command_reply: tid=0 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 client.7449 shutdown 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 -- 172.21.15.79:0/2985914649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0c9260 msgr2=0x55e53c0d3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0c9260 0x55e53c0d3860 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f06e80a93f0 tx=0x7f06e8032f10 comp rx=0 tx=0).stop 2024-06-10T00:21:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 -- 172.21.15.79:0/2985914649 shutdown_connections 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0c9260 0x55e53c0d3860 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55e53c0cd6d0 0x55e53c0cdab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c0b40e0 0x55e53c0cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 --2- 172.21.15.79:0/2985914649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06ce7fc640 0 client.7449 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 -- 172.21.15.79:0/2985914649 >> 172.21.15.79:0/2985914649 conn(0x55e53c086960 msgr2=0x55e53c087610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 -- 172.21.15.79:0/2985914649 shutdown_connections 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 1 -- 172.21.15.79:0/2985914649 wait complete. 2024-06-10T00:21:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.527+0000 7f06f89a1740 20 client.7449 trim_cache size 0 max 16384 2024-06-10T00:21:55.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.546+0000 7f06f89a1740 1 Processor -- start 2024-06-10T00:21:55.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.546+0000 7f06f89a1740 1 -- start start 2024-06-10T00:21:55.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.546+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0f5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06f89a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06f01fc240 con 0x55e53c0b40e0 2024-06-10T00:21:55.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06f89a1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06f01420d0 con 0x55e53c086960 2024-06-10T00:21:55.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06f89a1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06f01fbba0 con 0x55e53c0b3d00 2024-06-10T00:21:55.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41930/0 (socket says 172.21.15.79:41930) 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 -- 172.21.15.79:0/1870206189 learned_addr learned my addr 172.21.15.79:0/1870206189 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06eeffd640 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 -- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 msgr2=0x55e53c0b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 -- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 msgr2=0x55e53c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 -- 172.21.15.79:0/1870206189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e53c0d3e10 con 0x55e53c0b40e0 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06eeffd640 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06effff640 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0f5810 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f06e8075630 tx=0x7f06e807b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd935bc1748ffe34 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06d4ff9640 1 -- 172.21.15.79:0/1870206189 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8081db0 con 0x55e53c0b40e0 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06d4ff9640 1 -- 172.21.15.79:0/1870206189 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e802f070 con 0x55e53c0b40e0 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.547+0000 7f06d4ff9640 1 -- 172.21.15.79:0/1870206189 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8075840 con 0x55e53c0b40e0 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 -- 172.21.15.79:0/1870206189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 msgr2=0x55e53c0f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0f5810 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f06e8075630 tx=0x7f06e807b000 comp rx=0 tx=0).stop 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 -- 172.21.15.79:0/1870206189 shutdown_connections 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0f5810 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1870206189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 -- 172.21.15.79:0/1870206189 >> 172.21.15.79:0/1870206189 conn(0x55e53c085ce0 msgr2=0x55e53c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 -- 172.21.15.79:0/1870206189 shutdown_connections 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 -- 172.21.15.79:0/1870206189 wait complete. 2024-06-10T00:21:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 -- start start 2024-06-10T00:21:55.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.548+0000 7f06f89a1740 1 Processor -- start 2024-06-10T00:21:55.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06f89a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06f89a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e53c0d3340 con 0x55e53c0b40e0 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06f89a1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e53c08bd80 con 0x55e53c086960 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06f89a1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e53c0c9800 con 0x55e53c0b3d00 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06f89a1740 10 client.0 _ll_register_callbacks cb 0x7f06e8078b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0a4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41938/0 (socket says 172.21.15.79:41938) 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06effff640 1 -- 172.21.15.79:0/1452580226 learned_addr learned my addr 172.21.15.79:0/1452580226 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.549+0000 7f06eeffd640 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06effff640 1 -- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 msgr2=0x55e53c0b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06effff640 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06effff640 1 -- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 msgr2=0x55e53c0f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06effff640 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06effff640 1 -- 172.21.15.79:0/1452580226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e53c0b27c0 con 0x55e53c0b40e0 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06effff640 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0a4d30 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f06e8081f70 tx=0x7f06e80a9320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46b0604cb07c73c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06ce7fc640 1 -- 172.21.15.79:0/1452580226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8081db0 con 0x55e53c0b40e0 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06ce7fc640 1 -- 172.21.15.79:0/1452580226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f06e8078620 con 0x55e53c0b40e0 2024-06-10T00:21:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 1 -- 172.21.15.79:0/1452580226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e802f070 con 0x55e53c0b40e0 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06ce7fc640 1 -- 172.21.15.79:0/1452580226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f06e80a0050 con 0x55e53c0b40e0 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 10 client.7455 fetch_fsmap learned FSMap version 62 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 1 -- 172.21.15.79:0/1452580226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55e53c0b27c0 con 0x55e53c0b40e0 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06ce7fc640 1 -- 172.21.15.79:0/1452580226 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e802f070 con 0x55e53c0b40e0 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06ce7fc640 1 -- 172.21.15.79:0/1452580226 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7f06e8048040 con 0x55e53c0b40e0 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 10 client.7455 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 10 client.7455 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 20 client.7455 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55e53c0c9260 0x55e53c0cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 4 client.7455 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06f89a1740 1 -- 172.21.15.79:0/1452580226 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "status"}) -- 0x55e53bff71c0 con 0x55e53c0c9260 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.550+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55e53c0c9260 0x55e53c0cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06ef7fe640 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55e53c0c9260 0x55e53c0cbb40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a18a3ef4702fc16b server_cookie=7634f18a42e97308 in_seq=0 out_seq=0 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06ce7fc640 10 client.7455 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06ce7fc640 1 -- 172.21.15.79:0/1452580226 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55e53bff71c0 con 0x55e53c0c9260 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06ce7fc640 10 client.7455 handle_command_reply: tid=0 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 client.7455 shutdown 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 -- 172.21.15.79:0/1452580226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 msgr2=0x55e53c0a4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0a4d30 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f06e8081f70 tx=0x7f06e80a9320 comp rx=0 tx=0).stop 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 -- 172.21.15.79:0/1452580226 shutdown_connections 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e53c0b40e0 0x55e53c0a4d30 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e53c0b3d00 0x55e53c0b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55e53c0c9260 0x55e53c0cbb40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 --2- 172.21.15.79:0/1452580226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e53c086960 0x55e53c0f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 -- 172.21.15.79:0/1452580226 >> 172.21.15.79:0/1452580226 conn(0x55e53c085ce0 msgr2=0x55e53c0d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:55.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06ce7fc640 0 client.7455 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:55.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 -- 172.21.15.79:0/1452580226 shutdown_connections 2024-06-10T00:21:55.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 1 -- 172.21.15.79:0/1452580226 wait complete. 2024-06-10T00:21:55.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.551+0000 7f06f89a1740 20 client.7455 trim_cache size 0 max 16384 2024-06-10T00:21:55.560 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7365, 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3950478779999997, 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 62, 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 92, 2024-06-10T00:21:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 92, 2024-06-10T00:21:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 5.367145807 2024-06-10T00:21:55.562 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:21:55.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 -- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06dc06be60 msgr2=0x7f06dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06dc06be60 0x7f06dc06e320 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f06e0000c00 tx=0x7f06e0009040 comp rx=0 tx=0).stop 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 -- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f015c8a0 msgr2=0x7f06f00adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f015c8a0 0x7f06f00adec0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f06e8000f80 tx=0x7f06e8001dc0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 -- 172.21.15.79:0/3508246696 shutdown_connections 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f06dc06be60 0x7f06dc06e320 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f015c8a0 0x7f06f00adec0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06f015af60 0x7f06f009ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 --2- 172.21.15.79:0/3508246696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d80051c0 0x7f06f013e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 -- 172.21.15.79:0/3508246696 >> 172.21.15.79:0/3508246696 conn(0x7f06f00b19f0 msgr2=0x7f06f0159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:55.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 -- 172.21.15.79:0/3508246696 shutdown_connections 2024-06-10T00:21:55.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.552+0000 7f06f5c9a640 1 -- 172.21.15.79:0/3508246696 wait complete. 2024-06-10T00:21:55.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:21:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.666+0000 7f20b19dc640 1 Processor -- start 2024-06-10T00:21:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.666+0000 7f20b19dc640 1 -- start start 2024-06-10T00:21:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.666+0000 7f20b19dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b4c80 0x7f20ac0ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.666+0000 7f20b19dc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20ac0cec10 0x7f20ac0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.666+0000 7f20b19dc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac0b7d20 con 0x7f20ac0b7940 2024-06-10T00:21:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.666+0000 7f20b19dc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f20ac0d1200 con 0x7f20ac0cec10 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.666+0000 7f20b19dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac0cc620 con 0x7f20ac0b4c80 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20ab7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20ac0cec10 0x7f20ac0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20aaffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f20ac0b7940 0x7f20ac0d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34704/0 (socket says 172.21.15.79:34704) 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20aaffd640 1 -- 172.21.15.79:0/861481655 learned_addr learned my addr 172.21.15.79:0/861481655 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20a27fc640 1 --2- 172.21.15.79:0/861481655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b4c80 0x7f20ac0ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20aa7fc640 1 -- 172.21.15.79:0/861481655 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986200244 0 0) 0x7f20ac0b7d20 con 0x7f20ac0b7940 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20aa7fc640 1 -- 172.21.15.79:0/861481655 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2098003520 con 0x7f20ac0b7940 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20ab7fe640 1 -- 172.21.15.79:0/861481655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b4c80 msgr2=0x7f20ac0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20ab7fe640 1 --2- 172.21.15.79:0/861481655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b4c80 0x7f20ac0ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20ab7fe640 1 -- 172.21.15.79:0/861481655 >> v1:172.21.15.79:6789/0 conn(0x7f20ac0b7940 legacy=0x7f20ac0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20ab7fe640 1 -- 172.21.15.79:0/861481655 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac0cc900 con 0x7f20ac0cec10 2024-06-10T00:21:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.667+0000 7f20a27fc640 1 --2- 172.21.15.79:0/861481655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b4c80 0x7f20ac0ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20ab7fe640 1 --2- 172.21.15.79:0/861481655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0cec10 0x7f20ac0cd3e0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009d90 tx=0x7f20a402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cdffa1855d4523 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20aa7fc640 1 -- 172.21.15.79:0/861481655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4007740 con 0x7f20ac0cec10 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20aa7fc640 1 -- 172.21.15.79:0/861481655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a40078e0 con 0x7f20ac0cec10 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20aa7fc640 1 -- 172.21.15.79:0/861481655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4007cb0 con 0x7f20ac0cec10 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20b19dc640 1 -- 172.21.15.79:0/861481655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0cec10 msgr2=0x7f20ac0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20b19dc640 1 --2- 172.21.15.79:0/861481655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0cec10 0x7f20ac0cd3e0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009d90 tx=0x7f20a402a660 comp rx=0 tx=0).stop 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20b19dc640 1 -- 172.21.15.79:0/861481655 shutdown_connections 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20b19dc640 1 --2- 172.21.15.79:0/861481655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0cec10 0x7f20ac0cd3e0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20b19dc640 1 --2- 172.21.15.79:0/861481655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b4c80 0x7f20ac0ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20b19dc640 1 -- 172.21.15.79:0/861481655 >> 172.21.15.79:0/861481655 conn(0x7f20ac0d1e50 msgr2=0x7f20ac0d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20b19dc640 1 -- 172.21.15.79:0/861481655 shutdown_connections 2024-06-10T00:21:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.668+0000 7f20b19dc640 1 -- 172.21.15.79:0/861481655 wait complete. 2024-06-10T00:21:55.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20b19dc640 1 Processor -- start 2024-06-10T00:21:55.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20b19dc640 1 -- start start 2024-06-10T00:21:55.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20b19dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0b4c80 0x7f20ac1f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20b19dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b7940 0x7f20ac0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20b19dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac0cec10 0x7f20ac0c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20b19dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac0d2a90 con 0x7f20ac0b4c80 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20b19dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac0ccec0 con 0x7f20ac0cec10 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20b19dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac0d2c10 con 0x7f20ac0b7940 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.670+0000 7f20aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0b4c80 0x7f20ac1f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0b4c80 0x7f20ac1f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41960/0 (socket says 172.21.15.79:41960) 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20aaffd640 1 -- 172.21.15.79:0/2533444269 learned_addr learned my addr 172.21.15.79:0/2533444269 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20aaffd640 1 -- 172.21.15.79:0/2533444269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b7940 msgr2=0x7f20ac0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20aaffd640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b7940 0x7f20ac0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20aaffd640 1 -- 172.21.15.79:0/2533444269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac0cec10 msgr2=0x7f20ac0c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20aaffd640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac0cec10 0x7f20ac0c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20aaffd640 1 -- 172.21.15.79:0/2533444269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac0c9820 con 0x7f20ac0b4c80 2024-06-10T00:21:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20aaffd640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0b4c80 0x7f20ac1f3650 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f209c00c460 tx=0x7f209c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20a8ff9640 1 -- 172.21.15.79:0/2533444269 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c017070 con 0x7f20ac0b4c80 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20a8ff9640 1 -- 172.21.15.79:0/2533444269 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c005ce0 con 0x7f20ac0b4c80 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac0c9b00 con 0x7f20ac0b4c80 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20a8ff9640 1 -- 172.21.15.79:0/2533444269 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c007290 con 0x7f20ac0b4c80 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.671+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac0ca0c0 con 0x7f20ac0b4c80 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.672+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ac068430 con 0x7f20ac0b4c80 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.673+0000 7f20a8ff9640 1 -- 172.21.15.79:0/2533444269 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f209c01a070 con 0x7f20ac0b4c80 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.673+0000 7f20a8ff9640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f208c06be30 0x7f208c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.673+0000 7f20a27fc640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f208c06be30 0x7f208c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.673+0000 7f20a8ff9640 1 -- 172.21.15.79:0/2533444269 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f209c08a440 con 0x7f20ac0b4c80 2024-06-10T00:21:55.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.674+0000 7f20a27fc640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f208c06be30 0x7f208c06e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2094006fd0 tx=0x7f2094008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.678+0000 7f20a8ff9640 1 -- 172.21.15.79:0/2533444269 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f209c058c90 con 0x7f20ac0b4c80 2024-06-10T00:21:55.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.887+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f20ac0b3360 con 0x7f20ac0b4c80 2024-06-10T00:21:55.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.887+0000 7f20a8ff9640 1 -- 172.21.15.79:0/2533444269 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) ==== 53+0+73 (secure 0 0 0) 0x7f209c058590 con 0x7f20ac0b4c80 2024-06-10T00:21:55.887 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:21:55.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f208c06be30 msgr2=0x7f208c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f208c06be30 0x7f208c06e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2094006fd0 tx=0x7f2094008040 comp rx=0 tx=0).stop 2024-06-10T00:21:55.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0b4c80 msgr2=0x7f20ac1f3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0b4c80 0x7f20ac1f3650 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f209c00c460 tx=0x7f209c00c920 comp rx=0 tx=0).stop 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 shutdown_connections 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f208c06be30 0x7f208c06e2f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac0cec10 0x7f20ac0c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b7940 0x7f20ac0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 --2- 172.21.15.79:0/2533444269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ac0b4c80 0x7f20ac1f3650 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.889+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 >> 172.21.15.79:0/2533444269 conn(0x7f20ac0d1e50 msgr2=0x7f20ac0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.890+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 shutdown_connections 2024-06-10T00:21:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:55.890+0000 7f20b19dc640 1 -- 172.21.15.79:0/2533444269 wait complete. 2024-06-10T00:21:55.900 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:21:55.900 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:21:55.900 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:21:55.900 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:21:55.900 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:21:55.900 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:21:55.900 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:21:55.901 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:21:55.901 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:21:55.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:55.901 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:21:55.917 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:21:55.917 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:21:55.917 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:21:55.917 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:21:55.917 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:21:55.918 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42328sec preferred_lft 42328sec 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:21:55.919 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:21:55.920 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:21:55.920 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:21:55.920 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:21:55.920 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:21:55.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:55.920 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:21:55.980 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:21:55.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:55.982 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:21:56.038 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:21:56.038 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:21:56.038 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:21:56.038 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:21:56.038 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:21:56.039 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:21:56.039 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:21:56.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:21:56.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:21:56.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:21:56.039 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:21:56.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:21:56.156 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:21:56.157+0000 7f39282b1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:21:56.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:21:56.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:56.164 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:21:56.180 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:21:56.180 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:21:56.180 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:21:56.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:56.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:21:56.245 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:21:56.246 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:21:56.246 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:21:56.302 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:21:56.302 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:21:56.302 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:21:56.357 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:21:56.423 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:21:56.479 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:21:56.479 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:21:56.479 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:21:56.479 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:21:56.480 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:21:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:21:56.482 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:21:56.482 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:21:56.482 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:21:56.482 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:21:56.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:56.482 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:21:56.535 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:21:56.535 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:21:56.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:21:56.602 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:21:56.658 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:21:56.659 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:21:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:21:56.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:56.661 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:21:56.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:21:56.659+0000 7f2ce073d480 -1 init, newargv = 0x56554e823410 newargc=15 2024-06-10T00:21:56.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[67569]: starting ceph client 2024-06-10T00:21:56.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[67569]: starting fuse 2024-06-10T00:21:56.677 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:21:56.677 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:21:56.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:21:56.678 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:21:56.679 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:21:56.795 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.67569.asok 2024-06-10T00:21:56.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:21:56.806 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.67569.asok 2024-06-10T00:21:56.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:56.806 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.67569.asok status 2024-06-10T00:21:56.941 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:21:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:21:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:21:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:21:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:21:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:21:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:21:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "67569", 2024-06-10T00:21:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:21:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:21:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:21:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7467, 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 7467 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:21:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 430170190 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 430170190 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.7467 192.168.0.1:0/430170190", 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/430170190", 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:21:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 62, 2024-06-10T00:21:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 92, 2024-06-10T00:21:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:21:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:21:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:21:56.945 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:21:56.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:56.949 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:21:56.950 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:21:56.965 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:21:56.965 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:21:56.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:56.966 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:21:57.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:57.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-06-10T00:21:57.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.173+0000 7f9bfb2ae640 1 Processor -- start 2024-06-10T00:21:57.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.173+0000 7f9bfb2ae640 1 -- start start 2024-06-10T00:21:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bfb2ae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 0x7f9bf40cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bfb2ae640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9bf40ad800 0x7f9bf40adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bfb2ae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf40acd40 con 0x7f9bf4155590 2024-06-10T00:21:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bfb2ae640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf415bfe0 con 0x7f9bf40ad800 2024-06-10T00:21:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bfb2ae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf415c2c0 con 0x7f9bf40cec60 2024-06-10T00:21:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bf904a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9bf4155590 0x7f9bf415b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34716/0 (socket says 172.21.15.79:34716) 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bf904a640 1 -- 172.21.15.79:0/1733621070 learned_addr learned my addr 172.21.15.79:0/1733621070 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167745295 0 0) 0x7f9bf40acd40 con 0x7f9bf4155590 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be0003520 con 0x7f9bf4155590 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bf8849640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 0x7f9bf40cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bf984b640 1 --2- 172.21.15.79:0/1733621070 >> v2:172.21.15.117:3300/0 conn(0x7f9bf40ad800 0x7f9bf40adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4159399629 0 0) 0x7f9be0003520 con 0x7f9bf4155590 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 msgr2=0x7f9bf40cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 0x7f9bf40cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 >> v2:172.21.15.117:3300/0 conn(0x7f9bf40ad800 msgr2=0x7f9bf40adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 --2- 172.21.15.79:0/1733621070 >> v2:172.21.15.117:3300/0 conn(0x7f9bf40ad800 0x7f9bf40adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf40ad000 con 0x7f9bf4155590 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f9bf00019f0 con 0x7f9bf4155590 2024-06-10T00:21:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bf8849640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 0x7f9bf40cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 >> v1:172.21.15.79:6789/0 conn(0x7f9bf4155590 legacy=0x7f9bf415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 0x7f9be00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be0003fa0 0x7f9be0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9be00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf415bfe0 con 0x7f9be0004d40 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf415c2c0 con 0x7f9be0003fa0 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.174+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9be000baa0 con 0x7f9bf40cec60 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.175+0000 7f9bf984b640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9be00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.175+0000 7f9bf904a640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 0x7f9be00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.175+0000 7f9bf8849640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be0003fa0 0x7f9be0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.175+0000 7f9bf984b640 1 -- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 msgr2=0x7f9be00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.175+0000 7f9bf984b640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf40cec60 0x7f9be00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.175+0000 7f9bf984b640 1 -- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be0003fa0 msgr2=0x7f9be0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.175+0000 7f9bf984b640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be0003fa0 0x7f9be0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.175+0000 7f9bf984b640 1 -- 172.21.15.79:0/1733621070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be0003520 con 0x7f9be0004d40 2024-06-10T00:21:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bf984b640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9be00051c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00ba30 tx=0x7f9be0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c6d256fd1ca25f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec030070 con 0x7f9be0004d40 2024-06-10T00:21:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bec02ae10 con 0x7f9be0004d40 2024-06-10T00:21:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bebfff640 1 -- 172.21.15.79:0/1733621070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00b600 con 0x7f9be0004d40 2024-06-10T00:21:57.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/1733621070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 msgr2=0x7f9be00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bfb2ae640 1 --2- 172.21.15.79:0/1733621070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9be00051c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00ba30 tx=0x7f9be0005830 comp rx=0 tx=0).stop 2024-06-10T00:21:57.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bf984b640 1 -- 172.21.15.79:0/1733621070 reap_dead start 2024-06-10T00:21:57.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/1733621070 shutdown_connections 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/1733621070 >> 172.21.15.79:0/1733621070 conn(0x7f9bf40b1980 msgr2=0x7f9bf40b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/1733621070 shutdown_connections 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.176+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/1733621070 wait complete. 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.177+0000 7f9bfb2ae640 1 Processor -- start 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.177+0000 7f9bfb2ae640 1 -- start start 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bfb2ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9bf4153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bfb2ae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf415eef0 0x7f9bf415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bfb2ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bf409ba60 0x7f9bf409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bfb2ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf415bb70 con 0x7f9be0004d40 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bfb2ae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40b26d0 con 0x7f9bf409ba60 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bfb2ae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf415bcf0 con 0x7f9bf415eef0 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9bf4153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9bf4153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41980/0 (socket says 172.21.15.79:41980) 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bf904a640 1 -- 172.21.15.79:0/2970875367 learned_addr learned my addr 172.21.15.79:0/2970875367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bf8849640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf415eef0 0x7f9bf415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bf984b640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bf409ba60 0x7f9bf409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.178+0000 7f9bf904a640 1 -- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf415eef0 msgr2=0x7f9bf415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9bf904a640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf415eef0 0x7f9bf415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9bf904a640 1 -- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bf409ba60 msgr2=0x7f9bf409bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9bf904a640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bf409ba60 0x7f9bf409bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9bf904a640 1 -- 172.21.15.79:0/2970875367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf41f4d40 con 0x7f9be0004d40 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9bf8849640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf415eef0 0x7f9bf415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9bf904a640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9bf4153830 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0007a20 tx=0x7f9bf000a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9be9ffb640 1 -- 172.21.15.79:0/2970875367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0017020 con 0x7f9be0004d40 2024-06-10T00:21:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9be9ffb640 1 -- 172.21.15.79:0/2970875367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0013600 con 0x7f9be0004d40 2024-06-10T00:21:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9be9ffb640 1 -- 172.21.15.79:0/2970875367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000ae60 con 0x7f9be0004d40 2024-06-10T00:21:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/2970875367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf409c640 con 0x7f9be0004d40 2024-06-10T00:21:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.179+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/2970875367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf409cc00 con 0x7f9be0004d40 2024-06-10T00:21:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.180+0000 7f9be9ffb640 1 -- 172.21.15.79:0/2970875367 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bf001a020 con 0x7f9be0004d40 2024-06-10T00:21:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.181+0000 7f9be9ffb640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9bd806be30 0x7f9bd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.181+0000 7f9be9ffb640 1 -- 172.21.15.79:0/2970875367 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f9bf008bce0 con 0x7f9be0004d40 2024-06-10T00:21:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.181+0000 7f9bf8849640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9bd806be30 0x7f9bd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.181+0000 7f9bf8849640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9bd806be30 0x7f9bd806e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9bf41547e0 tx=0x7f9be4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.182+0000 7f9bfdfb7740 1 Processor -- start 2024-06-10T00:21:57.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.182+0000 7f9bfdfb7740 1 -- start start 2024-06-10T00:21:57.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5b8f70 0x5562ed5be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5c04a0 0x5562ed5be970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5562ed521a70 con 0x5562ed5e18c0 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5562ed4bfca0 con 0x5562ed5c04a0 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5562ed51da30 con 0x5562ed5b8f70 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41986/0 (socket says 172.21.15.79:41986) 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 -- 172.21.15.79:0/2139324549 learned_addr learned my addr 172.21.15.79:0/2139324549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 -- 172.21.15.79:0/2139324549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5b8f70 msgr2=0x5562ed5be430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 --2- 172.21.15.79:0/2139324549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5b8f70 0x5562ed5be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 -- 172.21.15.79:0/2139324549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5c04a0 msgr2=0x5562ed5be970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 --2- 172.21.15.79:0/2139324549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5c04a0 0x5562ed5be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 -- 172.21.15.79:0/2139324549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ed4eaeb0 con 0x5562ed5e18c0 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bf904a640 1 --2- 172.21.15.79:0/2139324549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bdef0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0062390 tx=0x7f9bf0059ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e451f7f1f1bc73f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bd6ffd640 1 -- 172.21.15.79:0/2139324549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf006f070 con 0x5562ed5e18c0 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bd6ffd640 1 -- 172.21.15.79:0/2139324549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0057d80 con 0x5562ed5e18c0 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.183+0000 7f9bd6ffd640 1 -- 172.21.15.79:0/2139324549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0056350 con 0x5562ed5e18c0 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/2139324549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 msgr2=0x5562ed5bdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/2139324549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bdef0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0062390 tx=0x7f9bf0059ce0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/2139324549 shutdown_connections 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/2139324549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5c04a0 0x5562ed5be970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/2139324549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5b8f70 0x5562ed5be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/2139324549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bdef0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/2139324549 >> 172.21.15.79:0/2139324549 conn(0x5562ed5bb1e0 msgr2=0x5562ed603d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/2139324549 shutdown_connections 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/2139324549 wait complete. 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.184+0000 7f9bfdfb7740 1 -- start start 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.185+0000 7f9bfdfb7740 1 Processor -- start 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.185+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.185+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 0x5562ed5e49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.185+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed5e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.185+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5562ed5bc9b0 con 0x5562ed5e18c0 2024-06-10T00:21:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.185+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5562ed4aae50 con 0x5562ed5e9890 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.185+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5562ed5e1ca0 con 0x5562ed5e45d0 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.185+0000 7f9bfdfb7740 10 client.0 _ll_register_callbacks cb 0x5562ed234c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41992/0 (socket says 172.21.15.79:41992) 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 -- 172.21.15.79:0/3898178051 learned_addr learned my addr 172.21.15.79:0/3898178051 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf8849640 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 0x5562ed5e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf984b640 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed5e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 -- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 msgr2=0x5562ed5e49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 0x5562ed5e49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 -- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 msgr2=0x5562ed5e9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed5e9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 -- 172.21.15.79:0/3898178051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ed2fd7e0 con 0x5562ed5e18c0 2024-06-10T00:21:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf984b640 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed5e9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bf904a640 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5d0410 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0062390 tx=0x7f9bf0001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68fc4f7d75da6bc server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bcffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bcffff640 1 -- 172.21.15.79:0/3898178051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0059340 con 0x5562ed5e18c0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bcffff640 1 -- 172.21.15.79:0/3898178051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f9bf0077070 con 0x5562ed5e18c0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/3898178051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf0057d80 con 0x5562ed5e18c0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bcffff640 1 -- 172.21.15.79:0/3898178051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9bf0083050 con 0x5562ed5e18c0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bfdfb7740 10 client.7479 fetch_fsmap learned FSMap version 62 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/3898178051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x5562ed35df70 con 0x5562ed5e18c0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bcffff640 1 -- 172.21.15.79:0/3898178051 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0057d80 con 0x5562ed5e18c0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bcffff640 1 -- 172.21.15.79:0/3898178051 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7f9bf00602a0 con 0x5562ed5e18c0 2024-06-10T00:21:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bfdfb7740 10 client.7479 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.186+0000 7f9bfdfb7740 10 client.7479 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.187+0000 7f9bfdfb7740 20 client.7479 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.187+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5562ed5e8200 0x5562ed5e86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.187+0000 7f9bfdfb7740 4 client.7479 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.187+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/3898178051 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562ed52f1a0 con 0x5562ed5e8200 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.187+0000 7f9bf8849640 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5562ed5e8200 0x5562ed5e86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.187+0000 7f9bf8849640 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5562ed5e8200 0x5562ed5e86b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5850dd80e8e4fd2 server_cookie=f5ab6c0dbbdc342e in_seq=0 out_seq=0 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.187+0000 7f9bcffff640 10 client.7479 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.187+0000 7f9bcffff640 1 -- 172.21.15.79:0/3898178051 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5562ed52f1a0 con 0x5562ed5e8200 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bcffff640 10 client.7479 handle_command_reply: tid=0 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 client.7479 shutdown 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/3898178051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 msgr2=0x5562ed5d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5d0410 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0062390 tx=0x7f9bf0001dc0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/3898178051 shutdown_connections 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5562ed5e8200 0x5562ed5e86b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed5e9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bcffff640 0 client.7479 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 0x5562ed5e49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/3898178051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5d0410 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/3898178051 >> 172.21.15.79:0/3898178051 conn(0x5562ed5c04a0 msgr2=0x5562ed5bce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/3898178051 shutdown_connections 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/3898178051 wait complete. 2024-06-10T00:21:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.188+0000 7f9bfdfb7740 20 client.7479 trim_cache size 0 max 16384 2024-06-10T00:21:57.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.206+0000 7f9bfdfb7740 1 Processor -- start 2024-06-10T00:21:57.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.206+0000 7f9bfdfb7740 1 -- start start 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed628000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e45d0 0x5562ed5bc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e9890 0x5562ed5bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5562ed5eccf0 con 0x5562ed5e18c0 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf4201710 con 0x5562ed5e45d0 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf4200720 con 0x5562ed5e9890 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed628000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed628000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42004/0 (socket says 172.21.15.79:42004) 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 -- 172.21.15.79:0/283892625 learned_addr learned my addr 172.21.15.79:0/283892625 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf984b640 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e9890 0x5562ed5bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 -- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e9890 msgr2=0x5562ed5bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf8849640 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e45d0 0x5562ed5bc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e9890 0x5562ed5bcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 -- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e45d0 msgr2=0x5562ed5bc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e45d0 0x5562ed5bc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 -- 172.21.15.79:0/283892625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ed5ea080 con 0x5562ed5e18c0 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf8849640 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e45d0 0x5562ed5bc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bf904a640 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed628000 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0001cf0 tx=0x7f9bf0076000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bff6c4e4c41d890 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bd67fc640 1 -- 172.21.15.79:0/283892625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0057d80 con 0x5562ed5e18c0 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bd67fc640 1 -- 172.21.15.79:0/283892625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf007c020 con 0x5562ed5e18c0 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.207+0000 7f9bd67fc640 1 -- 172.21.15.79:0/283892625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0059340 con 0x5562ed5e18c0 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/283892625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 msgr2=0x5562ed628000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed628000 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0001cf0 tx=0x7f9bf0076000 comp rx=0 tx=0).stop 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/283892625 shutdown_connections 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e9890 0x5562ed5bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e45d0 0x5562ed5bc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/283892625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed628000 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/283892625 >> 172.21.15.79:0/283892625 conn(0x5562ed5c04a0 msgr2=0x5562ed5e85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/283892625 shutdown_connections 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/283892625 wait complete. 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 -- start start 2024-06-10T00:21:57.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.208+0000 7f9bfdfb7740 1 Processor -- start 2024-06-10T00:21:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 0x5562ed680f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bfdfb7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed6814a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf415d980 con 0x5562ed5e18c0 2024-06-10T00:21:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf415d330 con 0x5562ed5e9890 2024-06-10T00:21:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bfdfb7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5562ed681fd0 con 0x5562ed5e45d0 2024-06-10T00:21:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bfdfb7740 10 client.0 _ll_register_callbacks cb 0x7f9bf005d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:57.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bf904a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42014/0 (socket says 172.21.15.79:42014) 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.209+0000 7f9bf904a640 1 -- 172.21.15.79:0/1248699142 learned_addr learned my addr 172.21.15.79:0/1248699142 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf904a640 1 -- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 msgr2=0x5562ed680f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf8849640 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 0x5562ed680f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf904a640 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 0x5562ed680f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf984b640 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed6814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf904a640 1 -- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 msgr2=0x5562ed6814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf904a640 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed6814a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf904a640 1 -- 172.21.15.79:0/1248699142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ed1f5170 con 0x5562ed5e18c0 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf984b640 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed6814a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bf904a640 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bccb0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000ac50 tx=0x7f9bf0056030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8f34e41d78228 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bcffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:57.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bcffff640 1 -- 172.21.15.79:0/1248699142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0062b10 con 0x5562ed5e18c0 2024-06-10T00:21:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bcffff640 1 -- 172.21.15.79:0/1248699142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f9bf0077040 con 0x5562ed5e18c0 2024-06-10T00:21:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/1248699142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf007c020 con 0x5562ed5e18c0 2024-06-10T00:21:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bcffff640 1 -- 172.21.15.79:0/1248699142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9bf004b050 con 0x5562ed5e18c0 2024-06-10T00:21:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 10 client.7485 fetch_fsmap learned FSMap version 62 2024-06-10T00:21:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/1248699142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x5562ed1f5170 con 0x5562ed5e18c0 2024-06-10T00:21:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bcffff640 1 -- 172.21.15.79:0/1248699142 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf007c020 con 0x5562ed5e18c0 2024-06-10T00:21:57.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bcffff640 1 -- 172.21.15.79:0/1248699142 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7f9bf0062cb0 con 0x5562ed5e18c0 2024-06-10T00:21:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 10 client.7485 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:21:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 10 client.7485 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 20 client.7485 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5562ed685260 0x5562ed685640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 4 client.7485 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-06-10T00:21:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.210+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/1248699142 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x5562ed5294f0 con 0x5562ed685260 2024-06-10T00:21:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bf8849640 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5562ed685260 0x5562ed685640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bcffff640 10 client.7485 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bf8849640 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5562ed685260 0x5562ed685640 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc9d80371e5ff82 server_cookie=767d4e675f596234 in_seq=0 out_seq=0 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bcffff640 1 -- 172.21.15.79:0/1248699142 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5562ed5294f0 con 0x5562ed685260 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bcffff640 10 client.7485 handle_command_reply: tid=0 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 client.7485 shutdown 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/1248699142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 msgr2=0x5562ed5bccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bccb0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000ac50 tx=0x7f9bf0056030 comp rx=0 tx=0).stop 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/1248699142 shutdown_connections 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5562ed685260 0x5562ed685640 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562ed5e9890 0x5562ed6814a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5562ed5e45d0 0x5562ed680f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 --2- 172.21.15.79:0/1248699142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562ed5e18c0 0x5562ed5bccb0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.211+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/1248699142 >> 172.21.15.79:0/1248699142 conn(0x5562ed5c04a0 msgr2=0x5562ed5b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bcffff640 0 client.7485 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:57.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/1248699142 shutdown_connections 2024-06-10T00:21:57.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfdfb7740 1 -- 172.21.15.79:0/1248699142 wait complete. 2024-06-10T00:21:57.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfdfb7740 20 client.7485 trim_cache size 0 max 16384 2024-06-10T00:21:57.220 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:21:57.220 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:21:57.220 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "61a1e692-6f5b-4f19-b523-62b7cf1b52c4", 2024-06-10T00:21:57.221 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:21:57.221 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:21:57.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9bd806be30 msgr2=0x7f9bd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9bd806be30 0x7f9bd806e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9bf41547e0 tx=0x7f9be4008040 comp rx=0 tx=0).stop 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 msgr2=0x7f9bf4153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9bf4153830 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0007a20 tx=0x7f9bf000a750 comp rx=0 tx=0).stop 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/2970875367 shutdown_connections 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9bd806be30 0x7f9bd806e2f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bf409ba60 0x7f9bf409bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bf415eef0 0x7f9bf415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 --2- 172.21.15.79:0/2970875367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be0004d40 0x7f9bf4153830 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.212+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/2970875367 >> 172.21.15.79:0/2970875367 conn(0x7f9bf40b1980 msgr2=0x7f9bf40afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.213+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/2970875367 shutdown_connections 2024-06-10T00:21:57.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.213+0000 7f9bfb2ae640 1 -- 172.21.15.79:0/2970875367 wait complete. 2024-06-10T00:21:57.223 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:21:57.213+0000 7f39242a9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x55f405fd2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v6>,<0x1/dir v13>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-10T00:21:57.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:21:57.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-06-10T00:21:57.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.325+0000 7fa5c34ca640 1 Processor -- start 2024-06-10T00:21:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.325+0000 7fa5c34ca640 1 -- start start 2024-06-10T00:21:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5c34ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 0x7fa5bc0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5c34ca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc155700 con 0x7fa5bc0d0730 2024-06-10T00:21:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5c34ca640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc15b6b0 con 0x7fa5bc0b34e0 2024-06-10T00:21:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5c34ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5bc15b990 con 0x7fa5bc155320 2024-06-10T00:21:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5c1a67640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa5bc0d0730 0x7fa5bc06e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34718/0 (socket says 172.21.15.79:34718) 2024-06-10T00:21:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1747736586 learned_addr learned my addr 172.21.15.79:0/1747736586 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:21:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5c1266640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 0x7fa5bc0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 643328938 0 0) 0x7fa5bc155700 con 0x7fa5bc0d0730 2024-06-10T00:21:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5a8003520 con 0x7fa5bc0d0730 2024-06-10T00:21:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4222075509 0 0) 0x7fa5a8003520 con 0x7fa5bc0d0730 2024-06-10T00:21:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 msgr2=0x7fa5bc0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5b3fff640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 0x7fa5bc0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 >> v1:172.21.15.117:6789/0 conn(0x7fa5bc0b34e0 legacy=0x7fa5bc0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc15bc70 con 0x7fa5bc0d0730 2024-06-10T00:21:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.326+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fa5b40019f0 con 0x7fa5bc0d0730 2024-06-10T00:21:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 >> v1:172.21.15.79:6789/0 conn(0x7fa5bc0d0730 legacy=0x7fa5bc06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5b3fff640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a80039e0 0x7fa5a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5b3fff640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 0x7fa5a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5b3fff640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc15b990 con 0x7fa5a8004d40 2024-06-10T00:21:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a800b9c0 con 0x7fa5a80039e0 2024-06-10T00:21:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a800bbc0 con 0x7fa5bc155320 2024-06-10T00:21:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c1266640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a80039e0 0x7fa5a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 0x7fa5a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 msgr2=0x7fa5a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 0x7fa5a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a80039e0 msgr2=0x7fa5a8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a80039e0 0x7fa5a8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1747736586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a8003520 con 0x7fa5a8004d40 2024-06-10T00:21:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.327+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc155320 0x7fa5a8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400a830 tx=0x7fa5a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98867cfe68d8c510 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400a480 con 0x7fa5a8004d40 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b402f070 con 0x7fa5a8004d40 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5b3fff640 1 -- 172.21.15.79:0/1747736586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b402bc90 con 0x7fa5a8004d40 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1747736586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a8004d40 msgr2=0x7fa5a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5c34ca640 1 --2- 172.21.15.79:0/1747736586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400a830 tx=0x7fa5a8005830 comp rx=0 tx=0).stop 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1747736586 reap_dead start 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1747736586 shutdown_connections 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1747736586 >> 172.21.15.79:0/1747736586 conn(0x7fa5bc0b1d10 msgr2=0x7fa5bc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1747736586 shutdown_connections 2024-06-10T00:21:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.328+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1747736586 wait complete. 2024-06-10T00:21:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c34ca640 1 Processor -- start 2024-06-10T00:21:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c34ca640 1 -- start start 2024-06-10T00:21:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c34ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a8004d40 0x7fa5bc149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c34ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc145fe0 0x7fa5bc15cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c34ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5bc1467e0 0x7fa5bc0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c34ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc15b470 con 0x7fa5bc1467e0 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c34ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc15b2f0 con 0x7fa5bc145fe0 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c34ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5bc0b2fa0 con 0x7fa5a8004d40 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c1a67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5bc1467e0 0x7fa5bc0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c1a67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5bc1467e0 0x7fa5bc0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42044/0 (socket says 172.21.15.79:42044) 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.330+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1332565529 learned_addr learned my addr 172.21.15.79:0/1332565529 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c1266640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a8004d40 0x7fa5bc149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc145fe0 0x7fa5bc15cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a8004d40 msgr2=0x7fa5bc149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a8004d40 0x7fa5bc149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc145fe0 msgr2=0x7fa5bc15cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc145fe0 0x7fa5bc15cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c1a67640 1 -- 172.21.15.79:0/1332565529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc15d4d0 con 0x7fa5bc1467e0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c1266640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a8004d40 0x7fa5bc149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc145fe0 0x7fa5bc15cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5bc1467e0 0x7fa5bc0cc610 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4000f80 tx=0x7fa5bc15be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5b1ffb640 1 -- 172.21.15.79:0/1332565529 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400a480 con 0x7fa5bc1467e0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5b1ffb640 1 -- 172.21.15.79:0/1332565529 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b4004b60 con 0x7fa5bc1467e0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5b1ffb640 1 -- 172.21.15.79:0/1332565529 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4001fd0 con 0x7fa5bc1467e0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1332565529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5bc156ae0 con 0x7fa5bc1467e0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.331+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1332565529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5bc1570a0 con 0x7fa5bc1467e0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.333+0000 7fa5b1ffb640 1 -- 172.21.15.79:0/1332565529 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5b4034470 con 0x7fa5bc1467e0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.333+0000 7fa5b1ffb640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa5a006be60 0x7fa5a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.333+0000 7fa5b1ffb640 1 -- 172.21.15.79:0/1332565529 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fa5b40ab350 con 0x7fa5bc1467e0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.333+0000 7fa5c1266640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa5a006be60 0x7fa5a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.333+0000 7fa5c1266640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa5a006be60 0x7fa5a006e320 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009bc0 tx=0x7fa5b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.334+0000 7fa5c61d6740 1 Processor -- start 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.334+0000 7fa5c61d6740 1 -- start start 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 0x5650e80e3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e80de1a0 0x5650e80e3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e80e56d0 0x5650e80e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5650e80087e0 con 0x5650e80de1a0 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5650e8046e80 con 0x5650e8106af0 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5650e7fe4700 con 0x5650e80e56d0 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e80de1a0 0x5650e80e3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e80de1a0 0x5650e80e3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42052/0 (socket says 172.21.15.79:42052) 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 -- 172.21.15.79:0/936048662 learned_addr learned my addr 172.21.15.79:0/936048662 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 -- 172.21.15.79:0/936048662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e80e56d0 msgr2=0x5650e80e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/936048662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e80e56d0 0x5650e80e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 -- 172.21.15.79:0/936048662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 msgr2=0x5650e80e3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/936048662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 0x5650e80e3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 -- 172.21.15.79:0/936048662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e8003dd0 con 0x5650e80de1a0 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/936048662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e80de1a0 0x5650e80e3660 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0055c0 tx=0x7fa5ac003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee8a054f94a38ed server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa59effd640 1 -- 172.21.15.79:0/936048662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac001630 con 0x5650e80de1a0 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa59effd640 1 -- 172.21.15.79:0/936048662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac019070 con 0x5650e80de1a0 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.335+0000 7fa59effd640 1 -- 172.21.15.79:0/936048662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0019f0 con 0x5650e80de1a0 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 -- 172.21.15.79:0/936048662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e80de1a0 msgr2=0x5650e80e3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/936048662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e80de1a0 0x5650e80e3660 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0055c0 tx=0x7fa5ac003a80 comp rx=0 tx=0).stop 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 -- 172.21.15.79:0/936048662 shutdown_connections 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/936048662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e80e56d0 0x5650e80e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/936048662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e80de1a0 0x5650e80e3660 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/936048662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 0x5650e80e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 -- 172.21.15.79:0/936048662 >> 172.21.15.79:0/936048662 conn(0x5650e80e0410 msgr2=0x5650e8128f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 -- 172.21.15.79:0/936048662 shutdown_connections 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.336+0000 7fa5c61d6740 1 -- 172.21.15.79:0/936048662 wait complete. 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.337+0000 7fa5c61d6740 1 -- start start 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.337+0000 7fa5c61d6740 1 Processor -- start 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 0x5650e810a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 0x5650e80efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e81084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5650e7fcf640 con 0x5650e8108020 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5650e8042e40 con 0x5650e8106af0 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5650e80e1be0 con 0x5650e81020b0 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 10 client.0 _ll_register_callbacks cb 0x5650e8001430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:57.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e81084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e81084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42064/0 (socket says 172.21.15.79:42064) 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 -- 172.21.15.79:0/38376763 learned_addr learned my addr 172.21.15.79:0/38376763 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1266640 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 0x5650e810a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 0x5650e80efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 -- 172.21.15.79:0/38376763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 msgr2=0x5650e80efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 0x5650e80efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 -- 172.21.15.79:0/38376763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 msgr2=0x5650e810a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 0x5650e810a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 -- 172.21.15.79:0/38376763 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e7e247d0 con 0x5650e8108020 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e81084a0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40819e0 tx=0x7fa5b40799a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdd1fd015370a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa597fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa597fff640 1 -- 172.21.15.79:0/38376763 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b407d650 con 0x5650e8108020 2024-06-10T00:21:57.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa597fff640 1 -- 172.21.15.79:0/38376763 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fa5b40ab070 con 0x5650e8108020 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 1 -- 172.21.15.79:0/38376763 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5ac019070 con 0x5650e8108020 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa597fff640 1 -- 172.21.15.79:0/38376763 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fa5b4081f10 con 0x5650e8108020 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 10 client.7497 fetch_fsmap learned FSMap version 62 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.338+0000 7fa5c61d6740 1 -- 172.21.15.79:0/38376763 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x5650e7d5a3f0 con 0x5650e8108020 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa597fff640 1 -- 172.21.15.79:0/38376763 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac019070 con 0x5650e8108020 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa597fff640 1 -- 172.21.15.79:0/38376763 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7fa5b4091120 con 0x5650e8108020 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa5c61d6740 10 client.7497 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa5c61d6740 10 client.7497 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa5c61d6740 20 client.7497 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5650e8130480 0x5650e8130890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa5c61d6740 4 client.7497 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa5c61d6740 1 -- 172.21.15.79:0/38376763 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650e80545b0 con 0x5650e8130480 2024-06-10T00:21:57.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa5c1266640 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5650e8130480 0x5650e8130890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa5c1266640 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5650e8130480 0x5650e8130890 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79da630df9d29148 server_cookie=c834b1cb5639a387 in_seq=0 out_seq=0 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.339+0000 7fa597fff640 10 client.7497 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa597fff640 1 -- 172.21.15.79:0/38376763 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5650e80545b0 con 0x5650e8130480 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa597fff640 10 client.7497 handle_command_reply: tid=0 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 client.7497 shutdown 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 -- 172.21.15.79:0/38376763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 msgr2=0x5650e81084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e81084a0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40819e0 tx=0x7fa5b40799a0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 -- 172.21.15.79:0/38376763 shutdown_connections 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e81084a0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 0x5650e80efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5650e8130480 0x5650e8130890 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/38376763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8106af0 0x5650e810a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa597fff640 0 client.7497 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:57.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 -- 172.21.15.79:0/38376763 >> 172.21.15.79:0/38376763 conn(0x5650e80e56d0 msgr2=0x5650e8105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 -- 172.21.15.79:0/38376763 shutdown_connections 2024-06-10T00:21:57.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 1 -- 172.21.15.79:0/38376763 wait complete. 2024-06-10T00:21:57.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.340+0000 7fa5c61d6740 20 client.7497 trim_cache size 0 max 16384 2024-06-10T00:21:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.358+0000 7fa5c61d6740 1 Processor -- start 2024-06-10T00:21:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.358+0000 7fa5c61d6740 1 -- start start 2024-06-10T00:21:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e81020b0 0x5650e80dd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e8106af0 0x5650e80dd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e814c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5650e8142d90 con 0x5650e8108020 2024-06-10T00:21:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc201650 con 0x5650e81020b0 2024-06-10T00:21:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5bc200690 con 0x5650e8106af0 2024-06-10T00:21:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e814c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e814c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42074/0 (socket says 172.21.15.79:42074) 2024-06-10T00:21:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 -- 172.21.15.79:0/756577742 learned_addr learned my addr 172.21.15.79:0/756577742 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1266640 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e81020b0 0x5650e80dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e8106af0 0x5650e80dd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 -- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e8106af0 msgr2=0x5650e80dd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e8106af0 0x5650e80dd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 -- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e81020b0 msgr2=0x5650e80dd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e81020b0 0x5650e80dd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 -- 172.21.15.79:0/756577742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e7d1a0f0 con 0x5650e8108020 2024-06-10T00:21:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1266640 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e81020b0 0x5650e80dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:21:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e814c250 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4075700 tx=0x7fa5b4042070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8018b3f7ab3dfafb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa59e7fc640 1 -- 172.21.15.79:0/756577742 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40775a0 con 0x5650e8108020 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa59e7fc640 1 -- 172.21.15.79:0/756577742 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b402f030 con 0x5650e8108020 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.359+0000 7fa59e7fc640 1 -- 172.21.15.79:0/756577742 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4091120 con 0x5650e8108020 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 -- 172.21.15.79:0/756577742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 msgr2=0x5650e814c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e814c250 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4075700 tx=0x7fa5b4042070 comp rx=0 tx=0).stop 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 -- 172.21.15.79:0/756577742 shutdown_connections 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8108020 0x5650e814c250 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e8106af0 0x5650e80dd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/756577742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e81020b0 0x5650e80dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 -- 172.21.15.79:0/756577742 >> 172.21.15.79:0/756577742 conn(0x5650e80e56d0 msgr2=0x5650e80e0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 -- 172.21.15.79:0/756577742 shutdown_connections 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 -- 172.21.15.79:0/756577742 wait complete. 2024-06-10T00:21:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 -- start start 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.360+0000 7fa5c61d6740 1 Processor -- start 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 0x5650e814c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8106af0 0x5650e80e3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c61d6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8108020 0x5650e812dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc200040 con 0x5650e8106af0 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc0cf3b0 con 0x5650e8108020 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c61d6740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5650e804c190 con 0x5650e81020b0 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c61d6740 10 client.0 _ll_register_callbacks cb 0x7fa5b4078c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:21:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c0a65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8106af0 0x5650e80e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c0a65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8106af0 0x5650e80e3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42084/0 (socket says 172.21.15.79:42084) 2024-06-10T00:21:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.361+0000 7fa5c0a65640 1 -- 172.21.15.79:0/2668645202 learned_addr learned my addr 172.21.15.79:0/2668645202 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:21:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c1266640 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 0x5650e814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8108020 0x5650e812dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c0a65640 1 -- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 msgr2=0x5650e814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 0x5650e814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c0a65640 1 -- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8108020 msgr2=0x5650e812dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8108020 0x5650e812dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c0a65640 1 -- 172.21.15.79:0/2668645202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e800d560 con 0x5650e8106af0 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c1a67640 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8108020 0x5650e812dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c0a65640 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8106af0 0x5650e80e3560 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac005560 tx=0x7fa5ac001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e930a64b4d98ae server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa597fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa597fff640 1 -- 172.21.15.79:0/2668645202 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac014600 con 0x5650e8106af0 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa597fff640 1 -- 172.21.15.79:0/2668645202 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fa5ac0147a0 con 0x5650e8106af0 2024-06-10T00:21:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 1 -- 172.21.15.79:0/2668645202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5b402f030 con 0x5650e8106af0 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa597fff640 1 -- 172.21.15.79:0/2668645202 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fa5ac0149a0 con 0x5650e8106af0 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 10 client.7503 fetch_fsmap learned FSMap version 62 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 1 -- 172.21.15.79:0/2668645202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x5650e814ce80 con 0x5650e8106af0 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa597fff640 1 -- 172.21.15.79:0/2668645202 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b402f030 con 0x5650e8106af0 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa597fff640 1 -- 172.21.15.79:0/2668645202 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7fa5ac014b40 con 0x5650e8106af0 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 10 client.7503 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 10 client.7503 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 20 client.7503 populate_metadata read hostname 'smithi079' 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5650e80e44e0 0x5650e812e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 4 client.7503 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.362+0000 7fa5c61d6740 1 -- 172.21.15.79:0/2668645202 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5650e804e900 con 0x5650e80e44e0 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c1266640 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5650e80e44e0 0x5650e812e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:21:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa597fff640 10 client.7503 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c1266640 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5650e80e44e0 0x5650e812e220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=660abe0f7e5e8fe5 server_cookie=cf194856cd56d312 in_seq=0 out_seq=0 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa597fff640 1 -- 172.21.15.79:0/2668645202 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x5650e804e900 con 0x5650e80e44e0 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa597fff640 10 client.7503 handle_command_reply: tid=0 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 client.7503 shutdown 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 -- 172.21.15.79:0/2668645202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8106af0 msgr2=0x5650e80e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8106af0 0x5650e80e3560 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac005560 tx=0x7fa5ac001230 comp rx=0 tx=0).stop 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 -- 172.21.15.79:0/2668645202 shutdown_connections 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x5650e80e44e0 0x5650e812e220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5650e8108020 0x5650e812dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e8106af0 0x5650e80e3560 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa597fff640 0 client.7503 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 --2- 172.21.15.79:0/2668645202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5650e81020b0 0x5650e814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 -- 172.21.15.79:0/2668645202 >> 172.21.15.79:0/2668645202 conn(0x5650e80e56d0 msgr2=0x5650e8103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 -- 172.21.15.79:0/2668645202 shutdown_connections 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 1 -- 172.21.15.79:0/2668645202 wait complete. 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.363+0000 7fa5c61d6740 20 client.7503 trim_cache size 0 max 16384 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "61a1e692-6f5b-4f19-b523-62b7cf1b52c4": { 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/dir", 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "61a1e692-6f5b-4f19-b523-62b7cf1b52c4", 2024-06-10T00:21:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-06-10T00:21:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:21:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:21:57.376 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:21:57.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa5a006be60 msgr2=0x7fa5a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa5a006be60 0x7fa5a006e320 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009bc0 tx=0x7fa5b8008040 comp rx=0 tx=0).stop 2024-06-10T00:21:57.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5bc1467e0 msgr2=0x7fa5bc0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:21:57.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5bc1467e0 0x7fa5bc0cc610 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4000f80 tx=0x7fa5bc15be40 comp rx=0 tx=0).stop 2024-06-10T00:21:57.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1332565529 shutdown_connections 2024-06-10T00:21:57.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa5a006be60 0x7fa5a006e320 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5bc1467e0 0x7fa5bc0cc610 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc145fe0 0x7fa5bc15cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 --2- 172.21.15.79:0/1332565529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a8004d40 0x7fa5bc149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:21:57.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1332565529 >> 172.21.15.79:0/1332565529 conn(0x7fa5bc0b1d10 msgr2=0x7fa5bc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:21:57.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1332565529 shutdown_connections 2024-06-10T00:21:57.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:21:57.364+0000 7fa5c34ca640 1 -- 172.21.15.79:0/1332565529 wait complete. 2024-06-10T00:21:57.378 INFO:tasks.cephfs.filesystem:scrub status for tag:61a1e692-6f5b-4f19-b523-62b7cf1b52c4 - {'path': '/dir', 'tag': '61a1e692-6f5b-4f19-b523-62b7cf1b52c4', 'options': 'recursive,repair'} 2024-06-10T00:22:14.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:22:14.793 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:22:27.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:27.379 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-06-10T00:22:27.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.495+0000 7f4af2d42640 1 Processor -- start 2024-06-10T00:22:27.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.495+0000 7f4af2d42640 1 -- start start 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4af2d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 0x7f4aec0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4af2d42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4aec0b34e0 0x7f4aec0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4af2d42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aec155700 con 0x7f4aec0d0560 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4af2d42640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4aec15b6b0 con 0x7f4aec0b34e0 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4af2d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec15b990 con 0x7f4aec155320 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4ae3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4aec0b34e0 0x7f4aec0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4ae3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4aec0b34e0 0x7f4aec0d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54664/0 (socket says 172.21.15.79:54664) 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4ae3fff640 1 -- 172.21.15.79:0/2267420220 learned_addr learned my addr 172.21.15.79:0/2267420220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4ae3fff640 1 -- 172.21.15.79:0/2267420220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 msgr2=0x7f4aec0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4af0ade640 1 --2- 172.21.15.79:0/2267420220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 0x7f4aec0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/2267420220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 0x7f4aec0b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4ae3fff640 1 -- 172.21.15.79:0/2267420220 >> v1:172.21.15.117:6789/0 conn(0x7f4aec0d0560 legacy=0x7f4aec06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.496+0000 7f4ae3fff640 1 -- 172.21.15.79:0/2267420220 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec15bc70 con 0x7f4aec0b34e0 2024-06-10T00:22:27.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.497+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/2267420220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0b34e0 0x7f4aec0d0020 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009870 tx=0x7f4adc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acdb21ea19cce1d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.497+0000 7f4ae37fe640 1 -- 172.21.15.79:0/2267420220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc037070 con 0x7f4aec0b34e0 2024-06-10T00:22:27.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.497+0000 7f4ae37fe640 1 -- 172.21.15.79:0/2267420220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4adc032440 con 0x7f4aec0b34e0 2024-06-10T00:22:27.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.497+0000 7f4ae37fe640 1 -- 172.21.15.79:0/2267420220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc032810 con 0x7f4aec0b34e0 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.498+0000 7f4af2d42640 1 -- 172.21.15.79:0/2267420220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0b34e0 msgr2=0x7f4aec0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.498+0000 7f4af2d42640 1 --2- 172.21.15.79:0/2267420220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0b34e0 0x7f4aec0d0020 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009870 tx=0x7f4adc02a210 comp rx=0 tx=0).stop 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.498+0000 7f4af2d42640 1 -- 172.21.15.79:0/2267420220 shutdown_connections 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.498+0000 7f4af2d42640 1 --2- 172.21.15.79:0/2267420220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0b34e0 0x7f4aec0d0020 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.498+0000 7f4af2d42640 1 --2- 172.21.15.79:0/2267420220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 0x7f4aec0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.498+0000 7f4af2d42640 1 -- 172.21.15.79:0/2267420220 >> 172.21.15.79:0/2267420220 conn(0x7f4aec0b1d10 msgr2=0x7f4aec0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.498+0000 7f4af2d42640 1 -- 172.21.15.79:0/2267420220 shutdown_connections 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.498+0000 7f4af2d42640 1 -- 172.21.15.79:0/2267420220 wait complete. 2024-06-10T00:22:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.499+0000 7f4af2d42640 1 Processor -- start 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.499+0000 7f4af2d42640 1 -- start start 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4af2d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec0b34e0 0x7f4aec14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4af2d42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0d0560 0x7f4aec0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4af2d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 0x7f4aec0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4af2d42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec15b470 con 0x7f4aec0d0560 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4af2d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec15b2f0 con 0x7f4aec0b34e0 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4af2d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec06e900 con 0x7f4aec155320 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0d0560 0x7f4aec0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0d0560 0x7f4aec0cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54670/0 (socket says 172.21.15.79:54670) 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4ae3fff640 1 -- 172.21.15.79:0/753769328 learned_addr learned my addr 172.21.15.79:0/753769328 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4af0ade640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec0b34e0 0x7f4aec14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4af12df640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 0x7f4aec0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4ae3fff640 1 -- 172.21.15.79:0/753769328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 msgr2=0x7f4aec0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 0x7f4aec0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4ae3fff640 1 -- 172.21.15.79:0/753769328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec0b34e0 msgr2=0x7f4aec14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.500+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec0b34e0 0x7f4aec14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.501+0000 7f4ae3fff640 1 -- 172.21.15.79:0/753769328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec15d760 con 0x7f4aec0d0560 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.501+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0d0560 0x7f4aec0cefe0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009870 tx=0x7f4adc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.501+0000 7f4ae17fa640 1 -- 172.21.15.79:0/753769328 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc041020 con 0x7f4aec0d0560 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.501+0000 7f4ae17fa640 1 -- 172.21.15.79:0/753769328 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4adc030970 con 0x7f4aec0d0560 2024-06-10T00:22:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.501+0000 7f4ae17fa640 1 -- 172.21.15.79:0/753769328 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc037040 con 0x7f4aec0d0560 2024-06-10T00:22:27.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.501+0000 7f4af2d42640 1 -- 172.21.15.79:0/753769328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec15da40 con 0x7f4aec0d0560 2024-06-10T00:22:27.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.501+0000 7f4af2d42640 1 -- 172.21.15.79:0/753769328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec15e000 con 0x7f4aec0d0560 2024-06-10T00:22:27.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.502+0000 7f4ae17fa640 1 -- 172.21.15.79:0/753769328 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4adc044020 con 0x7f4aec0d0560 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.503+0000 7f4ae17fa640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ad806be60 0x7f4ad806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.503+0000 7f4af0ade640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ad806be60 0x7f4ad806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.503+0000 7f4ae17fa640 1 -- 172.21.15.79:0/753769328 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f4adc0ab620 con 0x7f4aec0d0560 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.504+0000 7f4af0ade640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ad806be60 0x7f4ad806e320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800aa20 tx=0x7f4ae8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.504+0000 7f4af5a4e740 1 Processor -- start 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.504+0000 7f4af5a4e740 1 -- start start 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f73120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f6e1a0 0x55ecc3f73660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f756d0 0x55ecc3f73ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3e987e0 con 0x55ecc3f756d0 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3ed6e80 con 0x55ecc3f96af0 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ecc3e74700 con 0x55ecc3f6e1a0 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f756d0 0x55ecc3f73ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f756d0 0x55ecc3f73ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54672/0 (socket says 172.21.15.79:54672) 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 -- 172.21.15.79:0/3612788628 learned_addr learned my addr 172.21.15.79:0/3612788628 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 -- 172.21.15.79:0/3612788628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f6e1a0 msgr2=0x55ecc3f73660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 --2- 172.21.15.79:0/3612788628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f6e1a0 0x55ecc3f73660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 -- 172.21.15.79:0/3612788628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 msgr2=0x55ecc3f73120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 --2- 172.21.15.79:0/3612788628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f73120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 -- 172.21.15.79:0/3612788628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3e93dd0 con 0x55ecc3f756d0 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4af12df640 1 --2- 172.21.15.79:0/3612788628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f756d0 0x55ecc3f73ba0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40056b0 tx=0x7f4ae400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2330120bfd87 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4ad27fc640 1 -- 172.21.15.79:0/3612788628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4018020 con 0x55ecc3f756d0 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.505+0000 7f4ad27fc640 1 -- 172.21.15.79:0/3612788628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae4014470 con 0x55ecc3f756d0 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4ad27fc640 1 -- 172.21.15.79:0/3612788628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4014840 con 0x55ecc3f756d0 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3612788628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f756d0 msgr2=0x55ecc3f73ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3612788628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f756d0 0x55ecc3f73ba0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40056b0 tx=0x7f4ae400f5a0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3612788628 shutdown_connections 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3612788628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f756d0 0x55ecc3f73ba0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3612788628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f6e1a0 0x55ecc3f73660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3612788628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f73120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3612788628 >> 172.21.15.79:0/3612788628 conn(0x55ecc3f70410 msgr2=0x55ecc3fb8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3612788628 shutdown_connections 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.506+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3612788628 wait complete. 2024-06-10T00:22:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.507+0000 7f4af5a4e740 1 -- start start 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.507+0000 7f4af5a4e740 1 Processor -- start 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f93160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f98c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3fbb0f0 0x55ecc3fbb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3e5f640 con 0x55ecc3f98860 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3ed2e40 con 0x55ecc3f96af0 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ecc3f71be0 con 0x55ecc3fbb0f0 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4af5a4e740 10 client.0 _ll_register_callbacks cb 0x55ecc3e91430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f98c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f98c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54674/0 (socket says 172.21.15.79:54674) 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 -- 172.21.15.79:0/3707499144 learned_addr learned my addr 172.21.15.79:0/3707499144 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 -- 172.21.15.79:0/3707499144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3fbb0f0 msgr2=0x55ecc3fbb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3fbb0f0 0x55ecc3fbb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 -- 172.21.15.79:0/3707499144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 msgr2=0x55ecc3f93160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f93160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 -- 172.21.15.79:0/3707499144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc3cb47d0 con 0x55ecc3f98860 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f98c40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f4adc075b30 tx=0x7f4adc079030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb69cb3a2f973060 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4acb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4acb7fe640 1 -- 172.21.15.79:0/3707499144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc082200 con 0x55ecc3f98860 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4acb7fe640 1 -- 172.21.15.79:0/3707499144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f4adc081d70 con 0x55ecc3f98860 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3707499144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae4014470 con 0x55ecc3f98860 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.508+0000 7f4acb7fe640 1 -- 172.21.15.79:0/3707499144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f4adc081f90 con 0x55ecc3f98860 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af5a4e740 10 client.7515 fetch_fsmap learned FSMap version 62 2024-06-10T00:22:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3707499144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55ecc3bea3f0 con 0x55ecc3f98860 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4acb7fe640 1 -- 172.21.15.79:0/3707499144 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae4014470 con 0x55ecc3f98860 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4acb7fe640 1 -- 172.21.15.79:0/3707499144 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7f4adc03a030 con 0x55ecc3f98860 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af5a4e740 10 client.7515 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af5a4e740 10 client.7515 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af5a4e740 20 client.7515 populate_metadata read hostname 'smithi079' 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55ecc3fc90b0 0x55ecc3fc9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af5a4e740 4 client.7515 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3707499144 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecc3ee45b0 con 0x55ecc3fc90b0 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af0ade640 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55ecc3fc90b0 0x55ecc3fc9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4acb7fe640 10 client.7515 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.509+0000 7f4af0ade640 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55ecc3fc90b0 0x55ecc3fc9510 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b84530b5abf000d1 server_cookie=1f4c4a0f95f3fa62 in_seq=0 out_seq=0 2024-06-10T00:22:27.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4acb7fe640 1 -- 172.21.15.79:0/3707499144 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ecc3ee45b0 con 0x55ecc3fc90b0 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4acb7fe640 10 client.7515 handle_command_reply: tid=0 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 client.7515 shutdown 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3707499144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 msgr2=0x55ecc3f98c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f98c40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f4adc075b30 tx=0x7f4adc079030 comp rx=0 tx=0).stop 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3707499144 shutdown_connections 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3fbb0f0 0x55ecc3fbb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f98c40 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55ecc3fc90b0 0x55ecc3fc9510 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/3707499144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f93160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4acb7fe640 0 client.7515 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3707499144 >> 172.21.15.79:0/3707499144 conn(0x55ecc3f756d0 msgr2=0x55ecc3f95dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3707499144 shutdown_connections 2024-06-10T00:22:27.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 1 -- 172.21.15.79:0/3707499144 wait complete. 2024-06-10T00:22:27.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.510+0000 7f4af5a4e740 20 client.7515 trim_cache size 0 max 16384 2024-06-10T00:22:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.528+0000 7f4af5a4e740 1 Processor -- start 2024-06-10T00:22:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.528+0000 7f4af5a4e740 1 -- start start 2024-06-10T00:22:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f72090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f6d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3fbb0f0 0x55ecc3f6d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1fefa0 con 0x55ecc3f98860 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1fdfc0 con 0x55ecc3f96af0 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec1f2a20 con 0x55ecc3fbb0f0 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f6d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f6d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54684/0 (socket says 172.21.15.79:54684) 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4ae3fff640 1 -- 172.21.15.79:0/2518281117 learned_addr learned my addr 172.21.15.79:0/2518281117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4ae3fff640 1 -- 172.21.15.79:0/2518281117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3fbb0f0 msgr2=0x55ecc3f6d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/2518281117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3fbb0f0 0x55ecc3f6d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4ae3fff640 1 -- 172.21.15.79:0/2518281117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 msgr2=0x55ecc3f72090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.529+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/2518281117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f72090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4ae3fff640 1 -- 172.21.15.79:0/2518281117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3baa0f0 con 0x55ecc3f98860 2024-06-10T00:22:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/2518281117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f6d110 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4adc079660 tx=0x7f4adc008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac39c6075945857 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4ad1ffb640 1 -- 172.21.15.79:0/2518281117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc095070 con 0x55ecc3f98860 2024-06-10T00:22:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4ad1ffb640 1 -- 172.21.15.79:0/2518281117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4adc030d60 con 0x55ecc3f98860 2024-06-10T00:22:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4ad1ffb640 1 -- 172.21.15.79:0/2518281117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc082200 con 0x55ecc3f98860 2024-06-10T00:22:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 -- 172.21.15.79:0/2518281117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 msgr2=0x55ecc3f6d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/2518281117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f6d110 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4adc079660 tx=0x7f4adc008000 comp rx=0 tx=0).stop 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 -- 172.21.15.79:0/2518281117 shutdown_connections 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/2518281117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3fbb0f0 0x55ecc3f6d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/2518281117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3f6d110 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/2518281117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3f96af0 0x55ecc3f72090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 -- 172.21.15.79:0/2518281117 >> 172.21.15.79:0/2518281117 conn(0x55ecc3f756d0 msgr2=0x55ecc3f70fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 -- 172.21.15.79:0/2518281117 shutdown_connections 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.530+0000 7f4af5a4e740 1 -- 172.21.15.79:0/2518281117 wait complete. 2024-06-10T00:22:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.531+0000 7f4af5a4e740 1 -- start start 2024-06-10T00:22:27.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.531+0000 7f4af5a4e740 1 Processor -- start 2024-06-10T00:22:27.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f96af0 0x55ecc3fbc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3fbc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af5a4e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3fbb0f0 0x55ecc3f94210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3f70200 con 0x55ecc3f98860 2024-06-10T00:22:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1fd970 con 0x55ecc3fbb0f0 2024-06-10T00:22:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af5a4e740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ecc3f74780 con 0x55ecc3f96af0 2024-06-10T00:22:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af5a4e740 10 client.0 _ll_register_callbacks cb 0x7f4adc006cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:22:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3fbc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3fbc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54696/0 (socket says 172.21.15.79:54696) 2024-06-10T00:22:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 -- 172.21.15.79:0/1148298753 learned_addr learned my addr 172.21.15.79:0/1148298753 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af12df640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3fbb0f0 0x55ecc3f94210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af0ade640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f96af0 0x55ecc3fbc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 -- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f96af0 msgr2=0x55ecc3fbc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f96af0 0x55ecc3fbc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 -- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3fbb0f0 msgr2=0x55ecc3f94210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3fbb0f0 0x55ecc3f94210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 -- 172.21.15.79:0/1148298753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc3e9d560 con 0x55ecc3f98860 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af12df640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3fbb0f0 0x55ecc3f94210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4af0ade640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f96af0 0x55ecc3fbc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4ae3fff640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3fbc740 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f4adc075b30 tx=0x7f4adc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cc68539e7a2cba server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.532+0000 7f4acb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4acb7fe640 1 -- 172.21.15.79:0/1148298753 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc09d020 con 0x55ecc3f98860 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4acb7fe640 1 -- 172.21.15.79:0/1148298753 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f4adc075630 con 0x55ecc3f98860 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 1 -- 172.21.15.79:0/1148298753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4adc030d60 con 0x55ecc3f98860 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4acb7fe640 1 -- 172.21.15.79:0/1148298753 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f4adc095030 con 0x55ecc3f98860 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 10 client.7521 fetch_fsmap learned FSMap version 62 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 1 -- 172.21.15.79:0/1148298753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55ecc3e9d560 con 0x55ecc3f98860 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4acb7fe640 1 -- 172.21.15.79:0/1148298753 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4adc030d60 con 0x55ecc3f98860 2024-06-10T00:22:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4acb7fe640 1 -- 172.21.15.79:0/1148298753 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7f4adc08dab0 con 0x55ecc3f98860 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 10 client.7521 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 10 client.7521 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 20 client.7521 populate_metadata read hostname 'smithi079' 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55ecc3f954a0 0x55ecc3f94750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 4 client.7521 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af5a4e740 1 -- 172.21.15.79:0/1148298753 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ecc3ede900 con 0x55ecc3f954a0 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af0ade640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55ecc3f954a0 0x55ecc3f94750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4acb7fe640 10 client.7521 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.533+0000 7f4af0ade640 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55ecc3f954a0 0x55ecc3f94750 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f9595f30cfb1011 server_cookie=8d849748c1c03129 in_seq=0 out_seq=0 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4acb7fe640 1 -- 172.21.15.79:0/1148298753 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ecc3ede900 con 0x55ecc3f954a0 2024-06-10T00:22:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4acb7fe640 10 client.7521 handle_command_reply: tid=0 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 client.7521 shutdown 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 -- 172.21.15.79:0/1148298753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 msgr2=0x55ecc3fbc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3fbc740 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f4adc075b30 tx=0x7f4adc007000 comp rx=0 tx=0).stop 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 -- 172.21.15.79:0/1148298753 shutdown_connections 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55ecc3f954a0 0x55ecc3f94750 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc3fbb0f0 0x55ecc3f94210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ecc3f98860 0x55ecc3fbc740 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4acb7fe640 0 client.7521 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 --2- 172.21.15.79:0/1148298753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecc3f96af0 0x55ecc3fbc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 -- 172.21.15.79:0/1148298753 >> 172.21.15.79:0/1148298753 conn(0x55ecc3f756d0 msgr2=0x55ecc3f72090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 -- 172.21.15.79:0/1148298753 shutdown_connections 2024-06-10T00:22:27.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 1 -- 172.21.15.79:0/1148298753 wait complete. 2024-06-10T00:22:27.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af5a4e740 20 client.7521 trim_cache size 0 max 16384 2024-06-10T00:22:27.543 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:22:27.543 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:22:27.543 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:22:27.543 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af2d42640 1 -- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ad806be60 msgr2=0x7f4ad806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af2d42640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ad806be60 0x7f4ad806e320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800aa20 tx=0x7f4ae8008040 comp rx=0 tx=0).stop 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af2d42640 1 -- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0d0560 msgr2=0x7f4aec0cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.534+0000 7f4af2d42640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0d0560 0x7f4aec0cefe0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009870 tx=0x7f4adc0046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.535+0000 7f4af2d42640 1 -- 172.21.15.79:0/753769328 shutdown_connections 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.535+0000 7f4af2d42640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ad806be60 0x7f4ad806e320 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.535+0000 7f4af2d42640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aec155320 0x7f4aec0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.535+0000 7f4af2d42640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec0d0560 0x7f4aec0cefe0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.535+0000 7f4af2d42640 1 --2- 172.21.15.79:0/753769328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec0b34e0 0x7f4aec14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.535+0000 7f4af2d42640 1 -- 172.21.15.79:0/753769328 >> 172.21.15.79:0/753769328 conn(0x7f4aec0b1d10 msgr2=0x7f4aec0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.535+0000 7f4af2d42640 1 -- 172.21.15.79:0/753769328 shutdown_connections 2024-06-10T00:22:27.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.535+0000 7f4af2d42640 1 -- 172.21.15.79:0/753769328 wait complete. 2024-06-10T00:22:27.546 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:22:27.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:27.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.645+0000 7fd52b3ee640 1 Processor -- start 2024-06-10T00:22:27.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.645+0000 7fd52b3ee640 1 -- start start 2024-06-10T00:22:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52b3ee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5241553c0 0x7fd5240cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52b3ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5240cec50 0x7fd5240cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52b3ee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5240b31a0 con 0x7fd5240b2cf0 2024-06-10T00:22:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52b3ee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd5240b3420 con 0x7fd5241553c0 2024-06-10T00:22:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52b3ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5240cc750 con 0x7fd5240cec50 2024-06-10T00:22:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52918a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5241553c0 0x7fd5240cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52998b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5240cec50 0x7fd5240cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52918a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5241553c0 0x7fd5240cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:44744/0 (socket says 172.21.15.79:44744) 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52918a640 1 -- 172.21.15.79:0/1017314682 learned_addr learned my addr 172.21.15.79:0/1017314682 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52998b640 1 --2- 172.21.15.79:0/1017314682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5240cec50 0x7fd5240cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:58836/0 (socket says 172.21.15.79:58836) 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52918a640 1 -- 172.21.15.79:0/1017314682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5240cec50 msgr2=0x7fd5240cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52918a640 1 --2- 172.21.15.79:0/1017314682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5240cec50 0x7fd5240cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52918a640 1 -- 172.21.15.79:0/1017314682 >> v1:172.21.15.117:6789/0 conn(0x7fd5240b2cf0 legacy=0x7fd52415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.646+0000 7fd52918a640 1 -- 172.21.15.79:0/1017314682 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5240cca30 con 0x7fd5241553c0 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.647+0000 7fd52918a640 1 --2- 172.21.15.79:0/1017314682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5241553c0 0x7fd5240cd230 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd520009870 tx=0x7fd52002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f2b789d816bd22 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.647+0000 7fd517fff640 1 -- 172.21.15.79:0/1017314682 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520037070 con 0x7fd5241553c0 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.647+0000 7fd517fff640 1 -- 172.21.15.79:0/1017314682 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd520032440 con 0x7fd5241553c0 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.647+0000 7fd517fff640 1 -- 172.21.15.79:0/1017314682 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520032810 con 0x7fd5241553c0 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.648+0000 7fd52b3ee640 1 -- 172.21.15.79:0/1017314682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5241553c0 msgr2=0x7fd5240cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.648+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/1017314682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5241553c0 0x7fd5240cd230 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd520009870 tx=0x7fd52002a270 comp rx=0 tx=0).stop 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.648+0000 7fd52b3ee640 1 -- 172.21.15.79:0/1017314682 shutdown_connections 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.648+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/1017314682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5240cec50 0x7fd5240cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.648+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/1017314682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5241553c0 0x7fd5240cd230 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.648+0000 7fd52b3ee640 1 -- 172.21.15.79:0/1017314682 >> 172.21.15.79:0/1017314682 conn(0x7fd5240b19f0 msgr2=0x7fd5240b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.648+0000 7fd52b3ee640 1 -- 172.21.15.79:0/1017314682 shutdown_connections 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.648+0000 7fd52b3ee640 1 -- 172.21.15.79:0/1017314682 wait complete. 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.649+0000 7fd52b3ee640 1 Processor -- start 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.649+0000 7fd52b3ee640 1 -- start start 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52b3ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5240b2cf0 0x7fd524149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52b3ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5240cec50 0x7fd524147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52b3ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5241553c0 0x7fd524071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52b3ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd5241557a0 con 0x7fd5240b2cf0 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52b3ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5240b3700 con 0x7fd5240cec50 2024-06-10T00:22:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52b3ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd524155920 con 0x7fd5241553c0 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5240b2cf0 0x7fd524149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5240b2cf0 0x7fd524149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54708/0 (socket says 172.21.15.79:54708) 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 -- 172.21.15.79:0/3768166424 learned_addr learned my addr 172.21.15.79:0/3768166424 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52998b640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5241553c0 0x7fd524071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd528989640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5240cec50 0x7fd524147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 -- 172.21.15.79:0/3768166424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5241553c0 msgr2=0x7fd524071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5241553c0 0x7fd524071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 -- 172.21.15.79:0/3768166424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5240cec50 msgr2=0x7fd524147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5240cec50 0x7fd524147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 -- 172.21.15.79:0/3768166424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd524072c50 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52918a640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5240b2cf0 0x7fd524149b50 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd520000c00 tx=0x7fd5200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd515ffb640 1 -- 172.21.15.79:0/3768166424 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520037040 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd515ffb640 1 -- 172.21.15.79:0/3768166424 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd520042070 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd524166c00 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.650+0000 7fd515ffb640 1 -- 172.21.15.79:0/3768166424 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520030860 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.651+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5240731d0 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.652+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd524068430 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.652+0000 7fd515ffb640 1 -- 172.21.15.79:0/3768166424 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd520030a00 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.652+0000 7fd515ffb640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd50806be30 0x7fd50806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.653+0000 7fd515ffb640 1 -- 172.21.15.79:0/3768166424 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fd5200ab9d0 con 0x7fd5240b2cf0 2024-06-10T00:22:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.653+0000 7fd528989640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd50806be30 0x7fd50806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.653+0000 7fd528989640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd50806be30 0x7fd50806e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd5241f71c0 tx=0x7fd518009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.657+0000 7fd515ffb640 1 -- 172.21.15.79:0/3768166424 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd520045360 con 0x7fd5240b2cf0 2024-06-10T00:22:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.867+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd524075430 con 0x7fd5240b2cf0 2024-06-10T00:22:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.867+0000 7fd515ffb640 1 -- 172.21.15.79:0/3768166424 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5190 (secure 0 0 0) 0x7fd52007a0d0 con 0x7fd5240b2cf0 2024-06-10T00:22:27.867 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:27.867 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:21:54.167947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6836/2006151468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2006151468},{"type":"v1","addr":"172.21.15.79:6836","nonce":2006151468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-06-10T00:22:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 62 2024-06-10T00:22:27.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd50806be30 msgr2=0x7fd50806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd50806be30 0x7fd50806e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd5241f71c0 tx=0x7fd518009040 comp rx=0 tx=0).stop 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5240b2cf0 msgr2=0x7fd524149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5240b2cf0 0x7fd524149b50 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd520000c00 tx=0x7fd5200046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 shutdown_connections 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd50806be30 0x7fd50806e2f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5241553c0 0x7fd524071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5240cec50 0x7fd524147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 --2- 172.21.15.79:0/3768166424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5240b2cf0 0x7fd524149b50 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 >> 172.21.15.79:0/3768166424 conn(0x7fd5240b19f0 msgr2=0x7fd5240acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 shutdown_connections 2024-06-10T00:22:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.870+0000 7fd52b3ee640 1 -- 172.21.15.79:0/3768166424 wait complete. 2024-06-10T00:22:27.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-06-10T00:22:27.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.980+0000 7f358c6fc640 1 Processor -- start 2024-06-10T00:22:27.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.980+0000 7f358c6fc640 1 -- start start 2024-06-10T00:22:27.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.981+0000 7f358c6fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f35840d08f0 0x7f35840b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.981+0000 7f358c6fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35840d0cd0 0x7f35840cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.981+0000 7f358c6fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 0x7f35840d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.981+0000 7f358c6fc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f35840d1c80 con 0x7f35840d0cd0 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.981+0000 7f358c6fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f35840cf620 con 0x7f35840d08f0 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.981+0000 7f358c6fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35840cf8a0 con 0x7f35840cf190 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f3589c97640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35840d0cd0 0x7f35840cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f3589c97640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35840d0cd0 0x7f35840cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35358/0 (socket says 172.21.15.79:35358) 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f3589c97640 1 -- 172.21.15.79:0/481918628 learned_addr learned my addr 172.21.15.79:0/481918628 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f358a498640 1 --2- 172.21.15.79:0/481918628 >> v2:172.21.15.117:3300/0 conn(0x7f35840d08f0 0x7f35840b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f358ac99640 1 --2- 172.21.15.79:0/481918628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 0x7f35840d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f3589c97640 1 -- 172.21.15.79:0/481918628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 msgr2=0x7f35840d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f3589c97640 1 --2- 172.21.15.79:0/481918628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 0x7f35840d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f3589c97640 1 -- 172.21.15.79:0/481918628 >> v2:172.21.15.117:3300/0 conn(0x7f35840d08f0 msgr2=0x7f35840b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f3589c97640 1 --2- 172.21.15.79:0/481918628 >> v2:172.21.15.117:3300/0 conn(0x7f35840d08f0 0x7f35840b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f3589c97640 1 -- 172.21.15.79:0/481918628 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35840cfb80 con 0x7f35840d0cd0 2024-06-10T00:22:27.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.982+0000 7f358a498640 1 --2- 172.21.15.79:0/481918628 >> v2:172.21.15.117:3300/0 conn(0x7f35840d08f0 0x7f35840b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:27.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f3589c97640 1 --2- 172.21.15.79:0/481918628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d0cd0 0x7f35840cec50 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3578009870 tx=0x7f357802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c006c420f854a85a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f3589496640 1 -- 172.21.15.79:0/481918628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578037070 con 0x7f35840d0cd0 2024-06-10T00:22:27.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f3589496640 1 -- 172.21.15.79:0/481918628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578032440 con 0x7f35840d0cd0 2024-06-10T00:22:27.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f3589496640 1 -- 172.21.15.79:0/481918628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578032810 con 0x7f35840d0cd0 2024-06-10T00:22:27.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 -- 172.21.15.79:0/481918628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d0cd0 msgr2=0x7f35840cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 --2- 172.21.15.79:0/481918628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d0cd0 0x7f35840cec50 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3578009870 tx=0x7f357802a210 comp rx=0 tx=0).stop 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 -- 172.21.15.79:0/481918628 shutdown_connections 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 --2- 172.21.15.79:0/481918628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 0x7f35840d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 --2- 172.21.15.79:0/481918628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d0cd0 0x7f35840cec50 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 --2- 172.21.15.79:0/481918628 >> v2:172.21.15.117:3300/0 conn(0x7f35840d08f0 0x7f35840b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 -- 172.21.15.79:0/481918628 >> 172.21.15.79:0/481918628 conn(0x7f358409d3c0 msgr2=0x7f35840d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 -- 172.21.15.79:0/481918628 shutdown_connections 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.983+0000 7f358c6fc640 1 -- 172.21.15.79:0/481918628 wait complete. 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f358c6fc640 1 Processor -- start 2024-06-10T00:22:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f358c6fc640 1 -- start start 2024-06-10T00:22:27.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f358c6fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 0x7f3584152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f358c6fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d08f0 0x7f35840cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f358c6fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35840d0cd0 0x7f35840c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f358c6fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35840b50c0 con 0x7f35840d08f0 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f358c6fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35840d1ed0 con 0x7f35840d0cd0 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f358c6fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35840d1180 con 0x7f35840cf190 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f3589c97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d08f0 0x7f35840cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f3589c97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d08f0 0x7f35840cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35360/0 (socket says 172.21.15.79:35360) 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.985+0000 7f3589c97640 1 -- 172.21.15.79:0/3442961433 learned_addr learned my addr 172.21.15.79:0/3442961433 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f358a498640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 0x7f3584152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3589c97640 1 -- 172.21.15.79:0/3442961433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 msgr2=0x7f3584152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3589c97640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 0x7f3584152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3589c97640 1 -- 172.21.15.79:0/3442961433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35840d0cd0 msgr2=0x7f35840c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3589c97640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35840d0cd0 0x7f35840c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3589c97640 1 -- 172.21.15.79:0/3442961433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35840c8510 con 0x7f35840d08f0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3589c97640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d08f0 0x7f35840cc6d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f357802a250 tx=0x7f35780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3582ffd640 1 -- 172.21.15.79:0/3442961433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578041020 con 0x7f35840d08f0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3582ffd640 1 -- 172.21.15.79:0/3442961433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35780306e0 con 0x7f35840d08f0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f3582ffd640 1 -- 172.21.15.79:0/3442961433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578037040 con 0x7f35840d08f0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f358c6fc640 1 -- 172.21.15.79:0/3442961433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35840c87f0 con 0x7f35840d08f0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.986+0000 7f358c6fc640 1 -- 172.21.15.79:0/3442961433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35840c8fe0 con 0x7f35840d08f0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.987+0000 7f3582ffd640 1 -- 172.21.15.79:0/3442961433 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3578044020 con 0x7f35840d08f0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.988+0000 7f3582ffd640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f357006be30 0x7f357006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.988+0000 7f3582ffd640 1 -- 172.21.15.79:0/3442961433 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f35780ab970 con 0x7f35840d08f0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.988+0000 7f358a498640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f357006be30 0x7f357006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.988+0000 7f358a498640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f357006be30 0x7f357006e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3574009ed0 tx=0x7f357400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.989+0000 7f358f407740 1 Processor -- start 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.989+0000 7f358f407740 1 -- start start 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f358f407740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 0x55d03498d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f358f407740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349bd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f358f407740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349bda00 0x55d034992810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f358f407740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d0348f6d80 con 0x55d0349be140 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f358f407740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d0348942f0 con 0x55d0349bda00 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f358f407740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d0348f2d40 con 0x55d0349db020 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349bd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349bd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35370/0 (socket says 172.21.15.79:35370) 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 -- 172.21.15.79:0/2942523155 learned_addr learned my addr 172.21.15.79:0/2942523155 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 -- 172.21.15.79:0/2942523155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 msgr2=0x55d03498d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 --2- 172.21.15.79:0/2942523155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 0x55d03498d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 -- 172.21.15.79:0/2942523155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349bda00 msgr2=0x55d034992810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 --2- 172.21.15.79:0/2942523155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349bda00 0x55d034992810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 -- 172.21.15.79:0/2942523155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0346d67c0 con 0x55d0349be140 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f3589c97640 1 --2- 172.21.15.79:0/2942523155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349bd4c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f35780a9b30 tx=0x7f3578079390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad83769e6deb39c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f356bfff640 1 -- 172.21.15.79:0/2942523155 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357807dd20 con 0x55d0349be140 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f356bfff640 1 -- 172.21.15.79:0/2942523155 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578082550 con 0x55d0349be140 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.990+0000 7f356bfff640 1 -- 172.21.15.79:0/2942523155 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578077c70 con 0x55d0349be140 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 -- 172.21.15.79:0/2942523155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 msgr2=0x55d0349bd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 --2- 172.21.15.79:0/2942523155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349bd4c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f35780a9b30 tx=0x7f3578079390 comp rx=0 tx=0).stop 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 -- 172.21.15.79:0/2942523155 shutdown_connections 2024-06-10T00:22:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 --2- 172.21.15.79:0/2942523155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349bda00 0x55d034992810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 --2- 172.21.15.79:0/2942523155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349bd4c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 --2- 172.21.15.79:0/2942523155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 0x55d03498d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 -- 172.21.15.79:0/2942523155 >> 172.21.15.79:0/2942523155 conn(0x55d03498fc20 msgr2=0x55d0349d84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 -- 172.21.15.79:0/2942523155 shutdown_connections 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 -- 172.21.15.79:0/2942523155 wait complete. 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.991+0000 7f358f407740 1 -- start start 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.992+0000 7f358f407740 1 Processor -- start 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.992+0000 7f358f407740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349da480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.992+0000 7f358f407740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349db020 0x55d0349d84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.992+0000 7f358f407740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.992+0000 7f358f407740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d0348942f0 con 0x55d0349db020 2024-06-10T00:22:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.992+0000 7f358f407740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d034891da0 con 0x55d0349be140 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.992+0000 7f358f407740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d0348f6d80 con 0x55d0349c0750 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f358f407740 10 client.0 _ll_register_callbacks cb 0x55d034609ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349db020 0x55d0349d84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349db020 0x55d0349d84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35378/0 (socket says 172.21.15.79:35378) 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 -- 172.21.15.79:0/3114389453 learned_addr learned my addr 172.21.15.79:0/3114389453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f358a498640 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f358ac99640 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 -- 172.21.15.79:0/3114389453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 msgr2=0x55d0349c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349c0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 -- 172.21.15.79:0/3114389453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 msgr2=0x55d0349da480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349da480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 -- 172.21.15.79:0/3114389453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d034736f50 con 0x55d0349db020 2024-06-10T00:22:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f3589c97640 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349db020 0x55d0349d84c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f35780a9c40 tx=0x7f3578000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7155c447263cce05 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f35697fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f35697fa640 1 -- 172.21.15.79:0/3114389453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578080070 con 0x55d0349db020 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f35697fa640 1 -- 172.21.15.79:0/3114389453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f3578080210 con 0x55d0349db020 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f358f407740 1 -- 172.21.15.79:0/3114389453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3578082550 con 0x55d0349db020 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f35697fa640 1 -- 172.21.15.79:0/3114389453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3578091bd0 con 0x55d0349db020 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f358f407740 10 client.7536 fetch_fsmap learned FSMap version 62 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f358f407740 1 -- 172.21.15.79:0/3114389453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55d0345ca0b0 con 0x55d0349db020 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f35697fa640 1 -- 172.21.15.79:0/3114389453 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578082550 con 0x55d0349db020 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f35697fa640 1 -- 172.21.15.79:0/3114389453 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7f357803a030 con 0x55d0349db020 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.993+0000 7f358f407740 10 client.7536 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f358f407740 10 client.7536 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f358f407740 20 client.7536 populate_metadata read hostname 'smithi079' 2024-06-10T00:22:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f358f407740 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55d0349bf430 0x55d0349bf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f358f407740 4 client.7536 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f358f407740 1 -- 172.21.15.79:0/3114389453 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0349044b0 con 0x55d0349bf430 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f358a498640 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55d0349bf430 0x55d0349bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f35697fa640 10 client.7536 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f358a498640 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55d0349bf430 0x55d0349bf810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c13b5aeb3ad7d3a server_cookie=5d4dd38d4bc1f5b5 in_seq=0 out_seq=0 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.994+0000 7f35697fa640 1 -- 172.21.15.79:0/3114389453 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d0349044b0 con 0x55d0349bf430 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f35697fa640 10 client.7536 handle_command_reply: tid=0 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 client.7536 shutdown 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 -- 172.21.15.79:0/3114389453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349db020 msgr2=0x55d0349d84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349db020 0x55d0349d84c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f35780a9c40 tx=0x7f3578000bc0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 -- 172.21.15.79:0/3114389453 shutdown_connections 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349db020 0x55d0349d84c0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55d0349bf430 0x55d0349bf810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 --2- 172.21.15.79:0/3114389453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349da480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f35697fa640 0 client.7536 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:22:28.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 -- 172.21.15.79:0/3114389453 >> 172.21.15.79:0/3114389453 conn(0x55d0349bda00 msgr2=0x55d03498cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:28.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 -- 172.21.15.79:0/3114389453 shutdown_connections 2024-06-10T00:22:28.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 1 -- 172.21.15.79:0/3114389453 wait complete. 2024-06-10T00:22:28.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:27.995+0000 7f358f407740 20 client.7536 trim_cache size 0 max 16384 2024-06-10T00:22:28.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358f407740 1 Processor -- start 2024-06-10T00:22:28.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358f407740 1 -- start start 2024-06-10T00:22:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358f407740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349d8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358f407740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358f407740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349db020 0x55d0349bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358f407740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3584200320 con 0x55d0349be140 2024-06-10T00:22:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358f407740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35840ca330 con 0x55d0349db020 2024-06-10T00:22:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358f407740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35840ca980 con 0x55d0349c0750 2024-06-10T00:22:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358a498640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358a498640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349d8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35388/0 (socket says 172.21.15.79:35388) 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.009+0000 7f358a498640 1 -- 172.21.15.79:0/3947652492 learned_addr learned my addr 172.21.15.79:0/3947652492 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f3589c97640 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358ac99640 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349db020 0x55d0349bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358a498640 1 -- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 msgr2=0x55d0349b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358a498640 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349b9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358a498640 1 -- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349db020 msgr2=0x55d0349bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358a498640 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349db020 0x55d0349bc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358a498640 1 -- 172.21.15.79:0/3947652492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0349c0f40 con 0x55d0349be140 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f3589c97640 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358ac99640 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349db020 0x55d0349bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:28.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358a498640 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349d8520 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f3574009760 tx=0x7f3574011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27b9fe03a8e8a9b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f356b7fe640 1 -- 172.21.15.79:0/3947652492 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574003990 con 0x55d0349be140 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f356b7fe640 1 -- 172.21.15.79:0/3947652492 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574003b30 con 0x55d0349be140 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f356b7fe640 1 -- 172.21.15.79:0/3947652492 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574003d00 con 0x55d0349be140 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358f407740 1 -- 172.21.15.79:0/3947652492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 msgr2=0x55d0349d8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358f407740 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349d8520 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f3574009760 tx=0x7f3574011000 comp rx=0 tx=0).stop 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358f407740 1 -- 172.21.15.79:0/3947652492 shutdown_connections 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358f407740 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349db020 0x55d0349bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358f407740 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349c0750 0x55d0349b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358f407740 1 --2- 172.21.15.79:0/3947652492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349be140 0x55d0349d8520 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.010+0000 7f358f407740 1 -- 172.21.15.79:0/3947652492 >> 172.21.15.79:0/3947652492 conn(0x55d0349bda00 msgr2=0x55d0349da290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.011+0000 7f358f407740 1 -- 172.21.15.79:0/3947652492 shutdown_connections 2024-06-10T00:22:28.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.011+0000 7f358f407740 1 -- 172.21.15.79:0/3947652492 wait complete. 2024-06-10T00:22:28.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.011+0000 7f358f407740 1 -- start start 2024-06-10T00:22:28.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.011+0000 7f358f407740 1 Processor -- start 2024-06-10T00:22:28.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358f407740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349c0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358f407740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349c0750 0x55d034a3c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358f407740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 0x55d0349db740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358f407740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d0348942f0 con 0x55d0349c0750 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358f407740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d0349c1110 con 0x55d0349be140 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358f407740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d034891da0 con 0x55d0349db020 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358f407740 10 client.0 _ll_register_callbacks cb 0x7f3578091070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f3589c97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349c0750 0x55d034a3c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f3589c97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349c0750 0x55d034a3c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35398/0 (socket says 172.21.15.79:35398) 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f3589c97640 1 -- 172.21.15.79:0/1712845836 learned_addr learned my addr 172.21.15.79:0/1712845836 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358ac99640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 0x55d0349db740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358a498640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f3589c97640 1 -- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 msgr2=0x55d0349db740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f3589c97640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 0x55d0349db740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f3589c97640 1 -- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 msgr2=0x55d0349c0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:28.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f3589c97640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349c0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f3589c97640 1 -- 172.21.15.79:0/1712845836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0349ce820 con 0x55d0349c0750 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358ac99640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 0x55d0349db740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.012+0000 7f358a498640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349c0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f3589c97640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349c0750 0x55d034a3c920 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f3578082350 tx=0x7f3578075c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b1c511cb3e93c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f35697fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f35697fa640 1 -- 172.21.15.79:0/1712845836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578082550 con 0x55d0349c0750 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f35697fa640 1 -- 172.21.15.79:0/1712845836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f3578047d60 con 0x55d0349c0750 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 1 -- 172.21.15.79:0/1712845836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3574003b30 con 0x55d0349c0750 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f35697fa640 1 -- 172.21.15.79:0/1712845836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f357809d020 con 0x55d0349c0750 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 10 client.7542 fetch_fsmap learned FSMap version 62 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 1 -- 172.21.15.79:0/1712845836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55d0349ce820 con 0x55d0349c0750 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f35697fa640 1 -- 172.21.15.79:0/1712845836 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574003b30 con 0x55d0349c0750 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f35697fa640 1 -- 172.21.15.79:0/1712845836 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 3494+0+0 (secure 0 0 0) 0x7f3578078dc0 con 0x55d0349c0750 2024-06-10T00:22:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 10 client.7542 fetch_fsmap finished waiting for FSMap version 62 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 10 client.7542 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 20 client.7542 populate_metadata read hostname 'smithi079' 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55d034a5a9f0 0x55d0349ea660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 4 client.7542 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358f407740 1 -- 172.21.15.79:0/1712845836 --> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55d0348fe800 con 0x55d034a5a9f0 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358a498640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55d034a5a9f0 0x55d0349ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f35697fa640 10 client.7542 ms_handle_connect on v2:172.21.15.79:6834/2006151468 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.013+0000 7f358a498640 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55d034a5a9f0 0x55d0349ea660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e347f6f78631c550 server_cookie=7331808fa11a5662 in_seq=0 out_seq=0 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f35697fa640 1 -- 172.21.15.79:0/1712845836 <== mds.0 v2:172.21.15.79:6834/2006151468 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0348fe800 con 0x55d034a5a9f0 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f35697fa640 10 client.7542 handle_command_reply: tid=0 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 client.7542 shutdown 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 -- 172.21.15.79:0/1712845836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349c0750 msgr2=0x55d034a3c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349c0750 0x55d034a3c920 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f3578082350 tx=0x7f3578075c10 comp rx=0 tx=0).stop 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 -- 172.21.15.79:0/1712845836 shutdown_connections 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d0349db020 0x55d0349db740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0349c0750 0x55d034a3c920 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.79:6834/2006151468,v1:172.21.15.79:6836/2006151468] conn(0x55d034a5a9f0 0x55d0349ea660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 --2- 172.21.15.79:0/1712845836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d0349be140 0x55d0349c0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 -- 172.21.15.79:0/1712845836 >> 172.21.15.79:0/1712845836 conn(0x55d0349bda00 msgr2=0x55d034991360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f35697fa640 0 client.7542 ms_handle_reset on v2:172.21.15.79:6834/2006151468 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 -- 172.21.15.79:0/1712845836 shutdown_connections 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 1 -- 172.21.15.79:0/1712845836 wait complete. 2024-06-10T00:22:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358f407740 20 client.7542 trim_cache size 0 max 16384 2024-06-10T00:22:28.022 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:28.022 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-06-10T00:22:28.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 -- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f357006be30 msgr2=0x7f357006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f357006be30 0x7f357006e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3574009ed0 tx=0x7f357400b040 comp rx=0 tx=0).stop 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 -- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d08f0 msgr2=0x7f35840cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d08f0 0x7f35840cc6d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f357802a250 tx=0x7f35780046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 -- 172.21.15.79:0/3442961433 shutdown_connections 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f357006be30 0x7f357006e2f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35840d0cd0 0x7f35840c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35840d08f0 0x7f35840cc6d0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 --2- 172.21.15.79:0/3442961433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35840cf190 0x7f3584152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.014+0000 7f358c6fc640 1 -- 172.21.15.79:0/3442961433 >> 172.21.15.79:0/3442961433 conn(0x7f358409d3c0 msgr2=0x7f35840b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.015+0000 7f358c6fc640 1 -- 172.21.15.79:0/3442961433 shutdown_connections 2024-06-10T00:22:28.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.015+0000 7f358c6fc640 1 -- 172.21.15.79:0/3442961433 wait complete. 2024-06-10T00:22:28.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-10T00:22:28.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.123+0000 7f4770aae640 1 Processor -- start 2024-06-10T00:22:28.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.123+0000 7f4770aae640 1 -- start start 2024-06-10T00:22:28.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.124+0000 7f4770aae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0b46d0 0x7f476c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.124+0000 7f4770aae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f476c0721a0 0x7f476c165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.124+0000 7f4770aae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f476c072820 con 0x7f476c0cc6d0 2024-06-10T00:22:28.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.124+0000 7f4770aae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f476c072b00 con 0x7f476c0721a0 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.124+0000 7f4770aae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f476c072de0 con 0x7f476c0b46d0 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.125+0000 7f476a59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f476c0cc6d0 0x7f476c0ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57444/0 (socket says 172.21.15.79:57444) 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.125+0000 7f476a59c640 1 -- 172.21.15.79:0/3147176852 learned_addr learned my addr 172.21.15.79:0/3147176852 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.125+0000 7f476ad9d640 1 --2- 172.21.15.79:0/3147176852 >> v2:172.21.15.79:3300/0 conn(0x7f476c0721a0 0x7f476c165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.125+0000 7f4769d9b640 1 --2- 172.21.15.79:0/3147176852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0b46d0 0x7f476c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.125+0000 7f476ad9d640 1 -- 172.21.15.79:0/3147176852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0b46d0 msgr2=0x7f476c071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.125+0000 7f476ad9d640 1 --2- 172.21.15.79:0/3147176852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0b46d0 0x7f476c071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.125+0000 7f476ad9d640 1 -- 172.21.15.79:0/3147176852 >> v1:172.21.15.79:6789/0 conn(0x7f476c0cc6d0 legacy=0x7f476c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.125+0000 7f476ad9d640 1 -- 172.21.15.79:0/3147176852 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c0b31a0 con 0x7f476c0721a0 2024-06-10T00:22:28.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f476ad9d640 1 --2- 172.21.15.79:0/3147176852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0721a0 0x7f476c165c30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f475c0097a0 tx=0x7f475c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e30270d5dfe242 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f476959a640 1 -- 172.21.15.79:0/3147176852 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c037070 con 0x7f476c0721a0 2024-06-10T00:22:28.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f476959a640 1 -- 172.21.15.79:0/3147176852 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475c032440 con 0x7f476c0721a0 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f476959a640 1 -- 172.21.15.79:0/3147176852 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c032810 con 0x7f476c0721a0 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f4770aae640 1 -- 172.21.15.79:0/3147176852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0721a0 msgr2=0x7f476c165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f4770aae640 1 --2- 172.21.15.79:0/3147176852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0721a0 0x7f476c165c30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f475c0097a0 tx=0x7f475c02a180 comp rx=0 tx=0).stop 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f4770aae640 1 -- 172.21.15.79:0/3147176852 shutdown_connections 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f4770aae640 1 --2- 172.21.15.79:0/3147176852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0721a0 0x7f476c165c30 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f4770aae640 1 --2- 172.21.15.79:0/3147176852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0b46d0 0x7f476c071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f4770aae640 1 -- 172.21.15.79:0/3147176852 >> 172.21.15.79:0/3147176852 conn(0x7f476c0b19f0 msgr2=0x7f476c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f4770aae640 1 -- 172.21.15.79:0/3147176852 shutdown_connections 2024-06-10T00:22:28.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.126+0000 7f4770aae640 1 -- 172.21.15.79:0/3147176852 wait complete. 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.128+0000 7f4770aae640 1 Processor -- start 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.128+0000 7f4770aae640 1 -- start start 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.128+0000 7f4770aae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0721a0 0x7f476c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.128+0000 7f4770aae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c0b46d0 0x7f476c0afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.128+0000 7f4770aae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0cc6d0 0x7f476c0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.128+0000 7f4770aae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f476c166170 con 0x7f476c0cc6d0 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.128+0000 7f4770aae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f476c159f60 con 0x7f476c0b46d0 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.128+0000 7f4770aae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f476c1662f0 con 0x7f476c0721a0 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0cc6d0 0x7f476c0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0cc6d0 0x7f476c0cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35416/0 (socket says 172.21.15.79:35416) 2024-06-10T00:22:28.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 -- 172.21.15.79:0/1988850266 learned_addr learned my addr 172.21.15.79:0/1988850266 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476a59c640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0721a0 0x7f476c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f4769d9b640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c0b46d0 0x7f476c0afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 -- 172.21.15.79:0/1988850266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0721a0 msgr2=0x7f476c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0721a0 0x7f476c153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 -- 172.21.15.79:0/1988850266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c0b46d0 msgr2=0x7f476c0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c0b46d0 0x7f476c0afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 -- 172.21.15.79:0/1988850266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c1641f0 con 0x7f476c0cc6d0 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f476ad9d640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0cc6d0 0x7f476c0cdd20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f475c0098c0 tx=0x7f475c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f4762ffd640 1 -- 172.21.15.79:0/1988850266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c037040 con 0x7f476c0cc6d0 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f4762ffd640 1 -- 172.21.15.79:0/1988850266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475c042070 con 0x7f476c0cc6d0 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c1644d0 con 0x7f476c0cc6d0 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f4762ffd640 1 -- 172.21.15.79:0/1988850266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c030b50 con 0x7f476c0cc6d0 2024-06-10T00:22:28.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.129+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c153880 con 0x7f476c0cc6d0 2024-06-10T00:22:28.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.130+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476c068430 con 0x7f476c0cc6d0 2024-06-10T00:22:28.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.131+0000 7f4762ffd640 1 -- 172.21.15.79:0/1988850266 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f475c030cf0 con 0x7f476c0cc6d0 2024-06-10T00:22:28.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.131+0000 7f4762ffd640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f474c06be30 0x7f474c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.131+0000 7f4762ffd640 1 -- 172.21.15.79:0/1988850266 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f475c0abc90 con 0x7f476c0cc6d0 2024-06-10T00:22:28.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.131+0000 7f476a59c640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f474c06be30 0x7f474c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.132+0000 7f476a59c640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f474c06be30 0x7f474c06e2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f47640012e0 tx=0x7f4764009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.136+0000 7f4762ffd640 1 -- 172.21.15.79:0/1988850266 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f475c032e20 con 0x7f476c0cc6d0 2024-06-10T00:22:28.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.346+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f476c0b4db0 con 0x7f476c0cc6d0 2024-06-10T00:22:28.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.346+0000 7f4762ffd640 1 -- 172.21.15.79:0/1988850266 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f475c07a420 con 0x7f476c0cc6d0 2024-06-10T00:22:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:28.346 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-10T00:22:28.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.348+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f474c06be30 msgr2=0x7f474c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.348+0000 7f4770aae640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f474c06be30 0x7f474c06e2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f47640012e0 tx=0x7f4764009040 comp rx=0 tx=0).stop 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.348+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0cc6d0 msgr2=0x7f476c0cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.348+0000 7f4770aae640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0cc6d0 0x7f476c0cdd20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f475c0098c0 tx=0x7f475c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.349+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 shutdown_connections 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.349+0000 7f4770aae640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f474c06be30 0x7f474c06e2f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.349+0000 7f4770aae640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f476c0cc6d0 0x7f476c0cdd20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.349+0000 7f4770aae640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c0b46d0 0x7f476c0afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.349+0000 7f4770aae640 1 --2- 172.21.15.79:0/1988850266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f476c0721a0 0x7f476c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.349+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 >> 172.21.15.79:0/1988850266 conn(0x7f476c0b19f0 msgr2=0x7f476c15d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.349+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 shutdown_connections 2024-06-10T00:22:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.349+0000 7f4770aae640 1 -- 172.21.15.79:0/1988850266 wait complete. 2024-06-10T00:22:28.359 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-06-10T00:22:28.359 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:22:28.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:22:28.404 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:22:28.448 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:22:28.448 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:22:28.448 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:28.448 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:28.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:22:28.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.604+0000 7fc0be763640 1 Processor -- start 2024-06-10T00:22:28.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.604+0000 7fc0be763640 1 -- start start 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0be763640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0b815a870 0x7fc0b806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0be763640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0b80aef70 0x7fc0b80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0be763640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b80af3d0 0x7fc0b80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0be763640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b80b4fe0 con 0x7fc0b815a870 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0be763640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b806e390 con 0x7fc0b80aef70 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0be763640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b815ac50 con 0x7fc0b80af3d0 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0b7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0b815a870 0x7fc0b806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0b7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0b815a870 0x7fc0b806de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35430/0 (socket says 172.21.15.79:35430) 2024-06-10T00:22:28.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.605+0000 7fc0b7fff640 1 -- 172.21.15.79:0/3620265813 learned_addr learned my addr 172.21.15.79:0/3620265813 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0bcd00640 1 --2- 172.21.15.79:0/3620265813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b80af3d0 0x7fc0b80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0b77fe640 1 --2- 172.21.15.79:0/3620265813 >> v2:172.21.15.117:3300/0 conn(0x7fc0b80aef70 0x7fc0b80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0b7fff640 1 -- 172.21.15.79:0/3620265813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b80af3d0 msgr2=0x7fc0b80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/3620265813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b80af3d0 0x7fc0b80b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0b7fff640 1 -- 172.21.15.79:0/3620265813 >> v2:172.21.15.117:3300/0 conn(0x7fc0b80aef70 msgr2=0x7fc0b80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/3620265813 >> v2:172.21.15.117:3300/0 conn(0x7fc0b80aef70 0x7fc0b80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0b7fff640 1 -- 172.21.15.79:0/3620265813 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b806cdb0 con 0x7fc0b815a870 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0b77fe640 1 --2- 172.21.15.79:0/3620265813 >> v2:172.21.15.117:3300/0 conn(0x7fc0b80aef70 0x7fc0b80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0bcd00640 1 --2- 172.21.15.79:0/3620265813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b80af3d0 0x7fc0b80b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.606+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/3620265813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b815a870 0x7fc0b806de50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80b4070 tx=0x7fc0a802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6e9d93669e7531 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0b6ffd640 1 -- 172.21.15.79:0/3620265813 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8037070 con 0x7fc0b815a870 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0b6ffd640 1 -- 172.21.15.79:0/3620265813 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a8032440 con 0x7fc0b815a870 2024-06-10T00:22:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0b6ffd640 1 -- 172.21.15.79:0/3620265813 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8032810 con 0x7fc0b815a870 2024-06-10T00:22:28.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 -- 172.21.15.79:0/3620265813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b815a870 msgr2=0x7fc0b806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 --2- 172.21.15.79:0/3620265813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b815a870 0x7fc0b806de50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80b4070 tx=0x7fc0a802a140 comp rx=0 tx=0).stop 2024-06-10T00:22:28.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 -- 172.21.15.79:0/3620265813 shutdown_connections 2024-06-10T00:22:28.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 --2- 172.21.15.79:0/3620265813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b80af3d0 0x7fc0b80b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 --2- 172.21.15.79:0/3620265813 >> v2:172.21.15.117:3300/0 conn(0x7fc0b80aef70 0x7fc0b80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 --2- 172.21.15.79:0/3620265813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b815a870 0x7fc0b806de50 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 -- 172.21.15.79:0/3620265813 >> 172.21.15.79:0/3620265813 conn(0x7fc0b80b19f0 msgr2=0x7fc0b80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 -- 172.21.15.79:0/3620265813 shutdown_connections 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.607+0000 7fc0be763640 1 -- 172.21.15.79:0/3620265813 wait complete. 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.608+0000 7fc0be763640 1 Processor -- start 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.608+0000 7fc0be763640 1 -- start start 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0be763640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b80aef70 0x7fc0b8149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0be763640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b80af3d0 0x7fc0b80cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0be763640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b815a870 0x7fc0b81579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0be763640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b806d650 con 0x7fc0b80af3d0 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0be763640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b806d370 con 0x7fc0b80aef70 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0be763640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b806d930 con 0x7fc0b815a870 2024-06-10T00:22:28.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0b77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b80af3d0 0x7fc0b80cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0b77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b80af3d0 0x7fc0b80cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35434/0 (socket says 172.21.15.79:35434) 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0b77fe640 1 -- 172.21.15.79:0/2235761608 learned_addr learned my addr 172.21.15.79:0/2235761608 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.609+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b80aef70 0x7fc0b8149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0bcd00640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b815a870 0x7fc0b81579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b77fe640 1 -- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b815a870 msgr2=0x7fc0b81579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b77fe640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b815a870 0x7fc0b81579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b77fe640 1 -- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b80aef70 msgr2=0x7fc0b8149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b77fe640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b80aef70 0x7fc0b8149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b77fe640 1 -- 172.21.15.79:0/2235761608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b8151eb0 con 0x7fc0b80af3d0 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b80aef70 0x7fc0b8149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b77fe640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b80af3d0 0x7fc0b80cddb0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c7f0 tx=0x7fc0ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b4ff9640 1 -- 172.21.15.79:0/2235761608 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac015070 con 0x7fc0b80af3d0 2024-06-10T00:22:28.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b4ff9640 1 -- 172.21.15.79:0/2235761608 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac007820 con 0x7fc0b80af3d0 2024-06-10T00:22:28.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b8071940 con 0x7fc0b80af3d0 2024-06-10T00:22:28.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0b4ff9640 1 -- 172.21.15.79:0/2235761608 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac007c10 con 0x7fc0b80af3d0 2024-06-10T00:22:28.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.610+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b8152430 con 0x7fc0b80af3d0 2024-06-10T00:22:28.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.611+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b8068430 con 0x7fc0b80af3d0 2024-06-10T00:22:28.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.611+0000 7fc0b4ff9640 1 -- 172.21.15.79:0/2235761608 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0ac018070 con 0x7fc0b80af3d0 2024-06-10T00:22:28.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.612+0000 7fc0b4ff9640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:28.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.612+0000 7fc0b4ff9640 1 -- 172.21.15.79:0/2235761608 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7fc0ac08b040 con 0x7fc0b80af3d0 2024-06-10T00:22:28.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.612+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:28.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.612+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0a406be30 0x7fc0a406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8034000 tx=0x7fc0a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:28.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.616+0000 7fc0b4ff9640 1 -- 172.21.15.79:0/2235761608 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc0ac0596c0 con 0x7fc0b80af3d0 2024-06-10T00:22:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.800+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc0b80b2650 con 0x7fc0b80af3d0 2024-06-10T00:22:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.801+0000 7fc0b4ff9640 1 -- 172.21.15.79:0/2235761608 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v92) ==== 80+0+246 (secure 0 0 0) 0x7fc0ac058fc0 con 0x7fc0b80af3d0 2024-06-10T00:22:28.801 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6834/1800410806 2024-06-11T00:21:50.147248+0000 2024-06-10T00:22:28.801 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6836/1800410806 2024-06-11T00:21:50.147248+0000 2024-06-10T00:22:28.801 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.117:6835/2747696124 2024-06-11T00:20:32.967295+0000 2024-06-10T00:22:28.801 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.117:6833/2747696124 2024-06-11T00:20:32.967295+0000 2024-06-10T00:22:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:listed 4 entries 2024-06-10T00:22:28.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0a406be30 msgr2=0x7fc0a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0a406be30 0x7fc0a406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8034000 tx=0x7fc0a802e000 comp rx=0 tx=0).stop 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b80af3d0 msgr2=0x7fc0b80cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b80af3d0 0x7fc0b80cddb0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c7f0 tx=0x7fc0ac00ccb0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 shutdown_connections 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b815a870 0x7fc0b81579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b80af3d0 0x7fc0b80cddb0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 --2- 172.21.15.79:0/2235761608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b80aef70 0x7fc0b8149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 >> 172.21.15.79:0/2235761608 conn(0x7fc0b80b19f0 msgr2=0x7fc0b8156ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 shutdown_connections 2024-06-10T00:22:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:28.803+0000 7fc0be763640 1 -- 172.21.15.79:0/2235761608 wait complete. 2024-06-10T00:22:28.813 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:22:28.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:28.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:28.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[67569]: fuse finished with error 0 and tester_r 0 2024-06-10T00:22:28.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:22:28.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:28.838 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:22:28.894 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:22:28.894 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:22:28.894 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:28.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:22:28.913 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:22:28.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:28.914 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-10T00:22:28.971 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-10T00:22:28.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:22:28.972 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:22:28.972 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:28.972 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:28.988 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:22:28.988 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:22:28.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:28.988 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-10T00:22:29.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:22:29.044 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-10T00:22:29.044 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:22:29.044 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:22:29.044 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:29.063 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:22:29.063 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:22:29.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:29.063 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-10T00:22:29.121 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-10T00:22:29.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:22:29.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.223+0000 7ff0355d5640 1 Processor -- start 2024-06-10T00:22:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.223+0000 7ff0355d5640 1 -- start start 2024-06-10T00:22:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff0355d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300cc6d0 0x7ff0300ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff0355d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff030071c60 0x7ff0300720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff0355d5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0300b36c0 0x7ff0300b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff0355d5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff0300ccff0 con 0x7ff0300b36c0 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff0355d5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff030072820 con 0x7ff030071c60 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff0355d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff030072b00 con 0x7ff0300cc6d0 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0300b36c0 0x7ff0300b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0300b36c0 0x7ff0300b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35436/0 (socket says 172.21.15.79:35436) 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02f7fe640 1 -- 172.21.15.79:0/902854311 learned_addr learned my addr 172.21.15.79:0/902854311 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02effd640 1 --2- 172.21.15.79:0/902854311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300cc6d0 0x7ff0300ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff027fff640 1 --2- 172.21.15.79:0/902854311 >> v2:172.21.15.117:3300/0 conn(0x7ff030071c60 0x7ff0300720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02f7fe640 1 -- 172.21.15.79:0/902854311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300cc6d0 msgr2=0x7ff0300ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02f7fe640 1 --2- 172.21.15.79:0/902854311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300cc6d0 0x7ff0300ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02f7fe640 1 -- 172.21.15.79:0/902854311 >> v2:172.21.15.117:3300/0 conn(0x7ff030071c60 msgr2=0x7ff0300720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02f7fe640 1 --2- 172.21.15.79:0/902854311 >> v2:172.21.15.117:3300/0 conn(0x7ff030071c60 0x7ff0300720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02f7fe640 1 -- 172.21.15.79:0/902854311 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff030072de0 con 0x7ff0300b36c0 2024-06-10T00:22:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff027fff640 1 --2- 172.21.15.79:0/902854311 >> v2:172.21.15.117:3300/0 conn(0x7ff030071c60 0x7ff0300720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:29.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.224+0000 7ff02effd640 1 --2- 172.21.15.79:0/902854311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300cc6d0 0x7ff0300ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:29.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.225+0000 7ff02f7fe640 1 --2- 172.21.15.79:0/902854311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0300b36c0 0x7ff0300b3b30 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff03006cae0 tx=0x7ff02802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206481facb91666f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.225+0000 7ff02e7fc640 1 -- 172.21.15.79:0/902854311 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028036070 con 0x7ff0300b36c0 2024-06-10T00:22:29.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.225+0000 7ff02e7fc640 1 -- 172.21.15.79:0/902854311 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028031600 con 0x7ff0300b36c0 2024-06-10T00:22:29.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.225+0000 7ff02e7fc640 1 -- 172.21.15.79:0/902854311 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0280319d0 con 0x7ff0300b36c0 2024-06-10T00:22:29.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.225+0000 7ff0355d5640 1 -- 172.21.15.79:0/902854311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0300b36c0 msgr2=0x7ff0300b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.225+0000 7ff0355d5640 1 --2- 172.21.15.79:0/902854311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0300b36c0 0x7ff0300b3b30 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff03006cae0 tx=0x7ff02802a6a0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.226+0000 7ff0355d5640 1 -- 172.21.15.79:0/902854311 shutdown_connections 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.226+0000 7ff0355d5640 1 --2- 172.21.15.79:0/902854311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0300b36c0 0x7ff0300b3b30 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.226+0000 7ff0355d5640 1 --2- 172.21.15.79:0/902854311 >> v2:172.21.15.117:3300/0 conn(0x7ff030071c60 0x7ff0300720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.226+0000 7ff0355d5640 1 --2- 172.21.15.79:0/902854311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300cc6d0 0x7ff0300ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.226+0000 7ff0355d5640 1 -- 172.21.15.79:0/902854311 >> 172.21.15.79:0/902854311 conn(0x7ff0300b19f0 msgr2=0x7ff0300b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.226+0000 7ff0355d5640 1 -- 172.21.15.79:0/902854311 shutdown_connections 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.226+0000 7ff0355d5640 1 -- 172.21.15.79:0/902854311 wait complete. 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.227+0000 7ff0355d5640 1 Processor -- start 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.227+0000 7ff0355d5640 1 -- start start 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.227+0000 7ff0355d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff030071c60 0x7ff0300b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.227+0000 7ff0355d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b36c0 0x7ff0301485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.227+0000 7ff0355d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300cc6d0 0x7ff03015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.227+0000 7ff0355d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff030159f60 con 0x7ff030071c60 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.227+0000 7ff0355d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff03015c890 con 0x7ff0300cc6d0 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.227+0000 7ff0355d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0300b4070 con 0x7ff0300b36c0 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff030071c60 0x7ff0300b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff030071c60 0x7ff0300b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35448/0 (socket says 172.21.15.79:35448) 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 -- 172.21.15.79:0/2104223066 learned_addr learned my addr 172.21.15.79:0/2104223066 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02f7fe640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300cc6d0 0x7ff03015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 -- 172.21.15.79:0/2104223066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b36c0 msgr2=0x7ff0301485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b36c0 0x7ff0301485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 -- 172.21.15.79:0/2104223066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300cc6d0 msgr2=0x7ff03015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300cc6d0 0x7ff03015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 -- 172.21.15.79:0/2104223066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03009c660 con 0x7ff030071c60 2024-06-10T00:22:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02f7fe640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300cc6d0 0x7ff03015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff02effd640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff030071c60 0x7ff0300b47d0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ff02000c820 tx=0x7ff02000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff0277fe640 1 -- 172.21.15.79:0/2104223066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020015070 con 0x7ff030071c60 2024-06-10T00:22:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff0277fe640 1 -- 172.21.15.79:0/2104223066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff020007a30 con 0x7ff030071c60 2024-06-10T00:22:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0300b4d10 con 0x7ff030071c60 2024-06-10T00:22:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff0277fe640 1 -- 172.21.15.79:0/2104223066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020007de0 con 0x7ff030071c60 2024-06-10T00:22:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.228+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03009c900 con 0x7ff030071c60 2024-06-10T00:22:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.229+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff030068430 con 0x7ff030071c60 2024-06-10T00:22:29.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.230+0000 7ff0277fe640 1 -- 172.21.15.79:0/2104223066 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff020018070 con 0x7ff030071c60 2024-06-10T00:22:29.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.230+0000 7ff0277fe640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff01006be30 0x7ff01006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.230+0000 7ff0277fe640 1 -- 172.21.15.79:0/2104223066 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7ff02008b030 con 0x7ff030071c60 2024-06-10T00:22:29.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.230+0000 7ff027fff640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff01006be30 0x7ff01006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.230+0000 7ff027fff640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff01006be30 0x7ff01006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff0300b11c0 tx=0x7ff018008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.234+0000 7ff0277fe640 1 -- 172.21.15.79:0/2104223066 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff020059730 con 0x7ff030071c60 2024-06-10T00:22:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.449+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0300b0f10 con 0x7ff030071c60 2024-06-10T00:22:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.450+0000 7ff0277fe640 1 -- 172.21.15.79:0/2104223066 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5190 (secure 0 0 0) 0x7ff020059030 con 0x7ff030071c60 2024-06-10T00:22:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:29.450 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:21:54.167947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6836/2006151468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2006151468},{"type":"v1","addr":"172.21.15.79:6836","nonce":2006151468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-06-10T00:22:29.450 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 62 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff01006be30 msgr2=0x7ff01006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff01006be30 0x7ff01006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff0300b11c0 tx=0x7ff018008040 comp rx=0 tx=0).stop 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff030071c60 msgr2=0x7ff0300b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff030071c60 0x7ff0300b47d0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ff02000c820 tx=0x7ff02000cce0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 shutdown_connections 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff01006be30 0x7ff01006e2f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300cc6d0 0x7ff03015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b36c0 0x7ff0301485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 --2- 172.21.15.79:0/2104223066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff030071c60 0x7ff0300b47d0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 >> 172.21.15.79:0/2104223066 conn(0x7ff0300b19f0 msgr2=0x7ff03015ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 shutdown_connections 2024-06-10T00:22:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.452+0000 7ff0355d5640 1 -- 172.21.15.79:0/2104223066 wait complete. 2024-06-10T00:22:29.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:29.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.562+0000 7f889c577640 1 Processor -- start 2024-06-10T00:22:29.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.562+0000 7f889c577640 1 -- start start 2024-06-10T00:22:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f889c577640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88940ae910 0x7f889406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f889c577640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889406d130 con 0x7f88940cf360 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f889c577640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889406d410 con 0x7f889406ea20 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f889c577640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f889406ee60 con 0x7f88940ae910 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f889ab14640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f88940cf360 0x7f88940acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57452/0 (socket says 172.21.15.79:57452) 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f889ab14640 1 -- 172.21.15.79:0/2288439447 learned_addr learned my addr 172.21.15.79:0/2288439447 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590912997 0 0) 0x7f889406d130 con 0x7f88940cf360 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8880003520 con 0x7f88940cf360 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.563+0000 7f889a313640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88940ae910 0x7f889406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 206965401 0 0) 0x7f8880003520 con 0x7f88940cf360 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88940ae910 msgr2=0x7f889406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88940ae910 0x7f889406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 >> v1:172.21.15.117:6789/0 conn(0x7f889406ea20 legacy=0x7f88940cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889406d6f0 con 0x7f88940cf360 2024-06-10T00:22:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f888c0019f0 con 0x7f88940cf360 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 >> v1:172.21.15.79:6789/0 conn(0x7f88940cf360 legacy=0x7f88940acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88940ae910 0x7f88800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004010 0x7f8880004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8880004d40 0x7f88800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f889406ee60 con 0x7f8880004d40 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f888000bc00 con 0x7f8880004010 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f888000be00 con 0x7f88940ae910 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f889ab14640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8880004d40 0x7f88800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f889a313640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88940ae910 0x7f88800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f8899b12640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004010 0x7f8880004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f889ab14640 1 -- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88940ae910 msgr2=0x7f88800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f889ab14640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88940ae910 0x7f88800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f889ab14640 1 -- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004010 msgr2=0x7f8880004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f889ab14640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004010 0x7f8880004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.564+0000 7f889ab14640 1 -- 172.21.15.79:0/2288439447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8880003520 con 0x7f8880004d40 2024-06-10T00:22:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.565+0000 7f889ab14640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8880004d40 0x7f88800051c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f888c00a860 tx=0x7f8880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1796d9b0030056b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.565+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c00a480 con 0x7f8880004d40 2024-06-10T00:22:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.565+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c02f070 con 0x7f8880004d40 2024-06-10T00:22:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.565+0000 7f8899311640 1 -- 172.21.15.79:0/2288439447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c02bd40 con 0x7f8880004d40 2024-06-10T00:22:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.565+0000 7f889c577640 1 -- 172.21.15.79:0/2288439447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8880004d40 msgr2=0x7f88800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.565+0000 7f889c577640 1 --2- 172.21.15.79:0/2288439447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8880004d40 0x7f88800051c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f888c00a860 tx=0x7f8880005830 comp rx=0 tx=0).stop 2024-06-10T00:22:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.565+0000 7f889ab14640 1 -- 172.21.15.79:0/2288439447 reap_dead start 2024-06-10T00:22:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.566+0000 7f889c577640 1 -- 172.21.15.79:0/2288439447 shutdown_connections 2024-06-10T00:22:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.566+0000 7f889c577640 1 -- 172.21.15.79:0/2288439447 >> 172.21.15.79:0/2288439447 conn(0x7f88940b19f0 msgr2=0x7f88940b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.566+0000 7f889c577640 1 -- 172.21.15.79:0/2288439447 shutdown_connections 2024-06-10T00:22:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.566+0000 7f889c577640 1 -- 172.21.15.79:0/2288439447 wait complete. 2024-06-10T00:22:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.567+0000 7f889c577640 1 Processor -- start 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.567+0000 7f889c577640 1 -- start start 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.567+0000 7f889c577640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004d40 0x7f889415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889c577640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88940c50a0 0x7f889415dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889c577640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f889414c790 0x7f889414cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889c577640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f889406e4e0 con 0x7f88940c50a0 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889c577640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f88940aecf0 con 0x7f8880004d40 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889c577640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f889406e660 con 0x7f889414c790 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88940c50a0 0x7f889415dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88940c50a0 0x7f889415dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35452/0 (socket says 172.21.15.79:35452) 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 -- 172.21.15.79:0/3022460189 learned_addr learned my addr 172.21.15.79:0/3022460189 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889ab14640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f889414c790 0x7f889414cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889a313640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004d40 0x7f889415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 -- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f889414c790 msgr2=0x7f889414cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f889414c790 0x7f889414cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 -- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004d40 msgr2=0x7f889415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004d40 0x7f889415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 -- 172.21.15.79:0/3022460189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88940c55f0 con 0x7f88940c50a0 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889a313640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004d40 0x7f889415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f8899b12640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88940c50a0 0x7f889415dfc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f888400f880 tx=0x7f888400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f888affd640 1 -- 172.21.15.79:0/3022460189 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884001d20 con 0x7f88940c50a0 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f888affd640 1 -- 172.21.15.79:0/3022460189 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8884018070 con 0x7f88940c50a0 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f888affd640 1 -- 172.21.15.79:0/3022460189 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888400d730 con 0x7f88940c50a0 2024-06-10T00:22:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889414d6e0 con 0x7f88940c50a0 2024-06-10T00:22:29.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.568+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889414dca0 con 0x7f88940c50a0 2024-06-10T00:22:29.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.569+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8894068430 con 0x7f88940c50a0 2024-06-10T00:22:29.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.570+0000 7f888affd640 1 -- 172.21.15.79:0/3022460189 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f888400d8d0 con 0x7f88940c50a0 2024-06-10T00:22:29.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.570+0000 7f888affd640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f887806be30 0x7f887806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.570+0000 7f888affd640 1 -- 172.21.15.79:0/3022460189 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f888408aef0 con 0x7f88940c50a0 2024-06-10T00:22:29.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.570+0000 7f889a313640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f887806be30 0x7f887806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.571+0000 7f889a313640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f887806be30 0x7f887806e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8890006fd0 tx=0x7f8890008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.574+0000 7f888affd640 1 -- 172.21.15.79:0/3022460189 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8884059680 con 0x7f88940c50a0 2024-06-10T00:22:29.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.785+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88940cd3c0 con 0x7f88940c50a0 2024-06-10T00:22:29.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.785+0000 7f888affd640 1 -- 172.21.15.79:0/3022460189 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5190 (secure 0 0 0) 0x7f8884058f80 con 0x7f88940c50a0 2024-06-10T00:22:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:29.785 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:21:54.167947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6836/2006151468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2006151468},{"type":"v1","addr":"172.21.15.79:6836","nonce":2006151468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-06-10T00:22:29.786 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 62 2024-06-10T00:22:29.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.787+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f887806be30 msgr2=0x7f887806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.787+0000 7f889c577640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f887806be30 0x7f887806e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8890006fd0 tx=0x7f8890008040 comp rx=0 tx=0).stop 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.787+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88940c50a0 msgr2=0x7f889415dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.787+0000 7f889c577640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88940c50a0 0x7f889415dfc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f888400f880 tx=0x7f888400fd40 comp rx=0 tx=0).stop 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.787+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 shutdown_connections 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.787+0000 7f889c577640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f887806be30 0x7f887806e2f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.787+0000 7f889c577640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f889414c790 0x7f889414cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.787+0000 7f889c577640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88940c50a0 0x7f889415dfc0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.788+0000 7f889c577640 1 --2- 172.21.15.79:0/3022460189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8880004d40 0x7f889415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.788+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 >> 172.21.15.79:0/3022460189 conn(0x7f88940b19f0 msgr2=0x7f88940b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.788+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 shutdown_connections 2024-06-10T00:22:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.788+0000 7f889c577640 1 -- 172.21.15.79:0/3022460189 wait complete. 2024-06-10T00:22:29.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:22:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.901+0000 7f987eafc640 1 Processor -- start 2024-06-10T00:22:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.901+0000 7f987eafc640 1 -- start start 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987eafc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 0x7f98780b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987eafc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98780af3b0 0x7f98780b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987eafc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f987815ac50 con 0x7f987815a870 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987eafc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f98780b4fe0 con 0x7f98780af3b0 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987eafc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f987806cdb0 con 0x7f98780aef70 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987d099640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98780af3b0 0x7f98780b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987c898640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f987815a870 0x7f987806de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57458/0 (socket says 172.21.15.79:57458) 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987d099640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98780af3b0 0x7f98780b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35466/0 (socket says 172.21.15.79:35466) 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987c898640 1 -- 172.21.15.79:0/8393016 learned_addr learned my addr 172.21.15.79:0/8393016 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f9877fff640 1 --2- 172.21.15.79:0/8393016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 0x7f98780b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987d099640 1 -- 172.21.15.79:0/8393016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 msgr2=0x7f98780b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:29.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.902+0000 7f987d099640 1 --2- 172.21.15.79:0/8393016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 0x7f98780b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.903+0000 7f987d099640 1 -- 172.21.15.79:0/8393016 >> v1:172.21.15.79:6789/0 conn(0x7f987815a870 legacy=0x7f987806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.903+0000 7f987d099640 1 -- 172.21.15.79:0/8393016 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987806d090 con 0x7f98780af3b0 2024-06-10T00:22:29.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.903+0000 7f987d099640 1 --2- 172.21.15.79:0/8393016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f98780b4aa0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f9870009d90 tx=0x7f987002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190e1bd07650171f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.903+0000 7f98777fe640 1 -- 172.21.15.79:0/8393016 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870031600 con 0x7f98780af3b0 2024-06-10T00:22:29.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.903+0000 7f98777fe640 1 -- 172.21.15.79:0/8393016 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98700317a0 con 0x7f98780af3b0 2024-06-10T00:22:29.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.903+0000 7f98777fe640 1 -- 172.21.15.79:0/8393016 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870031b70 con 0x7f98780af3b0 2024-06-10T00:22:29.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.904+0000 7f987eafc640 1 -- 172.21.15.79:0/8393016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 msgr2=0x7f98780b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.904+0000 7f987eafc640 1 --2- 172.21.15.79:0/8393016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f98780b4aa0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f9870009d90 tx=0x7f987002a5d0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.904+0000 7f987eafc640 1 -- 172.21.15.79:0/8393016 shutdown_connections 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.904+0000 7f987eafc640 1 --2- 172.21.15.79:0/8393016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f98780b4aa0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.904+0000 7f987eafc640 1 --2- 172.21.15.79:0/8393016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 0x7f98780b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.904+0000 7f987eafc640 1 -- 172.21.15.79:0/8393016 >> 172.21.15.79:0/8393016 conn(0x7f98780b19f0 msgr2=0x7f98780b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.904+0000 7f987eafc640 1 -- 172.21.15.79:0/8393016 shutdown_connections 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.904+0000 7f987eafc640 1 -- 172.21.15.79:0/8393016 wait complete. 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.905+0000 7f987eafc640 1 Processor -- start 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.905+0000 7f987eafc640 1 -- start start 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f987eafc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 0x7f987814be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f987eafc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f987815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f987eafc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f987815a870 0x7f9878149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f987eafc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f987806d930 con 0x7f98780af3b0 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f987eafc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f987806d650 con 0x7f987815a870 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f987eafc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f98780b2e40 con 0x7f98780aef70 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f987815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f987815ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35482/0 (socket says 172.21.15.79:35482) 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 -- 172.21.15.79:0/102343549 learned_addr learned my addr 172.21.15.79:0/102343549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f987c898640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 0x7f987814be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f987d099640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f987815a870 0x7f9878149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 -- 172.21.15.79:0/102343549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 msgr2=0x7f987814be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 0x7f987814be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 -- 172.21.15.79:0/102343549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f987815a870 msgr2=0x7f9878149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f987815a870 0x7f9878149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 -- 172.21.15.79:0/102343549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987815b360 con 0x7f98780af3b0 2024-06-10T00:22:29.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.906+0000 7f9877fff640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f987815ae20 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f986c00d620 tx=0x7f986c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.907+0000 7f98757fa640 1 -- 172.21.15.79:0/102343549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c00b620 con 0x7f98780af3b0 2024-06-10T00:22:29.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.907+0000 7f98757fa640 1 -- 172.21.15.79:0/102343549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986c019070 con 0x7f98780af3b0 2024-06-10T00:22:29.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.907+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987814f3b0 con 0x7f98780af3b0 2024-06-10T00:22:29.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.907+0000 7f98757fa640 1 -- 172.21.15.79:0/102343549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c00b9e0 con 0x7f98780af3b0 2024-06-10T00:22:29.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.907+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987814d520 con 0x7f98780af3b0 2024-06-10T00:22:29.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.908+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9878068430 con 0x7f98780af3b0 2024-06-10T00:22:29.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.908+0000 7f98757fa640 1 -- 172.21.15.79:0/102343549 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f986c00bb80 con 0x7f98780af3b0 2024-06-10T00:22:29.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.909+0000 7f98757fa640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f986406be60 0x7f986406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:29.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.909+0000 7f987c898640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f986406be60 0x7f986406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:29.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.909+0000 7f98757fa640 1 -- 172.21.15.79:0/102343549 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f986c08b4e0 con 0x7f98780af3b0 2024-06-10T00:22:29.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.909+0000 7f987c898640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f986406be60 0x7f986406e320 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f987814efb0 tx=0x7f9868009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:29.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:29.913+0000 7f98757fa640 1 -- 172.21.15.79:0/102343549 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f986c059be0 con 0x7f98780af3b0 2024-06-10T00:22:30.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.088+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98780b2650 con 0x7f98780af3b0 2024-06-10T00:22:30.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.089+0000 7f98757fa640 1 -- 172.21.15.79:0/102343549 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+17292 (secure 0 0 0) 0x7f986c0594e0 con 0x7f98780af3b0 2024-06-10T00:22:30.089 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:30.089 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":92,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:21:50.147268+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:20:22.495363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-06-10T00:20:23.129127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.24","mappings":[{"from":1,"to":5}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6834/1800410806":"2024-06-11T00:21:50.147248+0000","172.21.15.79:6836/1800410806":"2024-06-11T00:21:50.147248+0000","172.21.15.117:6835/2747696124":"2024-06-11T00:20:32.967295+0000","172.21.15.117:6833/2747696124":"2024-06-11T00:20:32.967295+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:22:30.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f986406be60 msgr2=0x7f986406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f986406be60 0x7f986406e320 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f987814efb0 tx=0x7f9868009040 comp rx=0 tx=0).stop 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 msgr2=0x7f987815ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f987815ae20 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f986c00d620 tx=0x7f986c00dae0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 shutdown_connections 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f986406be60 0x7f986406e320 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f987815a870 0x7f9878149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98780af3b0 0x7f987815ae20 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 --2- 172.21.15.79:0/102343549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98780aef70 0x7f987814be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 >> 172.21.15.79:0/102343549 conn(0x7f98780b19f0 msgr2=0x7f98780ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 shutdown_connections 2024-06-10T00:22:30.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.091+0000 7f987eafc640 1 -- 172.21.15.79:0/102343549 wait complete. 2024-06-10T00:22:30.102 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:22:30.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:30.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.202+0000 7f2e75ec4640 1 Processor -- start 2024-06-10T00:22:30.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.202+0000 7f2e75ec4640 1 -- start start 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e75ec4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e700d2680 0x7f2e7015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e75ec4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e700d1fc0 0x7f2e700d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e75ec4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e700d2fa0 con 0x7f2e70161fa0 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e75ec4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2e700cff80 con 0x7f2e700d1fc0 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e75ec4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2e700d13e0 con 0x7f2e700d2680 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e67fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e700d1fc0 0x7f2e700d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e67fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e700d1fc0 0x7f2e700d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35492/0 (socket says 172.21.15.79:35492) 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e67fff640 1 -- 172.21.15.79:0/4214252470 learned_addr learned my addr 172.21.15.79:0/4214252470 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e6f7fe640 1 --2- 172.21.15.79:0/4214252470 >> v2:172.21.15.117:3300/0 conn(0x7f2e700d2680 0x7f2e7015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e67fff640 1 -- 172.21.15.79:0/4214252470 >> v2:172.21.15.117:3300/0 conn(0x7f2e700d2680 msgr2=0x7f2e7015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:30.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e67fff640 1 --2- 172.21.15.79:0/4214252470 >> v2:172.21.15.117:3300/0 conn(0x7f2e700d2680 0x7f2e7015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e67fff640 1 -- 172.21.15.79:0/4214252470 >> v1:172.21.15.117:6789/0 conn(0x7f2e70161fa0 legacy=0x7f2e701623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.203+0000 7f2e67fff640 1 -- 172.21.15.79:0/4214252470 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e700d0ad0 con 0x7f2e700d1fc0 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.204+0000 7f2e67fff640 1 --2- 172.21.15.79:0/4214252470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d1fc0 0x7f2e700d2a60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2e7008ca40 tx=0x7f2e5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b5fa541db5a8e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.204+0000 7f2e6effd640 1 -- 172.21.15.79:0/4214252470 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58037070 con 0x7f2e700d1fc0 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.204+0000 7f2e6effd640 1 -- 172.21.15.79:0/4214252470 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58032440 con 0x7f2e700d1fc0 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.204+0000 7f2e6effd640 1 -- 172.21.15.79:0/4214252470 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58032810 con 0x7f2e700d1fc0 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.205+0000 7f2e75ec4640 1 -- 172.21.15.79:0/4214252470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d1fc0 msgr2=0x7f2e700d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.205+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/4214252470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d1fc0 0x7f2e700d2a60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2e7008ca40 tx=0x7f2e5802a270 comp rx=0 tx=0).stop 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.205+0000 7f2e75ec4640 1 -- 172.21.15.79:0/4214252470 shutdown_connections 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.205+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/4214252470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d1fc0 0x7f2e700d2a60 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.205+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/4214252470 >> v2:172.21.15.117:3300/0 conn(0x7f2e700d2680 0x7f2e7015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.205+0000 7f2e75ec4640 1 -- 172.21.15.79:0/4214252470 >> 172.21.15.79:0/4214252470 conn(0x7f2e7009d3f0 msgr2=0x7f2e700d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.205+0000 7f2e75ec4640 1 -- 172.21.15.79:0/4214252470 shutdown_connections 2024-06-10T00:22:30.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.205+0000 7f2e75ec4640 1 -- 172.21.15.79:0/4214252470 wait complete. 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.206+0000 7f2e75ec4640 1 Processor -- start 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.206+0000 7f2e75ec4640 1 -- start start 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e75ec4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e700d1fc0 0x7f2e700cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e75ec4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d2680 0x7f2e700cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e75ec4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e70161fa0 0x7f2e700c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e75ec4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e700d1070 con 0x7f2e700d2680 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e75ec4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2e700d0d90 con 0x7f2e700d1fc0 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e75ec4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2e700d2400 con 0x7f2e70161fa0 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d2680 0x7f2e700cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d2680 0x7f2e700cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35498/0 (socket says 172.21.15.79:35498) 2024-06-10T00:22:30.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 -- 172.21.15.79:0/2593735022 learned_addr learned my addr 172.21.15.79:0/2593735022 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 -- 172.21.15.79:0/2593735022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e70161fa0 msgr2=0x7f2e700c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e70161fa0 0x7f2e700c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 -- 172.21.15.79:0/2593735022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e700d1fc0 msgr2=0x7f2e700cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e700d1fc0 0x7f2e700cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 -- 172.21.15.79:0/2593735022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e700ce020 con 0x7f2e700d2680 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e67fff640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d2680 0x7f2e700cb190 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f2e5802a2b0 tx=0x7f2e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e6cff9640 1 -- 172.21.15.79:0/2593735022 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58037040 con 0x7f2e700d2680 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e6cff9640 1 -- 172.21.15.79:0/2593735022 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58042070 con 0x7f2e700d2680 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e701f5960 con 0x7f2e700d2680 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e6cff9640 1 -- 172.21.15.79:0/2593735022 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58030880 con 0x7f2e700d2680 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.207+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e700cd000 con 0x7f2e700d2680 2024-06-10T00:22:30.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.208+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7009d7d0 con 0x7f2e700d2680 2024-06-10T00:22:30.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.209+0000 7f2e6cff9640 1 -- 172.21.15.79:0/2593735022 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e58030a20 con 0x7f2e700d2680 2024-06-10T00:22:30.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.209+0000 7f2e6cff9640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.209+0000 7f2e6f7fe640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.209+0000 7f2e6cff9640 1 -- 172.21.15.79:0/2593735022 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f2e580ab960 con 0x7f2e700d2680 2024-06-10T00:22:30.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.210+0000 7f2e6f7fe640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2e60006a90 tx=0x7f2e60006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.213+0000 7f2e6cff9640 1 -- 172.21.15.79:0/2593735022 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2e7009d7d0 con 0x7f2e700d2680 2024-06-10T00:22:30.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.421+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e70068430 con 0x7f2e700d2680 2024-06-10T00:22:30.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.422+0000 7f2e6cff9640 1 -- 172.21.15.79:0/2593735022 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5190 (secure 0 0 0) 0x7f2e5807a0f0 con 0x7f2e700d2680 2024-06-10T00:22:30.422 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:30.422 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:21:54.167947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6836/2006151468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2006151468},{"type":"v1","addr":"172.21.15.79:6836","nonce":2006151468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-06-10T00:22:30.422 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 62 2024-06-10T00:22:30.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 msgr2=0x7f2e5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2e60006a90 tx=0x7f2e60006a20 comp rx=0 tx=0).stop 2024-06-10T00:22:30.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d2680 msgr2=0x7f2e700cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d2680 0x7f2e700cb190 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f2e5802a2b0 tx=0x7f2e580046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 shutdown_connections 2024-06-10T00:22:30.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2e5006be30 0x7f2e5006e2f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e70161fa0 0x7f2e700c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e700d2680 0x7f2e700cb190 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 --2- 172.21.15.79:0/2593735022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e700d1fc0 0x7f2e700cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 >> 172.21.15.79:0/2593735022 conn(0x7f2e7009d3f0 msgr2=0x7f2e70160c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:30.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 shutdown_connections 2024-06-10T00:22:30.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.424+0000 7f2e75ec4640 1 -- 172.21.15.79:0/2593735022 wait complete. 2024-06-10T00:22:30.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.535+0000 7f099b170640 1 Processor -- start 2024-06-10T00:22:30.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.535+0000 7f099b170640 1 -- start start 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f099b170640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09940ae910 0x7f099406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f099b170640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09940cf360 0x7f09940acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f099b170640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099406d130 con 0x7f099406ea20 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f099b170640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f099406ee90 con 0x7f09940ae910 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f099b170640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f099406d410 con 0x7f09940cf360 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f0998f0c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09940ae910 0x7f099406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f0998f0c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09940ae910 0x7f099406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35504/0 (socket says 172.21.15.79:35504) 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f0998f0c640 1 -- 172.21.15.79:0/2467060897 learned_addr learned my addr 172.21.15.79:0/2467060897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f099970d640 1 --2- 172.21.15.79:0/2467060897 >> v2:172.21.15.117:3300/0 conn(0x7f09940cf360 0x7f09940acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f0998f0c640 1 -- 172.21.15.79:0/2467060897 >> v2:172.21.15.117:3300/0 conn(0x7f09940cf360 msgr2=0x7f09940acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:30.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f0998f0c640 1 --2- 172.21.15.79:0/2467060897 >> v2:172.21.15.117:3300/0 conn(0x7f09940cf360 0x7f09940acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f0998f0c640 1 -- 172.21.15.79:0/2467060897 >> v1:172.21.15.117:6789/0 conn(0x7f099406ea20 legacy=0x7f09940cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:30.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.536+0000 7f0998f0c640 1 -- 172.21.15.79:0/2467060897 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099406d6f0 con 0x7f09940ae910 2024-06-10T00:22:30.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.537+0000 7f0998f0c640 1 --2- 172.21.15.79:0/2467060897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940ae910 0x7f099406e4e0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f099406fbc0 tx=0x7f098802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5838dec29a6f4cd0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.537+0000 7f09937fe640 1 -- 172.21.15.79:0/2467060897 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988032710 con 0x7f09940ae910 2024-06-10T00:22:30.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.537+0000 7f09937fe640 1 -- 172.21.15.79:0/2467060897 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09880328b0 con 0x7f09940ae910 2024-06-10T00:22:30.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.537+0000 7f09937fe640 1 -- 172.21.15.79:0/2467060897 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988032ca0 con 0x7f09940ae910 2024-06-10T00:22:30.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.538+0000 7f099b170640 1 -- 172.21.15.79:0/2467060897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940ae910 msgr2=0x7f099406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.538+0000 7f099b170640 1 --2- 172.21.15.79:0/2467060897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940ae910 0x7f099406e4e0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f099406fbc0 tx=0x7f098802c850 comp rx=0 tx=0).stop 2024-06-10T00:22:30.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.538+0000 7f099b170640 1 -- 172.21.15.79:0/2467060897 shutdown_connections 2024-06-10T00:22:30.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.538+0000 7f099b170640 1 --2- 172.21.15.79:0/2467060897 >> v2:172.21.15.117:3300/0 conn(0x7f09940cf360 0x7f09940acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.538+0000 7f099b170640 1 --2- 172.21.15.79:0/2467060897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940ae910 0x7f099406e4e0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.538+0000 7f099b170640 1 -- 172.21.15.79:0/2467060897 >> 172.21.15.79:0/2467060897 conn(0x7f09940b19f0 msgr2=0x7f09940b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:30.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.538+0000 7f099b170640 1 -- 172.21.15.79:0/2467060897 shutdown_connections 2024-06-10T00:22:30.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.538+0000 7f099b170640 1 -- 172.21.15.79:0/2467060897 wait complete. 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.539+0000 7f099b170640 1 Processor -- start 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.539+0000 7f099b170640 1 -- start start 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099b170640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099406ea20 0x7f099415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099b170640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940ae910 0x7f09941f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099b170640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940cf360 0x7f09941f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099b170640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09940ad280 con 0x7f09940cf360 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099b170640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f09940aecf0 con 0x7f09940ae910 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099b170640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f09940ad400 con 0x7f099406ea20 2024-06-10T00:22:30.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099970d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940cf360 0x7f09941f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099970d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940cf360 0x7f09941f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35508/0 (socket says 172.21.15.79:35508) 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099970d640 1 -- 172.21.15.79:0/2950595662 learned_addr learned my addr 172.21.15.79:0/2950595662 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f0993fff640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940ae910 0x7f09941f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f0998f0c640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099406ea20 0x7f099415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099970d640 1 -- 172.21.15.79:0/2950595662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099406ea20 msgr2=0x7f099415bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099970d640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099406ea20 0x7f099415bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099970d640 1 -- 172.21.15.79:0/2950595662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940ae910 msgr2=0x7f09941f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099970d640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940ae910 0x7f09941f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.540+0000 7f099970d640 1 -- 172.21.15.79:0/2950595662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099415c600 con 0x7f09940cf360 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.541+0000 7f099970d640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940cf360 0x7f09941f36b0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f098c007e70 tx=0x7f098c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.541+0000 7f09917fa640 1 -- 172.21.15.79:0/2950595662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c014620 con 0x7f09940cf360 2024-06-10T00:22:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.541+0000 7f09917fa640 1 -- 172.21.15.79:0/2950595662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c019070 con 0x7f09940cf360 2024-06-10T00:22:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.541+0000 7f09917fa640 1 -- 172.21.15.79:0/2950595662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c014a20 con 0x7f09940cf360 2024-06-10T00:22:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.541+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099415c8e0 con 0x7f09940cf360 2024-06-10T00:22:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.541+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09941f3190 con 0x7f09940cf360 2024-06-10T00:22:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.542+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09941f2cd0 con 0x7f09940cf360 2024-06-10T00:22:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.542+0000 7f09917fa640 1 -- 172.21.15.79:0/2950595662 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f098c014bc0 con 0x7f09940cf360 2024-06-10T00:22:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.543+0000 7f09917fa640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.543+0000 7f09917fa640 1 -- 172.21.15.79:0/2950595662 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f098c08ba60 con 0x7f09940cf360 2024-06-10T00:22:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.543+0000 7f0998f0c640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.543+0000 7f0998f0c640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097806be30 0x7f097806e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0988037000 tx=0x7f0988032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.547+0000 7f09917fa640 1 -- 172.21.15.79:0/2950595662 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f09941f2cd0 con 0x7f09940cf360 2024-06-10T00:22:30.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.760+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0994068430 con 0x7f09940cf360 2024-06-10T00:22:30.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.760+0000 7f09917fa640 1 -- 172.21.15.79:0/2950595662 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5190 (secure 0 0 0) 0x7f098c05a160 con 0x7f09940cf360 2024-06-10T00:22:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:30.760 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:20:24.159187+0000","modified":"2024-06-10T00:21:54.167947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6836/2006151468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2006151468},{"type":"v1","addr":"172.21.15.79:6836","nonce":2006151468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-06-10T00:22:30.760 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 62 2024-06-10T00:22:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097806be30 msgr2=0x7f097806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097806be30 0x7f097806e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0988037000 tx=0x7f0988032000 comp rx=0 tx=0).stop 2024-06-10T00:22:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940cf360 msgr2=0x7f09941f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940cf360 0x7f09941f36b0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f098c007e70 tx=0x7f098c00e4b0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 shutdown_connections 2024-06-10T00:22:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940cf360 0x7f09941f36b0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940ae910 0x7f09941f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 --2- 172.21.15.79:0/2950595662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099406ea20 0x7f099415bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 >> 172.21.15.79:0/2950595662 conn(0x7f09940b19f0 msgr2=0x7f0994071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 shutdown_connections 2024-06-10T00:22:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.762+0000 7f099b170640 1 -- 172.21.15.79:0/2950595662 wait complete. 2024-06-10T00:22:30.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:22:30.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.874+0000 7f57815f9640 1 Processor -- start 2024-06-10T00:22:30.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.874+0000 7f57815f9640 1 -- start start 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f57815f9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f577c0cfef0 0x7f577c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f57815f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577c06deb0 con 0x7f577c15c240 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f57815f9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577c06e190 con 0x7f577c06d9b0 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f57815f9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f577c15d630 con 0x7f577c0cfef0 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f577affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f577c15c240 0x7f577c06ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57474/0 (socket says 172.21.15.79:57474) 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f577affd640 1 -- 172.21.15.79:0/2088228386 learned_addr learned my addr 172.21.15.79:0/2088228386 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245032001 0 0) 0x7f577c06deb0 con 0x7f577c15c240 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5764003520 con 0x7f577c15c240 2024-06-10T00:22:30.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f577b7fe640 1 --2- 172.21.15.79:0/2088228386 >> v2:172.21.15.117:3300/0 conn(0x7f577c0cfef0 0x7f577c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1079568459 0 0) 0x7f5764003520 con 0x7f577c15c240 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 >> v2:172.21.15.117:3300/0 conn(0x7f577c0cfef0 msgr2=0x7f577c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 --2- 172.21.15.79:0/2088228386 >> v2:172.21.15.117:3300/0 conn(0x7f577c0cfef0 0x7f577c06c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 >> v1:172.21.15.117:6789/0 conn(0x7f577c06d9b0 legacy=0x7f577c15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c06e470 con 0x7f577c15c240 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f576c001670 con 0x7f577c15c240 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 >> v1:172.21.15.79:6789/0 conn(0x7f577c15c240 legacy=0x7f577c06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57640039b0 0x7f5764003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5764004800 0x7f5764004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57640051c0 0x7f576400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.875+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f577c15d630 con 0x7f57640051c0 2024-06-10T00:22:30.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f576400c060 con 0x7f57640039b0 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f576400c260 con 0x7f5764004800 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577b7fe640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57640051c0 0x7f576400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577affd640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57640039b0 0x7f5764003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577a7fc640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5764004800 0x7f5764004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577b7fe640 1 -- 172.21.15.79:0/2088228386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5764004800 msgr2=0x7f5764004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577b7fe640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5764004800 0x7f5764004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577b7fe640 1 -- 172.21.15.79:0/2088228386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57640039b0 msgr2=0x7f5764003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577b7fe640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57640039b0 0x7f5764003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577b7fe640 1 -- 172.21.15.79:0/2088228386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5764003520 con 0x7f57640051c0 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.876+0000 7f577b7fe640 1 -- 172.21.15.79:0/2088228386 reap_dead start 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f577b7fe640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57640051c0 0x7f576400b9c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5774009fc0 tx=0x7f5764005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21934f661673d39 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5774035020 con 0x7f57640051c0 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5774003bd0 con 0x7f57640051c0 2024-06-10T00:22:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f5779ffb640 1 -- 172.21.15.79:0/2088228386 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5774009c10 con 0x7f57640051c0 2024-06-10T00:22:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f57815f9640 1 -- 172.21.15.79:0/2088228386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57640051c0 msgr2=0x7f576400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f57815f9640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57640051c0 0x7f576400b9c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5774009fc0 tx=0x7f5764005830 comp rx=0 tx=0).stop 2024-06-10T00:22:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f57815f9640 1 -- 172.21.15.79:0/2088228386 shutdown_connections 2024-06-10T00:22:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f57815f9640 1 --2- 172.21.15.79:0/2088228386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57640051c0 0x7f576400b9c0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f57815f9640 1 -- 172.21.15.79:0/2088228386 >> 172.21.15.79:0/2088228386 conn(0x7f577c071950 msgr2=0x7f577c071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f57815f9640 1 -- 172.21.15.79:0/2088228386 shutdown_connections 2024-06-10T00:22:30.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.877+0000 7f57815f9640 1 -- 172.21.15.79:0/2088228386 wait complete. 2024-06-10T00:22:30.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f57815f9640 1 Processor -- start 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f57815f9640 1 -- start start 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f57815f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57640051c0 0x7f577c147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f57815f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0ae8d0 0x7f577c0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f57815f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f577c0b4620 0x7f577c0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f57815f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f577c0d02d0 con 0x7f577c0ae8d0 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f57815f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f577c06ea30 con 0x7f577c0b4620 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f57815f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f577c0aff60 con 0x7f57640051c0 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f577a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0ae8d0 0x7f577c0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f577a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0ae8d0 0x7f577c0aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35536/0 (socket says 172.21.15.79:35536) 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.879+0000 7f577a7fc640 1 -- 172.21.15.79:0/1904200123 learned_addr learned my addr 172.21.15.79:0/1904200123 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577b7fe640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f577c0b4620 0x7f577c0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577affd640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57640051c0 0x7f577c147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577a7fc640 1 -- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57640051c0 msgr2=0x7f577c147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577a7fc640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57640051c0 0x7f577c147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577a7fc640 1 -- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f577c0b4620 msgr2=0x7f577c0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577a7fc640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f577c0b4620 0x7f577c0b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577a7fc640 1 -- 172.21.15.79:0/1904200123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c153ee0 con 0x7f577c0ae8d0 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577affd640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57640051c0 0x7f577c147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f577a7fc640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0ae8d0 0x7f577c0aed50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5770007810 tx=0x7f577000fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f57637fe640 1 -- 172.21.15.79:0/1904200123 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57700052e0 con 0x7f577c0ae8d0 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f57637fe640 1 -- 172.21.15.79:0/1904200123 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5770018070 con 0x7f577c0ae8d0 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f57637fe640 1 -- 172.21.15.79:0/1904200123 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770003830 con 0x7f577c0ae8d0 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577c154180 con 0x7f577c0ae8d0 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.880+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577c154740 con 0x7f577c0ae8d0 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.881+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577c068430 con 0x7f577c0ae8d0 2024-06-10T00:22:30.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.882+0000 7f57637fe640 1 -- 172.21.15.79:0/1904200123 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57700039d0 con 0x7f577c0ae8d0 2024-06-10T00:22:30.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.882+0000 7f57637fe640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f576806be60 0x7f576806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:30.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.882+0000 7f57637fe640 1 -- 172.21.15.79:0/1904200123 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f577008ae40 con 0x7f577c0ae8d0 2024-06-10T00:22:30.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.882+0000 7f577affd640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f576806be60 0x7f576806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:30.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.882+0000 7f577affd640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f576806be60 0x7f576806e320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f576c001eb0 tx=0x7f576c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:30.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:30.886+0000 7f57637fe640 1 -- 172.21.15.79:0/1904200123 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5770059540 con 0x7f577c0ae8d0 2024-06-10T00:22:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.060+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f577c15eeb0 con 0x7f577c0ae8d0 2024-06-10T00:22:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.061+0000 7f57637fe640 1 -- 172.21.15.79:0/1904200123 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+17292 (secure 0 0 0) 0x7f5770058e40 con 0x7f577c0ae8d0 2024-06-10T00:22:31.061 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:31.061 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":92,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:21:50.147268+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:20:22.495363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-06-10T00:20:23.129127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.24","mappings":[{"from":1,"to":5}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6834/1800410806":"2024-06-11T00:21:50.147248+0000","172.21.15.79:6836/1800410806":"2024-06-11T00:21:50.147248+0000","172.21.15.117:6835/2747696124":"2024-06-11T00:20:32.967295+0000","172.21.15.117:6833/2747696124":"2024-06-11T00:20:32.967295+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:22:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.063+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f576806be60 msgr2=0x7f576806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.063+0000 7f57815f9640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f576806be60 0x7f576806e320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f576c001eb0 tx=0x7f576c009040 comp rx=0 tx=0).stop 2024-06-10T00:22:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.063+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0ae8d0 msgr2=0x7f577c0aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.063+0000 7f57815f9640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0ae8d0 0x7f577c0aed50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5770007810 tx=0x7f577000fa50 comp rx=0 tx=0).stop 2024-06-10T00:22:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.063+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 shutdown_connections 2024-06-10T00:22:31.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.063+0000 7f57815f9640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f576806be60 0x7f576806e320 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.063+0000 7f57815f9640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f577c0b4620 0x7f577c0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.064+0000 7f57815f9640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577c0ae8d0 0x7f577c0aed50 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.064+0000 7f57815f9640 1 --2- 172.21.15.79:0/1904200123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57640051c0 0x7f577c147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.064+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 >> 172.21.15.79:0/1904200123 conn(0x7f577c071950 msgr2=0x7f577c06c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:31.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.064+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 shutdown_connections 2024-06-10T00:22:31.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.064+0000 7f57815f9640 1 -- 172.21.15.79:0/1904200123 wait complete. 2024-06-10T00:22:31.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:22:31.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.175+0000 7f3c51529640 1 Processor -- start 2024-06-10T00:22:31.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.175+0000 7f3c51529640 1 -- start start 2024-06-10T00:22:31.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c51529640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c4c161830 0x7f3c4c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c51529640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3c4c161c10 0x7f3c4c0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c51529640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c0cebb0 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c51529640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3c4c0d4cf0 con 0x7f3c4c161830 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c51529640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3c4c0d2fc0 con 0x7f3c4c161c10 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c4affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c4c161830 0x7f3c4c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c4b7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3c4c0d0a00 0x7f3c4c1620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57480/0 (socket says 172.21.15.79:57480) 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c4affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c4c161830 0x7f3c4c0b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35538/0 (socket says 172.21.15.79:35538) 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c4b7fe640 1 -- 172.21.15.79:0/1685261307 learned_addr learned my addr 172.21.15.79:0/1685261307 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c427fc640 1 --2- 172.21.15.79:0/1685261307 >> v2:172.21.15.117:3300/0 conn(0x7f3c4c161c10 0x7f3c4c0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.176+0000 7f3c4affd640 1 -- 172.21.15.79:0/1685261307 >> v2:172.21.15.117:3300/0 conn(0x7f3c4c161c10 msgr2=0x7f3c4c0d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.177+0000 7f3c4affd640 1 --2- 172.21.15.79:0/1685261307 >> v2:172.21.15.117:3300/0 conn(0x7f3c4c161c10 0x7f3c4c0d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.177+0000 7f3c4affd640 1 -- 172.21.15.79:0/1685261307 >> v1:172.21.15.79:6789/0 conn(0x7f3c4c0d0a00 legacy=0x7f3c4c1620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.177+0000 7f3c4a7fc640 1 -- 172.21.15.79:0/1685261307 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420155872 0 0) 0x7f3c4c0cebb0 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.177+0000 7f3c4affd640 1 -- 172.21.15.79:0/1685261307 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c0d4f20 con 0x7f3c4c161830 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.177+0000 7f3c4affd640 1 --2- 172.21.15.79:0/1685261307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c161830 0x7f3c4c0b5270 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c08e890 tx=0x7f3c3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c7ab16c044a628 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.177+0000 7f3c4a7fc640 1 -- 172.21.15.79:0/1685261307 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c037070 con 0x7f3c4c161830 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.177+0000 7f3c4a7fc640 1 -- 172.21.15.79:0/1685261307 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c032440 con 0x7f3c4c161830 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.177+0000 7f3c4a7fc640 1 -- 172.21.15.79:0/1685261307 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c032810 con 0x7f3c4c161830 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.178+0000 7f3c51529640 1 -- 172.21.15.79:0/1685261307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c161830 msgr2=0x7f3c4c0b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.178+0000 7f3c51529640 1 --2- 172.21.15.79:0/1685261307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c161830 0x7f3c4c0b5270 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c08e890 tx=0x7f3c3c02a1a0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.178+0000 7f3c51529640 1 -- 172.21.15.79:0/1685261307 shutdown_connections 2024-06-10T00:22:31.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.178+0000 7f3c51529640 1 --2- 172.21.15.79:0/1685261307 >> v2:172.21.15.117:3300/0 conn(0x7f3c4c161c10 0x7f3c4c0d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.178+0000 7f3c51529640 1 --2- 172.21.15.79:0/1685261307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c161830 0x7f3c4c0b5270 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.178+0000 7f3c51529640 1 -- 172.21.15.79:0/1685261307 >> 172.21.15.79:0/1685261307 conn(0x7f3c4c09d3e0 msgr2=0x7f3c4c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:31.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.178+0000 7f3c51529640 1 -- 172.21.15.79:0/1685261307 shutdown_connections 2024-06-10T00:22:31.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.178+0000 7f3c51529640 1 -- 172.21.15.79:0/1685261307 wait complete. 2024-06-10T00:22:31.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.179+0000 7f3c51529640 1 Processor -- start 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.179+0000 7f3c51529640 1 -- start start 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c51529640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c0d0a00 0x7f3c4c0b8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c51529640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c161830 0x7f3c4c0b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c51529640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c4c161c10 0x7f3c4c14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c51529640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c0d2ce0 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c51529640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c0d2a00 con 0x7f3c4c161830 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c51529640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c0d0060 con 0x7f3c4c161c10 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c0d0a00 0x7f3c4c0b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c0d0a00 0x7f3c4c0b8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35548/0 (socket says 172.21.15.79:35548) 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4affd640 1 -- 172.21.15.79:0/2320423072 learned_addr learned my addr 172.21.15.79:0/2320423072 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c427fc640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c161830 0x7f3c4c0b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4b7fe640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c4c161c10 0x7f3c4c14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4affd640 1 -- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c4c161c10 msgr2=0x7f3c4c14f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4affd640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c4c161c10 0x7f3c4c14f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4affd640 1 -- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c161830 msgr2=0x7f3c4c0b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4affd640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c161830 0x7f3c4c0b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4affd640 1 -- 172.21.15.79:0/2320423072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c14f900 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.180+0000 7f3c4b7fe640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c4c161c10 0x7f3c4c14f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.181+0000 7f3c4affd640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c0d0a00 0x7f3c4c0b8720 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c000c00 tx=0x7f3c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.181+0000 7f3c43fff640 1 -- 172.21.15.79:0/2320423072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c037040 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.181+0000 7f3c43fff640 1 -- 172.21.15.79:0/2320423072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c042070 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.181+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c0b9710 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.181+0000 7f3c43fff640 1 -- 172.21.15.79:0/2320423072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c030bd0 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.181+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c0b7f20 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.182+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c068430 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.182+0000 7f3c43fff640 1 -- 172.21.15.79:0/2320423072 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c3c047460 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.183+0000 7f3c43fff640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3c2c06be30 0x7f3c2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.183+0000 7f3c427fc640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3c2c06be30 0x7f3c2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.183+0000 7f3c43fff640 1 -- 172.21.15.79:0/2320423072 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6389+0+0 (secure 0 0 0) 0x7f3c3c0abd10 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.183+0000 7f3c427fc640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3c2c06be30 0x7f3c2c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c160840 tx=0x7f3c34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:31.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.187+0000 7f3c43fff640 1 -- 172.21.15.79:0/2320423072 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3c3c032e20 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.398+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3c4c0d1650 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.398 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:22:31.399+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:22:31.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.400+0000 7f3c43fff640 1 -- 172.21.15.79:0/2320423072 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) ==== 161+0+0 (secure 0 0 0) 0x7f3c3c07a410 con 0x7f3c4c0d0a00 2024-06-10T00:22:31.400 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:22:31.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.402+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3c2c06be30 msgr2=0x7f3c2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.402+0000 7f3c51529640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3c2c06be30 0x7f3c2c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c160840 tx=0x7f3c34008040 comp rx=0 tx=0).stop 2024-06-10T00:22:31.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.402+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c0d0a00 msgr2=0x7f3c4c0b8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.402+0000 7f3c51529640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c0d0a00 0x7f3c4c0b8720 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c000c00 tx=0x7f3c3c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.402+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 shutdown_connections 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.402+0000 7f3c51529640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3c2c06be30 0x7f3c2c06e2f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.402+0000 7f3c51529640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c4c161c10 0x7f3c4c14f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.403+0000 7f3c51529640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c161830 0x7f3c4c0b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.403+0000 7f3c51529640 1 --2- 172.21.15.79:0/2320423072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c4c0d0a00 0x7f3c4c0b8720 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.403+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 >> 172.21.15.79:0/2320423072 conn(0x7f3c4c09d3e0 msgr2=0x7f3c4c0c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.403+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 shutdown_connections 2024-06-10T00:22:31.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.403+0000 7f3c51529640 1 -- 172.21.15.79:0/2320423072 wait complete. 2024-06-10T00:22:31.405 INFO:tasks.ceph.mds.a.smithi079.stderr: -2206> 2024-06-10T00:21:56.157+0000 7f39282b1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:22:31.405 INFO:tasks.ceph.mds.a.smithi079.stderr: -1819> 2024-06-10T00:21:57.213+0000 7f39242a9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x55f405fd2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v6>,<0x1/dir v13>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-10T00:22:31.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-10T00:22:31.432 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:22:31.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.518+0000 7f12b8b89640 1 Processor -- start 2024-06-10T00:22:31.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.518+0000 7f12b8b89640 1 -- start start 2024-06-10T00:22:31.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12b8b89640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f12b40b3bf0 0x7f12b406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12b8b89640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b4155000 con 0x7f12b406d500 2024-06-10T00:22:31.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12b8b89640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b406dd30 con 0x7f12b4154c20 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12b8b89640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f12b406e010 con 0x7f12b40b3bf0 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12abfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f12b40b3bf0 0x7f12b406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12b2d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f12b406d500 0x7f12b4071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57492/0 (socket says 172.21.15.79:57492) 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12b2d9d640 1 -- 172.21.15.79:0/1369701249 learned_addr learned my addr 172.21.15.79:0/1369701249 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12abfff640 1 -- 172.21.15.79:0/1369701249 >> v1:172.21.15.117:6789/0 conn(0x7f12b4154c20 legacy=0x7f12b40b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12b1d9b640 1 -- 172.21.15.79:0/1369701249 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902381559 0 0) 0x7f12b4155000 con 0x7f12b406d500 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12abfff640 1 -- 172.21.15.79:0/1369701249 >> v1:172.21.15.79:6789/0 conn(0x7f12b406d500 legacy=0x7f12b4071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.519+0000 7f12abfff640 1 -- 172.21.15.79:0/1369701249 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b406e2f0 con 0x7f12b40b3bf0 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.520+0000 7f12abfff640 1 --2- 172.21.15.79:0/1369701249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b40b3bf0 0x7f12b406cfc0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f129c0097a0 tx=0x7f129c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2235afa65c675e5f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.520+0000 7f12b1d9b640 1 -- 172.21.15.79:0/1369701249 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c037070 con 0x7f12b40b3bf0 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.520+0000 7f12b1d9b640 1 -- 172.21.15.79:0/1369701249 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c032440 con 0x7f12b40b3bf0 2024-06-10T00:22:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.520+0000 7f12b1d9b640 1 -- 172.21.15.79:0/1369701249 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c032810 con 0x7f12b40b3bf0 2024-06-10T00:22:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.521+0000 7f12b8b89640 1 -- 172.21.15.79:0/1369701249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b40b3bf0 msgr2=0x7f12b406cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.521+0000 7f12b8b89640 1 --2- 172.21.15.79:0/1369701249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b40b3bf0 0x7f12b406cfc0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f129c0097a0 tx=0x7f129c02a230 comp rx=0 tx=0).stop 2024-06-10T00:22:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.521+0000 7f12b8b89640 1 -- 172.21.15.79:0/1369701249 shutdown_connections 2024-06-10T00:22:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.521+0000 7f12b8b89640 1 --2- 172.21.15.79:0/1369701249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b40b3bf0 0x7f12b406cfc0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.521+0000 7f12b8b89640 1 -- 172.21.15.79:0/1369701249 >> 172.21.15.79:0/1369701249 conn(0x7f12b40b1d10 msgr2=0x7f12b40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.521+0000 7f12b8b89640 1 -- 172.21.15.79:0/1369701249 shutdown_connections 2024-06-10T00:22:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.521+0000 7f12b8b89640 1 -- 172.21.15.79:0/1369701249 wait complete. 2024-06-10T00:22:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.522+0000 7f12b8b89640 1 Processor -- start 2024-06-10T00:22:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.522+0000 7f12b8b89640 1 -- start start 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b8b89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b406d500 0x7f12b40ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b8b89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b40b3bf0 0x7f12b41497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b8b89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b4154c20 0x7f12b409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b8b89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12b406daf0 con 0x7f12b4154c20 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b8b89640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f12b406d970 con 0x7f12b406d500 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b8b89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f12b40d0020 con 0x7f12b40b3bf0 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b4154c20 0x7f12b409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b4154c20 0x7f12b409cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35588/0 (socket says 172.21.15.79:35588) 2024-06-10T00:22:31.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 -- 172.21.15.79:0/672429287 learned_addr learned my addr 172.21.15.79:0/672429287 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12abfff640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b40b3bf0 0x7f12b41497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b259c640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b406d500 0x7f12b40ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 -- 172.21.15.79:0/672429287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b40b3bf0 msgr2=0x7f12b41497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b40b3bf0 0x7f12b41497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 -- 172.21.15.79:0/672429287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b406d500 msgr2=0x7f12b40ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b406d500 0x7f12b40ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 -- 172.21.15.79:0/672429287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b40721b0 con 0x7f12b4154c20 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b2d9d640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b4154c20 0x7f12b409cc20 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c7a0 tx=0x7f12ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12aaffd640 1 -- 172.21.15.79:0/672429287 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac018070 con 0x7f12b4154c20 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12aaffd640 1 -- 172.21.15.79:0/672429287 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ac00a640 con 0x7f12b4154c20 2024-06-10T00:22:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12aaffd640 1 -- 172.21.15.79:0/672429287 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00aa70 con 0x7f12b4154c20 2024-06-10T00:22:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.523+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b4155df0 con 0x7f12b4154c20 2024-06-10T00:22:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.524+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b4156370 con 0x7f12b4154c20 2024-06-10T00:22:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.525+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b4156a30 con 0x7f12b4154c20 2024-06-10T00:22:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.525+0000 7f12aaffd640 1 -- 172.21.15.79:0/672429287 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12ac01b070 con 0x7f12b4154c20 2024-06-10T00:22:31.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.525+0000 7f12aaffd640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f129406be30 0x7f129406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:31.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.525+0000 7f12b259c640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f129406be30 0x7f129406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:31.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.525+0000 7f12aaffd640 1 -- 172.21.15.79:0/672429287 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6475+0+0 (secure 0 0 0) 0x7f12ac08a5f0 con 0x7f12b4154c20 2024-06-10T00:22:31.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.526+0000 7f12b259c640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f129406be30 0x7f129406e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000f60 tx=0x7f12a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:31.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.530+0000 7f12aaffd640 1 -- 172.21.15.79:0/672429287 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f12b4156a30 con 0x7f12b4154c20 2024-06-10T00:22:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:31.742+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f12b4157f80 con 0x7f12b4154c20 2024-06-10T00:22:32.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.402+0000 7f12aaffd640 1 -- 172.21.15.79:0/672429287 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7f12ac0586e0 con 0x7f12b4154c20 2024-06-10T00:22:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f129406be30 msgr2=0x7f129406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f129406be30 0x7f129406e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000f60 tx=0x7f12a4009040 comp rx=0 tx=0).stop 2024-06-10T00:22:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b4154c20 msgr2=0x7f12b409cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b4154c20 0x7f12b409cc20 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c7a0 tx=0x7f12ac00cc60 comp rx=0 tx=0).stop 2024-06-10T00:22:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 shutdown_connections 2024-06-10T00:22:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f129406be30 0x7f129406e2f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b4154c20 0x7f12b409cc20 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b40b3bf0 0x7f12b41497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 --2- 172.21.15.79:0/672429287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b406d500 0x7f12b40ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 >> 172.21.15.79:0/672429287 conn(0x7f12b40b1d10 msgr2=0x7f12b414aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 shutdown_connections 2024-06-10T00:22:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.404+0000 7f12b8b89640 1 -- 172.21.15.79:0/672429287 wait complete. 2024-06-10T00:22:32.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-10T00:22:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.566+0000 7f9a69093640 1 Processor -- start 2024-06-10T00:22:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.566+0000 7f9a69093640 1 -- start start 2024-06-10T00:22:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.566+0000 7f9a69093640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a64155590 0x7f9a6415b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.566+0000 7f9a69093640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9a640cf370 0x7f9a640ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.566+0000 7f9a69093640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a640acd40 con 0x7f9a6415b9a0 2024-06-10T00:22:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.566+0000 7f9a69093640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6415bfe0 con 0x7f9a640cf370 2024-06-10T00:22:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.566+0000 7f9a69093640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6415c2c0 con 0x7f9a64155590 2024-06-10T00:22:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a6359e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9a640cf370 0x7f9a640ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a6359e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9a640cf370 0x7f9a640ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35590/0 (socket says 172.21.15.79:35590) 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a6359e640 1 -- 172.21.15.79:0/1036986915 learned_addr learned my addr 172.21.15.79:0/1036986915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a6359e640 1 -- 172.21.15.79:0/1036986915 >> v2:172.21.15.117:3300/0 conn(0x7f9a64155590 msgr2=0x7f9a6415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a62d9d640 1 --2- 172.21.15.79:0/1036986915 >> v2:172.21.15.117:3300/0 conn(0x7f9a64155590 0x7f9a6415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a6359e640 1 --2- 172.21.15.79:0/1036986915 >> v2:172.21.15.117:3300/0 conn(0x7f9a64155590 0x7f9a6415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a6359e640 1 -- 172.21.15.79:0/1036986915 >> v1:172.21.15.117:6789/0 conn(0x7f9a6415b9a0 legacy=0x7f9a640cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a6359e640 1 -- 172.21.15.79:0/1036986915 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a640ad000 con 0x7f9a640cf370 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.567+0000 7f9a62d9d640 1 --2- 172.21.15.79:0/1036986915 >> v2:172.21.15.117:3300/0 conn(0x7f9a64155590 0x7f9a6415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a6359e640 1 --2- 172.21.15.79:0/1036986915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a640cf370 0x7f9a640ad800 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9a64074220 tx=0x7f9a5c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab58279423bee9ba server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a6259c640 1 -- 172.21.15.79:0/1036986915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c036070 con 0x7f9a640cf370 2024-06-10T00:22:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a6259c640 1 -- 172.21.15.79:0/1036986915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c031600 con 0x7f9a640cf370 2024-06-10T00:22:32.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a6259c640 1 -- 172.21.15.79:0/1036986915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0319d0 con 0x7f9a640cf370 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a69093640 1 -- 172.21.15.79:0/1036986915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a640cf370 msgr2=0x7f9a640ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a69093640 1 --2- 172.21.15.79:0/1036986915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a640cf370 0x7f9a640ad800 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9a64074220 tx=0x7f9a5c02a6f0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a69093640 1 -- 172.21.15.79:0/1036986915 shutdown_connections 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a69093640 1 --2- 172.21.15.79:0/1036986915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a640cf370 0x7f9a640ad800 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a69093640 1 --2- 172.21.15.79:0/1036986915 >> v2:172.21.15.117:3300/0 conn(0x7f9a64155590 0x7f9a6415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a69093640 1 -- 172.21.15.79:0/1036986915 >> 172.21.15.79:0/1036986915 conn(0x7f9a640b1980 msgr2=0x7f9a640b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a69093640 1 -- 172.21.15.79:0/1036986915 shutdown_connections 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.568+0000 7f9a69093640 1 -- 172.21.15.79:0/1036986915 wait complete. 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a69093640 1 Processor -- start 2024-06-10T00:22:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a69093640 1 -- start start 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a69093640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a640cf370 0x7f9a6409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a69093640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a64155590 0x7f9a641512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a69093640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a6415b9a0 0x7f9a6414f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a69093640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a640add40 con 0x7f9a6415b9a0 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a69093640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a640b26d0 con 0x7f9a640cf370 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a69093640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9a640adec0 con 0x7f9a64155590 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a6359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a6415b9a0 0x7f9a6414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a6359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a6415b9a0 0x7f9a6414f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35600/0 (socket says 172.21.15.79:35600) 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.570+0000 7f9a6359e640 1 -- 172.21.15.79:0/3096959248 learned_addr learned my addr 172.21.15.79:0/3096959248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a62d9d640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a640cf370 0x7f9a6409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a6359e640 1 -- 172.21.15.79:0/3096959248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a64155590 msgr2=0x7f9a641512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a6359e640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a64155590 0x7f9a641512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a6359e640 1 -- 172.21.15.79:0/3096959248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a640cf370 msgr2=0x7f9a6409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a6359e640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a640cf370 0x7f9a6409ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a6359e640 1 -- 172.21.15.79:0/3096959248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a64151810 con 0x7f9a6415b9a0 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a6359e640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a6415b9a0 0x7f9a6414f430 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c02ace0 tx=0x7f9a5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a5b7fe640 1 -- 172.21.15.79:0/3096959248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c036050 con 0x7f9a6415b9a0 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a5b7fe640 1 -- 172.21.15.79:0/3096959248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c042070 con 0x7f9a6415b9a0 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6409c0f0 con 0x7f9a6415b9a0 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a5b7fe640 1 -- 172.21.15.79:0/3096959248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c009510 con 0x7f9a6415b9a0 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.571+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6409c6b0 con 0x7f9a6415b9a0 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.572+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a64068540 con 0x7f9a6415b9a0 2024-06-10T00:22:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.572+0000 7f9a5b7fe640 1 -- 172.21.15.79:0/3096959248 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a5c007bb0 con 0x7f9a6415b9a0 2024-06-10T00:22:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.573+0000 7f9a5b7fe640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9a4406be30 0x7f9a4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.573+0000 7f9a62d9d640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9a4406be30 0x7f9a4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.573+0000 7f9a5b7fe640 1 -- 172.21.15.79:0/3096959248 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6475+0+0 (secure 0 0 0) 0x7f9a5c0abfb0 con 0x7f9a6415b9a0 2024-06-10T00:22:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.573+0000 7f9a62d9d640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9a4406be30 0x7f9a4406e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9a6415cc90 tx=0x7f9a54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.577+0000 7f9a5b7fe640 1 -- 172.21.15.79:0/3096959248 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9a5c07a6f0 con 0x7f9a6415b9a0 2024-06-10T00:22:32.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:32.753+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a640d0b60 con 0x7f9a6415b9a0 2024-06-10T00:22:33.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.403+0000 7f9a5b7fe640 1 -- 172.21.15.79:0/3096959248 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7f9a5c079ff0 con 0x7f9a6415b9a0 2024-06-10T00:22:33.403 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-06-10T00:22:33.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.405+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9a4406be30 msgr2=0x7f9a4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:33.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9a4406be30 0x7f9a4406e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9a6415cc90 tx=0x7f9a54008040 comp rx=0 tx=0).stop 2024-06-10T00:22:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a6415b9a0 msgr2=0x7f9a6414f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a6415b9a0 0x7f9a6414f430 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c02ace0 tx=0x7f9a5c004a40 comp rx=0 tx=0).stop 2024-06-10T00:22:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 shutdown_connections 2024-06-10T00:22:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9a4406be30 0x7f9a4406e2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a6415b9a0 0x7f9a6414f430 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a64155590 0x7f9a641512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 --2- 172.21.15.79:0/3096959248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a640cf370 0x7f9a6409ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 >> 172.21.15.79:0/3096959248 conn(0x7f9a640b1980 msgr2=0x7f9a6406eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:33.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 shutdown_connections 2024-06-10T00:22:33.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.406+0000 7f9a69093640 1 -- 172.21.15.79:0/3096959248 wait complete. 2024-06-10T00:22:33.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-10T00:22:33.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.529+0000 7f229ae1c640 1 Processor -- start 2024-06-10T00:22:33.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.529+0000 7f229ae1c640 1 -- start start 2024-06-10T00:22:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.529+0000 7f229ae1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 0x7f229415b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f229ae1c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f229415b9a0 0x7f22940cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f229ae1c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22940cf1a0 0x7f229415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f229ae1c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f22940acd40 con 0x7f22940cf1a0 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f229ae1c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f229415bfe0 con 0x7f229415b9a0 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f229ae1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f229415c2c0 con 0x7f2294155590 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f22993b9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22940cf1a0 0x7f229415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f22993b9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22940cf1a0 0x7f229415eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35602/0 (socket says 172.21.15.79:35602) 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f22993b9640 1 -- 172.21.15.79:0/2161084652 learned_addr learned my addr 172.21.15.79:0/2161084652 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f2293fff640 1 --2- 172.21.15.79:0/2161084652 >> v2:172.21.15.117:3300/0 conn(0x7f229415b9a0 0x7f22940cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f2298bb8640 1 --2- 172.21.15.79:0/2161084652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 0x7f229415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f22993b9640 1 -- 172.21.15.79:0/2161084652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 msgr2=0x7f229415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f22993b9640 1 --2- 172.21.15.79:0/2161084652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 0x7f229415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f22993b9640 1 -- 172.21.15.79:0/2161084652 >> v2:172.21.15.117:3300/0 conn(0x7f229415b9a0 msgr2=0x7f22940cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f22993b9640 1 --2- 172.21.15.79:0/2161084652 >> v2:172.21.15.117:3300/0 conn(0x7f229415b9a0 0x7f22940cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f22993b9640 1 -- 172.21.15.79:0/2161084652 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22940ad000 con 0x7f22940cf1a0 2024-06-10T00:22:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f2298bb8640 1 --2- 172.21.15.79:0/2161084652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 0x7f229415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.530+0000 7f2293fff640 1 --2- 172.21.15.79:0/2161084652 >> v2:172.21.15.117:3300/0 conn(0x7f229415b9a0 0x7f22940cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f22993b9640 1 --2- 172.21.15.79:0/2161084652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f229415eaa0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2294075090 tx=0x7f227c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b7efe99f14004 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f22937fe640 1 -- 172.21.15.79:0/2161084652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c037070 con 0x7f22940cf1a0 2024-06-10T00:22:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f22937fe640 1 -- 172.21.15.79:0/2161084652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c032440 con 0x7f22940cf1a0 2024-06-10T00:22:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f22937fe640 1 -- 172.21.15.79:0/2161084652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c032810 con 0x7f22940cf1a0 2024-06-10T00:22:33.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 -- 172.21.15.79:0/2161084652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 msgr2=0x7f229415eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:33.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 --2- 172.21.15.79:0/2161084652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f229415eaa0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2294075090 tx=0x7f227c02a1e0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 -- 172.21.15.79:0/2161084652 shutdown_connections 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 --2- 172.21.15.79:0/2161084652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f229415eaa0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 --2- 172.21.15.79:0/2161084652 >> v2:172.21.15.117:3300/0 conn(0x7f229415b9a0 0x7f22940cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 --2- 172.21.15.79:0/2161084652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 0x7f229415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 -- 172.21.15.79:0/2161084652 >> 172.21.15.79:0/2161084652 conn(0x7f22940b1980 msgr2=0x7f22940b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 -- 172.21.15.79:0/2161084652 shutdown_connections 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.531+0000 7f229ae1c640 1 -- 172.21.15.79:0/2161084652 wait complete. 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.533+0000 7f229ae1c640 1 Processor -- start 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.533+0000 7f229ae1c640 1 -- start start 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.533+0000 7f229ae1c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f22941477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.533+0000 7f229ae1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 0x7f22940aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.533+0000 7f229ae1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f229415b9a0 0x7f229406df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.533+0000 7f229ae1c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f229415efe0 con 0x7f22940cf1a0 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.533+0000 7f229ae1c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22940b26d0 con 0x7f229415b9a0 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.533+0000 7f229ae1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f229415f160 con 0x7f2294155590 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f22941477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f22941477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35618/0 (socket says 172.21.15.79:35618) 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 -- 172.21.15.79:0/3073309869 learned_addr learned my addr 172.21.15.79:0/3073309869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 -- 172.21.15.79:0/3073309869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 msgr2=0x7f22940aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 0x7f22940aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 -- 172.21.15.79:0/3073309869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f229415b9a0 msgr2=0x7f229406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f229415b9a0 0x7f229406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 -- 172.21.15.79:0/3073309869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229409b010 con 0x7f22940cf1a0 2024-06-10T00:22:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f2298bb8640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f22941477e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f228c00c7c0 tx=0x7f228c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f22917fa640 1 -- 172.21.15.79:0/3073309869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c015070 con 0x7f22940cf1a0 2024-06-10T00:22:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f22917fa640 1 -- 172.21.15.79:0/3073309869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228c007a30 con 0x7f22940cf1a0 2024-06-10T00:22:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f22917fa640 1 -- 172.21.15.79:0/3073309869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c007e00 con 0x7f22940cf1a0 2024-06-10T00:22:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229409b2f0 con 0x7f22940cf1a0 2024-06-10T00:22:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.534+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f229409b8b0 con 0x7f22940cf1a0 2024-06-10T00:22:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.535+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2294068540 con 0x7f22940cf1a0 2024-06-10T00:22:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.536+0000 7f22917fa640 1 -- 172.21.15.79:0/3073309869 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f228c018070 con 0x7f22940cf1a0 2024-06-10T00:22:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.536+0000 7f22917fa640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f227406be30 0x7f227406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.536+0000 7f22917fa640 1 -- 172.21.15.79:0/3073309869 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6037+0+0 (secure 0 0 0) 0x7f228c08ae90 con 0x7f22940cf1a0 2024-06-10T00:22:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.536+0000 7f2293fff640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f227406be30 0x7f227406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.536+0000 7f2293fff640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f227406be30 0x7f227406e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2294151720 tx=0x7f2284008330 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:33.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.540+0000 7f22917fa640 1 -- 172.21.15.79:0/3073309869 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f228c059780 con 0x7f22940cf1a0 2024-06-10T00:22:33.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:33.714+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f229409acc0 con 0x7f22940cf1a0 2024-06-10T00:22:34.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.413+0000 7f22917fa640 1 -- 172.21.15.79:0/3073309869 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f228c059080 con 0x7f22940cf1a0 2024-06-10T00:22:34.413 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-06-10T00:22:34.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.417+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f227406be30 msgr2=0x7f227406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.417+0000 7f229ae1c640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f227406be30 0x7f227406e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2294151720 tx=0x7f2284008330 comp rx=0 tx=0).stop 2024-06-10T00:22:34.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.417+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 msgr2=0x7f22941477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.417+0000 7f229ae1c640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f22941477e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f228c00c7c0 tx=0x7f228c00cc80 comp rx=0 tx=0).stop 2024-06-10T00:22:34.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.418+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 shutdown_connections 2024-06-10T00:22:34.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.418+0000 7f229ae1c640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f227406be30 0x7f227406e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.418+0000 7f229ae1c640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f229415b9a0 0x7f229406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.418+0000 7f229ae1c640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2294155590 0x7f22940aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.418+0000 7f229ae1c640 1 --2- 172.21.15.79:0/3073309869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22940cf1a0 0x7f22941477e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.418+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 >> 172.21.15.79:0/3073309869 conn(0x7f22940b1980 msgr2=0x7f22940afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:34.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.418+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 shutdown_connections 2024-06-10T00:22:34.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.418+0000 7f229ae1c640 1 -- 172.21.15.79:0/3073309869 wait complete. 2024-06-10T00:22:34.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-10T00:22:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.533+0000 7f4634e1c640 1 Processor -- start 2024-06-10T00:22:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.534+0000 7f4634e1c640 1 -- start start 2024-06-10T00:22:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.534+0000 7f4634e1c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4630155320 0x7f46300b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f4634e1c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46300d0730 0x7f463006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f4634e1c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4630155700 con 0x7f46300b34e0 2024-06-10T00:22:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f4634e1c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f463015b6b0 con 0x7f4630155320 2024-06-10T00:22:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f4634e1c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f463015b990 con 0x7f46300d0730 2024-06-10T00:22:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f462e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4630155320 0x7f46300b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f462dd9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f46300b34e0 0x7f46300d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57500/0 (socket says 172.21.15.79:57500) 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f462dd9b640 1 -- 172.21.15.79:0/2706291625 learned_addr learned my addr 172.21.15.79:0/2706291625 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f462e59c640 1 -- 172.21.15.79:0/2706291625 >> v2:172.21.15.117:3300/0 conn(0x7f46300d0730 msgr2=0x7f463006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f462e59c640 1 --2- 172.21.15.79:0/2706291625 >> v2:172.21.15.117:3300/0 conn(0x7f46300d0730 0x7f463006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f462e59c640 1 -- 172.21.15.79:0/2706291625 >> v1:172.21.15.79:6789/0 conn(0x7f46300b34e0 legacy=0x7f46300d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f462e59c640 1 -- 172.21.15.79:0/2706291625 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463015bc70 con 0x7f4630155320 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.535+0000 7f462d59a640 1 -- 172.21.15.79:0/2706291625 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1925304438 0 0) 0x7f4630155700 con 0x7f46300b34e0 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f462e59c640 1 --2- 172.21.15.79:0/2706291625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4630155320 0x7f46300b2fa0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f46300b52b0 tx=0x7f462002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487b3e2b84718c05 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f462d59a640 1 -- 172.21.15.79:0/2706291625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620037070 con 0x7f4630155320 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f462d59a640 1 -- 172.21.15.79:0/2706291625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620032440 con 0x7f4630155320 2024-06-10T00:22:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f462d59a640 1 -- 172.21.15.79:0/2706291625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620032810 con 0x7f4630155320 2024-06-10T00:22:34.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f4634e1c640 1 -- 172.21.15.79:0/2706291625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4630155320 msgr2=0x7f46300b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f4634e1c640 1 --2- 172.21.15.79:0/2706291625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4630155320 0x7f46300b2fa0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f46300b52b0 tx=0x7f462002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f4634e1c640 1 -- 172.21.15.79:0/2706291625 shutdown_connections 2024-06-10T00:22:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f4634e1c640 1 --2- 172.21.15.79:0/2706291625 >> v2:172.21.15.117:3300/0 conn(0x7f46300d0730 0x7f463006e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f4634e1c640 1 --2- 172.21.15.79:0/2706291625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4630155320 0x7f46300b2fa0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f4634e1c640 1 -- 172.21.15.79:0/2706291625 >> 172.21.15.79:0/2706291625 conn(0x7f46300b1d10 msgr2=0x7f46300b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f4634e1c640 1 -- 172.21.15.79:0/2706291625 shutdown_connections 2024-06-10T00:22:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.536+0000 7f4634e1c640 1 -- 172.21.15.79:0/2706291625 wait complete. 2024-06-10T00:22:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.538+0000 7f4634e1c640 1 Processor -- start 2024-06-10T00:22:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.538+0000 7f4634e1c640 1 -- start start 2024-06-10T00:22:34.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.538+0000 7f4634e1c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46300b34e0 0x7f46300afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.538+0000 7f4634e1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46300d0730 0x7f463014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.538+0000 7f4634e1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4630155320 0x7f46301573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.538+0000 7f4634e1c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f463015b470 con 0x7f46300b34e0 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.538+0000 7f4634e1c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f463015b2f0 con 0x7f4630155320 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.538+0000 7f4634e1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f463006e730 con 0x7f46300d0730 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46300b34e0 0x7f46300afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46300b34e0 0x7f46300afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35622/0 (socket says 172.21.15.79:35622) 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 -- 172.21.15.79:0/369710550 learned_addr learned my addr 172.21.15.79:0/369710550 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 -- 172.21.15.79:0/369710550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46300d0730 msgr2=0x7f463014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46300d0730 0x7f463014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 -- 172.21.15.79:0/369710550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4630155320 msgr2=0x7f46301573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462ed9d640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4630155320 0x7f46301573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4630155320 0x7f46301573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 -- 172.21.15.79:0/369710550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4630157e60 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f462e59c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46300b34e0 0x7f46300afea0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f4620035040 tx=0x7f46200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f461effd640 1 -- 172.21.15.79:0/369710550 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620037040 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f461effd640 1 -- 172.21.15.79:0/369710550 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620004230 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f461effd640 1 -- 172.21.15.79:0/369710550 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620032e20 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46300af3c0 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.539+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4630158140 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.540+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46300683c0 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.541+0000 7f461effd640 1 -- 172.21.15.79:0/369710550 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4620030770 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.541+0000 7f461effd640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461006be30 0x7f461006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.541+0000 7f461effd640 1 -- 172.21.15.79:0/369710550 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f46200ac210 con 0x7f46300b34e0 2024-06-10T00:22:34.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.541+0000 7f462dd9b640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461006be30 0x7f461006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.542+0000 7f462dd9b640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461006be30 0x7f461006e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4624007fd0 tx=0x7f4624007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:34.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.545+0000 7f461effd640 1 -- 172.21.15.79:0/369710550 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f462007ae30 con 0x7f46300b34e0 2024-06-10T00:22:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.722+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f46300d02d0 con 0x7f46300b34e0 2024-06-10T00:22:34.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.725+0000 7f461effd640 1 -- 172.21.15.79:0/369710550 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f462007a730 con 0x7f46300b34e0 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461006be30 msgr2=0x7f461006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461006be30 0x7f461006e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4624007fd0 tx=0x7f4624007920 comp rx=0 tx=0).stop 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46300b34e0 msgr2=0x7f46300afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46300b34e0 0x7f46300afea0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f4620035040 tx=0x7f46200046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 shutdown_connections 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461006be30 0x7f461006e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4630155320 0x7f46301573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46300d0730 0x7f463014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 --2- 172.21.15.79:0/369710550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46300b34e0 0x7f46300afea0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 >> 172.21.15.79:0/369710550 conn(0x7f46300b1d10 msgr2=0x7f4630153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 shutdown_connections 2024-06-10T00:22:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.727+0000 7f4634e1c640 1 -- 172.21.15.79:0/369710550 wait complete. 2024-06-10T00:22:34.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-06-10T00:22:34.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.837+0000 7f9f6008c640 1 Processor -- start 2024-06-10T00:22:34.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.837+0000 7f9f6008c640 1 -- start start 2024-06-10T00:22:34.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.838+0000 7f9f6008c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9f58158770 0x7f9f5806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.838+0000 7f9f6008c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 0x7f9f5806c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.838+0000 7f9f6008c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f5806e670 con 0x7f9f5806d9b0 2024-06-10T00:22:34.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.838+0000 7f9f6008c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9f5806e950 con 0x7f9f58158770 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.838+0000 7f9f6008c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5806ec30 con 0x7f9f58158b50 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.838+0000 7f9f5de28640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9f58158770 0x7f9f5806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.838+0000 7f9f5e629640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9f5806d9b0 0x7f9f5806de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57502/0 (socket says 172.21.15.79:57502) 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.838+0000 7f9f5e629640 1 -- 172.21.15.79:0/2204086138 learned_addr learned my addr 172.21.15.79:0/2204086138 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5d627640 1 --2- 172.21.15.79:0/2204086138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 0x7f9f5806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5de28640 1 -- 172.21.15.79:0/2204086138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 msgr2=0x7f9f5806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5de28640 1 --2- 172.21.15.79:0/2204086138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 0x7f9f5806c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5de28640 1 -- 172.21.15.79:0/2204086138 >> v1:172.21.15.79:6789/0 conn(0x7f9f5806d9b0 legacy=0x7f9f5806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5de28640 1 -- 172.21.15.79:0/2204086138 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f580ae890 con 0x7f9f58158770 2024-06-10T00:22:34.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5de28640 1 --2- 172.21.15.79:0/2204086138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f5806c3d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009d90 tx=0x7f9f4802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2677dd847539265 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:34.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5ce26640 1 -- 172.21.15.79:0/2204086138 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48031600 con 0x7f9f58158770 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5ce26640 1 -- 172.21.15.79:0/2204086138 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f480317a0 con 0x7f9f58158770 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.839+0000 7f9f5ce26640 1 -- 172.21.15.79:0/2204086138 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48031b70 con 0x7f9f58158770 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.840+0000 7f9f6008c640 1 -- 172.21.15.79:0/2204086138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 msgr2=0x7f9f5806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.840+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2204086138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f5806c3d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009d90 tx=0x7f9f4802a5d0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.840+0000 7f9f6008c640 1 -- 172.21.15.79:0/2204086138 shutdown_connections 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.840+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2204086138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 0x7f9f5806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.840+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2204086138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f5806c3d0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.840+0000 7f9f6008c640 1 -- 172.21.15.79:0/2204086138 >> 172.21.15.79:0/2204086138 conn(0x7f9f58071950 msgr2=0x7f9f58071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.840+0000 7f9f6008c640 1 -- 172.21.15.79:0/2204086138 shutdown_connections 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.840+0000 7f9f6008c640 1 -- 172.21.15.79:0/2204086138 wait complete. 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.841+0000 7f9f6008c640 1 Processor -- start 2024-06-10T00:22:34.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.841+0000 7f9f6008c640 1 -- start start 2024-06-10T00:22:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f6008c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f5806d9b0 0x7f9f581f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f6008c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f581591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f6008c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 0x7f9f581f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f6008c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f580aef30 con 0x7f9f58158770 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f6008c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9f580aedb0 con 0x7f9f5806d9b0 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f6008c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9f580af0b0 con 0x7f9f58158b50 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5d627640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f581591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5d627640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f581591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35640/0 (socket says 172.21.15.79:35640) 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5d627640 1 -- 172.21.15.79:0/2490778696 learned_addr learned my addr 172.21.15.79:0/2490778696 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5e629640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 0x7f9f581f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5d627640 1 -- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 msgr2=0x7f9f581f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5de28640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f5806d9b0 0x7f9f581f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5d627640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 0x7f9f581f7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5d627640 1 -- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f5806d9b0 msgr2=0x7f9f581f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5d627640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f5806d9b0 0x7f9f581f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5d627640 1 -- 172.21.15.79:0/2490778696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f581f7df0 con 0x7f9f58158770 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.842+0000 7f9f5de28640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f5806d9b0 0x7f9f581f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.843+0000 7f9f5d627640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f581591a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00d5f0 tx=0x7f9f4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.843+0000 7f9f567fc640 1 -- 172.21.15.79:0/2490778696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0125f0 con 0x7f9f58158770 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.843+0000 7f9f567fc640 1 -- 172.21.15.79:0/2490778696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f4c019070 con 0x7f9f58158770 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.843+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f581f80d0 con 0x7f9f58158770 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.843+0000 7f9f567fc640 1 -- 172.21.15.79:0/2490778696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0129d0 con 0x7f9f58158770 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.843+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5815b220 con 0x7f9f58158770 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.844+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f58068430 con 0x7f9f58158770 2024-06-10T00:22:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.844+0000 7f9f567fc640 1 -- 172.21.15.79:0/2490778696 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f4c012b70 con 0x7f9f58158770 2024-06-10T00:22:34.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.845+0000 7f9f567fc640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:34.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.845+0000 7f9f5de28640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:34.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.845+0000 7f9f567fc640 1 -- 172.21.15.79:0/2490778696 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f9f4c08b110 con 0x7f9f58158770 2024-06-10T00:22:34.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.845+0000 7f9f5de28640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f4406be30 0x7f9f4406e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9f48034000 tx=0x7f9f4802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:34.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:34.849+0000 7f9f567fc640 1 -- 172.21.15.79:0/2490778696 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f4c059c10 con 0x7f9f58158770 2024-06-10T00:22:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.103+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7f9f5806e120 con 0x7f9f58158770 2024-06-10T00:22:35.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.415+0000 7f9f567fc640 1 -- 172.21.15.79:0/2490778696 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v358) ==== 167+0+0 (secure 0 0 0) 0x7f9f4c059510 con 0x7f9f58158770 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f4406be30 msgr2=0x7f9f4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f4406be30 0x7f9f4406e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9f48034000 tx=0x7f9f4802f000 comp rx=0 tx=0).stop 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 msgr2=0x7f9f581591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f581591a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00d5f0 tx=0x7f9f4c00dab0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 shutdown_connections 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9f4406be30 0x7f9f4406e2f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f58158b50 0x7f9f581f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f58158770 0x7f9f581591a0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 --2- 172.21.15.79:0/2490778696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f5806d9b0 0x7f9f581f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 >> 172.21.15.79:0/2490778696 conn(0x7f9f58071950 msgr2=0x7f9f580b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 shutdown_connections 2024-06-10T00:22:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.417+0000 7f9f6008c640 1 -- 172.21.15.79:0/2490778696 wait complete. 2024-06-10T00:22:35.428 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-06-10T00:22:35.428 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-06-10T00:22:35.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:22:35.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.528+0000 7f3b09483640 1 Processor -- start 2024-06-10T00:22:35.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.528+0000 7f3b09483640 1 -- start start 2024-06-10T00:22:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.528+0000 7f3b09483640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b04161830 0x7f3b040b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b09483640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161c10 0x7f3b040d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b09483640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b040cebb0 con 0x7f3b040d0a00 2024-06-10T00:22:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b09483640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3b040d4cf0 con 0x7f3b04161830 2024-06-10T00:22:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b09483640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b040d2fc0 con 0x7f3b04161c10 2024-06-10T00:22:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b02ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b04161830 0x7f3b040b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b037fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3b040d0a00 0x7f3b041620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57518/0 (socket says 172.21.15.79:57518) 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b037fe640 1 -- 172.21.15.79:0/1789236838 learned_addr learned my addr 172.21.15.79:0/1789236838 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3afa7fc640 1 --2- 172.21.15.79:0/1789236838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161c10 0x7f3b040d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b02ffd640 1 -- 172.21.15.79:0/1789236838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161c10 msgr2=0x7f3b040d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b02ffd640 1 --2- 172.21.15.79:0/1789236838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161c10 0x7f3b040d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b02ffd640 1 -- 172.21.15.79:0/1789236838 >> v1:172.21.15.79:6789/0 conn(0x7f3b040d0a00 legacy=0x7f3b041620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b02ffd640 1 -- 172.21.15.79:0/1789236838 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b040d4f20 con 0x7f3b04161830 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.529+0000 7f3b027fc640 1 -- 172.21.15.79:0/1789236838 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506533828 0 0) 0x7f3b040cebb0 con 0x7f3b040d0a00 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b02ffd640 1 --2- 172.21.15.79:0/1789236838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b04161830 0x7f3b040b5270 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3af40097a0 tx=0x7f3af402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae7062d7ef16ee6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b027fc640 1 -- 172.21.15.79:0/1789236838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4037070 con 0x7f3b04161830 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b027fc640 1 -- 172.21.15.79:0/1789236838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4032440 con 0x7f3b04161830 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b027fc640 1 -- 172.21.15.79:0/1789236838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4032810 con 0x7f3b04161830 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b09483640 1 -- 172.21.15.79:0/1789236838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b04161830 msgr2=0x7f3b040b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b09483640 1 --2- 172.21.15.79:0/1789236838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b04161830 0x7f3b040b5270 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3af40097a0 tx=0x7f3af402a180 comp rx=0 tx=0).stop 2024-06-10T00:22:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b09483640 1 -- 172.21.15.79:0/1789236838 shutdown_connections 2024-06-10T00:22:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b09483640 1 --2- 172.21.15.79:0/1789236838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161c10 0x7f3b040d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b09483640 1 --2- 172.21.15.79:0/1789236838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b04161830 0x7f3b040b5270 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b09483640 1 -- 172.21.15.79:0/1789236838 >> 172.21.15.79:0/1789236838 conn(0x7f3b0409d3e0 msgr2=0x7f3b040d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b09483640 1 -- 172.21.15.79:0/1789236838 shutdown_connections 2024-06-10T00:22:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.530+0000 7f3b09483640 1 -- 172.21.15.79:0/1789236838 wait complete. 2024-06-10T00:22:35.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.531+0000 7f3b09483640 1 Processor -- start 2024-06-10T00:22:35.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b09483640 1 -- start start 2024-06-10T00:22:35.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b09483640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b040d0a00 0x7f3b040ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b09483640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161830 0x7f3b0414b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b09483640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04161c10 0x7f3b040c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b09483640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040d2ce0 con 0x7f3b040d0a00 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b09483640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040d2a00 con 0x7f3b04161c10 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b09483640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b040d0060 con 0x7f3b04161830 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b02ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b040d0a00 0x7f3b040ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.532+0000 7f3b02ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b040d0a00 0x7f3b040ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35662/0 (socket says 172.21.15.79:35662) 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b02ffd640 1 -- 172.21.15.79:0/1989816559 learned_addr learned my addr 172.21.15.79:0/1989816559 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b02ffd640 1 -- 172.21.15.79:0/1989816559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161830 msgr2=0x7f3b0414b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b02ffd640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161830 0x7f3b0414b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b02ffd640 1 -- 172.21.15.79:0/1989816559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04161c10 msgr2=0x7f3b040c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b02ffd640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04161c10 0x7f3b040c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b02ffd640 1 -- 172.21.15.79:0/1989816559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b040cd4d0 con 0x7f3b040d0a00 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b02ffd640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b040d0a00 0x7f3b040ccef0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3af4035040 tx=0x7f3af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3afbfff640 1 -- 172.21.15.79:0/1989816559 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4037040 con 0x7f3b040d0a00 2024-06-10T00:22:35.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3afbfff640 1 -- 172.21.15.79:0/1989816559 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4030770 con 0x7f3b040d0a00 2024-06-10T00:22:35.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b040cd7b0 con 0x7f3b040d0a00 2024-06-10T00:22:35.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3afbfff640 1 -- 172.21.15.79:0/1989816559 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4030b80 con 0x7f3b040d0a00 2024-06-10T00:22:35.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.533+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b040cdd70 con 0x7f3b040d0a00 2024-06-10T00:22:35.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.534+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b04068430 con 0x7f3b040d0a00 2024-06-10T00:22:35.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.535+0000 7f3afbfff640 1 -- 172.21.15.79:0/1989816559 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3af4044020 con 0x7f3b040d0a00 2024-06-10T00:22:35.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.535+0000 7f3afbfff640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ae406be30 0x7f3ae406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.535+0000 7f3afbfff640 1 -- 172.21.15.79:0/1989816559 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f3af40ab2e0 con 0x7f3b040d0a00 2024-06-10T00:22:35.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.535+0000 7f3afa7fc640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ae406be30 0x7f3ae406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.536+0000 7f3afa7fc640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ae406be30 0x7f3ae406e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3b040d4900 tx=0x7f3aec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:35.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.539+0000 7f3afbfff640 1 -- 172.21.15.79:0/1989816559 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3af4032e20 con 0x7f3b040d0a00 2024-06-10T00:22:35.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.712+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b040d1650 con 0x7f3b040d0a00 2024-06-10T00:22:35.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.713+0000 7f3afbfff640 1 -- 172.21.15.79:0/1989816559 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+13508 (secure 0 0 0) 0x7f3af4079d50 con 0x7f3b040d0a00 2024-06-10T00:22:35.713 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:35.713 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":95,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:22:34.412988+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6834/1800410806":"2024-06-11T00:21:50.147248+0000","172.21.15.79:6836/1800410806":"2024-06-11T00:21:50.147248+0000","172.21.15.117:6835/2747696124":"2024-06-11T00:20:32.967295+0000","172.21.15.79:6836/2006151468":"2024-06-11T00:22:31.399764+0000","172.21.15.79:6834/2006151468":"2024-06-11T00:22:31.399764+0000","172.21.15.117:6833/2747696124":"2024-06-11T00:20:32.967295+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ae406be30 msgr2=0x7f3ae406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ae406be30 0x7f3ae406e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3b040d4900 tx=0x7f3aec008040 comp rx=0 tx=0).stop 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b040d0a00 msgr2=0x7f3b040ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b040d0a00 0x7f3b040ccef0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3af4035040 tx=0x7f3af40046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 shutdown_connections 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3ae406be30 0x7f3ae406e2f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04161c10 0x7f3b040c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b04161830 0x7f3b0414b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 --2- 172.21.15.79:0/1989816559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b040d0a00 0x7f3b040ccef0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 >> 172.21.15.79:0/1989816559 conn(0x7f3b0409d3e0 msgr2=0x7f3b0406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 shutdown_connections 2024-06-10T00:22:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.715+0000 7f3b09483640 1 -- 172.21.15.79:0/1989816559 wait complete. 2024-06-10T00:22:35.726 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-10T00:14:31.177808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-10T00:22:35.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-10T00:22:35.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.828+0000 7f3491872640 1 Processor -- start 2024-06-10T00:22:35.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.828+0000 7f3491872640 1 -- start start 2024-06-10T00:22:35.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.829+0000 7f3491872640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f348c072950 0x7f348c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.829+0000 7f3491872640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f348c0ce400 0x7f348c0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.829+0000 7f3491872640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f348c0ce900 con 0x7f348c15c2c0 2024-06-10T00:22:35.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.829+0000 7f3491872640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f348c0b4ad0 con 0x7f348c0ce400 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.829+0000 7f3491872640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f348c0cebe0 con 0x7f348c072950 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.829+0000 7f348b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f348c0ce400 0x7f348c0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.829+0000 7f348b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f348c0ce400 0x7f348c0b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35664/0 (socket says 172.21.15.79:35664) 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.829+0000 7f348b7fe640 1 -- 172.21.15.79:0/1460055147 learned_addr learned my addr 172.21.15.79:0/1460055147 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f348b7fe640 1 -- 172.21.15.79:0/1460055147 >> v2:172.21.15.117:3300/0 conn(0x7f348c072950 msgr2=0x7f348c0b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f348a7fc640 1 --2- 172.21.15.79:0/1460055147 >> v2:172.21.15.117:3300/0 conn(0x7f348c072950 0x7f348c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f348b7fe640 1 --2- 172.21.15.79:0/1460055147 >> v2:172.21.15.117:3300/0 conn(0x7f348c072950 0x7f348c0b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f348b7fe640 1 -- 172.21.15.79:0/1460055147 >> v1:172.21.15.117:6789/0 conn(0x7f348c15c2c0 legacy=0x7f348c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f348b7fe640 1 -- 172.21.15.79:0/1460055147 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c0b4760 con 0x7f348c0ce400 2024-06-10T00:22:35.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f348a7fc640 1 --2- 172.21.15.79:0/1460055147 >> v2:172.21.15.117:3300/0 conn(0x7f348c072950 0x7f348c0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:35.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f348b7fe640 1 --2- 172.21.15.79:0/1460055147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c0ce400 0x7f348c0b54a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f348c071470 tx=0x7f348402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a482a27066f877a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:35.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f3489ffb640 1 -- 172.21.15.79:0/1460055147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484036070 con 0x7f348c0ce400 2024-06-10T00:22:35.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f3489ffb640 1 -- 172.21.15.79:0/1460055147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3484031600 con 0x7f348c0ce400 2024-06-10T00:22:35.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.830+0000 7f3489ffb640 1 -- 172.21.15.79:0/1460055147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34840319d0 con 0x7f348c0ce400 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.831+0000 7f3491872640 1 -- 172.21.15.79:0/1460055147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c0ce400 msgr2=0x7f348c0b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.831+0000 7f3491872640 1 --2- 172.21.15.79:0/1460055147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c0ce400 0x7f348c0b54a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f348c071470 tx=0x7f348402a660 comp rx=0 tx=0).stop 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.831+0000 7f3491872640 1 -- 172.21.15.79:0/1460055147 shutdown_connections 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.831+0000 7f3491872640 1 --2- 172.21.15.79:0/1460055147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c0ce400 0x7f348c0b54a0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.831+0000 7f3491872640 1 --2- 172.21.15.79:0/1460055147 >> v2:172.21.15.117:3300/0 conn(0x7f348c072950 0x7f348c0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.831+0000 7f3491872640 1 -- 172.21.15.79:0/1460055147 >> 172.21.15.79:0/1460055147 conn(0x7f348c0b22b0 msgr2=0x7f348c0b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.831+0000 7f3491872640 1 -- 172.21.15.79:0/1460055147 shutdown_connections 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.831+0000 7f3491872640 1 -- 172.21.15.79:0/1460055147 wait complete. 2024-06-10T00:22:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.832+0000 7f3491872640 1 Processor -- start 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.832+0000 7f3491872640 1 -- start start 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f3491872640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f348c072950 0x7f348c144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f3491872640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f348c0ce400 0x7f348c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f3491872640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c15c2c0 0x7f348c158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f3491872640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0afb10 con 0x7f348c15c2c0 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f3491872640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0b4410 con 0x7f348c072950 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f3491872640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f348c0afc90 con 0x7f348c0ce400 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c15c2c0 0x7f348c158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c15c2c0 0x7f348c158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35668/0 (socket says 172.21.15.79:35668) 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348b7fe640 1 -- 172.21.15.79:0/4166129459 learned_addr learned my addr 172.21.15.79:0/4166129459 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348affd640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f348c072950 0x7f348c144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348a7fc640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f348c0ce400 0x7f348c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348b7fe640 1 -- 172.21.15.79:0/4166129459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f348c0ce400 msgr2=0x7f348c1585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348b7fe640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f348c0ce400 0x7f348c1585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348b7fe640 1 -- 172.21.15.79:0/4166129459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f348c072950 msgr2=0x7f348c144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348b7fe640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f348c072950 0x7f348c144f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.833+0000 7f348b7fe640 1 -- 172.21.15.79:0/4166129459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c1f4f80 con 0x7f348c15c2c0 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.834+0000 7f348b7fe640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c15c2c0 0x7f348c158b00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f3484009f40 tx=0x7f3484004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.834+0000 7f3473fff640 1 -- 172.21.15.79:0/4166129459 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484036050 con 0x7f348c15c2c0 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.834+0000 7f3473fff640 1 -- 172.21.15.79:0/4166129459 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3484042070 con 0x7f348c15c2c0 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.834+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c145700 con 0x7f348c15c2c0 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.834+0000 7f3473fff640 1 -- 172.21.15.79:0/4166129459 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484009510 con 0x7f348c15c2c0 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.834+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c1f44a0 con 0x7f348c15c2c0 2024-06-10T00:22:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.835+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348c0683c0 con 0x7f348c15c2c0 2024-06-10T00:22:35.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.835+0000 7f3473fff640 1 -- 172.21.15.79:0/4166129459 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3484007bd0 con 0x7f348c15c2c0 2024-06-10T00:22:35.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.836+0000 7f3473fff640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f347806be30 0x7f347806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:35.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.836+0000 7f3473fff640 1 -- 172.21.15.79:0/4166129459 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f34840abd90 con 0x7f348c15c2c0 2024-06-10T00:22:35.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.836+0000 7f348affd640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f347806be30 0x7f347806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:35.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.836+0000 7f348affd640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f347806be30 0x7f347806e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f347c006fd0 tx=0x7f347c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:35.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:35.840+0000 7f3473fff640 1 -- 172.21.15.79:0/4166129459 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f348407a800 con 0x7f348c15c2c0 2024-06-10T00:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.013+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f348c0675e0 con 0x7f348c15c2c0 2024-06-10T00:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.014+0000 7f3473fff640 1 -- 172.21.15.79:0/4166129459 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f348407a100 con 0x7f348c15c2c0 2024-06-10T00:22:36.013 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-06-10T00:22:36.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f347806be30 msgr2=0x7f347806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f347806be30 0x7f347806e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f347c006fd0 tx=0x7f347c008040 comp rx=0 tx=0).stop 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c15c2c0 msgr2=0x7f348c158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c15c2c0 0x7f348c158b00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f3484009f40 tx=0x7f3484004a40 comp rx=0 tx=0).stop 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 shutdown_connections 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f347806be30 0x7f347806e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f348c15c2c0 0x7f348c158b00 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f348c0ce400 0x7f348c1585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 --2- 172.21.15.79:0/4166129459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f348c072950 0x7f348c144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 >> 172.21.15.79:0/4166129459 conn(0x7f348c0b22b0 msgr2=0x7f348c06b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 shutdown_connections 2024-06-10T00:22:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.016+0000 7f3491872640 1 -- 172.21.15.79:0/4166129459 wait complete. 2024-06-10T00:22:36.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-06-10T00:22:36.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.126+0000 7f19efd5c640 1 Processor -- start 2024-06-10T00:22:36.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.126+0000 7f19efd5c640 1 -- start start 2024-06-10T00:22:36.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19efd5c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19e8156830 0x7f19e8071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19efd5c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19e8072130 0x7f19e80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19efd5c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e815c7f0 0x7f19e80ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19efd5c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f19e80b3090 con 0x7f19e8156830 2024-06-10T00:22:36.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19efd5c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f19e80725f0 con 0x7f19e8072130 2024-06-10T00:22:36.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19efd5c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f19e80728d0 con 0x7f19e815c7f0 2024-06-10T00:22:36.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19edaf8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19e8156830 0x7f19e8071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19edaf8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19e8156830 0x7f19e8071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35672/0 (socket says 172.21.15.79:35672) 2024-06-10T00:22:36.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.127+0000 7f19edaf8640 1 -- 172.21.15.79:0/2902907615 learned_addr learned my addr 172.21.15.79:0/2902907615 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:36.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19edaf8640 1 -- 172.21.15.79:0/2902907615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e815c7f0 msgr2=0x7f19e80ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:36.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19edaf8640 1 --2- 172.21.15.79:0/2902907615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e815c7f0 0x7f19e80ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19edaf8640 1 -- 172.21.15.79:0/2902907615 >> v2:172.21.15.117:3300/0 conn(0x7f19e8072130 msgr2=0x7f19e80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:36.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19edaf8640 1 --2- 172.21.15.79:0/2902907615 >> v2:172.21.15.117:3300/0 conn(0x7f19e8072130 0x7f19e80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19edaf8640 1 -- 172.21.15.79:0/2902907615 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e8072bb0 con 0x7f19e8156830 2024-06-10T00:22:36.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19edaf8640 1 --2- 172.21.15.79:0/2902907615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e8071bf0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f19e80d0d40 tx=0x7f19e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc1c6cb22bfb4a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:36.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19ecaf6640 1 -- 172.21.15.79:0/2902907615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4037070 con 0x7f19e8156830 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19ecaf6640 1 -- 172.21.15.79:0/2902907615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e4032440 con 0x7f19e8156830 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.128+0000 7f19ecaf6640 1 -- 172.21.15.79:0/2902907615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4032810 con 0x7f19e8156830 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 -- 172.21.15.79:0/2902907615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 msgr2=0x7f19e8071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 --2- 172.21.15.79:0/2902907615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e8071bf0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f19e80d0d40 tx=0x7f19e402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 -- 172.21.15.79:0/2902907615 shutdown_connections 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 --2- 172.21.15.79:0/2902907615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e815c7f0 0x7f19e80ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 --2- 172.21.15.79:0/2902907615 >> v2:172.21.15.117:3300/0 conn(0x7f19e8072130 0x7f19e80cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 --2- 172.21.15.79:0/2902907615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e8071bf0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 -- 172.21.15.79:0/2902907615 >> 172.21.15.79:0/2902907615 conn(0x7f19e80b19f0 msgr2=0x7f19e80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 -- 172.21.15.79:0/2902907615 shutdown_connections 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.129+0000 7f19efd5c640 1 -- 172.21.15.79:0/2902907615 wait complete. 2024-06-10T00:22:36.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.130+0000 7f19efd5c640 1 Processor -- start 2024-06-10T00:22:36.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.130+0000 7f19efd5c640 1 -- start start 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19efd5c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e8072130 0x7f19e81f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19efd5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e81e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19efd5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e815c7f0 0x7f19e8145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19efd5c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80b36a0 con 0x7f19e8156830 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19efd5c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80b3520 con 0x7f19e815c7f0 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19efd5c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f19e80b3820 con 0x7f19e8072130 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ed2f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e81e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ed2f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e81e4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35676/0 (socket says 172.21.15.79:35676) 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ed2f7640 1 -- 172.21.15.79:0/3532192529 learned_addr learned my addr 172.21.15.79:0/3532192529 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:36.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19edaf8640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e8072130 0x7f19e81f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ee2f9640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e815c7f0 0x7f19e8145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ed2f7640 1 -- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e8072130 msgr2=0x7f19e81f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ed2f7640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e8072130 0x7f19e81f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ed2f7640 1 -- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e815c7f0 msgr2=0x7f19e8145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ed2f7640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e815c7f0 0x7f19e8145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19ed2f7640 1 -- 172.21.15.79:0/3532192529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e81e5000 con 0x7f19e8156830 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.131+0000 7f19edaf8640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e8072130 0x7f19e81f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.132+0000 7f19ed2f7640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e81e4ac0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b4a0 tx=0x7f19d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.132+0000 7f19de7fc640 1 -- 172.21.15.79:0/3532192529 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8014070 con 0x7f19e8156830 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.132+0000 7f19de7fc640 1 -- 172.21.15.79:0/3532192529 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d8010610 con 0x7f19e8156830 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.132+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e81f5ce0 con 0x7f19e8156830 2024-06-10T00:22:36.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.132+0000 7f19de7fc640 1 -- 172.21.15.79:0/3532192529 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8010a00 con 0x7f19e8156830 2024-06-10T00:22:36.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.132+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e81f6580 con 0x7f19e8156830 2024-06-10T00:22:36.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.133+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e8068430 con 0x7f19e8156830 2024-06-10T00:22:36.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.133+0000 7f19de7fc640 1 -- 172.21.15.79:0/3532192529 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19d8017070 con 0x7f19e8156830 2024-06-10T00:22:36.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.134+0000 7f19de7fc640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19cc06be30 0x7f19cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.134+0000 7f19de7fc640 1 -- 172.21.15.79:0/3532192529 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f19d808a6d0 con 0x7f19e8156830 2024-06-10T00:22:36.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.134+0000 7f19edaf8640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19cc06be30 0x7f19cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.134+0000 7f19edaf8640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19cc06be30 0x7f19cc06e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f19e4034000 tx=0x7f19e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:36.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.138+0000 7f19de7fc640 1 -- 172.21.15.79:0/3532192529 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f19d8058b80 con 0x7f19e8156830 2024-06-10T00:22:36.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.384+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f19e80732a0 con 0x7f19e8156830 2024-06-10T00:22:36.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.416+0000 7f19de7fc640 1 -- 172.21.15.79:0/3532192529 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v359) ==== 149+0+0 (secure 0 0 0) 0x7f19d805ce80 con 0x7f19e8156830 2024-06-10T00:22:36.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19cc06be30 msgr2=0x7f19cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19cc06be30 0x7f19cc06e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f19e4034000 tx=0x7f19e402e000 comp rx=0 tx=0).stop 2024-06-10T00:22:36.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 msgr2=0x7f19e81e4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e81e4ac0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b4a0 tx=0x7f19d800b960 comp rx=0 tx=0).stop 2024-06-10T00:22:36.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 shutdown_connections 2024-06-10T00:22:36.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f19cc06be30 0x7f19cc06e2f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e815c7f0 0x7f19e8145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19e8156830 0x7f19e81e4ac0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 --2- 172.21.15.79:0/3532192529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e8072130 0x7f19e81f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.418+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 >> 172.21.15.79:0/3532192529 conn(0x7f19e80b19f0 msgr2=0x7f19e80b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:36.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.419+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 shutdown_connections 2024-06-10T00:22:36.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.419+0000 7f19efd5c640 1 -- 172.21.15.79:0/3532192529 wait complete. 2024-06-10T00:22:36.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-10T00:22:36.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.532+0000 7f41d1476640 1 Processor -- start 2024-06-10T00:22:36.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.532+0000 7f41d1476640 1 -- start start 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.532+0000 7f41d1476640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 0x7f41cc0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.532+0000 7f41d1476640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41cc0d17e0 con 0x7f41cc0b1240 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.532+0000 7f41d1476640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41cc0cef20 con 0x7f41cc0d0110 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.532+0000 7f41d1476640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc0cf200 con 0x7f41cc0d2640 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41c27fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f41cc0b1240 0x7f41cc0cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57520/0 (socket says 172.21.15.79:57520) 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41c27fc640 1 -- 172.21.15.79:0/983537719 learned_addr learned my addr 172.21.15.79:0/983537719 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042145776 0 0) 0x7f41cc0d17e0 con 0x7f41cc0b1240 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41caffd640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 0x7f41cc0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41b8003520 con 0x7f41cc0b1240 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4129187597 0 0) 0x7f41b8003520 con 0x7f41cc0b1240 2024-06-10T00:22:36.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 msgr2=0x7f41cc0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 0x7f41cc0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 >> v1:172.21.15.117:6789/0 conn(0x7f41cc0d0110 legacy=0x7f41cc15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc0cf4e0 con 0x7f41cc0b1240 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f41b4001670 con 0x7f41cc0b1240 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 >> v1:172.21.15.79:6789/0 conn(0x7f41cc0b1240 legacy=0x7f41cc0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 0x7f41b80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8003f60 0x7f41b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc0cf200 con 0x7f41b8003f60 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41b800baa0 con 0x7f41b8004d40 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41b800bca0 con 0x7f41cc0d2640 2024-06-10T00:22:36.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41c27fc640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8003f60 0x7f41b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41caffd640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 0x7f41b80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.533+0000 7f41cb7fe640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41c27fc640 1 -- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 msgr2=0x7f41b80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41c27fc640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 0x7f41b80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41c27fc640 1 -- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b8004d40 msgr2=0x7f41b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41c27fc640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41c27fc640 1 -- 172.21.15.79:0/983537719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b8003520 con 0x7f41b8003f60 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41caffd640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41cc0d2640 0x7f41b80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41c27fc640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8003f60 0x7f41b8004800 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c210 tx=0x7f41b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fb3599bd0ec7f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4007d30 con 0x7f41b8003f60 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b4005ad0 con 0x7f41b8003f60 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.534+0000 7f41ca7fc640 1 -- 172.21.15.79:0/983537719 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4007070 con 0x7f41b8003f60 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.535+0000 7f41d1476640 1 -- 172.21.15.79:0/983537719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8003f60 msgr2=0x7f41b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.535+0000 7f41d1476640 1 --2- 172.21.15.79:0/983537719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41b8003f60 0x7f41b8004800 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c210 tx=0x7f41b8005830 comp rx=0 tx=0).stop 2024-06-10T00:22:36.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.535+0000 7f41cb7fe640 1 -- 172.21.15.79:0/983537719 reap_dead start 2024-06-10T00:22:36.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.535+0000 7f41d1476640 1 -- 172.21.15.79:0/983537719 shutdown_connections 2024-06-10T00:22:36.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.535+0000 7f41d1476640 1 -- 172.21.15.79:0/983537719 >> 172.21.15.79:0/983537719 conn(0x7f41cc09d3a0 msgr2=0x7f41cc0d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:36.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.535+0000 7f41d1476640 1 -- 172.21.15.79:0/983537719 shutdown_connections 2024-06-10T00:22:36.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.535+0000 7f41d1476640 1 -- 172.21.15.79:0/983537719 wait complete. 2024-06-10T00:22:36.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.536+0000 7f41d1476640 1 Processor -- start 2024-06-10T00:22:36.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.536+0000 7f41d1476640 1 -- start start 2024-06-10T00:22:36.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41d1476640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8003f60 0x7f41cc156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41d1476640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41cc1590a0 0x7f41cc159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41d1476640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc0c9c80 0x7f41cc0ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41d1476640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc15e9f0 con 0x7f41cc0c9c80 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41d1476640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc15e870 con 0x7f41cc1590a0 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41d1476640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc156b70 con 0x7f41b8003f60 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41cb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc0c9c80 0x7f41cc0ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41cb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc0c9c80 0x7f41cc0ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35684/0 (socket says 172.21.15.79:35684) 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41cb7fe640 1 -- 172.21.15.79:0/3269181194 learned_addr learned my addr 172.21.15.79:0/3269181194 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41c27fc640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41cc1590a0 0x7f41cc159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41caffd640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8003f60 0x7f41cc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41cb7fe640 1 -- 172.21.15.79:0/3269181194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8003f60 msgr2=0x7f41cc156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41cb7fe640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8003f60 0x7f41cc156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41cb7fe640 1 -- 172.21.15.79:0/3269181194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41cc1590a0 msgr2=0x7f41cc159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41cb7fe640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41cc1590a0 0x7f41cc159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.537+0000 7f41cb7fe640 1 -- 172.21.15.79:0/3269181194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc156e50 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.538+0000 7f41cb7fe640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc0c9c80 0x7f41cc0ca0e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f41cc1632c0 tx=0x7f41c400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.538+0000 7f41c3fff640 1 -- 172.21.15.79:0/3269181194 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4003970 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.538+0000 7f41c3fff640 1 -- 172.21.15.79:0/3269181194 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c4018070 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.538+0000 7f41c3fff640 1 -- 172.21.15.79:0/3269181194 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4003d50 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.538+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41cc157130 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.538+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41cc0ca620 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.539+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41cc0683c0 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.539+0000 7f41c3fff640 1 -- 172.21.15.79:0/3269181194 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41c40050d0 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.539+0000 7f41c3fff640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41ac06be60 0x7f41ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.540+0000 7f41c3fff640 1 -- 172.21.15.79:0/3269181194 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f41c408a930 con 0x7f41cc0c9c80 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.540+0000 7f41caffd640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41ac06be60 0x7f41ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.540+0000 7f41caffd640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41ac06be60 0x7f41ac06e320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0ba0a0 tx=0x7f41bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.544+0000 7f41c3fff640 1 -- 172.21.15.79:0/3269181194 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f41c4059430 con 0x7f41cc0c9c80 2024-06-10T00:22:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.718+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f41cc09d880 con 0x7f41cc0c9c80 2024-06-10T00:22:36.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.721+0000 7f41c3fff640 1 -- 172.21.15.79:0/3269181194 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f41c4058d30 con 0x7f41cc0c9c80 2024-06-10T00:22:36.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41ac06be60 msgr2=0x7f41ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41ac06be60 0x7f41ac06e320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0ba0a0 tx=0x7f41bc008040 comp rx=0 tx=0).stop 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc0c9c80 msgr2=0x7f41cc0ca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc0c9c80 0x7f41cc0ca0e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f41cc1632c0 tx=0x7f41c400eb90 comp rx=0 tx=0).stop 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 shutdown_connections 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f41ac06be60 0x7f41ac06e320 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41cc0c9c80 0x7f41cc0ca0e0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41cc1590a0 0x7f41cc159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 --2- 172.21.15.79:0/3269181194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8003f60 0x7f41cc156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 >> 172.21.15.79:0/3269181194 conn(0x7f41cc09d3a0 msgr2=0x7f41cc0c7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 shutdown_connections 2024-06-10T00:22:36.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:36.724+0000 7f41d1476640 1 -- 172.21.15.79:0/3269181194 wait complete. 2024-06-10T00:22:36.734 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:22:36.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:22:36.771 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:22:36.824 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:22:36.824 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:36.824 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:36.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:22:36.840 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:22:36.840 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:36.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:22:36.859 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:36.859 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:36.895 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:22:36.896 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:22:36.896 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:36.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:22:36.916 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-10T00:22:36.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.034+0000 7f297de2c640 1 Processor -- start 2024-06-10T00:22:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.034+0000 7f297de2c640 1 -- start start 2024-06-10T00:22:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.035+0000 7f297de2c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29780aef70 0x7f29780b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.035+0000 7f297de2c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297815ac50 con 0x7f297815a870 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.035+0000 7f297de2c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297806cdb0 con 0x7f29780af3b0 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.035+0000 7f297de2c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f297806d090 con 0x7f29780aef70 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.035+0000 7f29777fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f297815a870 0x7f297806de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57524/0 (socket says 172.21.15.79:57524) 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.035+0000 7f29777fe640 1 -- 172.21.15.79:0/4055824239 learned_addr learned my addr 172.21.15.79:0/4055824239 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2138961480 0 0) 0x7f297815ac50 con 0x7f297815a870 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2976ffd640 1 --2- 172.21.15.79:0/4055824239 >> v2:172.21.15.117:3300/0 conn(0x7f29780aef70 0x7f29780b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2964003520 con 0x7f297815a870 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1922667551 0 0) 0x7f2964003520 con 0x7f297815a870 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 >> v2:172.21.15.117:3300/0 conn(0x7f29780aef70 msgr2=0x7f29780b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 --2- 172.21.15.79:0/4055824239 >> v2:172.21.15.117:3300/0 conn(0x7f29780aef70 0x7f29780b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 >> v1:172.21.15.117:6789/0 conn(0x7f29780af3b0 legacy=0x7f29780cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297806d370 con 0x7f297815a870 2024-06-10T00:22:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f29600019f0 con 0x7f297815a870 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 >> v1:172.21.15.79:6789/0 conn(0x7f297815a870 legacy=0x7f297806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29640039b0 0x7f2964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2964004800 0x7f2964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f296400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f297806d090 con 0x7f29640051c0 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f296400c160 con 0x7f2964004800 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f296400c360 con 0x7f29640039b0 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2977fff640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f296400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29777fe640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29640039b0 0x7f2964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2976ffd640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2964004800 0x7f2964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2977fff640 1 -- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29640039b0 msgr2=0x7f2964003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2977fff640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29640039b0 0x7f2964003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2977fff640 1 -- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2964004800 msgr2=0x7f2964004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2977fff640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2964004800 0x7f2964004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2977fff640 1 -- 172.21.15.79:0/4055824239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2964003520 con 0x7f29640051c0 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f2976ffd640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2964004800 0x7f2964004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.036+0000 7f29777fe640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29640039b0 0x7f2964003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.037+0000 7f2977fff640 1 -- 172.21.15.79:0/4055824239 reap_dead start 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.037+0000 7f2977fff640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f296400b9c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2970001750 tx=0x7f2964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa04e53a26b9ac5a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.037+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970001370 con 0x7f29640051c0 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.037+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2970005310 con 0x7f29640051c0 2024-06-10T00:22:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.037+0000 7f29767fc640 1 -- 172.21.15.79:0/4055824239 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297002abe0 con 0x7f29640051c0 2024-06-10T00:22:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.038+0000 7f297de2c640 1 -- 172.21.15.79:0/4055824239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 msgr2=0x7f296400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.038+0000 7f297de2c640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f296400b9c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2970001750 tx=0x7f2964005830 comp rx=0 tx=0).stop 2024-06-10T00:22:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.038+0000 7f297de2c640 1 -- 172.21.15.79:0/4055824239 shutdown_connections 2024-06-10T00:22:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.038+0000 7f297de2c640 1 --2- 172.21.15.79:0/4055824239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f296400b9c0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.038+0000 7f297de2c640 1 -- 172.21.15.79:0/4055824239 >> 172.21.15.79:0/4055824239 conn(0x7f29780b19f0 msgr2=0x7f29780b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.038+0000 7f297de2c640 1 -- 172.21.15.79:0/4055824239 shutdown_connections 2024-06-10T00:22:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.038+0000 7f297de2c640 1 -- 172.21.15.79:0/4055824239 wait complete. 2024-06-10T00:22:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.039+0000 7f297de2c640 1 Processor -- start 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.039+0000 7f297de2c640 1 -- start start 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f297de2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f297814d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f297de2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f297815ae60 0x7f2978155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f297de2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781570e0 0x7f2978157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f297de2c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29780b2e40 con 0x7f29640051c0 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f297de2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f297806d930 con 0x7f29781570e0 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f297de2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29780b2fc0 con 0x7f297815ae60 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f297814d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f297814d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35700/0 (socket says 172.21.15.79:35700) 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 -- 172.21.15.79:0/3359441622 learned_addr learned my addr 172.21.15.79:0/3359441622 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f2976ffd640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f297815ae60 0x7f2978155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f2977fff640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781570e0 0x7f2978157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 -- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f297815ae60 msgr2=0x7f2978155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f297815ae60 0x7f2978155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 -- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781570e0 msgr2=0x7f2978157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781570e0 0x7f2978157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 -- 172.21.15.79:0/3359441622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297815b3d0 con 0x7f29640051c0 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f2977fff640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781570e0 0x7f2978157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f2976ffd640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f297815ae60 0x7f2978155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.040+0000 7f29777fe640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f297814d7a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2960001f20 tx=0x7f296000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.041+0000 7f296ffff640 1 -- 172.21.15.79:0/3359441622 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296000ee20 con 0x7f29640051c0 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.041+0000 7f296ffff640 1 -- 172.21.15.79:0/3359441622 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2960018070 con 0x7f29640051c0 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.041+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297815b6b0 con 0x7f29640051c0 2024-06-10T00:22:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.041+0000 7f296ffff640 1 -- 172.21.15.79:0/3359441622 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960013640 con 0x7f29640051c0 2024-06-10T00:22:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.041+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297815bc70 con 0x7f29640051c0 2024-06-10T00:22:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.042+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2978068430 con 0x7f29640051c0 2024-06-10T00:22:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.042+0000 7f296ffff640 1 -- 172.21.15.79:0/3359441622 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29600137e0 con 0x7f29640051c0 2024-06-10T00:22:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.042+0000 7f296ffff640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f295806be60 0x7f295806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.043+0000 7f296ffff640 1 -- 172.21.15.79:0/3359441622 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5507+0+0 (secure 0 0 0) 0x7f296008b3d0 con 0x7f29640051c0 2024-06-10T00:22:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.043+0000 7f2976ffd640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f295806be60 0x7f295806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.043+0000 7f2976ffd640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f295806be60 0x7f295806e320 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2968006f80 tx=0x7f2968008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.047+0000 7f296ffff640 1 -- 172.21.15.79:0/3359441622 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2960059ed0 con 0x7f29640051c0 2024-06-10T00:22:37.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.257+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f297809af20 con 0x7f29640051c0 2024-06-10T00:22:37.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.257+0000 7f296ffff640 1 -- 172.21.15.79:0/3359441622 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+3872 (secure 0 0 0) 0x7f29600597d0 con 0x7f29640051c0 2024-06-10T00:22:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:37.257 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3047809483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3047809483},{"type":"v1","addr":"172.21.15.117:6834","nonce":3047809483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2371888065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2371888065},{"type":"v1","addr":"172.21.15.117:6835","nonce":2371888065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2087452960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2087452960},{"type":"v1","addr":"172.21.15.79:6837","nonce":2087452960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/273047822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":273047822},{"type":"v1","addr":"172.21.15.79:6836","nonce":273047822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[]} 2024-06-10T00:22:37.258 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2024-06-10T00:22:37.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f295806be60 msgr2=0x7f295806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f295806be60 0x7f295806e320 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2968006f80 tx=0x7f2968008040 comp rx=0 tx=0).stop 2024-06-10T00:22:37.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 msgr2=0x7f297814d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f297814d7a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2960001f20 tx=0x7f296000e530 comp rx=0 tx=0).stop 2024-06-10T00:22:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 shutdown_connections 2024-06-10T00:22:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f295806be60 0x7f295806e320 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781570e0 0x7f2978157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f297815ae60 0x7f2978155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 --2- 172.21.15.79:0/3359441622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640051c0 0x7f297814d7a0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.259+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 >> 172.21.15.79:0/3359441622 conn(0x7f29780b19f0 msgr2=0x7f29780d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:37.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.260+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 shutdown_connections 2024-06-10T00:22:37.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.260+0000 7f297de2c640 1 -- 172.21.15.79:0/3359441622 wait complete. 2024-06-10T00:22:37.270 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-10T00:22:37.271 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-10T00:22:37.271 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-10T00:22:37.271 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:22:37.271 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-10T00:22:37.271 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-10T00:22:37.271 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-10T00:22:37.271 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:22:37.272 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-10T00:22:37.272 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-10T00:22:37.272 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-10T00:22:37.272 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:22:37.272 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-10T00:22:37.272 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-10T00:22:37.273 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-10T00:22:37.273 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:22:37.280 INFO:tasks.ceph.mds.c:Stopped 2024-06-10T00:22:37.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-10T00:22:37.281 INFO:tasks.ceph.mds.a:Stopped 2024-06-10T00:22:37.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-10T00:22:37.283 INFO:tasks.ceph.mds.d:Stopped 2024-06-10T00:22:37.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-10T00:22:37.284 INFO:tasks.ceph.mds.b:Stopped 2024-06-10T00:22:37.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-10T00:22:37.323 INFO:tasks.ceph.mds.c:Started 2024-06-10T00:22:37.324 INFO:tasks.ceph.mds.a:Started 2024-06-10T00:22:37.325 DEBUG:teuthology.parallel:result is None 2024-06-10T00:22:37.325 DEBUG:teuthology.parallel:result is None 2024-06-10T00:22:37.327 INFO:tasks.ceph.mds.d:Started 2024-06-10T00:22:37.327 DEBUG:teuthology.parallel:result is None 2024-06-10T00:22:37.328 INFO:tasks.ceph.mds.b:Started 2024-06-10T00:22:37.328 DEBUG:teuthology.parallel:result is None 2024-06-10T00:22:37.328 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-10T00:22:37.398 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:22:37.398 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:22:37.410 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:22:37.410 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:22:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.436+0000 7f7ed4091640 1 Processor -- start 2024-06-10T00:22:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.436+0000 7f7ed4091640 1 -- start start 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed4091640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d2680 0x7f7ecc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed4091640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ecc0d1fc0 0x7f7ecc0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed4091640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ecc0d2fa0 con 0x7f7ecc161fa0 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed4091640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7ecc0cff80 con 0x7f7ecc0d1fc0 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed4091640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ecc0d13e0 con 0x7f7ecc0d2680 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed1e2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d2680 0x7f7ecc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed162c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ecc0d1fc0 0x7f7ecc0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed1e2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d2680 0x7f7ecc15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:53048/0 (socket says 172.21.15.79:53048) 2024-06-10T00:22:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed1e2d640 1 -- 172.21.15.79:0/1759852308 learned_addr learned my addr 172.21.15.79:0/1759852308 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed262e640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7ecc161fa0 0x7f7ecc162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:59274/0 (socket says 172.21.15.79:59274) 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed0e2b640 1 -- 172.21.15.79:0/1759852308 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780092142 0 0) 0x7f7ecc0d2fa0 con 0x7f7ecc161fa0 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed1e2d640 1 -- 172.21.15.79:0/1759852308 >> v2:172.21.15.117:3300/0 conn(0x7f7ecc0d1fc0 msgr2=0x7f7ecc0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed1e2d640 1 --2- 172.21.15.79:0/1759852308 >> v2:172.21.15.117:3300/0 conn(0x7f7ecc0d1fc0 0x7f7ecc0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed1e2d640 1 -- 172.21.15.79:0/1759852308 >> v1:172.21.15.117:6789/0 conn(0x7f7ecc161fa0 legacy=0x7f7ecc162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.437+0000 7f7ed1e2d640 1 -- 172.21.15.79:0/1759852308 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc0d0ad0 con 0x7f7ecc0d2680 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.438+0000 7f7ed1e2d640 1 --2- 172.21.15.79:0/1759852308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d2680 0x7f7ecc15f1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009870 tx=0x7f7ec802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fbeb3ee83351b5e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.438+0000 7f7ed0e2b640 1 -- 172.21.15.79:0/1759852308 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8037070 con 0x7f7ecc0d2680 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.438+0000 7f7ed0e2b640 1 -- 172.21.15.79:0/1759852308 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec8032440 con 0x7f7ecc0d2680 2024-06-10T00:22:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.438+0000 7f7ed0e2b640 1 -- 172.21.15.79:0/1759852308 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8032810 con 0x7f7ecc0d2680 2024-06-10T00:22:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.439+0000 7f7ed4091640 1 -- 172.21.15.79:0/1759852308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d2680 msgr2=0x7f7ecc15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.439+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1759852308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d2680 0x7f7ecc15f1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009870 tx=0x7f7ec802a270 comp rx=0 tx=0).stop 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.439+0000 7f7ed4091640 1 -- 172.21.15.79:0/1759852308 shutdown_connections 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.439+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1759852308 >> v2:172.21.15.117:3300/0 conn(0x7f7ecc0d1fc0 0x7f7ecc0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.439+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1759852308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d2680 0x7f7ecc15f1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.439+0000 7f7ed4091640 1 -- 172.21.15.79:0/1759852308 >> 172.21.15.79:0/1759852308 conn(0x7f7ecc09d3f0 msgr2=0x7f7ecc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.439+0000 7f7ed4091640 1 -- 172.21.15.79:0/1759852308 shutdown_connections 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.439+0000 7f7ed4091640 1 -- 172.21.15.79:0/1759852308 wait complete. 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.440+0000 7f7ed4091640 1 Processor -- start 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.440+0000 7f7ed4091640 1 -- start start 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed4091640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d1fc0 0x7f7ecc1f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed4091640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ecc0d2680 0x7f7ecc0b9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed4091640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ecc161fa0 0x7f7ecc15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed4091640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc0d1070 con 0x7f7ecc161fa0 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed4091640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc0d0d90 con 0x7f7ecc0d2680 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed4091640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ecc0d2400 con 0x7f7ecc0d1fc0 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ecc161fa0 0x7f7ecc15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ecc161fa0 0x7f7ecc15cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35748/0 (socket says 172.21.15.79:35748) 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 -- 172.21.15.79:0/1863871970 learned_addr learned my addr 172.21.15.79:0/1863871970 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed1e2d640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d1fc0 0x7f7ecc1f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed162c640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ecc0d2680 0x7f7ecc0b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 -- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d1fc0 msgr2=0x7f7ecc1f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d1fc0 0x7f7ecc1f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 -- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ecc0d2680 msgr2=0x7f7ecc0b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ecc0d2680 0x7f7ecc0b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 -- 172.21.15.79:0/1863871970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc0b7900 con 0x7f7ecc161fa0 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed162c640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ecc0d2680 0x7f7ecc0b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.441+0000 7f7ed262e640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ecc161fa0 0x7f7ecc15cfd0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400c700 tx=0x7f7ec400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.442+0000 7f7ec27fc640 1 -- 172.21.15.79:0/1863871970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4018070 con 0x7f7ecc161fa0 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.442+0000 7f7ec27fc640 1 -- 172.21.15.79:0/1863871970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec400ce10 con 0x7f7ecc161fa0 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.442+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc0b7be0 con 0x7f7ecc161fa0 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.442+0000 7f7ec27fc640 1 -- 172.21.15.79:0/1863871970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400a880 con 0x7f7ecc161fa0 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.442+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc0b81a0 con 0x7f7ecc161fa0 2024-06-10T00:22:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.443+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ecc068430 con 0x7f7ecc161fa0 2024-06-10T00:22:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.443+0000 7f7ec27fc640 1 -- 172.21.15.79:0/1863871970 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ec400aa20 con 0x7f7ecc161fa0 2024-06-10T00:22:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.443+0000 7f7ec27fc640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7eb006be30 0x7f7eb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.444+0000 7f7ec27fc640 1 -- 172.21.15.79:0/1863871970 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5507+0+0 (secure 0 0 0) 0x7f7ec408a290 con 0x7f7ecc161fa0 2024-06-10T00:22:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.444+0000 7f7ed1e2d640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7eb006be30 0x7f7eb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.444+0000 7f7ed1e2d640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7eb006be30 0x7f7eb006e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8034000 tx=0x7f7ec802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.448+0000 7f7ec27fc640 1 -- 172.21.15.79:0/1863871970 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7ec40586c0 con 0x7f7ecc161fa0 2024-06-10T00:22:37.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:37.635+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7ecc0b5910 con 0x7f7ecc161fa0 2024-06-10T00:22:38.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.431+0000 7f7ec27fc640 1 -- 172.21.15.79:0/1863871970 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v100) ==== 97+0+0 (secure 0 0 0) 0x7f7ec405c9c0 con 0x7f7ecc161fa0 2024-06-10T00:22:38.431 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-06-10T00:22:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7eb006be30 msgr2=0x7f7eb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7eb006be30 0x7f7eb006e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8034000 tx=0x7f7ec802e000 comp rx=0 tx=0).stop 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ecc161fa0 msgr2=0x7f7ecc15cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ecc161fa0 0x7f7ecc15cfd0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400c700 tx=0x7f7ec400cbc0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 shutdown_connections 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7eb006be30 0x7f7eb006e2f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ecc161fa0 0x7f7ecc15cfd0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ecc0d2680 0x7f7ecc0b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 --2- 172.21.15.79:0/1863871970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ecc0d1fc0 0x7f7ecc1f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 >> 172.21.15.79:0/1863871970 conn(0x7f7ecc09d3f0 msgr2=0x7f7ecc161710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 shutdown_connections 2024-06-10T00:22:38.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.434+0000 7f7ed4091640 1 -- 172.21.15.79:0/1863871970 wait complete. 2024-06-10T00:22:38.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-10T00:22:38.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.546+0000 7fab37010640 1 Processor -- start 2024-06-10T00:22:38.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.546+0000 7fab37010640 1 -- start start 2024-06-10T00:22:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.547+0000 7fab37010640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab30156830 0x7fab30071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.547+0000 7fab37010640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab300725f0 con 0x7fab30072130 2024-06-10T00:22:38.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.547+0000 7fab37010640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab300728d0 con 0x7fab3015c7f0 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.547+0000 7fab37010640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fab300b3090 con 0x7fab30156830 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.547+0000 7fab2ffff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fab30072130 0x7fab300cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34324/0 (socket says 172.21.15.79:34324) 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.547+0000 7fab2ffff640 1 -- 172.21.15.79:0/844501343 learned_addr learned my addr 172.21.15.79:0/844501343 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.547+0000 7fab34dac640 1 --2- 172.21.15.79:0/844501343 >> v2:172.21.15.117:3300/0 conn(0x7fab30156830 0x7fab30071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.547+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475935902 0 0) 0x7fab300725f0 con 0x7fab30072130 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab18003520 con 0x7fab30072130 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2502585263 0 0) 0x7fab18003520 con 0x7fab30072130 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 >> v2:172.21.15.117:3300/0 conn(0x7fab30156830 msgr2=0x7fab30071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 --2- 172.21.15.79:0/844501343 >> v2:172.21.15.117:3300/0 conn(0x7fab30156830 0x7fab30071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 >> v1:172.21.15.117:6789/0 conn(0x7fab3015c7f0 legacy=0x7fab30165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab30072bb0 con 0x7fab30072130 2024-06-10T00:22:38.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fab24001670 con 0x7fab30072130 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 >> v1:172.21.15.79:6789/0 conn(0x7fab30072130 legacy=0x7fab300cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180039b0 0x7fab18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab18004800 0x7fab18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab180051c0 0x7fab1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab300b3090 con 0x7fab180051c0 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab1800c010 con 0x7fab180039b0 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fab1800c210 con 0x7fab18004800 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab355ad640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab180051c0 0x7fab1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab34dac640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180039b0 0x7fab18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2ffff640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab18004800 0x7fab18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab355ad640 1 -- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab18004800 msgr2=0x7fab18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab355ad640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab18004800 0x7fab18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab355ad640 1 -- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180039b0 msgr2=0x7fab18003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab355ad640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180039b0 0x7fab18003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab355ad640 1 -- 172.21.15.79:0/844501343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab18003520 con 0x7fab180051c0 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.548+0000 7fab2ffff640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab18004800 0x7fab18004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.549+0000 7fab355ad640 1 -- 172.21.15.79:0/844501343 reap_dead start 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.549+0000 7fab355ad640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab180051c0 0x7fab1800b9c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fab28001f60 tx=0x7fab18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da436df818c763b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.549+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28001b30 con 0x7fab180051c0 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.549+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab28031600 con 0x7fab180051c0 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.549+0000 7fab2f7fe640 1 -- 172.21.15.79:0/844501343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab280319f0 con 0x7fab180051c0 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.550+0000 7fab37010640 1 -- 172.21.15.79:0/844501343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab180051c0 msgr2=0x7fab1800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.550+0000 7fab37010640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab180051c0 0x7fab1800b9c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fab28001f60 tx=0x7fab18005830 comp rx=0 tx=0).stop 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.550+0000 7fab37010640 1 -- 172.21.15.79:0/844501343 shutdown_connections 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.550+0000 7fab37010640 1 --2- 172.21.15.79:0/844501343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab180051c0 0x7fab1800b9c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.550+0000 7fab37010640 1 -- 172.21.15.79:0/844501343 >> 172.21.15.79:0/844501343 conn(0x7fab300b19f0 msgr2=0x7fab300b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:38.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.550+0000 7fab37010640 1 -- 172.21.15.79:0/844501343 shutdown_connections 2024-06-10T00:22:38.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.550+0000 7fab37010640 1 -- 172.21.15.79:0/844501343 wait complete. 2024-06-10T00:22:38.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.551+0000 7fab37010640 1 Processor -- start 2024-06-10T00:22:38.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.551+0000 7fab37010640 1 -- start start 2024-06-10T00:22:38.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab37010640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180051c0 0x7fab30156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab37010640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab3009d550 0x7fab3014cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab37010640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab300ad6e0 0x7fab300adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab37010640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab30071d70 con 0x7fab3009d550 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab37010640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab30071bf0 con 0x7fab180051c0 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab37010640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fab30071ef0 con 0x7fab300ad6e0 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab3009d550 0x7fab3014cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab3009d550 0x7fab3014cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34896/0 (socket says 172.21.15.79:34896) 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 -- 172.21.15.79:0/1703338417 learned_addr learned my addr 172.21.15.79:0/1703338417 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab34dac640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180051c0 0x7fab30156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab355ad640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab300ad6e0 0x7fab300adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 -- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab300ad6e0 msgr2=0x7fab300adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab300ad6e0 0x7fab300adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 -- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180051c0 msgr2=0x7fab30156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180051c0 0x7fab30156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 -- 172.21.15.79:0/1703338417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3009aa10 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab34dac640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180051c0 0x7fab30156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2ffff640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab3009d550 0x7fab3014cb40 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fab2400e7e0 tx=0x7fab2400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2d7fa640 1 -- 172.21.15.79:0/1703338417 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24019070 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2d7fa640 1 -- 172.21.15.79:0/1703338417 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2400c660 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab301571e0 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab2d7fa640 1 -- 172.21.15.79:0/1703338417 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2400ca10 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.552+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3009af90 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.553+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab30068430 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.554+0000 7fab2d7fa640 1 -- 172.21.15.79:0/1703338417 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab2401c070 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.555+0000 7fab2d7fa640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab1c06be30 0x7fab1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.555+0000 7fab34dac640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab1c06be30 0x7fab1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.555+0000 7fab2d7fa640 1 -- 172.21.15.79:0/1703338417 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5249+0+0 (secure 0 0 0) 0x7fab2408a1a0 con 0x7fab3009d550 2024-06-10T00:22:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.555+0000 7fab34dac640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab1c06be30 0x7fab1c06e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fab20009a40 tx=0x7fab20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:38.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.559+0000 7fab2d7fa640 1 -- 172.21.15.79:0/1703338417 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fab24058750 con 0x7fab3009d550 2024-06-10T00:22:38.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.800+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fab3015f4f0 con 0x7fab3009d550 2024-06-10T00:22:38.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.800+0000 7fab2d7fa640 1 -- 172.21.15.79:0/1703338417 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fab2405ca50 con 0x7fab3009d550 2024-06-10T00:22:38.800 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:38.800 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:22:38.800 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-06-10T00:22:38.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.800 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-06-10T00:22:38.800 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA==", 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow==", 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ==", 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:22:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw==", 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw==", 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg==", 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:22:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg==", 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g==", 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw==", 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw==", 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-06-10T00:22:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ==", 2024-06-10T00:22:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:22:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:22:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA==", 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw==", 2024-06-10T00:22:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA==", 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:22:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A==", 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw==", 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmQYVlARAAk+Jo8bykvpKKZY5XAPe2ZA==", 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA==", 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw==", 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-10T00:22:38.815 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.802+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab1c06be30 msgr2=0x7fab1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.802+0000 7fab37010640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab1c06be30 0x7fab1c06e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fab20009a40 tx=0x7fab20008040 comp rx=0 tx=0).stop 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab3009d550 msgr2=0x7fab3014cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab3009d550 0x7fab3014cb40 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fab2400e7e0 tx=0x7fab2400ebe0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 shutdown_connections 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab1c06be30 0x7fab1c06e2f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab300ad6e0 0x7fab300adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab3009d550 0x7fab3014cb40 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 --2- 172.21.15.79:0/1703338417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180051c0 0x7fab30156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 >> 172.21.15.79:0/1703338417 conn(0x7fab300b19f0 msgr2=0x7fab300aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:38.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 shutdown_connections 2024-06-10T00:22:38.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.803+0000 7fab37010640 1 -- 172.21.15.79:0/1703338417 wait complete. 2024-06-10T00:22:38.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-10T00:22:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.917+0000 7f27d3c00640 1 Processor -- start 2024-06-10T00:22:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.917+0000 7f27d3c00640 1 -- start start 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d3c00640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27cc156830 0x7f27cc071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d3c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27cc072130 0x7f27cc0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d3c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc15c7f0 0x7f27cc0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d3c00640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f27cc0b3090 con 0x7f27cc156830 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d3c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f27cc0725f0 con 0x7f27cc072130 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d3c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc0728d0 con 0x7f27cc15c7f0 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d199c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27cc156830 0x7f27cc071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d199c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27cc156830 0x7f27cc071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34900/0 (socket says 172.21.15.79:34900) 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d199c640 1 -- 172.21.15.79:0/601873505 learned_addr learned my addr 172.21.15.79:0/601873505 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d199c640 1 -- 172.21.15.79:0/601873505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc15c7f0 msgr2=0x7f27cc0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:38.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d199c640 1 --2- 172.21.15.79:0/601873505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc15c7f0 0x7f27cc0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d199c640 1 -- 172.21.15.79:0/601873505 >> v2:172.21.15.117:3300/0 conn(0x7f27cc072130 msgr2=0x7f27cc0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:38.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d199c640 1 --2- 172.21.15.79:0/601873505 >> v2:172.21.15.117:3300/0 conn(0x7f27cc072130 0x7f27cc0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.918+0000 7f27d199c640 1 -- 172.21.15.79:0/601873505 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc072bb0 con 0x7f27cc156830 2024-06-10T00:22:38.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.919+0000 7f27d199c640 1 --2- 172.21.15.79:0/601873505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc156830 0x7f27cc071bf0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0d0d40 tx=0x7f27c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e8908b79317fdf server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:38.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.919+0000 7f27d099a640 1 -- 172.21.15.79:0/601873505 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8037070 con 0x7f27cc156830 2024-06-10T00:22:38.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.919+0000 7f27d099a640 1 -- 172.21.15.79:0/601873505 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c8032440 con 0x7f27cc156830 2024-06-10T00:22:38.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.919+0000 7f27d099a640 1 -- 172.21.15.79:0/601873505 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8032810 con 0x7f27cc156830 2024-06-10T00:22:38.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 -- 172.21.15.79:0/601873505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc156830 msgr2=0x7f27cc071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 --2- 172.21.15.79:0/601873505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc156830 0x7f27cc071bf0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0d0d40 tx=0x7f27c802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 -- 172.21.15.79:0/601873505 shutdown_connections 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 --2- 172.21.15.79:0/601873505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc15c7f0 0x7f27cc0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 --2- 172.21.15.79:0/601873505 >> v2:172.21.15.117:3300/0 conn(0x7f27cc072130 0x7f27cc0cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 --2- 172.21.15.79:0/601873505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc156830 0x7f27cc071bf0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 -- 172.21.15.79:0/601873505 >> 172.21.15.79:0/601873505 conn(0x7f27cc0b19f0 msgr2=0x7f27cc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 -- 172.21.15.79:0/601873505 shutdown_connections 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.920+0000 7f27d3c00640 1 -- 172.21.15.79:0/601873505 wait complete. 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.921+0000 7f27d3c00640 1 Processor -- start 2024-06-10T00:22:38.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.921+0000 7f27d3c00640 1 -- start start 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d3c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27cc072130 0x7f27cc0cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d3c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc156830 0x7f27cc1f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d3c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc15c7f0 0x7f27cc15b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d3c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b36a0 con 0x7f27cc15c7f0 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d3c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b3520 con 0x7f27cc072130 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d3c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc0b3820 con 0x7f27cc156830 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc15c7f0 0x7f27cc15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc15c7f0 0x7f27cc15b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34914/0 (socket says 172.21.15.79:34914) 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 -- 172.21.15.79:0/3586275807 learned_addr learned my addr 172.21.15.79:0/3586275807 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d199c640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27cc072130 0x7f27cc0cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d119b640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc156830 0x7f27cc1f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 -- 172.21.15.79:0/3586275807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc156830 msgr2=0x7f27cc1f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc156830 0x7f27cc1f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 -- 172.21.15.79:0/3586275807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27cc072130 msgr2=0x7f27cc0cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27cc072130 0x7f27cc0cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 -- 172.21.15.79:0/3586275807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc0d0490 con 0x7f27cc15c7f0 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d219d640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc15c7f0 0x7f27cc15b020 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f27c400b9a0 tx=0x7f27c400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27c27fc640 1 -- 172.21.15.79:0/3586275807 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4019070 con 0x7f27cc15c7f0 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27c27fc640 1 -- 172.21.15.79:0/3586275807 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c400cbc0 con 0x7f27cc15c7f0 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc0d0770 con 0x7f27cc15c7f0 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.922+0000 7f27c27fc640 1 -- 172.21.15.79:0/3586275807 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4014440 con 0x7f27cc15c7f0 2024-06-10T00:22:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.923+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc1f7b40 con 0x7f27cc15c7f0 2024-06-10T00:22:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.924+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27cc068430 con 0x7f27cc15c7f0 2024-06-10T00:22:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.924+0000 7f27c27fc640 1 -- 172.21.15.79:0/3586275807 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27c401c070 con 0x7f27cc15c7f0 2024-06-10T00:22:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.924+0000 7f27c27fc640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27b006be30 0x7f27b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.924+0000 7f27c27fc640 1 -- 172.21.15.79:0/3586275807 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5249+0+0 (secure 0 0 0) 0x7f27c408aa10 con 0x7f27cc15c7f0 2024-06-10T00:22:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.924+0000 7f27d199c640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27b006be30 0x7f27b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.925+0000 7f27d199c640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27b006be30 0x7f27b006e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f27c8034000 tx=0x7f27c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:38.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:38.929+0000 7f27c27fc640 1 -- 172.21.15.79:0/3586275807 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f27c4059580 con 0x7f27cc15c7f0 2024-06-10T00:22:39.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.102+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f27cc0af700 con 0x7f27cc15c7f0 2024-06-10T00:22:39.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.102+0000 7f27c27fc640 1 -- 172.21.15.79:0/3586275807 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) ==== 84+0+65 (secure 0 0 0) 0x7f27c4058e80 con 0x7f27cc15c7f0 2024-06-10T00:22:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:39.102 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:22:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:22:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-06-10T00:22:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-06-10T00:22:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:39.103 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:22:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27b006be30 msgr2=0x7f27b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27b006be30 0x7f27b006e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f27c8034000 tx=0x7f27c802e000 comp rx=0 tx=0).stop 2024-06-10T00:22:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc15c7f0 msgr2=0x7f27cc15b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc15c7f0 0x7f27cc15b020 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f27c400b9a0 tx=0x7f27c400be60 comp rx=0 tx=0).stop 2024-06-10T00:22:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 shutdown_connections 2024-06-10T00:22:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27b006be30 0x7f27b006e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27cc15c7f0 0x7f27cc15b020 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27cc156830 0x7f27cc1f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 --2- 172.21.15.79:0/3586275807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27cc072130 0x7f27cc0cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 >> 172.21.15.79:0/3586275807 conn(0x7f27cc0b19f0 msgr2=0x7f27cc15d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 shutdown_connections 2024-06-10T00:22:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.104+0000 7f27d3c00640 1 -- 172.21.15.79:0/3586275807 wait complete. 2024-06-10T00:22:39.115 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-10T00:22:39.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-10T00:22:39.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.219+0000 7fdd70142640 1 Processor -- start 2024-06-10T00:22:39.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.219+0000 7fdd70142640 1 -- start start 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd70142640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd68155590 0x7fdd6815b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd70142640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd680cf370 0x7fdd680ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd70142640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd680acd40 con 0x7fdd6815b9a0 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd70142640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdd6815bfe0 con 0x7fdd68155590 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd70142640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdd6815c2c0 con 0x7fdd680cf370 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd6dede640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd68155590 0x7fdd6815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd6d6dd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdd6815b9a0 0x7fdd680cec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34336/0 (socket says 172.21.15.79:34336) 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd6d6dd640 1 -- 172.21.15.79:0/333553305 learned_addr learned my addr 172.21.15.79:0/333553305 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd6dede640 1 -- 172.21.15.79:0/333553305 >> v2:172.21.15.117:3300/0 conn(0x7fdd680cf370 msgr2=0x7fdd680ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:39.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd6dede640 1 --2- 172.21.15.79:0/333553305 >> v2:172.21.15.117:3300/0 conn(0x7fdd680cf370 0x7fdd680ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd6dede640 1 -- 172.21.15.79:0/333553305 >> v1:172.21.15.79:6789/0 conn(0x7fdd6815b9a0 legacy=0x7fdd680cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd6dede640 1 -- 172.21.15.79:0/333553305 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd680ad000 con 0x7fdd68155590 2024-06-10T00:22:39.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.220+0000 7fdd6cedc640 1 -- 172.21.15.79:0/333553305 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668303674 0 0) 0x7fdd680acd40 con 0x7fdd6815b9a0 2024-06-10T00:22:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.221+0000 7fdd6dede640 1 --2- 172.21.15.79:0/333553305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd68155590 0x7fdd6815b460 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fdd68070ce0 tx=0x7fdd6402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b028284b790c80 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.221+0000 7fdd6cedc640 1 -- 172.21.15.79:0/333553305 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64037070 con 0x7fdd68155590 2024-06-10T00:22:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.221+0000 7fdd6cedc640 1 -- 172.21.15.79:0/333553305 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd64032440 con 0x7fdd68155590 2024-06-10T00:22:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.221+0000 7fdd6cedc640 1 -- 172.21.15.79:0/333553305 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64032810 con 0x7fdd68155590 2024-06-10T00:22:39.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.222+0000 7fdd70142640 1 -- 172.21.15.79:0/333553305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd68155590 msgr2=0x7fdd6815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.222+0000 7fdd70142640 1 --2- 172.21.15.79:0/333553305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd68155590 0x7fdd6815b460 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fdd68070ce0 tx=0x7fdd6402a1c0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.222+0000 7fdd70142640 1 -- 172.21.15.79:0/333553305 shutdown_connections 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.222+0000 7fdd70142640 1 --2- 172.21.15.79:0/333553305 >> v2:172.21.15.117:3300/0 conn(0x7fdd680cf370 0x7fdd680ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.222+0000 7fdd70142640 1 --2- 172.21.15.79:0/333553305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd68155590 0x7fdd6815b460 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.222+0000 7fdd70142640 1 -- 172.21.15.79:0/333553305 >> 172.21.15.79:0/333553305 conn(0x7fdd680b1980 msgr2=0x7fdd680b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.222+0000 7fdd70142640 1 -- 172.21.15.79:0/333553305 shutdown_connections 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.222+0000 7fdd70142640 1 -- 172.21.15.79:0/333553305 wait complete. 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.223+0000 7fdd70142640 1 Processor -- start 2024-06-10T00:22:39.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.223+0000 7fdd70142640 1 -- start start 2024-06-10T00:22:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd70142640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd680cf370 0x7fdd680cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd70142640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd68155590 0x7fdd6815e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd70142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6815b9a0 0x7fdd6815e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd70142640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd680add40 con 0x7fdd680cf370 2024-06-10T00:22:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd70142640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd680b26d0 con 0x7fdd68155590 2024-06-10T00:22:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd70142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd680adec0 con 0x7fdd6815b9a0 2024-06-10T00:22:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd680cf370 0x7fdd680cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd680cf370 0x7fdd680cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34944/0 (socket says 172.21.15.79:34944) 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 -- 172.21.15.79:0/2109972580 learned_addr learned my addr 172.21.15.79:0/2109972580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6d6dd640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd68155590 0x7fdd6815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6e6df640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6815b9a0 0x7fdd6815e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 -- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6815b9a0 msgr2=0x7fdd6815e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6815b9a0 0x7fdd6815e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 -- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd68155590 msgr2=0x7fdd6815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd68155590 0x7fdd6815e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 -- 172.21.15.79:0/2109972580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd681563d0 con 0x7fdd680cf370 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6d6dd640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd68155590 0x7fdd6815e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd6dede640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd680cf370 0x7fdd680cddc0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fdd6402a7b0 tx=0x7fdd640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd5e7fc640 1 -- 172.21.15.79:0/2109972580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64041070 con 0x7fdd680cf370 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd5e7fc640 1 -- 172.21.15.79:0/2109972580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6403c870 con 0x7fdd680cf370 2024-06-10T00:22:39.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6815eb90 con 0x7fdd680cf370 2024-06-10T00:22:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd5e7fc640 1 -- 172.21.15.79:0/2109972580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64037040 con 0x7fdd680cf370 2024-06-10T00:22:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.224+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6815f430 con 0x7fdd680cf370 2024-06-10T00:22:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.225+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd68068540 con 0x7fdd680cf370 2024-06-10T00:22:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.226+0000 7fdd5e7fc640 1 -- 172.21.15.79:0/2109972580 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd64044070 con 0x7fdd680cf370 2024-06-10T00:22:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.226+0000 7fdd5e7fc640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd4c06be60 0x7fdd4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.226+0000 7fdd6d6dd640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd4c06be60 0x7fdd4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.226+0000 7fdd5e7fc640 1 -- 172.21.15.79:0/2109972580 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5249+0+0 (secure 0 0 0) 0x7fdd640ab9c0 con 0x7fdd680cf370 2024-06-10T00:22:39.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.227+0000 7fdd6d6dd640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd4c06be60 0x7fdd4c06e320 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd68155d50 tx=0x7fdd58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:39.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.231+0000 7fdd5e7fc640 1 -- 172.21.15.79:0/2109972580 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdd640ade20 con 0x7fdd680cf370 2024-06-10T00:22:39.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.406+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdd6809dd70 con 0x7fdd680cf370 2024-06-10T00:22:39.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.438+0000 7fdd5e7fc640 1 -- 172.21.15.79:0/2109972580 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v101) ==== 138+0+0 (secure 0 0 0) 0x7fdd6407a5c0 con 0x7fdd680cf370 2024-06-10T00:22:39.438 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-06-10T00:22:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd4c06be60 msgr2=0x7fdd4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd4c06be60 0x7fdd4c06e320 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd68155d50 tx=0x7fdd58009040 comp rx=0 tx=0).stop 2024-06-10T00:22:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd680cf370 msgr2=0x7fdd680cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd680cf370 0x7fdd680cddc0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fdd6402a7b0 tx=0x7fdd640046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 shutdown_connections 2024-06-10T00:22:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fdd4c06be60 0x7fdd4c06e320 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6815b9a0 0x7fdd6815e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd68155590 0x7fdd6815e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 --2- 172.21.15.79:0/2109972580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd680cf370 0x7fdd680cddc0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 >> 172.21.15.79:0/2109972580 conn(0x7fdd680b1980 msgr2=0x7fdd68071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 shutdown_connections 2024-06-10T00:22:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.440+0000 7fdd70142640 1 -- 172.21.15.79:0/2109972580 wait complete. 2024-06-10T00:22:39.454 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-10T00:22:39.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.561+0000 7fad70add640 1 Processor -- start 2024-06-10T00:22:39.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.561+0000 7fad70add640 1 -- start start 2024-06-10T00:22:39.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad70add640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad6c159a10 0x7fad6c06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad70add640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad6c0cffd0 0x7fad6c0d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad70add640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6c0d0910 con 0x7fad6c0acd40 2024-06-10T00:22:39.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad70add640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fad6c0ae960 con 0x7fad6c159a10 2024-06-10T00:22:39.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad70add640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fad6c0aec00 con 0x7fad6c0cffd0 2024-06-10T00:22:39.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad6a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad6c159a10 0x7fad6c06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad6a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad6c159a10 0x7fad6c06cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34958/0 (socket says 172.21.15.79:34958) 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad6a59c640 1 -- 172.21.15.79:0/2682138314 learned_addr learned my addr 172.21.15.79:0/2682138314 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad6a59c640 1 -- 172.21.15.79:0/2682138314 >> v2:172.21.15.117:3300/0 conn(0x7fad6c0cffd0 msgr2=0x7fad6c0d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad6a59c640 1 --2- 172.21.15.79:0/2682138314 >> v2:172.21.15.117:3300/0 conn(0x7fad6c0cffd0 0x7fad6c0d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad6a59c640 1 -- 172.21.15.79:0/2682138314 >> v1:172.21.15.117:6789/0 conn(0x7fad6c0acd40 legacy=0x7fad6c0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.562+0000 7fad6a59c640 1 -- 172.21.15.79:0/2682138314 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c0aeee0 con 0x7fad6c159a10 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad6a59c640 1 --2- 172.21.15.79:0/2682138314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c06cde0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fad6c06ea80 tx=0x7fad5c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95374c48ee07ccb4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad69d9b640 1 -- 172.21.15.79:0/2682138314 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c037070 con 0x7fad6c159a10 2024-06-10T00:22:39.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad69d9b640 1 -- 172.21.15.79:0/2682138314 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c032440 con 0x7fad6c159a10 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad69d9b640 1 -- 172.21.15.79:0/2682138314 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c032810 con 0x7fad6c159a10 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad70add640 1 -- 172.21.15.79:0/2682138314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 msgr2=0x7fad6c06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad70add640 1 --2- 172.21.15.79:0/2682138314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c06cde0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fad6c06ea80 tx=0x7fad5c02a230 comp rx=0 tx=0).stop 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad70add640 1 -- 172.21.15.79:0/2682138314 shutdown_connections 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad70add640 1 --2- 172.21.15.79:0/2682138314 >> v2:172.21.15.117:3300/0 conn(0x7fad6c0cffd0 0x7fad6c0d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad70add640 1 --2- 172.21.15.79:0/2682138314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c06cde0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad70add640 1 -- 172.21.15.79:0/2682138314 >> 172.21.15.79:0/2682138314 conn(0x7fad6c06b7e0 msgr2=0x7fad6c06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.563+0000 7fad70add640 1 -- 172.21.15.79:0/2682138314 shutdown_connections 2024-06-10T00:22:39.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.564+0000 7fad70add640 1 -- 172.21.15.79:0/2682138314 wait complete. 2024-06-10T00:22:39.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.565+0000 7fad70add640 1 Processor -- start 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.565+0000 7fad70add640 1 -- start start 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.565+0000 7fad70add640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad6c0acd40 0x7fad6c141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.565+0000 7fad70add640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6c0cffd0 0x7fad6c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.565+0000 7fad70add640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c1448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad70add640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c159df0 con 0x7fad6c159a10 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad70add640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c0af4a0 con 0x7fad6c0acd40 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad70add640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fad6c15c740 con 0x7fad6c0cffd0 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c1448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c1448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34968/0 (socket says 172.21.15.79:34968) 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 -- 172.21.15.79:0/1309867648 learned_addr learned my addr 172.21.15.79:0/1309867648 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6a59c640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad6c0acd40 0x7fad6c141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad63fff640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6c0cffd0 0x7fad6c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 -- 172.21.15.79:0/1309867648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6c0cffd0 msgr2=0x7fad6c1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6c0cffd0 0x7fad6c1513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 -- 172.21.15.79:0/1309867648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad6c0acd40 msgr2=0x7fad6c141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad6c0acd40 0x7fad6c141f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 -- 172.21.15.79:0/1309867648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c153bd0 con 0x7fad6c159a10 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad6ad9d640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c1448c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fad6400b970 tx=0x7fad6400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad62ffd640 1 -- 172.21.15.79:0/1309867648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64019070 con 0x7fad6c159a10 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad62ffd640 1 -- 172.21.15.79:0/1309867648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6400cb60 con 0x7fad6c159a10 2024-06-10T00:22:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6c153eb0 con 0x7fad6c159a10 2024-06-10T00:22:39.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad62ffd640 1 -- 172.21.15.79:0/1309867648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64014440 con 0x7fad6c159a10 2024-06-10T00:22:39.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.566+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6c154470 con 0x7fad6c159a10 2024-06-10T00:22:39.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.567+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6c06f2f0 con 0x7fad6c159a10 2024-06-10T00:22:39.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.568+0000 7fad62ffd640 1 -- 172.21.15.79:0/1309867648 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad6401c070 con 0x7fad6c159a10 2024-06-10T00:22:39.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.568+0000 7fad62ffd640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad4c06be30 0x7fad4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:39.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.568+0000 7fad62ffd640 1 -- 172.21.15.79:0/1309867648 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5619+0+0 (secure 0 0 0) 0x7fad6408ab60 con 0x7fad6c159a10 2024-06-10T00:22:39.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.568+0000 7fad6a59c640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad4c06be30 0x7fad4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:39.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.569+0000 7fad6a59c640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad4c06be30 0x7fad4c06e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fad5c034000 tx=0x7fad5c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:39.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.573+0000 7fad62ffd640 1 -- 172.21.15.79:0/1309867648 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fad6c06f2f0 con 0x7fad6c159a10 2024-06-10T00:22:39.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:39.750+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fad6c0683c0 con 0x7fad6c159a10 2024-06-10T00:22:40.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.440+0000 7fad62ffd640 1 -- 172.21.15.79:0/1309867648 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v102) ==== 170+0+0 (secure 0 0 0) 0x7fad64059560 con 0x7fad6c159a10 2024-06-10T00:22:40.442 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-06-10T00:22:40.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.444+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad4c06be30 msgr2=0x7fad4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:40.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.444+0000 7fad70add640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad4c06be30 0x7fad4c06e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fad5c034000 tx=0x7fad5c02e000 comp rx=0 tx=0).stop 2024-06-10T00:22:40.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.444+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 msgr2=0x7fad6c1448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:40.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.444+0000 7fad70add640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c1448c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fad6400b970 tx=0x7fad6400be30 comp rx=0 tx=0).stop 2024-06-10T00:22:40.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.445+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 shutdown_connections 2024-06-10T00:22:40.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.445+0000 7fad70add640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fad4c06be30 0x7fad4c06e2f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:40.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.445+0000 7fad70add640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad6c159a10 0x7fad6c1448c0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:40.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.445+0000 7fad70add640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6c0cffd0 0x7fad6c1513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:40.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.445+0000 7fad70add640 1 --2- 172.21.15.79:0/1309867648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad6c0acd40 0x7fad6c141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:40.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.445+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 >> 172.21.15.79:0/1309867648 conn(0x7fad6c06b7e0 msgr2=0x7fad6c158610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:40.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.445+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 shutdown_connections 2024-06-10T00:22:40.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.445+0000 7fad70add640 1 -- 172.21.15.79:0/1309867648 wait complete. 2024-06-10T00:22:40.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-10T00:22:40.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.577+0000 7f000b7b0640 1 Processor -- start 2024-06-10T00:22:40.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.577+0000 7f000b7b0640 1 -- start start 2024-06-10T00:22:40.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f000b7b0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00040b3fe0 0x7f0004169050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:40.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f000b7b0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00040b5a40 con 0x7f00041449b0 2024-06-10T00:22:40.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f000b7b0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0004072ae0 con 0x7f00041474f0 2024-06-10T00:22:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f000b7b0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f00040b4490 con 0x7f00040b3fe0 2024-06-10T00:22:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f0009d4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00040b3fe0 0x7f0004169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f000954c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f00041449b0 0x7f000406de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34352/0 (socket says 172.21.15.79:34352) 2024-06-10T00:22:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f000954c640 1 -- 172.21.15.79:0/1320834209 learned_addr learned my addr 172.21.15.79:0/1320834209 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f0009d4d640 1 -- 172.21.15.79:0/1320834209 >> v1:172.21.15.117:6789/0 conn(0x7f00041474f0 legacy=0x7f000406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f0009d4d640 1 -- 172.21.15.79:0/1320834209 >> v1:172.21.15.79:6789/0 conn(0x7f00041449b0 legacy=0x7f000406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7f0009d4d640 1 -- 172.21.15.79:0/1320834209 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0004072dc0 con 0x7f00040b3fe0 2024-06-10T00:22:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.578+0000 7efffbfff640 1 -- 172.21.15.79:0/1320834209 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442452438 0 0) 0x7f00040b5a40 con 0x7f00041449b0 2024-06-10T00:22:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.579+0000 7f0009d4d640 1 --2- 172.21.15.79:0/1320834209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004169050 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7efffc009d90 tx=0x7efffc02a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1792a58edb4de06 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.579+0000 7efffbfff640 1 -- 172.21.15.79:0/1320834209 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc007740 con 0x7f00040b3fe0 2024-06-10T00:22:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.579+0000 7efffbfff640 1 -- 172.21.15.79:0/1320834209 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc0078e0 con 0x7f00040b3fe0 2024-06-10T00:22:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.579+0000 7efffbfff640 1 -- 172.21.15.79:0/1320834209 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc007cb0 con 0x7f00040b3fe0 2024-06-10T00:22:40.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.579+0000 7f000b7b0640 1 -- 172.21.15.79:0/1320834209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 msgr2=0x7f0004169050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:40.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.579+0000 7f000b7b0640 1 --2- 172.21.15.79:0/1320834209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004169050 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7efffc009d90 tx=0x7efffc02a580 comp rx=0 tx=0).stop 2024-06-10T00:22:40.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.580+0000 7f000b7b0640 1 -- 172.21.15.79:0/1320834209 shutdown_connections 2024-06-10T00:22:40.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.580+0000 7f000b7b0640 1 --2- 172.21.15.79:0/1320834209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004169050 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:40.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.580+0000 7f000b7b0640 1 -- 172.21.15.79:0/1320834209 >> 172.21.15.79:0/1320834209 conn(0x7f00040b2a00 msgr2=0x7f00040b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:40.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.580+0000 7f000b7b0640 1 -- 172.21.15.79:0/1320834209 shutdown_connections 2024-06-10T00:22:40.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.580+0000 7f000b7b0640 1 -- 172.21.15.79:0/1320834209 wait complete. 2024-06-10T00:22:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.581+0000 7f000b7b0640 1 Processor -- start 2024-06-10T00:22:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.581+0000 7f000b7b0640 1 -- start start 2024-06-10T00:22:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.581+0000 7f000b7b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004161340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.581+0000 7f000b7b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00041449b0 0x7f000415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000b7b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00041474f0 0x7f000413c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000b7b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00040730a0 con 0x7f00040b3fe0 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000b7b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f00040b6050 con 0x7f00041449b0 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000b7b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0004169590 con 0x7f00041474f0 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34988/0 (socket says 172.21.15.79:34988) 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 -- 172.21.15.79:0/3845823012 learned_addr learned my addr 172.21.15.79:0/3845823012 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f0008d4b640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00041449b0 0x7f000415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f0009d4d640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00041474f0 0x7f000413c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 -- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00041474f0 msgr2=0x7f000413c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00041474f0 0x7f000413c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 -- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00041449b0 msgr2=0x7f000415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00041449b0 0x7f000415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 -- 172.21.15.79:0/3845823012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000415e260 con 0x7f00040b3fe0 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f0009d4d640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00041474f0 0x7f000413c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f0008d4b640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00041449b0 0x7f000415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000954c640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004161340 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f000000c430 tx=0x7f000000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7efff9ffb640 1 -- 172.21.15.79:0/3845823012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000074e0 con 0x7f00040b3fe0 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7efff9ffb640 1 -- 172.21.15.79:0/3845823012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00000047e0 con 0x7f00040b3fe0 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0004160be0 con 0x7f00040b3fe0 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.582+0000 7efff9ffb640 1 -- 172.21.15.79:0/3845823012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000004bd0 con 0x7f00040b3fe0 2024-06-10T00:22:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.583+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0004160340 con 0x7f00040b3fe0 2024-06-10T00:22:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.583+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00040b0bd0 con 0x7f00040b3fe0 2024-06-10T00:22:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.584+0000 7efff9ffb640 1 -- 172.21.15.79:0/3845823012 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0000011070 con 0x7f00040b3fe0 2024-06-10T00:22:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.584+0000 7efff9ffb640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effe806be30 0x7effe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.584+0000 7efff9ffb640 1 -- 172.21.15.79:0/3845823012 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6001+0+0 (secure 0 0 0) 0x7f000008ab70 con 0x7f00040b3fe0 2024-06-10T00:22:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.585+0000 7f0008d4b640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effe806be30 0x7effe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.585+0000 7f0008d4b640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effe806be30 0x7effe806e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f00041442a0 tx=0x7efff4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:40.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.589+0000 7efff9ffb640 1 -- 172.21.15.79:0/3845823012 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f00040b0bd0 con 0x7f00040b3fe0 2024-06-10T00:22:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:40.798+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f00040ae060 con 0x7f00040b3fe0 2024-06-10T00:22:41.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.461+0000 7efff9ffb640 1 -- 172.21.15.79:0/3845823012 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v66) ==== 174+0+0 (secure 0 0 0) 0x7f0000059480 con 0x7f00040b3fe0 2024-06-10T00:22:41.466 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 15 and data pool 16 2024-06-10T00:22:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effe806be30 msgr2=0x7effe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effe806be30 0x7effe806e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f00041442a0 tx=0x7efff4009040 comp rx=0 tx=0).stop 2024-06-10T00:22:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 msgr2=0x7f0004161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004161340 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f000000c430 tx=0x7f000000c8f0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 shutdown_connections 2024-06-10T00:22:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effe806be30 0x7effe806e2f0 secure :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f00041442a0 tx=0x7efff4009040 comp rx=0 tx=0).stop 2024-06-10T00:22:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00041474f0 0x7f000413c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00041449b0 0x7f000415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 --2- 172.21.15.79:0/3845823012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040b3fe0 0x7f0004161340 secure :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f000000c430 tx=0x7f000000c8f0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.476+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 >> 172.21.15.79:0/3845823012 conn(0x7f00040b2a00 msgr2=0x7f00040d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:41.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.479+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 shutdown_connections 2024-06-10T00:22:41.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.479+0000 7f000b7b0640 1 -- 172.21.15.79:0/3845823012 wait complete. 2024-06-10T00:22:41.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:22:41.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.594+0000 7fb63ada2640 1 Processor -- start 2024-06-10T00:22:41.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.594+0000 7fb63ada2640 1 -- start start 2024-06-10T00:22:41.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.595+0000 7fb63ada2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb6340af3b0 0x7fb6340cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.595+0000 7fb63ada2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63415ac50 con 0x7fb63415a870 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.595+0000 7fb63ada2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63406cdb0 con 0x7fb6340aef70 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.595+0000 7fb63ada2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb63406d090 con 0x7fb6340af3b0 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.595+0000 7fb638b3e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb63415a870 0x7fb63406de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34358/0 (socket says 172.21.15.79:34358) 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.595+0000 7fb638b3e640 1 -- 172.21.15.79:0/3424200569 learned_addr learned my addr 172.21.15.79:0/3424200569 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.595+0000 7fb63933f640 1 --2- 172.21.15.79:0/3424200569 >> v2:172.21.15.117:3300/0 conn(0x7fb6340af3b0 0x7fb6340cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.595+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217830338 0 0) 0x7fb63415ac50 con 0x7fb63415a870 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb61c005730 con 0x7fb63415a870 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2461240097 0 0) 0x7fb61c005730 con 0x7fb63415a870 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 >> v2:172.21.15.117:3300/0 conn(0x7fb6340af3b0 msgr2=0x7fb6340cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 --2- 172.21.15.79:0/3424200569 >> v2:172.21.15.117:3300/0 conn(0x7fb6340af3b0 0x7fb6340cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 >> v1:172.21.15.117:6789/0 conn(0x7fb6340aef70 legacy=0x7fb6340b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63406d370 con 0x7fb63415a870 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fb624001670 con 0x7fb63415a870 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 >> v1:172.21.15.79:6789/0 conn(0x7fb63415a870 legacy=0x7fb63406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61c005bc0 0x7fb61c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61c0065c0 0x7fb61c006a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c007330 0x7fb61c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb63406d090 con 0x7fb61c005bc0 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c00e270 con 0x7fb61c007330 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c00e470 con 0x7fb61c0065c0 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb638b3e640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61c005bc0 0x7fb61c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb63933f640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c007330 0x7fb61c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb633fff640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61c0065c0 0x7fb61c006a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb638b3e640 1 -- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61c0065c0 msgr2=0x7fb61c006a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb638b3e640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61c0065c0 0x7fb61c006a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb638b3e640 1 -- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c007330 msgr2=0x7fb61c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb638b3e640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c007330 0x7fb61c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb63933f640 1 -- 172.21.15.79:0/3424200569 reap_dead start 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb638b3e640 1 -- 172.21.15.79:0/3424200569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c005730 con 0x7fb61c005bc0 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.596+0000 7fb633fff640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61c0065c0 0x7fb61c006a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.597+0000 7fb638b3e640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61c005bc0 0x7fb61c005fa0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb62400c240 tx=0x7fb61c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37f344bda8b7bd0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.597+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624007d30 con 0x7fb61c005bc0 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.597+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb624005af0 con 0x7fb61c005bc0 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.597+0000 7fb6337fe640 1 -- 172.21.15.79:0/3424200569 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624007070 con 0x7fb61c005bc0 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.598+0000 7fb63ada2640 1 -- 172.21.15.79:0/3424200569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61c005bc0 msgr2=0x7fb61c005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.598+0000 7fb63ada2640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61c005bc0 0x7fb61c005fa0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb62400c240 tx=0x7fb61c007a40 comp rx=0 tx=0).stop 2024-06-10T00:22:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.598+0000 7fb63ada2640 1 -- 172.21.15.79:0/3424200569 shutdown_connections 2024-06-10T00:22:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.598+0000 7fb63ada2640 1 --2- 172.21.15.79:0/3424200569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61c005bc0 0x7fb61c005fa0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.598+0000 7fb63ada2640 1 -- 172.21.15.79:0/3424200569 >> 172.21.15.79:0/3424200569 conn(0x7fb6340b19f0 msgr2=0x7fb6340b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.598+0000 7fb63ada2640 1 -- 172.21.15.79:0/3424200569 shutdown_connections 2024-06-10T00:22:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.598+0000 7fb63ada2640 1 -- 172.21.15.79:0/3424200569 wait complete. 2024-06-10T00:22:41.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.599+0000 7fb63ada2640 1 Processor -- start 2024-06-10T00:22:41.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.599+0000 7fb63ada2640 1 -- start start 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb63ada2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c005bc0 0x7fb634072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb63ada2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6340ae690 0x7fb63414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb63ada2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6340b4520 0x7fb6340b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb63ada2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340b2e40 con 0x7fb6340ae690 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb63ada2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb63406d930 con 0x7fb61c005bc0 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb63ada2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340b2fc0 con 0x7fb6340b4520 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6340ae690 0x7fb63414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6340ae690 0x7fb63414d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35006/0 (socket says 172.21.15.79:35006) 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 -- 172.21.15.79:0/1333988063 learned_addr learned my addr 172.21.15.79:0/1333988063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb638b3e640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c005bc0 0x7fb634072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb63933f640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6340b4520 0x7fb6340b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 -- 172.21.15.79:0/1333988063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6340b4520 msgr2=0x7fb6340b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6340b4520 0x7fb6340b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 -- 172.21.15.79:0/1333988063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c005bc0 msgr2=0x7fb634072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c005bc0 0x7fb634072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 -- 172.21.15.79:0/1333988063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63415afe0 con 0x7fb6340ae690 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb633fff640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6340ae690 0x7fb63414d0b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fb62800e550 tx=0x7fb62800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb6317fa640 1 -- 172.21.15.79:0/1333988063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280052e0 con 0x7fb6340ae690 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb6317fa640 1 -- 172.21.15.79:0/1333988063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb628018070 con 0x7fb6340ae690 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.600+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6340aeb70 con 0x7fb6340ae690 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.601+0000 7fb6317fa640 1 -- 172.21.15.79:0/1333988063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628003830 con 0x7fb6340ae690 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.601+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63414d8a0 con 0x7fb6340ae690 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.601+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb634068430 con 0x7fb6340ae690 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.602+0000 7fb6317fa640 1 -- 172.21.15.79:0/1333988063 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6280039d0 con 0x7fb6340ae690 2024-06-10T00:22:41.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.602+0000 7fb6317fa640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb62006be30 0x7fb62006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.603+0000 7fb638b3e640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb62006be30 0x7fb62006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.603+0000 7fb6317fa640 1 -- 172.21.15.79:0/1333988063 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fb62808ab20 con 0x7fb6340ae690 2024-06-10T00:22:41.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.603+0000 7fb638b3e640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb62006be30 0x7fb62006e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb624032000 tx=0x7fb62402d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:41.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.607+0000 7fb6317fa640 1 -- 172.21.15.79:0/1333988063 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb628058e40 con 0x7fb6340ae690 2024-06-10T00:22:41.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.782+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6340b2650 con 0x7fb6340ae690 2024-06-10T00:22:41.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.783+0000 7fb6317fa640 1 -- 172.21.15.79:0/1333988063 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16849 (secure 0 0 0) 0x7fb62805d140 con 0x7fb6340ae690 2024-06-10T00:22:41.784 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:41.784 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":103,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:22:40.799803+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:22:39.425117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-06-10T00:22:39.768572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:22:41.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb62006be30 msgr2=0x7fb62006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb62006be30 0x7fb62006e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb624032000 tx=0x7fb62402d000 comp rx=0 tx=0).stop 2024-06-10T00:22:41.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6340ae690 msgr2=0x7fb63414d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6340ae690 0x7fb63414d0b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fb62800e550 tx=0x7fb62800ea10 comp rx=0 tx=0).stop 2024-06-10T00:22:41.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 shutdown_connections 2024-06-10T00:22:41.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb62006be30 0x7fb62006e2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6340b4520 0x7fb6340b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6340ae690 0x7fb63414d0b0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 --2- 172.21.15.79:0/1333988063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb61c005bc0 0x7fb634072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 >> 172.21.15.79:0/1333988063 conn(0x7fb6340b19f0 msgr2=0x7fb63406de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:41.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 shutdown_connections 2024-06-10T00:22:41.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.785+0000 7fb63ada2640 1 -- 172.21.15.79:0/1333988063 wait complete. 2024-06-10T00:22:41.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:22:41.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.896+0000 7fbaf0238640 1 Processor -- start 2024-06-10T00:22:41.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.896+0000 7fbaf0238640 1 -- start start 2024-06-10T00:22:41.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaf0238640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbae8072370 0x7fbae8166c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaf0238640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae8072820 con 0x7fbae80cc6d0 2024-06-10T00:22:41.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaf0238640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae8072b00 con 0x7fbae80b46d0 2024-06-10T00:22:41.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaf0238640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbae8072de0 con 0x7fbae8072370 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaedfd4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbae80cc6d0 0x7fbae80ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34370/0 (socket says 172.21.15.79:34370) 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaedfd4640 1 -- 172.21.15.79:0/2811812504 learned_addr learned my addr 172.21.15.79:0/2811812504 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542168759 0 0) 0x7fbae8072820 con 0x7fbae80cc6d0 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad4003520 con 0x7fbae80cc6d0 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaee7d5640 1 --2- 172.21.15.79:0/2811812504 >> v2:172.21.15.117:3300/0 conn(0x7fbae8072370 0x7fbae8166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1696536546 0 0) 0x7fbad4003520 con 0x7fbae80cc6d0 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 >> v2:172.21.15.117:3300/0 conn(0x7fbae8072370 msgr2=0x7fbae8166c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaecfd2640 1 --2- 172.21.15.79:0/2811812504 >> v2:172.21.15.117:3300/0 conn(0x7fbae8072370 0x7fbae8166c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 >> v1:172.21.15.117:6789/0 conn(0x7fbae80b46d0 legacy=0x7fbae8071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae80b31a0 con 0x7fbae80cc6d0 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.897+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fbae4001670 con 0x7fbae80cc6d0 2024-06-10T00:22:41.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 >> v1:172.21.15.79:6789/0 conn(0x7fbae80cc6d0 legacy=0x7fbae80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaecfd2640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbad4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaecfd2640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbad4004800 0x7fbad4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaecfd2640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbad40051c0 0x7fbad400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbae8072de0 con 0x7fbad40039b0 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbad400c110 con 0x7fbad4004800 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbad400c310 con 0x7fbad40051c0 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaedfd4640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbad4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaed7d3640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbad4004800 0x7fbad4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaee7d5640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbad40051c0 0x7fbad400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaedfd4640 1 -- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbad40051c0 msgr2=0x7fbad400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaedfd4640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbad40051c0 0x7fbad400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaedfd4640 1 -- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbad4004800 msgr2=0x7fbad4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaedfd4640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbad4004800 0x7fbad4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaedfd4640 1 -- 172.21.15.79:0/2811812504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad4003520 con 0x7fbad40039b0 2024-06-10T00:22:41.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaee7d5640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbad40051c0 0x7fbad400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:41.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.898+0000 7fbaee7d5640 1 -- 172.21.15.79:0/2811812504 reap_dead start 2024-06-10T00:22:41.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaedfd4640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbad4003dd0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fbae400c210 tx=0x7fbad4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457df8c50cb805d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:41.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4007d30 con 0x7fbad40039b0 2024-06-10T00:22:41.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae4005ad0 con 0x7fbad40039b0 2024-06-10T00:22:41.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaecfd2640 1 -- 172.21.15.79:0/2811812504 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4007070 con 0x7fbad40039b0 2024-06-10T00:22:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaf0238640 1 -- 172.21.15.79:0/2811812504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 msgr2=0x7fbad4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaf0238640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbad4003dd0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fbae400c210 tx=0x7fbad4005830 comp rx=0 tx=0).stop 2024-06-10T00:22:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaf0238640 1 -- 172.21.15.79:0/2811812504 shutdown_connections 2024-06-10T00:22:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaf0238640 1 --2- 172.21.15.79:0/2811812504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbad4003dd0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.899+0000 7fbaf0238640 1 -- 172.21.15.79:0/2811812504 >> 172.21.15.79:0/2811812504 conn(0x7fbae80b19f0 msgr2=0x7fbae80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.900+0000 7fbaf0238640 1 -- 172.21.15.79:0/2811812504 shutdown_connections 2024-06-10T00:22:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.900+0000 7fbaf0238640 1 -- 172.21.15.79:0/2811812504 wait complete. 2024-06-10T00:22:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaf0238640 1 Processor -- start 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaf0238640 1 -- start start 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaf0238640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbae80d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaf0238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae809b420 0x7fbae80cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaf0238640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae80cfe80 0x7fbae80cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaf0238640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbae8071c60 con 0x7fbad40039b0 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaf0238640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbae8159f60 con 0x7fbae80cfe80 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaf0238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbae8071de0 con 0x7fbae809b420 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.901+0000 7fbaedfd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbae80d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaedfd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbae80d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35016/0 (socket says 172.21.15.79:35016) 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaedfd4640 1 -- 172.21.15.79:0/3573839301 learned_addr learned my addr 172.21.15.79:0/3573839301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaedfd4640 1 -- 172.21.15.79:0/3573839301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae809b420 msgr2=0x7fbae80cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaedfd4640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae809b420 0x7fbae80cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaedfd4640 1 -- 172.21.15.79:0/3573839301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae80cfe80 msgr2=0x7fbae80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaedfd4640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae80cfe80 0x7fbae80cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaedfd4640 1 -- 172.21.15.79:0/3573839301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae80d0a20 con 0x7fbad40039b0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaedfd4640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbae80d04e0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fbae4001200 tx=0x7fbae4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbade7fc640 1 -- 172.21.15.79:0/3573839301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4037040 con 0x7fbad40039b0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbade7fc640 1 -- 172.21.15.79:0/3573839301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae4041070 con 0x7fbad40039b0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae809b9c0 con 0x7fbad40039b0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbade7fc640 1 -- 172.21.15.79:0/3573839301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae40047e0 con 0x7fbad40039b0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.902+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae809bf80 con 0x7fbad40039b0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.903+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae8068430 con 0x7fbad40039b0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.904+0000 7fbade7fc640 1 -- 172.21.15.79:0/3573839301 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbae4004980 con 0x7fbad40039b0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.904+0000 7fbade7fc640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbacc06be60 0x7fbacc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.904+0000 7fbaed7d3640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbacc06be60 0x7fbacc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.904+0000 7fbade7fc640 1 -- 172.21.15.79:0/3573839301 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fbae40aa840 con 0x7fbad40039b0 2024-06-10T00:22:41.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.905+0000 7fbaed7d3640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbacc06be60 0x7fbacc06e320 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbad8000c00 tx=0x7fbad8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:41.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:41.909+0000 7fbade7fc640 1 -- 172.21.15.79:0/3573839301 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbae4044370 con 0x7fbad40039b0 2024-06-10T00:22:42.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.082+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbae8159710 con 0x7fbad40039b0 2024-06-10T00:22:42.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.083+0000 7fbade7fc640 1 -- 172.21.15.79:0/3573839301 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16849 (secure 0 0 0) 0x7fbae40790f0 con 0x7fbad40039b0 2024-06-10T00:22:42.085 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:42.085 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":103,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:22:40.799803+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:22:39.425117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-06-10T00:22:39.768572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:22:42.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbacc06be60 msgr2=0x7fbacc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbacc06be60 0x7fbacc06e320 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbad8000c00 tx=0x7fbad8009040 comp rx=0 tx=0).stop 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 msgr2=0x7fbae80d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbae80d04e0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fbae4001200 tx=0x7fbae4001a40 comp rx=0 tx=0).stop 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 shutdown_connections 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbacc06be60 0x7fbacc06e320 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae80cfe80 0x7fbae80cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae809b420 0x7fbae80cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 --2- 172.21.15.79:0/3573839301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40039b0 0x7fbae80d04e0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.085+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 >> 172.21.15.79:0/3573839301 conn(0x7fbae80b19f0 msgr2=0x7fbae815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:42.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.086+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 shutdown_connections 2024-06-10T00:22:42.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.086+0000 7fbaf0238640 1 -- 172.21.15.79:0/3573839301 wait complete. 2024-06-10T00:22:42.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-10T00:22:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.199+0000 7f033ee45640 1 Processor -- start 2024-06-10T00:22:42.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.199+0000 7f033ee45640 1 -- start start 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033ee45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b2bf0 0x7f03380d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033ee45640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f03380d0560 0x7f033806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033ee45640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03380b3080 con 0x7f03380b3b40 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033ee45640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f03380d09b0 con 0x7f03380d0560 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033ee45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f033815c870 con 0x7f03380b2bf0 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033d3e2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f03380d0560 0x7f033806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033cbe1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f03380b3b40 0x7f03380b48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34386/0 (socket says 172.21.15.79:34386) 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033cbe1640 1 -- 172.21.15.79:0/4134585176 learned_addr learned my addr 172.21.15.79:0/4134585176 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f032ffff640 1 --2- 172.21.15.79:0/4134585176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b2bf0 0x7f03380d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033d3e2640 1 -- 172.21.15.79:0/4134585176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b2bf0 msgr2=0x7f03380d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:42.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033d3e2640 1 --2- 172.21.15.79:0/4134585176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b2bf0 0x7f03380d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033d3e2640 1 -- 172.21.15.79:0/4134585176 >> v1:172.21.15.79:6789/0 conn(0x7f03380b3b40 legacy=0x7f03380b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f033d3e2640 1 -- 172.21.15.79:0/4134585176 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033815cb50 con 0x7f03380d0560 2024-06-10T00:22:42.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.200+0000 7f032f7fe640 1 -- 172.21.15.79:0/4134585176 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177645823 0 0) 0x7f03380b3080 con 0x7f03380b3b40 2024-06-10T00:22:42.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.201+0000 7f033d3e2640 1 --2- 172.21.15.79:0/4134585176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033806d070 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f0330009d90 tx=0x7f033002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db29a9b3abf0609 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:42.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.201+0000 7f032f7fe640 1 -- 172.21.15.79:0/4134585176 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330007740 con 0x7f03380d0560 2024-06-10T00:22:42.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.201+0000 7f032f7fe640 1 -- 172.21.15.79:0/4134585176 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03300078e0 con 0x7f03380d0560 2024-06-10T00:22:42.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.201+0000 7f032f7fe640 1 -- 172.21.15.79:0/4134585176 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330007cb0 con 0x7f03380d0560 2024-06-10T00:22:42.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.202+0000 7f033ee45640 1 -- 172.21.15.79:0/4134585176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 msgr2=0x7f033806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.202+0000 7f033ee45640 1 --2- 172.21.15.79:0/4134585176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033806d070 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f0330009d90 tx=0x7f033002a660 comp rx=0 tx=0).stop 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.202+0000 7f033ee45640 1 -- 172.21.15.79:0/4134585176 shutdown_connections 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.202+0000 7f033ee45640 1 --2- 172.21.15.79:0/4134585176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033806d070 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.202+0000 7f033ee45640 1 --2- 172.21.15.79:0/4134585176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b2bf0 0x7f03380d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.202+0000 7f033ee45640 1 -- 172.21.15.79:0/4134585176 >> 172.21.15.79:0/4134585176 conn(0x7f03380b1d10 msgr2=0x7f03380b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.202+0000 7f033ee45640 1 -- 172.21.15.79:0/4134585176 shutdown_connections 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.202+0000 7f033ee45640 1 -- 172.21.15.79:0/4134585176 wait complete. 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.203+0000 7f033ee45640 1 Processor -- start 2024-06-10T00:22:42.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.203+0000 7f033ee45640 1 -- start start 2024-06-10T00:22:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033ee45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380b2bf0 0x7f0338152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033ee45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b3b40 0x7f033809c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033ee45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033809cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033ee45640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f033815d3f0 con 0x7f03380d0560 2024-06-10T00:22:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033ee45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f033815d110 con 0x7f03380b2bf0 2024-06-10T00:22:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033ee45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03380b3f20 con 0x7f03380b3b40 2024-06-10T00:22:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033809cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033809cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35046/0 (socket says 172.21.15.79:35046) 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 -- 172.21.15.79:0/2071469197 learned_addr learned my addr 172.21.15.79:0/2071469197 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 -- 172.21.15.79:0/2071469197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b3b40 msgr2=0x7f033809c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b3b40 0x7f033809c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033cbe1640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380b2bf0 0x7f0338152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 -- 172.21.15.79:0/2071469197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380b2bf0 msgr2=0x7f0338152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380b2bf0 0x7f0338152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 -- 172.21.15.79:0/2071469197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03381e7380 con 0x7f03380d0560 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033d3e2640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033809cf20 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0330009eb0 tx=0x7f0330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f032d7fa640 1 -- 172.21.15.79:0/2071469197 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033003f070 con 0x7f03380d0560 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f032d7fa640 1 -- 172.21.15.79:0/2071469197 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330031bc0 con 0x7f03380d0560 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03381e7660 con 0x7f03380d0560 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f032d7fa640 1 -- 172.21.15.79:0/2071469197 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330043410 con 0x7f03380d0560 2024-06-10T00:22:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.204+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033809c880 con 0x7f03380d0560 2024-06-10T00:22:42.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.205+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03380683c0 con 0x7f03380d0560 2024-06-10T00:22:42.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.206+0000 7f032d7fa640 1 -- 172.21.15.79:0/2071469197 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0330007790 con 0x7f03380d0560 2024-06-10T00:22:42.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.206+0000 7f032d7fa640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.207+0000 7f033cbe1640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.207+0000 7f032d7fa640 1 -- 172.21.15.79:0/2071469197 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f03300ac440 con 0x7f03380d0560 2024-06-10T00:22:42.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.207+0000 7f033cbe1640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f032406be30 0x7f032406e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0334007fd0 tx=0x7f0334009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:42.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.211+0000 7f032d7fa640 1 -- 172.21.15.79:0/2071469197 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f033007ac60 con 0x7f03380d0560 2024-06-10T00:22:42.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.422+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f033815b880 con 0x7f03380d0560 2024-06-10T00:22:42.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.465+0000 7f032d7fa640 1 -- 172.21.15.79:0/2071469197 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) ==== 118+0+0 (secure 0 0 0) 0x7f033007a560 con 0x7f03380d0560 2024-06-10T00:22:42.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f032406be30 msgr2=0x7f032406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f032406be30 0x7f032406e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0334007fd0 tx=0x7f0334009040 comp rx=0 tx=0).stop 2024-06-10T00:22:42.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 msgr2=0x7f033809cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033809cf20 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0330009eb0 tx=0x7f0330004a40 comp rx=0 tx=0).stop 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 shutdown_connections 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03380d0560 0x7f033809cf20 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380b3b40 0x7f033809c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 --2- 172.21.15.79:0/2071469197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380b2bf0 0x7f0338152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 >> 172.21.15.79:0/2071469197 conn(0x7f03380b1d10 msgr2=0x7f03380b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 shutdown_connections 2024-06-10T00:22:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.468+0000 7f033ee45640 1 -- 172.21.15.79:0/2071469197 wait complete. 2024-06-10T00:22:42.480 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-10T00:22:42.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-10T00:22:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.583+0000 7f5fd9bc1640 1 Processor -- start 2024-06-10T00:22:42.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.583+0000 7f5fd9bc1640 1 -- start start 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.584+0000 7f5fd9bc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40b3800 0x7f5fd40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.584+0000 7f5fd9bc1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5fd40cf190 0x7f5fd40d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.584+0000 7f5fd9bc1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd40b3c80 con 0x7f5fd40d08f0 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.584+0000 7f5fd9bc1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd40d1c80 con 0x7f5fd40cf190 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.584+0000 7f5fd9bc1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd40cf620 con 0x7f5fd40b3800 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.584+0000 7f5fd3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5fd40cf190 0x7f5fd40d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.584+0000 7f5fd3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5fd40cf190 0x7f5fd40d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35058/0 (socket says 172.21.15.79:35058) 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.584+0000 7f5fd3fff640 1 -- 172.21.15.79:0/624304817 learned_addr learned my addr 172.21.15.79:0/624304817 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.585+0000 7f5fd2ffd640 1 --2- 172.21.15.79:0/624304817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40b3800 0x7f5fd40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.585+0000 7f5fd3fff640 1 -- 172.21.15.79:0/624304817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40b3800 msgr2=0x7f5fd40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.585+0000 7f5fd3fff640 1 --2- 172.21.15.79:0/624304817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40b3800 0x7f5fd40cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.585+0000 7f5fd3fff640 1 -- 172.21.15.79:0/624304817 >> v1:172.21.15.117:6789/0 conn(0x7f5fd40d08f0 legacy=0x7f5fd40d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.585+0000 7f5fd3fff640 1 -- 172.21.15.79:0/624304817 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd40cf8a0 con 0x7f5fd40cf190 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.585+0000 7f5fd2ffd640 1 --2- 172.21.15.79:0/624304817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40b3800 0x7f5fd40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.585+0000 7f5fd3fff640 1 --2- 172.21.15.79:0/624304817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40d23f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009870 tx=0x7f5fcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c372ede54ef84c2a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd27fc640 1 -- 172.21.15.79:0/624304817 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc037070 con 0x7f5fd40cf190 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd27fc640 1 -- 172.21.15.79:0/624304817 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fcc032440 con 0x7f5fd40cf190 2024-06-10T00:22:42.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd27fc640 1 -- 172.21.15.79:0/624304817 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc032810 con 0x7f5fd40cf190 2024-06-10T00:22:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/624304817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 msgr2=0x7f5fd40d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/624304817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40d23f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009870 tx=0x7f5fcc02a270 comp rx=0 tx=0).stop 2024-06-10T00:22:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/624304817 shutdown_connections 2024-06-10T00:22:42.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/624304817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40d23f0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/624304817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40b3800 0x7f5fd40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/624304817 >> 172.21.15.79:0/624304817 conn(0x7f5fd409d3c0 msgr2=0x7f5fd40d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/624304817 shutdown_connections 2024-06-10T00:22:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.586+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/624304817 wait complete. 2024-06-10T00:22:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.587+0000 7f5fd9bc1640 1 Processor -- start 2024-06-10T00:22:42.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd9bc1640 1 -- start start 2024-06-10T00:22:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd9bc1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40b3800 0x7f5fd4157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd9bc1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd9bc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40d08f0 0x7f5fd4159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd9bc1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40d1ed0 con 0x7f5fd40cf190 2024-06-10T00:22:42.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd9bc1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40cfe60 con 0x7f5fd40b3800 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd9bc1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd40b50c0 con 0x7f5fd40d08f0 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35068/0 (socket says 172.21.15.79:35068) 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.588+0000 7f5fd2ffd640 1 -- 172.21.15.79:0/3905675224 learned_addr learned my addr 172.21.15.79:0/3905675224 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd3fff640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40d08f0 0x7f5fd4159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd2ffd640 1 -- 172.21.15.79:0/3905675224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40d08f0 msgr2=0x7f5fd4159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd2ffd640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40d08f0 0x7f5fd4159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd2ffd640 1 -- 172.21.15.79:0/3905675224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40b3800 msgr2=0x7f5fd4157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd2ffd640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40b3800 0x7f5fd4157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd2ffd640 1 -- 172.21.15.79:0/3905675224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd40b8430 con 0x7f5fd40cf190 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd2ffd640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40b94d0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800d800 tx=0x7f5fc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fbbfff640 1 -- 172.21.15.79:0/3905675224 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8004030 con 0x7f5fd40cf190 2024-06-10T00:22:42.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fbbfff640 1 -- 172.21.15.79:0/3905675224 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc80041d0 con 0x7f5fd40cf190 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd40b8710 con 0x7f5fd40cf190 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fbbfff640 1 -- 172.21.15.79:0/3905675224 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80096a0 con 0x7f5fd40cf190 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.589+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd40b8cd0 con 0x7f5fd40cf190 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.590+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd40b9110 con 0x7f5fd40cf190 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.590+0000 7f5fbbfff640 1 -- 172.21.15.79:0/3905675224 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fc8009840 con 0x7f5fd40cf190 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.591+0000 7f5fbbfff640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fc006be60 0x7f5fc006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.591+0000 7f5fbbfff640 1 -- 172.21.15.79:0/3905675224 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f5fc808b250 con 0x7f5fd40cf190 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.591+0000 7f5fd37fe640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fc006be60 0x7f5fc006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:42.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.591+0000 7f5fd37fe640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fc006be60 0x7f5fc006e320 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40012e0 tx=0x7f5fc4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:42.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.595+0000 7f5fbbfff640 1 -- 172.21.15.79:0/3905675224 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5fc8059b00 con 0x7f5fd40cf190 2024-06-10T00:22:42.729 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:22:42.728+0000 7f9f185b9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:22:42.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:42.804+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5fd40683c0 con 0x7f5fd40cf190 2024-06-10T00:22:43.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.471+0000 7f5fbbfff640 1 -- 172.21.15.79:0/3905675224 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7f5fc8059400 con 0x7f5fd40cf190 2024-06-10T00:22:43.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.473+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fc006be60 msgr2=0x7f5fc006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.473+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fc006be60 0x7f5fc006e320 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40012e0 tx=0x7f5fc4007d50 comp rx=0 tx=0).stop 2024-06-10T00:22:43.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.473+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 msgr2=0x7f5fd40b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.473+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40b94d0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800d800 tx=0x7f5fc800dcc0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.474+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 shutdown_connections 2024-06-10T00:22:43.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.474+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fc006be60 0x7f5fc006e320 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.474+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40d08f0 0x7f5fd4159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.474+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd40cf190 0x7f5fd40b94d0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.474+0000 7f5fd9bc1640 1 --2- 172.21.15.79:0/3905675224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40b3800 0x7f5fd4157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.474+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 >> 172.21.15.79:0/3905675224 conn(0x7f5fd409d3c0 msgr2=0x7f5fd406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:43.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.474+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 shutdown_connections 2024-06-10T00:22:43.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.474+0000 7f5fd9bc1640 1 -- 172.21.15.79:0/3905675224 wait complete. 2024-06-10T00:22:43.487 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-10T00:22:43.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:43.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.589+0000 7f4c807db640 1 Processor -- start 2024-06-10T00:22:43.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.589+0000 7f4c807db640 1 -- start start 2024-06-10T00:22:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c807db640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4c78156830 0x7f4c78071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c807db640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c7815c7f0 0x7f4c78165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c807db640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c780725f0 con 0x7f4c78072130 2024-06-10T00:22:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c807db640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4c780b3090 con 0x7f4c7815c7f0 2024-06-10T00:22:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c807db640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4c780728d0 con 0x7f4c78156830 2024-06-10T00:22:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c7ed78640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c7815c7f0 0x7f4c78165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c7ed78640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c7815c7f0 0x7f4c78165cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35072/0 (socket says 172.21.15.79:35072) 2024-06-10T00:22:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c7ed78640 1 -- 172.21.15.79:0/2290600407 learned_addr learned my addr 172.21.15.79:0/2290600407 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.590+0000 7f4c7e577640 1 --2- 172.21.15.79:0/2290600407 >> v2:172.21.15.117:3300/0 conn(0x7f4c78156830 0x7f4c78071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.591+0000 7f4c7ed78640 1 -- 172.21.15.79:0/2290600407 >> v2:172.21.15.117:3300/0 conn(0x7f4c78156830 msgr2=0x7f4c78071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.591+0000 7f4c7ed78640 1 --2- 172.21.15.79:0/2290600407 >> v2:172.21.15.117:3300/0 conn(0x7f4c78156830 0x7f4c78071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.591+0000 7f4c7ed78640 1 -- 172.21.15.79:0/2290600407 >> v1:172.21.15.117:6789/0 conn(0x7f4c78072130 legacy=0x7f4c780cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.591+0000 7f4c7ed78640 1 -- 172.21.15.79:0/2290600407 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c78072bb0 con 0x7f4c7815c7f0 2024-06-10T00:22:43.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.591+0000 7f4c7ed78640 1 --2- 172.21.15.79:0/2290600407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7815c7f0 0x7f4c78165cc0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f4c78070cb0 tx=0x7f4c7002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba4f080a4c048c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.591+0000 7f4c7d575640 1 -- 172.21.15.79:0/2290600407 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70036070 con 0x7f4c7815c7f0 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.591+0000 7f4c7d575640 1 -- 172.21.15.79:0/2290600407 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70031600 con 0x7f4c7815c7f0 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.591+0000 7f4c7d575640 1 -- 172.21.15.79:0/2290600407 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c700319d0 con 0x7f4c7815c7f0 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.592+0000 7f4c807db640 1 -- 172.21.15.79:0/2290600407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7815c7f0 msgr2=0x7f4c78165cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.592+0000 7f4c807db640 1 --2- 172.21.15.79:0/2290600407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7815c7f0 0x7f4c78165cc0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f4c78070cb0 tx=0x7f4c7002a730 comp rx=0 tx=0).stop 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.592+0000 7f4c807db640 1 -- 172.21.15.79:0/2290600407 shutdown_connections 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.592+0000 7f4c807db640 1 --2- 172.21.15.79:0/2290600407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c7815c7f0 0x7f4c78165cc0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.592+0000 7f4c807db640 1 --2- 172.21.15.79:0/2290600407 >> v2:172.21.15.117:3300/0 conn(0x7f4c78156830 0x7f4c78071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.592+0000 7f4c807db640 1 -- 172.21.15.79:0/2290600407 >> 172.21.15.79:0/2290600407 conn(0x7f4c780b19f0 msgr2=0x7f4c780b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.592+0000 7f4c807db640 1 -- 172.21.15.79:0/2290600407 shutdown_connections 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.592+0000 7f4c807db640 1 -- 172.21.15.79:0/2290600407 wait complete. 2024-06-10T00:22:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.593+0000 7f4c807db640 1 Processor -- start 2024-06-10T00:22:43.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.593+0000 7f4c807db640 1 -- start start 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c807db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c78072130 0x7f4c7814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c807db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c78156830 0x7f4c780d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c807db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c7815c7f0 0x7f4c780d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c807db640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780ccf00 con 0x7f4c78072130 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c807db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780ccd80 con 0x7f4c7815c7f0 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c807db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4c780cd080 con 0x7f4c78156830 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c78072130 0x7f4c7814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c78072130 0x7f4c7814d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35078/0 (socket says 172.21.15.79:35078) 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 -- 172.21.15.79:0/2613980264 learned_addr learned my addr 172.21.15.79:0/2613980264 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:43.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7ed78640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c7815c7f0 0x7f4c780d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7dd76640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c78156830 0x7f4c780d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 -- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c78156830 msgr2=0x7f4c780d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c78156830 0x7f4c780d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 -- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c7815c7f0 msgr2=0x7f4c780d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c7815c7f0 0x7f4c780d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 -- 172.21.15.79:0/2613980264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7809aab0 con 0x7f4c78072130 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7dd76640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c78156830 0x7f4c780d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7ed78640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c7815c7f0 0x7f4c780d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.594+0000 7f4c7e577640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c78072130 0x7f4c7814d940 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400d800 tx=0x7f4c7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.595+0000 7f4c6effd640 1 -- 172.21.15.79:0/2613980264 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7400b6c0 con 0x7f4c78072130 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.595+0000 7f4c6effd640 1 -- 172.21.15.79:0/2613980264 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74019070 con 0x7f4c78072130 2024-06-10T00:22:43.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.595+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7809ad20 con 0x7f4c78072130 2024-06-10T00:22:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.595+0000 7f4c6effd640 1 -- 172.21.15.79:0/2613980264 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7400bac0 con 0x7f4c78072130 2024-06-10T00:22:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.595+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7809b2e0 con 0x7f4c78072130 2024-06-10T00:22:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.595+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c78068430 con 0x7f4c78072130 2024-06-10T00:22:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.596+0000 7f4c6effd640 1 -- 172.21.15.79:0/2613980264 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c7400bc60 con 0x7f4c78072130 2024-06-10T00:22:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.596+0000 7f4c6effd640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5c06be60 0x7f4c5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.597+0000 7f4c6effd640 1 -- 172.21.15.79:0/2613980264 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f4c7408b4b0 con 0x7f4c78072130 2024-06-10T00:22:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.597+0000 7f4c7dd76640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5c06be60 0x7f4c5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.597+0000 7f4c7dd76640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5c06be60 0x7f4c5c06e320 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c780aeed0 tx=0x7f4c68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:43.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.601+0000 7f4c6effd640 1 -- 172.21.15.79:0/2613980264 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4c74059cd0 con 0x7f4c78072130 2024-06-10T00:22:43.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.807+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c7815eda0 con 0x7f4c78072130 2024-06-10T00:22:43.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.808+0000 7f4c6effd640 1 -- 172.21.15.79:0/2613980264 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7f4c740595d0 con 0x7f4c78072130 2024-06-10T00:22:43.808 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:43.809 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:22:42.806547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7698":{"gid":7698,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2980295924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2980295924},{"type":"v1","addr":"172.21.15.79:6837","nonce":2980295924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7698,"qdb_cluster":[7698]},"id":7}]} 2024-06-10T00:22:43.809 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-06-10T00:22:43.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.809+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5c06be60 msgr2=0x7f4c5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.809+0000 7f4c807db640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5c06be60 0x7f4c5c06e320 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c780aeed0 tx=0x7f4c68009040 comp rx=0 tx=0).stop 2024-06-10T00:22:43.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.809+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c78072130 msgr2=0x7f4c7814d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.809+0000 7f4c807db640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c78072130 0x7f4c7814d940 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400d800 tx=0x7f4c7400dcc0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.809+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 shutdown_connections 2024-06-10T00:22:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.809+0000 7f4c807db640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4c5c06be60 0x7f4c5c06e320 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.809+0000 7f4c807db640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c7815c7f0 0x7f4c780d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.809+0000 7f4c807db640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c78156830 0x7f4c780d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.810+0000 7f4c807db640 1 --2- 172.21.15.79:0/2613980264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c78072130 0x7f4c7814d940 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.810+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 >> 172.21.15.79:0/2613980264 conn(0x7f4c780b19f0 msgr2=0x7f4c780b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.810+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 shutdown_connections 2024-06-10T00:22:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.810+0000 7f4c807db640 1 -- 172.21.15.79:0/2613980264 wait complete. 2024-06-10T00:22:43.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:22:43.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.920+0000 7f71198d4640 1 Processor -- start 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.920+0000 7f71198d4640 1 -- start start 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71198d4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f711415c240 0x7f71140cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71198d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f711415d8b0 0x7f711415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71198d4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f711406deb0 con 0x7f711406d9b0 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71198d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f711415d630 con 0x7f711415d8b0 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71198d4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f711415e1d0 con 0x7f711415c240 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71137fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f711415d8b0 0x7f711415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71137fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f711415d8b0 0x7f711415dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35090/0 (socket says 172.21.15.79:35090) 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71137fe640 1 -- 172.21.15.79:0/3533042465 learned_addr learned my addr 172.21.15.79:0/3533042465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f7112ffd640 1 --2- 172.21.15.79:0/3533042465 >> v2:172.21.15.117:3300/0 conn(0x7f711415c240 0x7f71140cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71137fe640 1 -- 172.21.15.79:0/3533042465 >> v2:172.21.15.117:3300/0 conn(0x7f711415c240 msgr2=0x7f71140cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:43.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71137fe640 1 --2- 172.21.15.79:0/3533042465 >> v2:172.21.15.117:3300/0 conn(0x7f711415c240 0x7f71140cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71137fe640 1 -- 172.21.15.79:0/3533042465 >> v1:172.21.15.117:6789/0 conn(0x7f711406d9b0 legacy=0x7f711406ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.921+0000 7f71137fe640 1 -- 172.21.15.79:0/3533042465 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711406e190 con 0x7f711415d8b0 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.922+0000 7f71137fe640 1 --2- 172.21.15.79:0/3533042465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415dc90 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f71140b5c80 tx=0x7f710c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528fede7845cec3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.922+0000 7f71127fc640 1 -- 172.21.15.79:0/3533042465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c036070 con 0x7f711415d8b0 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.922+0000 7f71127fc640 1 -- 172.21.15.79:0/3533042465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710c031600 con 0x7f711415d8b0 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.922+0000 7f71127fc640 1 -- 172.21.15.79:0/3533042465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c0319d0 con 0x7f711415d8b0 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.923+0000 7f71198d4640 1 -- 172.21.15.79:0/3533042465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 msgr2=0x7f711415dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.923+0000 7f71198d4640 1 --2- 172.21.15.79:0/3533042465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415dc90 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f71140b5c80 tx=0x7f710c02a760 comp rx=0 tx=0).stop 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.923+0000 7f71198d4640 1 -- 172.21.15.79:0/3533042465 shutdown_connections 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.923+0000 7f71198d4640 1 --2- 172.21.15.79:0/3533042465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415dc90 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.923+0000 7f71198d4640 1 --2- 172.21.15.79:0/3533042465 >> v2:172.21.15.117:3300/0 conn(0x7f711415c240 0x7f71140cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.923+0000 7f71198d4640 1 -- 172.21.15.79:0/3533042465 >> 172.21.15.79:0/3533042465 conn(0x7f7114071950 msgr2=0x7f7114071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.923+0000 7f71198d4640 1 -- 172.21.15.79:0/3533042465 shutdown_connections 2024-06-10T00:22:43.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.923+0000 7f71198d4640 1 -- 172.21.15.79:0/3533042465 wait complete. 2024-06-10T00:22:43.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.924+0000 7f71198d4640 1 Processor -- start 2024-06-10T00:22:43.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.924+0000 7f71198d4640 1 -- start start 2024-06-10T00:22:43.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71198d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f711406d9b0 0x7f7114140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71198d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415c240 0x7f711414ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71198d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71198d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f711406ea30 con 0x7f711415d8b0 2024-06-10T00:22:43.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71198d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f711406e750 con 0x7f711415c240 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71198d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f71140aff60 con 0x7f711406d9b0 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35092/0 (socket says 172.21.15.79:35092) 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71137fe640 1 -- 172.21.15.79:0/2447334333 learned_addr learned my addr 172.21.15.79:0/2447334333 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f7112ffd640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f711406d9b0 0x7f7114140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f710a7fc640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415c240 0x7f711414ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71137fe640 1 -- 172.21.15.79:0/2447334333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f711406d9b0 msgr2=0x7f7114140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71137fe640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f711406d9b0 0x7f7114140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71137fe640 1 -- 172.21.15.79:0/2447334333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415c240 msgr2=0x7f711414ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71137fe640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415c240 0x7f711414ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.925+0000 7f71137fe640 1 -- 172.21.15.79:0/2447334333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711414b7c0 con 0x7f711415d8b0 2024-06-10T00:22:43.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.926+0000 7f71137fe640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415a840 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f710c009e50 tx=0x7f710c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.926+0000 7f7110ff9640 1 -- 172.21.15.79:0/2447334333 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c036050 con 0x7f711415d8b0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.926+0000 7f7110ff9640 1 -- 172.21.15.79:0/2447334333 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710c042070 con 0x7f711415d8b0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.926+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711414baa0 con 0x7f711415d8b0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.926+0000 7f7110ff9640 1 -- 172.21.15.79:0/2447334333 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c009510 con 0x7f711415d8b0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.926+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f711414c060 con 0x7f711415d8b0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.927+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7114068430 con 0x7f711415d8b0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.927+0000 7f7110ff9640 1 -- 172.21.15.79:0/2447334333 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f710c007bf0 con 0x7f711415d8b0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.928+0000 7f7110ff9640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70f406be30 0x7f70f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.928+0000 7f7110ff9640 1 -- 172.21.15.79:0/2447334333 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f710c0abbd0 con 0x7f711415d8b0 2024-06-10T00:22:43.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.928+0000 7f7112ffd640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70f406be30 0x7f70f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:43.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.928+0000 7f7112ffd640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70f406be30 0x7f70f406e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7104009b40 tx=0x7f7104009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:43.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:43.932+0000 7f7110ff9640 1 -- 172.21.15.79:0/2447334333 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f710c079e40 con 0x7f711415d8b0 2024-06-10T00:22:44.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.104+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f711415f890 con 0x7f711415d8b0 2024-06-10T00:22:44.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.105+0000 7f7110ff9640 1 -- 172.21.15.79:0/2447334333 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16836 (secure 0 0 0) 0x7f710c07e140 con 0x7f711415d8b0 2024-06-10T00:22:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:44.106 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":104,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:22:42.454234+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:22:39.425117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-06-10T00:22:39.768572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:22:44.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70f406be30 msgr2=0x7f70f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70f406be30 0x7f70f406e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7104009b40 tx=0x7f7104009190 comp rx=0 tx=0).stop 2024-06-10T00:22:44.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 msgr2=0x7f711415a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415a840 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f710c009e50 tx=0x7f710c004a40 comp rx=0 tx=0).stop 2024-06-10T00:22:44.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 shutdown_connections 2024-06-10T00:22:44.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f70f406be30 0x7f70f406e2f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f711415d8b0 0x7f711415a840 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415c240 0x7f711414ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 --2- 172.21.15.79:0/2447334333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f711406d9b0 0x7f7114140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 >> 172.21.15.79:0/2447334333 conn(0x7f7114071950 msgr2=0x7f7114159470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:44.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 shutdown_connections 2024-06-10T00:22:44.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.107+0000 7f71198d4640 1 -- 172.21.15.79:0/2447334333 wait complete. 2024-06-10T00:22:44.119 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:22:44.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:22:44.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.218+0000 7f321505d640 1 Processor -- start 2024-06-10T00:22:44.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.218+0000 7f321505d640 1 -- start start 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f321505d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3210158b50 0x7f321006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f321505d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f321006cae0 0x7f321006def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f321505d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321006e670 con 0x7f3210158770 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f321505d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f321006e430 con 0x7f321006cae0 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f321505d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f321006e950 con 0x7f3210158b50 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f320f59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f321006cae0 0x7f321006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f320f59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f321006cae0 0x7f321006def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35096/0 (socket says 172.21.15.79:35096) 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f320f59e640 1 -- 172.21.15.79:0/365471030 learned_addr learned my addr 172.21.15.79:0/365471030 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:44.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f320e59c640 1 --2- 172.21.15.79:0/365471030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3210158b50 0x7f321006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f320f59e640 1 -- 172.21.15.79:0/365471030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3210158b50 msgr2=0x7f321006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.219+0000 7f320f59e640 1 --2- 172.21.15.79:0/365471030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3210158b50 0x7f321006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.220+0000 7f320f59e640 1 -- 172.21.15.79:0/365471030 >> v1:172.21.15.117:6789/0 conn(0x7f3210158770 legacy=0x7f321006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.220+0000 7f320f59e640 1 -- 172.21.15.79:0/365471030 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321006ec30 con 0x7f321006cae0 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.220+0000 7f320f59e640 1 --2- 172.21.15.79:0/365471030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321006cae0 0x7f321006def0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f3208009870 tx=0x7f320802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7138aad4bba845 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.220+0000 7f320dd9b640 1 -- 172.21.15.79:0/365471030 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208037070 con 0x7f321006cae0 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.220+0000 7f320dd9b640 1 -- 172.21.15.79:0/365471030 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3208032440 con 0x7f321006cae0 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.220+0000 7f320dd9b640 1 -- 172.21.15.79:0/365471030 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208032810 con 0x7f321006cae0 2024-06-10T00:22:44.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.221+0000 7f321505d640 1 -- 172.21.15.79:0/365471030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321006cae0 msgr2=0x7f321006def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.221+0000 7f321505d640 1 --2- 172.21.15.79:0/365471030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321006cae0 0x7f321006def0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f3208009870 tx=0x7f320802a1c0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.221+0000 7f321505d640 1 -- 172.21.15.79:0/365471030 shutdown_connections 2024-06-10T00:22:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.221+0000 7f321505d640 1 --2- 172.21.15.79:0/365471030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321006cae0 0x7f321006def0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.221+0000 7f321505d640 1 --2- 172.21.15.79:0/365471030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3210158b50 0x7f321006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.221+0000 7f321505d640 1 -- 172.21.15.79:0/365471030 >> 172.21.15.79:0/365471030 conn(0x7f3210071950 msgr2=0x7f3210071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.221+0000 7f321505d640 1 -- 172.21.15.79:0/365471030 shutdown_connections 2024-06-10T00:22:44.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.221+0000 7f321505d640 1 -- 172.21.15.79:0/365471030 wait complete. 2024-06-10T00:22:44.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.222+0000 7f321505d640 1 Processor -- start 2024-06-10T00:22:44.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.222+0000 7f321505d640 1 -- start start 2024-06-10T00:22:44.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f321505d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321006cae0 0x7f3210146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f321505d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3210158770 0x7f32100af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f321505d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3210158b50 0x7f321015ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f321505d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32100ae630 con 0x7f3210158770 2024-06-10T00:22:44.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f321505d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32100ae4b0 con 0x7f3210158b50 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f321505d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32100aedb0 con 0x7f321006cae0 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f320e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3210158770 0x7f32100af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f320e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3210158770 0x7f32100af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35098/0 (socket says 172.21.15.79:35098) 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f320e59c640 1 -- 172.21.15.79:0/1236204882 learned_addr learned my addr 172.21.15.79:0/1236204882 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f320ed9d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321006cae0 0x7f3210146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.223+0000 7f320f59e640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3210158b50 0x7f321015ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f320e59c640 1 -- 172.21.15.79:0/1236204882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321006cae0 msgr2=0x7f3210146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f320e59c640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321006cae0 0x7f3210146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f320e59c640 1 -- 172.21.15.79:0/1236204882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3210158b50 msgr2=0x7f321015ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f320e59c640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3210158b50 0x7f321015ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f320e59c640 1 -- 172.21.15.79:0/1236204882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321015d310 con 0x7f3210158770 2024-06-10T00:22:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f320e59c640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3210158770 0x7f32100af1c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f320400d600 tx=0x7f320400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f31f77fe640 1 -- 172.21.15.79:0/1236204882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32040125f0 con 0x7f3210158770 2024-06-10T00:22:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f31f77fe640 1 -- 172.21.15.79:0/1236204882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3204019070 con 0x7f3210158770 2024-06-10T00:22:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f31f77fe640 1 -- 172.21.15.79:0/1236204882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32040129f0 con 0x7f3210158770 2024-06-10T00:22:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321015dff0 con 0x7f3210158770 2024-06-10T00:22:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.224+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321015e5b0 con 0x7f3210158770 2024-06-10T00:22:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.225+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321015e7b0 con 0x7f3210158770 2024-06-10T00:22:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.226+0000 7f31f77fe640 1 -- 172.21.15.79:0/1236204882 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3204012b90 con 0x7f3210158770 2024-06-10T00:22:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.226+0000 7f31f77fe640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f31fc06be30 0x7f31fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.226+0000 7f31f77fe640 1 -- 172.21.15.79:0/1236204882 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f320408b2c0 con 0x7f3210158770 2024-06-10T00:22:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.226+0000 7f320ed9d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f31fc06be30 0x7f31fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.226+0000 7f320ed9d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f31fc06be30 0x7f31fc06e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3200001f10 tx=0x7f3200009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.230+0000 7f31f77fe640 1 -- 172.21.15.79:0/1236204882 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3204059490 con 0x7f3210158770 2024-06-10T00:22:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.404+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f321015dde0 con 0x7f31fc06be30 2024-06-10T00:22:44.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.410+0000 7f31f77fe640 1 -- 172.21.15.79:0/1236204882 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247090 (secure 0 0 0) 0x7f321015dde0 con 0x7f31fc06be30 2024-06-10T00:22:44.413 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:44.415 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:22:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f31fc06be30 msgr2=0x7f31fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f31fc06be30 0x7f31fc06e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3200001f10 tx=0x7f3200009040 comp rx=0 tx=0).stop 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3210158770 msgr2=0x7f32100af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3210158770 0x7f32100af1c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f320400d600 tx=0x7f320400dac0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 shutdown_connections 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f31fc06be30 0x7f31fc06e2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3210158b50 0x7f321015ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3210158770 0x7f32100af1c0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 --2- 172.21.15.79:0/1236204882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321006cae0 0x7f3210146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 >> 172.21.15.79:0/1236204882 conn(0x7f3210071950 msgr2=0x7f3210161e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 shutdown_connections 2024-06-10T00:22:44.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.413+0000 7f321505d640 1 -- 172.21.15.79:0/1236204882 wait complete. 2024-06-10T00:22:44.424 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-06-10T00:22:43.255944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260484,"kb_used_data":11012,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714236,"statfs":{"total":773094113280,"available":772827377664,"internally_reserved":0,"allocated":11276288,"data_stored":5841191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000850"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453378+0000","last_change":"2024-06-10T00:22:40.453378+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453378+0000","last_undegraded":"2024-06-10T00:22:40.453378+0000","last_fullsized":"2024-06-10T00:22:40.453378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453738+0000","last_change":"2024-06-10T00:22:40.453738+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453738+0000","last_undegraded":"2024-06-10T00:22:40.453738+0000","last_fullsized":"2024-06-10T00:22:40.453738+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453610+0000","last_change":"2024-06-10T00:22:40.453610+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453610+0000","last_undegraded":"2024-06-10T00:22:40.453610+0000","last_fullsized":"2024-06-10T00:22:40.453610+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451659+0000","last_change":"2024-06-10T00:22:40.451659+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451659+0000","last_undegraded":"2024-06-10T00:22:40.451659+0000","last_fullsized":"2024-06-10T00:22:40.451659+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447665+0000","last_change":"2024-06-10T00:22:40.447665+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447665+0000","last_undegraded":"2024-06-10T00:22:40.447665+0000","last_fullsized":"2024-06-10T00:22:40.447665+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452521+0000","last_change":"2024-06-10T00:22:40.452521+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452521+0000","last_undegraded":"2024-06-10T00:22:40.452521+0000","last_fullsized":"2024-06-10T00:22:40.452521+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452200+0000","last_change":"2024-06-10T00:22:40.452200+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452200+0000","last_undegraded":"2024-06-10T00:22:40.452200+0000","last_fullsized":"2024-06-10T00:22:40.452200+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451364+0000","last_change":"2024-06-10T00:22:40.451364+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451364+0000","last_undegraded":"2024-06-10T00:22:40.451364+0000","last_fullsized":"2024-06-10T00:22:40.451364+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452776+0000","last_change":"2024-06-10T00:22:40.452776+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452776+0000","last_undegraded":"2024-06-10T00:22:40.452776+0000","last_fullsized":"2024-06-10T00:22:40.452776+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447237+0000","last_change":"2024-06-10T00:22:40.447237+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447237+0000","last_undegraded":"2024-06-10T00:22:40.447237+0000","last_fullsized":"2024-06-10T00:22:40.447237+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446588+0000","last_change":"2024-06-10T00:22:40.446588+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446588+0000","last_undegraded":"2024-06-10T00:22:40.446588+0000","last_fullsized":"2024-06-10T00:22:40.446588+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446567+0000","last_change":"2024-06-10T00:22:40.446567+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446567+0000","last_undegraded":"2024-06-10T00:22:40.446567+0000","last_fullsized":"2024-06-10T00:22:40.446567+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455589+0000","last_change":"2024-06-10T00:22:40.455589+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455589+0000","last_undegraded":"2024-06-10T00:22:40.455589+0000","last_fullsized":"2024-06-10T00:22:40.455589+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448757+0000","last_change":"2024-06-10T00:22:40.448757+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448757+0000","last_undegraded":"2024-06-10T00:22:40.448757+0000","last_fullsized":"2024-06-10T00:22:40.448757+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447882+0000","last_change":"2024-06-10T00:22:40.447882+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447882+0000","last_undegraded":"2024-06-10T00:22:40.447882+0000","last_fullsized":"2024-06-10T00:22:40.447882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448664+0000","last_change":"2024-06-10T00:22:40.448664+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448664+0000","last_undegraded":"2024-06-10T00:22:40.448664+0000","last_fullsized":"2024-06-10T00:22:40.448664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452849+0000","last_change":"2024-06-10T00:22:40.452849+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452849+0000","last_undegraded":"2024-06-10T00:22:40.452849+0000","last_fullsized":"2024-06-10T00:22:40.452849+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453321+0000","last_change":"2024-06-10T00:22:40.453321+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453321+0000","last_undegraded":"2024-06-10T00:22:40.453321+0000","last_fullsized":"2024-06-10T00:22:40.453321+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453224+0000","last_change":"2024-06-10T00:22:40.453224+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453224+0000","last_undegraded":"2024-06-10T00:22:40.453224+0000","last_fullsized":"2024-06-10T00:22:40.453224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446137+0000","last_change":"2024-06-10T00:22:40.446137+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446137+0000","last_undegraded":"2024-06-10T00:22:40.446137+0000","last_fullsized":"2024-06-10T00:22:40.446137+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451058+0000","last_change":"2024-06-10T00:22:40.451058+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451058+0000","last_undegraded":"2024-06-10T00:22:40.451058+0000","last_fullsized":"2024-06-10T00:22:40.451058+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447249+0000","last_change":"2024-06-10T00:22:40.447249+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447249+0000","last_undegraded":"2024-06-10T00:22:40.447249+0000","last_fullsized":"2024-06-10T00:22:40.447249+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451281+0000","last_change":"2024-06-10T00:22:40.451281+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451281+0000","last_undegraded":"2024-06-10T00:22:40.451281+0000","last_fullsized":"2024-06-10T00:22:40.451281+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447178+0000","last_change":"2024-06-10T00:22:40.447178+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447178+0000","last_undegraded":"2024-06-10T00:22:40.447178+0000","last_fullsized":"2024-06-10T00:22:40.447178+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445987+0000","last_change":"2024-06-10T00:22:40.445987+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445987+0000","last_undegraded":"2024-06-10T00:22:40.445987+0000","last_fullsized":"2024-06-10T00:22:40.445987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.444771+0000","last_change":"2024-06-10T00:22:40.444771+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.444771+0000","last_undegraded":"2024-06-10T00:22:40.444771+0000","last_fullsized":"2024-06-10T00:22:40.444771+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446154+0000","last_change":"2024-06-10T00:22:40.446154+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446154+0000","last_undegraded":"2024-06-10T00:22:40.446154+0000","last_fullsized":"2024-06-10T00:22:40.446154+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453937+0000","last_change":"2024-06-10T00:22:40.453937+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453937+0000","last_undegraded":"2024-06-10T00:22:40.453937+0000","last_fullsized":"2024-06-10T00:22:40.453937+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450597+0000","last_change":"2024-06-10T00:22:40.450597+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450597+0000","last_undegraded":"2024-06-10T00:22:40.450597+0000","last_fullsized":"2024-06-10T00:22:40.450597+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445568+0000","last_change":"2024-06-10T00:22:40.445568+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445568+0000","last_undegraded":"2024-06-10T00:22:40.445568+0000","last_fullsized":"2024-06-10T00:22:40.445568+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451664+0000","last_change":"2024-06-10T00:22:40.451664+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451664+0000","last_undegraded":"2024-06-10T00:22:40.451664+0000","last_fullsized":"2024-06-10T00:22:40.451664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450942+0000","last_change":"2024-06-10T00:22:40.450942+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450942+0000","last_undegraded":"2024-06-10T00:22:40.450942+0000","last_fullsized":"2024-06-10T00:22:40.450942+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.454640+0000","last_change":"2024-06-10T00:22:40.454640+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.454640+0000","last_undegraded":"2024-06-10T00:22:40.454640+0000","last_fullsized":"2024-06-10T00:22:40.454640+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465911+0000","last_change":"2024-06-10T00:22:40.464067+0000","last_active":"2024-06-10T00:22:40.465911+0000","last_peered":"2024-06-10T00:22:40.465911+0000","last_clean":"2024-06-10T00:22:40.465911+0000","last_became_active":"2024-06-10T00:22:40.463201+0000","last_became_peered":"2024-06-10T00:22:40.463201+0000","last_unstale":"2024-06-10T00:22:40.465911+0000","last_undegraded":"2024-06-10T00:22:40.465911+0000","last_fullsized":"2024-06-10T00:22:40.465911+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:21:18.421656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448819+0000","last_change":"2024-06-10T00:22:40.448819+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448819+0000","last_undegraded":"2024-06-10T00:22:40.448819+0000","last_fullsized":"2024-06-10T00:22:40.448819+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.464968+0000","last_change":"2024-06-10T00:22:40.459474+0000","last_active":"2024-06-10T00:22:40.464968+0000","last_peered":"2024-06-10T00:22:40.464968+0000","last_clean":"2024-06-10T00:22:40.464968+0000","last_became_active":"2024-06-10T00:22:40.459104+0000","last_became_peered":"2024-06-10T00:22:40.459104+0000","last_unstale":"2024-06-10T00:22:40.464968+0000","last_undegraded":"2024-06-10T00:22:40.464968+0000","last_fullsized":"2024-06-10T00:22:40.464968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:33:31.007804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445077+0000","last_change":"2024-06-10T00:22:40.445077+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445077+0000","last_undegraded":"2024-06-10T00:22:40.445077+0000","last_fullsized":"2024-06-10T00:22:40.445077+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462178+0000","last_change":"2024-06-10T00:22:40.459372+0000","last_active":"2024-06-10T00:22:40.462178+0000","last_peered":"2024-06-10T00:22:40.462178+0000","last_clean":"2024-06-10T00:22:40.462178+0000","last_became_active":"2024-06-10T00:22:40.456763+0000","last_became_peered":"2024-06-10T00:22:40.456763+0000","last_unstale":"2024-06-10T00:22:40.462178+0000","last_undegraded":"2024-06-10T00:22:40.462178+0000","last_fullsized":"2024-06-10T00:22:40.462178+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446568+0000","last_change":"2024-06-10T00:22:40.446568+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446568+0000","last_undegraded":"2024-06-10T00:22:40.446568+0000","last_fullsized":"2024-06-10T00:22:40.446568+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460758+0000","last_change":"2024-06-10T00:22:40.458499+0000","last_active":"2024-06-10T00:22:40.460758+0000","last_peered":"2024-06-10T00:22:40.460758+0000","last_clean":"2024-06-10T00:22:40.460758+0000","last_became_active":"2024-06-10T00:22:40.458216+0000","last_became_peered":"2024-06-10T00:22:40.458216+0000","last_unstale":"2024-06-10T00:22:40.460758+0000","last_undegraded":"2024-06-10T00:22:40.460758+0000","last_fullsized":"2024-06-10T00:22:40.460758+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:52:36.829097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451227+0000","last_change":"2024-06-10T00:22:40.451227+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451227+0000","last_undegraded":"2024-06-10T00:22:40.451227+0000","last_fullsized":"2024-06-10T00:22:40.451227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.457112+0000","last_change":"2024-06-10T00:22:40.455292+0000","last_active":"2024-06-10T00:22:40.457112+0000","last_peered":"2024-06-10T00:22:40.457112+0000","last_clean":"2024-06-10T00:22:40.457112+0000","last_became_active":"2024-06-10T00:22:40.455011+0000","last_became_peered":"2024-06-10T00:22:40.455011+0000","last_unstale":"2024-06-10T00:22:40.457112+0000","last_undegraded":"2024-06-10T00:22:40.457112+0000","last_fullsized":"2024-06-10T00:22:40.457112+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:13.197903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452127+0000","last_change":"2024-06-10T00:22:40.452127+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452127+0000","last_undegraded":"2024-06-10T00:22:40.452127+0000","last_fullsized":"2024-06-10T00:22:40.452127+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.456928+0000","last_change":"2024-06-10T00:22:40.453019+0000","last_active":"2024-06-10T00:22:40.456928+0000","last_peered":"2024-06-10T00:22:40.456928+0000","last_clean":"2024-06-10T00:22:40.456928+0000","last_became_active":"2024-06-10T00:22:40.452738+0000","last_became_peered":"2024-06-10T00:22:40.452738+0000","last_unstale":"2024-06-10T00:22:40.456928+0000","last_undegraded":"2024-06-10T00:22:40.456928+0000","last_fullsized":"2024-06-10T00:22:40.456928+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:57:14.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452619+0000","last_change":"2024-06-10T00:22:40.452619+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452619+0000","last_undegraded":"2024-06-10T00:22:40.452619+0000","last_fullsized":"2024-06-10T00:22:40.452619+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458402+0000","last_change":"2024-06-10T00:22:40.454657+0000","last_active":"2024-06-10T00:22:40.458402+0000","last_peered":"2024-06-10T00:22:40.458402+0000","last_clean":"2024-06-10T00:22:40.458402+0000","last_became_active":"2024-06-10T00:22:40.454398+0000","last_became_peered":"2024-06-10T00:22:40.454398+0000","last_unstale":"2024-06-10T00:22:40.458402+0000","last_undegraded":"2024-06-10T00:22:40.458402+0000","last_fullsized":"2024-06-10T00:22:40.458402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:19:39.853903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.456370+0000","last_change":"2024-06-10T00:22:40.456370+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.456370+0000","last_undegraded":"2024-06-10T00:22:40.456370+0000","last_fullsized":"2024-06-10T00:22:40.456370+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.464034+0000","last_change":"2024-06-10T00:22:40.461992+0000","last_active":"2024-06-10T00:22:40.464034+0000","last_peered":"2024-06-10T00:22:40.464034+0000","last_clean":"2024-06-10T00:22:40.464034+0000","last_became_active":"2024-06-10T00:22:40.461700+0000","last_became_peered":"2024-06-10T00:22:40.461700+0000","last_unstale":"2024-06-10T00:22:40.464034+0000","last_undegraded":"2024-06-10T00:22:40.464034+0000","last_fullsized":"2024-06-10T00:22:40.464034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:33:07.654120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455105+0000","last_change":"2024-06-10T00:22:40.455105+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455105+0000","last_undegraded":"2024-06-10T00:22:40.455105+0000","last_fullsized":"2024-06-10T00:22:40.455105+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458470+0000","last_change":"2024-06-10T00:22:40.455913+0000","last_active":"2024-06-10T00:22:40.458470+0000","last_peered":"2024-06-10T00:22:40.458470+0000","last_clean":"2024-06-10T00:22:40.458470+0000","last_became_active":"2024-06-10T00:22:40.455625+0000","last_became_peered":"2024-06-10T00:22:40.455625+0000","last_unstale":"2024-06-10T00:22:40.458470+0000","last_undegraded":"2024-06-10T00:22:40.458470+0000","last_fullsized":"2024-06-10T00:22:40.458470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446750+0000","last_change":"2024-06-10T00:22:40.446750+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446750+0000","last_undegraded":"2024-06-10T00:22:40.446750+0000","last_fullsized":"2024-06-10T00:22:40.446750+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465800+0000","last_change":"2024-06-10T00:22:40.463696+0000","last_active":"2024-06-10T00:22:40.465800+0000","last_peered":"2024-06-10T00:22:40.465800+0000","last_clean":"2024-06-10T00:22:40.465800+0000","last_became_active":"2024-06-10T00:22:40.463375+0000","last_became_peered":"2024-06-10T00:22:40.463375+0000","last_unstale":"2024-06-10T00:22:40.465800+0000","last_undegraded":"2024-06-10T00:22:40.465800+0000","last_fullsized":"2024-06-10T00:22:40.465800+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:06:16.483344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448537+0000","last_change":"2024-06-10T00:22:40.448537+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448537+0000","last_undegraded":"2024-06-10T00:22:40.448537+0000","last_fullsized":"2024-06-10T00:22:40.448537+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467797+0000","last_change":"2024-06-10T00:22:40.463539+0000","last_active":"2024-06-10T00:22:40.467797+0000","last_peered":"2024-06-10T00:22:40.467797+0000","last_clean":"2024-06-10T00:22:40.467797+0000","last_became_active":"2024-06-10T00:22:40.463229+0000","last_became_peered":"2024-06-10T00:22:40.463229+0000","last_unstale":"2024-06-10T00:22:40.467797+0000","last_undegraded":"2024-06-10T00:22:40.467797+0000","last_fullsized":"2024-06-10T00:22:40.467797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:07.961320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446602+0000","last_change":"2024-06-10T00:22:40.446602+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446602+0000","last_undegraded":"2024-06-10T00:22:40.446602+0000","last_fullsized":"2024-06-10T00:22:40.446602+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.468033+0000","last_change":"2024-06-10T00:22:40.465693+0000","last_active":"2024-06-10T00:22:40.468033+0000","last_peered":"2024-06-10T00:22:40.468033+0000","last_clean":"2024-06-10T00:22:40.468033+0000","last_became_active":"2024-06-10T00:22:40.465452+0000","last_became_peered":"2024-06-10T00:22:40.465452+0000","last_unstale":"2024-06-10T00:22:40.468033+0000","last_undegraded":"2024-06-10T00:22:40.468033+0000","last_fullsized":"2024-06-10T00:22:40.468033+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:03:33.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445894+0000","last_change":"2024-06-10T00:22:40.445894+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445894+0000","last_undegraded":"2024-06-10T00:22:40.445894+0000","last_fullsized":"2024-06-10T00:22:40.445894+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460056+0000","last_change":"2024-06-10T00:22:40.456048+0000","last_active":"2024-06-10T00:22:40.460056+0000","last_peered":"2024-06-10T00:22:40.460056+0000","last_clean":"2024-06-10T00:22:40.460056+0000","last_became_active":"2024-06-10T00:22:40.455788+0000","last_became_peered":"2024-06-10T00:22:40.455788+0000","last_unstale":"2024-06-10T00:22:40.460056+0000","last_undegraded":"2024-06-10T00:22:40.460056+0000","last_fullsized":"2024-06-10T00:22:40.460056+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452484+0000","last_change":"2024-06-10T00:22:40.452484+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452484+0000","last_undegraded":"2024-06-10T00:22:40.452484+0000","last_fullsized":"2024-06-10T00:22:40.452484+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.463737+0000","last_change":"2024-06-10T00:22:40.458861+0000","last_active":"2024-06-10T00:22:40.463737+0000","last_peered":"2024-06-10T00:22:40.463737+0000","last_clean":"2024-06-10T00:22:40.463737+0000","last_became_active":"2024-06-10T00:22:40.458585+0000","last_became_peered":"2024-06-10T00:22:40.458585+0000","last_unstale":"2024-06-10T00:22:40.463737+0000","last_undegraded":"2024-06-10T00:22:40.463737+0000","last_fullsized":"2024-06-10T00:22:40.463737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450140+0000","last_change":"2024-06-10T00:22:40.450140+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450140+0000","last_undegraded":"2024-06-10T00:22:40.450140+0000","last_fullsized":"2024-06-10T00:22:40.450140+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465695+0000","last_change":"2024-06-10T00:22:40.460616+0000","last_active":"2024-06-10T00:22:40.465695+0000","last_peered":"2024-06-10T00:22:40.465695+0000","last_clean":"2024-06-10T00:22:40.465695+0000","last_became_active":"2024-06-10T00:22:40.460359+0000","last_became_peered":"2024-06-10T00:22:40.460359+0000","last_unstale":"2024-06-10T00:22:40.465695+0000","last_undegraded":"2024-06-10T00:22:40.465695+0000","last_fullsized":"2024-06-10T00:22:40.465695+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:52:06.207600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452388+0000","last_change":"2024-06-10T00:22:40.452388+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452388+0000","last_undegraded":"2024-06-10T00:22:40.452388+0000","last_fullsized":"2024-06-10T00:22:40.452388+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458372+0000","last_change":"2024-06-10T00:22:40.451127+0000","last_active":"2024-06-10T00:22:40.458372+0000","last_peered":"2024-06-10T00:22:40.458372+0000","last_clean":"2024-06-10T00:22:40.458372+0000","last_became_active":"2024-06-10T00:22:40.450861+0000","last_became_peered":"2024-06-10T00:22:40.450861+0000","last_unstale":"2024-06-10T00:22:40.458372+0000","last_undegraded":"2024-06-10T00:22:40.458372+0000","last_fullsized":"2024-06-10T00:22:40.458372+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:03:33.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450517+0000","last_change":"2024-06-10T00:22:40.450517+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450517+0000","last_undegraded":"2024-06-10T00:22:40.450517+0000","last_fullsized":"2024-06-10T00:22:40.450517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462598+0000","last_change":"2024-06-10T00:22:40.459091+0000","last_active":"2024-06-10T00:22:40.462598+0000","last_peered":"2024-06-10T00:22:40.462598+0000","last_clean":"2024-06-10T00:22:40.462598+0000","last_became_active":"2024-06-10T00:22:40.458813+0000","last_became_peered":"2024-06-10T00:22:40.458813+0000","last_unstale":"2024-06-10T00:22:40.462598+0000","last_undegraded":"2024-06-10T00:22:40.462598+0000","last_fullsized":"2024-06-10T00:22:40.462598+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:43:56.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451845+0000","last_change":"2024-06-10T00:22:40.451845+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451845+0000","last_undegraded":"2024-06-10T00:22:40.451845+0000","last_fullsized":"2024-06-10T00:22:40.451845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462663+0000","last_change":"2024-06-10T00:22:40.460540+0000","last_active":"2024-06-10T00:22:40.462663+0000","last_peered":"2024-06-10T00:22:40.462663+0000","last_clean":"2024-06-10T00:22:40.462663+0000","last_became_active":"2024-06-10T00:22:40.460239+0000","last_became_peered":"2024-06-10T00:22:40.460239+0000","last_unstale":"2024-06-10T00:22:40.462663+0000","last_undegraded":"2024-06-10T00:22:40.462663+0000","last_fullsized":"2024-06-10T00:22:40.462663+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:41.291107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447119+0000","last_change":"2024-06-10T00:22:40.447119+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447119+0000","last_undegraded":"2024-06-10T00:22:40.447119+0000","last_fullsized":"2024-06-10T00:22:40.447119+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.459704+0000","last_change":"2024-06-10T00:22:40.457983+0000","last_active":"2024-06-10T00:22:40.459704+0000","last_peered":"2024-06-10T00:22:40.459704+0000","last_clean":"2024-06-10T00:22:40.459704+0000","last_became_active":"2024-06-10T00:22:40.457713+0000","last_became_peered":"2024-06-10T00:22:40.457713+0000","last_unstale":"2024-06-10T00:22:40.459704+0000","last_undegraded":"2024-06-10T00:22:40.459704+0000","last_fullsized":"2024-06-10T00:22:40.459704+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452095+0000","last_change":"2024-06-10T00:22:40.452095+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452095+0000","last_undegraded":"2024-06-10T00:22:40.452095+0000","last_fullsized":"2024-06-10T00:22:40.452095+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465729+0000","last_change":"2024-06-10T00:22:40.464715+0000","last_active":"2024-06-10T00:22:40.465729+0000","last_peered":"2024-06-10T00:22:40.465729+0000","last_clean":"2024-06-10T00:22:40.465729+0000","last_became_active":"2024-06-10T00:22:40.464434+0000","last_became_peered":"2024-06-10T00:22:40.464434+0000","last_unstale":"2024-06-10T00:22:40.465729+0000","last_undegraded":"2024-06-10T00:22:40.465729+0000","last_fullsized":"2024-06-10T00:22:40.465729+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:12:48.174973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452817+0000","last_change":"2024-06-10T00:22:40.452817+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452817+0000","last_undegraded":"2024-06-10T00:22:40.452817+0000","last_fullsized":"2024-06-10T00:22:40.452817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.461851+0000","last_change":"2024-06-10T00:22:40.458231+0000","last_active":"2024-06-10T00:22:40.461851+0000","last_peered":"2024-06-10T00:22:40.461851+0000","last_clean":"2024-06-10T00:22:40.461851+0000","last_became_active":"2024-06-10T00:22:40.457959+0000","last_became_peered":"2024-06-10T00:22:40.457959+0000","last_unstale":"2024-06-10T00:22:40.461851+0000","last_undegraded":"2024-06-10T00:22:40.461851+0000","last_fullsized":"2024-06-10T00:22:40.461851+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:58.753457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453465+0000","last_change":"2024-06-10T00:22:40.453465+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453465+0000","last_undegraded":"2024-06-10T00:22:40.453465+0000","last_fullsized":"2024-06-10T00:22:40.453465+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462888+0000","last_change":"2024-06-10T00:22:40.461887+0000","last_active":"2024-06-10T00:22:40.462888+0000","last_peered":"2024-06-10T00:22:40.462888+0000","last_clean":"2024-06-10T00:22:40.462888+0000","last_became_active":"2024-06-10T00:22:40.461591+0000","last_became_peered":"2024-06-10T00:22:40.461591+0000","last_unstale":"2024-06-10T00:22:40.462888+0000","last_undegraded":"2024-06-10T00:22:40.462888+0000","last_fullsized":"2024-06-10T00:22:40.462888+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:13:12.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448589+0000","last_change":"2024-06-10T00:22:40.448589+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448589+0000","last_undegraded":"2024-06-10T00:22:40.448589+0000","last_fullsized":"2024-06-10T00:22:40.448589+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.468529+0000","last_change":"2024-06-10T00:22:40.465440+0000","last_active":"2024-06-10T00:22:40.468529+0000","last_peered":"2024-06-10T00:22:40.468529+0000","last_clean":"2024-06-10T00:22:40.468529+0000","last_became_active":"2024-06-10T00:22:40.465137+0000","last_became_peered":"2024-06-10T00:22:40.465137+0000","last_unstale":"2024-06-10T00:22:40.468529+0000","last_undegraded":"2024-06-10T00:22:40.468529+0000","last_fullsized":"2024-06-10T00:22:40.468529+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:36:26.012841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455464+0000","last_change":"2024-06-10T00:22:40.455464+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455464+0000","last_undegraded":"2024-06-10T00:22:40.455464+0000","last_fullsized":"2024-06-10T00:22:40.455464+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460024+0000","last_change":"2024-06-10T00:22:40.455370+0000","last_active":"2024-06-10T00:22:40.460024+0000","last_peered":"2024-06-10T00:22:40.460024+0000","last_clean":"2024-06-10T00:22:40.460024+0000","last_became_active":"2024-06-10T00:22:40.455076+0000","last_became_peered":"2024-06-10T00:22:40.455076+0000","last_unstale":"2024-06-10T00:22:40.460024+0000","last_undegraded":"2024-06-10T00:22:40.460024+0000","last_fullsized":"2024-06-10T00:22:40.460024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445351+0000","last_change":"2024-06-10T00:22:40.445351+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445351+0000","last_undegraded":"2024-06-10T00:22:40.445351+0000","last_fullsized":"2024-06-10T00:22:40.445351+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465773+0000","last_change":"2024-06-10T00:22:40.463082+0000","last_active":"2024-06-10T00:22:40.465773+0000","last_peered":"2024-06-10T00:22:40.465773+0000","last_clean":"2024-06-10T00:22:40.465773+0000","last_became_active":"2024-06-10T00:22:40.462736+0000","last_became_peered":"2024-06-10T00:22:40.462736+0000","last_unstale":"2024-06-10T00:22:40.465773+0000","last_undegraded":"2024-06-10T00:22:40.465773+0000","last_fullsized":"2024-06-10T00:22:40.465773+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:28:31.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452463+0000","last_change":"2024-06-10T00:22:40.452463+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452463+0000","last_undegraded":"2024-06-10T00:22:40.452463+0000","last_fullsized":"2024-06-10T00:22:40.452463+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467724+0000","last_change":"2024-06-10T00:22:40.463965+0000","last_active":"2024-06-10T00:22:40.467724+0000","last_peered":"2024-06-10T00:22:40.467724+0000","last_clean":"2024-06-10T00:22:40.467724+0000","last_became_active":"2024-06-10T00:22:40.463632+0000","last_became_peered":"2024-06-10T00:22:40.463632+0000","last_unstale":"2024-06-10T00:22:40.467724+0000","last_undegraded":"2024-06-10T00:22:40.467724+0000","last_fullsized":"2024-06-10T00:22:40.467724+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:35:34.739817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447414+0000","last_change":"2024-06-10T00:22:40.447414+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447414+0000","last_undegraded":"2024-06-10T00:22:40.447414+0000","last_fullsized":"2024-06-10T00:22:40.447414+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465194+0000","last_change":"2024-06-10T00:22:40.460576+0000","last_active":"2024-06-10T00:22:40.465194+0000","last_peered":"2024-06-10T00:22:40.465194+0000","last_clean":"2024-06-10T00:22:40.465194+0000","last_became_active":"2024-06-10T00:22:40.460296+0000","last_became_peered":"2024-06-10T00:22:40.460296+0000","last_unstale":"2024-06-10T00:22:40.465194+0000","last_undegraded":"2024-06-10T00:22:40.465194+0000","last_fullsized":"2024-06-10T00:22:40.465194+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:18:24.160240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.449113+0000","last_change":"2024-06-10T00:22:40.449113+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.449113+0000","last_undegraded":"2024-06-10T00:22:40.449113+0000","last_fullsized":"2024-06-10T00:22:40.449113+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458443+0000","last_change":"2024-06-10T00:22:40.455011+0000","last_active":"2024-06-10T00:22:40.458443+0000","last_peered":"2024-06-10T00:22:40.458443+0000","last_clean":"2024-06-10T00:22:40.458443+0000","last_became_active":"2024-06-10T00:22:40.454696+0000","last_became_peered":"2024-06-10T00:22:40.454696+0000","last_unstale":"2024-06-10T00:22:40.458443+0000","last_undegraded":"2024-06-10T00:22:40.458443+0000","last_fullsized":"2024-06-10T00:22:40.458443+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:17.523826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447829+0000","last_change":"2024-06-10T00:22:40.447829+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447829+0000","last_undegraded":"2024-06-10T00:22:40.447829+0000","last_fullsized":"2024-06-10T00:22:40.447829+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465648+0000","last_change":"2024-06-10T00:22:40.459986+0000","last_active":"2024-06-10T00:22:40.465648+0000","last_peered":"2024-06-10T00:22:40.465648+0000","last_clean":"2024-06-10T00:22:40.465648+0000","last_became_active":"2024-06-10T00:22:40.459717+0000","last_became_peered":"2024-06-10T00:22:40.459717+0000","last_unstale":"2024-06-10T00:22:40.465648+0000","last_undegraded":"2024-06-10T00:22:40.465648+0000","last_fullsized":"2024-06-10T00:22:40.465648+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:37:04.035878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448417+0000","last_change":"2024-06-10T00:22:40.448417+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448417+0000","last_undegraded":"2024-06-10T00:22:40.448417+0000","last_fullsized":"2024-06-10T00:22:40.448417+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467755+0000","last_change":"2024-06-10T00:22:40.464220+0000","last_active":"2024-06-10T00:22:40.467755+0000","last_peered":"2024-06-10T00:22:40.467755+0000","last_clean":"2024-06-10T00:22:40.467755+0000","last_became_active":"2024-06-10T00:22:40.463898+0000","last_became_peered":"2024-06-10T00:22:40.463898+0000","last_unstale":"2024-06-10T00:22:40.467755+0000","last_undegraded":"2024-06-10T00:22:40.467755+0000","last_fullsized":"2024-06-10T00:22:40.467755+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:06.871558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446103+0000","last_change":"2024-06-10T00:22:40.446103+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446103+0000","last_undegraded":"2024-06-10T00:22:40.446103+0000","last_fullsized":"2024-06-10T00:22:40.446103+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465703+0000","last_change":"2024-06-10T00:22:40.461880+0000","last_active":"2024-06-10T00:22:40.465703+0000","last_peered":"2024-06-10T00:22:40.465703+0000","last_clean":"2024-06-10T00:22:40.465703+0000","last_became_active":"2024-06-10T00:22:40.461170+0000","last_became_peered":"2024-06-10T00:22:40.461170+0000","last_unstale":"2024-06-10T00:22:40.465703+0000","last_undegraded":"2024-06-10T00:22:40.465703+0000","last_fullsized":"2024-06-10T00:22:40.465703+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:45:21.663165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.444598+0000","last_change":"2024-06-10T00:22:40.444598+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.444598+0000","last_undegraded":"2024-06-10T00:22:40.444598+0000","last_fullsized":"2024-06-10T00:22:40.444598+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465752+0000","last_change":"2024-06-10T00:22:40.464744+0000","last_active":"2024-06-10T00:22:40.465752+0000","last_peered":"2024-06-10T00:22:40.465752+0000","last_clean":"2024-06-10T00:22:40.465752+0000","last_became_active":"2024-06-10T00:22:40.464450+0000","last_became_peered":"2024-06-10T00:22:40.464450+0000","last_unstale":"2024-06-10T00:22:40.465752+0000","last_undegraded":"2024-06-10T00:22:40.465752+0000","last_fullsized":"2024-06-10T00:22:40.465752+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:52.443257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":319,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.448897+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:22:40.448897+0000","last_peered":"2024-06-10T00:22:40.448897+0000","last_clean":"2024-06-10T00:22:40.448897+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:22:40.448897+0000","last_undegraded":"2024-06-10T00:22:40.448897+0000","last_fullsized":"2024-06-10T00:22:40.448897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1175425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1175425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:22:44.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:22:44.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.564+0000 7f83c0a01640 1 Processor -- start 2024-06-10T00:22:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.564+0000 7f83c0a01640 1 -- start start 2024-06-10T00:22:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83c0a01640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f83bc1587f0 0x7f83bc0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83c0a01640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83bc0d0340 0x7f83bc15b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83c0a01640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc15b950 0x7f83bc06dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83c0a01640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc15c180 con 0x7f83bc0d0340 2024-06-10T00:22:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83c0a01640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc15e8e0 con 0x7f83bc1587f0 2024-06-10T00:22:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83c0a01640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83bc15ebc0 con 0x7f83bc15b950 2024-06-10T00:22:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83ba59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83bc0d0340 0x7f83bc15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83ba59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83bc0d0340 0x7f83bc15b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35100/0 (socket says 172.21.15.79:35100) 2024-06-10T00:22:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83ba59c640 1 -- 172.21.15.79:0/667250535 learned_addr learned my addr 172.21.15.79:0/667250535 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83bb59e640 1 --2- 172.21.15.79:0/667250535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc15b950 0x7f83bc06dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83bad9d640 1 --2- 172.21.15.79:0/667250535 >> v2:172.21.15.117:3300/0 conn(0x7f83bc1587f0 0x7f83bc0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83ba59c640 1 -- 172.21.15.79:0/667250535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc15b950 msgr2=0x7f83bc06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83ba59c640 1 --2- 172.21.15.79:0/667250535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc15b950 0x7f83bc06dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83ba59c640 1 -- 172.21.15.79:0/667250535 >> v2:172.21.15.117:3300/0 conn(0x7f83bc1587f0 msgr2=0x7f83bc0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83ba59c640 1 --2- 172.21.15.79:0/667250535 >> v2:172.21.15.117:3300/0 conn(0x7f83bc1587f0 0x7f83bc0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83ba59c640 1 -- 172.21.15.79:0/667250535 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc15eea0 con 0x7f83bc0d0340 2024-06-10T00:22:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83bb59e640 1 --2- 172.21.15.79:0/667250535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc15b950 0x7f83bc06dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:44.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.565+0000 7f83bad9d640 1 --2- 172.21.15.79:0/667250535 >> v2:172.21.15.117:3300/0 conn(0x7f83bc1587f0 0x7f83bc0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:44.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.566+0000 7f83ba59c640 1 --2- 172.21.15.79:0/667250535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc0d0340 0x7f83bc15b410 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f83bc06ece0 tx=0x7f83b002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d921e98f1e5d545 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.566+0000 7f83b9d9b640 1 -- 172.21.15.79:0/667250535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0032790 con 0x7f83bc0d0340 2024-06-10T00:22:44.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.566+0000 7f83b9d9b640 1 -- 172.21.15.79:0/667250535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b0038070 con 0x7f83bc0d0340 2024-06-10T00:22:44.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.566+0000 7f83b9d9b640 1 -- 172.21.15.79:0/667250535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0032b50 con 0x7f83bc0d0340 2024-06-10T00:22:44.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 -- 172.21.15.79:0/667250535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc0d0340 msgr2=0x7f83bc15b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 --2- 172.21.15.79:0/667250535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc0d0340 0x7f83bc15b410 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f83bc06ece0 tx=0x7f83b002c890 comp rx=0 tx=0).stop 2024-06-10T00:22:44.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 -- 172.21.15.79:0/667250535 shutdown_connections 2024-06-10T00:22:44.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 --2- 172.21.15.79:0/667250535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc15b950 0x7f83bc06dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 --2- 172.21.15.79:0/667250535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc0d0340 0x7f83bc15b410 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 --2- 172.21.15.79:0/667250535 >> v2:172.21.15.117:3300/0 conn(0x7f83bc1587f0 0x7f83bc0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 -- 172.21.15.79:0/667250535 >> 172.21.15.79:0/667250535 conn(0x7f83bc06b7b0 msgr2=0x7f83bc06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 -- 172.21.15.79:0/667250535 shutdown_connections 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.567+0000 7f83c0a01640 1 -- 172.21.15.79:0/667250535 wait complete. 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.568+0000 7f83c0a01640 1 Processor -- start 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.568+0000 7f83c0a01640 1 -- start start 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83c0a01640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc0d0340 0x7f83bc1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83c0a01640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc1587f0 0x7f83bc15d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83c0a01640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83bc15b950 0x7f83bc0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83c0a01640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc15f6a0 con 0x7f83bc1587f0 2024-06-10T00:22:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83c0a01640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc158bd0 con 0x7f83bc15b950 2024-06-10T00:22:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83c0a01640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83bc15bd80 con 0x7f83bc0d0340 2024-06-10T00:22:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83ba59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc1587f0 0x7f83bc15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83ba59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc1587f0 0x7f83bc15d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35106/0 (socket says 172.21.15.79:35106) 2024-06-10T00:22:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83ba59c640 1 -- 172.21.15.79:0/1559944006 learned_addr learned my addr 172.21.15.79:0/1559944006 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83bad9d640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc0d0340 0x7f83bc1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83bb59e640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83bc15b950 0x7f83bc0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83ba59c640 1 -- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc0d0340 msgr2=0x7f83bc1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83ba59c640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc0d0340 0x7f83bc1482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83ba59c640 1 -- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83bc15b950 msgr2=0x7f83bc0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83ba59c640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83bc15b950 0x7f83bc0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83ba59c640 1 -- 172.21.15.79:0/1559944006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc154f30 con 0x7f83bc1587f0 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83bb59e640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83bc15b950 0x7f83bc0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.569+0000 7f83bad9d640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc0d0340 0x7f83bc1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.570+0000 7f83ba59c640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc1587f0 0x7f83bc15d900 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f83b002c8d0 tx=0x7f83b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.570+0000 7f83a37fe640 1 -- 172.21.15.79:0/1559944006 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0033620 con 0x7f83bc1587f0 2024-06-10T00:22:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.570+0000 7f83a37fe640 1 -- 172.21.15.79:0/1559944006 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b00337c0 con 0x7f83bc1587f0 2024-06-10T00:22:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.570+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83bc155210 con 0x7f83bc1587f0 2024-06-10T00:22:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.570+0000 7f83a37fe640 1 -- 172.21.15.79:0/1559944006 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0033bb0 con 0x7f83bc1587f0 2024-06-10T00:22:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.570+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83bc1557d0 con 0x7f83bc1587f0 2024-06-10T00:22:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.571+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83bc0683c0 con 0x7f83bc1587f0 2024-06-10T00:22:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.571+0000 7f83a37fe640 1 -- 172.21.15.79:0/1559944006 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83b004d060 con 0x7f83bc1587f0 2024-06-10T00:22:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.572+0000 7f83a37fe640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f83a806be60 0x7f83a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.572+0000 7f83bad9d640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f83a806be60 0x7f83a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.572+0000 7f83a37fe640 1 -- 172.21.15.79:0/1559944006 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f83b00ad8d0 con 0x7f83bc1587f0 2024-06-10T00:22:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.572+0000 7f83bad9d640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f83a806be60 0x7f83a806e320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f83ac006fd0 tx=0x7f83ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.576+0000 7f83a37fe640 1 -- 172.21.15.79:0/1559944006 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f83b0041070 con 0x7f83bc1587f0 2024-06-10T00:22:44.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.745+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83bc0cc830 con 0x7f83a806be60 2024-06-10T00:22:44.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.751+0000 7f83a37fe640 1 -- 172.21.15.79:0/1559944006 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247090 (secure 0 0 0) 0x7f83bc0cc830 con 0x7f83a806be60 2024-06-10T00:22:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:44.755 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:22:44.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f83a806be60 msgr2=0x7f83a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f83a806be60 0x7f83a806e320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f83ac006fd0 tx=0x7f83ac008040 comp rx=0 tx=0).stop 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc1587f0 msgr2=0x7f83bc15d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc1587f0 0x7f83bc15d900 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f83b002c8d0 tx=0x7f83b00046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 shutdown_connections 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f83a806be60 0x7f83a806e320 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83bc15b950 0x7f83bc0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83bc1587f0 0x7f83bc15d900 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 --2- 172.21.15.79:0/1559944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83bc0d0340 0x7f83bc1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 >> 172.21.15.79:0/1559944006 conn(0x7f83bc06b7b0 msgr2=0x7f83bc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 shutdown_connections 2024-06-10T00:22:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.754+0000 7f83c0a01640 1 -- 172.21.15.79:0/1559944006 wait complete. 2024-06-10T00:22:44.765 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-06-10T00:22:43.255944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260484,"kb_used_data":11012,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714236,"statfs":{"total":773094113280,"available":772827377664,"internally_reserved":0,"allocated":11276288,"data_stored":5841191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000850"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453378+0000","last_change":"2024-06-10T00:22:40.453378+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453378+0000","last_undegraded":"2024-06-10T00:22:40.453378+0000","last_fullsized":"2024-06-10T00:22:40.453378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453738+0000","last_change":"2024-06-10T00:22:40.453738+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453738+0000","last_undegraded":"2024-06-10T00:22:40.453738+0000","last_fullsized":"2024-06-10T00:22:40.453738+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453610+0000","last_change":"2024-06-10T00:22:40.453610+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453610+0000","last_undegraded":"2024-06-10T00:22:40.453610+0000","last_fullsized":"2024-06-10T00:22:40.453610+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451659+0000","last_change":"2024-06-10T00:22:40.451659+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451659+0000","last_undegraded":"2024-06-10T00:22:40.451659+0000","last_fullsized":"2024-06-10T00:22:40.451659+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447665+0000","last_change":"2024-06-10T00:22:40.447665+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447665+0000","last_undegraded":"2024-06-10T00:22:40.447665+0000","last_fullsized":"2024-06-10T00:22:40.447665+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452521+0000","last_change":"2024-06-10T00:22:40.452521+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452521+0000","last_undegraded":"2024-06-10T00:22:40.452521+0000","last_fullsized":"2024-06-10T00:22:40.452521+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452200+0000","last_change":"2024-06-10T00:22:40.452200+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452200+0000","last_undegraded":"2024-06-10T00:22:40.452200+0000","last_fullsized":"2024-06-10T00:22:40.452200+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451364+0000","last_change":"2024-06-10T00:22:40.451364+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451364+0000","last_undegraded":"2024-06-10T00:22:40.451364+0000","last_fullsized":"2024-06-10T00:22:40.451364+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452776+0000","last_change":"2024-06-10T00:22:40.452776+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452776+0000","last_undegraded":"2024-06-10T00:22:40.452776+0000","last_fullsized":"2024-06-10T00:22:40.452776+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447237+0000","last_change":"2024-06-10T00:22:40.447237+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447237+0000","last_undegraded":"2024-06-10T00:22:40.447237+0000","last_fullsized":"2024-06-10T00:22:40.447237+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446588+0000","last_change":"2024-06-10T00:22:40.446588+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446588+0000","last_undegraded":"2024-06-10T00:22:40.446588+0000","last_fullsized":"2024-06-10T00:22:40.446588+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446567+0000","last_change":"2024-06-10T00:22:40.446567+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446567+0000","last_undegraded":"2024-06-10T00:22:40.446567+0000","last_fullsized":"2024-06-10T00:22:40.446567+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455589+0000","last_change":"2024-06-10T00:22:40.455589+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455589+0000","last_undegraded":"2024-06-10T00:22:40.455589+0000","last_fullsized":"2024-06-10T00:22:40.455589+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448757+0000","last_change":"2024-06-10T00:22:40.448757+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448757+0000","last_undegraded":"2024-06-10T00:22:40.448757+0000","last_fullsized":"2024-06-10T00:22:40.448757+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447882+0000","last_change":"2024-06-10T00:22:40.447882+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447882+0000","last_undegraded":"2024-06-10T00:22:40.447882+0000","last_fullsized":"2024-06-10T00:22:40.447882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448664+0000","last_change":"2024-06-10T00:22:40.448664+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448664+0000","last_undegraded":"2024-06-10T00:22:40.448664+0000","last_fullsized":"2024-06-10T00:22:40.448664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452849+0000","last_change":"2024-06-10T00:22:40.452849+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452849+0000","last_undegraded":"2024-06-10T00:22:40.452849+0000","last_fullsized":"2024-06-10T00:22:40.452849+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453321+0000","last_change":"2024-06-10T00:22:40.453321+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453321+0000","last_undegraded":"2024-06-10T00:22:40.453321+0000","last_fullsized":"2024-06-10T00:22:40.453321+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453224+0000","last_change":"2024-06-10T00:22:40.453224+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453224+0000","last_undegraded":"2024-06-10T00:22:40.453224+0000","last_fullsized":"2024-06-10T00:22:40.453224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446137+0000","last_change":"2024-06-10T00:22:40.446137+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446137+0000","last_undegraded":"2024-06-10T00:22:40.446137+0000","last_fullsized":"2024-06-10T00:22:40.446137+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451058+0000","last_change":"2024-06-10T00:22:40.451058+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451058+0000","last_undegraded":"2024-06-10T00:22:40.451058+0000","last_fullsized":"2024-06-10T00:22:40.451058+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447249+0000","last_change":"2024-06-10T00:22:40.447249+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447249+0000","last_undegraded":"2024-06-10T00:22:40.447249+0000","last_fullsized":"2024-06-10T00:22:40.447249+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451281+0000","last_change":"2024-06-10T00:22:40.451281+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451281+0000","last_undegraded":"2024-06-10T00:22:40.451281+0000","last_fullsized":"2024-06-10T00:22:40.451281+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447178+0000","last_change":"2024-06-10T00:22:40.447178+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447178+0000","last_undegraded":"2024-06-10T00:22:40.447178+0000","last_fullsized":"2024-06-10T00:22:40.447178+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445987+0000","last_change":"2024-06-10T00:22:40.445987+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445987+0000","last_undegraded":"2024-06-10T00:22:40.445987+0000","last_fullsized":"2024-06-10T00:22:40.445987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.444771+0000","last_change":"2024-06-10T00:22:40.444771+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.444771+0000","last_undegraded":"2024-06-10T00:22:40.444771+0000","last_fullsized":"2024-06-10T00:22:40.444771+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446154+0000","last_change":"2024-06-10T00:22:40.446154+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446154+0000","last_undegraded":"2024-06-10T00:22:40.446154+0000","last_fullsized":"2024-06-10T00:22:40.446154+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453937+0000","last_change":"2024-06-10T00:22:40.453937+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453937+0000","last_undegraded":"2024-06-10T00:22:40.453937+0000","last_fullsized":"2024-06-10T00:22:40.453937+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450597+0000","last_change":"2024-06-10T00:22:40.450597+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450597+0000","last_undegraded":"2024-06-10T00:22:40.450597+0000","last_fullsized":"2024-06-10T00:22:40.450597+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445568+0000","last_change":"2024-06-10T00:22:40.445568+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445568+0000","last_undegraded":"2024-06-10T00:22:40.445568+0000","last_fullsized":"2024-06-10T00:22:40.445568+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451664+0000","last_change":"2024-06-10T00:22:40.451664+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451664+0000","last_undegraded":"2024-06-10T00:22:40.451664+0000","last_fullsized":"2024-06-10T00:22:40.451664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450942+0000","last_change":"2024-06-10T00:22:40.450942+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450942+0000","last_undegraded":"2024-06-10T00:22:40.450942+0000","last_fullsized":"2024-06-10T00:22:40.450942+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.454640+0000","last_change":"2024-06-10T00:22:40.454640+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.454640+0000","last_undegraded":"2024-06-10T00:22:40.454640+0000","last_fullsized":"2024-06-10T00:22:40.454640+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465911+0000","last_change":"2024-06-10T00:22:40.464067+0000","last_active":"2024-06-10T00:22:40.465911+0000","last_peered":"2024-06-10T00:22:40.465911+0000","last_clean":"2024-06-10T00:22:40.465911+0000","last_became_active":"2024-06-10T00:22:40.463201+0000","last_became_peered":"2024-06-10T00:22:40.463201+0000","last_unstale":"2024-06-10T00:22:40.465911+0000","last_undegraded":"2024-06-10T00:22:40.465911+0000","last_fullsized":"2024-06-10T00:22:40.465911+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:21:18.421656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448819+0000","last_change":"2024-06-10T00:22:40.448819+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448819+0000","last_undegraded":"2024-06-10T00:22:40.448819+0000","last_fullsized":"2024-06-10T00:22:40.448819+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.464968+0000","last_change":"2024-06-10T00:22:40.459474+0000","last_active":"2024-06-10T00:22:40.464968+0000","last_peered":"2024-06-10T00:22:40.464968+0000","last_clean":"2024-06-10T00:22:40.464968+0000","last_became_active":"2024-06-10T00:22:40.459104+0000","last_became_peered":"2024-06-10T00:22:40.459104+0000","last_unstale":"2024-06-10T00:22:40.464968+0000","last_undegraded":"2024-06-10T00:22:40.464968+0000","last_fullsized":"2024-06-10T00:22:40.464968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:33:31.007804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445077+0000","last_change":"2024-06-10T00:22:40.445077+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445077+0000","last_undegraded":"2024-06-10T00:22:40.445077+0000","last_fullsized":"2024-06-10T00:22:40.445077+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462178+0000","last_change":"2024-06-10T00:22:40.459372+0000","last_active":"2024-06-10T00:22:40.462178+0000","last_peered":"2024-06-10T00:22:40.462178+0000","last_clean":"2024-06-10T00:22:40.462178+0000","last_became_active":"2024-06-10T00:22:40.456763+0000","last_became_peered":"2024-06-10T00:22:40.456763+0000","last_unstale":"2024-06-10T00:22:40.462178+0000","last_undegraded":"2024-06-10T00:22:40.462178+0000","last_fullsized":"2024-06-10T00:22:40.462178+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446568+0000","last_change":"2024-06-10T00:22:40.446568+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446568+0000","last_undegraded":"2024-06-10T00:22:40.446568+0000","last_fullsized":"2024-06-10T00:22:40.446568+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460758+0000","last_change":"2024-06-10T00:22:40.458499+0000","last_active":"2024-06-10T00:22:40.460758+0000","last_peered":"2024-06-10T00:22:40.460758+0000","last_clean":"2024-06-10T00:22:40.460758+0000","last_became_active":"2024-06-10T00:22:40.458216+0000","last_became_peered":"2024-06-10T00:22:40.458216+0000","last_unstale":"2024-06-10T00:22:40.460758+0000","last_undegraded":"2024-06-10T00:22:40.460758+0000","last_fullsized":"2024-06-10T00:22:40.460758+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:52:36.829097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451227+0000","last_change":"2024-06-10T00:22:40.451227+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451227+0000","last_undegraded":"2024-06-10T00:22:40.451227+0000","last_fullsized":"2024-06-10T00:22:40.451227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.457112+0000","last_change":"2024-06-10T00:22:40.455292+0000","last_active":"2024-06-10T00:22:40.457112+0000","last_peered":"2024-06-10T00:22:40.457112+0000","last_clean":"2024-06-10T00:22:40.457112+0000","last_became_active":"2024-06-10T00:22:40.455011+0000","last_became_peered":"2024-06-10T00:22:40.455011+0000","last_unstale":"2024-06-10T00:22:40.457112+0000","last_undegraded":"2024-06-10T00:22:40.457112+0000","last_fullsized":"2024-06-10T00:22:40.457112+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:13.197903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452127+0000","last_change":"2024-06-10T00:22:40.452127+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452127+0000","last_undegraded":"2024-06-10T00:22:40.452127+0000","last_fullsized":"2024-06-10T00:22:40.452127+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.456928+0000","last_change":"2024-06-10T00:22:40.453019+0000","last_active":"2024-06-10T00:22:40.456928+0000","last_peered":"2024-06-10T00:22:40.456928+0000","last_clean":"2024-06-10T00:22:40.456928+0000","last_became_active":"2024-06-10T00:22:40.452738+0000","last_became_peered":"2024-06-10T00:22:40.452738+0000","last_unstale":"2024-06-10T00:22:40.456928+0000","last_undegraded":"2024-06-10T00:22:40.456928+0000","last_fullsized":"2024-06-10T00:22:40.456928+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:57:14.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452619+0000","last_change":"2024-06-10T00:22:40.452619+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452619+0000","last_undegraded":"2024-06-10T00:22:40.452619+0000","last_fullsized":"2024-06-10T00:22:40.452619+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458402+0000","last_change":"2024-06-10T00:22:40.454657+0000","last_active":"2024-06-10T00:22:40.458402+0000","last_peered":"2024-06-10T00:22:40.458402+0000","last_clean":"2024-06-10T00:22:40.458402+0000","last_became_active":"2024-06-10T00:22:40.454398+0000","last_became_peered":"2024-06-10T00:22:40.454398+0000","last_unstale":"2024-06-10T00:22:40.458402+0000","last_undegraded":"2024-06-10T00:22:40.458402+0000","last_fullsized":"2024-06-10T00:22:40.458402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:19:39.853903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.456370+0000","last_change":"2024-06-10T00:22:40.456370+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.456370+0000","last_undegraded":"2024-06-10T00:22:40.456370+0000","last_fullsized":"2024-06-10T00:22:40.456370+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.464034+0000","last_change":"2024-06-10T00:22:40.461992+0000","last_active":"2024-06-10T00:22:40.464034+0000","last_peered":"2024-06-10T00:22:40.464034+0000","last_clean":"2024-06-10T00:22:40.464034+0000","last_became_active":"2024-06-10T00:22:40.461700+0000","last_became_peered":"2024-06-10T00:22:40.461700+0000","last_unstale":"2024-06-10T00:22:40.464034+0000","last_undegraded":"2024-06-10T00:22:40.464034+0000","last_fullsized":"2024-06-10T00:22:40.464034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:33:07.654120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455105+0000","last_change":"2024-06-10T00:22:40.455105+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455105+0000","last_undegraded":"2024-06-10T00:22:40.455105+0000","last_fullsized":"2024-06-10T00:22:40.455105+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458470+0000","last_change":"2024-06-10T00:22:40.455913+0000","last_active":"2024-06-10T00:22:40.458470+0000","last_peered":"2024-06-10T00:22:40.458470+0000","last_clean":"2024-06-10T00:22:40.458470+0000","last_became_active":"2024-06-10T00:22:40.455625+0000","last_became_peered":"2024-06-10T00:22:40.455625+0000","last_unstale":"2024-06-10T00:22:40.458470+0000","last_undegraded":"2024-06-10T00:22:40.458470+0000","last_fullsized":"2024-06-10T00:22:40.458470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446750+0000","last_change":"2024-06-10T00:22:40.446750+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446750+0000","last_undegraded":"2024-06-10T00:22:40.446750+0000","last_fullsized":"2024-06-10T00:22:40.446750+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465800+0000","last_change":"2024-06-10T00:22:40.463696+0000","last_active":"2024-06-10T00:22:40.465800+0000","last_peered":"2024-06-10T00:22:40.465800+0000","last_clean":"2024-06-10T00:22:40.465800+0000","last_became_active":"2024-06-10T00:22:40.463375+0000","last_became_peered":"2024-06-10T00:22:40.463375+0000","last_unstale":"2024-06-10T00:22:40.465800+0000","last_undegraded":"2024-06-10T00:22:40.465800+0000","last_fullsized":"2024-06-10T00:22:40.465800+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:06:16.483344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448537+0000","last_change":"2024-06-10T00:22:40.448537+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448537+0000","last_undegraded":"2024-06-10T00:22:40.448537+0000","last_fullsized":"2024-06-10T00:22:40.448537+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467797+0000","last_change":"2024-06-10T00:22:40.463539+0000","last_active":"2024-06-10T00:22:40.467797+0000","last_peered":"2024-06-10T00:22:40.467797+0000","last_clean":"2024-06-10T00:22:40.467797+0000","last_became_active":"2024-06-10T00:22:40.463229+0000","last_became_peered":"2024-06-10T00:22:40.463229+0000","last_unstale":"2024-06-10T00:22:40.467797+0000","last_undegraded":"2024-06-10T00:22:40.467797+0000","last_fullsized":"2024-06-10T00:22:40.467797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:07.961320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446602+0000","last_change":"2024-06-10T00:22:40.446602+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446602+0000","last_undegraded":"2024-06-10T00:22:40.446602+0000","last_fullsized":"2024-06-10T00:22:40.446602+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.468033+0000","last_change":"2024-06-10T00:22:40.465693+0000","last_active":"2024-06-10T00:22:40.468033+0000","last_peered":"2024-06-10T00:22:40.468033+0000","last_clean":"2024-06-10T00:22:40.468033+0000","last_became_active":"2024-06-10T00:22:40.465452+0000","last_became_peered":"2024-06-10T00:22:40.465452+0000","last_unstale":"2024-06-10T00:22:40.468033+0000","last_undegraded":"2024-06-10T00:22:40.468033+0000","last_fullsized":"2024-06-10T00:22:40.468033+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:03:33.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445894+0000","last_change":"2024-06-10T00:22:40.445894+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445894+0000","last_undegraded":"2024-06-10T00:22:40.445894+0000","last_fullsized":"2024-06-10T00:22:40.445894+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460056+0000","last_change":"2024-06-10T00:22:40.456048+0000","last_active":"2024-06-10T00:22:40.460056+0000","last_peered":"2024-06-10T00:22:40.460056+0000","last_clean":"2024-06-10T00:22:40.460056+0000","last_became_active":"2024-06-10T00:22:40.455788+0000","last_became_peered":"2024-06-10T00:22:40.455788+0000","last_unstale":"2024-06-10T00:22:40.460056+0000","last_undegraded":"2024-06-10T00:22:40.460056+0000","last_fullsized":"2024-06-10T00:22:40.460056+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452484+0000","last_change":"2024-06-10T00:22:40.452484+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452484+0000","last_undegraded":"2024-06-10T00:22:40.452484+0000","last_fullsized":"2024-06-10T00:22:40.452484+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.463737+0000","last_change":"2024-06-10T00:22:40.458861+0000","last_active":"2024-06-10T00:22:40.463737+0000","last_peered":"2024-06-10T00:22:40.463737+0000","last_clean":"2024-06-10T00:22:40.463737+0000","last_became_active":"2024-06-10T00:22:40.458585+0000","last_became_peered":"2024-06-10T00:22:40.458585+0000","last_unstale":"2024-06-10T00:22:40.463737+0000","last_undegraded":"2024-06-10T00:22:40.463737+0000","last_fullsized":"2024-06-10T00:22:40.463737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450140+0000","last_change":"2024-06-10T00:22:40.450140+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450140+0000","last_undegraded":"2024-06-10T00:22:40.450140+0000","last_fullsized":"2024-06-10T00:22:40.450140+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465695+0000","last_change":"2024-06-10T00:22:40.460616+0000","last_active":"2024-06-10T00:22:40.465695+0000","last_peered":"2024-06-10T00:22:40.465695+0000","last_clean":"2024-06-10T00:22:40.465695+0000","last_became_active":"2024-06-10T00:22:40.460359+0000","last_became_peered":"2024-06-10T00:22:40.460359+0000","last_unstale":"2024-06-10T00:22:40.465695+0000","last_undegraded":"2024-06-10T00:22:40.465695+0000","last_fullsized":"2024-06-10T00:22:40.465695+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:52:06.207600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452388+0000","last_change":"2024-06-10T00:22:40.452388+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452388+0000","last_undegraded":"2024-06-10T00:22:40.452388+0000","last_fullsized":"2024-06-10T00:22:40.452388+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458372+0000","last_change":"2024-06-10T00:22:40.451127+0000","last_active":"2024-06-10T00:22:40.458372+0000","last_peered":"2024-06-10T00:22:40.458372+0000","last_clean":"2024-06-10T00:22:40.458372+0000","last_became_active":"2024-06-10T00:22:40.450861+0000","last_became_peered":"2024-06-10T00:22:40.450861+0000","last_unstale":"2024-06-10T00:22:40.458372+0000","last_undegraded":"2024-06-10T00:22:40.458372+0000","last_fullsized":"2024-06-10T00:22:40.458372+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:03:33.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450517+0000","last_change":"2024-06-10T00:22:40.450517+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450517+0000","last_undegraded":"2024-06-10T00:22:40.450517+0000","last_fullsized":"2024-06-10T00:22:40.450517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462598+0000","last_change":"2024-06-10T00:22:40.459091+0000","last_active":"2024-06-10T00:22:40.462598+0000","last_peered":"2024-06-10T00:22:40.462598+0000","last_clean":"2024-06-10T00:22:40.462598+0000","last_became_active":"2024-06-10T00:22:40.458813+0000","last_became_peered":"2024-06-10T00:22:40.458813+0000","last_unstale":"2024-06-10T00:22:40.462598+0000","last_undegraded":"2024-06-10T00:22:40.462598+0000","last_fullsized":"2024-06-10T00:22:40.462598+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:43:56.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451845+0000","last_change":"2024-06-10T00:22:40.451845+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451845+0000","last_undegraded":"2024-06-10T00:22:40.451845+0000","last_fullsized":"2024-06-10T00:22:40.451845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462663+0000","last_change":"2024-06-10T00:22:40.460540+0000","last_active":"2024-06-10T00:22:40.462663+0000","last_peered":"2024-06-10T00:22:40.462663+0000","last_clean":"2024-06-10T00:22:40.462663+0000","last_became_active":"2024-06-10T00:22:40.460239+0000","last_became_peered":"2024-06-10T00:22:40.460239+0000","last_unstale":"2024-06-10T00:22:40.462663+0000","last_undegraded":"2024-06-10T00:22:40.462663+0000","last_fullsized":"2024-06-10T00:22:40.462663+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:41.291107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447119+0000","last_change":"2024-06-10T00:22:40.447119+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447119+0000","last_undegraded":"2024-06-10T00:22:40.447119+0000","last_fullsized":"2024-06-10T00:22:40.447119+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.459704+0000","last_change":"2024-06-10T00:22:40.457983+0000","last_active":"2024-06-10T00:22:40.459704+0000","last_peered":"2024-06-10T00:22:40.459704+0000","last_clean":"2024-06-10T00:22:40.459704+0000","last_became_active":"2024-06-10T00:22:40.457713+0000","last_became_peered":"2024-06-10T00:22:40.457713+0000","last_unstale":"2024-06-10T00:22:40.459704+0000","last_undegraded":"2024-06-10T00:22:40.459704+0000","last_fullsized":"2024-06-10T00:22:40.459704+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452095+0000","last_change":"2024-06-10T00:22:40.452095+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452095+0000","last_undegraded":"2024-06-10T00:22:40.452095+0000","last_fullsized":"2024-06-10T00:22:40.452095+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465729+0000","last_change":"2024-06-10T00:22:40.464715+0000","last_active":"2024-06-10T00:22:40.465729+0000","last_peered":"2024-06-10T00:22:40.465729+0000","last_clean":"2024-06-10T00:22:40.465729+0000","last_became_active":"2024-06-10T00:22:40.464434+0000","last_became_peered":"2024-06-10T00:22:40.464434+0000","last_unstale":"2024-06-10T00:22:40.465729+0000","last_undegraded":"2024-06-10T00:22:40.465729+0000","last_fullsized":"2024-06-10T00:22:40.465729+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:12:48.174973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452817+0000","last_change":"2024-06-10T00:22:40.452817+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452817+0000","last_undegraded":"2024-06-10T00:22:40.452817+0000","last_fullsized":"2024-06-10T00:22:40.452817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.461851+0000","last_change":"2024-06-10T00:22:40.458231+0000","last_active":"2024-06-10T00:22:40.461851+0000","last_peered":"2024-06-10T00:22:40.461851+0000","last_clean":"2024-06-10T00:22:40.461851+0000","last_became_active":"2024-06-10T00:22:40.457959+0000","last_became_peered":"2024-06-10T00:22:40.457959+0000","last_unstale":"2024-06-10T00:22:40.461851+0000","last_undegraded":"2024-06-10T00:22:40.461851+0000","last_fullsized":"2024-06-10T00:22:40.461851+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:58.753457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453465+0000","last_change":"2024-06-10T00:22:40.453465+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453465+0000","last_undegraded":"2024-06-10T00:22:40.453465+0000","last_fullsized":"2024-06-10T00:22:40.453465+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462888+0000","last_change":"2024-06-10T00:22:40.461887+0000","last_active":"2024-06-10T00:22:40.462888+0000","last_peered":"2024-06-10T00:22:40.462888+0000","last_clean":"2024-06-10T00:22:40.462888+0000","last_became_active":"2024-06-10T00:22:40.461591+0000","last_became_peered":"2024-06-10T00:22:40.461591+0000","last_unstale":"2024-06-10T00:22:40.462888+0000","last_undegraded":"2024-06-10T00:22:40.462888+0000","last_fullsized":"2024-06-10T00:22:40.462888+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:13:12.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448589+0000","last_change":"2024-06-10T00:22:40.448589+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448589+0000","last_undegraded":"2024-06-10T00:22:40.448589+0000","last_fullsized":"2024-06-10T00:22:40.448589+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.468529+0000","last_change":"2024-06-10T00:22:40.465440+0000","last_active":"2024-06-10T00:22:40.468529+0000","last_peered":"2024-06-10T00:22:40.468529+0000","last_clean":"2024-06-10T00:22:40.468529+0000","last_became_active":"2024-06-10T00:22:40.465137+0000","last_became_peered":"2024-06-10T00:22:40.465137+0000","last_unstale":"2024-06-10T00:22:40.468529+0000","last_undegraded":"2024-06-10T00:22:40.468529+0000","last_fullsized":"2024-06-10T00:22:40.468529+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:36:26.012841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455464+0000","last_change":"2024-06-10T00:22:40.455464+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455464+0000","last_undegraded":"2024-06-10T00:22:40.455464+0000","last_fullsized":"2024-06-10T00:22:40.455464+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460024+0000","last_change":"2024-06-10T00:22:40.455370+0000","last_active":"2024-06-10T00:22:40.460024+0000","last_peered":"2024-06-10T00:22:40.460024+0000","last_clean":"2024-06-10T00:22:40.460024+0000","last_became_active":"2024-06-10T00:22:40.455076+0000","last_became_peered":"2024-06-10T00:22:40.455076+0000","last_unstale":"2024-06-10T00:22:40.460024+0000","last_undegraded":"2024-06-10T00:22:40.460024+0000","last_fullsized":"2024-06-10T00:22:40.460024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445351+0000","last_change":"2024-06-10T00:22:40.445351+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445351+0000","last_undegraded":"2024-06-10T00:22:40.445351+0000","last_fullsized":"2024-06-10T00:22:40.445351+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465773+0000","last_change":"2024-06-10T00:22:40.463082+0000","last_active":"2024-06-10T00:22:40.465773+0000","last_peered":"2024-06-10T00:22:40.465773+0000","last_clean":"2024-06-10T00:22:40.465773+0000","last_became_active":"2024-06-10T00:22:40.462736+0000","last_became_peered":"2024-06-10T00:22:40.462736+0000","last_unstale":"2024-06-10T00:22:40.465773+0000","last_undegraded":"2024-06-10T00:22:40.465773+0000","last_fullsized":"2024-06-10T00:22:40.465773+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:28:31.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452463+0000","last_change":"2024-06-10T00:22:40.452463+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452463+0000","last_undegraded":"2024-06-10T00:22:40.452463+0000","last_fullsized":"2024-06-10T00:22:40.452463+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467724+0000","last_change":"2024-06-10T00:22:40.463965+0000","last_active":"2024-06-10T00:22:40.467724+0000","last_peered":"2024-06-10T00:22:40.467724+0000","last_clean":"2024-06-10T00:22:40.467724+0000","last_became_active":"2024-06-10T00:22:40.463632+0000","last_became_peered":"2024-06-10T00:22:40.463632+0000","last_unstale":"2024-06-10T00:22:40.467724+0000","last_undegraded":"2024-06-10T00:22:40.467724+0000","last_fullsized":"2024-06-10T00:22:40.467724+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:35:34.739817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447414+0000","last_change":"2024-06-10T00:22:40.447414+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447414+0000","last_undegraded":"2024-06-10T00:22:40.447414+0000","last_fullsized":"2024-06-10T00:22:40.447414+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465194+0000","last_change":"2024-06-10T00:22:40.460576+0000","last_active":"2024-06-10T00:22:40.465194+0000","last_peered":"2024-06-10T00:22:40.465194+0000","last_clean":"2024-06-10T00:22:40.465194+0000","last_became_active":"2024-06-10T00:22:40.460296+0000","last_became_peered":"2024-06-10T00:22:40.460296+0000","last_unstale":"2024-06-10T00:22:40.465194+0000","last_undegraded":"2024-06-10T00:22:40.465194+0000","last_fullsized":"2024-06-10T00:22:40.465194+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:18:24.160240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.449113+0000","last_change":"2024-06-10T00:22:40.449113+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.449113+0000","last_undegraded":"2024-06-10T00:22:40.449113+0000","last_fullsized":"2024-06-10T00:22:40.449113+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458443+0000","last_change":"2024-06-10T00:22:40.455011+0000","last_active":"2024-06-10T00:22:40.458443+0000","last_peered":"2024-06-10T00:22:40.458443+0000","last_clean":"2024-06-10T00:22:40.458443+0000","last_became_active":"2024-06-10T00:22:40.454696+0000","last_became_peered":"2024-06-10T00:22:40.454696+0000","last_unstale":"2024-06-10T00:22:40.458443+0000","last_undegraded":"2024-06-10T00:22:40.458443+0000","last_fullsized":"2024-06-10T00:22:40.458443+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:17.523826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447829+0000","last_change":"2024-06-10T00:22:40.447829+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447829+0000","last_undegraded":"2024-06-10T00:22:40.447829+0000","last_fullsized":"2024-06-10T00:22:40.447829+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465648+0000","last_change":"2024-06-10T00:22:40.459986+0000","last_active":"2024-06-10T00:22:40.465648+0000","last_peered":"2024-06-10T00:22:40.465648+0000","last_clean":"2024-06-10T00:22:40.465648+0000","last_became_active":"2024-06-10T00:22:40.459717+0000","last_became_peered":"2024-06-10T00:22:40.459717+0000","last_unstale":"2024-06-10T00:22:40.465648+0000","last_undegraded":"2024-06-10T00:22:40.465648+0000","last_fullsized":"2024-06-10T00:22:40.465648+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:37:04.035878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448417+0000","last_change":"2024-06-10T00:22:40.448417+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448417+0000","last_undegraded":"2024-06-10T00:22:40.448417+0000","last_fullsized":"2024-06-10T00:22:40.448417+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467755+0000","last_change":"2024-06-10T00:22:40.464220+0000","last_active":"2024-06-10T00:22:40.467755+0000","last_peered":"2024-06-10T00:22:40.467755+0000","last_clean":"2024-06-10T00:22:40.467755+0000","last_became_active":"2024-06-10T00:22:40.463898+0000","last_became_peered":"2024-06-10T00:22:40.463898+0000","last_unstale":"2024-06-10T00:22:40.467755+0000","last_undegraded":"2024-06-10T00:22:40.467755+0000","last_fullsized":"2024-06-10T00:22:40.467755+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:06.871558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446103+0000","last_change":"2024-06-10T00:22:40.446103+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446103+0000","last_undegraded":"2024-06-10T00:22:40.446103+0000","last_fullsized":"2024-06-10T00:22:40.446103+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465703+0000","last_change":"2024-06-10T00:22:40.461880+0000","last_active":"2024-06-10T00:22:40.465703+0000","last_peered":"2024-06-10T00:22:40.465703+0000","last_clean":"2024-06-10T00:22:40.465703+0000","last_became_active":"2024-06-10T00:22:40.461170+0000","last_became_peered":"2024-06-10T00:22:40.461170+0000","last_unstale":"2024-06-10T00:22:40.465703+0000","last_undegraded":"2024-06-10T00:22:40.465703+0000","last_fullsized":"2024-06-10T00:22:40.465703+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:45:21.663165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.444598+0000","last_change":"2024-06-10T00:22:40.444598+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.444598+0000","last_undegraded":"2024-06-10T00:22:40.444598+0000","last_fullsized":"2024-06-10T00:22:40.444598+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465752+0000","last_change":"2024-06-10T00:22:40.464744+0000","last_active":"2024-06-10T00:22:40.465752+0000","last_peered":"2024-06-10T00:22:40.465752+0000","last_clean":"2024-06-10T00:22:40.465752+0000","last_became_active":"2024-06-10T00:22:40.464450+0000","last_became_peered":"2024-06-10T00:22:40.464450+0000","last_unstale":"2024-06-10T00:22:40.465752+0000","last_undegraded":"2024-06-10T00:22:40.465752+0000","last_fullsized":"2024-06-10T00:22:40.465752+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:52.443257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":319,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.448897+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:22:40.448897+0000","last_peered":"2024-06-10T00:22:40.448897+0000","last_clean":"2024-06-10T00:22:40.448897+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:22:40.448897+0000","last_undegraded":"2024-06-10T00:22:40.448897+0000","last_fullsized":"2024-06-10T00:22:40.448897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1175425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1175425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:22:44.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:22:44.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.909+0000 7f580d709640 1 Processor -- start 2024-06-10T00:22:44.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.909+0000 7f580d709640 1 -- start start 2024-06-10T00:22:44.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f580d709640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f58080cd230 0x7f58080b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f580d709640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58080cec50 0x7f58080cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f580d709640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58080b3420 con 0x7f58081553c0 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f580d709640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f58080cc750 con 0x7f58080cd230 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f580d709640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f58080cca30 con 0x7f58080cec50 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f5806ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f58081553c0 0x7f580815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34394/0 (socket says 172.21.15.79:34394) 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f5806ffd640 1 -- 172.21.15.79:0/476552079 learned_addr learned my addr 172.21.15.79:0/476552079 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f57fe7fc640 1 --2- 172.21.15.79:0/476552079 >> v2:172.21.15.79:3300/0 conn(0x7f58080cd230 0x7f58080b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f58077fe640 1 --2- 172.21.15.79:0/476552079 >> v2:172.21.15.117:3300/0 conn(0x7f58080cec50 0x7f58080cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f58067fc640 1 -- 172.21.15.79:0/476552079 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013576592 0 0) 0x7f58080b3420 con 0x7f58081553c0 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.910+0000 7f58067fc640 1 -- 172.21.15.79:0/476552079 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57f4003520 con 0x7f58081553c0 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.911+0000 7f57fe7fc640 1 -- 172.21.15.79:0/476552079 >> v2:172.21.15.117:3300/0 conn(0x7f58080cec50 msgr2=0x7f58080cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.911+0000 7f57fe7fc640 1 --2- 172.21.15.79:0/476552079 >> v2:172.21.15.117:3300/0 conn(0x7f58080cec50 0x7f58080cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.911+0000 7f57fe7fc640 1 -- 172.21.15.79:0/476552079 >> v1:172.21.15.79:6789/0 conn(0x7f58081553c0 legacy=0x7f580815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.911+0000 7f57fe7fc640 1 -- 172.21.15.79:0/476552079 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58080ccd10 con 0x7f58080cd230 2024-06-10T00:22:44.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.911+0000 7f57fe7fc640 1 --2- 172.21.15.79:0/476552079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cd230 0x7f58080b2cf0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f58080b41f0 tx=0x7f57f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddb1881fee3721b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.911+0000 7f58067fc640 1 -- 172.21.15.79:0/476552079 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0037070 con 0x7f58080cd230 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.911+0000 7f58067fc640 1 -- 172.21.15.79:0/476552079 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f0032440 con 0x7f58080cd230 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.911+0000 7f58067fc640 1 -- 172.21.15.79:0/476552079 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0032810 con 0x7f58080cd230 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.912+0000 7f580d709640 1 -- 172.21.15.79:0/476552079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cd230 msgr2=0x7f58080b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.912+0000 7f580d709640 1 --2- 172.21.15.79:0/476552079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cd230 0x7f58080b2cf0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f58080b41f0 tx=0x7f57f002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.912+0000 7f580d709640 1 -- 172.21.15.79:0/476552079 shutdown_connections 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.912+0000 7f580d709640 1 --2- 172.21.15.79:0/476552079 >> v2:172.21.15.117:3300/0 conn(0x7f58080cec50 0x7f58080cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.912+0000 7f580d709640 1 --2- 172.21.15.79:0/476552079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cd230 0x7f58080b2cf0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.912+0000 7f580d709640 1 -- 172.21.15.79:0/476552079 >> 172.21.15.79:0/476552079 conn(0x7f58080b19f0 msgr2=0x7f58080b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.912+0000 7f580d709640 1 -- 172.21.15.79:0/476552079 shutdown_connections 2024-06-10T00:22:44.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.912+0000 7f580d709640 1 -- 172.21.15.79:0/476552079 wait complete. 2024-06-10T00:22:44.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.913+0000 7f580d709640 1 Processor -- start 2024-06-10T00:22:44.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.913+0000 7f580d709640 1 -- start start 2024-06-10T00:22:44.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f580d709640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58080cd230 0x7f580809ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f580d709640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cec50 0x7f580814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f580d709640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58081553c0 0x7f5808149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f580d709640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5808155920 con 0x7f58080cec50 2024-06-10T00:22:44.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f580d709640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58081557a0 con 0x7f58081553c0 2024-06-10T00:22:44.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f580d709640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5808071030 con 0x7f58080cd230 2024-06-10T00:22:44.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f57fe7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cec50 0x7f580814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f57fe7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cec50 0x7f580814c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35126/0 (socket says 172.21.15.79:35126) 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f57fe7fc640 1 -- 172.21.15.79:0/1895122461 learned_addr learned my addr 172.21.15.79:0/1895122461 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f58077fe640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58081553c0 0x7f5808149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f5806ffd640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58080cd230 0x7f580809ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f57fe7fc640 1 -- 172.21.15.79:0/1895122461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58080cd230 msgr2=0x7f580809ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f57fe7fc640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58080cd230 0x7f580809ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f57fe7fc640 1 -- 172.21.15.79:0/1895122461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58081553c0 msgr2=0x7f5808149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f57fe7fc640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58081553c0 0x7f5808149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.914+0000 7f57fe7fc640 1 -- 172.21.15.79:0/1895122461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580814c850 con 0x7f58080cec50 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.915+0000 7f57fe7fc640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cec50 0x7f580814c310 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f57f0000c00 tx=0x7f57f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.915+0000 7f57fffff640 1 -- 172.21.15.79:0/1895122461 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0037040 con 0x7f58080cec50 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.915+0000 7f57fffff640 1 -- 172.21.15.79:0/1895122461 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f0042070 con 0x7f58080cec50 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.915+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580814cad0 con 0x7f58080cec50 2024-06-10T00:22:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.915+0000 7f57fffff640 1 -- 172.21.15.79:0/1895122461 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0030960 con 0x7f58080cec50 2024-06-10T00:22:44.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.915+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f580814d090 con 0x7f58080cec50 2024-06-10T00:22:44.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.916+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580814d2d0 con 0x7f58080cec50 2024-06-10T00:22:44.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.916+0000 7f57fffff640 1 -- 172.21.15.79:0/1895122461 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57f0030b00 con 0x7f58080cec50 2024-06-10T00:22:44.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.917+0000 7f57fffff640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57e806be30 0x7f57e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:44.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.917+0000 7f57fffff640 1 -- 172.21.15.79:0/1895122461 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f57f00ab910 con 0x7f58080cec50 2024-06-10T00:22:44.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.917+0000 7f5806ffd640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57e806be30 0x7f57e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:44.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.917+0000 7f5806ffd640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57e806be30 0x7f57e806e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f57f8005880 tx=0x7f57f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:44.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:44.921+0000 7f57fffff640 1 -- 172.21.15.79:0/1895122461 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f580814d2d0 con 0x7f58080cec50 2024-06-10T00:22:44.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:22:44.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:22:45.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.096+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5808068430 con 0x7f57e806be30 2024-06-10T00:22:45.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.101+0000 7f57fffff640 1 -- 172.21.15.79:0/1895122461 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247090 (secure 0 0 0) 0x7f5808068430 con 0x7f57e806be30 2024-06-10T00:22:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:45.106 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:22:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.104+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57e806be30 msgr2=0x7f57e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.104+0000 7f580d709640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57e806be30 0x7f57e806e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f57f8005880 tx=0x7f57f8009040 comp rx=0 tx=0).stop 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.104+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cec50 msgr2=0x7f580814c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.104+0000 7f580d709640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cec50 0x7f580814c310 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f57f0000c00 tx=0x7f57f00046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.105+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 shutdown_connections 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.105+0000 7f580d709640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f57e806be30 0x7f57e806e2f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.105+0000 7f580d709640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58081553c0 0x7f5808149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.105+0000 7f580d709640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58080cec50 0x7f580814c310 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.105+0000 7f580d709640 1 --2- 172.21.15.79:0/1895122461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58080cd230 0x7f580809ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.105+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 >> 172.21.15.79:0/1895122461 conn(0x7f58080b19f0 msgr2=0x7f5808154500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.105+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 shutdown_connections 2024-06-10T00:22:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.105+0000 7f580d709640 1 -- 172.21.15.79:0/1895122461 wait complete. 2024-06-10T00:22:45.116 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-06-10T00:22:43.255944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260484,"kb_used_data":11012,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714236,"statfs":{"total":773094113280,"available":772827377664,"internally_reserved":0,"allocated":11276288,"data_stored":5841191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000850"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453378+0000","last_change":"2024-06-10T00:22:40.453378+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453378+0000","last_undegraded":"2024-06-10T00:22:40.453378+0000","last_fullsized":"2024-06-10T00:22:40.453378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453738+0000","last_change":"2024-06-10T00:22:40.453738+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453738+0000","last_undegraded":"2024-06-10T00:22:40.453738+0000","last_fullsized":"2024-06-10T00:22:40.453738+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453610+0000","last_change":"2024-06-10T00:22:40.453610+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453610+0000","last_undegraded":"2024-06-10T00:22:40.453610+0000","last_fullsized":"2024-06-10T00:22:40.453610+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451659+0000","last_change":"2024-06-10T00:22:40.451659+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451659+0000","last_undegraded":"2024-06-10T00:22:40.451659+0000","last_fullsized":"2024-06-10T00:22:40.451659+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447665+0000","last_change":"2024-06-10T00:22:40.447665+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447665+0000","last_undegraded":"2024-06-10T00:22:40.447665+0000","last_fullsized":"2024-06-10T00:22:40.447665+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452521+0000","last_change":"2024-06-10T00:22:40.452521+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452521+0000","last_undegraded":"2024-06-10T00:22:40.452521+0000","last_fullsized":"2024-06-10T00:22:40.452521+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452200+0000","last_change":"2024-06-10T00:22:40.452200+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452200+0000","last_undegraded":"2024-06-10T00:22:40.452200+0000","last_fullsized":"2024-06-10T00:22:40.452200+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451364+0000","last_change":"2024-06-10T00:22:40.451364+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451364+0000","last_undegraded":"2024-06-10T00:22:40.451364+0000","last_fullsized":"2024-06-10T00:22:40.451364+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452776+0000","last_change":"2024-06-10T00:22:40.452776+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452776+0000","last_undegraded":"2024-06-10T00:22:40.452776+0000","last_fullsized":"2024-06-10T00:22:40.452776+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447237+0000","last_change":"2024-06-10T00:22:40.447237+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447237+0000","last_undegraded":"2024-06-10T00:22:40.447237+0000","last_fullsized":"2024-06-10T00:22:40.447237+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446588+0000","last_change":"2024-06-10T00:22:40.446588+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446588+0000","last_undegraded":"2024-06-10T00:22:40.446588+0000","last_fullsized":"2024-06-10T00:22:40.446588+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446567+0000","last_change":"2024-06-10T00:22:40.446567+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446567+0000","last_undegraded":"2024-06-10T00:22:40.446567+0000","last_fullsized":"2024-06-10T00:22:40.446567+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455589+0000","last_change":"2024-06-10T00:22:40.455589+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455589+0000","last_undegraded":"2024-06-10T00:22:40.455589+0000","last_fullsized":"2024-06-10T00:22:40.455589+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448757+0000","last_change":"2024-06-10T00:22:40.448757+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448757+0000","last_undegraded":"2024-06-10T00:22:40.448757+0000","last_fullsized":"2024-06-10T00:22:40.448757+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447882+0000","last_change":"2024-06-10T00:22:40.447882+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447882+0000","last_undegraded":"2024-06-10T00:22:40.447882+0000","last_fullsized":"2024-06-10T00:22:40.447882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448664+0000","last_change":"2024-06-10T00:22:40.448664+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448664+0000","last_undegraded":"2024-06-10T00:22:40.448664+0000","last_fullsized":"2024-06-10T00:22:40.448664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452849+0000","last_change":"2024-06-10T00:22:40.452849+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452849+0000","last_undegraded":"2024-06-10T00:22:40.452849+0000","last_fullsized":"2024-06-10T00:22:40.452849+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453321+0000","last_change":"2024-06-10T00:22:40.453321+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453321+0000","last_undegraded":"2024-06-10T00:22:40.453321+0000","last_fullsized":"2024-06-10T00:22:40.453321+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453224+0000","last_change":"2024-06-10T00:22:40.453224+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453224+0000","last_undegraded":"2024-06-10T00:22:40.453224+0000","last_fullsized":"2024-06-10T00:22:40.453224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446137+0000","last_change":"2024-06-10T00:22:40.446137+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446137+0000","last_undegraded":"2024-06-10T00:22:40.446137+0000","last_fullsized":"2024-06-10T00:22:40.446137+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451058+0000","last_change":"2024-06-10T00:22:40.451058+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451058+0000","last_undegraded":"2024-06-10T00:22:40.451058+0000","last_fullsized":"2024-06-10T00:22:40.451058+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447249+0000","last_change":"2024-06-10T00:22:40.447249+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447249+0000","last_undegraded":"2024-06-10T00:22:40.447249+0000","last_fullsized":"2024-06-10T00:22:40.447249+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451281+0000","last_change":"2024-06-10T00:22:40.451281+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451281+0000","last_undegraded":"2024-06-10T00:22:40.451281+0000","last_fullsized":"2024-06-10T00:22:40.451281+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447178+0000","last_change":"2024-06-10T00:22:40.447178+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447178+0000","last_undegraded":"2024-06-10T00:22:40.447178+0000","last_fullsized":"2024-06-10T00:22:40.447178+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445987+0000","last_change":"2024-06-10T00:22:40.445987+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445987+0000","last_undegraded":"2024-06-10T00:22:40.445987+0000","last_fullsized":"2024-06-10T00:22:40.445987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.444771+0000","last_change":"2024-06-10T00:22:40.444771+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.444771+0000","last_undegraded":"2024-06-10T00:22:40.444771+0000","last_fullsized":"2024-06-10T00:22:40.444771+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446154+0000","last_change":"2024-06-10T00:22:40.446154+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446154+0000","last_undegraded":"2024-06-10T00:22:40.446154+0000","last_fullsized":"2024-06-10T00:22:40.446154+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453937+0000","last_change":"2024-06-10T00:22:40.453937+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453937+0000","last_undegraded":"2024-06-10T00:22:40.453937+0000","last_fullsized":"2024-06-10T00:22:40.453937+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450597+0000","last_change":"2024-06-10T00:22:40.450597+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450597+0000","last_undegraded":"2024-06-10T00:22:40.450597+0000","last_fullsized":"2024-06-10T00:22:40.450597+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445568+0000","last_change":"2024-06-10T00:22:40.445568+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445568+0000","last_undegraded":"2024-06-10T00:22:40.445568+0000","last_fullsized":"2024-06-10T00:22:40.445568+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451664+0000","last_change":"2024-06-10T00:22:40.451664+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451664+0000","last_undegraded":"2024-06-10T00:22:40.451664+0000","last_fullsized":"2024-06-10T00:22:40.451664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450942+0000","last_change":"2024-06-10T00:22:40.450942+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450942+0000","last_undegraded":"2024-06-10T00:22:40.450942+0000","last_fullsized":"2024-06-10T00:22:40.450942+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.454640+0000","last_change":"2024-06-10T00:22:40.454640+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.454640+0000","last_undegraded":"2024-06-10T00:22:40.454640+0000","last_fullsized":"2024-06-10T00:22:40.454640+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465911+0000","last_change":"2024-06-10T00:22:40.464067+0000","last_active":"2024-06-10T00:22:40.465911+0000","last_peered":"2024-06-10T00:22:40.465911+0000","last_clean":"2024-06-10T00:22:40.465911+0000","last_became_active":"2024-06-10T00:22:40.463201+0000","last_became_peered":"2024-06-10T00:22:40.463201+0000","last_unstale":"2024-06-10T00:22:40.465911+0000","last_undegraded":"2024-06-10T00:22:40.465911+0000","last_fullsized":"2024-06-10T00:22:40.465911+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:21:18.421656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448819+0000","last_change":"2024-06-10T00:22:40.448819+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448819+0000","last_undegraded":"2024-06-10T00:22:40.448819+0000","last_fullsized":"2024-06-10T00:22:40.448819+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.464968+0000","last_change":"2024-06-10T00:22:40.459474+0000","last_active":"2024-06-10T00:22:40.464968+0000","last_peered":"2024-06-10T00:22:40.464968+0000","last_clean":"2024-06-10T00:22:40.464968+0000","last_became_active":"2024-06-10T00:22:40.459104+0000","last_became_peered":"2024-06-10T00:22:40.459104+0000","last_unstale":"2024-06-10T00:22:40.464968+0000","last_undegraded":"2024-06-10T00:22:40.464968+0000","last_fullsized":"2024-06-10T00:22:40.464968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:33:31.007804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445077+0000","last_change":"2024-06-10T00:22:40.445077+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445077+0000","last_undegraded":"2024-06-10T00:22:40.445077+0000","last_fullsized":"2024-06-10T00:22:40.445077+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462178+0000","last_change":"2024-06-10T00:22:40.459372+0000","last_active":"2024-06-10T00:22:40.462178+0000","last_peered":"2024-06-10T00:22:40.462178+0000","last_clean":"2024-06-10T00:22:40.462178+0000","last_became_active":"2024-06-10T00:22:40.456763+0000","last_became_peered":"2024-06-10T00:22:40.456763+0000","last_unstale":"2024-06-10T00:22:40.462178+0000","last_undegraded":"2024-06-10T00:22:40.462178+0000","last_fullsized":"2024-06-10T00:22:40.462178+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446568+0000","last_change":"2024-06-10T00:22:40.446568+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446568+0000","last_undegraded":"2024-06-10T00:22:40.446568+0000","last_fullsized":"2024-06-10T00:22:40.446568+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460758+0000","last_change":"2024-06-10T00:22:40.458499+0000","last_active":"2024-06-10T00:22:40.460758+0000","last_peered":"2024-06-10T00:22:40.460758+0000","last_clean":"2024-06-10T00:22:40.460758+0000","last_became_active":"2024-06-10T00:22:40.458216+0000","last_became_peered":"2024-06-10T00:22:40.458216+0000","last_unstale":"2024-06-10T00:22:40.460758+0000","last_undegraded":"2024-06-10T00:22:40.460758+0000","last_fullsized":"2024-06-10T00:22:40.460758+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:52:36.829097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451227+0000","last_change":"2024-06-10T00:22:40.451227+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451227+0000","last_undegraded":"2024-06-10T00:22:40.451227+0000","last_fullsized":"2024-06-10T00:22:40.451227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.457112+0000","last_change":"2024-06-10T00:22:40.455292+0000","last_active":"2024-06-10T00:22:40.457112+0000","last_peered":"2024-06-10T00:22:40.457112+0000","last_clean":"2024-06-10T00:22:40.457112+0000","last_became_active":"2024-06-10T00:22:40.455011+0000","last_became_peered":"2024-06-10T00:22:40.455011+0000","last_unstale":"2024-06-10T00:22:40.457112+0000","last_undegraded":"2024-06-10T00:22:40.457112+0000","last_fullsized":"2024-06-10T00:22:40.457112+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:13.197903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452127+0000","last_change":"2024-06-10T00:22:40.452127+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452127+0000","last_undegraded":"2024-06-10T00:22:40.452127+0000","last_fullsized":"2024-06-10T00:22:40.452127+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.456928+0000","last_change":"2024-06-10T00:22:40.453019+0000","last_active":"2024-06-10T00:22:40.456928+0000","last_peered":"2024-06-10T00:22:40.456928+0000","last_clean":"2024-06-10T00:22:40.456928+0000","last_became_active":"2024-06-10T00:22:40.452738+0000","last_became_peered":"2024-06-10T00:22:40.452738+0000","last_unstale":"2024-06-10T00:22:40.456928+0000","last_undegraded":"2024-06-10T00:22:40.456928+0000","last_fullsized":"2024-06-10T00:22:40.456928+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:57:14.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452619+0000","last_change":"2024-06-10T00:22:40.452619+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452619+0000","last_undegraded":"2024-06-10T00:22:40.452619+0000","last_fullsized":"2024-06-10T00:22:40.452619+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458402+0000","last_change":"2024-06-10T00:22:40.454657+0000","last_active":"2024-06-10T00:22:40.458402+0000","last_peered":"2024-06-10T00:22:40.458402+0000","last_clean":"2024-06-10T00:22:40.458402+0000","last_became_active":"2024-06-10T00:22:40.454398+0000","last_became_peered":"2024-06-10T00:22:40.454398+0000","last_unstale":"2024-06-10T00:22:40.458402+0000","last_undegraded":"2024-06-10T00:22:40.458402+0000","last_fullsized":"2024-06-10T00:22:40.458402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:19:39.853903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.456370+0000","last_change":"2024-06-10T00:22:40.456370+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.456370+0000","last_undegraded":"2024-06-10T00:22:40.456370+0000","last_fullsized":"2024-06-10T00:22:40.456370+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.464034+0000","last_change":"2024-06-10T00:22:40.461992+0000","last_active":"2024-06-10T00:22:40.464034+0000","last_peered":"2024-06-10T00:22:40.464034+0000","last_clean":"2024-06-10T00:22:40.464034+0000","last_became_active":"2024-06-10T00:22:40.461700+0000","last_became_peered":"2024-06-10T00:22:40.461700+0000","last_unstale":"2024-06-10T00:22:40.464034+0000","last_undegraded":"2024-06-10T00:22:40.464034+0000","last_fullsized":"2024-06-10T00:22:40.464034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:33:07.654120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455105+0000","last_change":"2024-06-10T00:22:40.455105+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455105+0000","last_undegraded":"2024-06-10T00:22:40.455105+0000","last_fullsized":"2024-06-10T00:22:40.455105+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458470+0000","last_change":"2024-06-10T00:22:40.455913+0000","last_active":"2024-06-10T00:22:40.458470+0000","last_peered":"2024-06-10T00:22:40.458470+0000","last_clean":"2024-06-10T00:22:40.458470+0000","last_became_active":"2024-06-10T00:22:40.455625+0000","last_became_peered":"2024-06-10T00:22:40.455625+0000","last_unstale":"2024-06-10T00:22:40.458470+0000","last_undegraded":"2024-06-10T00:22:40.458470+0000","last_fullsized":"2024-06-10T00:22:40.458470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446750+0000","last_change":"2024-06-10T00:22:40.446750+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446750+0000","last_undegraded":"2024-06-10T00:22:40.446750+0000","last_fullsized":"2024-06-10T00:22:40.446750+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465800+0000","last_change":"2024-06-10T00:22:40.463696+0000","last_active":"2024-06-10T00:22:40.465800+0000","last_peered":"2024-06-10T00:22:40.465800+0000","last_clean":"2024-06-10T00:22:40.465800+0000","last_became_active":"2024-06-10T00:22:40.463375+0000","last_became_peered":"2024-06-10T00:22:40.463375+0000","last_unstale":"2024-06-10T00:22:40.465800+0000","last_undegraded":"2024-06-10T00:22:40.465800+0000","last_fullsized":"2024-06-10T00:22:40.465800+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:06:16.483344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448537+0000","last_change":"2024-06-10T00:22:40.448537+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448537+0000","last_undegraded":"2024-06-10T00:22:40.448537+0000","last_fullsized":"2024-06-10T00:22:40.448537+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467797+0000","last_change":"2024-06-10T00:22:40.463539+0000","last_active":"2024-06-10T00:22:40.467797+0000","last_peered":"2024-06-10T00:22:40.467797+0000","last_clean":"2024-06-10T00:22:40.467797+0000","last_became_active":"2024-06-10T00:22:40.463229+0000","last_became_peered":"2024-06-10T00:22:40.463229+0000","last_unstale":"2024-06-10T00:22:40.467797+0000","last_undegraded":"2024-06-10T00:22:40.467797+0000","last_fullsized":"2024-06-10T00:22:40.467797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:07.961320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446602+0000","last_change":"2024-06-10T00:22:40.446602+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446602+0000","last_undegraded":"2024-06-10T00:22:40.446602+0000","last_fullsized":"2024-06-10T00:22:40.446602+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.468033+0000","last_change":"2024-06-10T00:22:40.465693+0000","last_active":"2024-06-10T00:22:40.468033+0000","last_peered":"2024-06-10T00:22:40.468033+0000","last_clean":"2024-06-10T00:22:40.468033+0000","last_became_active":"2024-06-10T00:22:40.465452+0000","last_became_peered":"2024-06-10T00:22:40.465452+0000","last_unstale":"2024-06-10T00:22:40.468033+0000","last_undegraded":"2024-06-10T00:22:40.468033+0000","last_fullsized":"2024-06-10T00:22:40.468033+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:03:33.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445894+0000","last_change":"2024-06-10T00:22:40.445894+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445894+0000","last_undegraded":"2024-06-10T00:22:40.445894+0000","last_fullsized":"2024-06-10T00:22:40.445894+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460056+0000","last_change":"2024-06-10T00:22:40.456048+0000","last_active":"2024-06-10T00:22:40.460056+0000","last_peered":"2024-06-10T00:22:40.460056+0000","last_clean":"2024-06-10T00:22:40.460056+0000","last_became_active":"2024-06-10T00:22:40.455788+0000","last_became_peered":"2024-06-10T00:22:40.455788+0000","last_unstale":"2024-06-10T00:22:40.460056+0000","last_undegraded":"2024-06-10T00:22:40.460056+0000","last_fullsized":"2024-06-10T00:22:40.460056+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452484+0000","last_change":"2024-06-10T00:22:40.452484+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452484+0000","last_undegraded":"2024-06-10T00:22:40.452484+0000","last_fullsized":"2024-06-10T00:22:40.452484+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.463737+0000","last_change":"2024-06-10T00:22:40.458861+0000","last_active":"2024-06-10T00:22:40.463737+0000","last_peered":"2024-06-10T00:22:40.463737+0000","last_clean":"2024-06-10T00:22:40.463737+0000","last_became_active":"2024-06-10T00:22:40.458585+0000","last_became_peered":"2024-06-10T00:22:40.458585+0000","last_unstale":"2024-06-10T00:22:40.463737+0000","last_undegraded":"2024-06-10T00:22:40.463737+0000","last_fullsized":"2024-06-10T00:22:40.463737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450140+0000","last_change":"2024-06-10T00:22:40.450140+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450140+0000","last_undegraded":"2024-06-10T00:22:40.450140+0000","last_fullsized":"2024-06-10T00:22:40.450140+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465695+0000","last_change":"2024-06-10T00:22:40.460616+0000","last_active":"2024-06-10T00:22:40.465695+0000","last_peered":"2024-06-10T00:22:40.465695+0000","last_clean":"2024-06-10T00:22:40.465695+0000","last_became_active":"2024-06-10T00:22:40.460359+0000","last_became_peered":"2024-06-10T00:22:40.460359+0000","last_unstale":"2024-06-10T00:22:40.465695+0000","last_undegraded":"2024-06-10T00:22:40.465695+0000","last_fullsized":"2024-06-10T00:22:40.465695+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:52:06.207600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452388+0000","last_change":"2024-06-10T00:22:40.452388+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452388+0000","last_undegraded":"2024-06-10T00:22:40.452388+0000","last_fullsized":"2024-06-10T00:22:40.452388+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458372+0000","last_change":"2024-06-10T00:22:40.451127+0000","last_active":"2024-06-10T00:22:40.458372+0000","last_peered":"2024-06-10T00:22:40.458372+0000","last_clean":"2024-06-10T00:22:40.458372+0000","last_became_active":"2024-06-10T00:22:40.450861+0000","last_became_peered":"2024-06-10T00:22:40.450861+0000","last_unstale":"2024-06-10T00:22:40.458372+0000","last_undegraded":"2024-06-10T00:22:40.458372+0000","last_fullsized":"2024-06-10T00:22:40.458372+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:03:33.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450517+0000","last_change":"2024-06-10T00:22:40.450517+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450517+0000","last_undegraded":"2024-06-10T00:22:40.450517+0000","last_fullsized":"2024-06-10T00:22:40.450517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462598+0000","last_change":"2024-06-10T00:22:40.459091+0000","last_active":"2024-06-10T00:22:40.462598+0000","last_peered":"2024-06-10T00:22:40.462598+0000","last_clean":"2024-06-10T00:22:40.462598+0000","last_became_active":"2024-06-10T00:22:40.458813+0000","last_became_peered":"2024-06-10T00:22:40.458813+0000","last_unstale":"2024-06-10T00:22:40.462598+0000","last_undegraded":"2024-06-10T00:22:40.462598+0000","last_fullsized":"2024-06-10T00:22:40.462598+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:43:56.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451845+0000","last_change":"2024-06-10T00:22:40.451845+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451845+0000","last_undegraded":"2024-06-10T00:22:40.451845+0000","last_fullsized":"2024-06-10T00:22:40.451845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462663+0000","last_change":"2024-06-10T00:22:40.460540+0000","last_active":"2024-06-10T00:22:40.462663+0000","last_peered":"2024-06-10T00:22:40.462663+0000","last_clean":"2024-06-10T00:22:40.462663+0000","last_became_active":"2024-06-10T00:22:40.460239+0000","last_became_peered":"2024-06-10T00:22:40.460239+0000","last_unstale":"2024-06-10T00:22:40.462663+0000","last_undegraded":"2024-06-10T00:22:40.462663+0000","last_fullsized":"2024-06-10T00:22:40.462663+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:41.291107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447119+0000","last_change":"2024-06-10T00:22:40.447119+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447119+0000","last_undegraded":"2024-06-10T00:22:40.447119+0000","last_fullsized":"2024-06-10T00:22:40.447119+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.459704+0000","last_change":"2024-06-10T00:22:40.457983+0000","last_active":"2024-06-10T00:22:40.459704+0000","last_peered":"2024-06-10T00:22:40.459704+0000","last_clean":"2024-06-10T00:22:40.459704+0000","last_became_active":"2024-06-10T00:22:40.457713+0000","last_became_peered":"2024-06-10T00:22:40.457713+0000","last_unstale":"2024-06-10T00:22:40.459704+0000","last_undegraded":"2024-06-10T00:22:40.459704+0000","last_fullsized":"2024-06-10T00:22:40.459704+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452095+0000","last_change":"2024-06-10T00:22:40.452095+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452095+0000","last_undegraded":"2024-06-10T00:22:40.452095+0000","last_fullsized":"2024-06-10T00:22:40.452095+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465729+0000","last_change":"2024-06-10T00:22:40.464715+0000","last_active":"2024-06-10T00:22:40.465729+0000","last_peered":"2024-06-10T00:22:40.465729+0000","last_clean":"2024-06-10T00:22:40.465729+0000","last_became_active":"2024-06-10T00:22:40.464434+0000","last_became_peered":"2024-06-10T00:22:40.464434+0000","last_unstale":"2024-06-10T00:22:40.465729+0000","last_undegraded":"2024-06-10T00:22:40.465729+0000","last_fullsized":"2024-06-10T00:22:40.465729+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:12:48.174973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452817+0000","last_change":"2024-06-10T00:22:40.452817+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452817+0000","last_undegraded":"2024-06-10T00:22:40.452817+0000","last_fullsized":"2024-06-10T00:22:40.452817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.461851+0000","last_change":"2024-06-10T00:22:40.458231+0000","last_active":"2024-06-10T00:22:40.461851+0000","last_peered":"2024-06-10T00:22:40.461851+0000","last_clean":"2024-06-10T00:22:40.461851+0000","last_became_active":"2024-06-10T00:22:40.457959+0000","last_became_peered":"2024-06-10T00:22:40.457959+0000","last_unstale":"2024-06-10T00:22:40.461851+0000","last_undegraded":"2024-06-10T00:22:40.461851+0000","last_fullsized":"2024-06-10T00:22:40.461851+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:58.753457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453465+0000","last_change":"2024-06-10T00:22:40.453465+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453465+0000","last_undegraded":"2024-06-10T00:22:40.453465+0000","last_fullsized":"2024-06-10T00:22:40.453465+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462888+0000","last_change":"2024-06-10T00:22:40.461887+0000","last_active":"2024-06-10T00:22:40.462888+0000","last_peered":"2024-06-10T00:22:40.462888+0000","last_clean":"2024-06-10T00:22:40.462888+0000","last_became_active":"2024-06-10T00:22:40.461591+0000","last_became_peered":"2024-06-10T00:22:40.461591+0000","last_unstale":"2024-06-10T00:22:40.462888+0000","last_undegraded":"2024-06-10T00:22:40.462888+0000","last_fullsized":"2024-06-10T00:22:40.462888+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:13:12.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448589+0000","last_change":"2024-06-10T00:22:40.448589+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448589+0000","last_undegraded":"2024-06-10T00:22:40.448589+0000","last_fullsized":"2024-06-10T00:22:40.448589+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.468529+0000","last_change":"2024-06-10T00:22:40.465440+0000","last_active":"2024-06-10T00:22:40.468529+0000","last_peered":"2024-06-10T00:22:40.468529+0000","last_clean":"2024-06-10T00:22:40.468529+0000","last_became_active":"2024-06-10T00:22:40.465137+0000","last_became_peered":"2024-06-10T00:22:40.465137+0000","last_unstale":"2024-06-10T00:22:40.468529+0000","last_undegraded":"2024-06-10T00:22:40.468529+0000","last_fullsized":"2024-06-10T00:22:40.468529+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:36:26.012841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455464+0000","last_change":"2024-06-10T00:22:40.455464+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455464+0000","last_undegraded":"2024-06-10T00:22:40.455464+0000","last_fullsized":"2024-06-10T00:22:40.455464+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460024+0000","last_change":"2024-06-10T00:22:40.455370+0000","last_active":"2024-06-10T00:22:40.460024+0000","last_peered":"2024-06-10T00:22:40.460024+0000","last_clean":"2024-06-10T00:22:40.460024+0000","last_became_active":"2024-06-10T00:22:40.455076+0000","last_became_peered":"2024-06-10T00:22:40.455076+0000","last_unstale":"2024-06-10T00:22:40.460024+0000","last_undegraded":"2024-06-10T00:22:40.460024+0000","last_fullsized":"2024-06-10T00:22:40.460024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445351+0000","last_change":"2024-06-10T00:22:40.445351+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445351+0000","last_undegraded":"2024-06-10T00:22:40.445351+0000","last_fullsized":"2024-06-10T00:22:40.445351+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465773+0000","last_change":"2024-06-10T00:22:40.463082+0000","last_active":"2024-06-10T00:22:40.465773+0000","last_peered":"2024-06-10T00:22:40.465773+0000","last_clean":"2024-06-10T00:22:40.465773+0000","last_became_active":"2024-06-10T00:22:40.462736+0000","last_became_peered":"2024-06-10T00:22:40.462736+0000","last_unstale":"2024-06-10T00:22:40.465773+0000","last_undegraded":"2024-06-10T00:22:40.465773+0000","last_fullsized":"2024-06-10T00:22:40.465773+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:28:31.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452463+0000","last_change":"2024-06-10T00:22:40.452463+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452463+0000","last_undegraded":"2024-06-10T00:22:40.452463+0000","last_fullsized":"2024-06-10T00:22:40.452463+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467724+0000","last_change":"2024-06-10T00:22:40.463965+0000","last_active":"2024-06-10T00:22:40.467724+0000","last_peered":"2024-06-10T00:22:40.467724+0000","last_clean":"2024-06-10T00:22:40.467724+0000","last_became_active":"2024-06-10T00:22:40.463632+0000","last_became_peered":"2024-06-10T00:22:40.463632+0000","last_unstale":"2024-06-10T00:22:40.467724+0000","last_undegraded":"2024-06-10T00:22:40.467724+0000","last_fullsized":"2024-06-10T00:22:40.467724+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:35:34.739817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447414+0000","last_change":"2024-06-10T00:22:40.447414+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447414+0000","last_undegraded":"2024-06-10T00:22:40.447414+0000","last_fullsized":"2024-06-10T00:22:40.447414+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465194+0000","last_change":"2024-06-10T00:22:40.460576+0000","last_active":"2024-06-10T00:22:40.465194+0000","last_peered":"2024-06-10T00:22:40.465194+0000","last_clean":"2024-06-10T00:22:40.465194+0000","last_became_active":"2024-06-10T00:22:40.460296+0000","last_became_peered":"2024-06-10T00:22:40.460296+0000","last_unstale":"2024-06-10T00:22:40.465194+0000","last_undegraded":"2024-06-10T00:22:40.465194+0000","last_fullsized":"2024-06-10T00:22:40.465194+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:18:24.160240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.449113+0000","last_change":"2024-06-10T00:22:40.449113+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.449113+0000","last_undegraded":"2024-06-10T00:22:40.449113+0000","last_fullsized":"2024-06-10T00:22:40.449113+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458443+0000","last_change":"2024-06-10T00:22:40.455011+0000","last_active":"2024-06-10T00:22:40.458443+0000","last_peered":"2024-06-10T00:22:40.458443+0000","last_clean":"2024-06-10T00:22:40.458443+0000","last_became_active":"2024-06-10T00:22:40.454696+0000","last_became_peered":"2024-06-10T00:22:40.454696+0000","last_unstale":"2024-06-10T00:22:40.458443+0000","last_undegraded":"2024-06-10T00:22:40.458443+0000","last_fullsized":"2024-06-10T00:22:40.458443+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:17.523826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447829+0000","last_change":"2024-06-10T00:22:40.447829+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447829+0000","last_undegraded":"2024-06-10T00:22:40.447829+0000","last_fullsized":"2024-06-10T00:22:40.447829+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465648+0000","last_change":"2024-06-10T00:22:40.459986+0000","last_active":"2024-06-10T00:22:40.465648+0000","last_peered":"2024-06-10T00:22:40.465648+0000","last_clean":"2024-06-10T00:22:40.465648+0000","last_became_active":"2024-06-10T00:22:40.459717+0000","last_became_peered":"2024-06-10T00:22:40.459717+0000","last_unstale":"2024-06-10T00:22:40.465648+0000","last_undegraded":"2024-06-10T00:22:40.465648+0000","last_fullsized":"2024-06-10T00:22:40.465648+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:37:04.035878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448417+0000","last_change":"2024-06-10T00:22:40.448417+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448417+0000","last_undegraded":"2024-06-10T00:22:40.448417+0000","last_fullsized":"2024-06-10T00:22:40.448417+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467755+0000","last_change":"2024-06-10T00:22:40.464220+0000","last_active":"2024-06-10T00:22:40.467755+0000","last_peered":"2024-06-10T00:22:40.467755+0000","last_clean":"2024-06-10T00:22:40.467755+0000","last_became_active":"2024-06-10T00:22:40.463898+0000","last_became_peered":"2024-06-10T00:22:40.463898+0000","last_unstale":"2024-06-10T00:22:40.467755+0000","last_undegraded":"2024-06-10T00:22:40.467755+0000","last_fullsized":"2024-06-10T00:22:40.467755+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:06.871558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446103+0000","last_change":"2024-06-10T00:22:40.446103+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446103+0000","last_undegraded":"2024-06-10T00:22:40.446103+0000","last_fullsized":"2024-06-10T00:22:40.446103+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465703+0000","last_change":"2024-06-10T00:22:40.461880+0000","last_active":"2024-06-10T00:22:40.465703+0000","last_peered":"2024-06-10T00:22:40.465703+0000","last_clean":"2024-06-10T00:22:40.465703+0000","last_became_active":"2024-06-10T00:22:40.461170+0000","last_became_peered":"2024-06-10T00:22:40.461170+0000","last_unstale":"2024-06-10T00:22:40.465703+0000","last_undegraded":"2024-06-10T00:22:40.465703+0000","last_fullsized":"2024-06-10T00:22:40.465703+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:45:21.663165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.444598+0000","last_change":"2024-06-10T00:22:40.444598+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.444598+0000","last_undegraded":"2024-06-10T00:22:40.444598+0000","last_fullsized":"2024-06-10T00:22:40.444598+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465752+0000","last_change":"2024-06-10T00:22:40.464744+0000","last_active":"2024-06-10T00:22:40.465752+0000","last_peered":"2024-06-10T00:22:40.465752+0000","last_clean":"2024-06-10T00:22:40.465752+0000","last_became_active":"2024-06-10T00:22:40.464450+0000","last_became_peered":"2024-06-10T00:22:40.464450+0000","last_unstale":"2024-06-10T00:22:40.465752+0000","last_undegraded":"2024-06-10T00:22:40.465752+0000","last_fullsized":"2024-06-10T00:22:40.465752+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:52.443257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":319,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.448897+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:22:40.448897+0000","last_peered":"2024-06-10T00:22:40.448897+0000","last_clean":"2024-06-10T00:22:40.448897+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:22:40.448897+0000","last_undegraded":"2024-06-10T00:22:40.448897+0000","last_fullsized":"2024-06-10T00:22:40.448897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1175425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1175425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:22:45.120 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3f is not active+clean 2024-06-10T00:22:45.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.453378+0000', 'last_change': '2024-06-10T00:22:40.453378+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.453378+0000', 'last_undegraded': '2024-06-10T00:22:40.453378+0000', 'last_fullsized': '2024-06-10T00:22:40.453378+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.120 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3e is not active+clean 2024-06-10T00:22:45.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.453738+0000', 'last_change': '2024-06-10T00:22:40.453738+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.453738+0000', 'last_undegraded': '2024-06-10T00:22:40.453738+0000', 'last_fullsized': '2024-06-10T00:22:40.453738+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.120 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3d is not active+clean 2024-06-10T00:22:45.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.453610+0000', 'last_change': '2024-06-10T00:22:40.453610+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.453610+0000', 'last_undegraded': '2024-06-10T00:22:40.453610+0000', 'last_fullsized': '2024-06-10T00:22:40.453610+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3c is not active+clean 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.451659+0000', 'last_change': '2024-06-10T00:22:40.451659+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.451659+0000', 'last_undegraded': '2024-06-10T00:22:40.451659+0000', 'last_fullsized': '2024-06-10T00:22:40.451659+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3b is not active+clean 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.447665+0000', 'last_change': '2024-06-10T00:22:40.447665+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.447665+0000', 'last_undegraded': '2024-06-10T00:22:40.447665+0000', 'last_fullsized': '2024-06-10T00:22:40.447665+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3a is not active+clean 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452521+0000', 'last_change': '2024-06-10T00:22:40.452521+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452521+0000', 'last_undegraded': '2024-06-10T00:22:40.452521+0000', 'last_fullsized': '2024-06-10T00:22:40.452521+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:PG 16.39 is not active+clean 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452200+0000', 'last_change': '2024-06-10T00:22:40.452200+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452200+0000', 'last_undegraded': '2024-06-10T00:22:40.452200+0000', 'last_fullsized': '2024-06-10T00:22:40.452200+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:PG 16.38 is not active+clean 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.451364+0000', 'last_change': '2024-06-10T00:22:40.451364+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.451364+0000', 'last_undegraded': '2024-06-10T00:22:40.451364+0000', 'last_fullsized': '2024-06-10T00:22:40.451364+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.121 INFO:tasks.ceph.ceph_manager.ceph:PG 16.37 is not active+clean 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452776+0000', 'last_change': '2024-06-10T00:22:40.452776+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452776+0000', 'last_undegraded': '2024-06-10T00:22:40.452776+0000', 'last_fullsized': '2024-06-10T00:22:40.452776+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:PG 16.36 is not active+clean 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.447237+0000', 'last_change': '2024-06-10T00:22:40.447237+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.447237+0000', 'last_undegraded': '2024-06-10T00:22:40.447237+0000', 'last_fullsized': '2024-06-10T00:22:40.447237+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:PG 16.35 is not active+clean 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.446588+0000', 'last_change': '2024-06-10T00:22:40.446588+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.446588+0000', 'last_undegraded': '2024-06-10T00:22:40.446588+0000', 'last_fullsized': '2024-06-10T00:22:40.446588+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:PG 16.34 is not active+clean 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.446567+0000', 'last_change': '2024-06-10T00:22:40.446567+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.446567+0000', 'last_undegraded': '2024-06-10T00:22:40.446567+0000', 'last_fullsized': '2024-06-10T00:22:40.446567+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:PG 16.33 is not active+clean 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.455589+0000', 'last_change': '2024-06-10T00:22:40.455589+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.455589+0000', 'last_undegraded': '2024-06-10T00:22:40.455589+0000', 'last_fullsized': '2024-06-10T00:22:40.455589+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:PG 16.32 is not active+clean 2024-06-10T00:22:45.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.448757+0000', 'last_change': '2024-06-10T00:22:40.448757+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.448757+0000', 'last_undegraded': '2024-06-10T00:22:40.448757+0000', 'last_fullsized': '2024-06-10T00:22:40.448757+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:PG 16.31 is not active+clean 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.447882+0000', 'last_change': '2024-06-10T00:22:40.447882+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.447882+0000', 'last_undegraded': '2024-06-10T00:22:40.447882+0000', 'last_fullsized': '2024-06-10T00:22:40.447882+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:PG 16.30 is not active+clean 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.448664+0000', 'last_change': '2024-06-10T00:22:40.448664+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.448664+0000', 'last_undegraded': '2024-06-10T00:22:40.448664+0000', 'last_fullsized': '2024-06-10T00:22:40.448664+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2f is not active+clean 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452849+0000', 'last_change': '2024-06-10T00:22:40.452849+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452849+0000', 'last_undegraded': '2024-06-10T00:22:40.452849+0000', 'last_fullsized': '2024-06-10T00:22:40.452849+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2e is not active+clean 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.453321+0000', 'last_change': '2024-06-10T00:22:40.453321+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.453321+0000', 'last_undegraded': '2024-06-10T00:22:40.453321+0000', 'last_fullsized': '2024-06-10T00:22:40.453321+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2d is not active+clean 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.453224+0000', 'last_change': '2024-06-10T00:22:40.453224+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.453224+0000', 'last_undegraded': '2024-06-10T00:22:40.453224+0000', 'last_fullsized': '2024-06-10T00:22:40.453224+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.123 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2c is not active+clean 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.446137+0000', 'last_change': '2024-06-10T00:22:40.446137+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.446137+0000', 'last_undegraded': '2024-06-10T00:22:40.446137+0000', 'last_fullsized': '2024-06-10T00:22:40.446137+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2b is not active+clean 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.451058+0000', 'last_change': '2024-06-10T00:22:40.451058+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.451058+0000', 'last_undegraded': '2024-06-10T00:22:40.451058+0000', 'last_fullsized': '2024-06-10T00:22:40.451058+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2a is not active+clean 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.447249+0000', 'last_change': '2024-06-10T00:22:40.447249+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.447249+0000', 'last_undegraded': '2024-06-10T00:22:40.447249+0000', 'last_fullsized': '2024-06-10T00:22:40.447249+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:PG 16.29 is not active+clean 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.451281+0000', 'last_change': '2024-06-10T00:22:40.451281+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.451281+0000', 'last_undegraded': '2024-06-10T00:22:40.451281+0000', 'last_fullsized': '2024-06-10T00:22:40.451281+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:PG 16.28 is not active+clean 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.447178+0000', 'last_change': '2024-06-10T00:22:40.447178+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.447178+0000', 'last_undegraded': '2024-06-10T00:22:40.447178+0000', 'last_fullsized': '2024-06-10T00:22:40.447178+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:PG 16.27 is not active+clean 2024-06-10T00:22:45.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.445987+0000', 'last_change': '2024-06-10T00:22:40.445987+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.445987+0000', 'last_undegraded': '2024-06-10T00:22:40.445987+0000', 'last_fullsized': '2024-06-10T00:22:40.445987+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:PG 16.26 is not active+clean 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.444771+0000', 'last_change': '2024-06-10T00:22:40.444771+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.444771+0000', 'last_undegraded': '2024-06-10T00:22:40.444771+0000', 'last_fullsized': '2024-06-10T00:22:40.444771+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:PG 16.25 is not active+clean 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.446154+0000', 'last_change': '2024-06-10T00:22:40.446154+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.446154+0000', 'last_undegraded': '2024-06-10T00:22:40.446154+0000', 'last_fullsized': '2024-06-10T00:22:40.446154+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:PG 16.24 is not active+clean 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.453937+0000', 'last_change': '2024-06-10T00:22:40.453937+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.453937+0000', 'last_undegraded': '2024-06-10T00:22:40.453937+0000', 'last_fullsized': '2024-06-10T00:22:40.453937+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:PG 16.23 is not active+clean 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.450597+0000', 'last_change': '2024-06-10T00:22:40.450597+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.450597+0000', 'last_undegraded': '2024-06-10T00:22:40.450597+0000', 'last_fullsized': '2024-06-10T00:22:40.450597+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:PG 16.22 is not active+clean 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.445568+0000', 'last_change': '2024-06-10T00:22:40.445568+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.445568+0000', 'last_undegraded': '2024-06-10T00:22:40.445568+0000', 'last_fullsized': '2024-06-10T00:22:40.445568+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:22:45.125 INFO:tasks.ceph.ceph_manager.ceph:PG 16.21 is not active+clean 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.451664+0000', 'last_change': '2024-06-10T00:22:40.451664+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.451664+0000', 'last_undegraded': '2024-06-10T00:22:40.451664+0000', 'last_fullsized': '2024-06-10T00:22:40.451664+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:PG 16.20 is not active+clean 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.450942+0000', 'last_change': '2024-06-10T00:22:40.450942+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.450942+0000', 'last_undegraded': '2024-06-10T00:22:40.450942+0000', 'last_fullsized': '2024-06-10T00:22:40.450942+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:PG 16.0 is not active+clean 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.454640+0000', 'last_change': '2024-06-10T00:22:40.454640+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.454640+0000', 'last_undegraded': '2024-06-10T00:22:40.454640+0000', 'last_fullsized': '2024-06-10T00:22:40.454640+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1 is not active+clean 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.448819+0000', 'last_change': '2024-06-10T00:22:40.448819+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.448819+0000', 'last_undegraded': '2024-06-10T00:22:40.448819+0000', 'last_fullsized': '2024-06-10T00:22:40.448819+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2 is not active+clean 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.445077+0000', 'last_change': '2024-06-10T00:22:40.445077+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.445077+0000', 'last_undegraded': '2024-06-10T00:22:40.445077+0000', 'last_fullsized': '2024-06-10T00:22:40.445077+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3 is not active+clean 2024-06-10T00:22:45.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.446568+0000', 'last_change': '2024-06-10T00:22:40.446568+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.446568+0000', 'last_undegraded': '2024-06-10T00:22:40.446568+0000', 'last_fullsized': '2024-06-10T00:22:40.446568+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:PG 16.4 is not active+clean 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.451227+0000', 'last_change': '2024-06-10T00:22:40.451227+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.451227+0000', 'last_undegraded': '2024-06-10T00:22:40.451227+0000', 'last_fullsized': '2024-06-10T00:22:40.451227+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:PG 16.5 is not active+clean 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452127+0000', 'last_change': '2024-06-10T00:22:40.452127+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452127+0000', 'last_undegraded': '2024-06-10T00:22:40.452127+0000', 'last_fullsized': '2024-06-10T00:22:40.452127+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:PG 16.6 is not active+clean 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452619+0000', 'last_change': '2024-06-10T00:22:40.452619+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452619+0000', 'last_undegraded': '2024-06-10T00:22:40.452619+0000', 'last_fullsized': '2024-06-10T00:22:40.452619+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:PG 16.7 is not active+clean 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.456370+0000', 'last_change': '2024-06-10T00:22:40.456370+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.456370+0000', 'last_undegraded': '2024-06-10T00:22:40.456370+0000', 'last_fullsized': '2024-06-10T00:22:40.456370+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:PG 16.8 is not active+clean 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.455105+0000', 'last_change': '2024-06-10T00:22:40.455105+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.455105+0000', 'last_undegraded': '2024-06-10T00:22:40.455105+0000', 'last_fullsized': '2024-06-10T00:22:40.455105+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.127 INFO:tasks.ceph.ceph_manager.ceph:PG 16.9 is not active+clean 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.446750+0000', 'last_change': '2024-06-10T00:22:40.446750+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.446750+0000', 'last_undegraded': '2024-06-10T00:22:40.446750+0000', 'last_fullsized': '2024-06-10T00:22:40.446750+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:PG 16.a is not active+clean 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.448537+0000', 'last_change': '2024-06-10T00:22:40.448537+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.448537+0000', 'last_undegraded': '2024-06-10T00:22:40.448537+0000', 'last_fullsized': '2024-06-10T00:22:40.448537+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:PG 16.b is not active+clean 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.446602+0000', 'last_change': '2024-06-10T00:22:40.446602+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.446602+0000', 'last_undegraded': '2024-06-10T00:22:40.446602+0000', 'last_fullsized': '2024-06-10T00:22:40.446602+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:PG 16.c is not active+clean 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.445894+0000', 'last_change': '2024-06-10T00:22:40.445894+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.445894+0000', 'last_undegraded': '2024-06-10T00:22:40.445894+0000', 'last_fullsized': '2024-06-10T00:22:40.445894+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:PG 16.d is not active+clean 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452484+0000', 'last_change': '2024-06-10T00:22:40.452484+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452484+0000', 'last_undegraded': '2024-06-10T00:22:40.452484+0000', 'last_fullsized': '2024-06-10T00:22:40.452484+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:PG 16.e is not active+clean 2024-06-10T00:22:45.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.450140+0000', 'last_change': '2024-06-10T00:22:40.450140+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.450140+0000', 'last_undegraded': '2024-06-10T00:22:40.450140+0000', 'last_fullsized': '2024-06-10T00:22:40.450140+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:PG 16.f is not active+clean 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452388+0000', 'last_change': '2024-06-10T00:22:40.452388+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452388+0000', 'last_undegraded': '2024-06-10T00:22:40.452388+0000', 'last_fullsized': '2024-06-10T00:22:40.452388+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:PG 16.10 is not active+clean 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.450517+0000', 'last_change': '2024-06-10T00:22:40.450517+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.450517+0000', 'last_undegraded': '2024-06-10T00:22:40.450517+0000', 'last_fullsized': '2024-06-10T00:22:40.450517+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:PG 16.12 is not active+clean 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.451845+0000', 'last_change': '2024-06-10T00:22:40.451845+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.451845+0000', 'last_undegraded': '2024-06-10T00:22:40.451845+0000', 'last_fullsized': '2024-06-10T00:22:40.451845+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:PG 16.13 is not active+clean 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.447119+0000', 'last_change': '2024-06-10T00:22:40.447119+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.447119+0000', 'last_undegraded': '2024-06-10T00:22:40.447119+0000', 'last_fullsized': '2024-06-10T00:22:40.447119+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:PG 16.14 is not active+clean 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452095+0000', 'last_change': '2024-06-10T00:22:40.452095+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452095+0000', 'last_undegraded': '2024-06-10T00:22:40.452095+0000', 'last_fullsized': '2024-06-10T00:22:40.452095+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:PG 16.15 is not active+clean 2024-06-10T00:22:45.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452817+0000', 'last_change': '2024-06-10T00:22:40.452817+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452817+0000', 'last_undegraded': '2024-06-10T00:22:40.452817+0000', 'last_fullsized': '2024-06-10T00:22:40.452817+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:PG 16.16 is not active+clean 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.453465+0000', 'last_change': '2024-06-10T00:22:40.453465+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.453465+0000', 'last_undegraded': '2024-06-10T00:22:40.453465+0000', 'last_fullsized': '2024-06-10T00:22:40.453465+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:PG 16.17 is not active+clean 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.448589+0000', 'last_change': '2024-06-10T00:22:40.448589+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.448589+0000', 'last_undegraded': '2024-06-10T00:22:40.448589+0000', 'last_fullsized': '2024-06-10T00:22:40.448589+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:PG 16.18 is not active+clean 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.455464+0000', 'last_change': '2024-06-10T00:22:40.455464+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.455464+0000', 'last_undegraded': '2024-06-10T00:22:40.455464+0000', 'last_fullsized': '2024-06-10T00:22:40.455464+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:PG 16.19 is not active+clean 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.445351+0000', 'last_change': '2024-06-10T00:22:40.445351+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.445351+0000', 'last_undegraded': '2024-06-10T00:22:40.445351+0000', 'last_fullsized': '2024-06-10T00:22:40.445351+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1a is not active+clean 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.452463+0000', 'last_change': '2024-06-10T00:22:40.452463+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.452463+0000', 'last_undegraded': '2024-06-10T00:22:40.452463+0000', 'last_fullsized': '2024-06-10T00:22:40.452463+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-10T00:22:45.130 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1b is not active+clean 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.447414+0000', 'last_change': '2024-06-10T00:22:40.447414+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.447414+0000', 'last_undegraded': '2024-06-10T00:22:40.447414+0000', 'last_fullsized': '2024-06-10T00:22:40.447414+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1c is not active+clean 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.449113+0000', 'last_change': '2024-06-10T00:22:40.449113+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.449113+0000', 'last_undegraded': '2024-06-10T00:22:40.449113+0000', 'last_fullsized': '2024-06-10T00:22:40.449113+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1d is not active+clean 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.447829+0000', 'last_change': '2024-06-10T00:22:40.447829+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.447829+0000', 'last_undegraded': '2024-06-10T00:22:40.447829+0000', 'last_fullsized': '2024-06-10T00:22:40.447829+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1e is not active+clean 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.448417+0000', 'last_change': '2024-06-10T00:22:40.448417+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.448417+0000', 'last_undegraded': '2024-06-10T00:22:40.448417+0000', 'last_fullsized': '2024-06-10T00:22:40.448417+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1f is not active+clean 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.446103+0000', 'last_change': '2024-06-10T00:22:40.446103+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.446103+0000', 'last_undegraded': '2024-06-10T00:22:40.446103+0000', 'last_fullsized': '2024-06-10T00:22:40.446103+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:PG 16.11 is not active+clean 2024-06-10T00:22:45.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-06-10T00:22:40.444598+0000', 'last_change': '2024-06-10T00:22:40.444598+0000', 'last_active': '2024-06-10T00:22:40.439121+0000', 'last_peered': '2024-06-10T00:22:40.439121+0000', 'last_clean': '2024-06-10T00:22:40.439121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-10T00:22:40.444598+0000', 'last_undegraded': '2024-06-10T00:22:40.444598+0000', 'last_fullsized': '2024-06-10T00:22:40.444598+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'last_clean_scrub_stamp': '2024-06-10T00:22:40.439121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-10T00:22:45.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-10T00:22:45.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.255+0000 7f098b196640 1 Processor -- start 2024-06-10T00:22:45.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.255+0000 7f098b196640 1 -- start start 2024-06-10T00:22:45.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f098b196640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09840711b0 0x7f098406f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f098b196640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f098415fd50 con 0x7f098415f970 2024-06-10T00:22:45.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f098b196640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09840ce3b0 con 0x7f098409b120 2024-06-10T00:22:45.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f098b196640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f098409b9c0 con 0x7f09840711b0 2024-06-10T00:22:45.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f0988f32640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f098415f970 0x7f098409aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34408/0 (socket says 172.21.15.79:34408) 2024-06-10T00:22:45.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f0988f32640 1 -- 172.21.15.79:0/378776554 learned_addr learned my addr 172.21.15.79:0/378776554 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1413272514 0 0) 0x7f0980001110 con 0x7f098415f970 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f096c003520 con 0x7f098415f970 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097bfff640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09840711b0 0x7f098406f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3418257234 0 0) 0x7f096c003520 con 0x7f098415f970 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09840711b0 msgr2=0x7f098406f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09840711b0 0x7f098406f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 >> v1:172.21.15.117:6789/0 conn(0x7f098409b120 legacy=0x7f098406f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09840708e0 con 0x7f098415f970 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f0980001840 con 0x7f098415f970 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 >> v1:172.21.15.79:6789/0 conn(0x7f098415f970 legacy=0x7f098409aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c0039e0 0x7f096c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f096c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.256+0000 7f097b7fe640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09840711b0 0x7f096c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f096c00ba70 con 0x7f096c004800 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f096c00bbf0 con 0x7f096c0039e0 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f096c00bdf0 con 0x7f09840711b0 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097bfff640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f096c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f0989733640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09840711b0 0x7f096c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f0988f32640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c0039e0 0x7f096c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097bfff640 1 -- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09840711b0 msgr2=0x7f096c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097bfff640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09840711b0 0x7f096c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097bfff640 1 -- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c0039e0 msgr2=0x7f096c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097bfff640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c0039e0 0x7f096c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f097bfff640 1 -- 172.21.15.79:0/378776554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c003520 con 0x7f096c004800 2024-06-10T00:22:45.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.257+0000 7f0988f32640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c0039e0 0x7f096c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:45.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f097bfff640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f096c004c80 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f0984071630 tx=0x7f096c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d015e94e5cbc0220 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:45.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974036070 con 0x7f096c004800 2024-06-10T00:22:45.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0974031400 con 0x7f096c004800 2024-06-10T00:22:45.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f097b7fe640 1 -- 172.21.15.79:0/378776554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974009690 con 0x7f096c004800 2024-06-10T00:22:45.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f098b196640 1 -- 172.21.15.79:0/378776554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 msgr2=0x7f096c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f098b196640 1 --2- 172.21.15.79:0/378776554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f096c004c80 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f0984071630 tx=0x7f096c005830 comp rx=0 tx=0).stop 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f0989733640 1 -- 172.21.15.79:0/378776554 reap_dead start 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f098b196640 1 -- 172.21.15.79:0/378776554 shutdown_connections 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f098b196640 1 -- 172.21.15.79:0/378776554 >> 172.21.15.79:0/378776554 conn(0x7f09840d1eb0 msgr2=0x7f09840d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f098b196640 1 -- 172.21.15.79:0/378776554 shutdown_connections 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.258+0000 7f098b196640 1 -- 172.21.15.79:0/378776554 wait complete. 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.259+0000 7f098b196640 1 Processor -- start 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.259+0000 7f098b196640 1 -- start start 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f098b196640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f098415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f098b196640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098409f020 0x7f098415e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f098b196640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098409f4a0 0x7f098415e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f098b196640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0984070d00 con 0x7f096c004800 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f098b196640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f09840d06c0 con 0x7f098409f4a0 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f098b196640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0984070e80 con 0x7f098409f020 2024-06-10T00:22:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f0988f32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f098415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f0988f32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f098415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35148/0 (socket says 172.21.15.79:35148) 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.260+0000 7f0988f32640 1 -- 172.21.15.79:0/1698690865 learned_addr learned my addr 172.21.15.79:0/1698690865 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f0988f32640 1 -- 172.21.15.79:0/1698690865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098409f020 msgr2=0x7f098415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f0988f32640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098409f020 0x7f098415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f0988f32640 1 -- 172.21.15.79:0/1698690865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098409f4a0 msgr2=0x7f098415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f0988f32640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098409f4a0 0x7f098415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f0988f32640 1 -- 172.21.15.79:0/1698690865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09841f57d0 con 0x7f096c004800 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f0988f32640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f098415a5e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f0980007390 tx=0x7f0980007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f09797fa640 1 -- 172.21.15.79:0/1698690865 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098000e870 con 0x7f096c004800 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f09797fa640 1 -- 172.21.15.79:0/1698690865 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0980018070 con 0x7f096c004800 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09841f5a70 con 0x7f096c004800 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f09797fa640 1 -- 172.21.15.79:0/1698690865 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098000ec10 con 0x7f096c004800 2024-06-10T00:22:45.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.261+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09841f6030 con 0x7f096c004800 2024-06-10T00:22:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.262+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0984068430 con 0x7f096c004800 2024-06-10T00:22:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.262+0000 7f09797fa640 1 -- 172.21.15.79:0/1698690865 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f098001d460 con 0x7f096c004800 2024-06-10T00:22:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.263+0000 7f09797fa640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097006be60 0x7f097006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.263+0000 7f09797fa640 1 -- 172.21.15.79:0/1698690865 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f098008af60 con 0x7f096c004800 2024-06-10T00:22:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.263+0000 7f097bfff640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097006be60 0x7f097006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.263+0000 7f097bfff640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097006be60 0x7f097006e320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0974033000 tx=0x7f097402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.267+0000 7f09797fa640 1 -- 172.21.15.79:0/1698690865 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f098415fd50 con 0x7f096c004800 2024-06-10T00:22:45.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.511+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f09840cd190 con 0x7f096c004800 2024-06-10T00:22:45.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.511+0000 7f09797fa640 1 -- 172.21.15.79:0/1698690865 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1197 (secure 0 0 0) 0x7f0980059780 con 0x7f096c004800 2024-06-10T00:22:45.512 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:45.512 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":506,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1717978470,"num_in_osds":8,"osd_in_since":1717978461,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":266735616,"bytes_avail":772827377664,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":68,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":7698}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-06-10T00:22:11.249070+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097006be60 msgr2=0x7f097006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097006be60 0x7f097006e320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0974033000 tx=0x7f097402e000 comp rx=0 tx=0).stop 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 msgr2=0x7f098415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f098415a5e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f0980007390 tx=0x7f0980007850 comp rx=0 tx=0).stop 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 shutdown_connections 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f097006be60 0x7f097006e320 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098409f4a0 0x7f098415e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098409f020 0x7f098415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 --2- 172.21.15.79:0/1698690865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f096c004800 0x7f098415a5e0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 >> 172.21.15.79:0/1698690865 conn(0x7f09840d1eb0 msgr2=0x7f09840b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 shutdown_connections 2024-06-10T00:22:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.513+0000 7f098b196640 1 -- 172.21.15.79:0/1698690865 wait complete. 2024-06-10T00:22:45.524 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-10T00:22:45.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:22:45.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.624+0000 7fab50b22640 1 Processor -- start 2024-06-10T00:22:45.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.624+0000 7fab50b22640 1 -- start start 2024-06-10T00:22:45.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.625+0000 7fab50b22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c06ebf0 0x7fab4c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.625+0000 7fab50b22640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab4c0cf190 0x7fab4c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.625+0000 7fab50b22640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4c0cf640 con 0x7fab4c0ae910 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.625+0000 7fab50b22640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fab4c06d130 con 0x7fab4c0cf190 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.625+0000 7fab50b22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fab4c06d410 con 0x7fab4c06ebf0 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab4ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab4c0cf190 0x7fab4c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab49d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c06ebf0 0x7fab4c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab4a59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fab4c0ae910 0x7fab4c06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:57784/0 (socket says 172.21.15.79:57784) 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab4ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab4c0cf190 0x7fab4c0acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:54680/0 (socket says 172.21.15.79:54680) 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab49d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c06ebf0 0x7fab4c0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50704/0 (socket says 172.21.15.79:50704) 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab4a59c640 1 -- 172.21.15.79:0/784874671 learned_addr learned my addr 172.21.15.79:0/784874671 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab4ad9d640 1 -- 172.21.15.79:0/784874671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c06ebf0 msgr2=0x7fab4c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab4ad9d640 1 --2- 172.21.15.79:0/784874671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c06ebf0 0x7fab4c0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab4ad9d640 1 -- 172.21.15.79:0/784874671 >> v1:172.21.15.117:6789/0 conn(0x7fab4c0ae910 legacy=0x7fab4c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab4ad9d640 1 -- 172.21.15.79:0/784874671 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c06d6f0 con 0x7fab4c0cf190 2024-06-10T00:22:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.626+0000 7fab49d9b640 1 --2- 172.21.15.79:0/784874671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c06ebf0 0x7fab4c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab4ad9d640 1 --2- 172.21.15.79:0/784874671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c0cf190 0x7fab4c0acd40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fab44009dc0 tx=0x7fab4402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef42be26d09cb3d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab4959a640 1 -- 172.21.15.79:0/784874671 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44007740 con 0x7fab4c0cf190 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab4959a640 1 -- 172.21.15.79:0/784874671 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab440078e0 con 0x7fab4c0cf190 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab4959a640 1 -- 172.21.15.79:0/784874671 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44007cb0 con 0x7fab4c0cf190 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab50b22640 1 -- 172.21.15.79:0/784874671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c0cf190 msgr2=0x7fab4c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab50b22640 1 --2- 172.21.15.79:0/784874671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c0cf190 0x7fab4c0acd40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fab44009dc0 tx=0x7fab4402a5f0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab50b22640 1 -- 172.21.15.79:0/784874671 shutdown_connections 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab50b22640 1 --2- 172.21.15.79:0/784874671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c0cf190 0x7fab4c0acd40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab50b22640 1 --2- 172.21.15.79:0/784874671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c06ebf0 0x7fab4c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.627+0000 7fab50b22640 1 -- 172.21.15.79:0/784874671 >> 172.21.15.79:0/784874671 conn(0x7fab4c0b19f0 msgr2=0x7fab4c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.628+0000 7fab50b22640 1 -- 172.21.15.79:0/784874671 shutdown_connections 2024-06-10T00:22:45.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.628+0000 7fab50b22640 1 -- 172.21.15.79:0/784874671 wait complete. 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.629+0000 7fab50b22640 1 Processor -- start 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.629+0000 7fab50b22640 1 -- start start 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab50b22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c06ebf0 0x7fab4c157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab50b22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c0ae910 0x7fab4c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab50b22640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c0cf190 0x7fab4c0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab50b22640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c0ad280 con 0x7fab4c0cf190 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab50b22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c0aecf0 con 0x7fab4c06ebf0 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab50b22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fab4c0ad400 con 0x7fab4c0ae910 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c0cf190 0x7fab4c0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c0cf190 0x7fab4c0b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35152/0 (socket says 172.21.15.79:35152) 2024-06-10T00:22:45.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 -- 172.21.15.79:0/693670714 learned_addr learned my addr 172.21.15.79:0/693670714 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab49d9b640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c0ae910 0x7fab4c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4a59c640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c06ebf0 0x7fab4c157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 -- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c0ae910 msgr2=0x7fab4c1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c0ae910 0x7fab4c1552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 -- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c06ebf0 msgr2=0x7fab4c157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c06ebf0 0x7fab4c157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 -- 172.21.15.79:0/693670714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c155a60 con 0x7fab4c0cf190 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab49d9b640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c0ae910 0x7fab4c1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab4ad9d640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c0cf190 0x7fab4c0b03c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fab4402abe0 tx=0x7fab44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab3affd640 1 -- 172.21.15.79:0/693670714 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44040070 con 0x7fab4c0cf190 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab3affd640 1 -- 172.21.15.79:0/693670714 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab44031c40 con 0x7fab4c0cf190 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c1f4550 con 0x7fab4c0cf190 2024-06-10T00:22:45.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab3affd640 1 -- 172.21.15.79:0/693670714 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44009450 con 0x7fab4c0cf190 2024-06-10T00:22:45.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.630+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c1f4b10 con 0x7fab4c0cf190 2024-06-10T00:22:45.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.631+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4c09c2b0 con 0x7fab4c0cf190 2024-06-10T00:22:45.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.632+0000 7fab3affd640 1 -- 172.21.15.79:0/693670714 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab44039040 con 0x7fab4c0cf190 2024-06-10T00:22:45.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.632+0000 7fab3affd640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab2c06be30 0x7fab2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:45.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.633+0000 7fab4a59c640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab2c06be30 0x7fab2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:45.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.633+0000 7fab3affd640 1 -- 172.21.15.79:0/693670714 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fab440ac890 con 0x7fab4c0cf190 2024-06-10T00:22:45.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.633+0000 7fab4a59c640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab2c06be30 0x7fab2c06e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fab4c09df10 tx=0x7fab3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:45.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.637+0000 7fab3affd640 1 -- 172.21.15.79:0/693670714 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fab4407b030 con 0x7fab4c0cf190 2024-06-10T00:22:45.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.805+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab4c0b21c0 con 0x7fab2c06be30 2024-06-10T00:22:45.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.810+0000 7fab3affd640 1 -- 172.21.15.79:0/693670714 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247090 (secure 0 0 0) 0x7fab4c0b21c0 con 0x7fab2c06be30 2024-06-10T00:22:45.814 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:45.815 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:22:45.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab2c06be30 msgr2=0x7fab2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab2c06be30 0x7fab2c06e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fab4c09df10 tx=0x7fab3c009040 comp rx=0 tx=0).stop 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c0cf190 msgr2=0x7fab4c0b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c0cf190 0x7fab4c0b03c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fab4402abe0 tx=0x7fab44004a40 comp rx=0 tx=0).stop 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 shutdown_connections 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fab2c06be30 0x7fab2c06e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c0cf190 0x7fab4c0b03c0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab4c0ae910 0x7fab4c1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 --2- 172.21.15.79:0/693670714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab4c06ebf0 0x7fab4c157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.813+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 >> 172.21.15.79:0/693670714 conn(0x7fab4c0b19f0 msgr2=0x7fab4c0d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.814+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 shutdown_connections 2024-06-10T00:22:45.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:45.814+0000 7fab50b22640 1 -- 172.21.15.79:0/693670714 wait complete. 2024-06-10T00:22:45.825 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-06-10T00:22:45.256240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260484,"kb_used_data":11012,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714236,"statfs":{"total":773094113280,"available":772827377664,"internally_reserved":0,"allocated":11276288,"data_stored":5841191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.816662"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453378+0000","last_change":"2024-06-10T00:22:40.453378+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453378+0000","last_undegraded":"2024-06-10T00:22:40.453378+0000","last_fullsized":"2024-06-10T00:22:40.453378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453738+0000","last_change":"2024-06-10T00:22:40.453738+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453738+0000","last_undegraded":"2024-06-10T00:22:40.453738+0000","last_fullsized":"2024-06-10T00:22:40.453738+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453610+0000","last_change":"2024-06-10T00:22:40.453610+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453610+0000","last_undegraded":"2024-06-10T00:22:40.453610+0000","last_fullsized":"2024-06-10T00:22:40.453610+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451659+0000","last_change":"2024-06-10T00:22:40.451659+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451659+0000","last_undegraded":"2024-06-10T00:22:40.451659+0000","last_fullsized":"2024-06-10T00:22:40.451659+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447665+0000","last_change":"2024-06-10T00:22:40.447665+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447665+0000","last_undegraded":"2024-06-10T00:22:40.447665+0000","last_fullsized":"2024-06-10T00:22:40.447665+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452521+0000","last_change":"2024-06-10T00:22:40.452521+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452521+0000","last_undegraded":"2024-06-10T00:22:40.452521+0000","last_fullsized":"2024-06-10T00:22:40.452521+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452200+0000","last_change":"2024-06-10T00:22:40.452200+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452200+0000","last_undegraded":"2024-06-10T00:22:40.452200+0000","last_fullsized":"2024-06-10T00:22:40.452200+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451364+0000","last_change":"2024-06-10T00:22:40.451364+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451364+0000","last_undegraded":"2024-06-10T00:22:40.451364+0000","last_fullsized":"2024-06-10T00:22:40.451364+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452776+0000","last_change":"2024-06-10T00:22:40.452776+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452776+0000","last_undegraded":"2024-06-10T00:22:40.452776+0000","last_fullsized":"2024-06-10T00:22:40.452776+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447237+0000","last_change":"2024-06-10T00:22:40.447237+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447237+0000","last_undegraded":"2024-06-10T00:22:40.447237+0000","last_fullsized":"2024-06-10T00:22:40.447237+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446588+0000","last_change":"2024-06-10T00:22:40.446588+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446588+0000","last_undegraded":"2024-06-10T00:22:40.446588+0000","last_fullsized":"2024-06-10T00:22:40.446588+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446567+0000","last_change":"2024-06-10T00:22:40.446567+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446567+0000","last_undegraded":"2024-06-10T00:22:40.446567+0000","last_fullsized":"2024-06-10T00:22:40.446567+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455589+0000","last_change":"2024-06-10T00:22:40.455589+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455589+0000","last_undegraded":"2024-06-10T00:22:40.455589+0000","last_fullsized":"2024-06-10T00:22:40.455589+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448757+0000","last_change":"2024-06-10T00:22:40.448757+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448757+0000","last_undegraded":"2024-06-10T00:22:40.448757+0000","last_fullsized":"2024-06-10T00:22:40.448757+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447882+0000","last_change":"2024-06-10T00:22:40.447882+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447882+0000","last_undegraded":"2024-06-10T00:22:40.447882+0000","last_fullsized":"2024-06-10T00:22:40.447882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448664+0000","last_change":"2024-06-10T00:22:40.448664+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448664+0000","last_undegraded":"2024-06-10T00:22:40.448664+0000","last_fullsized":"2024-06-10T00:22:40.448664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452849+0000","last_change":"2024-06-10T00:22:40.452849+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452849+0000","last_undegraded":"2024-06-10T00:22:40.452849+0000","last_fullsized":"2024-06-10T00:22:40.452849+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453321+0000","last_change":"2024-06-10T00:22:40.453321+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453321+0000","last_undegraded":"2024-06-10T00:22:40.453321+0000","last_fullsized":"2024-06-10T00:22:40.453321+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453224+0000","last_change":"2024-06-10T00:22:40.453224+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453224+0000","last_undegraded":"2024-06-10T00:22:40.453224+0000","last_fullsized":"2024-06-10T00:22:40.453224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446137+0000","last_change":"2024-06-10T00:22:40.446137+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446137+0000","last_undegraded":"2024-06-10T00:22:40.446137+0000","last_fullsized":"2024-06-10T00:22:40.446137+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451058+0000","last_change":"2024-06-10T00:22:40.451058+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451058+0000","last_undegraded":"2024-06-10T00:22:40.451058+0000","last_fullsized":"2024-06-10T00:22:40.451058+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447249+0000","last_change":"2024-06-10T00:22:40.447249+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447249+0000","last_undegraded":"2024-06-10T00:22:40.447249+0000","last_fullsized":"2024-06-10T00:22:40.447249+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451281+0000","last_change":"2024-06-10T00:22:40.451281+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451281+0000","last_undegraded":"2024-06-10T00:22:40.451281+0000","last_fullsized":"2024-06-10T00:22:40.451281+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447178+0000","last_change":"2024-06-10T00:22:40.447178+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447178+0000","last_undegraded":"2024-06-10T00:22:40.447178+0000","last_fullsized":"2024-06-10T00:22:40.447178+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445987+0000","last_change":"2024-06-10T00:22:40.445987+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445987+0000","last_undegraded":"2024-06-10T00:22:40.445987+0000","last_fullsized":"2024-06-10T00:22:40.445987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.444771+0000","last_change":"2024-06-10T00:22:40.444771+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.444771+0000","last_undegraded":"2024-06-10T00:22:40.444771+0000","last_fullsized":"2024-06-10T00:22:40.444771+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446154+0000","last_change":"2024-06-10T00:22:40.446154+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446154+0000","last_undegraded":"2024-06-10T00:22:40.446154+0000","last_fullsized":"2024-06-10T00:22:40.446154+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453937+0000","last_change":"2024-06-10T00:22:40.453937+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453937+0000","last_undegraded":"2024-06-10T00:22:40.453937+0000","last_fullsized":"2024-06-10T00:22:40.453937+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450597+0000","last_change":"2024-06-10T00:22:40.450597+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450597+0000","last_undegraded":"2024-06-10T00:22:40.450597+0000","last_fullsized":"2024-06-10T00:22:40.450597+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445568+0000","last_change":"2024-06-10T00:22:40.445568+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445568+0000","last_undegraded":"2024-06-10T00:22:40.445568+0000","last_fullsized":"2024-06-10T00:22:40.445568+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451664+0000","last_change":"2024-06-10T00:22:40.451664+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451664+0000","last_undegraded":"2024-06-10T00:22:40.451664+0000","last_fullsized":"2024-06-10T00:22:40.451664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450942+0000","last_change":"2024-06-10T00:22:40.450942+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450942+0000","last_undegraded":"2024-06-10T00:22:40.450942+0000","last_fullsized":"2024-06-10T00:22:40.450942+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.454640+0000","last_change":"2024-06-10T00:22:40.454640+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.454640+0000","last_undegraded":"2024-06-10T00:22:40.454640+0000","last_fullsized":"2024-06-10T00:22:40.454640+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465911+0000","last_change":"2024-06-10T00:22:40.464067+0000","last_active":"2024-06-10T00:22:40.465911+0000","last_peered":"2024-06-10T00:22:40.465911+0000","last_clean":"2024-06-10T00:22:40.465911+0000","last_became_active":"2024-06-10T00:22:40.463201+0000","last_became_peered":"2024-06-10T00:22:40.463201+0000","last_unstale":"2024-06-10T00:22:40.465911+0000","last_undegraded":"2024-06-10T00:22:40.465911+0000","last_fullsized":"2024-06-10T00:22:40.465911+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:21:18.421656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448819+0000","last_change":"2024-06-10T00:22:40.448819+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448819+0000","last_undegraded":"2024-06-10T00:22:40.448819+0000","last_fullsized":"2024-06-10T00:22:40.448819+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.464968+0000","last_change":"2024-06-10T00:22:40.459474+0000","last_active":"2024-06-10T00:22:40.464968+0000","last_peered":"2024-06-10T00:22:40.464968+0000","last_clean":"2024-06-10T00:22:40.464968+0000","last_became_active":"2024-06-10T00:22:40.459104+0000","last_became_peered":"2024-06-10T00:22:40.459104+0000","last_unstale":"2024-06-10T00:22:40.464968+0000","last_undegraded":"2024-06-10T00:22:40.464968+0000","last_fullsized":"2024-06-10T00:22:40.464968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:33:31.007804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445077+0000","last_change":"2024-06-10T00:22:40.445077+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445077+0000","last_undegraded":"2024-06-10T00:22:40.445077+0000","last_fullsized":"2024-06-10T00:22:40.445077+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462178+0000","last_change":"2024-06-10T00:22:40.459372+0000","last_active":"2024-06-10T00:22:40.462178+0000","last_peered":"2024-06-10T00:22:40.462178+0000","last_clean":"2024-06-10T00:22:40.462178+0000","last_became_active":"2024-06-10T00:22:40.456763+0000","last_became_peered":"2024-06-10T00:22:40.456763+0000","last_unstale":"2024-06-10T00:22:40.462178+0000","last_undegraded":"2024-06-10T00:22:40.462178+0000","last_fullsized":"2024-06-10T00:22:40.462178+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446568+0000","last_change":"2024-06-10T00:22:40.446568+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446568+0000","last_undegraded":"2024-06-10T00:22:40.446568+0000","last_fullsized":"2024-06-10T00:22:40.446568+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460758+0000","last_change":"2024-06-10T00:22:40.458499+0000","last_active":"2024-06-10T00:22:40.460758+0000","last_peered":"2024-06-10T00:22:40.460758+0000","last_clean":"2024-06-10T00:22:40.460758+0000","last_became_active":"2024-06-10T00:22:40.458216+0000","last_became_peered":"2024-06-10T00:22:40.458216+0000","last_unstale":"2024-06-10T00:22:40.460758+0000","last_undegraded":"2024-06-10T00:22:40.460758+0000","last_fullsized":"2024-06-10T00:22:40.460758+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:52:36.829097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451227+0000","last_change":"2024-06-10T00:22:40.451227+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451227+0000","last_undegraded":"2024-06-10T00:22:40.451227+0000","last_fullsized":"2024-06-10T00:22:40.451227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.457112+0000","last_change":"2024-06-10T00:22:40.455292+0000","last_active":"2024-06-10T00:22:40.457112+0000","last_peered":"2024-06-10T00:22:40.457112+0000","last_clean":"2024-06-10T00:22:40.457112+0000","last_became_active":"2024-06-10T00:22:40.455011+0000","last_became_peered":"2024-06-10T00:22:40.455011+0000","last_unstale":"2024-06-10T00:22:40.457112+0000","last_undegraded":"2024-06-10T00:22:40.457112+0000","last_fullsized":"2024-06-10T00:22:40.457112+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:13.197903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452127+0000","last_change":"2024-06-10T00:22:40.452127+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452127+0000","last_undegraded":"2024-06-10T00:22:40.452127+0000","last_fullsized":"2024-06-10T00:22:40.452127+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.456928+0000","last_change":"2024-06-10T00:22:40.453019+0000","last_active":"2024-06-10T00:22:40.456928+0000","last_peered":"2024-06-10T00:22:40.456928+0000","last_clean":"2024-06-10T00:22:40.456928+0000","last_became_active":"2024-06-10T00:22:40.452738+0000","last_became_peered":"2024-06-10T00:22:40.452738+0000","last_unstale":"2024-06-10T00:22:40.456928+0000","last_undegraded":"2024-06-10T00:22:40.456928+0000","last_fullsized":"2024-06-10T00:22:40.456928+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:57:14.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452619+0000","last_change":"2024-06-10T00:22:40.452619+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452619+0000","last_undegraded":"2024-06-10T00:22:40.452619+0000","last_fullsized":"2024-06-10T00:22:40.452619+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458402+0000","last_change":"2024-06-10T00:22:40.454657+0000","last_active":"2024-06-10T00:22:40.458402+0000","last_peered":"2024-06-10T00:22:40.458402+0000","last_clean":"2024-06-10T00:22:40.458402+0000","last_became_active":"2024-06-10T00:22:40.454398+0000","last_became_peered":"2024-06-10T00:22:40.454398+0000","last_unstale":"2024-06-10T00:22:40.458402+0000","last_undegraded":"2024-06-10T00:22:40.458402+0000","last_fullsized":"2024-06-10T00:22:40.458402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:19:39.853903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.456370+0000","last_change":"2024-06-10T00:22:40.456370+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.456370+0000","last_undegraded":"2024-06-10T00:22:40.456370+0000","last_fullsized":"2024-06-10T00:22:40.456370+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.464034+0000","last_change":"2024-06-10T00:22:40.461992+0000","last_active":"2024-06-10T00:22:40.464034+0000","last_peered":"2024-06-10T00:22:40.464034+0000","last_clean":"2024-06-10T00:22:40.464034+0000","last_became_active":"2024-06-10T00:22:40.461700+0000","last_became_peered":"2024-06-10T00:22:40.461700+0000","last_unstale":"2024-06-10T00:22:40.464034+0000","last_undegraded":"2024-06-10T00:22:40.464034+0000","last_fullsized":"2024-06-10T00:22:40.464034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:33:07.654120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455105+0000","last_change":"2024-06-10T00:22:40.455105+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455105+0000","last_undegraded":"2024-06-10T00:22:40.455105+0000","last_fullsized":"2024-06-10T00:22:40.455105+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458470+0000","last_change":"2024-06-10T00:22:40.455913+0000","last_active":"2024-06-10T00:22:40.458470+0000","last_peered":"2024-06-10T00:22:40.458470+0000","last_clean":"2024-06-10T00:22:40.458470+0000","last_became_active":"2024-06-10T00:22:40.455625+0000","last_became_peered":"2024-06-10T00:22:40.455625+0000","last_unstale":"2024-06-10T00:22:40.458470+0000","last_undegraded":"2024-06-10T00:22:40.458470+0000","last_fullsized":"2024-06-10T00:22:40.458470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446750+0000","last_change":"2024-06-10T00:22:40.446750+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446750+0000","last_undegraded":"2024-06-10T00:22:40.446750+0000","last_fullsized":"2024-06-10T00:22:40.446750+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465800+0000","last_change":"2024-06-10T00:22:40.463696+0000","last_active":"2024-06-10T00:22:40.465800+0000","last_peered":"2024-06-10T00:22:40.465800+0000","last_clean":"2024-06-10T00:22:40.465800+0000","last_became_active":"2024-06-10T00:22:40.463375+0000","last_became_peered":"2024-06-10T00:22:40.463375+0000","last_unstale":"2024-06-10T00:22:40.465800+0000","last_undegraded":"2024-06-10T00:22:40.465800+0000","last_fullsized":"2024-06-10T00:22:40.465800+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:06:16.483344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448537+0000","last_change":"2024-06-10T00:22:40.448537+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448537+0000","last_undegraded":"2024-06-10T00:22:40.448537+0000","last_fullsized":"2024-06-10T00:22:40.448537+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467797+0000","last_change":"2024-06-10T00:22:40.463539+0000","last_active":"2024-06-10T00:22:40.467797+0000","last_peered":"2024-06-10T00:22:40.467797+0000","last_clean":"2024-06-10T00:22:40.467797+0000","last_became_active":"2024-06-10T00:22:40.463229+0000","last_became_peered":"2024-06-10T00:22:40.463229+0000","last_unstale":"2024-06-10T00:22:40.467797+0000","last_undegraded":"2024-06-10T00:22:40.467797+0000","last_fullsized":"2024-06-10T00:22:40.467797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:07.961320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446602+0000","last_change":"2024-06-10T00:22:40.446602+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446602+0000","last_undegraded":"2024-06-10T00:22:40.446602+0000","last_fullsized":"2024-06-10T00:22:40.446602+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.468033+0000","last_change":"2024-06-10T00:22:40.465693+0000","last_active":"2024-06-10T00:22:40.468033+0000","last_peered":"2024-06-10T00:22:40.468033+0000","last_clean":"2024-06-10T00:22:40.468033+0000","last_became_active":"2024-06-10T00:22:40.465452+0000","last_became_peered":"2024-06-10T00:22:40.465452+0000","last_unstale":"2024-06-10T00:22:40.468033+0000","last_undegraded":"2024-06-10T00:22:40.468033+0000","last_fullsized":"2024-06-10T00:22:40.468033+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:03:33.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445894+0000","last_change":"2024-06-10T00:22:40.445894+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445894+0000","last_undegraded":"2024-06-10T00:22:40.445894+0000","last_fullsized":"2024-06-10T00:22:40.445894+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460056+0000","last_change":"2024-06-10T00:22:40.456048+0000","last_active":"2024-06-10T00:22:40.460056+0000","last_peered":"2024-06-10T00:22:40.460056+0000","last_clean":"2024-06-10T00:22:40.460056+0000","last_became_active":"2024-06-10T00:22:40.455788+0000","last_became_peered":"2024-06-10T00:22:40.455788+0000","last_unstale":"2024-06-10T00:22:40.460056+0000","last_undegraded":"2024-06-10T00:22:40.460056+0000","last_fullsized":"2024-06-10T00:22:40.460056+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452484+0000","last_change":"2024-06-10T00:22:40.452484+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452484+0000","last_undegraded":"2024-06-10T00:22:40.452484+0000","last_fullsized":"2024-06-10T00:22:40.452484+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.463737+0000","last_change":"2024-06-10T00:22:40.458861+0000","last_active":"2024-06-10T00:22:40.463737+0000","last_peered":"2024-06-10T00:22:40.463737+0000","last_clean":"2024-06-10T00:22:40.463737+0000","last_became_active":"2024-06-10T00:22:40.458585+0000","last_became_peered":"2024-06-10T00:22:40.458585+0000","last_unstale":"2024-06-10T00:22:40.463737+0000","last_undegraded":"2024-06-10T00:22:40.463737+0000","last_fullsized":"2024-06-10T00:22:40.463737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450140+0000","last_change":"2024-06-10T00:22:40.450140+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450140+0000","last_undegraded":"2024-06-10T00:22:40.450140+0000","last_fullsized":"2024-06-10T00:22:40.450140+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465695+0000","last_change":"2024-06-10T00:22:40.460616+0000","last_active":"2024-06-10T00:22:40.465695+0000","last_peered":"2024-06-10T00:22:40.465695+0000","last_clean":"2024-06-10T00:22:40.465695+0000","last_became_active":"2024-06-10T00:22:40.460359+0000","last_became_peered":"2024-06-10T00:22:40.460359+0000","last_unstale":"2024-06-10T00:22:40.465695+0000","last_undegraded":"2024-06-10T00:22:40.465695+0000","last_fullsized":"2024-06-10T00:22:40.465695+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:52:06.207600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452388+0000","last_change":"2024-06-10T00:22:40.452388+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452388+0000","last_undegraded":"2024-06-10T00:22:40.452388+0000","last_fullsized":"2024-06-10T00:22:40.452388+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458372+0000","last_change":"2024-06-10T00:22:40.451127+0000","last_active":"2024-06-10T00:22:40.458372+0000","last_peered":"2024-06-10T00:22:40.458372+0000","last_clean":"2024-06-10T00:22:40.458372+0000","last_became_active":"2024-06-10T00:22:40.450861+0000","last_became_peered":"2024-06-10T00:22:40.450861+0000","last_unstale":"2024-06-10T00:22:40.458372+0000","last_undegraded":"2024-06-10T00:22:40.458372+0000","last_fullsized":"2024-06-10T00:22:40.458372+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:03:33.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.450517+0000","last_change":"2024-06-10T00:22:40.450517+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.450517+0000","last_undegraded":"2024-06-10T00:22:40.450517+0000","last_fullsized":"2024-06-10T00:22:40.450517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462598+0000","last_change":"2024-06-10T00:22:40.459091+0000","last_active":"2024-06-10T00:22:40.462598+0000","last_peered":"2024-06-10T00:22:40.462598+0000","last_clean":"2024-06-10T00:22:40.462598+0000","last_became_active":"2024-06-10T00:22:40.458813+0000","last_became_peered":"2024-06-10T00:22:40.458813+0000","last_unstale":"2024-06-10T00:22:40.462598+0000","last_undegraded":"2024-06-10T00:22:40.462598+0000","last_fullsized":"2024-06-10T00:22:40.462598+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:43:56.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.451845+0000","last_change":"2024-06-10T00:22:40.451845+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.451845+0000","last_undegraded":"2024-06-10T00:22:40.451845+0000","last_fullsized":"2024-06-10T00:22:40.451845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462663+0000","last_change":"2024-06-10T00:22:40.460540+0000","last_active":"2024-06-10T00:22:40.462663+0000","last_peered":"2024-06-10T00:22:40.462663+0000","last_clean":"2024-06-10T00:22:40.462663+0000","last_became_active":"2024-06-10T00:22:40.460239+0000","last_became_peered":"2024-06-10T00:22:40.460239+0000","last_unstale":"2024-06-10T00:22:40.462663+0000","last_undegraded":"2024-06-10T00:22:40.462663+0000","last_fullsized":"2024-06-10T00:22:40.462663+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:41.291107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447119+0000","last_change":"2024-06-10T00:22:40.447119+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447119+0000","last_undegraded":"2024-06-10T00:22:40.447119+0000","last_fullsized":"2024-06-10T00:22:40.447119+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.459704+0000","last_change":"2024-06-10T00:22:40.457983+0000","last_active":"2024-06-10T00:22:40.459704+0000","last_peered":"2024-06-10T00:22:40.459704+0000","last_clean":"2024-06-10T00:22:40.459704+0000","last_became_active":"2024-06-10T00:22:40.457713+0000","last_became_peered":"2024-06-10T00:22:40.457713+0000","last_unstale":"2024-06-10T00:22:40.459704+0000","last_undegraded":"2024-06-10T00:22:40.459704+0000","last_fullsized":"2024-06-10T00:22:40.459704+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452095+0000","last_change":"2024-06-10T00:22:40.452095+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452095+0000","last_undegraded":"2024-06-10T00:22:40.452095+0000","last_fullsized":"2024-06-10T00:22:40.452095+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465729+0000","last_change":"2024-06-10T00:22:40.464715+0000","last_active":"2024-06-10T00:22:40.465729+0000","last_peered":"2024-06-10T00:22:40.465729+0000","last_clean":"2024-06-10T00:22:40.465729+0000","last_became_active":"2024-06-10T00:22:40.464434+0000","last_became_peered":"2024-06-10T00:22:40.464434+0000","last_unstale":"2024-06-10T00:22:40.465729+0000","last_undegraded":"2024-06-10T00:22:40.465729+0000","last_fullsized":"2024-06-10T00:22:40.465729+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:12:48.174973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452817+0000","last_change":"2024-06-10T00:22:40.452817+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452817+0000","last_undegraded":"2024-06-10T00:22:40.452817+0000","last_fullsized":"2024-06-10T00:22:40.452817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.461851+0000","last_change":"2024-06-10T00:22:40.458231+0000","last_active":"2024-06-10T00:22:40.461851+0000","last_peered":"2024-06-10T00:22:40.461851+0000","last_clean":"2024-06-10T00:22:40.461851+0000","last_became_active":"2024-06-10T00:22:40.457959+0000","last_became_peered":"2024-06-10T00:22:40.457959+0000","last_unstale":"2024-06-10T00:22:40.461851+0000","last_undegraded":"2024-06-10T00:22:40.461851+0000","last_fullsized":"2024-06-10T00:22:40.461851+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:09:58.753457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.453465+0000","last_change":"2024-06-10T00:22:40.453465+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.453465+0000","last_undegraded":"2024-06-10T00:22:40.453465+0000","last_fullsized":"2024-06-10T00:22:40.453465+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.462888+0000","last_change":"2024-06-10T00:22:40.461887+0000","last_active":"2024-06-10T00:22:40.462888+0000","last_peered":"2024-06-10T00:22:40.462888+0000","last_clean":"2024-06-10T00:22:40.462888+0000","last_became_active":"2024-06-10T00:22:40.461591+0000","last_became_peered":"2024-06-10T00:22:40.461591+0000","last_unstale":"2024-06-10T00:22:40.462888+0000","last_undegraded":"2024-06-10T00:22:40.462888+0000","last_fullsized":"2024-06-10T00:22:40.462888+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:13:12.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448589+0000","last_change":"2024-06-10T00:22:40.448589+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448589+0000","last_undegraded":"2024-06-10T00:22:40.448589+0000","last_fullsized":"2024-06-10T00:22:40.448589+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.468529+0000","last_change":"2024-06-10T00:22:40.465440+0000","last_active":"2024-06-10T00:22:40.468529+0000","last_peered":"2024-06-10T00:22:40.468529+0000","last_clean":"2024-06-10T00:22:40.468529+0000","last_became_active":"2024-06-10T00:22:40.465137+0000","last_became_peered":"2024-06-10T00:22:40.465137+0000","last_unstale":"2024-06-10T00:22:40.468529+0000","last_undegraded":"2024-06-10T00:22:40.468529+0000","last_fullsized":"2024-06-10T00:22:40.468529+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:36:26.012841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.455464+0000","last_change":"2024-06-10T00:22:40.455464+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.455464+0000","last_undegraded":"2024-06-10T00:22:40.455464+0000","last_fullsized":"2024-06-10T00:22:40.455464+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.460024+0000","last_change":"2024-06-10T00:22:40.455370+0000","last_active":"2024-06-10T00:22:40.460024+0000","last_peered":"2024-06-10T00:22:40.460024+0000","last_clean":"2024-06-10T00:22:40.460024+0000","last_became_active":"2024-06-10T00:22:40.455076+0000","last_became_peered":"2024-06-10T00:22:40.455076+0000","last_unstale":"2024-06-10T00:22:40.460024+0000","last_undegraded":"2024-06-10T00:22:40.460024+0000","last_fullsized":"2024-06-10T00:22:40.460024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.445351+0000","last_change":"2024-06-10T00:22:40.445351+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.445351+0000","last_undegraded":"2024-06-10T00:22:40.445351+0000","last_fullsized":"2024-06-10T00:22:40.445351+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465773+0000","last_change":"2024-06-10T00:22:40.463082+0000","last_active":"2024-06-10T00:22:40.465773+0000","last_peered":"2024-06-10T00:22:40.465773+0000","last_clean":"2024-06-10T00:22:40.465773+0000","last_became_active":"2024-06-10T00:22:40.462736+0000","last_became_peered":"2024-06-10T00:22:40.462736+0000","last_unstale":"2024-06-10T00:22:40.465773+0000","last_undegraded":"2024-06-10T00:22:40.465773+0000","last_fullsized":"2024-06-10T00:22:40.465773+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:28:31.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.452463+0000","last_change":"2024-06-10T00:22:40.452463+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.452463+0000","last_undegraded":"2024-06-10T00:22:40.452463+0000","last_fullsized":"2024-06-10T00:22:40.452463+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467724+0000","last_change":"2024-06-10T00:22:40.463965+0000","last_active":"2024-06-10T00:22:40.467724+0000","last_peered":"2024-06-10T00:22:40.467724+0000","last_clean":"2024-06-10T00:22:40.467724+0000","last_became_active":"2024-06-10T00:22:40.463632+0000","last_became_peered":"2024-06-10T00:22:40.463632+0000","last_unstale":"2024-06-10T00:22:40.467724+0000","last_undegraded":"2024-06-10T00:22:40.467724+0000","last_fullsized":"2024-06-10T00:22:40.467724+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:35:34.739817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447414+0000","last_change":"2024-06-10T00:22:40.447414+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447414+0000","last_undegraded":"2024-06-10T00:22:40.447414+0000","last_fullsized":"2024-06-10T00:22:40.447414+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465194+0000","last_change":"2024-06-10T00:22:40.460576+0000","last_active":"2024-06-10T00:22:40.465194+0000","last_peered":"2024-06-10T00:22:40.465194+0000","last_clean":"2024-06-10T00:22:40.465194+0000","last_became_active":"2024-06-10T00:22:40.460296+0000","last_became_peered":"2024-06-10T00:22:40.460296+0000","last_unstale":"2024-06-10T00:22:40.465194+0000","last_undegraded":"2024-06-10T00:22:40.465194+0000","last_fullsized":"2024-06-10T00:22:40.465194+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:18:24.160240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.449113+0000","last_change":"2024-06-10T00:22:40.449113+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.449113+0000","last_undegraded":"2024-06-10T00:22:40.449113+0000","last_fullsized":"2024-06-10T00:22:40.449113+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.458443+0000","last_change":"2024-06-10T00:22:40.455011+0000","last_active":"2024-06-10T00:22:40.458443+0000","last_peered":"2024-06-10T00:22:40.458443+0000","last_clean":"2024-06-10T00:22:40.458443+0000","last_became_active":"2024-06-10T00:22:40.454696+0000","last_became_peered":"2024-06-10T00:22:40.454696+0000","last_unstale":"2024-06-10T00:22:40.458443+0000","last_undegraded":"2024-06-10T00:22:40.458443+0000","last_fullsized":"2024-06-10T00:22:40.458443+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:17.523826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.447829+0000","last_change":"2024-06-10T00:22:40.447829+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.447829+0000","last_undegraded":"2024-06-10T00:22:40.447829+0000","last_fullsized":"2024-06-10T00:22:40.447829+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465648+0000","last_change":"2024-06-10T00:22:40.459986+0000","last_active":"2024-06-10T00:22:40.465648+0000","last_peered":"2024-06-10T00:22:40.465648+0000","last_clean":"2024-06-10T00:22:40.465648+0000","last_became_active":"2024-06-10T00:22:40.459717+0000","last_became_peered":"2024-06-10T00:22:40.459717+0000","last_unstale":"2024-06-10T00:22:40.465648+0000","last_undegraded":"2024-06-10T00:22:40.465648+0000","last_fullsized":"2024-06-10T00:22:40.465648+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:37:04.035878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.448417+0000","last_change":"2024-06-10T00:22:40.448417+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.448417+0000","last_undegraded":"2024-06-10T00:22:40.448417+0000","last_fullsized":"2024-06-10T00:22:40.448417+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.467755+0000","last_change":"2024-06-10T00:22:40.464220+0000","last_active":"2024-06-10T00:22:40.467755+0000","last_peered":"2024-06-10T00:22:40.467755+0000","last_clean":"2024-06-10T00:22:40.467755+0000","last_became_active":"2024-06-10T00:22:40.463898+0000","last_became_peered":"2024-06-10T00:22:40.463898+0000","last_unstale":"2024-06-10T00:22:40.467755+0000","last_undegraded":"2024-06-10T00:22:40.467755+0000","last_fullsized":"2024-06-10T00:22:40.467755+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:44:06.871558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.446103+0000","last_change":"2024-06-10T00:22:40.446103+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.446103+0000","last_undegraded":"2024-06-10T00:22:40.446103+0000","last_fullsized":"2024-06-10T00:22:40.446103+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465703+0000","last_change":"2024-06-10T00:22:40.461880+0000","last_active":"2024-06-10T00:22:40.465703+0000","last_peered":"2024-06-10T00:22:40.465703+0000","last_clean":"2024-06-10T00:22:40.465703+0000","last_became_active":"2024-06-10T00:22:40.461170+0000","last_became_peered":"2024-06-10T00:22:40.461170+0000","last_unstale":"2024-06-10T00:22:40.465703+0000","last_undegraded":"2024-06-10T00:22:40.465703+0000","last_fullsized":"2024-06-10T00:22:40.465703+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T00:45:21.663165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-06-10T00:22:40.444598+0000","last_change":"2024-06-10T00:22:40.444598+0000","last_active":"2024-06-10T00:22:40.439121+0000","last_peered":"2024-06-10T00:22:40.439121+0000","last_clean":"2024-06-10T00:22:40.439121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-10T00:22:40.444598+0000","last_undegraded":"2024-06-10T00:22:40.444598+0000","last_fullsized":"2024-06-10T00:22:40.444598+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.465752+0000","last_change":"2024-06-10T00:22:40.464744+0000","last_active":"2024-06-10T00:22:40.465752+0000","last_peered":"2024-06-10T00:22:40.465752+0000","last_clean":"2024-06-10T00:22:40.465752+0000","last_became_active":"2024-06-10T00:22:40.464450+0000","last_became_peered":"2024-06-10T00:22:40.464450+0000","last_unstale":"2024-06-10T00:22:40.465752+0000","last_undegraded":"2024-06-10T00:22:40.465752+0000","last_fullsized":"2024-06-10T00:22:40.465752+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:51:52.443257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":319,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-06-10T00:22:40.448897+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:22:40.448897+0000","last_peered":"2024-06-10T00:22:40.448897+0000","last_clean":"2024-06-10T00:22:40.448897+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:22:40.448897+0000","last_undegraded":"2024-06-10T00:22:40.448897+0000","last_fullsized":"2024-06-10T00:22:40.448897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1175425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":585057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1859584,"data_stored":1175425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:22:48.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:22:48.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.941+0000 7f28eb438640 1 Processor -- start 2024-06-10T00:22:48.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.941+0000 7f28eb438640 1 -- start start 2024-06-10T00:22:48.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28eb438640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28e4156830 0x7f28e4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:48.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28eb438640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28e4072130 0x7f28e40cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:48.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28eb438640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415c7f0 0x7f28e40ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28eb438640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f28e40b3090 con 0x7f28e4072130 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28eb438640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f28e40725f0 con 0x7f28e4156830 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28eb438640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28e40728d0 con 0x7f28e415c7f0 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28e89d3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28e4072130 0x7f28e40cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28e89d3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28e4072130 0x7f28e40cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49178/0 (socket says 172.21.15.79:49178) 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.942+0000 7f28e89d3640 1 -- 172.21.15.79:0/2745186346 learned_addr learned my addr 172.21.15.79:0/2745186346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e99d5640 1 --2- 172.21.15.79:0/2745186346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415c7f0 0x7f28e40ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e89d3640 1 -- 172.21.15.79:0/2745186346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415c7f0 msgr2=0x7f28e40ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e91d4640 1 --2- 172.21.15.79:0/2745186346 >> v2:172.21.15.117:3300/0 conn(0x7f28e4156830 0x7f28e4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e89d3640 1 --2- 172.21.15.79:0/2745186346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415c7f0 0x7f28e40ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e89d3640 1 -- 172.21.15.79:0/2745186346 >> v2:172.21.15.117:3300/0 conn(0x7f28e4156830 msgr2=0x7f28e4071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e89d3640 1 --2- 172.21.15.79:0/2745186346 >> v2:172.21.15.117:3300/0 conn(0x7f28e4156830 0x7f28e4071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:48.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e89d3640 1 -- 172.21.15.79:0/2745186346 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e4072bb0 con 0x7f28e4072130 2024-06-10T00:22:48.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e99d5640 1 --2- 172.21.15.79:0/2745186346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415c7f0 0x7f28e40ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:48.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e91d4640 1 --2- 172.21.15.79:0/2745186346 >> v2:172.21.15.117:3300/0 conn(0x7f28e4156830 0x7f28e4071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.943+0000 7f28e89d3640 1 --2- 172.21.15.79:0/2745186346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4072130 0x7f28e40cc670 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f28e4070cb0 tx=0x7f28d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503faf5649234b6b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28dbfff640 1 -- 172.21.15.79:0/2745186346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4037070 con 0x7f28e4072130 2024-06-10T00:22:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28dbfff640 1 -- 172.21.15.79:0/2745186346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4032440 con 0x7f28e4072130 2024-06-10T00:22:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28dbfff640 1 -- 172.21.15.79:0/2745186346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4032810 con 0x7f28e4072130 2024-06-10T00:22:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 -- 172.21.15.79:0/2745186346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4072130 msgr2=0x7f28e40cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 --2- 172.21.15.79:0/2745186346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4072130 0x7f28e40cc670 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f28e4070cb0 tx=0x7f28d402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:22:48.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 -- 172.21.15.79:0/2745186346 shutdown_connections 2024-06-10T00:22:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 --2- 172.21.15.79:0/2745186346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415c7f0 0x7f28e40ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 --2- 172.21.15.79:0/2745186346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4072130 0x7f28e40cc670 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 --2- 172.21.15.79:0/2745186346 >> v2:172.21.15.117:3300/0 conn(0x7f28e4156830 0x7f28e4071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 -- 172.21.15.79:0/2745186346 >> 172.21.15.79:0/2745186346 conn(0x7f28e40b19f0 msgr2=0x7f28e40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 -- 172.21.15.79:0/2745186346 shutdown_connections 2024-06-10T00:22:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.944+0000 7f28eb438640 1 -- 172.21.15.79:0/2745186346 wait complete. 2024-06-10T00:22:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28eb438640 1 Processor -- start 2024-06-10T00:22:48.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28eb438640 1 -- start start 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28eb438640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4072130 0x7f28e40cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28eb438640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4156830 0x7f28e41525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28eb438640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e415c7f0 0x7f28e4152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28eb438640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28e40b36a0 con 0x7f28e4156830 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28eb438640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28e40b3520 con 0x7f28e415c7f0 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28eb438640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28e40b3820 con 0x7f28e4072130 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28e89d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4156830 0x7f28e41525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28e89d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4156830 0x7f28e41525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49190/0 (socket says 172.21.15.79:49190) 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.946+0000 7f28e89d3640 1 -- 172.21.15.79:0/2406590723 learned_addr learned my addr 172.21.15.79:0/2406590723 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:48.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28e91d4640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4072130 0x7f28e40cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28e99d5640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e415c7f0 0x7f28e4152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28e89d3640 1 -- 172.21.15.79:0/2406590723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4072130 msgr2=0x7f28e40cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28e89d3640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4072130 0x7f28e40cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28e89d3640 1 -- 172.21.15.79:0/2406590723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e415c7f0 msgr2=0x7f28e4152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28e89d3640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e415c7f0 0x7f28e4152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28e89d3640 1 -- 172.21.15.79:0/2406590723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e414fda0 con 0x7f28e4156830 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28e89d3640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4156830 0x7f28e41525a0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f28d402a220 tx=0x7f28d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28d9ffb640 1 -- 172.21.15.79:0/2406590723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4037040 con 0x7f28e4156830 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28d9ffb640 1 -- 172.21.15.79:0/2406590723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4042070 con 0x7f28e4156830 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e4150080 con 0x7f28e4156830 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28d9ffb640 1 -- 172.21.15.79:0/2406590723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4030bb0 con 0x7f28e4156830 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.947+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e4150640 con 0x7f28e4156830 2024-06-10T00:22:48.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.948+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e4068430 con 0x7f28e4156830 2024-06-10T00:22:48.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.949+0000 7f28d9ffb640 1 -- 172.21.15.79:0/2406590723 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28d4047460 con 0x7f28e4156830 2024-06-10T00:22:48.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.949+0000 7f28d9ffb640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be30 0x7f28c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:48.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.949+0000 7f28d9ffb640 1 -- 172.21.15.79:0/2406590723 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f28d40abbd0 con 0x7f28e4156830 2024-06-10T00:22:48.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.949+0000 7f28e91d4640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be30 0x7f28c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:48.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.950+0000 7f28e91d4640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be30 0x7f28c806e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f28e409d6d0 tx=0x7f28e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:48.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:48.954+0000 7f28d9ffb640 1 -- 172.21.15.79:0/2406590723 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f28d4045360 con 0x7f28e4156830 2024-06-10T00:22:49.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.122+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28e40713b0 con 0x7f28c806be30 2024-06-10T00:22:49.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.128+0000 7f28d9ffb640 1 -- 172.21.15.79:0/2406590723 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7f28e40713b0 con 0x7f28c806be30 2024-06-10T00:22:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:49.133 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:22:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be30 msgr2=0x7f28c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be30 0x7f28c806e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f28e409d6d0 tx=0x7f28e0008040 comp rx=0 tx=0).stop 2024-06-10T00:22:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4156830 msgr2=0x7f28e41525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4156830 0x7f28e41525a0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f28d402a220 tx=0x7f28d40046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 shutdown_connections 2024-06-10T00:22:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28c806be30 0x7f28c806e2f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e415c7f0 0x7f28e4152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4156830 0x7f28e41525a0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 --2- 172.21.15.79:0/2406590723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4072130 0x7f28e40cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 >> 172.21.15.79:0/2406590723 conn(0x7f28e40b19f0 msgr2=0x7f28e40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 shutdown_connections 2024-06-10T00:22:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.131+0000 7f28eb438640 1 -- 172.21.15.79:0/2406590723 wait complete. 2024-06-10T00:22:49.142 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-06-10T00:22:47.256610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260752,"kb_used_data":11304,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713968,"statfs":{"total":773094113280,"available":772827103232,"internally_reserved":0,"allocated":11575296,"data_stored":5976884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.814515"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472481+0000","last_change":"2024-06-10T00:22:41.476376+0000","last_active":"2024-06-10T00:22:42.472481+0000","last_peered":"2024-06-10T00:22:42.472481+0000","last_clean":"2024-06-10T00:22:42.472481+0000","last_became_active":"2024-06-10T00:22:41.476057+0000","last_became_peered":"2024-06-10T00:22:41.476057+0000","last_unstale":"2024-06-10T00:22:42.472481+0000","last_undegraded":"2024-06-10T00:22:42.472481+0000","last_fullsized":"2024-06-10T00:22:42.472481+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:09.260613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.948147+0000","last_change":"2024-06-10T00:22:41.472111+0000","last_active":"2024-06-10T00:22:42.948147+0000","last_peered":"2024-06-10T00:22:42.948147+0000","last_clean":"2024-06-10T00:22:42.948147+0000","last_became_active":"2024-06-10T00:22:41.471827+0000","last_became_peered":"2024-06-10T00:22:41.471827+0000","last_unstale":"2024-06-10T00:22:42.948147+0000","last_undegraded":"2024-06-10T00:22:42.948147+0000","last_fullsized":"2024-06-10T00:22:42.948147+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:45:47.340561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472376+0000","last_change":"2024-06-10T00:22:41.481842+0000","last_active":"2024-06-10T00:22:42.472376+0000","last_peered":"2024-06-10T00:22:42.472376+0000","last_clean":"2024-06-10T00:22:42.472376+0000","last_became_active":"2024-06-10T00:22:41.481550+0000","last_became_peered":"2024-06-10T00:22:41.481550+0000","last_unstale":"2024-06-10T00:22:42.472376+0000","last_undegraded":"2024-06-10T00:22:42.472376+0000","last_fullsized":"2024-06-10T00:22:42.472376+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:54:54.175079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103295+0000","last_change":"2024-06-10T00:22:41.465259+0000","last_active":"2024-06-10T00:22:43.103295+0000","last_peered":"2024-06-10T00:22:43.103295+0000","last_clean":"2024-06-10T00:22:43.103295+0000","last_became_active":"2024-06-10T00:22:41.464990+0000","last_became_peered":"2024-06-10T00:22:41.464990+0000","last_unstale":"2024-06-10T00:22:43.103295+0000","last_undegraded":"2024-06-10T00:22:43.103295+0000","last_fullsized":"2024-06-10T00:22:43.103295+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:34:50.519945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458121+0000","last_change":"2024-06-10T00:22:41.463786+0000","last_active":"2024-06-10T00:22:42.458121+0000","last_peered":"2024-06-10T00:22:42.458121+0000","last_clean":"2024-06-10T00:22:42.458121+0000","last_became_active":"2024-06-10T00:22:41.463321+0000","last_became_peered":"2024-06-10T00:22:41.463321+0000","last_unstale":"2024-06-10T00:22:42.458121+0000","last_undegraded":"2024-06-10T00:22:42.458121+0000","last_fullsized":"2024-06-10T00:22:42.458121+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:30.166964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.947653+0000","last_change":"2024-06-10T00:22:41.471227+0000","last_active":"2024-06-10T00:22:42.947653+0000","last_peered":"2024-06-10T00:22:42.947653+0000","last_clean":"2024-06-10T00:22:42.947653+0000","last_became_active":"2024-06-10T00:22:41.470940+0000","last_became_peered":"2024-06-10T00:22:41.470940+0000","last_unstale":"2024-06-10T00:22:42.947653+0000","last_undegraded":"2024-06-10T00:22:42.947653+0000","last_fullsized":"2024-06-10T00:22:42.947653+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:30.166964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.947575+0000","last_change":"2024-06-10T00:22:41.473471+0000","last_active":"2024-06-10T00:22:42.947575+0000","last_peered":"2024-06-10T00:22:42.947575+0000","last_clean":"2024-06-10T00:22:42.947575+0000","last_became_active":"2024-06-10T00:22:41.473196+0000","last_became_peered":"2024-06-10T00:22:41.473196+0000","last_unstale":"2024-06-10T00:22:42.947575+0000","last_undegraded":"2024-06-10T00:22:42.947575+0000","last_fullsized":"2024-06-10T00:22:42.947575+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:08.967526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.546832+0000","last_change":"2024-06-10T00:22:41.470635+0000","last_active":"2024-06-10T00:22:42.546832+0000","last_peered":"2024-06-10T00:22:42.546832+0000","last_clean":"2024-06-10T00:22:42.546832+0000","last_became_active":"2024-06-10T00:22:41.468731+0000","last_became_peered":"2024-06-10T00:22:41.468731+0000","last_unstale":"2024-06-10T00:22:42.546832+0000","last_undegraded":"2024-06-10T00:22:42.546832+0000","last_fullsized":"2024-06-10T00:22:42.546832+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:56:42.213565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.948121+0000","last_change":"2024-06-10T00:22:41.475046+0000","last_active":"2024-06-10T00:22:42.948121+0000","last_peered":"2024-06-10T00:22:42.948121+0000","last_clean":"2024-06-10T00:22:42.948121+0000","last_became_active":"2024-06-10T00:22:41.474779+0000","last_became_peered":"2024-06-10T00:22:41.474779+0000","last_unstale":"2024-06-10T00:22:42.948121+0000","last_undegraded":"2024-06-10T00:22:42.948121+0000","last_fullsized":"2024-06-10T00:22:42.948121+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:27:31.046958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458261+0000","last_change":"2024-06-10T00:22:41.476453+0000","last_active":"2024-06-10T00:22:42.458261+0000","last_peered":"2024-06-10T00:22:42.458261+0000","last_clean":"2024-06-10T00:22:42.458261+0000","last_became_active":"2024-06-10T00:22:41.476188+0000","last_became_peered":"2024-06-10T00:22:41.476188+0000","last_unstale":"2024-06-10T00:22:42.458261+0000","last_undegraded":"2024-06-10T00:22:42.458261+0000","last_fullsized":"2024-06-10T00:22:42.458261+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:27:31.046958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459139+0000","last_change":"2024-06-10T00:22:41.474060+0000","last_active":"2024-06-10T00:22:42.459139+0000","last_peered":"2024-06-10T00:22:42.459139+0000","last_clean":"2024-06-10T00:22:42.459139+0000","last_became_active":"2024-06-10T00:22:41.473777+0000","last_became_peered":"2024-06-10T00:22:41.473777+0000","last_unstale":"2024-06-10T00:22:42.459139+0000","last_undegraded":"2024-06-10T00:22:42.459139+0000","last_fullsized":"2024-06-10T00:22:42.459139+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:27:31.046958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459603+0000","last_change":"2024-06-10T00:22:41.467018+0000","last_active":"2024-06-10T00:22:42.459603+0000","last_peered":"2024-06-10T00:22:42.459603+0000","last_clean":"2024-06-10T00:22:42.459603+0000","last_became_active":"2024-06-10T00:22:41.466754+0000","last_became_peered":"2024-06-10T00:22:41.466754+0000","last_unstale":"2024-06-10T00:22:42.459603+0000","last_undegraded":"2024-06-10T00:22:42.459603+0000","last_fullsized":"2024-06-10T00:22:42.459603+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:32:37.953701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103244+0000","last_change":"2024-06-10T00:22:41.467698+0000","last_active":"2024-06-10T00:22:43.103244+0000","last_peered":"2024-06-10T00:22:43.103244+0000","last_clean":"2024-06-10T00:22:43.103244+0000","last_became_active":"2024-06-10T00:22:41.467409+0000","last_became_peered":"2024-06-10T00:22:41.467409+0000","last_unstale":"2024-06-10T00:22:43.103244+0000","last_undegraded":"2024-06-10T00:22:43.103244+0000","last_fullsized":"2024-06-10T00:22:43.103244+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:45:47.340561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103239+0000","last_change":"2024-06-10T00:22:41.470408+0000","last_active":"2024-06-10T00:22:43.103239+0000","last_peered":"2024-06-10T00:22:43.103239+0000","last_clean":"2024-06-10T00:22:43.103239+0000","last_became_active":"2024-06-10T00:22:41.470069+0000","last_became_peered":"2024-06-10T00:22:41.470069+0000","last_unstale":"2024-06-10T00:22:43.103239+0000","last_undegraded":"2024-06-10T00:22:43.103239+0000","last_fullsized":"2024-06-10T00:22:43.103239+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:07:04.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103246+0000","last_change":"2024-06-10T00:22:41.475778+0000","last_active":"2024-06-10T00:22:43.103246+0000","last_peered":"2024-06-10T00:22:43.103246+0000","last_clean":"2024-06-10T00:22:43.103246+0000","last_became_active":"2024-06-10T00:22:41.475469+0000","last_became_peered":"2024-06-10T00:22:41.475469+0000","last_unstale":"2024-06-10T00:22:43.103246+0000","last_undegraded":"2024-06-10T00:22:43.103246+0000","last_fullsized":"2024-06-10T00:22:43.103246+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:27.463504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103434+0000","last_change":"2024-06-10T00:22:41.471441+0000","last_active":"2024-06-10T00:22:43.103434+0000","last_peered":"2024-06-10T00:22:43.103434+0000","last_clean":"2024-06-10T00:22:43.103434+0000","last_became_active":"2024-06-10T00:22:41.471167+0000","last_became_peered":"2024-06-10T00:22:41.471167+0000","last_unstale":"2024-06-10T00:22:43.103434+0000","last_undegraded":"2024-06-10T00:22:43.103434+0000","last_fullsized":"2024-06-10T00:22:43.103434+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:23.340905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472587+0000","last_change":"2024-06-10T00:22:41.482486+0000","last_active":"2024-06-10T00:22:42.472587+0000","last_peered":"2024-06-10T00:22:42.472587+0000","last_clean":"2024-06-10T00:22:42.472587+0000","last_became_active":"2024-06-10T00:22:41.482246+0000","last_became_peered":"2024-06-10T00:22:41.482246+0000","last_unstale":"2024-06-10T00:22:42.472587+0000","last_undegraded":"2024-06-10T00:22:42.472587+0000","last_fullsized":"2024-06-10T00:22:42.472587+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:00:31.807299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.948185+0000","last_change":"2024-06-10T00:22:41.480502+0000","last_active":"2024-06-10T00:22:42.948185+0000","last_peered":"2024-06-10T00:22:42.948185+0000","last_clean":"2024-06-10T00:22:42.948185+0000","last_became_active":"2024-06-10T00:22:41.480155+0000","last_became_peered":"2024-06-10T00:22:41.480155+0000","last_unstale":"2024-06-10T00:22:42.948185+0000","last_undegraded":"2024-06-10T00:22:42.948185+0000","last_fullsized":"2024-06-10T00:22:42.948185+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:27.463504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472500+0000","last_change":"2024-06-10T00:22:41.483679+0000","last_active":"2024-06-10T00:22:42.472500+0000","last_peered":"2024-06-10T00:22:42.472500+0000","last_clean":"2024-06-10T00:22:42.472500+0000","last_became_active":"2024-06-10T00:22:41.483401+0000","last_became_peered":"2024-06-10T00:22:41.483401+0000","last_unstale":"2024-06-10T00:22:42.472500+0000","last_undegraded":"2024-06-10T00:22:42.472500+0000","last_fullsized":"2024-06-10T00:22:42.472500+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:59:44.782936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459627+0000","last_change":"2024-06-10T00:22:41.468164+0000","last_active":"2024-06-10T00:22:42.459627+0000","last_peered":"2024-06-10T00:22:42.459627+0000","last_clean":"2024-06-10T00:22:42.459627+0000","last_became_active":"2024-06-10T00:22:41.467902+0000","last_became_peered":"2024-06-10T00:22:41.467902+0000","last_unstale":"2024-06-10T00:22:42.459627+0000","last_undegraded":"2024-06-10T00:22:42.459627+0000","last_fullsized":"2024-06-10T00:22:42.459627+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:27:31.046958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547145+0000","last_change":"2024-06-10T00:22:41.475009+0000","last_active":"2024-06-10T00:22:42.547145+0000","last_peered":"2024-06-10T00:22:42.547145+0000","last_clean":"2024-06-10T00:22:42.547145+0000","last_became_active":"2024-06-10T00:22:41.474722+0000","last_became_peered":"2024-06-10T00:22:41.474722+0000","last_unstale":"2024-06-10T00:22:42.547145+0000","last_undegraded":"2024-06-10T00:22:42.547145+0000","last_fullsized":"2024-06-10T00:22:42.547145+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:38:06.335675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458135+0000","last_change":"2024-06-10T00:22:41.460807+0000","last_active":"2024-06-10T00:22:42.458135+0000","last_peered":"2024-06-10T00:22:42.458135+0000","last_clean":"2024-06-10T00:22:42.458135+0000","last_became_active":"2024-06-10T00:22:41.460540+0000","last_became_peered":"2024-06-10T00:22:41.460540+0000","last_unstale":"2024-06-10T00:22:42.458135+0000","last_undegraded":"2024-06-10T00:22:42.458135+0000","last_fullsized":"2024-06-10T00:22:42.458135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:34.864080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472286+0000","last_change":"2024-06-10T00:22:41.480570+0000","last_active":"2024-06-10T00:22:42.472286+0000","last_peered":"2024-06-10T00:22:42.472286+0000","last_clean":"2024-06-10T00:22:42.472286+0000","last_became_active":"2024-06-10T00:22:41.480309+0000","last_became_peered":"2024-06-10T00:22:41.480309+0000","last_unstale":"2024-06-10T00:22:42.472286+0000","last_undegraded":"2024-06-10T00:22:42.472286+0000","last_fullsized":"2024-06-10T00:22:42.472286+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:57:57.008323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458009+0000","last_change":"2024-06-10T00:22:41.478757+0000","last_active":"2024-06-10T00:22:42.458009+0000","last_peered":"2024-06-10T00:22:42.458009+0000","last_clean":"2024-06-10T00:22:42.458009+0000","last_became_active":"2024-06-10T00:22:41.478384+0000","last_became_peered":"2024-06-10T00:22:41.478384+0000","last_unstale":"2024-06-10T00:22:42.458009+0000","last_undegraded":"2024-06-10T00:22:42.458009+0000","last_fullsized":"2024-06-10T00:22:42.458009+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:08.967526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458622+0000","last_change":"2024-06-10T00:22:41.466407+0000","last_active":"2024-06-10T00:22:42.458622+0000","last_peered":"2024-06-10T00:22:42.458622+0000","last_clean":"2024-06-10T00:22:42.458622+0000","last_became_active":"2024-06-10T00:22:41.466089+0000","last_became_peered":"2024-06-10T00:22:41.466089+0000","last_unstale":"2024-06-10T00:22:42.458622+0000","last_undegraded":"2024-06-10T00:22:42.458622+0000","last_fullsized":"2024-06-10T00:22:42.458622+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:42.297313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458807+0000","last_change":"2024-06-10T00:22:41.474379+0000","last_active":"2024-06-10T00:22:42.458807+0000","last_peered":"2024-06-10T00:22:42.458807+0000","last_clean":"2024-06-10T00:22:42.458807+0000","last_became_active":"2024-06-10T00:22:41.473997+0000","last_became_peered":"2024-06-10T00:22:41.473997+0000","last_unstale":"2024-06-10T00:22:42.458807+0000","last_undegraded":"2024-06-10T00:22:42.458807+0000","last_fullsized":"2024-06-10T00:22:42.458807+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:01:08.967526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459318+0000","last_change":"2024-06-10T00:22:41.475283+0000","last_active":"2024-06-10T00:22:42.459318+0000","last_peered":"2024-06-10T00:22:42.459318+0000","last_clean":"2024-06-10T00:22:42.459318+0000","last_became_active":"2024-06-10T00:22:41.474984+0000","last_became_peered":"2024-06-10T00:22:41.474984+0000","last_unstale":"2024-06-10T00:22:42.459318+0000","last_undegraded":"2024-06-10T00:22:42.459318+0000","last_fullsized":"2024-06-10T00:22:42.459318+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:45:47.340561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.947780+0000","last_change":"2024-06-10T00:22:41.473153+0000","last_active":"2024-06-10T00:22:42.947780+0000","last_peered":"2024-06-10T00:22:42.947780+0000","last_clean":"2024-06-10T00:22:42.947780+0000","last_became_active":"2024-06-10T00:22:41.472172+0000","last_became_peered":"2024-06-10T00:22:41.472172+0000","last_unstale":"2024-06-10T00:22:42.947780+0000","last_undegraded":"2024-06-10T00:22:42.947780+0000","last_fullsized":"2024-06-10T00:22:42.947780+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:34.864080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547260+0000","last_change":"2024-06-10T00:22:41.475722+0000","last_active":"2024-06-10T00:22:42.547260+0000","last_peered":"2024-06-10T00:22:42.547260+0000","last_clean":"2024-06-10T00:22:42.547260+0000","last_became_active":"2024-06-10T00:22:41.475417+0000","last_became_peered":"2024-06-10T00:22:41.475417+0000","last_unstale":"2024-06-10T00:22:42.547260+0000","last_undegraded":"2024-06-10T00:22:42.547260+0000","last_fullsized":"2024-06-10T00:22:42.547260+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:42:41.319115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459476+0000","last_change":"2024-06-10T00:22:41.464805+0000","last_active":"2024-06-10T00:22:42.459476+0000","last_peered":"2024-06-10T00:22:42.459476+0000","last_clean":"2024-06-10T00:22:42.459476+0000","last_became_active":"2024-06-10T00:22:41.464507+0000","last_became_peered":"2024-06-10T00:22:41.464507+0000","last_unstale":"2024-06-10T00:22:42.459476+0000","last_undegraded":"2024-06-10T00:22:42.459476+0000","last_fullsized":"2024-06-10T00:22:42.459476+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:30.166964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.947590+0000","last_change":"2024-06-10T00:22:41.485610+0000","last_active":"2024-06-10T00:22:42.947590+0000","last_peered":"2024-06-10T00:22:42.947590+0000","last_clean":"2024-06-10T00:22:42.947590+0000","last_became_active":"2024-06-10T00:22:41.485374+0000","last_became_peered":"2024-06-10T00:22:41.485374+0000","last_unstale":"2024-06-10T00:22:42.947590+0000","last_undegraded":"2024-06-10T00:22:42.947590+0000","last_fullsized":"2024-06-10T00:22:42.947590+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:33:21.707875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.546870+0000","last_change":"2024-06-10T00:22:41.467884+0000","last_active":"2024-06-10T00:22:42.546870+0000","last_peered":"2024-06-10T00:22:42.546870+0000","last_clean":"2024-06-10T00:22:42.546870+0000","last_became_active":"2024-06-10T00:22:41.467653+0000","last_became_peered":"2024-06-10T00:22:41.467653+0000","last_unstale":"2024-06-10T00:22:42.546870+0000","last_undegraded":"2024-06-10T00:22:42.546870+0000","last_fullsized":"2024-06-10T00:22:42.546870+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:04:32.530536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472403+0000","last_change":"2024-06-10T00:22:41.474803+0000","last_active":"2024-06-10T00:22:42.472403+0000","last_peered":"2024-06-10T00:22:42.472403+0000","last_clean":"2024-06-10T00:22:42.472403+0000","last_became_active":"2024-06-10T00:22:41.474509+0000","last_became_peered":"2024-06-10T00:22:41.474509+0000","last_unstale":"2024-06-10T00:22:42.472403+0000","last_undegraded":"2024-06-10T00:22:42.472403+0000","last_fullsized":"2024-06-10T00:22:42.472403+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:51.433282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"103'4","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103320+0000","last_change":"2024-06-10T00:22:40.464067+0000","last_active":"2024-06-10T00:22:43.103320+0000","last_peered":"2024-06-10T00:22:43.103320+0000","last_clean":"2024-06-10T00:22:43.103320+0000","last_became_active":"2024-06-10T00:22:40.463201+0000","last_became_peered":"2024-06-10T00:22:40.463201+0000","last_unstale":"2024-06-10T00:22:43.103320+0000","last_undegraded":"2024-06-10T00:22:43.103320+0000","last_fullsized":"2024-06-10T00:22:43.103320+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:55:20.196120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.546889+0000","last_change":"2024-06-10T00:22:41.477376+0000","last_active":"2024-06-10T00:22:42.546889+0000","last_peered":"2024-06-10T00:22:42.546889+0000","last_clean":"2024-06-10T00:22:42.546889+0000","last_became_active":"2024-06-10T00:22:41.477110+0000","last_became_peered":"2024-06-10T00:22:41.477110+0000","last_unstale":"2024-06-10T00:22:42.546889+0000","last_undegraded":"2024-06-10T00:22:42.546889+0000","last_fullsized":"2024-06-10T00:22:42.546889+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:17:23.339924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547194+0000","last_change":"2024-06-10T00:22:40.459474+0000","last_active":"2024-06-10T00:22:42.547194+0000","last_peered":"2024-06-10T00:22:42.547194+0000","last_clean":"2024-06-10T00:22:42.547194+0000","last_became_active":"2024-06-10T00:22:40.459104+0000","last_became_peered":"2024-06-10T00:22:40.459104+0000","last_unstale":"2024-06-10T00:22:42.547194+0000","last_undegraded":"2024-06-10T00:22:42.547194+0000","last_fullsized":"2024-06-10T00:22:42.547194+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:14:44.459904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459533+0000","last_change":"2024-06-10T00:22:41.467183+0000","last_active":"2024-06-10T00:22:42.459533+0000","last_peered":"2024-06-10T00:22:42.459533+0000","last_clean":"2024-06-10T00:22:42.459533+0000","last_became_active":"2024-06-10T00:22:41.466905+0000","last_became_peered":"2024-06-10T00:22:41.466905+0000","last_unstale":"2024-06-10T00:22:42.459533+0000","last_undegraded":"2024-06-10T00:22:42.459533+0000","last_fullsized":"2024-06-10T00:22:42.459533+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:34.864080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458664+0000","last_change":"2024-06-10T00:22:40.459372+0000","last_active":"2024-06-10T00:22:42.458664+0000","last_peered":"2024-06-10T00:22:42.458664+0000","last_clean":"2024-06-10T00:22:42.458664+0000","last_became_active":"2024-06-10T00:22:40.456763+0000","last_became_peered":"2024-06-10T00:22:40.456763+0000","last_unstale":"2024-06-10T00:22:42.458664+0000","last_undegraded":"2024-06-10T00:22:42.458664+0000","last_fullsized":"2024-06-10T00:22:42.458664+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:23:55.448554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459468+0000","last_change":"2024-06-10T00:22:41.463348+0000","last_active":"2024-06-10T00:22:42.459468+0000","last_peered":"2024-06-10T00:22:42.459468+0000","last_clean":"2024-06-10T00:22:42.459468+0000","last_became_active":"2024-06-10T00:22:41.462866+0000","last_became_peered":"2024-06-10T00:22:41.462866+0000","last_unstale":"2024-06-10T00:22:42.459468+0000","last_undegraded":"2024-06-10T00:22:42.459468+0000","last_fullsized":"2024-06-10T00:22:42.459468+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:27.463504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458205+0000","last_change":"2024-06-10T00:22:40.458499+0000","last_active":"2024-06-10T00:22:42.458205+0000","last_peered":"2024-06-10T00:22:42.458205+0000","last_clean":"2024-06-10T00:22:42.458205+0000","last_became_active":"2024-06-10T00:22:40.458216+0000","last_became_peered":"2024-06-10T00:22:40.458216+0000","last_unstale":"2024-06-10T00:22:42.458205+0000","last_undegraded":"2024-06-10T00:22:42.458205+0000","last_fullsized":"2024-06-10T00:22:42.458205+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:23:55.448554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103386+0000","last_change":"2024-06-10T00:22:41.468869+0000","last_active":"2024-06-10T00:22:43.103386+0000","last_peered":"2024-06-10T00:22:43.103386+0000","last_clean":"2024-06-10T00:22:43.103386+0000","last_became_active":"2024-06-10T00:22:41.468584+0000","last_became_peered":"2024-06-10T00:22:41.468584+0000","last_unstale":"2024-06-10T00:22:43.103386+0000","last_undegraded":"2024-06-10T00:22:43.103386+0000","last_fullsized":"2024-06-10T00:22:43.103386+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:23.340905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103286+0000","last_change":"2024-06-10T00:22:40.455292+0000","last_active":"2024-06-10T00:22:43.103286+0000","last_peered":"2024-06-10T00:22:43.103286+0000","last_clean":"2024-06-10T00:22:43.103286+0000","last_became_active":"2024-06-10T00:22:40.455011+0000","last_became_peered":"2024-06-10T00:22:40.455011+0000","last_unstale":"2024-06-10T00:22:43.103286+0000","last_undegraded":"2024-06-10T00:22:43.103286+0000","last_fullsized":"2024-06-10T00:22:43.103286+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:33:20.701669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472604+0000","last_change":"2024-06-10T00:22:41.483138+0000","last_active":"2024-06-10T00:22:42.472604+0000","last_peered":"2024-06-10T00:22:42.472604+0000","last_clean":"2024-06-10T00:22:42.472604+0000","last_became_active":"2024-06-10T00:22:41.482886+0000","last_became_peered":"2024-06-10T00:22:41.482886+0000","last_unstale":"2024-06-10T00:22:42.472604+0000","last_undegraded":"2024-06-10T00:22:42.472604+0000","last_fullsized":"2024-06-10T00:22:42.472604+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:03:19.341437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458462+0000","last_change":"2024-06-10T00:22:40.453019+0000","last_active":"2024-06-10T00:22:42.458462+0000","last_peered":"2024-06-10T00:22:42.458462+0000","last_clean":"2024-06-10T00:22:42.458462+0000","last_became_active":"2024-06-10T00:22:40.452738+0000","last_became_peered":"2024-06-10T00:22:40.452738+0000","last_unstale":"2024-06-10T00:22:42.458462+0000","last_undegraded":"2024-06-10T00:22:42.458462+0000","last_fullsized":"2024-06-10T00:22:42.458462+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:21:18.421656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.948292+0000","last_change":"2024-06-10T00:22:41.471504+0000","last_active":"2024-06-10T00:22:42.948292+0000","last_peered":"2024-06-10T00:22:42.948292+0000","last_clean":"2024-06-10T00:22:42.948292+0000","last_became_active":"2024-06-10T00:22:41.471199+0000","last_became_peered":"2024-06-10T00:22:41.471199+0000","last_unstale":"2024-06-10T00:22:42.948292+0000","last_undegraded":"2024-06-10T00:22:42.948292+0000","last_fullsized":"2024-06-10T00:22:42.948292+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:07:04.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458982+0000","last_change":"2024-06-10T00:22:40.454657+0000","last_active":"2024-06-10T00:22:42.458982+0000","last_peered":"2024-06-10T00:22:42.458982+0000","last_clean":"2024-06-10T00:22:42.458982+0000","last_became_active":"2024-06-10T00:22:40.454398+0000","last_became_peered":"2024-06-10T00:22:40.454398+0000","last_unstale":"2024-06-10T00:22:42.458982+0000","last_undegraded":"2024-06-10T00:22:42.458982+0000","last_fullsized":"2024-06-10T00:22:42.458982+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:18:24.160240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103368+0000","last_change":"2024-06-10T00:22:41.476456+0000","last_active":"2024-06-10T00:22:43.103368+0000","last_peered":"2024-06-10T00:22:43.103368+0000","last_clean":"2024-06-10T00:22:43.103368+0000","last_became_active":"2024-06-10T00:22:41.476193+0000","last_became_peered":"2024-06-10T00:22:41.476193+0000","last_unstale":"2024-06-10T00:22:43.103368+0000","last_undegraded":"2024-06-10T00:22:43.103368+0000","last_fullsized":"2024-06-10T00:22:43.103368+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:07:04.844011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103095+0000","last_change":"2024-06-10T00:22:40.461992+0000","last_active":"2024-06-10T00:22:43.103095+0000","last_peered":"2024-06-10T00:22:43.103095+0000","last_clean":"2024-06-10T00:22:43.103095+0000","last_became_active":"2024-06-10T00:22:40.461700+0000","last_became_peered":"2024-06-10T00:22:40.461700+0000","last_unstale":"2024-06-10T00:22:43.103095+0000","last_undegraded":"2024-06-10T00:22:43.103095+0000","last_fullsized":"2024-06-10T00:22:43.103095+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:08:24.295036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472240+0000","last_change":"2024-06-10T00:22:41.483606+0000","last_active":"2024-06-10T00:22:42.472240+0000","last_peered":"2024-06-10T00:22:42.472240+0000","last_clean":"2024-06-10T00:22:42.472240+0000","last_became_active":"2024-06-10T00:22:41.483343+0000","last_became_peered":"2024-06-10T00:22:41.483343+0000","last_unstale":"2024-06-10T00:22:42.472240+0000","last_undegraded":"2024-06-10T00:22:42.472240+0000","last_fullsized":"2024-06-10T00:22:42.472240+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:10:04.447256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458730+0000","last_change":"2024-06-10T00:22:40.455913+0000","last_active":"2024-06-10T00:22:42.458730+0000","last_peered":"2024-06-10T00:22:42.458730+0000","last_clean":"2024-06-10T00:22:42.458730+0000","last_became_active":"2024-06-10T00:22:40.455625+0000","last_became_peered":"2024-06-10T00:22:40.455625+0000","last_unstale":"2024-06-10T00:22:42.458730+0000","last_undegraded":"2024-06-10T00:22:42.458730+0000","last_fullsized":"2024-06-10T00:22:42.458730+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:57:14.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458056+0000","last_change":"2024-06-10T00:22:41.470393+0000","last_active":"2024-06-10T00:22:42.458056+0000","last_peered":"2024-06-10T00:22:42.458056+0000","last_clean":"2024-06-10T00:22:42.458056+0000","last_became_active":"2024-06-10T00:22:41.470112+0000","last_became_peered":"2024-06-10T00:22:41.470112+0000","last_unstale":"2024-06-10T00:22:42.458056+0000","last_undegraded":"2024-06-10T00:22:42.458056+0000","last_fullsized":"2024-06-10T00:22:42.458056+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:33:21.707875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472344+0000","last_change":"2024-06-10T00:22:40.463696+0000","last_active":"2024-06-10T00:22:42.472344+0000","last_peered":"2024-06-10T00:22:42.472344+0000","last_clean":"2024-06-10T00:22:42.472344+0000","last_became_active":"2024-06-10T00:22:40.463375+0000","last_became_peered":"2024-06-10T00:22:40.463375+0000","last_unstale":"2024-06-10T00:22:42.472344+0000","last_undegraded":"2024-06-10T00:22:42.472344+0000","last_fullsized":"2024-06-10T00:22:42.472344+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:33:22.185148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.546986+0000","last_change":"2024-06-10T00:22:41.470978+0000","last_active":"2024-06-10T00:22:42.546986+0000","last_peered":"2024-06-10T00:22:42.546986+0000","last_clean":"2024-06-10T00:22:42.546986+0000","last_became_active":"2024-06-10T00:22:41.468684+0000","last_became_peered":"2024-06-10T00:22:41.468684+0000","last_unstale":"2024-06-10T00:22:42.546986+0000","last_undegraded":"2024-06-10T00:22:42.546986+0000","last_fullsized":"2024-06-10T00:22:42.546986+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:13:28.308792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"103'3","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103324+0000","last_change":"2024-06-10T00:22:40.463539+0000","last_active":"2024-06-10T00:22:43.103324+0000","last_peered":"2024-06-10T00:22:43.103324+0000","last_clean":"2024-06-10T00:22:43.103324+0000","last_became_active":"2024-06-10T00:22:40.463229+0000","last_became_peered":"2024-06-10T00:22:40.463229+0000","last_unstale":"2024-06-10T00:22:43.103324+0000","last_undegraded":"2024-06-10T00:22:43.103324+0000","last_fullsized":"2024-06-10T00:22:43.103324+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:29.160758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458372+0000","last_change":"2024-06-10T00:22:41.471154+0000","last_active":"2024-06-10T00:22:42.458372+0000","last_peered":"2024-06-10T00:22:42.458372+0000","last_clean":"2024-06-10T00:22:42.458372+0000","last_became_active":"2024-06-10T00:22:41.469736+0000","last_became_peered":"2024-06-10T00:22:41.469736+0000","last_unstale":"2024-06-10T00:22:42.458372+0000","last_undegraded":"2024-06-10T00:22:42.458372+0000","last_fullsized":"2024-06-10T00:22:42.458372+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:45:47.340561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"103'6","reported_seq":20,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.947924+0000","last_change":"2024-06-10T00:22:40.465693+0000","last_active":"2024-06-10T00:22:42.947924+0000","last_peered":"2024-06-10T00:22:42.947924+0000","last_clean":"2024-06-10T00:22:42.947924+0000","last_became_active":"2024-06-10T00:22:40.465452+0000","last_became_peered":"2024-06-10T00:22:40.465452+0000","last_unstale":"2024-06-10T00:22:42.947924+0000","last_undegraded":"2024-06-10T00:22:42.947924+0000","last_fullsized":"2024-06-10T00:22:42.947924+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:59:37.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458685+0000","last_change":"2024-06-10T00:22:41.475686+0000","last_active":"2024-06-10T00:22:42.458685+0000","last_peered":"2024-06-10T00:22:42.458685+0000","last_clean":"2024-06-10T00:22:42.458685+0000","last_became_active":"2024-06-10T00:22:41.475420+0000","last_became_peered":"2024-06-10T00:22:41.475420+0000","last_unstale":"2024-06-10T00:22:42.458685+0000","last_undegraded":"2024-06-10T00:22:42.458685+0000","last_fullsized":"2024-06-10T00:22:42.458685+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:34.864080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458323+0000","last_change":"2024-06-10T00:22:40.456048+0000","last_active":"2024-06-10T00:22:42.458323+0000","last_peered":"2024-06-10T00:22:42.458323+0000","last_clean":"2024-06-10T00:22:42.458323+0000","last_became_active":"2024-06-10T00:22:40.455788+0000","last_became_peered":"2024-06-10T00:22:40.455788+0000","last_unstale":"2024-06-10T00:22:42.458323+0000","last_undegraded":"2024-06-10T00:22:42.458323+0000","last_fullsized":"2024-06-10T00:22:42.458323+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:33:07.654120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.948139+0000","last_change":"2024-06-10T00:22:41.472919+0000","last_active":"2024-06-10T00:22:42.948139+0000","last_peered":"2024-06-10T00:22:42.948139+0000","last_clean":"2024-06-10T00:22:42.948139+0000","last_became_active":"2024-06-10T00:22:41.472631+0000","last_became_peered":"2024-06-10T00:22:41.472631+0000","last_unstale":"2024-06-10T00:22:42.948139+0000","last_undegraded":"2024-06-10T00:22:42.948139+0000","last_fullsized":"2024-06-10T00:22:42.948139+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:34:50.519945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103145+0000","last_change":"2024-06-10T00:22:40.458861+0000","last_active":"2024-06-10T00:22:43.103145+0000","last_peered":"2024-06-10T00:22:43.103145+0000","last_clean":"2024-06-10T00:22:43.103145+0000","last_became_active":"2024-06-10T00:22:40.458585+0000","last_became_peered":"2024-06-10T00:22:40.458585+0000","last_unstale":"2024-06-10T00:22:43.103145+0000","last_undegraded":"2024-06-10T00:22:43.103145+0000","last_fullsized":"2024-06-10T00:22:43.103145+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:29:30.297080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547387+0000","last_change":"2024-06-10T00:22:41.467651+0000","last_active":"2024-06-10T00:22:42.547387+0000","last_peered":"2024-06-10T00:22:42.547387+0000","last_clean":"2024-06-10T00:22:42.547387+0000","last_became_active":"2024-06-10T00:22:41.467418+0000","last_became_peered":"2024-06-10T00:22:41.467418+0000","last_unstale":"2024-06-10T00:22:42.547387+0000","last_undegraded":"2024-06-10T00:22:42.547387+0000","last_fullsized":"2024-06-10T00:22:42.547387+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:51:52.915602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.546876+0000","last_change":"2024-06-10T00:22:40.460616+0000","last_active":"2024-06-10T00:22:42.546876+0000","last_peered":"2024-06-10T00:22:42.546876+0000","last_clean":"2024-06-10T00:22:42.546876+0000","last_became_active":"2024-06-10T00:22:40.460359+0000","last_became_peered":"2024-06-10T00:22:40.460359+0000","last_unstale":"2024-06-10T00:22:42.546876+0000","last_undegraded":"2024-06-10T00:22:42.546876+0000","last_fullsized":"2024-06-10T00:22:42.546876+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:39:38.323271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472645+0000","last_change":"2024-06-10T00:22:41.481874+0000","last_active":"2024-06-10T00:22:42.472645+0000","last_peered":"2024-06-10T00:22:42.472645+0000","last_clean":"2024-06-10T00:22:42.472645+0000","last_became_active":"2024-06-10T00:22:41.481600+0000","last_became_peered":"2024-06-10T00:22:41.481600+0000","last_unstale":"2024-06-10T00:22:42.472645+0000","last_undegraded":"2024-06-10T00:22:42.472645+0000","last_fullsized":"2024-06-10T00:22:42.472645+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:59:22.739612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"103'8","reported_seq":22,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458299+0000","last_change":"2024-06-10T00:22:40.451127+0000","last_active":"2024-06-10T00:22:42.458299+0000","last_peered":"2024-06-10T00:22:42.458299+0000","last_clean":"2024-06-10T00:22:42.458299+0000","last_became_active":"2024-06-10T00:22:40.450861+0000","last_became_peered":"2024-06-10T00:22:40.450861+0000","last_unstale":"2024-06-10T00:22:42.458299+0000","last_undegraded":"2024-06-10T00:22:42.458299+0000","last_fullsized":"2024-06-10T00:22:42.458299+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:52:36.829097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547004+0000","last_change":"2024-06-10T00:22:41.475864+0000","last_active":"2024-06-10T00:22:42.547004+0000","last_peered":"2024-06-10T00:22:42.547004+0000","last_clean":"2024-06-10T00:22:42.547004+0000","last_became_active":"2024-06-10T00:22:41.475601+0000","last_became_peered":"2024-06-10T00:22:41.475601+0000","last_unstale":"2024-06-10T00:22:42.547004+0000","last_undegraded":"2024-06-10T00:22:42.547004+0000","last_fullsized":"2024-06-10T00:22:42.547004+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:44:01.534128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.948123+0000","last_change":"2024-06-10T00:22:40.459091+0000","last_active":"2024-06-10T00:22:42.948123+0000","last_peered":"2024-06-10T00:22:42.948123+0000","last_clean":"2024-06-10T00:22:42.948123+0000","last_became_active":"2024-06-10T00:22:40.458813+0000","last_became_peered":"2024-06-10T00:22:40.458813+0000","last_unstale":"2024-06-10T00:22:42.948123+0000","last_undegraded":"2024-06-10T00:22:42.948123+0000","last_fullsized":"2024-06-10T00:22:42.948123+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:52:36.829097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.947853+0000","last_change":"2024-06-10T00:22:41.485472+0000","last_active":"2024-06-10T00:22:42.947853+0000","last_peered":"2024-06-10T00:22:42.947853+0000","last_clean":"2024-06-10T00:22:42.947853+0000","last_became_active":"2024-06-10T00:22:41.485161+0000","last_became_peered":"2024-06-10T00:22:41.485161+0000","last_unstale":"2024-06-10T00:22:42.947853+0000","last_undegraded":"2024-06-10T00:22:42.947853+0000","last_fullsized":"2024-06-10T00:22:42.947853+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:32:37.953701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103427+0000","last_change":"2024-06-10T00:22:40.460540+0000","last_active":"2024-06-10T00:22:43.103427+0000","last_peered":"2024-06-10T00:22:43.103427+0000","last_clean":"2024-06-10T00:22:43.103427+0000","last_became_active":"2024-06-10T00:22:40.460239+0000","last_became_peered":"2024-06-10T00:22:40.460239+0000","last_unstale":"2024-06-10T00:22:43.103427+0000","last_undegraded":"2024-06-10T00:22:43.103427+0000","last_fullsized":"2024-06-10T00:22:43.103427+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:16:33.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458225+0000","last_change":"2024-06-10T00:22:41.466828+0000","last_active":"2024-06-10T00:22:42.458225+0000","last_peered":"2024-06-10T00:22:42.458225+0000","last_clean":"2024-06-10T00:22:42.458225+0000","last_became_active":"2024-06-10T00:22:41.466545+0000","last_became_peered":"2024-06-10T00:22:41.466545+0000","last_unstale":"2024-06-10T00:22:42.458225+0000","last_undegraded":"2024-06-10T00:22:42.458225+0000","last_fullsized":"2024-06-10T00:22:42.458225+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:32:37.953701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458790+0000","last_change":"2024-06-10T00:22:40.457983+0000","last_active":"2024-06-10T00:22:42.458790+0000","last_peered":"2024-06-10T00:22:42.458790+0000","last_clean":"2024-06-10T00:22:42.458790+0000","last_became_active":"2024-06-10T00:22:40.457713+0000","last_became_peered":"2024-06-10T00:22:40.457713+0000","last_unstale":"2024-06-10T00:22:42.458790+0000","last_undegraded":"2024-06-10T00:22:42.458790+0000","last_fullsized":"2024-06-10T00:22:42.458790+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:33:07.654120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472361+0000","last_change":"2024-06-10T00:22:41.472385+0000","last_active":"2024-06-10T00:22:42.472361+0000","last_peered":"2024-06-10T00:22:42.472361+0000","last_clean":"2024-06-10T00:22:42.472361+0000","last_became_active":"2024-06-10T00:22:41.472138+0000","last_became_peered":"2024-06-10T00:22:41.472138+0000","last_unstale":"2024-06-10T00:22:42.472361+0000","last_undegraded":"2024-06-10T00:22:42.472361+0000","last_fullsized":"2024-06-10T00:22:42.472361+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:41:11.746034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547254+0000","last_change":"2024-06-10T00:22:40.464715+0000","last_active":"2024-06-10T00:22:42.547254+0000","last_peered":"2024-06-10T00:22:42.547254+0000","last_clean":"2024-06-10T00:22:42.547254+0000","last_became_active":"2024-06-10T00:22:40.464434+0000","last_became_peered":"2024-06-10T00:22:40.464434+0000","last_unstale":"2024-06-10T00:22:42.547254+0000","last_undegraded":"2024-06-10T00:22:42.547254+0000","last_fullsized":"2024-06-10T00:22:42.547254+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:13:00.760621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472543+0000","last_change":"2024-06-10T00:22:41.473418+0000","last_active":"2024-06-10T00:22:42.472543+0000","last_peered":"2024-06-10T00:22:42.472543+0000","last_clean":"2024-06-10T00:22:42.472543+0000","last_became_active":"2024-06-10T00:22:41.473170+0000","last_became_peered":"2024-06-10T00:22:41.473170+0000","last_unstale":"2024-06-10T00:22:42.472543+0000","last_undegraded":"2024-06-10T00:22:42.472543+0000","last_fullsized":"2024-06-10T00:22:42.472543+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:14:58.334722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.546854+0000","last_change":"2024-06-10T00:22:40.458231+0000","last_active":"2024-06-10T00:22:42.546854+0000","last_peered":"2024-06-10T00:22:42.546854+0000","last_clean":"2024-06-10T00:22:42.546854+0000","last_became_active":"2024-06-10T00:22:40.457959+0000","last_became_peered":"2024-06-10T00:22:40.457959+0000","last_unstale":"2024-06-10T00:22:42.546854+0000","last_undegraded":"2024-06-10T00:22:42.546854+0000","last_fullsized":"2024-06-10T00:22:42.546854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:06:44.547020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103345+0000","last_change":"2024-06-10T00:22:41.474576+0000","last_active":"2024-06-10T00:22:43.103345+0000","last_peered":"2024-06-10T00:22:43.103345+0000","last_clean":"2024-06-10T00:22:43.103345+0000","last_became_active":"2024-06-10T00:22:41.474329+0000","last_became_peered":"2024-06-10T00:22:41.474329+0000","last_unstale":"2024-06-10T00:22:43.103345+0000","last_undegraded":"2024-06-10T00:22:43.103345+0000","last_fullsized":"2024-06-10T00:22:43.103345+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:23:27.463504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.947741+0000","last_change":"2024-06-10T00:22:40.461887+0000","last_active":"2024-06-10T00:22:42.947741+0000","last_peered":"2024-06-10T00:22:42.947741+0000","last_clean":"2024-06-10T00:22:42.947741+0000","last_became_active":"2024-06-10T00:22:40.461591+0000","last_became_peered":"2024-06-10T00:22:40.461591+0000","last_unstale":"2024-06-10T00:22:42.947741+0000","last_undegraded":"2024-06-10T00:22:42.947741+0000","last_fullsized":"2024-06-10T00:22:42.947741+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:34:17.523826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547203+0000","last_change":"2024-06-10T00:22:41.475129+0000","last_active":"2024-06-10T00:22:42.547203+0000","last_peered":"2024-06-10T00:22:42.547203+0000","last_clean":"2024-06-10T00:22:42.547203+0000","last_became_active":"2024-06-10T00:22:41.474862+0000","last_became_peered":"2024-06-10T00:22:41.474862+0000","last_unstale":"2024-06-10T00:22:42.547203+0000","last_undegraded":"2024-06-10T00:22:42.547203+0000","last_fullsized":"2024-06-10T00:22:42.547203+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:21:56.684946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547069+0000","last_change":"2024-06-10T00:22:40.465440+0000","last_active":"2024-06-10T00:22:42.547069+0000","last_peered":"2024-06-10T00:22:42.547069+0000","last_clean":"2024-06-10T00:22:42.547069+0000","last_became_active":"2024-06-10T00:22:40.465137+0000","last_became_peered":"2024-06-10T00:22:40.465137+0000","last_unstale":"2024-06-10T00:22:42.547069+0000","last_undegraded":"2024-06-10T00:22:42.547069+0000","last_fullsized":"2024-06-10T00:22:42.547069+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:25:35.753354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472222+0000","last_change":"2024-06-10T00:22:41.474021+0000","last_active":"2024-06-10T00:22:42.472222+0000","last_peered":"2024-06-10T00:22:42.472222+0000","last_clean":"2024-06-10T00:22:42.472222+0000","last_became_active":"2024-06-10T00:22:41.473743+0000","last_became_peered":"2024-06-10T00:22:41.473743+0000","last_unstale":"2024-06-10T00:22:42.472222+0000","last_undegraded":"2024-06-10T00:22:42.472222+0000","last_fullsized":"2024-06-10T00:22:42.472222+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:30:30.477300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458241+0000","last_change":"2024-06-10T00:22:40.455370+0000","last_active":"2024-06-10T00:22:42.458241+0000","last_peered":"2024-06-10T00:22:42.458241+0000","last_clean":"2024-06-10T00:22:42.458241+0000","last_became_active":"2024-06-10T00:22:40.455076+0000","last_became_peered":"2024-06-10T00:22:40.455076+0000","last_unstale":"2024-06-10T00:22:42.458241+0000","last_undegraded":"2024-06-10T00:22:42.458241+0000","last_fullsized":"2024-06-10T00:22:42.458241+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458552+0000","last_change":"2024-06-10T00:22:41.467731+0000","last_active":"2024-06-10T00:22:42.458552+0000","last_peered":"2024-06-10T00:22:42.458552+0000","last_clean":"2024-06-10T00:22:42.458552+0000","last_became_active":"2024-06-10T00:22:41.467472+0000","last_became_peered":"2024-06-10T00:22:41.467472+0000","last_unstale":"2024-06-10T00:22:42.458552+0000","last_undegraded":"2024-06-10T00:22:42.458552+0000","last_fullsized":"2024-06-10T00:22:42.458552+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:33:21.707875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"104'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.472494+0000","last_change":"2024-06-10T00:22:40.463082+0000","last_active":"2024-06-10T00:22:42.472494+0000","last_peered":"2024-06-10T00:22:42.472494+0000","last_clean":"2024-06-10T00:22:42.472494+0000","last_became_active":"2024-06-10T00:22:40.462736+0000","last_became_peered":"2024-06-10T00:22:40.462736+0000","last_unstale":"2024-06-10T00:22:42.472494+0000","last_undegraded":"2024-06-10T00:22:42.472494+0000","last_fullsized":"2024-06-10T00:22:42.472494+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:40:09.367380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103233+0000","last_change":"2024-06-10T00:22:41.473913+0000","last_active":"2024-06-10T00:22:43.103233+0000","last_peered":"2024-06-10T00:22:43.103233+0000","last_clean":"2024-06-10T00:22:43.103233+0000","last_became_active":"2024-06-10T00:22:41.473589+0000","last_became_peered":"2024-06-10T00:22:41.473589+0000","last_unstale":"2024-06-10T00:22:43.103233+0000","last_undegraded":"2024-06-10T00:22:43.103233+0000","last_fullsized":"2024-06-10T00:22:43.103233+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:27:31.046958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.948095+0000","last_change":"2024-06-10T00:22:40.463965+0000","last_active":"2024-06-10T00:22:42.948095+0000","last_peered":"2024-06-10T00:22:42.948095+0000","last_clean":"2024-06-10T00:22:42.948095+0000","last_became_active":"2024-06-10T00:22:40.463632+0000","last_became_peered":"2024-06-10T00:22:40.463632+0000","last_unstale":"2024-06-10T00:22:42.948095+0000","last_undegraded":"2024-06-10T00:22:42.948095+0000","last_fullsized":"2024-06-10T00:22:42.948095+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:18:24.160240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459081+0000","last_change":"2024-06-10T00:22:41.464120+0000","last_active":"2024-06-10T00:22:42.459081+0000","last_peered":"2024-06-10T00:22:42.459081+0000","last_clean":"2024-06-10T00:22:42.459081+0000","last_became_active":"2024-06-10T00:22:41.463828+0000","last_became_peered":"2024-06-10T00:22:41.463828+0000","last_unstale":"2024-06-10T00:22:42.459081+0000","last_undegraded":"2024-06-10T00:22:42.459081+0000","last_fullsized":"2024-06-10T00:22:42.459081+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:32:37.953701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458357+0000","last_change":"2024-06-10T00:22:40.460576+0000","last_active":"2024-06-10T00:22:42.458357+0000","last_peered":"2024-06-10T00:22:42.458357+0000","last_clean":"2024-06-10T00:22:42.458357+0000","last_became_active":"2024-06-10T00:22:40.460296+0000","last_became_peered":"2024-06-10T00:22:40.460296+0000","last_unstale":"2024-06-10T00:22:42.458357+0000","last_undegraded":"2024-06-10T00:22:42.458357+0000","last_fullsized":"2024-06-10T00:22:42.458357+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:57:14.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547026+0000","last_change":"2024-06-10T00:22:41.468230+0000","last_active":"2024-06-10T00:22:42.547026+0000","last_peered":"2024-06-10T00:22:42.547026+0000","last_clean":"2024-06-10T00:22:42.547026+0000","last_became_active":"2024-06-10T00:22:41.467981+0000","last_became_peered":"2024-06-10T00:22:41.467981+0000","last_unstale":"2024-06-10T00:22:42.547026+0000","last_undegraded":"2024-06-10T00:22:42.547026+0000","last_fullsized":"2024-06-10T00:22:42.547026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:15:24.105425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459261+0000","last_change":"2024-06-10T00:22:40.455011+0000","last_active":"2024-06-10T00:22:42.459261+0000","last_peered":"2024-06-10T00:22:42.459261+0000","last_clean":"2024-06-10T00:22:42.459261+0000","last_became_active":"2024-06-10T00:22:40.454696+0000","last_became_peered":"2024-06-10T00:22:40.454696+0000","last_unstale":"2024-06-10T00:22:42.459261+0000","last_undegraded":"2024-06-10T00:22:42.459261+0000","last_fullsized":"2024-06-10T00:22:42.459261+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:10:04.794749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547036+0000","last_change":"2024-06-10T00:22:41.470540+0000","last_active":"2024-06-10T00:22:42.547036+0000","last_peered":"2024-06-10T00:22:42.547036+0000","last_clean":"2024-06-10T00:22:42.547036+0000","last_became_active":"2024-06-10T00:22:41.468633+0000","last_became_peered":"2024-06-10T00:22:41.468633+0000","last_unstale":"2024-06-10T00:22:42.547036+0000","last_undegraded":"2024-06-10T00:22:42.547036+0000","last_fullsized":"2024-06-10T00:22:42.547036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:31:47.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.546948+0000","last_change":"2024-06-10T00:22:40.459986+0000","last_active":"2024-06-10T00:22:42.546948+0000","last_peered":"2024-06-10T00:22:42.546948+0000","last_clean":"2024-06-10T00:22:42.546948+0000","last_became_active":"2024-06-10T00:22:40.459717+0000","last_became_peered":"2024-06-10T00:22:40.459717+0000","last_unstale":"2024-06-10T00:22:42.546948+0000","last_undegraded":"2024-06-10T00:22:42.546948+0000","last_fullsized":"2024-06-10T00:22:42.546948+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:22:49.368109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103556+0000","last_change":"2024-06-10T00:22:41.475284+0000","last_active":"2024-06-10T00:22:43.103556+0000","last_peered":"2024-06-10T00:22:43.103556+0000","last_clean":"2024-06-10T00:22:43.103556+0000","last_became_active":"2024-06-10T00:22:41.474891+0000","last_became_peered":"2024-06-10T00:22:41.474891+0000","last_unstale":"2024-06-10T00:22:43.103556+0000","last_undegraded":"2024-06-10T00:22:43.103556+0000","last_fullsized":"2024-06-10T00:22:43.103556+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:36:22.770387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.947798+0000","last_change":"2024-06-10T00:22:40.464220+0000","last_active":"2024-06-10T00:22:42.947798+0000","last_peered":"2024-06-10T00:22:42.947798+0000","last_clean":"2024-06-10T00:22:42.947798+0000","last_became_active":"2024-06-10T00:22:40.463898+0000","last_became_peered":"2024-06-10T00:22:40.463898+0000","last_unstale":"2024-06-10T00:22:42.947798+0000","last_undegraded":"2024-06-10T00:22:42.947798+0000","last_fullsized":"2024-06-10T00:22:42.947798+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:03:02.701295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.459343+0000","last_change":"2024-06-10T00:22:41.466887+0000","last_active":"2024-06-10T00:22:42.459343+0000","last_peered":"2024-06-10T00:22:42.459343+0000","last_clean":"2024-06-10T00:22:42.459343+0000","last_became_active":"2024-06-10T00:22:41.466450+0000","last_became_peered":"2024-06-10T00:22:41.466450+0000","last_unstale":"2024-06-10T00:22:42.459343+0000","last_undegraded":"2024-06-10T00:22:42.459343+0000","last_fullsized":"2024-06-10T00:22:42.459343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:34:50.519945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547081+0000","last_change":"2024-06-10T00:22:40.461880+0000","last_active":"2024-06-10T00:22:42.547081+0000","last_peered":"2024-06-10T00:22:42.547081+0000","last_clean":"2024-06-10T00:22:42.547081+0000","last_became_active":"2024-06-10T00:22:40.461170+0000","last_became_peered":"2024-06-10T00:22:40.461170+0000","last_unstale":"2024-06-10T00:22:42.547081+0000","last_undegraded":"2024-06-10T00:22:42.547081+0000","last_fullsized":"2024-06-10T00:22:42.547081+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:58:34.969467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.458425+0000","last_change":"2024-06-10T00:22:41.474948+0000","last_active":"2024-06-10T00:22:42.458425+0000","last_peered":"2024-06-10T00:22:42.458425+0000","last_clean":"2024-06-10T00:22:42.458425+0000","last_became_active":"2024-06-10T00:22:41.474685+0000","last_became_peered":"2024-06-10T00:22:41.474685+0000","last_unstale":"2024-06-10T00:22:42.458425+0000","last_undegraded":"2024-06-10T00:22:42.458425+0000","last_fullsized":"2024-06-10T00:22:42.458425+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:40.439121+0000","last_clean_scrub_stamp":"2024-06-10T00:22:40.439121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:07:30.166964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:42.547287+0000","last_change":"2024-06-10T00:22:40.464744+0000","last_active":"2024-06-10T00:22:42.547287+0000","last_peered":"2024-06-10T00:22:42.547287+0000","last_clean":"2024-06-10T00:22:42.547287+0000","last_became_active":"2024-06-10T00:22:40.464450+0000","last_became_peered":"2024-06-10T00:22:40.464450+0000","last_unstale":"2024-06-10T00:22:42.547287+0000","last_undegraded":"2024-06-10T00:22:42.547287+0000","last_fullsized":"2024-06-10T00:22:42.547287+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:22:39.432915+0000","last_clean_scrub_stamp":"2024-06-10T00:22:39.432915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:10:59.687630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":323,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-06-10T00:22:43.103234+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:22:43.103234+0000","last_peered":"2024-06-10T00:22:43.103234+0000","last_clean":"2024-06-10T00:22:43.103234+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:22:43.103234+0000","last_undegraded":"2024-06-10T00:22:43.103234+0000","last_fullsized":"2024-06-10T00:22:43.103234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1892352,"data_stored":1189444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574951,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1310720,"data_stored":601132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1290240,"data_stored":598916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1298432,"data_stored":599008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":599498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":598950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":598950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1900544,"data_stored":1190986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:22:49.189 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:22:49.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-10T00:22:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.295+0000 7f65d8b9b640 1 Processor -- start 2024-06-10T00:22:49.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.295+0000 7f65d8b9b640 1 -- start start 2024-06-10T00:22:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d8b9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65d41589e0 0x7f65d415f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d8b9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65d40d06e0 0x7f65d40ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d8b9b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d4158dc0 con 0x7f65d415ea40 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d8b9b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f65d40721b0 con 0x7f65d41589e0 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d8b9b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f65d4072490 con 0x7f65d40d06e0 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65d41589e0 0x7f65d415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65d41589e0 0x7f65d415f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49192/0 (socket says 172.21.15.79:49192) 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d259c640 1 -- 172.21.15.79:0/643696017 learned_addr learned my addr 172.21.15.79:0/643696017 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d2d9d640 1 --2- 172.21.15.79:0/643696017 >> v2:172.21.15.117:3300/0 conn(0x7f65d40d06e0 0x7f65d40ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d259c640 1 -- 172.21.15.79:0/643696017 >> v2:172.21.15.117:3300/0 conn(0x7f65d40d06e0 msgr2=0x7f65d40ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d259c640 1 --2- 172.21.15.79:0/643696017 >> v2:172.21.15.117:3300/0 conn(0x7f65d40d06e0 0x7f65d40ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.296+0000 7f65d259c640 1 -- 172.21.15.79:0/643696017 >> v1:172.21.15.117:6789/0 conn(0x7f65d415ea40 legacy=0x7f65d40cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.297+0000 7f65d259c640 1 -- 172.21.15.79:0/643696017 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d4072770 con 0x7f65d41589e0 2024-06-10T00:22:49.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.297+0000 7f65d259c640 1 --2- 172.21.15.79:0/643696017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d415f270 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f65d415b350 tx=0x7f65c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3242f3dbca24c873 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.297+0000 7f65d1d9b640 1 -- 172.21.15.79:0/643696017 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4037070 con 0x7f65d41589e0 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.297+0000 7f65d1d9b640 1 -- 172.21.15.79:0/643696017 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4032440 con 0x7f65d41589e0 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.297+0000 7f65d1d9b640 1 -- 172.21.15.79:0/643696017 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4032810 con 0x7f65d41589e0 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.298+0000 7f65d8b9b640 1 -- 172.21.15.79:0/643696017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 msgr2=0x7f65d415f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.298+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/643696017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d415f270 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f65d415b350 tx=0x7f65c402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.298+0000 7f65d8b9b640 1 -- 172.21.15.79:0/643696017 shutdown_connections 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.298+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/643696017 >> v2:172.21.15.117:3300/0 conn(0x7f65d40d06e0 0x7f65d40ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.298+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/643696017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d415f270 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.298+0000 7f65d8b9b640 1 -- 172.21.15.79:0/643696017 >> 172.21.15.79:0/643696017 conn(0x7f65d406b7e0 msgr2=0x7f65d406bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.298+0000 7f65d8b9b640 1 -- 172.21.15.79:0/643696017 shutdown_connections 2024-06-10T00:22:49.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.298+0000 7f65d8b9b640 1 -- 172.21.15.79:0/643696017 wait complete. 2024-06-10T00:22:49.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.299+0000 7f65d8b9b640 1 Processor -- start 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65d8b9b640 1 -- start start 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65d8b9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40d06e0 0x7f65d4150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65d8b9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d409c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65d8b9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415ea40 0x7f65d41535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65d8b9b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65d415f7b0 con 0x7f65d41589e0 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65d8b9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f65d4072d30 con 0x7f65d40d06e0 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65d8b9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f65d4073250 con 0x7f65d415ea40 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d409c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d409c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49194/0 (socket says 172.21.15.79:49194) 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.300+0000 7f65c9d9b640 1 -- 172.21.15.79:0/1738890411 learned_addr learned my addr 172.21.15.79:0/1738890411 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65d259c640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40d06e0 0x7f65d4150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65d2d9d640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415ea40 0x7f65d41535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65c9d9b640 1 -- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415ea40 msgr2=0x7f65d41535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65c9d9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415ea40 0x7f65d41535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65c9d9b640 1 -- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40d06e0 msgr2=0x7f65d4150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65c9d9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40d06e0 0x7f65d4150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65c9d9b640 1 -- 172.21.15.79:0/1738890411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d409d120 con 0x7f65d41589e0 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65d259c640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40d06e0 0x7f65d4150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65c9d9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d409c7d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c400 tx=0x7f65bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65cb7fe640 1 -- 172.21.15.79:0/1738890411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc017070 con 0x7f65d41589e0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65cb7fe640 1 -- 172.21.15.79:0/1738890411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65bc0052d0 con 0x7f65d41589e0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d409d400 con 0x7f65d41589e0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65cb7fe640 1 -- 172.21.15.79:0/1738890411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc003830 con 0x7f65d41589e0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.301+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d4151260 con 0x7f65d41589e0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.302+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d40683c0 con 0x7f65d41589e0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.303+0000 7f65cb7fe640 1 -- 172.21.15.79:0/1738890411 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65bc01a070 con 0x7f65d41589e0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.303+0000 7f65cb7fe640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65b406be30 0x7f65b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.303+0000 7f65d259c640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65b406be30 0x7f65b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.303+0000 7f65cb7fe640 1 -- 172.21.15.79:0/1738890411 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f65bc08a2a0 con 0x7f65d41589e0 2024-06-10T00:22:49.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.304+0000 7f65d259c640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65b406be30 0x7f65b406e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f65c4034000 tx=0x7f65c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:49.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.307+0000 7f65cb7fe640 1 -- 172.21.15.79:0/1738890411 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f65bc058b50 con 0x7f65d41589e0 2024-06-10T00:22:49.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.550+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f65d4071bc0 con 0x7f65d41589e0 2024-06-10T00:22:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.552+0000 7f65cb7fe640 1 -- 172.21.15.79:0/1738890411 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f65bc058450 con 0x7f65d41589e0 2024-06-10T00:22:49.552 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-06-10T00:22:49.553 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:22:49.553 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-06-10T00:22:49.553 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-06-10T00:22:49.553 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-10T00:22:49.553 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-06-10T00:22:49.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65b406be30 msgr2=0x7f65b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65b406be30 0x7f65b406e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f65c4034000 tx=0x7f65c402e000 comp rx=0 tx=0).stop 2024-06-10T00:22:49.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 msgr2=0x7f65d409c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d409c7d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c400 tx=0x7f65bc00c8c0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 shutdown_connections 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65b406be30 0x7f65b406e2f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415ea40 0x7f65d41535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d41589e0 0x7f65d409c7d0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 --2- 172.21.15.79:0/1738890411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40d06e0 0x7f65d4150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 >> 172.21.15.79:0/1738890411 conn(0x7f65d406b7e0 msgr2=0x7f65d406e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 shutdown_connections 2024-06-10T00:22:49.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.554+0000 7f65d8b9b640 1 -- 172.21.15.79:0/1738890411 wait complete. 2024-06-10T00:22:49.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.665+0000 7f186b963640 1 Processor -- start 2024-06-10T00:22:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.665+0000 7f186b963640 1 -- start start 2024-06-10T00:22:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f186b963640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f18641553c0 0x7f18640cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f186b963640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640b2cf0 0x7f186415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f186b963640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f186415c3f0 con 0x7f18640cec50 2024-06-10T00:22:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f186b963640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f18640b3170 con 0x7f18641553c0 2024-06-10T00:22:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f186b963640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18640b3420 con 0x7f18640b2cf0 2024-06-10T00:22:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f1869f00640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f18640cec50 0x7f1864071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52918/0 (socket says 172.21.15.79:52918) 2024-06-10T00:22:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f1869f00640 1 -- 172.21.15.79:0/3399515358 learned_addr learned my addr 172.21.15.79:0/3399515358 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f1868efe640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640b2cf0 0x7f186415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f18696ff640 1 --2- 172.21.15.79:0/3399515358 >> v2:172.21.15.117:3300/0 conn(0x7f18641553c0 0x7f18640cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957351491 0 0) 0x7f185c001490 con 0x7f18640cec50 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1850003520 con 0x7f18640cec50 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 601703014 0 0) 0x7f1850003520 con 0x7f18640cec50 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640b2cf0 msgr2=0x7f186415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640b2cf0 0x7f186415beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 >> v2:172.21.15.117:3300/0 conn(0x7f18641553c0 msgr2=0x7f18640cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 --2- 172.21.15.79:0/3399515358 >> v2:172.21.15.117:3300/0 conn(0x7f18641553c0 0x7f18640cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18640cc750 con 0x7f18640cec50 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f185c001bc0 con 0x7f18640cec50 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 >> v1:172.21.15.79:6789/0 conn(0x7f18640cec50 legacy=0x7f1864071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.666+0000 7f185bfff640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640b2cf0 0x7f18500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f185bfff640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850003f30 0x7f1850004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f185bfff640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850004d40 0x7f18500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18640b3170 con 0x7f1850003f30 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18640b3420 con 0x7f1850004d40 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f185000b9c0 con 0x7f18640b2cf0 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f1868efe640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850003f30 0x7f1850004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f18696ff640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640b2cf0 0x7f18500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f1869f00640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850004d40 0x7f18500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f1868efe640 1 -- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640b2cf0 msgr2=0x7f18500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f1868efe640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640b2cf0 0x7f18500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f1868efe640 1 -- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850004d40 msgr2=0x7f18500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f1868efe640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850004d40 0x7f18500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f1868efe640 1 -- 172.21.15.79:0/3399515358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1850003520 con 0x7f1850003f30 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.667+0000 7f1869f00640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850004d40 0x7f18500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f1868efe640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850003f30 0x7f1850004800 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f1854009ac0 tx=0x7f1850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6253f0d360aea6e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854036070 con 0x7f1850003f30 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1854031400 con 0x7f1850003f30 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f185bfff640 1 -- 172.21.15.79:0/3399515358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854009690 con 0x7f1850003f30 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f186b963640 1 -- 172.21.15.79:0/3399515358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850003f30 msgr2=0x7f1850004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f186b963640 1 --2- 172.21.15.79:0/3399515358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1850003f30 0x7f1850004800 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f1854009ac0 tx=0x7f1850005830 comp rx=0 tx=0).stop 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f1869f00640 1 -- 172.21.15.79:0/3399515358 reap_dead start 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f186b963640 1 -- 172.21.15.79:0/3399515358 shutdown_connections 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f186b963640 1 -- 172.21.15.79:0/3399515358 >> 172.21.15.79:0/3399515358 conn(0x7f18640b19f0 msgr2=0x7f18640b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f186b963640 1 -- 172.21.15.79:0/3399515358 shutdown_connections 2024-06-10T00:22:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.668+0000 7f186b963640 1 -- 172.21.15.79:0/3399515358 wait complete. 2024-06-10T00:22:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f186b963640 1 Processor -- start 2024-06-10T00:22:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f186b963640 1 -- start start 2024-06-10T00:22:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f186b963640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003f30 0x7f18641543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f186b963640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186409d920 0x7f1864152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f186b963640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f186406d570 0x7f186406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f186b963640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18640b3700 con 0x7f186409d920 2024-06-10T00:22:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f186b963640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18640ccd10 con 0x7f186406d570 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f186b963640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18641557a0 con 0x7f1850003f30 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f1868efe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186409d920 0x7f1864152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f1868efe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186409d920 0x7f1864152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49220/0 (socket says 172.21.15.79:49220) 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f1868efe640 1 -- 172.21.15.79:0/1884079934 learned_addr learned my addr 172.21.15.79:0/1884079934 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f18696ff640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003f30 0x7f18641543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.670+0000 7f1869f00640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f186406d570 0x7f186406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1868efe640 1 -- 172.21.15.79:0/1884079934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003f30 msgr2=0x7f18641543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1868efe640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003f30 0x7f18641543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1868efe640 1 -- 172.21.15.79:0/1884079934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f186406d570 msgr2=0x7f186406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1868efe640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f186406d570 0x7f186406d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1868efe640 1 -- 172.21.15.79:0/1884079934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1864153310 con 0x7f186409d920 2024-06-10T00:22:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1868efe640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186409d920 0x7f1864152650 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f1854000c00 tx=0x7f1854004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1859ffb640 1 -- 172.21.15.79:0/1884079934 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854040020 con 0x7f186409d920 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1859ffb640 1 -- 172.21.15.79:0/1884079934 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1854003c60 con 0x7f186409d920 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18641535f0 con 0x7f186409d920 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f1859ffb640 1 -- 172.21.15.79:0/1884079934 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854036040 con 0x7f186409d920 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.671+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1864153bb0 con 0x7f186409d920 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.672+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1864068430 con 0x7f186409d920 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.673+0000 7f1859ffb640 1 -- 172.21.15.79:0/1884079934 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1854043020 con 0x7f186409d920 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.673+0000 7f1859ffb640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f184806be30 0x7f184806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.673+0000 7f1859ffb640 1 -- 172.21.15.79:0/1884079934 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f18540aafb0 con 0x7f186409d920 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.673+0000 7f18696ff640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f184806be30 0x7f184806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.674+0000 7f18696ff640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f184806be30 0x7f184806e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1860009c40 tx=0x7f1860009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.678+0000 7f1859ffb640 1 -- 172.21.15.79:0/1884079934 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f185404a070 con 0x7f186409d920 2024-06-10T00:22:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.885+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18640adf50 con 0x7f186409d920 2024-06-10T00:22:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.886+0000 7f1859ffb640 1 -- 172.21.15.79:0/1884079934 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7f18540044e0 con 0x7f186409d920 2024-06-10T00:22:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:49.887 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:22:42.806547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7698":{"gid":7698,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2980295924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2980295924},{"type":"v1","addr":"172.21.15.79:6837","nonce":2980295924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7698,"qdb_cluster":[7698]},"id":7}]} 2024-06-10T00:22:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-06-10T00:22:49.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f184806be30 msgr2=0x7f184806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f184806be30 0x7f184806e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1860009c40 tx=0x7f1860009190 comp rx=0 tx=0).stop 2024-06-10T00:22:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186409d920 msgr2=0x7f1864152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186409d920 0x7f1864152650 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f1854000c00 tx=0x7f1854004730 comp rx=0 tx=0).stop 2024-06-10T00:22:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 shutdown_connections 2024-06-10T00:22:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f184806be30 0x7f184806e2f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f186406d570 0x7f186406d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186409d920 0x7f1864152650 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 --2- 172.21.15.79:0/1884079934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003f30 0x7f18641543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 >> 172.21.15.79:0/1884079934 conn(0x7f18640b19f0 msgr2=0x7f18640af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 shutdown_connections 2024-06-10T00:22:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:49.888+0000 7f186b963640 1 -- 172.21.15.79:0/1884079934 wait complete. 2024-06-10T00:22:50.302 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:22:40.800117+0000', 'modified': '2024-06-10T00:22:42.806547+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7698}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7698': {'gid': 7698, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6837/2980295924', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 2980295924}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2980295924}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7698, 'qdb_cluster': [7698]} 2024-06-10T00:22:50.302 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:22:50.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:22:50.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.403+0000 7f1917858640 1 Processor -- start 2024-06-10T00:22:50.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.403+0000 7f1917858640 1 -- start start 2024-06-10T00:22:50.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1917858640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f191006ebf0 0x7f19100cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1917858640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19100cf190 0x7f19100acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1917858640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19100cf600 con 0x7f19100ae910 2024-06-10T00:22:50.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1917858640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f191006d130 con 0x7f19100cf190 2024-06-10T00:22:50.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1917858640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f191006d410 con 0x7f191006ebf0 2024-06-10T00:22:50.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1915df5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19100cf190 0x7f19100acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1915df5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19100cf190 0x7f19100acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49222/0 (socket says 172.21.15.79:49222) 2024-06-10T00:22:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1915df5640 1 -- 172.21.15.79:0/867773282 learned_addr learned my addr 172.21.15.79:0/867773282 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1914df3640 1 --2- 172.21.15.79:0/867773282 >> v2:172.21.15.117:3300/0 conn(0x7f191006ebf0 0x7f19100cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1915df5640 1 -- 172.21.15.79:0/867773282 >> v2:172.21.15.117:3300/0 conn(0x7f191006ebf0 msgr2=0x7f19100cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1915df5640 1 --2- 172.21.15.79:0/867773282 >> v2:172.21.15.117:3300/0 conn(0x7f191006ebf0 0x7f19100cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1915df5640 1 -- 172.21.15.79:0/867773282 >> v1:172.21.15.117:6789/0 conn(0x7f19100ae910 legacy=0x7f191006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1915df5640 1 -- 172.21.15.79:0/867773282 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191006d6f0 con 0x7f19100cf190 2024-06-10T00:22:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.404+0000 7f1914df3640 1 --2- 172.21.15.79:0/867773282 >> v2:172.21.15.117:3300/0 conn(0x7f191006ebf0 0x7f19100cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:50.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.405+0000 7f1915df5640 1 --2- 172.21.15.79:0/867773282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100cf190 0x7f19100acd40 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f1910070c80 tx=0x7f190802c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53839e19fdf45dc7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.405+0000 7f1907fff640 1 -- 172.21.15.79:0/867773282 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908039070 con 0x7f19100cf190 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.405+0000 7f1907fff640 1 -- 172.21.15.79:0/867773282 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190800b2e0 con 0x7f19100cf190 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.405+0000 7f1907fff640 1 -- 172.21.15.79:0/867773282 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908009820 con 0x7f19100cf190 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.406+0000 7f1917858640 1 -- 172.21.15.79:0/867773282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100cf190 msgr2=0x7f19100acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.406+0000 7f1917858640 1 --2- 172.21.15.79:0/867773282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100cf190 0x7f19100acd40 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f1910070c80 tx=0x7f190802c860 comp rx=0 tx=0).stop 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.406+0000 7f1917858640 1 -- 172.21.15.79:0/867773282 shutdown_connections 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.406+0000 7f1917858640 1 --2- 172.21.15.79:0/867773282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100cf190 0x7f19100acd40 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.406+0000 7f1917858640 1 --2- 172.21.15.79:0/867773282 >> v2:172.21.15.117:3300/0 conn(0x7f191006ebf0 0x7f19100cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.406+0000 7f1917858640 1 -- 172.21.15.79:0/867773282 >> 172.21.15.79:0/867773282 conn(0x7f19100b19f0 msgr2=0x7f19100b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.406+0000 7f1917858640 1 -- 172.21.15.79:0/867773282 shutdown_connections 2024-06-10T00:22:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.406+0000 7f1917858640 1 -- 172.21.15.79:0/867773282 wait complete. 2024-06-10T00:22:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.407+0000 7f1917858640 1 Processor -- start 2024-06-10T00:22:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.407+0000 7f1917858640 1 -- start start 2024-06-10T00:22:50.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1917858640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191006ebf0 0x7f1910147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1917858640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100ae910 0x7f1910159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1917858640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19100cf190 0x7f1910159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1917858640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f19100ad280 con 0x7f19100ae910 2024-06-10T00:22:50.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1917858640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f19100aecf0 con 0x7f19100cf190 2024-06-10T00:22:50.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1917858640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f19100ad400 con 0x7f191006ebf0 2024-06-10T00:22:50.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100ae910 0x7f1910159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100ae910 0x7f1910159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49236/0 (socket says 172.21.15.79:49236) 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 -- 172.21.15.79:0/3301548947 learned_addr learned my addr 172.21.15.79:0/3301548947 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1915df5640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19100cf190 0x7f1910159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 -- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191006ebf0 msgr2=0x7f1910147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f19155f4640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191006ebf0 0x7f1910147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191006ebf0 0x7f1910147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 -- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19100cf190 msgr2=0x7f1910159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19100cf190 0x7f1910159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 -- 172.21.15.79:0/3301548947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19101498c0 con 0x7f19100ae910 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1915df5640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19100cf190 0x7f1910159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f19155f4640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191006ebf0 0x7f1910147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.408+0000 7f1914df3640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100ae910 0x7f1910159610 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f190000c7f0 tx=0x7f190000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.409+0000 7f1905ffb640 1 -- 172.21.15.79:0/3301548947 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900015070 con 0x7f19100ae910 2024-06-10T00:22:50.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.409+0000 7f1905ffb640 1 -- 172.21.15.79:0/3301548947 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1900007820 con 0x7f19100ae910 2024-06-10T00:22:50.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.409+0000 7f1905ffb640 1 -- 172.21.15.79:0/3301548947 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900007bd0 con 0x7f19100ae910 2024-06-10T00:22:50.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.409+0000 7f1917858640 1 -- 172.21.15.79:0/3301548947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191014c060 con 0x7f19100ae910 2024-06-10T00:22:50.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.409+0000 7f1917858640 1 -- 172.21.15.79:0/3301548947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1910148de0 con 0x7f19100ae910 2024-06-10T00:22:50.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.410+0000 7f1905ffb640 1 -- 172.21.15.79:0/3301548947 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1900018070 con 0x7f19100ae910 2024-06-10T00:22:50.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.411+0000 7f1905ffb640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18f406be30 0x7f18f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.411+0000 7f1905ffb640 1 -- 172.21.15.79:0/3301548947 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f190008b060 con 0x7f19100ae910 2024-06-10T00:22:50.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.411+0000 7f19155f4640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18f406be30 0x7f18f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.411+0000 7f19155f4640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18f406be30 0x7f18f406e2f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f190c003eb0 tx=0x7f190c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.412+0000 7f191a563740 1 Processor -- start 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.412+0000 7f191a563740 1 -- start start 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.412+0000 7f191a563740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea835d00 0x5561ea838510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.412+0000 7f191a563740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea8360e0 0x5561ea838a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.412+0000 7f191a563740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea808960 0x5561ea80c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f191a563740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5561ea771740 con 0x5561ea808960 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f191a563740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5561ea70fa80 con 0x5561ea8360e0 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f191a563740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5561ea76d700 con 0x5561ea835d00 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea808960 0x5561ea80c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea808960 0x5561ea80c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49246/0 (socket says 172.21.15.79:49246) 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 -- 172.21.15.79:0/3758107137 learned_addr learned my addr 172.21.15.79:0/3758107137 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f19155f4640 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea835d00 0x5561ea838510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1914df3640 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea8360e0 0x5561ea838a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 -- 172.21.15.79:0/3758107137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea835d00 msgr2=0x5561ea838510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea835d00 0x5561ea838510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 -- 172.21.15.79:0/3758107137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea8360e0 msgr2=0x5561ea838a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea8360e0 0x5561ea838a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 -- 172.21.15.79:0/3758107137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ea73afb0 con 0x5561ea808960 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f1915df5640 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea808960 0x5561ea80c170 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f1908037040 tx=0x7f190802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa68a15b4cd2f14a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f18f2ffd640 1 -- 172.21.15.79:0/3758107137 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908039040 con 0x5561ea808960 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f18f2ffd640 1 -- 172.21.15.79:0/3758107137 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1908045070 con 0x5561ea808960 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.413+0000 7f18f2ffd640 1 -- 172.21.15.79:0/3758107137 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908009920 con 0x5561ea808960 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 -- 172.21.15.79:0/3758107137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea808960 msgr2=0x5561ea80c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea808960 0x5561ea80c170 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f1908037040 tx=0x7f190802f000 comp rx=0 tx=0).stop 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 -- 172.21.15.79:0/3758107137 shutdown_connections 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea808960 0x5561ea80c170 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea8360e0 0x5561ea838a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 --2- 172.21.15.79:0/3758107137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea835d00 0x5561ea838510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 -- 172.21.15.79:0/3758107137 >> 172.21.15.79:0/3758107137 conn(0x5561ea80abd0 msgr2=0x5561ea853510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 -- 172.21.15.79:0/3758107137 shutdown_connections 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 -- 172.21.15.79:0/3758107137 wait complete. 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.414+0000 7f191a563740 1 -- start start 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.415+0000 7f191a563740 1 Processor -- start 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.415+0000 7f191a563740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea82f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.415+0000 7f191a563740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea8360e0 0x5561ea856860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.415+0000 7f191a563740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea856da0 0x5561ea834380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.415+0000 7f191a563740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5561ea80dd80 con 0x5561ea8360e0 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.415+0000 7f191a563740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5561ea6fac30 con 0x5561ea835d00 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.415+0000 7f191a563740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5561ea80e060 con 0x5561ea856da0 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.415+0000 7f191a563740 10 client.0 _ll_register_callbacks cb 0x5561ea72c7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea8360e0 0x5561ea856860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea8360e0 0x5561ea856860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49256/0 (socket says 172.21.15.79:49256) 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 -- 172.21.15.79:0/3832571837 learned_addr learned my addr 172.21.15.79:0/3832571837 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1915df5640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea856da0 0x5561ea834380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f19155f4640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea82f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 -- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea856da0 msgr2=0x5561ea834380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea856da0 0x5561ea834380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 -- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 msgr2=0x5561ea82f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea82f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 -- 172.21.15.79:0/3832571837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ea4852d0 con 0x5561ea8360e0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1915df5640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea856da0 0x5561ea834380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f19155f4640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea82f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f1914df3640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea8360e0 0x5561ea856860 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f1900055670 tx=0x7f1900059320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbb5596e0f46757 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f18ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f18ebfff640 1 -- 172.21.15.79:0/3832571837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190001f040 con 0x5561ea8360e0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f18ebfff640 1 -- 172.21.15.79:0/3832571837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f190005d150 con 0x5561ea8360e0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f191a563740 1 -- 172.21.15.79:0/3832571837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1908045070 con 0x5561ea8360e0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f18ebfff640 1 -- 172.21.15.79:0/3832571837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f1900089050 con 0x5561ea8360e0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f191a563740 10 client.7851 fetch_fsmap learned FSMap version 68 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f191a563740 1 -- 172.21.15.79:0/3832571837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5561ea54f6b0 con 0x5561ea8360e0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f18ebfff640 1 -- 172.21.15.79:0/3832571837 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1908045070 con 0x5561ea8360e0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f18ebfff640 1 -- 172.21.15.79:0/3832571837 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f1900058660 con 0x5561ea8360e0 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f191a563740 10 client.7851 fetch_fsmap finished waiting for FSMap version 68 2024-06-10T00:22:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f191a563740 10 client.7851 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.416+0000 7f191a563740 20 client.7851 populate_metadata read hostname 'smithi079' 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.417+0000 7f191a563740 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5561ea854d50 0x5561ea871da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.417+0000 7f191a563740 4 client.7851 mds_command: new command op to 7698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.417+0000 7f191a563740 1 -- 172.21.15.79:0/3832571837 --> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561ea77ee70 con 0x5561ea854d50 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.417+0000 7f19155f4640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5561ea854d50 0x5561ea871da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.417+0000 7f18ebfff640 10 client.7851 ms_handle_connect on v2:172.21.15.79:6835/2980295924 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.417+0000 7f19155f4640 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5561ea854d50 0x5561ea871da0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65dda234dc137168 server_cookie=2e5ac96ddb52ba0 in_seq=0 out_seq=0 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f18ebfff640 1 -- 172.21.15.79:0/3832571837 <== mds.0 v2:172.21.15.79:6835/2980295924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5561ea77ee70 con 0x5561ea854d50 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f18ebfff640 10 client.7851 handle_command_reply: tid=0 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 client.7851 shutdown 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 -- 172.21.15.79:0/3832571837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea8360e0 msgr2=0x5561ea856860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea8360e0 0x5561ea856860 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f1900055670 tx=0x7f1900059320 comp rx=0 tx=0).stop 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 -- 172.21.15.79:0/3832571837 shutdown_connections 2024-06-10T00:22:50.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea856da0 0x5561ea834380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5561ea854d50 0x5561ea871da0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea8360e0 0x5561ea856860 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 --2- 172.21.15.79:0/3832571837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea82f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f18ebfff640 0 client.7851 ms_handle_reset on v2:172.21.15.79:6835/2980295924 2024-06-10T00:22:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 -- 172.21.15.79:0/3832571837 >> 172.21.15.79:0/3832571837 conn(0x5561ea808960 msgr2=0x5561ea8350f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 -- 172.21.15.79:0/3832571837 shutdown_connections 2024-06-10T00:22:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 1 -- 172.21.15.79:0/3832571837 wait complete. 2024-06-10T00:22:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.418+0000 7f191a563740 20 client.7851 trim_cache size 0 max 16384 2024-06-10T00:22:50.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.436+0000 7f191a563740 1 Processor -- start 2024-06-10T00:22:50.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.436+0000 7f191a563740 1 -- start start 2024-06-10T00:22:50.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f191a563740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea807970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f191a563740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 0x5561ea807eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f191a563740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea8254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f191a563740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f191014a1d0 con 0x5561ea856da0 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f191a563740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f19100c5570 con 0x5561ea835d00 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f191a563740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1910149b80 con 0x5561ea8360e0 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f1915df5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea8254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f1915df5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea8254b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49260/0 (socket says 172.21.15.79:49260) 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f1915df5640 1 -- 172.21.15.79:0/950815820 learned_addr learned my addr 172.21.15.79:0/950815820 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f1915df5640 1 -- 172.21.15.79:0/950815820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 msgr2=0x5561ea807eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f1915df5640 1 --2- 172.21.15.79:0/950815820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 0x5561ea807eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f1915df5640 1 -- 172.21.15.79:0/950815820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 msgr2=0x5561ea807970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f1915df5640 1 --2- 172.21.15.79:0/950815820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea807970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.437+0000 7f1915df5640 1 -- 172.21.15.79:0/950815820 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ea80a810 con 0x5561ea856da0 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f1915df5640 1 --2- 172.21.15.79:0/950815820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea8254b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f190800d210 tx=0x7f190800b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb2fbaec2886136 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f18f27fc640 1 -- 172.21.15.79:0/950815820 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908039030 con 0x5561ea856da0 2024-06-10T00:22:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f18f27fc640 1 -- 172.21.15.79:0/950815820 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1908045040 con 0x5561ea856da0 2024-06-10T00:22:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f18f27fc640 1 -- 172.21.15.79:0/950815820 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908009920 con 0x5561ea856da0 2024-06-10T00:22:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 -- 172.21.15.79:0/950815820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 msgr2=0x5561ea8254b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 --2- 172.21.15.79:0/950815820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea8254b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f190800d210 tx=0x7f190800b000 comp rx=0 tx=0).stop 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 -- 172.21.15.79:0/950815820 shutdown_connections 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 --2- 172.21.15.79:0/950815820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea8254b0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 --2- 172.21.15.79:0/950815820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 0x5561ea807eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 --2- 172.21.15.79:0/950815820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea807970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 -- 172.21.15.79:0/950815820 >> 172.21.15.79:0/950815820 conn(0x5561ea808960 msgr2=0x5561ea80e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 -- 172.21.15.79:0/950815820 shutdown_connections 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.438+0000 7f191a563740 1 -- 172.21.15.79:0/950815820 wait complete. 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.439+0000 7f191a563740 1 -- start start 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.439+0000 7f191a563740 1 Processor -- start 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f191a563740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea831f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f191a563740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 0x5561ea861e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f191a563740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea82d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f191a563740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5561ea8304e0 con 0x5561ea856da0 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f191a563740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5561ea831620 con 0x5561ea835d00 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f191a563740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5561ea82feb0 con 0x5561ea8360e0 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f191a563740 10 client.0 _ll_register_callbacks cb 0x7f1900059980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1915df5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea82d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1915df5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea82d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49270/0 (socket says 172.21.15.79:49270) 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1915df5640 1 -- 172.21.15.79:0/2685310268 learned_addr learned my addr 172.21.15.79:0/2685310268 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f19155f4640 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea831f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1914df3640 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 0x5561ea861e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1915df5640 1 -- 172.21.15.79:0/2685310268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 msgr2=0x5561ea861e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1915df5640 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 0x5561ea861e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1915df5640 1 -- 172.21.15.79:0/2685310268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 msgr2=0x5561ea831f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1915df5640 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea831f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.440+0000 7f1915df5640 1 -- 172.21.15.79:0/2685310268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ea862770 con 0x5561ea856da0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f1915df5640 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea82d500 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f19080072a0 tx=0x7f1908004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4862ecea8bd5cc22 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f18ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f18ebfff640 1 -- 172.21.15.79:0/2685310268 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908003b90 con 0x5561ea856da0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f18ebfff640 1 -- 172.21.15.79:0/2685310268 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f1908003d30 con 0x5561ea856da0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 1 -- 172.21.15.79:0/2685310268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1908045040 con 0x5561ea856da0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f18ebfff640 1 -- 172.21.15.79:0/2685310268 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f1908004040 con 0x5561ea856da0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 10 client.7857 fetch_fsmap learned FSMap version 68 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 1 -- 172.21.15.79:0/2685310268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5561ea8324b0 con 0x5561ea856da0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f18ebfff640 1 -- 172.21.15.79:0/2685310268 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1908045040 con 0x5561ea856da0 2024-06-10T00:22:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f18ebfff640 1 -- 172.21.15.79:0/2685310268 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f19080041e0 con 0x5561ea856da0 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 10 client.7857 fetch_fsmap finished waiting for FSMap version 68 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 10 client.7857 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 20 client.7857 populate_metadata read hostname 'smithi079' 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5561ea82da40 0x5561ea8254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 4 client.7857 mds_command: new command op to 7698 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f191a563740 1 -- 172.21.15.79:0/2685310268 --> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] -- command(tid 0: {"prefix": "status"}) -- 0x5561ea7791c0 con 0x5561ea82da40 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.441+0000 7f19155f4640 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5561ea82da40 0x5561ea8254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f18ebfff640 10 client.7857 ms_handle_connect on v2:172.21.15.79:6835/2980295924 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f19155f4640 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5561ea82da40 0x5561ea8254b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6f51101ca8db970 server_cookie=c09b45ad218d0110 in_seq=0 out_seq=0 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f18ebfff640 1 -- 172.21.15.79:0/2685310268 <== mds.0 v2:172.21.15.79:6835/2980295924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5561ea7791c0 con 0x5561ea82da40 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f18ebfff640 10 client.7857 handle_command_reply: tid=0 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 client.7857 shutdown 2024-06-10T00:22:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 -- 172.21.15.79:0/2685310268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 msgr2=0x5561ea82d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea82d500 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f19080072a0 tx=0x7f1908004ab0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 -- 172.21.15.79:0/2685310268 shutdown_connections 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5561ea82da40 0x5561ea8254b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561ea856da0 0x5561ea82d500 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f18ebfff640 0 client.7857 ms_handle_reset on v2:172.21.15.79:6835/2980295924 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5561ea8360e0 0x5561ea861e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 --2- 172.21.15.79:0/2685310268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561ea835d00 0x5561ea831f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 -- 172.21.15.79:0/2685310268 >> 172.21.15.79:0/2685310268 conn(0x5561ea808960 msgr2=0x5561ea80e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 -- 172.21.15.79:0/2685310268 shutdown_connections 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 1 -- 172.21.15.79:0/2685310268 wait complete. 2024-06-10T00:22:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.442+0000 7f191a563740 20 client.7857 trim_cache size 0 max 16384 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7698, 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 8.9799310129999999, 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 68, 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 104, 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 104, 2024-06-10T00:22:50.450 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.042647884000001 2024-06-10T00:22:50.451 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:22:50.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 -- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18f406be30 msgr2=0x7f18f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18f406be30 0x7f18f406e2f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f190c003eb0 tx=0x7f190c009040 comp rx=0 tx=0).stop 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 -- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100ae910 msgr2=0x7f1910159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100ae910 0x7f1910159610 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f190000c7f0 tx=0x7f190000ccb0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 -- 172.21.15.79:0/3301548947 shutdown_connections 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f18f406be30 0x7f18f406e2f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19100cf190 0x7f1910159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100ae910 0x7f1910159610 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 --2- 172.21.15.79:0/3301548947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f191006ebf0 0x7f1910147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 -- 172.21.15.79:0/3301548947 >> 172.21.15.79:0/3301548947 conn(0x7f19100b19f0 msgr2=0x7f1910071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 -- 172.21.15.79:0/3301548947 shutdown_connections 2024-06-10T00:22:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.443+0000 7f1917858640 1 -- 172.21.15.79:0/3301548947 wait complete. 2024-06-10T00:22:50.454 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:22:50.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.553+0000 7fb66eda2640 1 Processor -- start 2024-06-10T00:22:50.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.553+0000 7fb66eda2640 1 -- start start 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.553+0000 7fb66eda2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb66815f1a0 0x7fb6680d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.553+0000 7fb66eda2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6680cef70 0x7fb6680cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.553+0000 7fb66eda2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66815f5e0 con 0x7fb6680d2680 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.553+0000 7fb66eda2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb6680d13e0 con 0x7fb6680cef70 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.553+0000 7fb66eda2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb6680d0ad0 con 0x7fb66815f1a0 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb66cb3e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb6680d2680 0x7fb6680d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52926/0 (socket says 172.21.15.79:52926) 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb66d33f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6680cef70 0x7fb6680cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb66cb3e640 1 -- 172.21.15.79:0/4011676337 learned_addr learned my addr 172.21.15.79:0/4011676337 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb667fff640 1 --2- 172.21.15.79:0/4011676337 >> v2:172.21.15.117:3300/0 conn(0x7fb66815f1a0 0x7fb6680d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb66d33f640 1 -- 172.21.15.79:0/4011676337 >> v2:172.21.15.117:3300/0 conn(0x7fb66815f1a0 msgr2=0x7fb6680d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb66d33f640 1 --2- 172.21.15.79:0/4011676337 >> v2:172.21.15.117:3300/0 conn(0x7fb66815f1a0 0x7fb6680d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb66d33f640 1 -- 172.21.15.79:0/4011676337 >> v1:172.21.15.79:6789/0 conn(0x7fb6680d2680 legacy=0x7fb6680d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb66d33f640 1 -- 172.21.15.79:0/4011676337 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66815f890 con 0x7fb6680cef70 2024-06-10T00:22:50.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb6677fe640 1 -- 172.21.15.79:0/4011676337 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876268619 0 0) 0x7fb66815f5e0 con 0x7fb6680d2680 2024-06-10T00:22:50.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.554+0000 7fb667fff640 1 --2- 172.21.15.79:0/4011676337 >> v2:172.21.15.117:3300/0 conn(0x7fb66815f1a0 0x7fb6680d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:50.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66d33f640 1 --2- 172.21.15.79:0/4011676337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680cef70 0x7fb6680cf3c0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fb6680d1560 tx=0x7fb66002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d01fea947e67408 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb6677fe640 1 -- 172.21.15.79:0/4011676337 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660007740 con 0x7fb6680cef70 2024-06-10T00:22:50.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb6677fe640 1 -- 172.21.15.79:0/4011676337 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6600078e0 con 0x7fb6680cef70 2024-06-10T00:22:50.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb6677fe640 1 -- 172.21.15.79:0/4011676337 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660007cb0 con 0x7fb6680cef70 2024-06-10T00:22:50.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66eda2640 1 -- 172.21.15.79:0/4011676337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680cef70 msgr2=0x7fb6680cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66eda2640 1 --2- 172.21.15.79:0/4011676337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680cef70 0x7fb6680cf3c0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fb6680d1560 tx=0x7fb66002a660 comp rx=0 tx=0).stop 2024-06-10T00:22:50.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66eda2640 1 -- 172.21.15.79:0/4011676337 shutdown_connections 2024-06-10T00:22:50.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66eda2640 1 --2- 172.21.15.79:0/4011676337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680cef70 0x7fb6680cf3c0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66eda2640 1 --2- 172.21.15.79:0/4011676337 >> v2:172.21.15.117:3300/0 conn(0x7fb66815f1a0 0x7fb6680d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66eda2640 1 -- 172.21.15.79:0/4011676337 >> 172.21.15.79:0/4011676337 conn(0x7fb66809d3f0 msgr2=0x7fb6680d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:50.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66eda2640 1 -- 172.21.15.79:0/4011676337 shutdown_connections 2024-06-10T00:22:50.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.555+0000 7fb66eda2640 1 -- 172.21.15.79:0/4011676337 wait complete. 2024-06-10T00:22:50.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.556+0000 7fb66eda2640 1 Processor -- start 2024-06-10T00:22:50.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.557+0000 7fb66eda2640 1 -- start start 2024-06-10T00:22:50.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.557+0000 7fb66eda2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680cef70 0x7fb668149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.557+0000 7fb66eda2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680d2680 0x7fb6681f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.557+0000 7fb66eda2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66815f1a0 0x7fb66815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.557+0000 7fb66eda2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6680d4f00 con 0x7fb6680d2680 2024-06-10T00:22:50.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.557+0000 7fb66eda2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6680d1070 con 0x7fb6680cef70 2024-06-10T00:22:50.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.557+0000 7fb66eda2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb6680d1870 con 0x7fb66815f1a0 2024-06-10T00:22:50.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680d2680 0x7fb6681f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680d2680 0x7fb6681f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49298/0 (socket says 172.21.15.79:49298) 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 -- 172.21.15.79:0/3923443755 learned_addr learned my addr 172.21.15.79:0/3923443755 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 -- 172.21.15.79:0/3923443755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66815f1a0 msgr2=0x7fb66815d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb66d33f640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66815f1a0 0x7fb66815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb66cb3e640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680cef70 0x7fb668149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66815f1a0 0x7fb66815d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 -- 172.21.15.79:0/3923443755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680cef70 msgr2=0x7fb668149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680cef70 0x7fb668149ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 -- 172.21.15.79:0/3923443755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66815e880 con 0x7fb6680d2680 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb667fff640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680d2680 0x7fb6681f43d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb65400e7e0 tx=0x7fb65400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb6657fa640 1 -- 172.21.15.79:0/3923443755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65400f040 con 0x7fb6680d2680 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb6657fa640 1 -- 172.21.15.79:0/3923443755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb654004030 con 0x7fb6680d2680 2024-06-10T00:22:50.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb6657fa640 1 -- 172.21.15.79:0/3923443755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb654004400 con 0x7fb6680d2680 2024-06-10T00:22:50.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66815dfe0 con 0x7fb6680d2680 2024-06-10T00:22:50.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.558+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66815e5a0 con 0x7fb6680d2680 2024-06-10T00:22:50.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.559+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb668068430 con 0x7fb6680d2680 2024-06-10T00:22:50.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.560+0000 7fb6657fa640 1 -- 172.21.15.79:0/3923443755 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb65400c6d0 con 0x7fb6680d2680 2024-06-10T00:22:50.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.560+0000 7fb6657fa640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb64c06be30 0x7fb64c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:50.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.560+0000 7fb66cb3e640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb64c06be30 0x7fb64c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:50.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.560+0000 7fb6657fa640 1 -- 172.21.15.79:0/3923443755 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fb65408ad90 con 0x7fb6680d2680 2024-06-10T00:22:50.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.560+0000 7fb66cb3e640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb64c06be30 0x7fb64c06e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb65c007fd0 tx=0x7fb65c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:50.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.564+0000 7fb6657fa640 1 -- 172.21.15.79:0/3923443755 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb654017020 con 0x7fb6680d2680 2024-06-10T00:22:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.776+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb6680ce580 con 0x7fb6680d2680 2024-06-10T00:22:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.777+0000 7fb6657fa640 1 -- 172.21.15.79:0/3923443755 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7fb654059640 con 0x7fb6680d2680 2024-06-10T00:22:50.776 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:22:50.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.778+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb64c06be30 msgr2=0x7fb64c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.778+0000 7fb66eda2640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb64c06be30 0x7fb64c06e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb65c007fd0 tx=0x7fb65c009040 comp rx=0 tx=0).stop 2024-06-10T00:22:50.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.778+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680d2680 msgr2=0x7fb6681f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.778+0000 7fb66eda2640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680d2680 0x7fb6681f43d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb65400e7e0 tx=0x7fb65400eca0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.779+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 shutdown_connections 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.779+0000 7fb66eda2640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb64c06be30 0x7fb64c06e2f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.779+0000 7fb66eda2640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66815f1a0 0x7fb66815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.779+0000 7fb66eda2640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6680d2680 0x7fb6681f43d0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.779+0000 7fb66eda2640 1 --2- 172.21.15.79:0/3923443755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680cef70 0x7fb668149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.779+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 >> 172.21.15.79:0/3923443755 conn(0x7fb66809d3f0 msgr2=0x7fb6680c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.779+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 shutdown_connections 2024-06-10T00:22:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:50.779+0000 7fb66eda2640 1 -- 172.21.15.79:0/3923443755 wait complete. 2024-06-10T00:22:50.789 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:22:50.789 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:22:50.789 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:22:50.789 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:22:50.789 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:50.790 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:22:50.790 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:22:50.790 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:22:50.790 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:22:50.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:50.790 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:22:50.806 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:22:50.806 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:22:50.806 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:22:50.806 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:50.806 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:22:50.806 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:50.806 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42273sec preferred_lft 42273sec 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:22:50.807 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:22:50.808 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:50.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:50.809 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:22:50.869 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:22:50.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:50.871 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:22:50.927 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:22:50.927 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:22:50.927 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:22:50.927 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:22:50.927 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:22:50.928 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:22:50.928 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:22:50.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:22:50.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:22:50.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:22:50.928 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:22:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:22:51.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:22:51.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:51.053 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:22:51.069 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:22:51.069 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:22:51.069 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:22:51.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:51.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:22:51.133 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:22:51.134 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:22:51.134 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:51.189 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:22:51.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:22:51.190 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:51.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:22:51.310 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:22:51.366 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:22:51.366 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:22:51.366 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:22:51.366 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:22:51.367 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:22:51.368 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:22:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:22:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:22:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:22:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:51.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:51.369 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:22:51.421 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:22:51.422 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:22:51.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:22:51.490 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:22:51.546 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:22:51.546 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:22:51.546 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:22:51.546 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:22:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:22:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:22:51.549 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:51.549 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:51.549 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:51.549 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:51.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:51.549 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:22:51.550 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:22:51.547+0000 7f3f69f29480 -1 init, newargv = 0x5585ef0503a0 newargc=15 2024-06-10T00:22:51.550 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[70309]: starting ceph client 2024-06-10T00:22:51.552 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[70309]: starting fuse 2024-06-10T00:22:51.564 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:22:51.565 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:22:51.565 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:22:51.566 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:22:51.567 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:51.567 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:22:51.567 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:22:51.682 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.70309.asok 2024-06-10T00:22:51.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:22:51.693 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.70309.asok 2024-06-10T00:22:51.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:51.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.70309.asok status 2024-06-10T00:22:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:22:51.827 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:22:51.827 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:22:51.827 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "70309", 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7875, 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:22:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 7875 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 668832311 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 668832311 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.7875 192.168.0.1:0/668832311", 2024-06-10T00:22:51.829 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/668832311", 2024-06-10T00:22:51.830 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:22:51.830 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 68, 2024-06-10T00:22:51.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 104, 2024-06-10T00:22:51.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:22:51.830 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:22:51.830 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:22:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:22:51.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:51.836 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:22:51.836 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:51.852 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:22:51.852 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:51.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:51.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:51.919 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:51.919 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:51.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:51.975 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-06-10T00:22:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records in 2024-06-10T00:22:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records out 2024-06-10T00:22:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0466089 s, 135 MB/s 2024-06-10T00:22:52.083 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:52.083 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:52.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:22:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.239+0000 7fef4d3a9640 1 Processor -- start 2024-06-10T00:22:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.239+0000 7fef4d3a9640 1 -- start start 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef4d3a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef480730d0 0x7fef480b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef4d3a9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef480b5140 0x7fef480cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef4d3a9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef480b5f80 con 0x7fef48072350 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef4d3a9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fef480b56e0 con 0x7fef480b5140 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef4d3a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef480b59c0 con 0x7fef480730d0 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef477fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef480b5140 0x7fef480cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef477fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef480b5140 0x7fef480cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49314/0 (socket says 172.21.15.79:49314) 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef46ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fef48072350 0x7fef48072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52928/0 (socket says 172.21.15.79:52928) 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef477fe640 1 -- 172.21.15.79:0/2964056597 learned_addr learned my addr 172.21.15.79:0/2964056597 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef477fe640 1 -- 172.21.15.79:0/2964056597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef480730d0 msgr2=0x7fef480b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef467fc640 1 --2- 172.21.15.79:0/2964056597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef480730d0 0x7fef480b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef477fe640 1 --2- 172.21.15.79:0/2964056597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef480730d0 0x7fef480b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef477fe640 1 -- 172.21.15.79:0/2964056597 >> v1:172.21.15.79:6789/0 conn(0x7fef48072350 legacy=0x7fef48072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef45ffb640 1 -- 172.21.15.79:0/2964056597 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869103855 0 0) 0x7fef480b5f80 con 0x7fef48072350 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef477fe640 1 -- 172.21.15.79:0/2964056597 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480b5ca0 con 0x7fef480b5140 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.240+0000 7fef467fc640 1 --2- 172.21.15.79:0/2964056597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef480730d0 0x7fef480b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.241+0000 7fef477fe640 1 --2- 172.21.15.79:0/2964056597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef480cf210 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fef40009870 tx=0x7fef4002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24f2d380f097e47 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.241+0000 7fef45ffb640 1 -- 172.21.15.79:0/2964056597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40037070 con 0x7fef480b5140 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.241+0000 7fef45ffb640 1 -- 172.21.15.79:0/2964056597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40032440 con 0x7fef480b5140 2024-06-10T00:22:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.241+0000 7fef45ffb640 1 -- 172.21.15.79:0/2964056597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40032810 con 0x7fef480b5140 2024-06-10T00:22:52.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.242+0000 7fef4d3a9640 1 -- 172.21.15.79:0/2964056597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 msgr2=0x7fef480cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.242+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/2964056597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef480cf210 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fef40009870 tx=0x7fef4002a1c0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.242+0000 7fef4d3a9640 1 -- 172.21.15.79:0/2964056597 shutdown_connections 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.242+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/2964056597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef480cf210 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.242+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/2964056597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef480730d0 0x7fef480b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.242+0000 7fef4d3a9640 1 -- 172.21.15.79:0/2964056597 >> 172.21.15.79:0/2964056597 conn(0x7fef480b2ae0 msgr2=0x7fef480b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.242+0000 7fef4d3a9640 1 -- 172.21.15.79:0/2964056597 shutdown_connections 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.242+0000 7fef4d3a9640 1 -- 172.21.15.79:0/2964056597 wait complete. 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.243+0000 7fef4d3a9640 1 Processor -- start 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.243+0000 7fef4d3a9640 1 -- start start 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef4d3a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef48072350 0x7fef48154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef4d3a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef480730d0 0x7fef481485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef4d3a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef481f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef4d3a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef4815c630 con 0x7fef480b5140 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef4d3a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef4815c4b0 con 0x7fef480730d0 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef4d3a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef480cf750 con 0x7fef48072350 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef481f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef481f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49322/0 (socket says 172.21.15.79:49322) 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 -- 172.21.15.79:0/1007788559 learned_addr learned my addr 172.21.15.79:0/1007788559 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef46ffd640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef48072350 0x7fef48154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef467fc640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef480730d0 0x7fef481485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 -- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef48072350 msgr2=0x7fef48154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef48072350 0x7fef48154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 -- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef480730d0 msgr2=0x7fef481485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef480730d0 0x7fef481485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 -- 172.21.15.79:0/1007788559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4815e270 con 0x7fef480b5140 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef467fc640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef480730d0 0x7fef481485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.244+0000 7fef477fe640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef481f1fa0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fef40009870 tx=0x7fef400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.245+0000 7fef3f7fe640 1 -- 172.21.15.79:0/1007788559 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40037040 con 0x7fef480b5140 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.245+0000 7fef3f7fe640 1 -- 172.21.15.79:0/1007788559 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40042070 con 0x7fef480b5140 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.245+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef48152150 con 0x7fef480b5140 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.245+0000 7fef3f7fe640 1 -- 172.21.15.79:0/1007788559 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40030bd0 con 0x7fef480b5140 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.245+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef48152430 con 0x7fef480b5140 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.246+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef48068430 con 0x7fef480b5140 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.246+0000 7fef3f7fe640 1 -- 172.21.15.79:0/1007788559 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef4002ad10 con 0x7fef480b5140 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.247+0000 7fef3f7fe640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef2806be30 0x7fef2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.247+0000 7fef46ffd640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef2806be30 0x7fef2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.247+0000 7fef3f7fe640 1 -- 172.21.15.79:0/1007788559 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fef400ab960 con 0x7fef480b5140 2024-06-10T00:22:52.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.247+0000 7fef46ffd640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef2806be30 0x7fef2806e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fef380012e0 tx=0x7fef38007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:52.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.251+0000 7fef3f7fe640 1 -- 172.21.15.79:0/1007788559 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fef4007a180 con 0x7fef480b5140 2024-06-10T00:22:52.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.433+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef480b03a0 con 0x7fef480b5140 2024-06-10T00:22:52.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.433+0000 7fef3f7fe640 1 -- 172.21.15.79:0/1007788559 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7fef40079a80 con 0x7fef480b5140 2024-06-10T00:22:52.433 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:22:52.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef2806be30 msgr2=0x7fef2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef2806be30 0x7fef2806e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fef380012e0 tx=0x7fef38007ed0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 msgr2=0x7fef481f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef481f1fa0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fef40009870 tx=0x7fef400046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 shutdown_connections 2024-06-10T00:22:52.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fef2806be30 0x7fef2806e2f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef480b5140 0x7fef481f1fa0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef480730d0 0x7fef481485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 --2- 172.21.15.79:0/1007788559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef48072350 0x7fef48154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 >> 172.21.15.79:0/1007788559 conn(0x7fef480b2ae0 msgr2=0x7fef480b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:52.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 shutdown_connections 2024-06-10T00:22:52.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.435+0000 7fef4d3a9640 1 -- 172.21.15.79:0/1007788559 wait complete. 2024-06-10T00:22:52.445 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:52.446 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:52.462 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:22:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.602+0000 7f6131e38640 1 Processor -- start 2024-06-10T00:22:52.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.602+0000 7f6131e38640 1 -- start start 2024-06-10T00:22:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6131e38640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c06ebf0 0x7f612c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6131e38640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f612c0cf190 0x7f612c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6131e38640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612c0cf640 con 0x7f612c0ae910 2024-06-10T00:22:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6131e38640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f612c06d130 con 0x7f612c0cf190 2024-06-10T00:22:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6131e38640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f612c06d410 con 0x7f612c06ebf0 2024-06-10T00:22:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f612bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f612c0cf190 0x7f612c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6123fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c06ebf0 0x7f612c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f612b7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f612c0ae910 0x7f612c06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:58608/0 (socket says 172.21.15.79:58608) 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f612b7fe640 1 -- 172.21.15.79:0/1754732243 learned_addr learned my addr 172.21.15.79:0/1754732243 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6123fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c06ebf0 0x7f612c0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:38170/0 (socket says 172.21.15.79:38170) 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6123fff640 1 -- 172.21.15.79:0/1754732243 >> v2:172.21.15.117:3300/0 conn(0x7f612c0cf190 msgr2=0x7f612c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6123fff640 1 --2- 172.21.15.79:0/1754732243 >> v2:172.21.15.117:3300/0 conn(0x7f612c0cf190 0x7f612c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6123fff640 1 -- 172.21.15.79:0/1754732243 >> v1:172.21.15.117:6789/0 conn(0x7f612c0ae910 legacy=0x7f612c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f612affd640 1 -- 172.21.15.79:0/1754732243 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236480087 0 0) 0x7f612c0cf640 con 0x7f612c0ae910 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f6123fff640 1 -- 172.21.15.79:0/1754732243 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c06d6f0 con 0x7f612c06ebf0 2024-06-10T00:22:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.603+0000 7f612bfff640 1 --2- 172.21.15.79:0/1754732243 >> v2:172.21.15.117:3300/0 conn(0x7f612c0cf190 0x7f612c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:22:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.604+0000 7f6123fff640 1 --2- 172.21.15.79:0/1754732243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c06ebf0 0x7f612c0cec50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61140097d0 tx=0x7f611402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd1b18e007b6c86 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.604+0000 7f612affd640 1 -- 172.21.15.79:0/1754732243 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114037070 con 0x7f612c06ebf0 2024-06-10T00:22:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.604+0000 7f612affd640 1 -- 172.21.15.79:0/1754732243 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611402ae40 con 0x7f612c06ebf0 2024-06-10T00:22:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.604+0000 7f612affd640 1 -- 172.21.15.79:0/1754732243 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114032660 con 0x7f612c06ebf0 2024-06-10T00:22:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.605+0000 7f6131e38640 1 -- 172.21.15.79:0/1754732243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c06ebf0 msgr2=0x7f612c0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.605+0000 7f6131e38640 1 --2- 172.21.15.79:0/1754732243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c06ebf0 0x7f612c0cec50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61140097d0 tx=0x7f611402a130 comp rx=0 tx=0).stop 2024-06-10T00:22:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.605+0000 7f6131e38640 1 -- 172.21.15.79:0/1754732243 shutdown_connections 2024-06-10T00:22:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.605+0000 7f6131e38640 1 --2- 172.21.15.79:0/1754732243 >> v2:172.21.15.117:3300/0 conn(0x7f612c0cf190 0x7f612c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.605+0000 7f6131e38640 1 --2- 172.21.15.79:0/1754732243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c06ebf0 0x7f612c0cec50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.605+0000 7f6131e38640 1 -- 172.21.15.79:0/1754732243 >> 172.21.15.79:0/1754732243 conn(0x7f612c0b19f0 msgr2=0x7f612c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.605+0000 7f6131e38640 1 -- 172.21.15.79:0/1754732243 shutdown_connections 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.605+0000 7f6131e38640 1 -- 172.21.15.79:0/1754732243 wait complete. 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.606+0000 7f6131e38640 1 Processor -- start 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.606+0000 7f6131e38640 1 -- start start 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6131e38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c06ebf0 0x7f612c14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6131e38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f612c0ae910 0x7f612c154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6131e38640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c0cf190 0x7f612c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6131e38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f612c0ad280 con 0x7f612c0ae910 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6131e38640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f612c0aecf0 con 0x7f612c06ebf0 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6131e38640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f612c0ad400 con 0x7f612c0cf190 2024-06-10T00:22:52.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6123fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f612c0ae910 0x7f612c154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6123fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f612c0ae910 0x7f612c154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49324/0 (socket says 172.21.15.79:49324) 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6123fff640 1 -- 172.21.15.79:0/654050050 learned_addr learned my addr 172.21.15.79:0/654050050 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f612bfff640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c0cf190 0x7f612c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f612b7fe640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c06ebf0 0x7f612c14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6123fff640 1 -- 172.21.15.79:0/654050050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c0cf190 msgr2=0x7f612c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6123fff640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c0cf190 0x7f612c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6123fff640 1 -- 172.21.15.79:0/654050050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c06ebf0 msgr2=0x7f612c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6123fff640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c06ebf0 0x7f612c14f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.607+0000 7f6123fff640 1 -- 172.21.15.79:0/654050050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c15b680 con 0x7f612c0ae910 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.608+0000 7f6123fff640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f612c0ae910 0x7f612c154f50 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6114000c00 tx=0x7f61140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.608+0000 7f6128ff9640 1 -- 172.21.15.79:0/654050050 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114037040 con 0x7f612c0ae910 2024-06-10T00:22:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.608+0000 7f6128ff9640 1 -- 172.21.15.79:0/654050050 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6114004030 con 0x7f612c0ae910 2024-06-10T00:22:52.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.608+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612c15b960 con 0x7f612c0ae910 2024-06-10T00:22:52.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.608+0000 7f6128ff9640 1 -- 172.21.15.79:0/654050050 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114006e10 con 0x7f612c0ae910 2024-06-10T00:22:52.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.608+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612c14fb20 con 0x7f612c0ae910 2024-06-10T00:22:52.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.609+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612c068430 con 0x7f612c0ae910 2024-06-10T00:22:52.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.609+0000 7f6128ff9640 1 -- 172.21.15.79:0/654050050 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6114004220 con 0x7f612c0ae910 2024-06-10T00:22:52.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.609+0000 7f6128ff9640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f610c06be30 0x7f610c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:52.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.610+0000 7f6128ff9640 1 -- 172.21.15.79:0/654050050 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f61140ab460 con 0x7f612c0ae910 2024-06-10T00:22:52.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.610+0000 7f612b7fe640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f610c06be30 0x7f610c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:52.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.610+0000 7f612b7fe640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f610c06be30 0x7f610c06e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f611c000f60 tx=0x7f611c007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:52.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.614+0000 7f6128ff9640 1 -- 172.21.15.79:0/654050050 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6114042020 con 0x7f612c0ae910 2024-06-10T00:22:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.799+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f612c0b3f90 con 0x7f612c0ae910 2024-06-10T00:22:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.800+0000 7f6128ff9640 1 -- 172.21.15.79:0/654050050 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7f61140796c0 con 0x7f612c0ae910 2024-06-10T00:22:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:22:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f610c06be30 msgr2=0x7f610c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f610c06be30 0x7f610c06e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f611c000f60 tx=0x7f611c007d50 comp rx=0 tx=0).stop 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f612c0ae910 msgr2=0x7f612c154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f612c0ae910 0x7f612c154f50 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6114000c00 tx=0x7f61140046c0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 shutdown_connections 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f610c06be30 0x7f610c06e2f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f612c0cf190 0x7f612c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f612c0ae910 0x7f612c154f50 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 --2- 172.21.15.79:0/654050050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c06ebf0 0x7f612c14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 >> 172.21.15.79:0/654050050 conn(0x7f612c0b19f0 msgr2=0x7f612c06e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 shutdown_connections 2024-06-10T00:22:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:52.802+0000 7f6131e38640 1 -- 172.21.15.79:0/654050050 wait complete. 2024-06-10T00:22:52.812 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:22:52.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:52.812 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:52.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[70309]: fuse finished with error 0 and tester_r 0 2024-06-10T00:22:52.837 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:22:52.937 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:22:52.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:52.937 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:22:52.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:53.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.093+0000 7ff221aa5640 1 Processor -- start 2024-06-10T00:22:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.093+0000 7ff221aa5640 1 -- start start 2024-06-10T00:22:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff221aa5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0aef70 0x7ff21c0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff221aa5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff21c0af3b0 0x7ff21c0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff221aa5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21c15ac50 con 0x7ff21c15a870 2024-06-10T00:22:53.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff221aa5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff21c0b4fe0 con 0x7ff21c0af3b0 2024-06-10T00:22:53.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff221aa5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff21c06cdb0 con 0x7ff21c0aef70 2024-06-10T00:22:53.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff21bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff21c0af3b0 0x7ff21c0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff213fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0aef70 0x7ff21c0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff213fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0aef70 0x7ff21c0b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:38184/0 (socket says 172.21.15.79:38184) 2024-06-10T00:22:53.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff213fff640 1 -- 172.21.15.79:0/4024483218 learned_addr learned my addr 172.21.15.79:0/4024483218 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:53.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff213fff640 1 -- 172.21.15.79:0/4024483218 >> v2:172.21.15.117:3300/0 conn(0x7ff21c0af3b0 msgr2=0x7ff21c0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:53.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff213fff640 1 --2- 172.21.15.79:0/4024483218 >> v2:172.21.15.117:3300/0 conn(0x7ff21c0af3b0 0x7ff21c0b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff213fff640 1 -- 172.21.15.79:0/4024483218 >> v1:172.21.15.117:6789/0 conn(0x7ff21c15a870 legacy=0x7ff21c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.094+0000 7ff213fff640 1 -- 172.21.15.79:0/4024483218 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21c06d090 con 0x7ff21c0aef70 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.095+0000 7ff213fff640 1 --2- 172.21.15.79:0/4024483218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0aef70 0x7ff21c0b4560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff204009870 tx=0x7ff20402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48889a185e586595 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.095+0000 7ff21affd640 1 -- 172.21.15.79:0/4024483218 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204037070 con 0x7ff21c0aef70 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.095+0000 7ff21affd640 1 -- 172.21.15.79:0/4024483218 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff204032440 con 0x7ff21c0aef70 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.095+0000 7ff21affd640 1 -- 172.21.15.79:0/4024483218 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204032810 con 0x7ff21c0aef70 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.096+0000 7ff221aa5640 1 -- 172.21.15.79:0/4024483218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0aef70 msgr2=0x7ff21c0b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.096+0000 7ff221aa5640 1 --2- 172.21.15.79:0/4024483218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0aef70 0x7ff21c0b4560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff204009870 tx=0x7ff20402a1c0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.096+0000 7ff221aa5640 1 -- 172.21.15.79:0/4024483218 shutdown_connections 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.096+0000 7ff221aa5640 1 --2- 172.21.15.79:0/4024483218 >> v2:172.21.15.117:3300/0 conn(0x7ff21c0af3b0 0x7ff21c0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.096+0000 7ff221aa5640 1 --2- 172.21.15.79:0/4024483218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0aef70 0x7ff21c0b4560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.096+0000 7ff221aa5640 1 -- 172.21.15.79:0/4024483218 >> 172.21.15.79:0/4024483218 conn(0x7ff21c0b19f0 msgr2=0x7ff21c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.096+0000 7ff221aa5640 1 -- 172.21.15.79:0/4024483218 shutdown_connections 2024-06-10T00:22:53.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.096+0000 7ff221aa5640 1 -- 172.21.15.79:0/4024483218 wait complete. 2024-06-10T00:22:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.097+0000 7ff221aa5640 1 Processor -- start 2024-06-10T00:22:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.097+0000 7ff221aa5640 1 -- start start 2024-06-10T00:22:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff221aa5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21c0aef70 0x7ff21c166910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff221aa5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0af3b0 0x7ff21c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff221aa5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff21c15a870 0x7ff21c146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff221aa5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c06d930 con 0x7ff21c15a870 2024-06-10T00:22:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff221aa5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c06d650 con 0x7ff21c0aef70 2024-06-10T00:22:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff221aa5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff21c0b2e40 con 0x7ff21c0af3b0 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff21c15a870 0x7ff21c146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff21c15a870 0x7ff21c146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49332/0 (socket says 172.21.15.79:49332) 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 -- 172.21.15.79:0/2826425409 learned_addr learned my addr 172.21.15.79:0/2826425409 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff213fff640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0af3b0 0x7ff21c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21b7fe640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21c0aef70 0x7ff21c166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 -- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0af3b0 msgr2=0x7ff21c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0af3b0 0x7ff21c15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 -- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21c0aef70 msgr2=0x7ff21c166910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21c0aef70 0x7ff21c166910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 -- 172.21.15.79:0/2826425409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21c09d8c0 con 0x7ff21c15a870 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff213fff640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0af3b0 0x7ff21c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21b7fe640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21c0aef70 0x7ff21c166910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.098+0000 7ff21bfff640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff21c15a870 0x7ff21c146bc0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7ff214009dd0 tx=0x7ff21400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.099+0000 7ff218ff9640 1 -- 172.21.15.79:0/2826425409 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214018020 con 0x7ff21c15a870 2024-06-10T00:22:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.099+0000 7ff218ff9640 1 -- 172.21.15.79:0/2826425409 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff214014480 con 0x7ff21c15a870 2024-06-10T00:22:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.099+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21c15af90 con 0x7ff21c15a870 2024-06-10T00:22:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.099+0000 7ff218ff9640 1 -- 172.21.15.79:0/2826425409 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214014870 con 0x7ff21c15a870 2024-06-10T00:22:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.099+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff21c09d300 con 0x7ff21c15a870 2024-06-10T00:22:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.100+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21c15b160 con 0x7ff21c15a870 2024-06-10T00:22:53.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.100+0000 7ff218ff9640 1 -- 172.21.15.79:0/2826425409 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff214005d10 con 0x7ff21c15a870 2024-06-10T00:22:53.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.100+0000 7ff218ff9640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.101+0000 7ff21b7fe640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.101+0000 7ff218ff9640 1 -- 172.21.15.79:0/2826425409 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7ff21408baf0 con 0x7ff21c15a870 2024-06-10T00:22:53.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.101+0000 7ff21b7fe640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0aee60 tx=0x7ff20c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.105+0000 7ff218ff9640 1 -- 172.21.15.79:0/2826425409 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff214022070 con 0x7ff21c15a870 2024-06-10T00:22:53.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.314+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff21c0b2650 con 0x7ff21c15a870 2024-06-10T00:22:53.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.315+0000 7ff218ff9640 1 -- 172.21.15.79:0/2826425409 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7ff214010040 con 0x7ff21c15a870 2024-06-10T00:22:53.314 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:53.315 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:22:42.806547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7698":{"gid":7698,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2980295924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2980295924},{"type":"v1","addr":"172.21.15.79:6837","nonce":2980295924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7698,"qdb_cluster":[7698]},"id":7}]} 2024-06-10T00:22:53.315 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1fc06be30 msgr2=0x7ff1fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0aee60 tx=0x7ff20c009040 comp rx=0 tx=0).stop 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff21c15a870 msgr2=0x7ff21c146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff21c15a870 0x7ff21c146bc0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7ff214009dd0 tx=0x7ff21400c490 comp rx=0 tx=0).stop 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 shutdown_connections 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff21c15a870 0x7ff21c146bc0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21c0af3b0 0x7ff21c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 --2- 172.21.15.79:0/2826425409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21c0aef70 0x7ff21c166910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 >> 172.21.15.79:0/2826425409 conn(0x7ff21c0b19f0 msgr2=0x7ff21c159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 shutdown_connections 2024-06-10T00:22:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.317+0000 7ff221aa5640 1 -- 172.21.15.79:0/2826425409 wait complete. 2024-06-10T00:22:53.328 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-06-10T00:22:53.450 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0} 2024-06-10T00:22:53.450 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:22:53.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:22:53.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.553+0000 7f081b209640 1 Processor -- start 2024-06-10T00:22:53.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.553+0000 7f081b209640 1 -- start start 2024-06-10T00:22:53.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f081b209640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 0x7f0814165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f081b209640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f081406d130 con 0x7f08140ae910 2024-06-10T00:22:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f081b209640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f081406d410 con 0x7f081406ebf0 2024-06-10T00:22:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f081b209640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f081406d6f0 con 0x7f08140add50 2024-06-10T00:22:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f0818fa5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f08140ae910 0x7f081406e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52942/0 (socket says 172.21.15.79:52942) 2024-06-10T00:22:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f0818fa5640 1 -- 172.21.15.79:0/3218260390 learned_addr learned my addr 172.21.15.79:0/3218260390 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08197a6640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 0x7f0814165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816693208 0 0) 0x7f081406d130 con 0x7f08140ae910 2024-06-10T00:22:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0804003520 con 0x7f08140ae910 2024-06-10T00:22:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3584744292 0 0) 0x7f0804003520 con 0x7f08140ae910 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 msgr2=0x7f0814165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 0x7f0814165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 >> v1:172.21.15.117:6789/0 conn(0x7f081406ebf0 legacy=0x7f08140cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081406d9d0 con 0x7f08140ae910 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f0808001670 con 0x7f08140ae910 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 >> v1:172.21.15.79:6789/0 conn(0x7f08140ae910 legacy=0x7f081406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08040039e0 0x7f0804003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 0x7f0804004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.554+0000 7f08137fe640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0804004d40 0x7f08040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f081406d6f0 con 0x7f0804004d40 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f080400bb20 con 0x7f08040039e0 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f080400bd20 con 0x7f08140add50 2024-06-10T00:22:53.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08197a6640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0804004d40 0x7f08040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f0818fa5640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08040039e0 0x7f0804003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f0813fff640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 0x7f0804004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08197a6640 1 -- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 msgr2=0x7f0804004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08197a6640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 0x7f0804004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08197a6640 1 -- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08040039e0 msgr2=0x7f0804003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08197a6640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08040039e0 0x7f0804003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08197a6640 1 -- 172.21.15.79:0/3218260390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0804003520 con 0x7f0804004d40 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f0813fff640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08140add50 0x7f0804004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.555+0000 7f08197a6640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0804004d40 0x7f08040051c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f081406dcf0 tx=0x7f0804005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c9ed48aece171c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c037070 con 0x7f0804004d40 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c02e050 con 0x7f0804004d40 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f08137fe640 1 -- 172.21.15.79:0/3218260390 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c009c10 con 0x7f0804004d40 2024-06-10T00:22:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f081b209640 1 -- 172.21.15.79:0/3218260390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0804004d40 msgr2=0x7f08040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f081b209640 1 --2- 172.21.15.79:0/3218260390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0804004d40 0x7f08040051c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f081406dcf0 tx=0x7f0804005830 comp rx=0 tx=0).stop 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f08197a6640 1 -- 172.21.15.79:0/3218260390 reap_dead start 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f081b209640 1 -- 172.21.15.79:0/3218260390 shutdown_connections 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f081b209640 1 -- 172.21.15.79:0/3218260390 >> 172.21.15.79:0/3218260390 conn(0x7f08140b19f0 msgr2=0x7f08140b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f081b209640 1 -- 172.21.15.79:0/3218260390 shutdown_connections 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.556+0000 7f081b209640 1 -- 172.21.15.79:0/3218260390 wait complete. 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.557+0000 7f081b209640 1 Processor -- start 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.557+0000 7f081b209640 1 -- start start 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f081b209640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0804004d40 0x7f0814144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f081b209640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08141585c0 0x7f081415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f081b209640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081415d460 0x7f08141e3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f081b209640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08140cf4e0 con 0x7f081415d460 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f081b209640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f08140cf360 con 0x7f08141585c0 2024-06-10T00:22:53.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f081b209640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f08140cf660 con 0x7f0804004d40 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f08197a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081415d460 0x7f08141e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f08197a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081415d460 0x7f08141e3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49352/0 (socket says 172.21.15.79:49352) 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f08197a6640 1 -- 172.21.15.79:0/3921733413 learned_addr learned my addr 172.21.15.79:0/3921733413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f0818fa5640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0804004d40 0x7f0814144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.558+0000 7f0813fff640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08141585c0 0x7f081415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08197a6640 1 -- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0804004d40 msgr2=0x7f0814144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08197a6640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0804004d40 0x7f0814144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08197a6640 1 -- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08141585c0 msgr2=0x7f081415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08197a6640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08141585c0 0x7f081415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08197a6640 1 -- 172.21.15.79:0/3921733413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081415d8e0 con 0x7f081415d460 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f0813fff640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08141585c0 0x7f081415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:53.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08197a6640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081415d460 0x7f08141e3850 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f080c00e230 tx=0x7f080c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08117fa640 1 -- 172.21.15.79:0/3921733413 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c037040 con 0x7f081415d460 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08117fa640 1 -- 172.21.15.79:0/3921733413 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c044070 con 0x7f081415d460 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081415dbc0 con 0x7f081415d460 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f08117fa640 1 -- 172.21.15.79:0/3921733413 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c009c10 con 0x7f081415d460 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.559+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08141457d0 con 0x7f081415d460 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.560+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0814068430 con 0x7f081415d460 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.560+0000 7f08117fa640 1 -- 172.21.15.79:0/3921733413 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f080c005d10 con 0x7f081415d460 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.561+0000 7f08117fa640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07f806bd70 0x7f07f806e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.561+0000 7f08117fa640 1 -- 172.21.15.79:0/3921733413 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f080c0aba00 con 0x7f081415d460 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.561+0000 7f0818fa5640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07f806bd70 0x7f07f806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.561+0000 7f0818fa5640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07f806bd70 0x7f07f806e230 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0808001eb0 tx=0x7f0808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.565+0000 7f08117fa640 1 -- 172.21.15.79:0/3921733413 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f080c04e020 con 0x7f081415d460 2024-06-10T00:22:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.774+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08140b20b0 con 0x7f081415d460 2024-06-10T00:22:53.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.774+0000 7f08117fa640 1 -- 172.21.15.79:0/3921733413 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7f080c07a3d0 con 0x7f081415d460 2024-06-10T00:22:53.774 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:22:53.774 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:22:42.806547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7698":{"gid":7698,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2980295924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2980295924},{"type":"v1","addr":"172.21.15.79:6837","nonce":2980295924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7698,"qdb_cluster":[7698]},"id":7}]} 2024-06-10T00:22:53.774 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-06-10T00:22:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07f806bd70 msgr2=0x7f07f806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07f806bd70 0x7f07f806e230 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0808001eb0 tx=0x7f0808009040 comp rx=0 tx=0).stop 2024-06-10T00:22:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081415d460 msgr2=0x7f08141e3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081415d460 0x7f08141e3850 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f080c00e230 tx=0x7f080c009750 comp rx=0 tx=0).stop 2024-06-10T00:22:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 shutdown_connections 2024-06-10T00:22:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f07f806bd70 0x7f07f806e230 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081415d460 0x7f08141e3850 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08141585c0 0x7f081415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 --2- 172.21.15.79:0/3921733413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0804004d40 0x7f0814144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 >> 172.21.15.79:0/3921733413 conn(0x7f08140b19f0 msgr2=0x7f08140cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 shutdown_connections 2024-06-10T00:22:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.776+0000 7f081b209640 1 -- 172.21.15.79:0/3921733413 wait complete. 2024-06-10T00:22:53.787 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-06-10T00:22:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.831+0000 7f93ee023f40 1 Processor -- start 2024-06-10T00:22:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.831+0000 7f93ee023f40 1 -- start start 2024-06-10T00:22:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ee023f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d31dce0 0x563c6d3d6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ee023f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d34a080 0x563c6d3f1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ee023f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d363b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ee023f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563c6d2c2e30 con 0x563c6d3ef950 2024-06-10T00:22:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ee023f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563c6d2c6e70 con 0x563c6d31dce0 2024-06-10T00:22:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ee023f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563c6d34b220 con 0x563c6d34a080 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d363b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d363b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49364/0 (socket says 172.21.15.79:49364) 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 -- 172.21.15.79:0/2005961655 learned_addr learned my addr 172.21.15.79:0/2005961655 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93e3323640 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d34a080 0x563c6d3f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ebb24640 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d31dce0 0x563c6d3d6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 -- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d34a080 msgr2=0x563c6d3f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d34a080 0x563c6d3f1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 -- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d31dce0 msgr2=0x563c6d3d6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d31dce0 0x563c6d3d6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 -- 172.21.15.79:0/2005961655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6d3eee10 con 0x563c6d3ef950 2024-06-10T00:22:53.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93e3323640 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d34a080 0x563c6d3f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ebb24640 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d31dce0 0x563c6d3d6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93ec325640 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d363b70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f93e4001630 tx=0x7f93e4001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e8a69e2c839e78 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93eab22640 1 -- 172.21.15.79:0/2005961655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4004520 con 0x563c6d3ef950 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93eab22640 1 -- 172.21.15.79:0/2005961655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e40046c0 con 0x563c6d3ef950 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.832+0000 7f93eab22640 1 -- 172.21.15.79:0/2005961655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4004a90 con 0x563c6d3ef950 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 -- 172.21.15.79:0/2005961655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 msgr2=0x563c6d363b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d363b70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f93e4001630 tx=0x7f93e4001af0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 -- 172.21.15.79:0/2005961655 shutdown_connections 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d363b70 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d34a080 0x563c6d3f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 --2- 172.21.15.79:0/2005961655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d31dce0 0x563c6d3d6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 -- 172.21.15.79:0/2005961655 >> 172.21.15.79:0/2005961655 conn(0x563c6d31c280 msgr2=0x563c6d3f0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 -- 172.21.15.79:0/2005961655 shutdown_connections 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 -- 172.21.15.79:0/2005961655 wait complete. 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 Processor -- start 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.833+0000 7f93ee023f40 1 -- start start 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ee023f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d31dce0 0x563c6d482860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ee023f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d34a080 0x563c6d481830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ee023f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d360500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ee023f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563c6d3475b0 con 0x563c6d3ef950 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ee023f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563c6d3d9f60 con 0x563c6d34a080 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ee023f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563c6d3ee9a0 con 0x563c6d31dce0 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ec325640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d360500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ec325640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d360500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49366/0 (socket says 172.21.15.79:49366) 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ec325640 1 -- 172.21.15.79:0/270467931 learned_addr learned my addr 172.21.15.79:0/270467931 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ebb24640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d31dce0 0x563c6d482860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93e3323640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d34a080 0x563c6d481830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ec325640 1 -- 172.21.15.79:0/270467931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d31dce0 msgr2=0x563c6d482860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ec325640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563c6d31dce0 0x563c6d482860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ec325640 1 -- 172.21.15.79:0/270467931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d34a080 msgr2=0x563c6d481830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ec325640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563c6d34a080 0x563c6d481830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.834+0000 7f93ec325640 1 -- 172.21.15.79:0/270467931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6d482da0 con 0x563c6d3ef950 2024-06-10T00:22:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.835+0000 7f93ec325640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d360500 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f93e4001b30 tx=0x7f93e4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.835+0000 7f93e9b20640 1 -- 172.21.15.79:0/270467931 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4021030 con 0x563c6d3ef950 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.835+0000 7f93e9b20640 1 -- 172.21.15.79:0/270467931 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e4006d10 con 0x563c6d3ef950 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.835+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c6d3d8d60 con 0x563c6d3ef950 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.835+0000 7f93e9b20640 1 -- 172.21.15.79:0/270467931 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4018040 con 0x563c6d3ef950 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.835+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6d361f10 con 0x563c6d3ef950 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.836+0000 7f93e9b20640 1 -- 172.21.15.79:0/270467931 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93e4024070 con 0x563c6d3ef950 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.836+0000 7f93e9b20640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f93cc06a810 0x7f93cc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93e9b20640 1 -- 172.21.15.79:0/270467931 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f93e408acc0 con 0x563c6d3ef950 2024-06-10T00:22:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93ebb24640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f93cc06a810 0x7f93cc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93ee023f40 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x563c6d481d70 0x563c6d360a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x563c6d482250 con 0x563c6d481d70 2024-06-10T00:22:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93e3323640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x563c6d481d70 0x563c6d360a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93ebb24640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f93cc06a810 0x7f93cc06ccd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f93dc005fd0 tx=0x7f93dc00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93e3323640 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x563c6d481d70 0x563c6d360a40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93e3323640 1 -- 172.21.15.79:0/270467931 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7f93d4054870 con 0x563c6d481d70 2024-06-10T00:22:53.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x563c6d481d70 msgr2=0x563c6d360a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.837+0000 7f93ee023f40 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x563c6d481d70 0x563c6d360a40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f93cc06a810 msgr2=0x7f93cc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ee023f40 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f93cc06a810 0x7f93cc06ccd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f93dc005fd0 tx=0x7f93dc00d040 comp rx=0 tx=0).stop 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 msgr2=0x563c6d360500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ee023f40 1 --2- 172.21.15.79:0/270467931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c6d3ef950 0x563c6d360500 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f93e4001b30 tx=0x7f93e4000f40 comp rx=0 tx=0).stop 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ec325640 1 -- 172.21.15.79:0/270467931 reap_dead start 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 shutdown_connections 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 >> 172.21.15.79:0/270467931 conn(0x563c6d31c280 msgr2=0x563c6d3f0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 shutdown_connections 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.838+0000 7f93ee023f40 1 -- 172.21.15.79:0/270467931 wait complete. 2024-06-10T00:22:53.845 INFO:teuthology.orchestra.run.smithi079.stdout:����� 2024-06-10T00:22:53.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:22:53.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.984+0000 7fb60024d640 1 Processor -- start 2024-06-10T00:22:53.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.984+0000 7fb60024d640 1 -- start start 2024-06-10T00:22:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.985+0000 7fb60024d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5f80d1fc0 0x7fb5f80cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.985+0000 7fb60024d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f815f5e0 con 0x7fb5f80d2680 2024-06-10T00:22:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.985+0000 7fb60024d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f80d0ad0 con 0x7fb5f815f1a0 2024-06-10T00:22:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.985+0000 7fb60024d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f80d13e0 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.985+0000 7fb5fe7ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5f80d1fc0 0x7fb5f80cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.985+0000 7fb5fdfe9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb5f80d2680 0x7fb5f80d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52972/0 (socket says 172.21.15.79:52972) 2024-06-10T00:22:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.985+0000 7fb5fdfe9640 1 -- 172.21.15.79:0/1171988372 learned_addr learned my addr 172.21.15.79:0/1171988372 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.986+0000 7fb5fe7ea640 1 -- 172.21.15.79:0/1171988372 >> v1:172.21.15.117:6789/0 conn(0x7fb5f815f1a0 legacy=0x7fb5f80cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.986+0000 7fb5fe7ea640 1 -- 172.21.15.79:0/1171988372 >> v1:172.21.15.79:6789/0 conn(0x7fb5f80d2680 legacy=0x7fb5f80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.986+0000 7fb5fe7ea640 1 -- 172.21.15.79:0/1171988372 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f815f890 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.986+0000 7fb5fcfe7640 1 -- 172.21.15.79:0/1171988372 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973185098 0 0) 0x7fb5f815f5e0 con 0x7fb5f80d2680 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.986+0000 7fb5fe7ea640 1 --2- 172.21.15.79:0/1171988372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80cf680 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009d90 tx=0x7fb5f002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d038d84f472b954 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb5fcfe7640 1 -- 172.21.15.79:0/1171988372 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007740 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb5fcfe7640 1 -- 172.21.15.79:0/1171988372 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f00078e0 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb5fcfe7640 1 -- 172.21.15.79:0/1171988372 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007cb0 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb60024d640 1 -- 172.21.15.79:0/1171988372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 msgr2=0x7fb5f80cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb60024d640 1 --2- 172.21.15.79:0/1171988372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80cf680 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009d90 tx=0x7fb5f002a6a0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb60024d640 1 -- 172.21.15.79:0/1171988372 shutdown_connections 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb60024d640 1 --2- 172.21.15.79:0/1171988372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80cf680 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb60024d640 1 -- 172.21.15.79:0/1171988372 >> 172.21.15.79:0/1171988372 conn(0x7fb5f809d3f0 msgr2=0x7fb5f80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb60024d640 1 -- 172.21.15.79:0/1171988372 shutdown_connections 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.987+0000 7fb60024d640 1 -- 172.21.15.79:0/1171988372 wait complete. 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.988+0000 7fb60024d640 1 Processor -- start 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.988+0000 7fb60024d640 1 -- start start 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb60024d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb60024d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5f80d2680 0x7fb5f815c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb60024d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5f815f1a0 0x7fb5f81f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb60024d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f80d2410 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb60024d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f80d1070 con 0x7fb5f815f1a0 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb60024d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f80d4f00 con 0x7fb5f80d2680 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fdfe9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fdfe9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49380/0 (socket says 172.21.15.79:49380) 2024-06-10T00:22:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fdfe9640 1 -- 172.21.15.79:0/70914797 learned_addr learned my addr 172.21.15.79:0/70914797 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fd7e8640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5f80d2680 0x7fb5f815c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fe7ea640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5f815f1a0 0x7fb5f81f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fdfe9640 1 -- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5f80d2680 msgr2=0x7fb5f815c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fdfe9640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5f80d2680 0x7fb5f815c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fdfe9640 1 -- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5f815f1a0 msgr2=0x7fb5f81f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.989+0000 7fb5fdfe9640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5f815f1a0 0x7fb5f81f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.990+0000 7fb5fdfe9640 1 -- 172.21.15.79:0/70914797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f815da50 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.990+0000 7fb5fe7ea640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5f815f1a0 0x7fb5f81f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.990+0000 7fb5fdfe9640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80c7bf0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800c4d0 tx=0x7fb5e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.990+0000 7fb5f67fc640 1 -- 172.21.15.79:0/70914797 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8018070 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.990+0000 7fb5f67fc640 1 -- 172.21.15.79:0/70914797 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8007500 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.990+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f815d1b0 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.990+0000 7fb5f67fc640 1 -- 172.21.15.79:0/70914797 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004a20 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.990+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f815d770 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.991+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f8068430 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.991+0000 7fb5f67fc640 1 -- 172.21.15.79:0/70914797 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5e801b070 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.992+0000 7fb5f67fc640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb5e406be30 0x7fb5e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.992+0000 7fb5f67fc640 1 -- 172.21.15.79:0/70914797 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fb5e808a200 con 0x7fb5f80d1fc0 2024-06-10T00:22:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.992+0000 7fb5fd7e8640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb5e406be30 0x7fb5e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.992+0000 7fb5fd7e8640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb5e406be30 0x7fb5e406e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb5f815c690 tx=0x7fb5ec009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:53.996+0000 7fb5f67fc640 1 -- 172.21.15.79:0/70914797 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb5e8058460 con 0x7fb5f80d1fc0 2024-06-10T00:22:54.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.208+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb5f80d04e0 con 0x7fb5f80d1fc0 2024-06-10T00:22:54.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.209+0000 7fb5f67fc640 1 -- 172.21.15.79:0/70914797 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7fb5e805c760 con 0x7fb5f80d1fc0 2024-06-10T00:22:54.209 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:22:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb5e406be30 msgr2=0x7fb5e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb5e406be30 0x7fb5e406e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb5f815c690 tx=0x7fb5ec009060 comp rx=0 tx=0).stop 2024-06-10T00:22:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 msgr2=0x7fb5f80c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80c7bf0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800c4d0 tx=0x7fb5e800c990 comp rx=0 tx=0).stop 2024-06-10T00:22:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 shutdown_connections 2024-06-10T00:22:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb5e406be30 0x7fb5e406e2f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:54.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5f815f1a0 0x7fb5f81f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:54.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5f80d2680 0x7fb5f815c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:54.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 --2- 172.21.15.79:0/70914797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5f80d1fc0 0x7fb5f80c7bf0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:54.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 >> 172.21.15.79:0/70914797 conn(0x7fb5f809d3f0 msgr2=0x7fb5f80b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:54.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 shutdown_connections 2024-06-10T00:22:54.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54.211+0000 7fb60024d640 1 -- 172.21.15.79:0/70914797 wait complete. 2024-06-10T00:22:54.222 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:22:54.222 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:22:54.222 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:22:54.222 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:22:54.222 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:54.223 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:22:54.223 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:22:54.223 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:22:54.223 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:22:54.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:54.224 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:22:54.240 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:22:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:22:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:22:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:22:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:54.241 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:22:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:22:54.242 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:22:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:22:54.242 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:22:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:54.243 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:22:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:22:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42270sec preferred_lft 42270sec 2024-06-10T00:22:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:22:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:54.244 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:22:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:22:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:22:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:22:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:54.245 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:22:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:22:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:54.245 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:22:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:22:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:22:54.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:54.246 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:22:54.305 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:22:54.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:54.307 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:22:54.363 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:22:54.363 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:22:54.363 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:22:54.363 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:22:54.363 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:22:54.364 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:22:54.364 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:22:54.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:22:54.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:22:54.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:22:54.364 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:22:54.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:22:54.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:22:54.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:54.489 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:22:54.505 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:22:54.505 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:22:54.505 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:22:54.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:54.505 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:22:54.570 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:22:54.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:22:54.571 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:54.626 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:22:54.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:22:54.626 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:54.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:22:54.746 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:22:54.805 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:22:54.805 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:22:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:22:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:22:54.808 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:22:54.808 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:22:54.808 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:54.808 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:54.808 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:54.808 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:54.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:54.809 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:22:54.866 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:22:54.866 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:22:54.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:22:54.936 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:22:54.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:22:54.991+0000 7f3aeb41b480 -1 init, newargv = 0x55c8d9d98600 newargc=15 2024-06-10T00:22:54.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[71052]: starting ceph client 2024-06-10T00:22:54.995 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:22:54.995 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:22:54.995 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:22:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:22:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:22:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:22:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:22:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:22:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:22:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:22:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:22:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:22:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:22:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:22:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:22:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:22:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:22:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:22:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:22:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:22:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:22:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:22:54.999 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:22:54.999 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:22:54.999 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:22:54.999 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:22:54.999 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:22:54.999 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:22:55.000 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:22:55.000 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:22:55.001 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:55.001 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:22:55.002 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:55.002 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:22:55.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:55.004 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:22:55.005 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[71052]: starting fuse 2024-06-10T00:22:55.054 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:22:55.054 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:22:55.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:22:55.055 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:22:55.055 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:22:55.055 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:22:55.055 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:22:55.056 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:55.056 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:22:55.056 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:22:55.056 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:22:55.056 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:22:55.056 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:55.057 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:22:55.057 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:22:55.057 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:22:55.057 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:22:55.057 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:55.058 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:22:55.058 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:22:55.058 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:22:55.058 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:22:55.058 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:22:55.058 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:22:55.059 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:22:55.059 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:22:55.059 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:55.059 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:22:55.059 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:22:55.173 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.71052.asok 2024-06-10T00:22:55.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:22:55.184 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.71052.asok 2024-06-10T00:22:55.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:55.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.71052.asok status 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "71052", 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:22:55.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:55.321 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:22:55.321 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:22:55.321 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7923, 2024-06-10T00:22:55.321 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:22:55.321 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:22:55.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:22:55.321 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 7923 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2755751960 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:22:55.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:22:55.323 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:22:55.323 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2755751960 2024-06-10T00:22:55.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:22:55.323 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.7923 192.168.0.1:0/2755751960", 2024-06-10T00:22:55.323 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/2755751960", 2024-06-10T00:22:55.324 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:22:55.324 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 68, 2024-06-10T00:22:55.324 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 104, 2024-06-10T00:22:55.324 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:22:55.324 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:22:55.324 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:22:55.324 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:22:55.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:55.328 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:22:55.328 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:55.344 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:22:55.344 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:55.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:55.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:55.411 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:55.411 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:55.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:55.468 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-06-10T00:22:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records in 2024-06-10T00:22:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records out 2024-06-10T00:22:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0401954 s, 157 MB/s 2024-06-10T00:22:55.568 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:55.568 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:55.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:55.585 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-06-10T00:22:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records in 2024-06-10T00:22:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:6+0 records out 2024-06-10T00:22:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0406734 s, 155 MB/s 2024-06-10T00:22:55.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:55.684 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-06-10T00:22:55.702 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-06-10T00:22:55.702 INFO:teuthology.orchestra.run.smithi079.stdout:./file2_sixmegs 2024-06-10T00:22:55.702 INFO:teuthology.orchestra.run.smithi079.stdout:./file3_sixmegs 2024-06-10T00:22:55.702 INFO:teuthology.orchestra.run.smithi079.stdout:./file1_sixmegs 2024-06-10T00:22:55.702 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:22:55.702 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:22:55.703 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:22:55.703 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:55.703 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-06-10T00:22:55.703 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:22:55.808 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:22:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:22:55.817 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:22:55.817 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:22:55.817 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:22:55.817 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:55.817 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-06-10T00:22:55.817 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:22:55.922 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-06-10T00:22:55.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:22:55.931 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:22:55.931 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:22:55.931 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:22:55.931 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:55.931 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-06-10T00:22:55.931 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:22:56.037 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-06-10T00:22:56.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:22:56.046 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:22:56.047 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:22:56.047 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:22:56.047 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:22:56.047 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-06-10T00:22:56.047 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:22:56.151 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-06-10T00:22:56.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:22:56.159 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:56.159 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:56.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:22:56.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.355+0000 7fcb731f4640 1 Processor -- start 2024-06-10T00:22:56.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.355+0000 7fcb731f4640 1 -- start start 2024-06-10T00:22:56.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb731f4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb6c06ebf0 0x7fcb6c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb731f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cf190 0x7fcb6c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb731f4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c0cf620 con 0x7fcb6c0ae910 2024-06-10T00:22:56.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb731f4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c06d130 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb731f4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c06d410 con 0x7fcb6c0cf190 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb63fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb6c06ebf0 0x7fcb6c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb63fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb6c06ebf0 0x7fcb6c0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49382/0 (socket says 172.21.15.79:49382) 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb63fff640 1 -- 172.21.15.79:0/4036279784 learned_addr learned my addr 172.21.15.79:0/4036279784 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb70f90640 1 --1- 172.21.15.79:0/4036279784 >> v1:172.21.15.79:6789/0 conn(0x7fcb6c0ae910 0x7fcb6c06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52978/0 (socket says 172.21.15.79:52978) 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb63fff640 1 -- 172.21.15.79:0/4036279784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cf190 msgr2=0x7fcb6c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb63fff640 1 --2- 172.21.15.79:0/4036279784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cf190 0x7fcb6c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb63fff640 1 -- 172.21.15.79:0/4036279784 >> v1:172.21.15.79:6789/0 conn(0x7fcb6c0ae910 legacy=0x7fcb6c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb637fe640 1 -- 172.21.15.79:0/4036279784 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584052836 0 0) 0x7fcb6c0cf620 con 0x7fcb6c0ae910 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.356+0000 7fcb63fff640 1 -- 172.21.15.79:0/4036279784 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c06d6f0 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.357+0000 7fcb63fff640 1 --2- 172.21.15.79:0/4036279784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c0cec50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009870 tx=0x7fcb5c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbca242139212a7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.357+0000 7fcb637fe640 1 -- 172.21.15.79:0/4036279784 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c037070 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.357+0000 7fcb637fe640 1 -- 172.21.15.79:0/4036279784 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c032440 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.357+0000 7fcb637fe640 1 -- 172.21.15.79:0/4036279784 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c032810 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.358+0000 7fcb731f4640 1 -- 172.21.15.79:0/4036279784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 msgr2=0x7fcb6c0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.358+0000 7fcb731f4640 1 --2- 172.21.15.79:0/4036279784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c0cec50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009870 tx=0x7fcb5c02a1c0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.358+0000 7fcb731f4640 1 -- 172.21.15.79:0/4036279784 shutdown_connections 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.358+0000 7fcb731f4640 1 --2- 172.21.15.79:0/4036279784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cf190 0x7fcb6c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.358+0000 7fcb731f4640 1 --2- 172.21.15.79:0/4036279784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c0cec50 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.358+0000 7fcb731f4640 1 -- 172.21.15.79:0/4036279784 >> 172.21.15.79:0/4036279784 conn(0x7fcb6c0b19f0 msgr2=0x7fcb6c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.358+0000 7fcb731f4640 1 -- 172.21.15.79:0/4036279784 shutdown_connections 2024-06-10T00:22:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.358+0000 7fcb731f4640 1 -- 172.21.15.79:0/4036279784 wait complete. 2024-06-10T00:22:56.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.359+0000 7fcb731f4640 1 Processor -- start 2024-06-10T00:22:56.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.359+0000 7fcb731f4640 1 -- start start 2024-06-10T00:22:56.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb731f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb731f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0ae910 0x7fcb6c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb731f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cf190 0x7fcb6c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb731f4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c0ad280 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb731f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c0aecf0 con 0x7fcb6c0ae910 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb731f4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c0ad400 con 0x7fcb6c0cf190 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c14c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49390/0 (socket says 172.21.15.79:49390) 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 -- 172.21.15.79:0/1221776387 learned_addr learned my addr 172.21.15.79:0/1221776387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 -- 172.21.15.79:0/1221776387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cf190 msgr2=0x7fcb6c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cf190 0x7fcb6c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 -- 172.21.15.79:0/1221776387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0ae910 msgr2=0x7fcb6c0b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0ae910 0x7fcb6c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 -- 172.21.15.79:0/1221776387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c155650 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb70f90640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c14c820 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800c4d0 tx=0x7fcb6800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb617fa640 1 -- 172.21.15.79:0/1221776387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68018070 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb617fa640 1 -- 172.21.15.79:0/1221776387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb68007500 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c1558f0 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb617fa640 1 -- 172.21.15.79:0/1221776387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68004a20 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.360+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c155eb0 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.361+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c068430 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.362+0000 7fcb617fa640 1 -- 172.21.15.79:0/1221776387 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb6801b070 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.362+0000 7fcb617fa640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5806be30 0x7fcb5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.362+0000 7fcb617fa640 1 -- 172.21.15.79:0/1221776387 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fcb6808a290 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.362+0000 7fcb63fff640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5806be30 0x7fcb5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.363+0000 7fcb63fff640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5806be30 0x7fcb5806e2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c034000 tx=0x7fcb5c02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:56.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.366+0000 7fcb617fa640 1 -- 172.21.15.79:0/1221776387 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcb68058b40 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.555+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb6c0732f0 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.556+0000 7fcb617fa640 1 -- 172.21.15.79:0/1221776387 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7fcb68058440 con 0x7fcb6c06ebf0 2024-06-10T00:22:56.555 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:22:56.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5806be30 msgr2=0x7fcb5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5806be30 0x7fcb5806e2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c034000 tx=0x7fcb5c02c000 comp rx=0 tx=0).stop 2024-06-10T00:22:56.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 msgr2=0x7fcb6c14c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c14c820 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800c4d0 tx=0x7fcb6800c990 comp rx=0 tx=0).stop 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 shutdown_connections 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcb5806be30 0x7fcb5806e2f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb6c0cf190 0x7fcb6c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0ae910 0x7fcb6c0b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 --2- 172.21.15.79:0/1221776387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb6c06ebf0 0x7fcb6c14c820 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 >> 172.21.15.79:0/1221776387 conn(0x7fcb6c0b19f0 msgr2=0x7fcb6c06e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 shutdown_connections 2024-06-10T00:22:56.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.558+0000 7fcb731f4640 1 -- 172.21.15.79:0/1221776387 wait complete. 2024-06-10T00:22:56.568 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:22:56.568 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:22:56.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:22:56.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.725+0000 7fbdeb7fb640 1 Processor -- start 2024-06-10T00:22:56.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.725+0000 7fbdeb7fb640 1 -- start start 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbdeb7fb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbde406ebf0 0x7fbde40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbdeb7fb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbde40cf190 0x7fbde40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbdeb7fb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde40cf600 con 0x7fbde40ae910 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbdeb7fb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbde406d130 con 0x7fbde40cf190 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbdeb7fb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbde406d410 con 0x7fbde406ebf0 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbde9597640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbde40ae910 0x7fbde406e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52992/0 (socket says 172.21.15.79:52992) 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbde9597640 1 -- 172.21.15.79:0/2937632970 learned_addr learned my addr 172.21.15.79:0/2937632970 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbde9d98640 1 --2- 172.21.15.79:0/2937632970 >> v2:172.21.15.79:3300/0 conn(0x7fbde40cf190 0x7fbde40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbde9d98640 1 -- 172.21.15.79:0/2937632970 >> v2:172.21.15.117:3300/0 conn(0x7fbde406ebf0 msgr2=0x7fbde40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:22:56.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbde8d96640 1 --2- 172.21.15.79:0/2937632970 >> v2:172.21.15.117:3300/0 conn(0x7fbde406ebf0 0x7fbde40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbde9d98640 1 --2- 172.21.15.79:0/2937632970 >> v2:172.21.15.117:3300/0 conn(0x7fbde406ebf0 0x7fbde40cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbde9d98640 1 -- 172.21.15.79:0/2937632970 >> v1:172.21.15.79:6789/0 conn(0x7fbde40ae910 legacy=0x7fbde406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.726+0000 7fbde9d98640 1 -- 172.21.15.79:0/2937632970 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde406d6f0 con 0x7fbde40cf190 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.727+0000 7fbde9d98640 1 --2- 172.21.15.79:0/2937632970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40cf190 0x7fbde40acd40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbde4070c80 tx=0x7fbddc02a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41a60dfef361b37 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.727+0000 7fbddbfff640 1 -- 172.21.15.79:0/2937632970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc007740 con 0x7fbde40cf190 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.727+0000 7fbddbfff640 1 -- 172.21.15.79:0/2937632970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc0078e0 con 0x7fbde40cf190 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.727+0000 7fbddbfff640 1 -- 172.21.15.79:0/2937632970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc007cb0 con 0x7fbde40cf190 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.728+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/2937632970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40cf190 msgr2=0x7fbde40acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.728+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/2937632970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40cf190 0x7fbde40acd40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbde4070c80 tx=0x7fbddc02a4e0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.728+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/2937632970 shutdown_connections 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.728+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/2937632970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40cf190 0x7fbde40acd40 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.728+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/2937632970 >> v2:172.21.15.117:3300/0 conn(0x7fbde406ebf0 0x7fbde40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.728+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/2937632970 >> 172.21.15.79:0/2937632970 conn(0x7fbde40b19f0 msgr2=0x7fbde40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:56.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.728+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/2937632970 shutdown_connections 2024-06-10T00:22:56.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.728+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/2937632970 wait complete. 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.729+0000 7fbdeb7fb640 1 Processor -- start 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.729+0000 7fbdeb7fb640 1 -- start start 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdeb7fb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbde406ebf0 0x7fbde41e6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdeb7fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40ae910 0x7fbde40cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdeb7fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbde40cf190 0x7fbde40ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdeb7fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbde40ad280 con 0x7fbde40ae910 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdeb7fb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbde40aecf0 con 0x7fbde40cf190 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdeb7fb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbde40ad400 con 0x7fbde406ebf0 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40ae910 0x7fbde40cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40ae910 0x7fbde40cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49400/0 (socket says 172.21.15.79:49400) 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 -- 172.21.15.79:0/3500684846 learned_addr learned my addr 172.21.15.79:0/3500684846 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde9597640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbde406ebf0 0x7fbde41e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde9d98640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbde40cf190 0x7fbde40ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 -- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbde406ebf0 msgr2=0x7fbde41e6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbde406ebf0 0x7fbde41e6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 -- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbde40cf190 msgr2=0x7fbde40ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbde40cf190 0x7fbde40ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 -- 172.21.15.79:0/3500684846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde41e3bb0 con 0x7fbde40ae910 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde9d98640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbde40cf190 0x7fbde40ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbde8d96640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40ae910 0x7fbde40cdb40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400c7f0 tx=0x7fbdd400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdd9ffb640 1 -- 172.21.15.79:0/3500684846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4015070 con 0x7fbde40ae910 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdd9ffb640 1 -- 172.21.15.79:0/3500684846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd4004220 con 0x7fbde40ae910 2024-06-10T00:22:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde41e3e90 con 0x7fbde40ae910 2024-06-10T00:22:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.730+0000 7fbdd9ffb640 1 -- 172.21.15.79:0/3500684846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4007620 con 0x7fbde40ae910 2024-06-10T00:22:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.731+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde41e4450 con 0x7fbde40ae910 2024-06-10T00:22:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.732+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde4068430 con 0x7fbde40ae910 2024-06-10T00:22:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.732+0000 7fbdd9ffb640 1 -- 172.21.15.79:0/3500684846 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdd40079d0 con 0x7fbde40ae910 2024-06-10T00:22:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.732+0000 7fbdd9ffb640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbdc806be30 0x7fbdc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:22:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.733+0000 7fbde9597640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbdc806be30 0x7fbdc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:22:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.733+0000 7fbdd9ffb640 1 -- 172.21.15.79:0/3500684846 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fbdd408b310 con 0x7fbde40ae910 2024-06-10T00:22:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.733+0000 7fbde9597640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbdc806be30 0x7fbdc806e2f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbde0000f60 tx=0x7fbde0000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:22:56.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.737+0000 7fbdd9ffb640 1 -- 172.21.15.79:0/3500684846 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbdd40594e0 con 0x7fbde40ae910 2024-06-10T00:22:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.923+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbde4075430 con 0x7fbde40ae910 2024-06-10T00:22:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.923+0000 7fbdd9ffb640 1 -- 172.21.15.79:0/3500684846 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7fbdd405d7e0 con 0x7fbde40ae910 2024-06-10T00:22:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:22:56.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.925+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbdc806be30 msgr2=0x7fbdc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.925+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbdc806be30 0x7fbdc806e2f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbde0000f60 tx=0x7fbde0000bc0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40ae910 msgr2=0x7fbde40cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40ae910 0x7fbde40cdb40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400c7f0 tx=0x7fbdd400ccb0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 shutdown_connections 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbdc806be30 0x7fbdc806e2f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbde40cf190 0x7fbde40ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbde40ae910 0x7fbde40cdb40 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 --2- 172.21.15.79:0/3500684846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbde406ebf0 0x7fbde41e6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 >> 172.21.15.79:0/3500684846 conn(0x7fbde40b19f0 msgr2=0x7fbde4071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 shutdown_connections 2024-06-10T00:22:56.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:22:56.926+0000 7fbdeb7fb640 1 -- 172.21.15.79:0/3500684846 wait complete. 2024-06-10T00:22:56.936 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:22:56.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:22:56.936 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:22:56.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[71052]: fuse finished with error 0 and tester_r 0 2024-06-10T00:22:56.961 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:23:03.063 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:23:03.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:23:03.063 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:23:03.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:23:03.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.234+0000 7f52e28a5640 1 Processor -- start 2024-06-10T00:23:03.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.234+0000 7f52e28a5640 1 -- start start 2024-06-10T00:23:03.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52e28a5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f52dc0ae910 0x7f52dc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52e28a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52dc06ea20 0x7f52dc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52e28a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52dc06d130 con 0x7f52dc0cf190 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52e28a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f52dc06ee90 con 0x7f52dc06ea20 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52e28a5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f52dc06d410 con 0x7f52dc0ae910 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52db7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52dc06ea20 0x7f52dc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52db7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52dc06ea20 0x7f52dc0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52008/0 (socket says 172.21.15.79:52008) 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52db7fe640 1 -- 172.21.15.79:0/3453292238 learned_addr learned my addr 172.21.15.79:0/3453292238 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52db7fe640 1 -- 172.21.15.79:0/3453292238 >> v2:172.21.15.117:3300/0 conn(0x7f52dc0ae910 msgr2=0x7f52dc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52db7fe640 1 --2- 172.21.15.79:0/3453292238 >> v2:172.21.15.117:3300/0 conn(0x7f52dc0ae910 0x7f52dc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52db7fe640 1 -- 172.21.15.79:0/3453292238 >> v1:172.21.15.117:6789/0 conn(0x7f52dc0cf190 legacy=0x7f52dc15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.235+0000 7f52db7fe640 1 -- 172.21.15.79:0/3453292238 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc06d6f0 con 0x7f52dc06ea20 2024-06-10T00:23:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52db7fe640 1 --2- 172.21.15.79:0/3453292238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc06ea20 0x7f52dc0cec50 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0750b0 tx=0x7f52d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe03d745644b31d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52daffd640 1 -- 172.21.15.79:0/3453292238 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0037070 con 0x7f52dc06ea20 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52daffd640 1 -- 172.21.15.79:0/3453292238 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d0032440 con 0x7f52dc06ea20 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52daffd640 1 -- 172.21.15.79:0/3453292238 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0032810 con 0x7f52dc06ea20 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52e28a5640 1 -- 172.21.15.79:0/3453292238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc06ea20 msgr2=0x7f52dc0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3453292238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc06ea20 0x7f52dc0cec50 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0750b0 tx=0x7f52d002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52e28a5640 1 -- 172.21.15.79:0/3453292238 shutdown_connections 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3453292238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc06ea20 0x7f52dc0cec50 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3453292238 >> v2:172.21.15.117:3300/0 conn(0x7f52dc0ae910 0x7f52dc06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.236+0000 7f52e28a5640 1 -- 172.21.15.79:0/3453292238 >> 172.21.15.79:0/3453292238 conn(0x7f52dc0b19f0 msgr2=0x7f52dc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.237+0000 7f52e28a5640 1 -- 172.21.15.79:0/3453292238 shutdown_connections 2024-06-10T00:23:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.237+0000 7f52e28a5640 1 -- 172.21.15.79:0/3453292238 wait complete. 2024-06-10T00:23:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.238+0000 7f52e28a5640 1 Processor -- start 2024-06-10T00:23:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.238+0000 7f52e28a5640 1 -- start start 2024-06-10T00:23:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e28a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52dc06ea20 0x7f52dc09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e28a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52dc0ae910 0x7f52dc09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e28a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc0cf190 0x7f52dc1e7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e28a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc0aecf0 con 0x7f52dc0cf190 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e28a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc0cf5e0 con 0x7f52dc06ea20 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e28a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f52dc0add50 con 0x7f52dc0ae910 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc0cf190 0x7f52dc1e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc0cf190 0x7f52dc1e7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52016/0 (socket says 172.21.15.79:52016) 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 -- 172.21.15.79:0/3995997641 learned_addr learned my addr 172.21.15.79:0/3995997641 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52dbfff640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52dc06ea20 0x7f52dc09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 -- 172.21.15.79:0/3995997641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52dc0ae910 msgr2=0x7f52dc09cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52db7fe640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52dc0ae910 0x7f52dc09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52dc0ae910 0x7f52dc09cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 -- 172.21.15.79:0/3995997641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52dc06ea20 msgr2=0x7f52dc09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52dc06ea20 0x7f52dc09ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 -- 172.21.15.79:0/3995997641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc1469c0 con 0x7f52dc0cf190 2024-06-10T00:23:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e0e42640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc0cf190 0x7f52dc1e7730 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f52d400c780 tx=0x7f52d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52d8ff9640 1 -- 172.21.15.79:0/3995997641 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4017070 con 0x7f52dc0cf190 2024-06-10T00:23:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52d8ff9640 1 -- 172.21.15.79:0/3995997641 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d4003da0 con 0x7f52dc0cf190 2024-06-10T00:23:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52dc146c30 con 0x7f52dc0cf190 2024-06-10T00:23:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52d8ff9640 1 -- 172.21.15.79:0/3995997641 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40052b0 con 0x7f52dc0cf190 2024-06-10T00:23:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.239+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52dc1e4b80 con 0x7f52dc0cf190 2024-06-10T00:23:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.240+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52dc068430 con 0x7f52dc0cf190 2024-06-10T00:23:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.241+0000 7f52d8ff9640 1 -- 172.21.15.79:0/3995997641 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52d4006b10 con 0x7f52dc0cf190 2024-06-10T00:23:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.241+0000 7f52d8ff9640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52c806be30 0x7f52c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.241+0000 7f52d8ff9640 1 -- 172.21.15.79:0/3995997641 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f52d408a5f0 con 0x7f52dc0cf190 2024-06-10T00:23:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.241+0000 7f52dbfff640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52c806be30 0x7f52c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.242+0000 7f52dbfff640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52c806be30 0x7f52c806e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00a810 tx=0x7f52cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.246+0000 7f52d8ff9640 1 -- 172.21.15.79:0/3995997641 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f52d4058e20 con 0x7f52dc0cf190 2024-06-10T00:23:03.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.456+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52dc15dea0 con 0x7f52dc0cf190 2024-06-10T00:23:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.457+0000 7f52d8ff9640 1 -- 172.21.15.79:0/3995997641 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5189 (secure 0 0 0) 0x7f52d4058720 con 0x7f52dc0cf190 2024-06-10T00:23:03.457 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:03.457 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:22:42.806547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7698":{"gid":7698,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6837/2980295924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":2980295924},{"type":"v1","addr":"172.21.15.79:6837","nonce":2980295924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7698,"qdb_cluster":[7698]},"id":7}]} 2024-06-10T00:23:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2024-06-10T00:23:03.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52c806be30 msgr2=0x7f52c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52c806be30 0x7f52c806e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00a810 tx=0x7f52cc008040 comp rx=0 tx=0).stop 2024-06-10T00:23:03.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc0cf190 msgr2=0x7f52dc1e7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc0cf190 0x7f52dc1e7730 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f52d400c780 tx=0x7f52d400cc40 comp rx=0 tx=0).stop 2024-06-10T00:23:03.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 shutdown_connections 2024-06-10T00:23:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52c806be30 0x7f52c806e2f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52dc0cf190 0x7f52dc1e7730 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52dc0ae910 0x7f52dc09cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 --2- 172.21.15.79:0/3995997641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52dc06ea20 0x7f52dc09ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 >> 172.21.15.79:0/3995997641 conn(0x7f52dc0b19f0 msgr2=0x7f52dc0b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 shutdown_connections 2024-06-10T00:23:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.459+0000 7f52e28a5640 1 -- 172.21.15.79:0/3995997641 wait complete. 2024-06-10T00:23:03.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-06-10T00:23:03.592 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0} 2024-06-10T00:23:03.592 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-06-10T00:23:03.593 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:23:03.593 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:23:03.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:23:03.608 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi079.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2024-06-10T00:23:03.608 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:23:03.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:23:03.609 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:23:03.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:23:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-10T00:23:03.665 DEBUG:teuthology.orchestra.run.smithi079:> sudo daemon-helper kill ceph --cluster ceph -w 2024-06-10T00:23:03.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:23:03.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-06-10T00:23:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.811+0000 7f68880b3640 1 Processor -- start 2024-06-10T00:23:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.812+0000 7f68880b3640 1 -- start start 2024-06-10T00:23:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f68880b3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f688015e670 0x7f68800d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f68880b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f68800d1f30 0x7f68800d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f68880b3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688015ec90 con 0x7f68800d0c30 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f68880b3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f688015fa50 con 0x7f68800d1f30 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f68880b3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f68800d10a0 con 0x7f688015e670 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f688564e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f68800d1f30 0x7f68800d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f6886650640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f68800d0c30 0x7f6880162010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34522/0 (socket says 172.21.15.79:34522) 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f6886650640 1 -- 172.21.15.79:0/4279536905 learned_addr learned my addr 172.21.15.79:0/4279536905 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f688564e640 1 -- 172.21.15.79:0/4279536905 >> v2:172.21.15.117:3300/0 conn(0x7f688015e670 msgr2=0x7f68800d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f688564e640 1 --2- 172.21.15.79:0/4279536905 >> v2:172.21.15.117:3300/0 conn(0x7f688015e670 0x7f68800d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f688564e640 1 -- 172.21.15.79:0/4279536905 >> v1:172.21.15.79:6789/0 conn(0x7f68800d0c30 legacy=0x7f6880162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.813+0000 7f688564e640 1 -- 172.21.15.79:0/4279536905 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688015ef70 con 0x7f68800d1f30 2024-06-10T00:23:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.814+0000 7f688564e640 1 --2- 172.21.15.79:0/4279536905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800d06f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f688008cc40 tx=0x7f687002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b38713ec0809a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.814+0000 7f6884e4d640 1 -- 172.21.15.79:0/4279536905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870037070 con 0x7f68800d1f30 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.814+0000 7f6884e4d640 1 -- 172.21.15.79:0/4279536905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6870032440 con 0x7f68800d1f30 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.814+0000 7f6884e4d640 1 -- 172.21.15.79:0/4279536905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870032810 con 0x7f68800d1f30 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.814+0000 7f68880b3640 1 -- 172.21.15.79:0/4279536905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 msgr2=0x7f68800d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.814+0000 7f68880b3640 1 --2- 172.21.15.79:0/4279536905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800d06f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f688008cc40 tx=0x7f687002a230 comp rx=0 tx=0).stop 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.815+0000 7f68880b3640 1 -- 172.21.15.79:0/4279536905 shutdown_connections 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.815+0000 7f68880b3640 1 --2- 172.21.15.79:0/4279536905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800d06f0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.815+0000 7f68880b3640 1 --2- 172.21.15.79:0/4279536905 >> v2:172.21.15.117:3300/0 conn(0x7f688015e670 0x7f68800d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.815+0000 7f68880b3640 1 -- 172.21.15.79:0/4279536905 >> 172.21.15.79:0/4279536905 conn(0x7f688009d400 msgr2=0x7f68800d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.815+0000 7f68880b3640 1 -- 172.21.15.79:0/4279536905 shutdown_connections 2024-06-10T00:23:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.815+0000 7f68880b3640 1 -- 172.21.15.79:0/4279536905 wait complete. 2024-06-10T00:23:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.816+0000 7f68880b3640 1 Processor -- start 2024-06-10T00:23:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.817+0000 7f68880b3640 1 -- start start 2024-06-10T00:23:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68880b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68800d0c30 0x7f68800cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68880b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68880b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688015e670 0x7f6880156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68880b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f688015f530 con 0x7f68800d1f30 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68880b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f688015ea50 con 0x7f68800d0c30 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68880b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f68800d2370 con 0x7f688015e670 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52034/0 (socket says 172.21.15.79:52034) 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 -- 172.21.15.79:0/4087128954 learned_addr learned my addr 172.21.15.79:0/4087128954 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f6886650640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688015e670 0x7f6880156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f6885e4f640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68800d0c30 0x7f68800cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 -- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688015e670 msgr2=0x7f6880156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688015e670 0x7f6880156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 -- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68800d0c30 msgr2=0x7f68800cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68800d0c30 0x7f68800cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 -- 172.21.15.79:0/4087128954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68800cdf20 con 0x7f68800d1f30 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f6886650640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688015e670 0x7f6880156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f6885e4f640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68800d0c30 0x7f68800cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f688564e640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800cd880 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f6870000c00 tx=0x7f68700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68767fc640 1 -- 172.21.15.79:0/4087128954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870037040 con 0x7f68800d1f30 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68767fc640 1 -- 172.21.15.79:0/4087128954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6870042070 con 0x7f68800d1f30 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68767fc640 1 -- 172.21.15.79:0/4087128954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870030bd0 con 0x7f68800d1f30 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.818+0000 7f68880b3640 1 -- 172.21.15.79:0/4087128954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68800cbba0 con 0x7f68800d1f30 2024-06-10T00:23:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.819+0000 7f68880b3640 1 -- 172.21.15.79:0/4087128954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68800cc160 con 0x7f68800d1f30 2024-06-10T00:23:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.821+0000 7f68767fc640 1 -- 172.21.15.79:0/4087128954 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6870047460 con 0x7f68800d1f30 2024-06-10T00:23:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.821+0000 7f68767fc640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686406be30 0x7f686406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.821+0000 7f68767fc640 1 -- 172.21.15.79:0/4087128954 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f68700abc30 con 0x7f68800d1f30 2024-06-10T00:23:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.821+0000 7f6885e4f640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686406be30 0x7f686406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f6885e4f640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686406be30 0x7f686406e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6878007eb0 tx=0x7f68780073c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f688adc0740 1 Processor -- start 2024-06-10T00:23:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f688adc0740 1 -- start start 2024-06-10T00:23:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f688adc0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e8aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f688adc0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086e85f70 0x55e086e8b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f688adc0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086e8d4a0 0x55e086e8b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f688adc0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e086deea70 con 0x55e086eae8c0 2024-06-10T00:23:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f688adc0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e086d8cca0 con 0x55e086e8d4a0 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.822+0000 7f688adc0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e086deaa30 con 0x55e086e85f70 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e8aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e8aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52040/0 (socket says 172.21.15.79:52040) 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 -- 172.21.15.79:0/972322897 learned_addr learned my addr 172.21.15.79:0/972322897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f688564e640 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086e85f70 0x55e086e8b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6886650640 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086e8d4a0 0x55e086e8b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 -- 172.21.15.79:0/972322897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086e85f70 msgr2=0x55e086e8b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086e85f70 0x55e086e8b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 -- 172.21.15.79:0/972322897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086e8d4a0 msgr2=0x55e086e8b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086e8d4a0 0x55e086e8b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 -- 172.21.15.79:0/972322897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e086db7eb0 con 0x55e086eae8c0 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f6885e4f640 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e8aef0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f687800f760 tx=0x7f687800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42abdd5137efb766 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f68637fe640 1 -- 172.21.15.79:0/972322897 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687801c440 con 0x55e086eae8c0 2024-06-10T00:23:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f68637fe640 1 -- 172.21.15.79:0/972322897 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878021070 con 0x55e086eae8c0 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.823+0000 7f68637fe640 1 -- 172.21.15.79:0/972322897 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687801c7e0 con 0x55e086eae8c0 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 -- 172.21.15.79:0/972322897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 msgr2=0x55e086e8aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e8aef0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f687800f760 tx=0x7f687800f000 comp rx=0 tx=0).stop 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 -- 172.21.15.79:0/972322897 shutdown_connections 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086e8d4a0 0x55e086e8b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086e85f70 0x55e086e8b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 --2- 172.21.15.79:0/972322897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e8aef0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 -- 172.21.15.79:0/972322897 >> 172.21.15.79:0/972322897 conn(0x55e086e881e0 msgr2=0x55e086ed0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 -- 172.21.15.79:0/972322897 shutdown_connections 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.824+0000 7f688adc0740 1 -- 172.21.15.79:0/972322897 wait complete. 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.825+0000 7f688adc0740 1 -- start start 2024-06-10T00:23:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.825+0000 7f688adc0740 1 Processor -- start 2024-06-10T00:23:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688adc0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086eae8c0 0x55e086eb4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688adc0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086ee48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688adc0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086ed3020 0x55e086ed34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688adc0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e086e899b0 con 0x55e086ed3020 2024-06-10T00:23:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688adc0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e086d77e50 con 0x55e086eae8c0 2024-06-10T00:23:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688adc0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e086eaeca0 con 0x55e086ee4510 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688adc0740 10 client.0 _ll_register_callbacks cb 0x55e086b01c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086ed3020 0x55e086ed34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086ed3020 0x55e086ed34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52048/0 (socket says 172.21.15.79:52048) 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 -- 172.21.15.79:0/533748120 learned_addr learned my addr 172.21.15.79:0/533748120 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6885e4f640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086eae8c0 0x55e086eb4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688564e640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086ee48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 -- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 msgr2=0x55e086ee48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086ee48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 -- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086eae8c0 msgr2=0x55e086eb4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086eae8c0 0x55e086eb4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 -- 172.21.15.79:0/533748120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e086bca7e0 con 0x55e086ed3020 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688564e640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086ee48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6885e4f640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086eae8c0 0x55e086eb4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6886650640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086ed3020 0x55e086ed34a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f687c0102a0 tx=0x7f687c010760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff51046b42b2219a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6860ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6860ff9640 1 -- 172.21.15.79:0/533748120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c005ce0 con 0x55e086ed3020 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f6860ff9640 1 -- 172.21.15.79:0/533748120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f687c0070d0 con 0x55e086ed3020 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.826+0000 7f688adc0740 1 -- 172.21.15.79:0/533748120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6878021070 con 0x55e086ed3020 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f6860ff9640 1 -- 172.21.15.79:0/533748120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f687c021050 con 0x55e086ed3020 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f688adc0740 10 client.7962 fetch_fsmap learned FSMap version 68 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f688adc0740 1 -- 172.21.15.79:0/533748120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55e086c2af70 con 0x55e086ed3020 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f6860ff9640 1 -- 172.21.15.79:0/533748120 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878021070 con 0x55e086ed3020 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f6860ff9640 1 -- 172.21.15.79:0/533748120 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f687c024020 con 0x55e086ed3020 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f688adc0740 10 client.7962 fetch_fsmap finished waiting for FSMap version 68 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f688adc0740 10 client.7962 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f688adc0740 20 client.7962 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f688adc0740 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x55e086eaf350 0x55e086eaf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f688adc0740 4 client.7962 mds_command: new command op to 7698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f688adc0740 1 -- 172.21.15.79:0/533748120 --> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e086dfc1a0 con 0x55e086eaf350 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f6885e4f640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x55e086eaf350 0x55e086eaf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f6860ff9640 10 client.7962 ms_handle_connect on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.827+0000 7f6885e4f640 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x55e086eaf350 0x55e086eaf7c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c517f111b94afe37 server_cookie=a58743c490c9db48 in_seq=0 out_seq=0 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f6860ff9640 1 -- 172.21.15.79:0/533748120 <== mds.0 v2:172.21.15.79:6835/2980295924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e086dfc1a0 con 0x55e086eaf350 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f6860ff9640 10 client.7962 handle_command_reply: tid=0 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 client.7962 shutdown 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 -- 172.21.15.79:0/533748120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086ed3020 msgr2=0x55e086ed34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086ed3020 0x55e086ed34a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f687c0102a0 tx=0x7f687c010760 comp rx=0 tx=0).stop 2024-06-10T00:23:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 -- 172.21.15.79:0/533748120 shutdown_connections 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x55e086eaf350 0x55e086eaf7c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086ed3020 0x55e086ed34a0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f6860ff9640 0 client.7962 ms_handle_reset on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086ee48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 --2- 172.21.15.79:0/533748120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086eae8c0 0x55e086eb4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 -- 172.21.15.79:0/533748120 >> 172.21.15.79:0/533748120 conn(0x55e086e8d4a0 msgr2=0x55e086e89e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 -- 172.21.15.79:0/533748120 shutdown_connections 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.828+0000 7f688adc0740 1 -- 172.21.15.79:0/533748120 wait complete. 2024-06-10T00:23:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.829+0000 7f688adc0740 20 client.7962 trim_cache size 0 max 16384 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.832+0000 7f49e739b640 1 Processor -- start 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.833+0000 7f49e739b640 1 -- start start 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.833+0000 7f49e739b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49e00d0c70 0x7f49e00d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.833+0000 7f49e739b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 0x7f49e00b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.833+0000 7f49e739b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e00cfce0 con 0x7f49e0161a20 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.833+0000 7f49e739b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f49e00cffc0 con 0x7f49e00d0c70 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e739b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49e00b38c0 con 0x7f49e00cf740 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e5137640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f49e0161a20 0x7f49e00d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34526/0 (socket says 172.21.15.79:34526) 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e5137640 1 -- 172.21.15.79:0/2457948647 learned_addr learned my addr 172.21.15.79:0/2457948647 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:23:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e4936640 1 --2- 172.21.15.79:0/2457948647 >> v2:172.21.15.79:3300/0 conn(0x7f49e00d0c70 0x7f49e00d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e4936640 1 -- 172.21.15.79:0/2457948647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 msgr2=0x7f49e00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e5938640 1 --2- 172.21.15.79:0/2457948647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 0x7f49e00b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e4936640 1 --2- 172.21.15.79:0/2457948647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 0x7f49e00b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49d7fff640 1 -- 172.21.15.79:0/2457948647 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165652718 0 0) 0x7f49e00cfce0 con 0x7f49e0161a20 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e4936640 1 -- 172.21.15.79:0/2457948647 >> v1:172.21.15.79:6789/0 conn(0x7f49e0161a20 legacy=0x7f49e00d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e4936640 1 -- 172.21.15.79:0/2457948647 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e00b3ba0 con 0x7f49e00d0c70 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.834+0000 7f49e5938640 1 --2- 172.21.15.79:0/2457948647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 0x7f49e00b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e4936640 1 --2- 172.21.15.79:0/2457948647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00d0c70 0x7f49e00d4bb0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0097a0 tx=0x7f49dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b9028bf3c9beff server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49d7fff640 1 -- 172.21.15.79:0/2457948647 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc037070 con 0x7f49e00d0c70 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49d7fff640 1 -- 172.21.15.79:0/2457948647 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc032440 con 0x7f49e00d0c70 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49d7fff640 1 -- 172.21.15.79:0/2457948647 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc032810 con 0x7f49e00d0c70 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e739b640 1 -- 172.21.15.79:0/2457948647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00d0c70 msgr2=0x7f49e00d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e739b640 1 --2- 172.21.15.79:0/2457948647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00d0c70 0x7f49e00d4bb0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0097a0 tx=0x7f49dc02a180 comp rx=0 tx=0).stop 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e739b640 1 -- 172.21.15.79:0/2457948647 shutdown_connections 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e739b640 1 --2- 172.21.15.79:0/2457948647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 0x7f49e00b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e739b640 1 --2- 172.21.15.79:0/2457948647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00d0c70 0x7f49e00d4bb0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e739b640 1 -- 172.21.15.79:0/2457948647 >> 172.21.15.79:0/2457948647 conn(0x7f49e00d4090 msgr2=0x7f49e00d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e739b640 1 -- 172.21.15.79:0/2457948647 shutdown_connections 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.835+0000 7f49e739b640 1 -- 172.21.15.79:0/2457948647 wait complete. 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e739b640 1 Processor -- start 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e739b640 1 -- start start 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e739b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 0x7f49e00b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e739b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00d0c70 0x7f49e00b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e739b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e0161a20 0x7f49e00b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e739b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00d1350 con 0x7f49e00d0c70 2024-06-10T00:23:03.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e739b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00b3e80 con 0x7f49e0161a20 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e739b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49e0161e00 con 0x7f49e00cf740 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e4936640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00d0c70 0x7f49e00b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e4936640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00d0c70 0x7f49e00b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52066/0 (socket says 172.21.15.79:52066) 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e4936640 1 -- 172.21.15.79:0/3815662866 learned_addr learned my addr 172.21.15.79:0/3815662866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.837+0000 7f49e5137640 1 --2- 172.21.15.79:0/3815662866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 0x7f49e00b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e5938640 1 --2- 172.21.15.79:0/3815662866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e0161a20 0x7f49e00b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e4936640 1 -- 172.21.15.79:0/3815662866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 msgr2=0x7f49e00b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e4936640 1 --2- 172.21.15.79:0/3815662866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00cf740 0x7f49e00b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e4936640 1 -- 172.21.15.79:0/3815662866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e0161a20 msgr2=0x7f49e00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e4936640 1 --2- 172.21.15.79:0/3815662866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e0161a20 0x7f49e00b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e4936640 1 -- 172.21.15.79:0/3815662866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e00b1120 con 0x7f49e00d0c70 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e4936640 1 --2- 172.21.15.79:0/3815662866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00d0c70 0x7f49e00b5b60 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f49dc035040 tx=0x7f49dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc037040 con 0x7f49e00d0c70 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc030770 con 0x7f49e00d0c70 2024-06-10T00:23:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e739b640 1 -- 172.21.15.79:0/3815662866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e00b1400 con 0x7f49e00d0c70 2024-06-10T00:23:03.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc030b80 con 0x7f49e00d0c70 2024-06-10T00:23:03.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.838+0000 7f49e739b640 1 -- 172.21.15.79:0/3815662866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e00b19c0 con 0x7f49e00d0c70 2024-06-10T00:23:03.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.839+0000 7f49e739b640 1 -- 172.21.15.79:0/3815662866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f49e00b2700 con 0x7f49e00d0c70 2024-06-10T00:23:03.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.840+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49dc044020 con 0x7f49e00d0c70 2024-06-10T00:23:03.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.840+0000 7f49d5ffb640 1 --2- 172.21.15.79:0/3815662866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f49c406be60 0x7f49c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.840+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f49dc0abf60 con 0x7f49e00d0c70 2024-06-10T00:23:03.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.840+0000 7f49e5137640 1 --2- 172.21.15.79:0/3815662866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f49c406be60 0x7f49c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.840+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+511 (secure 0 0 0) 0x7f49e00b2700 con 0x7f49e00d0c70 2024-06-10T00:23:03.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.840+0000 7f49e739b640 1 -- 172.21.15.79:0/3815662866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f49e00684a0 con 0x7f49e00d0c70 2024-06-10T00:23:03.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.841+0000 7f49e5137640 1 --2- 172.21.15.79:0/3815662866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f49c406be60 0x7f49c406e320 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f49d0000f60 tx=0x7f49d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.848+0000 7f688adc0740 1 Processor -- start 2024-06-10T00:23:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.848+0000 7f688adc0740 1 -- start start 2024-06-10T00:23:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f688adc0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e85630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f688adc0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ed3020 0x55e086e9db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f688adc0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ee4510 0x55e086e9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f688adc0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6880200da0 con 0x55e086eae8c0 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f688adc0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f68801f8ac0 con 0x55e086ee4510 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f688adc0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f68801f7e20 con 0x55e086ed3020 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6885e4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e85630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6885e4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e85630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52076/0 (socket says 172.21.15.79:52076) 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6885e4f640 1 -- 172.21.15.79:0/3591414322 learned_addr learned my addr 172.21.15.79:0/3591414322 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f688564e640 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ed3020 0x55e086e9db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6886650640 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ee4510 0x55e086e9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6885e4f640 1 -- 172.21.15.79:0/3591414322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ed3020 msgr2=0x55e086e9db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6885e4f640 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ed3020 0x55e086e9db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6885e4f640 1 -- 172.21.15.79:0/3591414322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ee4510 msgr2=0x55e086e9e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6885e4f640 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ee4510 0x55e086e9e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.849+0000 7f6885e4f640 1 -- 172.21.15.79:0/3591414322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e086ac2170 con 0x55e086eae8c0 2024-06-10T00:23:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.850+0000 7f6885e4f640 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e85630 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f687801d000 tx=0x7f6878011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a328410242e98520 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.850+0000 7f6862ffd640 1 -- 172.21.15.79:0/3591414322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878031650 con 0x55e086eae8c0 2024-06-10T00:23:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.850+0000 7f6862ffd640 1 -- 172.21.15.79:0/3591414322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878021040 con 0x55e086eae8c0 2024-06-10T00:23:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.850+0000 7f6862ffd640 1 -- 172.21.15.79:0/3591414322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68780319f0 con 0x55e086eae8c0 2024-06-10T00:23:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 -- 172.21.15.79:0/3591414322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 msgr2=0x55e086e85630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e85630 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f687801d000 tx=0x7f6878011000 comp rx=0 tx=0).stop 2024-06-10T00:23:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 -- 172.21.15.79:0/3591414322 shutdown_connections 2024-06-10T00:23:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ee4510 0x55e086e9e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ed3020 0x55e086e9db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 --2- 172.21.15.79:0/3591414322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086e85630 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 -- 172.21.15.79:0/3591414322 >> 172.21.15.79:0/3591414322 conn(0x55e086e8d4a0 msgr2=0x55e086ead320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 -- 172.21.15.79:0/3591414322 shutdown_connections 2024-06-10T00:23:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.851+0000 7f688adc0740 1 -- 172.21.15.79:0/3591414322 wait complete. 2024-06-10T00:23:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.852+0000 7f688adc0740 1 -- start start 2024-06-10T00:23:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.852+0000 7f688adc0740 1 Processor -- start 2024-06-10T00:23:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f688adc0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086f4fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f688adc0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ed3020 0x55e086ee3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f688adc0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086eac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f688adc0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e086eb41c0 con 0x55e086eae8c0 2024-06-10T00:23:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f688adc0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f68801f8470 con 0x55e086ed3020 2024-06-10T00:23:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f688adc0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e086ee0420 con 0x55e086ee4510 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f688adc0740 10 client.0 _ll_register_callbacks cb 0x7f687c0012b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f6885e4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086f4fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f6885e4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086f4fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52086/0 (socket says 172.21.15.79:52086) 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.853+0000 7f6885e4f640 1 -- 172.21.15.79:0/1334509807 learned_addr learned my addr 172.21.15.79:0/1334509807 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6886650640 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086eac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f688564e640 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ed3020 0x55e086ee3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6885e4f640 1 -- 172.21.15.79:0/1334509807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 msgr2=0x55e086eac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6885e4f640 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086eac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6885e4f640 1 -- 172.21.15.79:0/1334509807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ed3020 msgr2=0x55e086ee3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6885e4f640 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ed3020 0x55e086ee3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6885e4f640 1 -- 172.21.15.79:0/1334509807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e086ecf9b0 con 0x55e086eae8c0 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6885e4f640 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086f4fd60 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6878029040 tx=0x7f6878004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10af73ab9ae884d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6860ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6860ff9640 1 -- 172.21.15.79:0/1334509807 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878031860 con 0x55e086eae8c0 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6860ff9640 1 -- 172.21.15.79:0/1334509807 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f6878031a00 con 0x55e086eae8c0 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f688adc0740 1 -- 172.21.15.79:0/1334509807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6878021040 con 0x55e086eae8c0 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6860ff9640 1 -- 172.21.15.79:0/1334509807 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f6878049050 con 0x55e086eae8c0 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f688adc0740 10 client.7977 fetch_fsmap learned FSMap version 68 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f688adc0740 1 -- 172.21.15.79:0/1334509807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55e086e9e060 con 0x55e086eae8c0 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.854+0000 7f6860ff9640 1 -- 172.21.15.79:0/1334509807 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878021040 con 0x55e086eae8c0 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.855+0000 7f6860ff9640 1 -- 172.21.15.79:0/1334509807 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f687804c020 con 0x55e086eae8c0 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.855+0000 7f688adc0740 10 client.7977 fetch_fsmap finished waiting for FSMap version 68 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.855+0000 7f688adc0740 10 client.7977 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.855+0000 7f688adc0740 20 client.7977 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.855+0000 7f688adc0740 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x55e086e8b190 0x55e086e8b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.856+0000 7f688adc0740 4 client.7977 mds_command: new command op to 7698 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.856+0000 7f688adc0740 1 -- 172.21.15.79:0/1334509807 --> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x55e086eb5000 con 0x55e086e8b190 2024-06-10T00:23:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.856+0000 7f688564e640 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x55e086e8b190 0x55e086e8b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.856+0000 7f6860ff9640 10 client.7977 ms_handle_connect on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.856+0000 7f688564e640 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x55e086e8b190 0x55e086e8b570 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=447ff31d46656a3e server_cookie=1299a4b47fb24e68 in_seq=0 out_seq=0 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f6860ff9640 1 -- 172.21.15.79:0/1334509807 <== mds.0 v2:172.21.15.79:6835/2980295924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e086eb5000 con 0x55e086e8b190 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f6860ff9640 10 client.7977 handle_command_reply: tid=0 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 client.7977 shutdown 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 -- 172.21.15.79:0/1334509807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 msgr2=0x55e086f4fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086f4fd60 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6878029040 tx=0x7f6878004a40 comp rx=0 tx=0).stop 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 -- 172.21.15.79:0/1334509807 shutdown_connections 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e086ee4510 0x55e086eac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e086ed3020 0x55e086ee3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x55e086e8b190 0x55e086e8b570 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 --2- 172.21.15.79:0/1334509807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e086eae8c0 0x55e086f4fd60 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 -- 172.21.15.79:0/1334509807 >> 172.21.15.79:0/1334509807 conn(0x55e086e8d4a0 msgr2=0x55e086ed3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f6860ff9640 0 client.7977 ms_handle_reset on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:03.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 -- 172.21.15.79:0/1334509807 shutdown_connections 2024-06-10T00:23:03.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.857+0000 7f688adc0740 1 -- 172.21.15.79:0/1334509807 wait complete. 2024-06-10T00:23:03.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f688adc0740 20 client.7977 trim_cache size 0 max 16384 2024-06-10T00:23:03.861 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:23:03.861 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:23:03.861 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "5ace9dfc-4cc1-4e74-b41d-5a756867aede", 2024-06-10T00:23:03.861 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:23:03.861 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:23:03.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 -- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686406be30 msgr2=0x7f686406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686406be30 0x7f686406e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6878007eb0 tx=0x7f68780073c0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 -- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 msgr2=0x7f68800cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800cd880 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f6870000c00 tx=0x7f68700046c0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 -- 172.21.15.79:0/4087128954 shutdown_connections 2024-06-10T00:23:03.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f686406be30 0x7f686406e2f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688015e670 0x7f6880156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68800d1f30 0x7f68800cd880 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 --2- 172.21.15.79:0/4087128954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68800d0c30 0x7f68800cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 -- 172.21.15.79:0/4087128954 >> 172.21.15.79:0/4087128954 conn(0x7f688009d400 msgr2=0x7f68800d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 -- 172.21.15.79:0/4087128954 shutdown_connections 2024-06-10T00:23:03.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.858+0000 7f68880b3640 1 -- 172.21.15.79:0/4087128954 wait complete. 2024-06-10T00:23:03.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:23:03.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-06-10T00:23:03.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.970+0000 7fa7a362c640 1 Processor -- start 2024-06-10T00:23:03.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.970+0000 7fa7a362c640 1 -- start start 2024-06-10T00:23:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa7a362c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa79c155320 0x7fa79c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa7a362c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79c155700 con 0x7fa79c0b34e0 2024-06-10T00:23:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa7a362c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79c15b6b0 con 0x7fa79c0d0730 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa7a362c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa79c15b990 con 0x7fa79c155320 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa7a0bc7640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa79c0b34e0 0x7fa79c0d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34534/0 (socket says 172.21.15.79:34534) 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/2847727364 learned_addr learned my addr 172.21.15.79:0/2847727364 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282953585 0 0) 0x7fa79c155700 con 0x7fa79c0b34e0 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa788003520 con 0x7fa79c0b34e0 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.971+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/2847727364 >> v2:172.21.15.117:3300/0 conn(0x7fa79c155320 0x7fa79c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1252334529 0 0) 0x7fa788003520 con 0x7fa79c0b34e0 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 >> v2:172.21.15.117:3300/0 conn(0x7fa79c155320 msgr2=0x7fa79c0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 --2- 172.21.15.79:0/2847727364 >> v2:172.21.15.117:3300/0 conn(0x7fa79c155320 0x7fa79c0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 >> v1:172.21.15.117:6789/0 conn(0x7fa79c0d0730 legacy=0x7fa79c06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c15bc70 con 0x7fa79c0b34e0 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fa78c001670 con 0x7fa79c0b34e0 2024-06-10T00:23:03.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 >> v1:172.21.15.79:6789/0 conn(0x7fa79c0b34e0 legacy=0x7fa79c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880039b0 0x7fa788003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa788004800 0x7fa788004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7880051c0 0x7fa78800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c15b990 con 0x7fa788004800 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa78800c110 con 0x7fa7880039b0 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa78800c310 con 0x7fa7880051c0 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa788004800 0x7fa788004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880039b0 0x7fa788003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7880051c0 0x7fa78800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/2847727364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7880051c0 msgr2=0x7fa78800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7880051c0 0x7fa78800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/2847727364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880039b0 msgr2=0x7fa788003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880039b0 0x7fa788003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/2847727364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa788003520 con 0x7fa788004800 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.972+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/2847727364 reap_dead start 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa788004800 0x7fa788004c80 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00c240 tx=0x7fa788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b17e8c631085154 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c007cf0 con 0x7fa788004800 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa78c0058d0 con 0x7fa788004800 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa793fff640 1 -- 172.21.15.79:0/2847727364 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c005d20 con 0x7fa788004800 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa7a362c640 1 -- 172.21.15.79:0/2847727364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa788004800 msgr2=0x7fa788004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa7a362c640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa788004800 0x7fa788004c80 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00c240 tx=0x7fa788005830 comp rx=0 tx=0).stop 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa7a362c640 1 -- 172.21.15.79:0/2847727364 shutdown_connections 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa7a362c640 1 --2- 172.21.15.79:0/2847727364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa788004800 0x7fa788004c80 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.973+0000 7fa7a362c640 1 -- 172.21.15.79:0/2847727364 >> 172.21.15.79:0/2847727364 conn(0x7fa79c0b1d10 msgr2=0x7fa79c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.974+0000 7fa7a362c640 1 -- 172.21.15.79:0/2847727364 shutdown_connections 2024-06-10T00:23:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.974+0000 7fa7a362c640 1 -- 172.21.15.79:0/2847727364 wait complete. 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.975+0000 7fa7a362c640 1 Processor -- start 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.975+0000 7fa7a362c640 1 -- start start 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.975+0000 7fa7a362c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa788004800 0x7fa79c0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.975+0000 7fa7a362c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa79c09bc40 0x7fa79c09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.975+0000 7fa7a362c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79c15dbf0 0x7fa79c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.975+0000 7fa7a362c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c15b470 con 0x7fa79c15dbf0 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.975+0000 7fa7a362c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c15b2f0 con 0x7fa79c09bc40 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.975+0000 7fa7a362c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c0b2fa0 con 0x7fa788004800 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79c15dbf0 0x7fa79c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79c15dbf0 0x7fa79c15e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52106/0 (socket says 172.21.15.79:52106) 2024-06-10T00:23:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/712038589 learned_addr learned my addr 172.21.15.79:0/712038589 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa788004800 0x7fa79c0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa79c09bc40 0x7fa79c09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/712038589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa788004800 msgr2=0x7fa79c0cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa788004800 0x7fa79c0cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/712038589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa79c09bc40 msgr2=0x7fa79c09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa79c09bc40 0x7fa79c09c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/712038589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c15cb50 con 0x7fa79c15dbf0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79c15dbf0 0x7fa79c15e070 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0d0c10 tx=0x7fa79400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa791ffb640 1 -- 172.21.15.79:0/712038589 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794003970 con 0x7fa79c15dbf0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa791ffb640 1 -- 172.21.15.79:0/712038589 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa794018070 con 0x7fa79c15dbf0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a362c640 1 -- 172.21.15.79:0/712038589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c15ce30 con 0x7fa79c15dbf0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa791ffb640 1 -- 172.21.15.79:0/712038589 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794003d70 con 0x7fa79c15dbf0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.976+0000 7fa7a362c640 1 -- 172.21.15.79:0/712038589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c15d3f0 con 0x7fa79c15dbf0 2024-06-10T00:23:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.978+0000 7fa791ffb640 1 -- 172.21.15.79:0/712038589 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7940050d0 con 0x7fa79c15dbf0 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.978+0000 7fa791ffb640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa78006be30 0x7fa78006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.979+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa78006be30 0x7fa78006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.979+0000 7fa791ffb640 1 -- 172.21.15.79:0/712038589 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fa79408aad0 con 0x7fa79c15dbf0 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.979+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa78006be30 0x7fa78006e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa798006fd0 tx=0x7fa798008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a640f740 1 Processor -- start 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a640f740 1 -- start start 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfbe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfb91a0 0x558b6cfbe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfc06d0 0x558b6cfbeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a640f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558b6cee37e0 con 0x558b6cfe1af0 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a640f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558b6cf21e80 con 0x558b6cfc06d0 2024-06-10T00:23:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a640f740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558b6cebf700 con 0x558b6cfb91a0 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a13c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfbe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a13c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfbe120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52122/0 (socket says 172.21.15.79:52122) 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.980+0000 7fa7a13c8640 1 -- 172.21.15.79:0/4123254420 learned_addr learned my addr 172.21.15.79:0/4123254420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa7a13c8640 1 -- 172.21.15.79:0/4123254420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfb91a0 msgr2=0x558b6cfbe660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/4123254420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfb91a0 0x558b6cfbe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa7a13c8640 1 -- 172.21.15.79:0/4123254420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfc06d0 msgr2=0x558b6cfbeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/4123254420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfc06d0 0x558b6cfbeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa7a13c8640 1 -- 172.21.15.79:0/4123254420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6cededd0 con 0x558b6cfe1af0 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/4123254420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfbe120 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa798003f10 tx=0x7fa798016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332ca3e2a2c4fec3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa786ffd640 1 -- 172.21.15.79:0/4123254420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798026070 con 0x558b6cfe1af0 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa786ffd640 1 -- 172.21.15.79:0/4123254420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa798015bb0 con 0x558b6cfe1af0 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.981+0000 7fa786ffd640 1 -- 172.21.15.79:0/4123254420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798022450 con 0x558b6cfe1af0 2024-06-10T00:23:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 -- 172.21.15.79:0/4123254420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 msgr2=0x558b6cfbe120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 --2- 172.21.15.79:0/4123254420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfbe120 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa798003f10 tx=0x7fa798016000 comp rx=0 tx=0).stop 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 -- 172.21.15.79:0/4123254420 shutdown_connections 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 --2- 172.21.15.79:0/4123254420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfc06d0 0x558b6cfbeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 --2- 172.21.15.79:0/4123254420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfb91a0 0x558b6cfbe660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 --2- 172.21.15.79:0/4123254420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfbe120 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 -- 172.21.15.79:0/4123254420 >> 172.21.15.79:0/4123254420 conn(0x558b6cfbb410 msgr2=0x558b6d003f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 -- 172.21.15.79:0/4123254420 shutdown_connections 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 -- 172.21.15.79:0/4123254420 wait complete. 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 -- start start 2024-06-10T00:23:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.982+0000 7fa7a640f740 1 Processor -- start 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 0x558b6cfe5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfd3830 0x558b6cfe8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfea620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a640f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558b6ceaa640 con 0x558b6cfd3830 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a640f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558b6cf1de40 con 0x558b6cfe1af0 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a640f740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558b6cfbcbe0 con 0x558b6cfe8970 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a0bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfd3830 0x558b6cfe8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a0bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfd3830 0x558b6cfe8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52138/0 (socket says 172.21.15.79:52138) 2024-06-10T00:23:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/2538572691 learned_addr learned my addr 172.21.15.79:0/2538572691 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a640f740 10 client.0 _ll_register_callbacks cb 0x558b6cedc430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 0x558b6cfe5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/2538572691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 msgr2=0x558b6cfea620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfea620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/2538572691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 msgr2=0x558b6cfe5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 0x558b6cfe5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.983+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/2538572691 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6ccff7d0 con 0x558b6cfd3830 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfd3830 0x558b6cfe8430 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00c240 tx=0x7fa79c15be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533651edd9a1d4c0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa77bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa77bfff640 1 -- 172.21.15.79:0/2538572691 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c042070 con 0x558b6cfd3830 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa77bfff640 1 -- 172.21.15.79:0/2538572691 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fa78c02f040 con 0x558b6cfd3830 2024-06-10T00:23:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 1 -- 172.21.15.79:0/2538572691 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa798015bb0 con 0x558b6cfd3830 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa77bfff640 1 -- 172.21.15.79:0/2538572691 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fa78c04d050 con 0x558b6cfd3830 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 10 client.7989 fetch_fsmap learned FSMap version 68 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 1 -- 172.21.15.79:0/2538572691 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x558b6cc353f0 con 0x558b6cfd3830 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa77bfff640 1 -- 172.21.15.79:0/2538572691 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa798015bb0 con 0x558b6cfd3830 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa77bfff640 1 -- 172.21.15.79:0/2538572691 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7fa78c050020 con 0x558b6cfd3830 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 10 client.7989 fetch_fsmap finished waiting for FSMap version 68 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 10 client.7989 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 20 client.7989 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x558b6cfeb030 0x558b6cfe6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 4 client.7989 mds_command: new command op to 7698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a640f740 1 -- 172.21.15.79:0/2538572691 --> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b6cf2f5b0 con 0x558b6cfeb030 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.984+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x558b6cfeb030 0x558b6cfe6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x558b6cfeb030 0x558b6cfe6f00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42f946236af37a69 server_cookie=6a5725b9558047cc in_seq=0 out_seq=0 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa77bfff640 10 client.7989 ms_handle_connect on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa77bfff640 1 -- 172.21.15.79:0/2538572691 <== mds.0 v2:172.21.15.79:6835/2980295924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558b6cf2f5b0 con 0x558b6cfeb030 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa77bfff640 10 client.7989 handle_command_reply: tid=0 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 client.7989 shutdown 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 -- 172.21.15.79:0/2538572691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfd3830 msgr2=0x558b6cfe8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfd3830 0x558b6cfe8430 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00c240 tx=0x7fa79c15be40 comp rx=0 tx=0).stop 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 -- 172.21.15.79:0/2538572691 shutdown_connections 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x558b6cfeb030 0x558b6cfe6f00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfd3830 0x558b6cfe8430 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 --2- 172.21.15.79:0/2538572691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 0x558b6cfe5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa77bfff640 0 client.7989 ms_handle_reset on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.985+0000 7fa7a640f740 1 -- 172.21.15.79:0/2538572691 >> 172.21.15.79:0/2538572691 conn(0x558b6cfc06d0 msgr2=0x558b6cfe0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.986+0000 7fa7a640f740 1 -- 172.21.15.79:0/2538572691 shutdown_connections 2024-06-10T00:23:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.986+0000 7fa7a640f740 1 -- 172.21.15.79:0/2538572691 wait complete. 2024-06-10T00:23:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:03.986+0000 7fa7a640f740 20 client.7989 trim_cache size 0 max 16384 2024-06-10T00:23:04.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.003+0000 7fa7a640f740 1 Processor -- start 2024-06-10T00:23:04.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.003+0000 7fa7a640f740 1 -- start start 2024-06-10T00:23:04.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfd3830 0x558b6cfe60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:04.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 0x558b6cfb8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:04.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe8970 0x558b6cfb8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:04.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a640f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1ff160 con 0x558b6cfe8970 2024-06-10T00:23:04.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a640f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1fe1a0 con 0x558b6cfe1af0 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a640f740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c1fd530 con 0x558b6cfd3830 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a1bc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe8970 0x558b6cfb8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a1bc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe8970 0x558b6cfb8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52154/0 (socket says 172.21.15.79:52154) 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/3312524258 learned_addr learned my addr 172.21.15.79:0/3312524258 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/3312524258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfd3830 msgr2=0x558b6cfe60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/3312524258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfd3830 0x558b6cfe60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/3312524258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 msgr2=0x558b6cfb8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/3312524258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 0x558b6cfb8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.004+0000 7fa7a1bc9640 1 -- 172.21.15.79:0/3312524258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6cbf50f0 con 0x558b6cfe8970 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/3312524258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe8970 0x558b6cfb8650 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fa7940550b0 tx=0x7fa794058600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd75928b2e42b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7867fc640 1 -- 172.21.15.79:0/3312524258 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7940617d0 con 0x558b6cfe8970 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7867fc640 1 -- 172.21.15.79:0/3312524258 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa794070e50 con 0x558b6cfe8970 2024-06-10T00:23:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7867fc640 1 -- 172.21.15.79:0/3312524258 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794055310 con 0x558b6cfe8970 2024-06-10T00:23:04.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 -- 172.21.15.79:0/3312524258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe8970 msgr2=0x558b6cfb8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:04.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 --2- 172.21.15.79:0/3312524258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe8970 0x558b6cfb8650 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fa7940550b0 tx=0x7fa794058600 comp rx=0 tx=0).stop 2024-06-10T00:23:04.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 -- 172.21.15.79:0/3312524258 shutdown_connections 2024-06-10T00:23:04.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 --2- 172.21.15.79:0/3312524258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe8970 0x558b6cfb8650 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 --2- 172.21.15.79:0/3312524258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfe1af0 0x558b6cfb8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 --2- 172.21.15.79:0/3312524258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfd3830 0x558b6cfe60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 -- 172.21.15.79:0/3312524258 >> 172.21.15.79:0/3312524258 conn(0x558b6cfc06d0 msgr2=0x558b6cfb48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 -- 172.21.15.79:0/3312524258 shutdown_connections 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.005+0000 7fa7a640f740 1 -- 172.21.15.79:0/3312524258 wait complete. 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.006+0000 7fa7a640f740 1 -- start start 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.006+0000 7fa7a640f740 1 Processor -- start 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfd3830 0x558b6d080f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfe0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a640f740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfe0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a640f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1fdb80 con 0x558b6cfe1af0 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a640f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558b6cfed240 con 0x558b6cfd3830 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a640f740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558b6cfe9c70 con 0x558b6cfe8970 2024-06-10T00:23:04.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a640f740 10 client.0 _ll_register_callbacks cb 0x7fa78c00c0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfe0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfe0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52160/0 (socket says 172.21.15.79:52160) 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/1431252461 learned_addr learned my addr 172.21.15.79:0/1431252461 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfd3830 0x558b6d080f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfe0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 msgr2=0x558b6cfe0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfe0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfd3830 msgr2=0x558b6d080f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfd3830 0x558b6d080f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 -- 172.21.15.79:0/1431252461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6cee8560 con 0x558b6cfe1af0 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfd3830 0x558b6d080f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a1bc9640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfe0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:04.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa7a0bc7640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfe0a00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fa78c02adf0 tx=0x7fa78c0078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20eba2ca189ede8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa77bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.007+0000 7fa77bfff640 1 -- 172.21.15.79:0/1431252461 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c042070 con 0x558b6cfe1af0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa77bfff640 1 -- 172.21.15.79:0/1431252461 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7fa78c038040 con 0x558b6cfe1af0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 1 -- 172.21.15.79:0/1431252461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa794070e50 con 0x558b6cfe1af0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa77bfff640 1 -- 172.21.15.79:0/1431252461 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fa78c005940 con 0x558b6cfe1af0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 10 client.7995 fetch_fsmap learned FSMap version 68 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 1 -- 172.21.15.79:0/1431252461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x558b6cfe2c20 con 0x558b6cfe1af0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa77bfff640 1 -- 172.21.15.79:0/1431252461 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa794070e50 con 0x558b6cfe1af0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa77bfff640 1 -- 172.21.15.79:0/1431252461 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7fa78c059050 con 0x558b6cfe1af0 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 10 client.7995 fetch_fsmap finished waiting for FSMap version 68 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 10 client.7995 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 20 client.7995 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:04.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x558b6d004340 0x558b6d084990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 4 client.7995 mds_command: new command op to 7698 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a640f740 1 -- 172.21.15.79:0/1431252461 --> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b6cf29900 con 0x558b6d004340 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x558b6d004340 0x558b6d084990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa77bfff640 10 client.7995 ms_handle_connect on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.008+0000 7fa7a13c8640 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x558b6d004340 0x558b6d084990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=377b60ca2c32563f server_cookie=ca9b6a67986318bb in_seq=0 out_seq=0 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa77bfff640 1 -- 172.21.15.79:0/1431252461 <== mds.0 v2:172.21.15.79:6835/2980295924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x558b6cf29900 con 0x558b6d004340 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa77bfff640 10 client.7995 handle_command_reply: tid=0 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 client.7995 shutdown 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 -- 172.21.15.79:0/1431252461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 msgr2=0x558b6cfe0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfe0a00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fa78c02adf0 tx=0x7fa78c0078f0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 -- 172.21.15.79:0/1431252461 shutdown_connections 2024-06-10T00:23:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b6cfe8970 0x558b6cfe0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x558b6d004340 0x558b6d084990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558b6cfe1af0 0x558b6cfe0a00 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 --2- 172.21.15.79:0/1431252461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b6cfd3830 0x558b6d080f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa77bfff640 0 client.7995 ms_handle_reset on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 -- 172.21.15.79:0/1431252461 >> 172.21.15.79:0/1431252461 conn(0x558b6cfc06d0 msgr2=0x558b6cfe4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 -- 172.21.15.79:0/1431252461 shutdown_connections 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 1 -- 172.21.15.79:0/1431252461 wait complete. 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a640f740 20 client.7995 trim_cache size 0 max 16384 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:23:04.015 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:23:04.016 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:23:04.016 INFO:teuthology.orchestra.run.smithi079.stdout: "5ace9dfc-4cc1-4e74-b41d-5a756867aede": { 2024-06-10T00:23:04.016 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-06-10T00:23:04.016 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "5ace9dfc-4cc1-4e74-b41d-5a756867aede", 2024-06-10T00:23:04.016 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-06-10T00:23:04.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:23:04.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:23:04.016 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:23:04.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a362c640 1 -- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa78006be30 msgr2=0x7fa78006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:04.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a362c640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa78006be30 0x7fa78006e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa798006fd0 tx=0x7fa798008040 comp rx=0 tx=0).stop 2024-06-10T00:23:04.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a362c640 1 -- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79c15dbf0 msgr2=0x7fa79c15e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:04.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.009+0000 7fa7a362c640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79c15dbf0 0x7fa79c15e070 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0d0c10 tx=0x7fa79400eb90 comp rx=0 tx=0).stop 2024-06-10T00:23:04.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.010+0000 7fa7a362c640 1 -- 172.21.15.79:0/712038589 shutdown_connections 2024-06-10T00:23:04.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.010+0000 7fa7a362c640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa78006be30 0x7fa78006e2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.010+0000 7fa7a362c640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa79c15dbf0 0x7fa79c15e070 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.010+0000 7fa7a362c640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa79c09bc40 0x7fa79c09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.010+0000 7fa7a362c640 1 --2- 172.21.15.79:0/712038589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa788004800 0x7fa79c0cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:04.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.010+0000 7fa7a362c640 1 -- 172.21.15.79:0/712038589 >> 172.21.15.79:0/712038589 conn(0x7fa79c0b1d10 msgr2=0x7fa79c0ae260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:04.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.010+0000 7fa7a362c640 1 -- 172.21.15.79:0/712038589 shutdown_connections 2024-06-10T00:23:04.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.010+0000 7fa7a362c640 1 -- 172.21.15.79:0/712038589 wait complete. 2024-06-10T00:23:04.020 INFO:tasks.cephfs.filesystem:scrub status for tag:5ace9dfc-4cc1-4e74-b41d-5a756867aede - {'path': '/', 'tag': '5ace9dfc-4cc1-4e74-b41d-5a756867aede', 'options': 'recursive,repair'} 2024-06-10T00:23:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:04.521+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 7 ==== log(4 entries from seq 1 at 2024-06-10T00:23:03.857344+0000) ==== 695+0+0 (secure 0 0 0) 0x7f49dc078110 con 0x7f49e00d0c70 2024-06-10T00:23:04.521 INFO:teuthology.orchestra.run.smithi079.stdout: cluster: 2024-06-10T00:23:04.521 INFO:teuthology.orchestra.run.smithi079.stdout: id: 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:23:04.521 INFO:teuthology.orchestra.run.smithi079.stdout: health: HEALTH_OK 2024-06-10T00:23:04.521 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:04.521 INFO:teuthology.orchestra.run.smithi079.stdout: services: 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: mgr: y(active, since 8m), standbys: x 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: mds: 1/1 daemons up, 3 standby 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: data: 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: volumes: 1/1 healthy 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: pools: 3 pools, 97 pgs 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: objects: 30 objects, 19 MiB 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: usage: 291 MiB used, 720 GiB / 720 GiB avail 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: pgs: 97 active+clean 2024-06-10T00:23:04.522 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:04.523 INFO:teuthology.orchestra.run.smithi079.stdout: io: 2024-06-10T00:23:04.523 INFO:teuthology.orchestra.run.smithi079.stdout: client: 85 B/s rd, 1.5 MiB/s wr, 0 op/s rd, 3 op/s wr 2024-06-10T00:23:04.523 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:04.523 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:04.523 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:03.857344+0000 mds.a [INF] scrub queued for path: / 2024-06-10T00:23:04.523 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:03.857347+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-06-10T00:23:04.523 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:03.857352+0000 mds.a [INF] scrub summary: active paths [/] 2024-06-10T00:23:04.523 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:03.858565+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-06-10T00:23:07.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:07.529+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 8 ==== log(1 entries from seq 5 at 2024-06-10T00:23:07.404381+0000) ==== 189+0+0 (secure 0 0 0) 0x7f49dc078370 con 0x7f49e00d0c70 2024-06-10T00:23:07.529 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:07.404381+0000 mds.a [INF] scrub summary: idle 2024-06-10T00:23:15.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:23:15.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:23:25.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:25.555+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 9 ==== log(3 entries from seq 1029 at 2024-06-10T00:23:24.984974+0000) ==== 889+0+0 (secure 0 0 0) 0x7f49dc0aa370 con 0x7f49e00d0c70 2024-06-10T00:23:26.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:26.565+0000 7f49d5ffb640 1 -- 172.21.15.79:0/3815662866 <== mon.0 v2:172.21.15.79:3300/0 10 ==== log(3 entries from seq 1032 at 2024-06-10T00:23:25.560473+0000) ==== 895+0+0 (secure 0 0 0) 0x7f49dc030d20 con 0x7f49e00d0c70 2024-06-10T00:23:34.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:23:34.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-06-10T00:23:34.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.135+0000 7f1af7e5d640 1 Processor -- start 2024-06-10T00:23:34.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.135+0000 7f1af7e5d640 1 -- start start 2024-06-10T00:23:34.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af7e5d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1af015bbc0 0x7f1af006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af7e5d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1af015e670 0x7f1af015eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af7e5d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1af015f0f0 con 0x7f1af00d0020 2024-06-10T00:23:34.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af7e5d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1af015f3d0 con 0x7f1af015e670 2024-06-10T00:23:34.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af7e5d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1af006cfa0 con 0x7f1af015bbc0 2024-06-10T00:23:34.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af53f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1af015e670 0x7f1af015eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af63fa640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1af00d0020 0x7f1af00acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33936/0 (socket says 172.21.15.79:33936) 2024-06-10T00:23:34.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af53f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1af015e670 0x7f1af015eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41136/0 (socket says 172.21.15.79:41136) 2024-06-10T00:23:34.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af63fa640 1 -- 172.21.15.79:0/4141659065 learned_addr learned my addr 172.21.15.79:0/4141659065 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:23:34.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/4141659065 >> v2:172.21.15.117:3300/0 conn(0x7f1af015bbc0 0x7f1af006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af53f8640 1 -- 172.21.15.79:0/4141659065 >> v2:172.21.15.117:3300/0 conn(0x7f1af015bbc0 msgr2=0x7f1af006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af53f8640 1 --2- 172.21.15.79:0/4141659065 >> v2:172.21.15.117:3300/0 conn(0x7f1af015bbc0 0x7f1af006d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af53f8640 1 -- 172.21.15.79:0/4141659065 >> v1:172.21.15.79:6789/0 conn(0x7f1af00d0020 legacy=0x7f1af00acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.136+0000 7f1af53f8640 1 -- 172.21.15.79:0/4141659065 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af006d280 con 0x7f1af015e670 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.137+0000 7f1af53f8640 1 --2- 172.21.15.79:0/4141659065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af015e670 0x7f1af015eae0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f1af006f3a0 tx=0x7f1ae002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837668cd97ddc64b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.137+0000 7f1af4bf7640 1 -- 172.21.15.79:0/4141659065 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0037070 con 0x7f1af015e670 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.137+0000 7f1af4bf7640 1 -- 172.21.15.79:0/4141659065 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ae0032440 con 0x7f1af015e670 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.137+0000 7f1af4bf7640 1 -- 172.21.15.79:0/4141659065 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0032810 con 0x7f1af015e670 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.138+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4141659065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af015e670 msgr2=0x7f1af015eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.138+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4141659065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af015e670 0x7f1af015eae0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f1af006f3a0 tx=0x7f1ae002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.138+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4141659065 shutdown_connections 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.138+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4141659065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af015e670 0x7f1af015eae0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.138+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4141659065 >> v2:172.21.15.117:3300/0 conn(0x7f1af015bbc0 0x7f1af006d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.138+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4141659065 >> 172.21.15.79:0/4141659065 conn(0x7f1af00b1d10 msgr2=0x7f1af00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.138+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4141659065 shutdown_connections 2024-06-10T00:23:34.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.138+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4141659065 wait complete. 2024-06-10T00:23:34.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.139+0000 7f1af7e5d640 1 Processor -- start 2024-06-10T00:23:34.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.139+0000 7f1af7e5d640 1 -- start start 2024-06-10T00:23:34.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af7e5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af00d0020 0x7f1af0133100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af7e5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af015bbc0 0x7f1af01e9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af7e5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af015e670 0x7f1af015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af7e5d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1af00b4d90 con 0x7f1af00d0020 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af7e5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1af006dce0 con 0x7f1af015bbc0 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af7e5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1af00b4f10 con 0x7f1af015e670 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af5bf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af00d0020 0x7f1af0133100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af5bf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af00d0020 0x7f1af0133100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41152/0 (socket says 172.21.15.79:41152) 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af5bf9640 1 -- 172.21.15.79:0/4218708221 learned_addr learned my addr 172.21.15.79:0/4218708221 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af63fa640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af015e670 0x7f1af015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af53f8640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af015bbc0 0x7f1af01e9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af5bf9640 1 -- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af015e670 msgr2=0x7f1af015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af015e670 0x7f1af015f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af5bf9640 1 -- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af015bbc0 msgr2=0x7f1af01e9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af015bbc0 0x7f1af01e9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af5bf9640 1 -- 172.21.15.79:0/4218708221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af01e8da0 con 0x7f1af00d0020 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.140+0000 7f1af53f8640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af015bbc0 0x7f1af01e9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.141+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af00d0020 0x7f1af0133100 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00d800 tx=0x7f1aec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.141+0000 7f1ae67fc640 1 -- 172.21.15.79:0/4218708221 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00b6c0 con 0x7f1af00d0020 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.141+0000 7f1ae67fc640 1 -- 172.21.15.79:0/4218708221 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec019070 con 0x7f1af00d0020 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.141+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4218708221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af01e9080 con 0x7f1af00d0020 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.141+0000 7f1ae67fc640 1 -- 172.21.15.79:0/4218708221 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00ba80 con 0x7f1af00d0020 2024-06-10T00:23:34.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.141+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4218708221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af01e9640 con 0x7f1af00d0020 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.143+0000 7f1ae67fc640 1 -- 172.21.15.79:0/4218708221 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1aec00bc20 con 0x7f1af00d0020 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.143+0000 7f1ae67fc640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.143+0000 7f1ae67fc640 1 -- 172.21.15.79:0/4218708221 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6188+0+0 (secure 0 0 0) 0x7f1aec08b380 con 0x7f1af00d0020 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.143+0000 7f1af53f8640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.144+0000 7f1af53f8640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0034000 tx=0x7f1ae002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.144+0000 7f1afab6a740 1 Processor -- start 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.144+0000 7f1afab6a740 1 -- start start 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 0x5560c039a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03951a0 0x5560c039a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c039c6d0 0x5560c039aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1afab6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5560c02bf7e0 con 0x5560c039c6d0 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1afab6a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5560c02fde80 con 0x5560c03bdaf0 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1afab6a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5560c029b700 con 0x5560c03951a0 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c039c6d0 0x5560c039aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c039c6d0 0x5560c039aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41158/0 (socket says 172.21.15.79:41158) 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 -- 172.21.15.79:0/1381872333 learned_addr learned my addr 172.21.15.79:0/1381872333 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af53f8640 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03951a0 0x5560c039a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 0x5560c039a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 -- 172.21.15.79:0/1381872333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03951a0 msgr2=0x5560c039a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03951a0 0x5560c039a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 -- 172.21.15.79:0/1381872333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 msgr2=0x5560c039a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 0x5560c039a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 -- 172.21.15.79:0/1381872333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c02badd0 con 0x5560c039c6d0 2024-06-10T00:23:34.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.145+0000 7f1af63fa640 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c039c6d0 0x5560c039aba0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800f280 tx=0x7f1ae80019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39597d16dee1abc6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1ad37fe640 1 -- 172.21.15.79:0/1381872333 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae800fea0 con 0x5560c039c6d0 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1ad37fe640 1 -- 172.21.15.79:0/1381872333 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ae8018070 con 0x5560c039c6d0 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1ad37fe640 1 -- 172.21.15.79:0/1381872333 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80074e0 con 0x5560c039c6d0 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 -- 172.21.15.79:0/1381872333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c039c6d0 msgr2=0x5560c039aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c039c6d0 0x5560c039aba0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800f280 tx=0x7f1ae80019f0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 -- 172.21.15.79:0/1381872333 shutdown_connections 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c039c6d0 0x5560c039aba0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03951a0 0x5560c039a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 --2- 172.21.15.79:0/1381872333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 0x5560c039a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 -- 172.21.15.79:0/1381872333 >> 172.21.15.79:0/1381872333 conn(0x5560c0397410 msgr2=0x5560c03dff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 -- 172.21.15.79:0/1381872333 shutdown_connections 2024-06-10T00:23:34.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.146+0000 7f1afab6a740 1 -- 172.21.15.79:0/1381872333 wait complete. 2024-06-10T00:23:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.147+0000 7f1afab6a740 1 -- start start 2024-06-10T00:23:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.147+0000 7f1afab6a740 1 Processor -- start 2024-06-10T00:23:34.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 0x5560c03c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03ab730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03a9470 0x5560c03a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1afab6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5560c0286640 con 0x5560c03ab350 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1afab6a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5560c02f9e40 con 0x5560c03bdaf0 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1afab6a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5560c0398be0 con 0x5560c03a9470 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1afab6a740 10 client.0 _ll_register_callbacks cb 0x5560c02b8430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af53f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af53f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03ab730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41170/0 (socket says 172.21.15.79:41170) 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af53f8640 1 -- 172.21.15.79:0/2669718796 learned_addr learned my addr 172.21.15.79:0/2669718796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 0x5560c03c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af63fa640 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03a9470 0x5560c03a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af53f8640 1 -- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03a9470 msgr2=0x5560c03a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af53f8640 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03a9470 0x5560c03a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af53f8640 1 -- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 msgr2=0x5560c03c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af53f8640 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 0x5560c03c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af53f8640 1 -- 172.21.15.79:0/2669718796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c00db7d0 con 0x5560c03ab350 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.148+0000 7f1af63fa640 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03a9470 0x5560c03a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1af53f8640 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03ab730 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009860 tx=0x7f1ae0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3772ce7446d6075a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1ad0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/2669718796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae004e060 con 0x5560c03ab350 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/2669718796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6188+0+0 (secure 0 0 0) 0x7f1ae003e9f0 con 0x5560c03ab350 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 1 -- 172.21.15.79:0/2669718796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae8018070 con 0x5560c03ab350 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/2669718796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f1ae0054050 con 0x5560c03ab350 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 10 client.8010 fetch_fsmap learned FSMap version 68 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 1 -- 172.21.15.79:0/2669718796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5560c00113f0 con 0x5560c03ab350 2024-06-10T00:23:34.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/2669718796 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ae8018070 con 0x5560c03ab350 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/2669718796 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f1ae0057020 con 0x5560c03ab350 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 10 client.8010 fetch_fsmap finished waiting for FSMap version 68 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 10 client.8010 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 20 client.8010 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5560c03fb210 0x5560c03fd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 4 client.8010 mds_command: new command op to 7698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1afab6a740 1 -- 172.21.15.79:0/2669718796 --> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560c030b5b0 con 0x5560c03fb210 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.149+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5560c03fb210 0x5560c03fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1ad0ff9640 10 client.8010 ms_handle_connect on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5560c03fb210 0x5560c03fd600 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=994801cf27c01d41 server_cookie=5e4e79556ac77c4 in_seq=0 out_seq=0 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/2669718796 <== mds.0 v2:172.21.15.79:6835/2980295924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5560c030b5b0 con 0x5560c03fb210 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1ad0ff9640 10 client.8010 handle_command_reply: tid=0 2024-06-10T00:23:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 client.8010 shutdown 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 -- 172.21.15.79:0/2669718796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 msgr2=0x5560c03ab730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03ab730 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009860 tx=0x7f1ae0004730 comp rx=0 tx=0).stop 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 -- 172.21.15.79:0/2669718796 shutdown_connections 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03a9470 0x5560c03a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5560c03fb210 0x5560c03fd600 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03ab730 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 --2- 172.21.15.79:0/2669718796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03bdaf0 0x5560c03c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1ad0ff9640 0 client.8010 ms_handle_reset on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.150+0000 7f1afab6a740 1 -- 172.21.15.79:0/2669718796 >> 172.21.15.79:0/2669718796 conn(0x5560c039c6d0 msgr2=0x5560c03bb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.151+0000 7f1afab6a740 1 -- 172.21.15.79:0/2669718796 shutdown_connections 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.151+0000 7f1afab6a740 1 -- 172.21.15.79:0/2669718796 wait complete. 2024-06-10T00:23:34.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.151+0000 7f1afab6a740 20 client.8010 trim_cache size 0 max 16384 2024-06-10T00:23:34.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.169+0000 7f1afab6a740 1 Processor -- start 2024-06-10T00:23:34.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.169+0000 7f1afab6a740 1 -- start start 2024-06-10T00:23:34.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.169+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03a9470 0x5560c03c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.169+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03ab350 0x5560c03bf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.169+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 0x5560c03aa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.169+0000 7f1afab6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1af0200d70 con 0x5560c03a9470 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.169+0000 7f1afab6a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01ffde0 con 0x5560c03ab350 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.169+0000 7f1afab6a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1af0136840 con 0x5560c03bdaf0 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03a9470 0x5560c03c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03a9470 0x5560c03c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41172/0 (socket says 172.21.15.79:41172) 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 -- 172.21.15.79:0/1895995943 learned_addr learned my addr 172.21.15.79:0/1895995943 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af63fa640 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 0x5560c03aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af53f8640 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03ab350 0x5560c03bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 -- 172.21.15.79:0/1895995943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 msgr2=0x5560c03aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 0x5560c03aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 -- 172.21.15.79:0/1895995943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03ab350 msgr2=0x5560c03bf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03ab350 0x5560c03bf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 -- 172.21.15.79:0/1895995943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560bffd10f0 con 0x5560c03a9470 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03a9470 0x5560c03c5910 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0591e0 tx=0x7f1aec020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1251109bc6eef589 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1ad2ffd640 1 -- 172.21.15.79:0/1895995943 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec057580 con 0x5560c03a9470 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1ad2ffd640 1 -- 172.21.15.79:0/1895995943 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec0577e0 con 0x5560c03a9470 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.170+0000 7f1ad2ffd640 1 -- 172.21.15.79:0/1895995943 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec055b50 con 0x5560c03a9470 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 -- 172.21.15.79:0/1895995943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03a9470 msgr2=0x5560c03c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03a9470 0x5560c03c5910 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0591e0 tx=0x7f1aec020040 comp rx=0 tx=0).stop 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 -- 172.21.15.79:0/1895995943 shutdown_connections 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 0x5560c03aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03ab350 0x5560c03bf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 --2- 172.21.15.79:0/1895995943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03a9470 0x5560c03c5910 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 -- 172.21.15.79:0/1895995943 >> 172.21.15.79:0/1895995943 conn(0x5560c039c6d0 msgr2=0x5560c0390830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 -- 172.21.15.79:0/1895995943 shutdown_connections 2024-06-10T00:23:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 -- 172.21.15.79:0/1895995943 wait complete. 2024-06-10T00:23:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 -- start start 2024-06-10T00:23:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.171+0000 7f1afab6a740 1 Processor -- start 2024-06-10T00:23:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03a9470 0x5560c0394110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1afab6a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 0x5560c03aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1afab6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5560c0398530 con 0x5560c03ab350 2024-06-10T00:23:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1afab6a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01ff790 con 0x5560c03a9470 2024-06-10T00:23:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1afab6a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5560c03e0540 con 0x5560c03bdaf0 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1afab6a740 10 client.0 _ll_register_callbacks cb 0x7f1ae0032900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1af53f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1af53f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41174/0 (socket says 172.21.15.79:41174) 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.172+0000 7f1af53f8640 1 -- 172.21.15.79:0/3892349221 learned_addr learned my addr 172.21.15.79:0/3892349221 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03a9470 0x5560c0394110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af63fa640 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 0x5560c03aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af53f8640 1 -- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 msgr2=0x5560c03aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af53f8640 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 0x5560c03aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af53f8640 1 -- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03a9470 msgr2=0x5560c0394110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af53f8640 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03a9470 0x5560c0394110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af53f8640 1 -- 172.21.15.79:0/3892349221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c02c4560 con 0x5560c03ab350 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03a9470 0x5560c0394110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1af53f8640 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03aa460 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0035040 tx=0x7f1ae003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5266701abcfb93ed server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1ad0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/3892349221 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae005c030 con 0x5560c03ab350 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/3892349221 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6188+0+0 (secure 0 0 0) 0x7f1ae003ca70 con 0x5560c03ab350 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 1 -- 172.21.15.79:0/3892349221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aec0577e0 con 0x5560c03ab350 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/3892349221 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f1ae0065050 con 0x5560c03ab350 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 10 client.8016 fetch_fsmap learned FSMap version 68 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 1 -- 172.21.15.79:0/3892349221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5560c03946b0 con 0x5560c03ab350 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/3892349221 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec0577e0 con 0x5560c03ab350 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/3892349221 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f1ae0068020 con 0x5560c03ab350 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 10 client.8016 fetch_fsmap finished waiting for FSMap version 68 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 10 client.8016 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 20 client.8016 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5560c03ee690 0x5560c03eea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 4 client.8016 mds_command: new command op to 7698 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.173+0000 7f1afab6a740 1 -- 172.21.15.79:0/3892349221 --> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560c0305900 con 0x5560c03ee690 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5560c03ee690 0x5560c03eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1ad0ff9640 10 client.8016 ms_handle_connect on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1af5bf9640 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5560c03ee690 0x5560c03eea70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b96cfbea5e7282a server_cookie=6af3629ef5d394e9 in_seq=0 out_seq=0 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1ad0ff9640 1 -- 172.21.15.79:0/3892349221 <== mds.0 v2:172.21.15.79:6835/2980295924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5560c0305900 con 0x5560c03ee690 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1ad0ff9640 10 client.8016 handle_command_reply: tid=0 2024-06-10T00:23:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 client.8016 shutdown 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 -- 172.21.15.79:0/3892349221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 msgr2=0x5560c03aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03aa460 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0035040 tx=0x7f1ae003b000 comp rx=0 tx=0).stop 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 -- 172.21.15.79:0/3892349221 shutdown_connections 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560c03bdaf0 0x5560c03aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.79:6835/2980295924,v1:172.21.15.79:6837/2980295924] conn(0x5560c03ee690 0x5560c03eea70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5560c03ab350 0x5560c03aa460 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 --2- 172.21.15.79:0/3892349221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560c03a9470 0x5560c0394110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1ad0ff9640 0 client.8016 ms_handle_reset on v2:172.21.15.79:6835/2980295924 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 -- 172.21.15.79:0/3892349221 >> 172.21.15.79:0/3892349221 conn(0x5560c039c6d0 msgr2=0x5560c03ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 -- 172.21.15.79:0/3892349221 shutdown_connections 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 1 -- 172.21.15.79:0/3892349221 wait complete. 2024-06-10T00:23:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.174+0000 7f1afab6a740 20 client.8016 trim_cache size 0 max 16384 2024-06-10T00:23:34.183 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:23:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:23:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:23:34.183 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:23:34.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 msgr2=0x7f1ad406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0034000 tx=0x7f1ae002e000 comp rx=0 tx=0).stop 2024-06-10T00:23:34.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af00d0020 msgr2=0x7f1af0133100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af00d0020 0x7f1af0133100 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00d800 tx=0x7f1aec00dcc0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4218708221 shutdown_connections 2024-06-10T00:23:34.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f1ad406be30 0x7f1ad406e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af015e670 0x7f1af015f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af015bbc0 0x7f1af01e9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 --2- 172.21.15.79:0/4218708221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1af00d0020 0x7f1af0133100 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4218708221 >> 172.21.15.79:0/4218708221 conn(0x7f1af00b1d10 msgr2=0x7f1af00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4218708221 shutdown_connections 2024-06-10T00:23:34.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.175+0000 7f1af7e5d640 1 -- 172.21.15.79:0/4218708221 wait complete. 2024-06-10T00:23:34.187 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:23:34.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:23:34.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.387+0000 7fc932c3f640 1 Processor -- start 2024-06-10T00:23:34.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.387+0000 7fc932c3f640 1 -- start start 2024-06-10T00:23:34.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc932c3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c156830 0x7fc92c071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc932c3f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc92c072130 0x7fc92c0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc932c3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92c0725f0 con 0x7fc92c15c7f0 2024-06-10T00:23:34.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc932c3f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc92c0b3090 con 0x7fc92c072130 2024-06-10T00:23:34.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc932c3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c0728d0 con 0x7fc92c156830 2024-06-10T00:23:34.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc92bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc92c072130 0x7fc92c0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc9311dc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc92c15c7f0 0x7fc92c0b3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33948/0 (socket says 172.21.15.79:33948) 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc9311dc640 1 -- 172.21.15.79:0/2490788554 learned_addr learned my addr 172.21.15.79:0/2490788554 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc9309db640 1 --2- 172.21.15.79:0/2490788554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c156830 0x7fc92c071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc92bfff640 1 -- 172.21.15.79:0/2490788554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c156830 msgr2=0x7fc92c071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc92bfff640 1 --2- 172.21.15.79:0/2490788554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c156830 0x7fc92c071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc92bfff640 1 -- 172.21.15.79:0/2490788554 >> v1:172.21.15.79:6789/0 conn(0x7fc92c15c7f0 legacy=0x7fc92c0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.388+0000 7fc92bfff640 1 -- 172.21.15.79:0/2490788554 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c072bb0 con 0x7fc92c072130 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.389+0000 7fc92bfff640 1 --2- 172.21.15.79:0/2490788554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c072130 0x7fc92c0cc670 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc9180097d0 tx=0x7fc91802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8633e8595b23402 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.389+0000 7fc92b7fe640 1 -- 172.21.15.79:0/2490788554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918037070 con 0x7fc92c072130 2024-06-10T00:23:34.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.389+0000 7fc92b7fe640 1 -- 172.21.15.79:0/2490788554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc918032440 con 0x7fc92c072130 2024-06-10T00:23:34.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.389+0000 7fc92b7fe640 1 -- 172.21.15.79:0/2490788554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918032810 con 0x7fc92c072130 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.390+0000 7fc932c3f640 1 -- 172.21.15.79:0/2490788554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c072130 msgr2=0x7fc92c0cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.390+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2490788554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c072130 0x7fc92c0cc670 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc9180097d0 tx=0x7fc91802a1c0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.390+0000 7fc932c3f640 1 -- 172.21.15.79:0/2490788554 shutdown_connections 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.390+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2490788554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c072130 0x7fc92c0cc670 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.390+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2490788554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c156830 0x7fc92c071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.390+0000 7fc932c3f640 1 -- 172.21.15.79:0/2490788554 >> 172.21.15.79:0/2490788554 conn(0x7fc92c0b19f0 msgr2=0x7fc92c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.390+0000 7fc932c3f640 1 -- 172.21.15.79:0/2490788554 shutdown_connections 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.390+0000 7fc932c3f640 1 -- 172.21.15.79:0/2490788554 wait complete. 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.391+0000 7fc932c3f640 1 Processor -- start 2024-06-10T00:23:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.391+0000 7fc932c3f640 1 -- start start 2024-06-10T00:23:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc932c3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c072130 0x7fc92c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc932c3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc92c156830 0x7fc92c09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc932c3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c15c7f0 0x7fc92c09c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc932c3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c0ccd30 con 0x7fc92c15c7f0 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc932c3f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c0ccbb0 con 0x7fc92c156830 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc932c3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c0cceb0 con 0x7fc92c072130 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c15c7f0 0x7fc92c09c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c15c7f0 0x7fc92c09c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41186/0 (socket says 172.21.15.79:41186) 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 -- 172.21.15.79:0/2906963312 learned_addr learned my addr 172.21.15.79:0/2906963312 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc92bfff640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc92c156830 0x7fc92c09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9309db640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c072130 0x7fc92c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 -- 172.21.15.79:0/2906963312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c072130 msgr2=0x7fc92c06e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c072130 0x7fc92c06e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 -- 172.21.15.79:0/2906963312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc92c156830 msgr2=0x7fc92c09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc92c156830 0x7fc92c09aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 -- 172.21.15.79:0/2906963312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c09b240 con 0x7fc92c15c7f0 2024-06-10T00:23:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.392+0000 7fc9311dc640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c15c7f0 0x7fc92c09c2e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc92400caa0 tx=0x7fc92400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.393+0000 7fc9297fa640 1 -- 172.21.15.79:0/2906963312 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924017070 con 0x7fc92c15c7f0 2024-06-10T00:23:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.393+0000 7fc9297fa640 1 -- 172.21.15.79:0/2906963312 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92400ac00 con 0x7fc92c15c7f0 2024-06-10T00:23:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.393+0000 7fc9297fa640 1 -- 172.21.15.79:0/2906963312 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924012400 con 0x7fc92c15c7f0 2024-06-10T00:23:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.393+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c09b580 con 0x7fc92c15c7f0 2024-06-10T00:23:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.393+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c09bdc0 con 0x7fc92c15c7f0 2024-06-10T00:23:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.394+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92c068430 con 0x7fc92c15c7f0 2024-06-10T00:23:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.394+0000 7fc9297fa640 1 -- 172.21.15.79:0/2906963312 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc92401a070 con 0x7fc92c15c7f0 2024-06-10T00:23:34.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.394+0000 7fc9297fa640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc91006be80 0x7fc91006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.395+0000 7fc9297fa640 1 -- 172.21.15.79:0/2906963312 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6188+0+0 (secure 0 0 0) 0x7fc92408ac10 con 0x7fc92c15c7f0 2024-06-10T00:23:34.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.395+0000 7fc9309db640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc91006be80 0x7fc91006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.395+0000 7fc9309db640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc91006be80 0x7fc91006e340 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc920009b40 tx=0x7fc920009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.400+0000 7fc9297fa640 1 -- 172.21.15.79:0/2906963312 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc92c09b580 con 0x7fc92c15c7f0 2024-06-10T00:23:34.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.607+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc92c0b1e70 con 0x7fc92c15c7f0 2024-06-10T00:23:34.608 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:23:34.608+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:23:34.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.609+0000 7fc9297fa640 1 -- 172.21.15.79:0/2906963312 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) ==== 161+0+0 (secure 0 0 0) 0x7fc924058de0 con 0x7fc92c15c7f0 2024-06-10T00:23:34.610 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:23:34.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.612+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc91006be80 msgr2=0x7fc91006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.612+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc91006be80 0x7fc91006e340 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc920009b40 tx=0x7fc920009190 comp rx=0 tx=0).stop 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.612+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c15c7f0 msgr2=0x7fc92c09c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.612+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c15c7f0 0x7fc92c09c2e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc92400caa0 tx=0x7fc92400cf60 comp rx=0 tx=0).stop 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.613+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 shutdown_connections 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.613+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc91006be80 0x7fc91006e340 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.613+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92c15c7f0 0x7fc92c09c2e0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.613+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc92c156830 0x7fc92c09aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.613+0000 7fc932c3f640 1 --2- 172.21.15.79:0/2906963312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92c072130 0x7fc92c06e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.613+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 >> 172.21.15.79:0/2906963312 conn(0x7fc92c0b19f0 msgr2=0x7fc92c0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.613+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 shutdown_connections 2024-06-10T00:23:34.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.613+0000 7fc932c3f640 1 -- 172.21.15.79:0/2906963312 wait complete. 2024-06-10T00:23:34.615 INFO:tasks.ceph.mds.a.smithi079.stderr: -6066> 2024-06-10T00:22:42.728+0000 7f9f185b9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:23:34.625 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-06-10T00:23:34.646 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:23:34.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.668+0000 7f8fc218d280 1 -- start start 2024-06-10T00:23:34.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.668+0000 7f8fc218d280 1 Processor -- start 2024-06-10T00:23:34.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101b16000 0x565100db3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565100d3bc00 0x565100db3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101b16800 0x565100db3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x565101b18480 con 0x565101b16800 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x565101b18600 con 0x565100d3bc00 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x565101b18780 con 0x565101b16000 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101b16800 0x565100db3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101b16800 0x565100db3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41226/0 (socket says 172.21.15.79:41226) 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 -- 172.21.15.79:0/2275326695 learned_addr learned my addr 172.21.15.79:0/2275326695 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc0939640 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101b16000 0x565100db3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc0138640 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565100d3bc00 0x565100db3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 -- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101b16000 msgr2=0x565100db3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101b16000 0x565100db3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 -- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565100d3bc00 msgr2=0x565100db3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565100d3bc00 0x565100db3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 -- 172.21.15.79:0/2275326695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565100d70780 con 0x565101b16800 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc0138640 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565100d3bc00 0x565100db3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc113a640 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101b16800 0x565100db3600 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x565101b6d260 tx=0x565101ad6360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357f37d290579485 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fbe134640 1 -- 172.21.15.79:0/2275326695 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565100d60d00 con 0x565101b16800 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fbe134640 1 -- 172.21.15.79:0/2275326695 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x565100d66fc0 con 0x565101b16800 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fbe134640 1 -- 172.21.15.79:0/2275326695 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565100d60680 con 0x565101b16800 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 1 -- 172.21.15.79:0/2275326695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565100d70000 con 0x565101b16800 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 1 -- 172.21.15.79:0/2275326695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x565100d71680 con 0x565101b16800 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.669+0000 7f8fc218d280 4 waiting for MDS map... 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.670+0000 7f8fbe134640 1 -- 172.21.15.79:0/2275326695 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x565101c20600 con 0x565101b16800 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.670+0000 7f8fbe134640 1 -- 172.21.15.79:0/2275326695 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 2885+0+0 (secure 0 0 0) 0x565100d95180 con 0x565101b16800 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.670+0000 7f8fc218d280 4 Got MDS map 69 2024-06-10T00:23:34.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.670+0000 7f8fc218d280 10 main: JournalTool::main 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.670+0000 7f8fc218d280 4 main: JournalTool: connecting to RADOS... 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.670+0000 7f8fc218d280 1 Processor -- start 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.670+0000 7f8fc218d280 1 -- start start 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c22c00 0x565100db2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101c23400 0x565100db4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc218d280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x565100d9c180 con 0x565101c23000 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc218d280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x565101b18f00 con 0x565101c22c00 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc218d280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x565101b19080 con 0x565101c23400 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41230/0 (socket says 172.21.15.79:41230) 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 -- 172.21.15.79:0/2593342352 learned_addr learned my addr 172.21.15.79:0/2593342352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0138640 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c22c00 0x565100db2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0138640 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101c23400 0x565100db4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 -- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101c23400 msgr2=0x565100db4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101c23400 0x565100db4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 -- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c22c00 msgr2=0x565100db2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c22c00 0x565100db2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 -- 172.21.15.79:0/2593342352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565100d71860 con 0x565101c23000 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0138640 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c22c00 0x565100db2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fc0939640 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x565101c3a6c0 tx=0x565101c3d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc291b86ad258ab server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.671+0000 7f8fbc130640 1 -- 172.21.15.79:0/2593342352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565100d60d00 con 0x565101c23000 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fbc130640 1 -- 172.21.15.79:0/2593342352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x565100d66e00 con 0x565101c23000 2024-06-10T00:23:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fbc130640 1 -- 172.21.15.79:0/2593342352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565100d60680 con 0x565101c23000 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 -- 172.21.15.79:0/2593342352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 msgr2=0x565100db4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x565101c3a6c0 tx=0x565101c3d800 comp rx=0 tx=0).stop 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 -- 172.21.15.79:0/2593342352 shutdown_connections 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101c23400 0x565100db4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 --2- 172.21.15.79:0/2593342352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c22c00 0x565100db2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 -- 172.21.15.79:0/2593342352 >> 172.21.15.79:0/2593342352 conn(0x565101b16400 msgr2=0x565100e2d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 -- 172.21.15.79:0/2593342352 shutdown_connections 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 -- 172.21.15.79:0/2593342352 wait complete. 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.672+0000 7f8fc218d280 1 Processor -- start 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc218d280 1 -- start start 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101c22c00 0x565100db2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc218d280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c23400 0x565100db4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc218d280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x565101b19380 con 0x565101c23000 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc218d280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x565101b19200 con 0x565101c23400 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc218d280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x565101b19500 con 0x565101c22c00 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41242/0 (socket says 172.21.15.79:41242) 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0939640 1 -- 172.21.15.79:0/238167627 learned_addr learned my addr 172.21.15.79:0/238167627 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0138640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c23400 0x565100db4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0939640 1 -- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101c22c00 msgr2=0x565100db2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0939640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101c22c00 0x565100db2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0939640 1 -- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c23400 msgr2=0x565100db4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0939640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c23400 0x565100db4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0939640 1 -- 172.21.15.79:0/238167627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565100d70780 con 0x565101c23000 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.673+0000 7f8fc0138640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565101c23400 0x565100db4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.674+0000 7f8fc0939640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x565101c3b980 tx=0x565101ad4a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.674+0000 7f8fba92d640 1 -- 172.21.15.79:0/238167627 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565100d60820 con 0x565101c23000 2024-06-10T00:23:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.674+0000 7f8fba92d640 1 -- 172.21.15.79:0/238167627 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x565100d66e00 con 0x565101c23000 2024-06-10T00:23:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.674+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565100d70000 con 0x565101c23000 2024-06-10T00:23:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.674+0000 7f8fba92d640 1 -- 172.21.15.79:0/238167627 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565100d60d00 con 0x565101c23000 2024-06-10T00:23:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.674+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565100d71a40 con 0x565101c23000 2024-06-10T00:23:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.674+0000 7f8fc218d280 4 main: JournalTool: resolving pool 15 2024-06-10T00:23:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fba92d640 1 -- 172.21.15.79:0/238167627 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x565101c96c00 con 0x565101c23000 2024-06-10T00:23:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fba92d640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x565101c92c00 0x565100db5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fba92d640 1 -- 172.21.15.79:0/238167627 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x565101c94a00 con 0x565101c23000 2024-06-10T00:23:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fc0138640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x565101c92c00 0x565100db5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fc218d280 4 main: JournalTool: creating IoCtx.. 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fc218d280 4 main: Executing for rank 0 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fc218d280 4 Filtering by inode '1099511627777' 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fc218d280 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x565101c23800 0x565100db4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.675+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x565101c23c00 con 0x565101c23800 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.676+0000 7f8fc0138640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x565101c23800 0x565100db4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.676+0000 7f8fc0138640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x565101c92c00 0x565100db5700 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x565101b6ccf0 tx=0x565101ad5f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.676+0000 7f8fc0138640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x565101c23800 0x565100db4c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc0138640 1 -- 172.21.15.79:0/238167627 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x565100e32000 con 0x565101c23800 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 4 Pointer 400.00000000 is readable 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 4 JournalScanner::scan: reading header object '200.00000000' 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x565101c93000 con 0x565101c23800 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc0138640 1 -- 172.21.15.79:0/238167627 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x565100e32000 con 0x565101c23800 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 10 Header 0x400000 0x405f0c 0x406288 2024-06-10T00:23:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 10 Starting journal scan from offset 0x405f0c 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 24332~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x565101c93400 con 0x565101c23800 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc0138640 1 -- 172.21.15.79:0/238167627 <== osd.6 v2:172.21.15.117:6808/1306883621 3 ==== osd_op_reply(3 200.00000001 [read 24332~892 out=892b] v0'0 uv27 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x565100e32000 con 0x565101c23800 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 10 Parsing data, 0x37c bytes available 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 10 Attempting decode at 0x405f0c 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 10 Consumed 0x37c bytes 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 10 Valid entry at 0x405f0c 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x565101c93800 0x565100db5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x565101c93c00 con 0x565101c93800 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc113a640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x565101c93800 0x565100db5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.680+0000 7f8fc113a640 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x565101c93800 0x565100db5180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc113a640 1 -- 172.21.15.79:0/238167627 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x565100e32500 con 0x565101c93800 2024-06-10T00:23:34.687 INFO:teuthology.orchestra.run.smithi079.stdout:Events by type: 2024-06-10T00:23:34.687 INFO:teuthology.orchestra.run.smithi079.stdout:Errors: 0 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 4 Reached end of journal objects 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 4 Scanned objects, 0 missing, 1 valid 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 4 Events scanned, 0 gaps 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 4 Found 1 valid events 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 4 Selected 0 events events for processing 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 4 0 events 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x565101c23800 msgr2=0x565100db4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x565101c23800 0x565100db4c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x565101c93800 msgr2=0x565100db5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x565101c93800 0x565100db5180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x565101c92c00 msgr2=0x565100db5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x565101c92c00 0x565100db5700 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x565101b6ccf0 tx=0x565101ad5f80 comp rx=0 tx=0).stop 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 msgr2=0x565100db4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 --2- 172.21.15.79:0/238167627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101c23000 0x565100db4100 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x565101c3b980 tx=0x565101ad4a20 comp rx=0 tx=0).stop 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc0939640 1 -- 172.21.15.79:0/238167627 reap_dead start 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc0939640 1 -- 172.21.15.79:0/238167627 reap_dead start 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 shutdown_connections 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 >> 172.21.15.79:0/238167627 conn(0x565101b16400 msgr2=0x565100e2d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 shutdown_connections 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/238167627 wait complete. 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/2275326695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101b16800 msgr2=0x565100db3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101b16800 0x565100db3600 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x565101b6d260 tx=0x565101ad6360 comp rx=0 tx=0).stop 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/2275326695 shutdown_connections 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565101b16800 0x565100db3600 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565100d3bc00 0x565100db3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 --2- 172.21.15.79:0/2275326695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x565101b16000 0x565100db3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/2275326695 >> 172.21.15.79:0/2275326695 conn(0x565100d3b000 msgr2=0x565100e2d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/2275326695 shutdown_connections 2024-06-10T00:23:34.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.683+0000 7f8fc218d280 1 -- 172.21.15.79:0/2275326695 wait complete. 2024-06-10T00:23:34.691 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.066036, result: Events by type: Errors: 0 2024-06-10T00:23:34.691 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-06-10T00:23:34.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.772+0000 7f96b980c280 1 -- start start 2024-06-10T00:23:34.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.772+0000 7f96b980c280 1 Processor -- start 2024-06-10T00:23:34.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690074c00 0x5576900ec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690075800 0x5576900ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690075c00 0x5576900ed080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557690e52600 con 0x557690074c00 2024-06-10T00:23:34.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557690e52480 con 0x557690075800 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557690e52300 con 0x557690075c00 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690074c00 0x5576900ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690074c00 0x5576900ec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41266/0 (socket says 172.21.15.79:41266) 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 -- 172.21.15.79:0/1668612299 learned_addr learned my addr 172.21.15.79:0/1668612299 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b6adb640 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690075800 0x5576900ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b7add640 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690075c00 0x5576900ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 -- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690075c00 msgr2=0x5576900ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690075c00 0x5576900ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 -- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690075800 msgr2=0x5576900ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690075800 0x5576900ecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 -- 172.21.15.79:0/1668612299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576900aa780 con 0x557690074c00 2024-06-10T00:23:34.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b7add640 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690075c00 0x5576900ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b72dc640 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690074c00 0x5576900ec580 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x557690e99560 tx=0x557690e10fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a4fc67d0db896f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b4ad7640 1 -- 172.21.15.79:0/1668612299 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55769009a680 con 0x557690074c00 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b4ad7640 1 -- 172.21.15.79:0/1668612299 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5576900a0e00 con 0x557690074c00 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b4ad7640 1 -- 172.21.15.79:0/1668612299 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55769009ab60 con 0x557690074c00 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 1 -- 172.21.15.79:0/1668612299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576900ab4a0 con 0x557690074c00 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 1 -- 172.21.15.79:0/1668612299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5576900aa000 con 0x557690074c00 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b980c280 4 waiting for MDS map... 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.773+0000 7f96b4ad7640 1 -- 172.21.15.79:0/1668612299 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x557690f56600 con 0x557690074c00 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.774+0000 7f96b4ad7640 1 -- 172.21.15.79:0/1668612299 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 2885+0+0 (secure 0 0 0) 0x5576900cf180 con 0x557690074c00 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.774+0000 7f96b980c280 4 Got MDS map 69 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.774+0000 7f96b980c280 10 main: JournalTool::main 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.774+0000 7f96b980c280 4 main: JournalTool: connecting to RADOS... 2024-06-10T00:23:34.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.774+0000 7f96b980c280 1 Processor -- start 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.774+0000 7f96b980c280 1 -- start start 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b980c280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 0x5576900ed600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b980c280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 0x5576900edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b980c280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b980c280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557690e52180 con 0x557690f43c00 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b980c280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5576900d6480 con 0x557690f43400 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b980c280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5576900d6900 con 0x557690f43800 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41280/0 (socket says 172.21.15.79:41280) 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 -- 172.21.15.79:0/2406959446 learned_addr learned my addr 172.21.15.79:0/2406959446 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b7add640 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 0x5576900ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b72dc640 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 0x5576900edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 -- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 msgr2=0x5576900edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 0x5576900edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 -- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 msgr2=0x5576900ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 0x5576900ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 -- 172.21.15.79:0/2406959446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576900aa3c0 con 0x557690f43c00 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b7add640 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 0x5576900ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b6adb640 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee100 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x557690e98ab0 tx=0x557690f6f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31d2fde15f22b45 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b2ad3640 1 -- 172.21.15.79:0/2406959446 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55769009a680 con 0x557690f43c00 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b2ad3640 1 -- 172.21.15.79:0/2406959446 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5576900a0a80 con 0x557690f43c00 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.775+0000 7f96b2ad3640 1 -- 172.21.15.79:0/2406959446 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55769009ab60 con 0x557690f43c00 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 -- 172.21.15.79:0/2406959446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 msgr2=0x5576900ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee100 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x557690e98ab0 tx=0x557690f6f800 comp rx=0 tx=0).stop 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 -- 172.21.15.79:0/2406959446 shutdown_connections 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee100 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 0x5576900edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 --2- 172.21.15.79:0/2406959446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 0x5576900ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 -- 172.21.15.79:0/2406959446 >> 172.21.15.79:0/2406959446 conn(0x557690f43000 msgr2=0x557690165800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 -- 172.21.15.79:0/2406959446 shutdown_connections 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 -- 172.21.15.79:0/2406959446 wait complete. 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 Processor -- start 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.776+0000 7f96b980c280 1 -- start start 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b980c280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 0x5576900ef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b980c280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 0x5576900eec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b980c280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b980c280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557690e53380 con 0x557690f43c00 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b980c280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557690e52180 con 0x557690f43400 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b980c280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557690e53500 con 0x557690f43800 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41284/0 (socket says 172.21.15.79:41284) 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 -- 172.21.15.79:0/2515941920 learned_addr learned my addr 172.21.15.79:0/2515941920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b72dc640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 0x5576900eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b7add640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 0x5576900ef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 -- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 msgr2=0x5576900eec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690f43800 0x5576900eec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 -- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 msgr2=0x5576900ef180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690f43400 0x5576900ef180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 -- 172.21.15.79:0/2515941920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576900aa780 con 0x557690f43c00 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.777+0000 7f96b6adb640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee680 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x557690f694d0 tx=0x557690e10f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.778+0000 7f96b12d0640 1 -- 172.21.15.79:0/2515941920 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55769009a4e0 con 0x557690f43c00 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.778+0000 7f96b12d0640 1 -- 172.21.15.79:0/2515941920 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5576900a0c40 con 0x557690f43c00 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.778+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576900ab4a0 con 0x557690f43c00 2024-06-10T00:23:34.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.778+0000 7f96b12d0640 1 -- 172.21.15.79:0/2515941920 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55769009a680 con 0x557690f43c00 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.778+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576900aa960 con 0x557690f43c00 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.778+0000 7f96b980c280 4 main: JournalTool: resolving pool 15 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b12d0640 1 -- 172.21.15.79:0/2515941920 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x557690fcec00 con 0x557690f43c00 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b12d0640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x557690fc6c00 0x5576900ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b12d0640 1 -- 172.21.15.79:0/2515941920 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x557690fc8a00 con 0x557690f43c00 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b980c280 4 main: JournalTool: creating IoCtx.. 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b980c280 4 main: Executing for rank 0 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b980c280 4 Filtering by inode '1099511627778' 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b7add640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x557690fc6c00 0x5576900ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b980c280 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x557690fc7000 0x5576900ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.779+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x557690fc7400 con 0x557690fc7000 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.780+0000 7f96b72dc640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x557690fc7000 0x5576900ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.780+0000 7f96b7add640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x557690fc6c00 0x5576900ef700 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55769016c330 tx=0x557690e10d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.780+0000 7f96b72dc640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x557690fc7000 0x5576900ee100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.780+0000 7f96b72dc640 1 -- 172.21.15.79:0/2515941920 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5576901ea000 con 0x557690fc7000 2024-06-10T00:23:34.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.780+0000 7f96b980c280 4 Pointer 400.00000000 is readable 2024-06-10T00:23:34.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.780+0000 7f96b980c280 4 JournalScanner::scan: reading header object '200.00000000' 2024-06-10T00:23:34.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.780+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x557690fc7800 con 0x557690fc7000 2024-06-10T00:23:34.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b72dc640 1 -- 172.21.15.79:0/2515941920 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5576901ea000 con 0x557690fc7000 2024-06-10T00:23:34.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 10 Header 0x400000 0x405f0c 0x406288 2024-06-10T00:23:34.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 10 Starting journal scan from offset 0x405f0c 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 24332~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x557690fc7c00 con 0x557690fc7000 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b72dc640 1 -- 172.21.15.79:0/2515941920 <== osd.6 v2:172.21.15.117:6808/1306883621 3 ==== osd_op_reply(3 200.00000001 [read 24332~892 out=892b] v0'0 uv27 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x5576901ea000 con 0x557690fc7000 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 10 Parsing data, 0x37c bytes available 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 10 Attempting decode at 0x405f0c 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 10 Consumed 0x37c bytes 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 10 Valid entry at 0x405f0c 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x557690402000 0x5576900edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x557690402400 con 0x557690402000 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.781+0000 7f96b7add640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x557690402000 0x5576900edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b7add640 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x557690402000 0x5576900edb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b7add640 1 -- 172.21.15.79:0/2515941920 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5576901ea500 con 0x557690402000 2024-06-10T00:23:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 4 Reached end of journal objects 2024-06-10T00:23:34.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 4 Scanned objects, 0 missing, 1 valid 2024-06-10T00:23:34.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 4 Events scanned, 0 gaps 2024-06-10T00:23:34.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 4 Found 1 valid events 2024-06-10T00:23:34.791 INFO:teuthology.orchestra.run.smithi079.stdout:Events by type: 2024-06-10T00:23:34.791 INFO:teuthology.orchestra.run.smithi079.stdout:Errors: 0 2024-06-10T00:23:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 4 Selected 0 events events for processing 2024-06-10T00:23:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 4 0 events 2024-06-10T00:23:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x557690fc7000 msgr2=0x5576900ee100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x557690fc7000 0x5576900ee100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x557690402000 msgr2=0x5576900edb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x557690402000 0x5576900edb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x557690fc6c00 msgr2=0x5576900ef700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x557690fc6c00 0x5576900ef700 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55769016c330 tx=0x557690e10d20 comp rx=0 tx=0).stop 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 msgr2=0x5576900ee680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b6adb640 1 -- 172.21.15.79:0/2515941920 reap_dead start 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee680 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x557690f694d0 tx=0x557690e10f00 comp rx=0 tx=0).stop 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 shutdown_connections 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 --2- 172.21.15.79:0/2515941920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690f43c00 0x5576900ee680 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 >> 172.21.15.79:0/2515941920 conn(0x557690f43000 msgr2=0x557690165800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 shutdown_connections 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/2515941920 wait complete. 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 -- 172.21.15.79:0/1668612299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690074c00 msgr2=0x5576900ec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.782+0000 7f96b980c280 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690074c00 0x5576900ec580 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x557690e99560 tx=0x557690e10fc0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.783+0000 7f96b980c280 1 -- 172.21.15.79:0/1668612299 shutdown_connections 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.783+0000 7f96b980c280 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557690075c00 0x5576900ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.783+0000 7f96b980c280 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557690075800 0x5576900ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.783+0000 7f96b980c280 1 --2- 172.21.15.79:0/1668612299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557690074c00 0x5576900ec580 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.783+0000 7f96b980c280 1 -- 172.21.15.79:0/1668612299 >> 172.21.15.79:0/1668612299 conn(0x557690075000 msgr2=0x557690165000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.783+0000 7f96b980c280 1 -- 172.21.15.79:0/1668612299 shutdown_connections 2024-06-10T00:23:34.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.783+0000 7f96b980c280 1 -- 172.21.15.79:0/1668612299 wait complete. 2024-06-10T00:23:34.795 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.103857, result: Events by type: Errors: 0 2024-06-10T00:23:34.795 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-06-10T00:23:34.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.877+0000 7f71c4439f40 1 Processor -- start 2024-06-10T00:23:34.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.877+0000 7f71c4439f40 1 -- start start 2024-06-10T00:23:34.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c4439f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850b02490 0x555850bcbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c4439f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b4b510 0x555850bdb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c4439f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850bd89d0 0x555850bdba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c4439f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555850b06660 con 0x555850b02490 2024-06-10T00:23:34.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c4439f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555850aaae30 con 0x555850bd89d0 2024-06-10T00:23:34.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c4439f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555850b4a350 con 0x555850b4b510 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850b02490 0x555850bcbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850b02490 0x555850bcbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41304/0 (socket says 172.21.15.79:41304) 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 -- 172.21.15.79:0/1120576944 learned_addr learned my addr 172.21.15.79:0/1120576944 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71bbfff640 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b4b510 0x555850bdb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c273b640 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850bd89d0 0x555850bdba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 -- 172.21.15.79:0/1120576944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b4b510 msgr2=0x555850bdb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b4b510 0x555850bdb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 -- 172.21.15.79:0/1120576944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850bd89d0 msgr2=0x555850bdba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850bd89d0 0x555850bdba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 -- 172.21.15.79:0/1120576944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555850a2fcb0 con 0x555850b02490 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c1f3a640 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850b02490 0x555850bcbd00 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f71b4001d10 tx=0x7f71b400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3df0cd8420f97d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.879+0000 7f71c0f38640 1 -- 172.21.15.79:0/1120576944 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4001e60 con 0x555850b02490 2024-06-10T00:23:34.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c0f38640 1 -- 172.21.15.79:0/1120576944 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b400bd80 con 0x555850b02490 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c0f38640 1 -- 172.21.15.79:0/1120576944 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b400f640 con 0x555850b02490 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 -- 172.21.15.79:0/1120576944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850b02490 msgr2=0x555850bcbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850b02490 0x555850bcbd00 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f71b4001d10 tx=0x7f71b400b5b0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 -- 172.21.15.79:0/1120576944 shutdown_connections 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850bd89d0 0x555850bdba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b4b510 0x555850bdb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 --2- 172.21.15.79:0/1120576944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850b02490 0x555850bcbd00 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 -- 172.21.15.79:0/1120576944 >> 172.21.15.79:0/1120576944 conn(0x555850b04280 msgr2=0x555850b4c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 -- 172.21.15.79:0/1120576944 shutdown_connections 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.880+0000 7f71c4439f40 1 -- 172.21.15.79:0/1120576944 wait complete. 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c4439f40 1 Processor -- start 2024-06-10T00:23:34.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c4439f40 1 -- start start 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c4439f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b02490 0x555850bc22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c4439f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850b4b510 0x555850bc4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c4439f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850bd89d0 0x555850bc50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c4439f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555850b4cff0 con 0x555850bd89d0 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c4439f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555850b4d240 con 0x555850b4b510 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c4439f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555850bd98d0 con 0x555850b02490 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c273b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850bd89d0 0x555850bc50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c273b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850bd89d0 0x555850bc50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41310/0 (socket says 172.21.15.79:41310) 2024-06-10T00:23:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c273b640 1 -- 172.21.15.79:0/2800823477 learned_addr learned my addr 172.21.15.79:0/2800823477 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71c1f3a640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b02490 0x555850bc22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.881+0000 7f71bbfff640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850b4b510 0x555850bc4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71c273b640 1 -- 172.21.15.79:0/2800823477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b02490 msgr2=0x555850bc22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71c273b640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555850b02490 0x555850bc22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71c273b640 1 -- 172.21.15.79:0/2800823477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850b4b510 msgr2=0x555850bc4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71c273b640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555850b4b510 0x555850bc4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71c273b640 1 -- 172.21.15.79:0/2800823477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555850bcb890 con 0x555850bd89d0 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71c273b640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850bd89d0 0x555850bc50b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00a4b0 tx=0x7f71bc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71baffd640 1 -- 172.21.15.79:0/2800823477 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc055040 con 0x555850bd89d0 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71baffd640 1 -- 172.21.15.79:0/2800823477 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc065440 con 0x555850bd89d0 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555850bc8bc0 con 0x555850bd89d0 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71baffd640 1 -- 172.21.15.79:0/2800823477 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc065810 con 0x555850bd89d0 2024-06-10T00:23:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.882+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555850bc8e60 con 0x555850bd89d0 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.883+0000 7f71baffd640 1 -- 172.21.15.79:0/2800823477 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71bc058020 con 0x555850bd89d0 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.884+0000 7f71baffd640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406a810 0x7f71a406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.884+0000 7f71c1f3a640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406a810 0x7f71a406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.884+0000 7f71baffd640 1 -- 172.21.15.79:0/2800823477 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f71bc0cdb70 con 0x555850bd89d0 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.884+0000 7f71c4439f40 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x555850bce940 0x555850bc96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.884+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x555850bc9bf0 con 0x555850bce940 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.884+0000 7f71c1f3a640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406a810 0x7f71a406ccd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b5f0 tx=0x7f71b4009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.884+0000 7f71bbfff640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x555850bce940 0x555850bc96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.884+0000 7f71bbfff640 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x555850bce940 0x555850bc96b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71bbfff640 1 -- 172.21.15.79:0/2800823477 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v107'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f71ac009a10 con 0x555850bce940 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x555850bce940 msgr2=0x555850bc96b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x555850bce940 0x555850bc96b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406a810 msgr2=0x7f71a406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406a810 0x7f71a406ccd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b5f0 tx=0x7f71b4009000 comp rx=0 tx=0).stop 2024-06-10T00:23:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850bd89d0 msgr2=0x555850bc50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:34.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 --2- 172.21.15.79:0/2800823477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555850bd89d0 0x555850bc50b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00a4b0 tx=0x7f71bc003330 comp rx=0 tx=0).stop 2024-06-10T00:23:34.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c273b640 1 -- 172.21.15.79:0/2800823477 reap_dead start 2024-06-10T00:23:34.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 shutdown_connections 2024-06-10T00:23:34.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 >> 172.21.15.79:0/2800823477 conn(0x555850b04280 msgr2=0x555850bd8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:34.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 shutdown_connections 2024-06-10T00:23:34.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:34.886+0000 7f71c4439f40 1 -- 172.21.15.79:0/2800823477 wait complete. 2024-06-10T00:23:34.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-06-10T00:23:35.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.033+0000 7effd069e640 1 Processor -- start 2024-06-10T00:23:35.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.033+0000 7effd069e640 1 -- start start 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effd069e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc8155320 0x7effc80b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effd069e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effc80b34e0 0x7effc80d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effd069e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc8155700 con 0x7effc80d0560 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effd069e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7effc815b6b0 con 0x7effc80b34e0 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effd069e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effc815b990 con 0x7effc8155320 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effcdc39640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effc80b34e0 0x7effc80d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effcdc39640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effc80b34e0 0x7effc80d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41320/0 (socket says 172.21.15.79:41320) 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effcdc39640 1 -- 172.21.15.79:0/3761107619 learned_addr learned my addr 172.21.15.79:0/3761107619 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:35.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effce43a640 1 --2- 172.21.15.79:0/3761107619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc8155320 0x7effc80b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effcdc39640 1 -- 172.21.15.79:0/3761107619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc8155320 msgr2=0x7effc80b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:35.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effcdc39640 1 --2- 172.21.15.79:0/3761107619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc8155320 0x7effc80b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effcdc39640 1 -- 172.21.15.79:0/3761107619 >> v1:172.21.15.117:6789/0 conn(0x7effc80d0560 legacy=0x7effc806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:35.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.034+0000 7effcdc39640 1 -- 172.21.15.79:0/3761107619 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc815bc70 con 0x7effc80b34e0 2024-06-10T00:23:35.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.035+0000 7effcdc39640 1 --2- 172.21.15.79:0/3761107619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc80b34e0 0x7effc80d0020 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7effc4009870 tx=0x7effc402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac08f68250bec6e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:35.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.035+0000 7effcd438640 1 -- 172.21.15.79:0/3761107619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4037070 con 0x7effc80b34e0 2024-06-10T00:23:35.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.035+0000 7effcd438640 1 -- 172.21.15.79:0/3761107619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc4032440 con 0x7effc80b34e0 2024-06-10T00:23:35.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.035+0000 7effcd438640 1 -- 172.21.15.79:0/3761107619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4032810 con 0x7effc80b34e0 2024-06-10T00:23:35.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.036+0000 7effd069e640 1 -- 172.21.15.79:0/3761107619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc80b34e0 msgr2=0x7effc80d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.036+0000 7effd069e640 1 --2- 172.21.15.79:0/3761107619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc80b34e0 0x7effc80d0020 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7effc4009870 tx=0x7effc402a210 comp rx=0 tx=0).stop 2024-06-10T00:23:35.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.036+0000 7effd069e640 1 -- 172.21.15.79:0/3761107619 shutdown_connections 2024-06-10T00:23:35.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.036+0000 7effd069e640 1 --2- 172.21.15.79:0/3761107619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc80b34e0 0x7effc80d0020 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.036+0000 7effd069e640 1 --2- 172.21.15.79:0/3761107619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc8155320 0x7effc80b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.036+0000 7effd069e640 1 -- 172.21.15.79:0/3761107619 >> 172.21.15.79:0/3761107619 conn(0x7effc80b1d10 msgr2=0x7effc80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:35.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.036+0000 7effd069e640 1 -- 172.21.15.79:0/3761107619 shutdown_connections 2024-06-10T00:23:35.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.036+0000 7effd069e640 1 -- 172.21.15.79:0/3761107619 wait complete. 2024-06-10T00:23:35.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.037+0000 7effd069e640 1 Processor -- start 2024-06-10T00:23:35.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.037+0000 7effd069e640 1 -- start start 2024-06-10T00:23:35.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effd069e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc80b34e0 0x7effc814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effd069e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc80d0560 0x7effc809c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effd069e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8155320 0x7effc809c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effd069e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effc815b470 con 0x7effc8155320 2024-06-10T00:23:35.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effd069e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effc815b2f0 con 0x7effc80b34e0 2024-06-10T00:23:35.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effd069e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effc806e900 con 0x7effc80d0560 2024-06-10T00:23:35.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8155320 0x7effc809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8155320 0x7effc809c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41334/0 (socket says 172.21.15.79:41334) 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 -- 172.21.15.79:0/1998468565 learned_addr learned my addr 172.21.15.79:0/1998468565 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcdc39640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc80d0560 0x7effc809c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effce43a640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc80b34e0 0x7effc814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 -- 172.21.15.79:0/1998468565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc80d0560 msgr2=0x7effc809c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc80d0560 0x7effc809c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 -- 172.21.15.79:0/1998468565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc80b34e0 msgr2=0x7effc814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc80b34e0 0x7effc814fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 -- 172.21.15.79:0/1998468565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc814ff70 con 0x7effc8155320 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effcec3b640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8155320 0x7effc809c920 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7effc000c780 tx=0x7effc000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effbeffd640 1 -- 172.21.15.79:0/1998468565 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0004b60 con 0x7effc8155320 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effbeffd640 1 -- 172.21.15.79:0/1998468565 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc0004d00 con 0x7effc8155320 2024-06-10T00:23:35.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effbeffd640 1 -- 172.21.15.79:0/1998468565 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc000aa90 con 0x7effc8155320 2024-06-10T00:23:35.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc80ce110 con 0x7effc8155320 2024-06-10T00:23:35.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.038+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc8155da0 con 0x7effc8155320 2024-06-10T00:23:35.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.039+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc80683c0 con 0x7effc8155320 2024-06-10T00:23:35.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.040+0000 7effbeffd640 1 -- 172.21.15.79:0/1998468565 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effc000ac30 con 0x7effc8155320 2024-06-10T00:23:35.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.040+0000 7effbeffd640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effac06be30 0x7effac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.040+0000 7effce43a640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effac06be30 0x7effac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.040+0000 7effbeffd640 1 -- 172.21.15.79:0/1998468565 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7effc008b310 con 0x7effc8155320 2024-06-10T00:23:35.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.041+0000 7effce43a640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effac06be30 0x7effac06e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7effb8006fd0 tx=0x7effb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:35.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.044+0000 7effbeffd640 1 -- 172.21.15.79:0/1998468565 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7effc0020070 con 0x7effc8155320 2024-06-10T00:23:35.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.254+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7effc80cf640 con 0x7effc8155320 2024-06-10T00:23:35.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.614+0000 7effbeffd640 1 -- 172.21.15.79:0/1998468565 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v70) ==== 162+0+0 (secure 0 0 0) 0x7effc0059a80 con 0x7effc8155320 2024-06-10T00:23:35.614 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-06-10T00:23:35.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effac06be30 msgr2=0x7effac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effac06be30 0x7effac06e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7effb8006fd0 tx=0x7effb8008040 comp rx=0 tx=0).stop 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8155320 msgr2=0x7effc809c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8155320 0x7effc809c920 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7effc000c780 tx=0x7effc000cc40 comp rx=0 tx=0).stop 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 shutdown_connections 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effac06be30 0x7effac06e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8155320 0x7effc809c920 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc80d0560 0x7effc809c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 --2- 172.21.15.79:0/1998468565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc80b34e0 0x7effc814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 >> 172.21.15.79:0/1998468565 conn(0x7effc80b1d10 msgr2=0x7effc80b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 shutdown_connections 2024-06-10T00:23:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.617+0000 7effd069e640 1 -- 172.21.15.79:0/1998468565 wait complete. 2024-06-10T00:23:35.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:23:35.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.730+0000 7f2788f34640 1 Processor -- start 2024-06-10T00:23:35.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.730+0000 7f2788f34640 1 -- start start 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2788f34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27840cc6d0 0x7f27840ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2788f34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2784071c60 0x7f27840720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2788f34640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27840b36c0 0x7f27840b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2788f34640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f27840ccff0 con 0x7f27840b36c0 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2788f34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2784072820 con 0x7f27840cc6d0 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2788f34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2784072b00 con 0x7f2784071c60 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2782d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27840b36c0 0x7f27840b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2782d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27840b36c0 0x7f27840b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41346/0 (socket says 172.21.15.79:41346) 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2782d9d640 1 -- 172.21.15.79:0/1946643732 learned_addr learned my addr 172.21.15.79:0/1946643732 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f278259c640 1 --2- 172.21.15.79:0/1946643732 >> v2:172.21.15.117:3300/0 conn(0x7f27840cc6d0 0x7f27840ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.731+0000 7f2781d9b640 1 --2- 172.21.15.79:0/1946643732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2784071c60 0x7f27840720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f2782d9d640 1 -- 172.21.15.79:0/1946643732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2784071c60 msgr2=0x7f27840720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f2782d9d640 1 --2- 172.21.15.79:0/1946643732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2784071c60 0x7f27840720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f2782d9d640 1 -- 172.21.15.79:0/1946643732 >> v2:172.21.15.117:3300/0 conn(0x7f27840cc6d0 msgr2=0x7f27840ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f2782d9d640 1 --2- 172.21.15.79:0/1946643732 >> v2:172.21.15.117:3300/0 conn(0x7f27840cc6d0 0x7f27840ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f2782d9d640 1 -- 172.21.15.79:0/1946643732 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2784072de0 con 0x7f27840b36c0 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f278259c640 1 --2- 172.21.15.79:0/1946643732 >> v2:172.21.15.117:3300/0 conn(0x7f27840cc6d0 0x7f27840ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f2782d9d640 1 --2- 172.21.15.79:0/1946643732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27840b36c0 0x7f27840b3b30 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f278409e090 tx=0x7f277c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e68eedf7cb8434 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f278159a640 1 -- 172.21.15.79:0/1946643732 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c036070 con 0x7f27840b36c0 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f278159a640 1 -- 172.21.15.79:0/1946643732 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c031600 con 0x7f27840b36c0 2024-06-10T00:23:35.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.732+0000 7f278159a640 1 -- 172.21.15.79:0/1946643732 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0319d0 con 0x7f27840b36c0 2024-06-10T00:23:35.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 -- 172.21.15.79:0/1946643732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27840b36c0 msgr2=0x7f27840b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 --2- 172.21.15.79:0/1946643732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27840b36c0 0x7f27840b3b30 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f278409e090 tx=0x7f277c02a6a0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 -- 172.21.15.79:0/1946643732 shutdown_connections 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 --2- 172.21.15.79:0/1946643732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27840b36c0 0x7f27840b3b30 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 --2- 172.21.15.79:0/1946643732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2784071c60 0x7f27840720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 --2- 172.21.15.79:0/1946643732 >> v2:172.21.15.117:3300/0 conn(0x7f27840cc6d0 0x7f27840ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 -- 172.21.15.79:0/1946643732 >> 172.21.15.79:0/1946643732 conn(0x7f27840b19f0 msgr2=0x7f27840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 -- 172.21.15.79:0/1946643732 shutdown_connections 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.733+0000 7f2788f34640 1 -- 172.21.15.79:0/1946643732 wait complete. 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.734+0000 7f2788f34640 1 Processor -- start 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.734+0000 7f2788f34640 1 -- start start 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f2788f34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2784071c60 0x7f27841500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f2788f34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27840b36c0 0x7f2784157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f2788f34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27840cc6d0 0x7f2784157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f2788f34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2784159f60 con 0x7f2784071c60 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f2788f34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f278415c890 con 0x7f27840cc6d0 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f2788f34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f27840b4070 con 0x7f27840b36c0 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f278259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2784071c60 0x7f27841500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f278259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2784071c60 0x7f27841500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41350/0 (socket says 172.21.15.79:41350) 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f278259c640 1 -- 172.21.15.79:0/712635055 learned_addr learned my addr 172.21.15.79:0/712635055 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f2781d9b640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27840b36c0 0x7f2784157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.735+0000 7f2782d9d640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27840cc6d0 0x7f2784157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f278259c640 1 -- 172.21.15.79:0/712635055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27840b36c0 msgr2=0x7f2784157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f278259c640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27840b36c0 0x7f2784157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f278259c640 1 -- 172.21.15.79:0/712635055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27840cc6d0 msgr2=0x7f2784157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f278259c640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27840cc6d0 0x7f2784157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f278259c640 1 -- 172.21.15.79:0/712635055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2784158370 con 0x7f2784071c60 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f278259c640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2784071c60 0x7f27841500e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7f0 tx=0x7f277400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f2772ffd640 1 -- 172.21.15.79:0/712635055 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774015070 con 0x7f2784071c60 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f2772ffd640 1 -- 172.21.15.79:0/712635055 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2774007820 con 0x7f2784071c60 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f2772ffd640 1 -- 172.21.15.79:0/712635055 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774007bd0 con 0x7f2784071c60 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2784158650 con 0x7f2784071c60 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.736+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2784158c10 con 0x7f2784071c60 2024-06-10T00:23:35.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.737+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2784068430 con 0x7f2784071c60 2024-06-10T00:23:35.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.737+0000 7f2772ffd640 1 -- 172.21.15.79:0/712635055 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2774018070 con 0x7f2784071c60 2024-06-10T00:23:35.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.738+0000 7f2772ffd640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f276406be60 0x7f276406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:35.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.738+0000 7f2772ffd640 1 -- 172.21.15.79:0/712635055 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f277408b130 con 0x7f2784071c60 2024-06-10T00:23:35.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.738+0000 7f2781d9b640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f276406be60 0x7f276406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:35.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.738+0000 7f2781d9b640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f276406be60 0x7f276406e320 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2784153080 tx=0x7f2778008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:35.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.742+0000 7f2772ffd640 1 -- 172.21.15.79:0/712635055 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2774059250 con 0x7f2784071c60 2024-06-10T00:23:35.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.951+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f278406cdb0 con 0x7f2784071c60 2024-06-10T00:23:35.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.952+0000 7f2772ffd640 1 -- 172.21.15.79:0/712635055 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5175 (secure 0 0 0) 0x7f277405d550 con 0x7f2784071c60 2024-06-10T00:23:35.951 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:35.951 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:23:35.617175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8031":{"gid":8031,"name":"a","rank":0,"incarnation":71,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/4878507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4878507},{"type":"v1","addr":"172.21.15.79:6837","nonce":4878507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-06-10T00:23:35.952 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 71 2024-06-10T00:23:35.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.953+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f276406be60 msgr2=0x7f276406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.953+0000 7f2788f34640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f276406be60 0x7f276406e320 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2784153080 tx=0x7f2778008040 comp rx=0 tx=0).stop 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.953+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2784071c60 msgr2=0x7f27841500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.953+0000 7f2788f34640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2784071c60 0x7f27841500e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7f0 tx=0x7f277400ccb0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.954+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 shutdown_connections 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.954+0000 7f2788f34640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f276406be60 0x7f276406e320 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.954+0000 7f2788f34640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27840cc6d0 0x7f2784157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.954+0000 7f2788f34640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27840b36c0 0x7f2784157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.954+0000 7f2788f34640 1 --2- 172.21.15.79:0/712635055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2784071c60 0x7f27841500e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.954+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 >> 172.21.15.79:0/712635055 conn(0x7f27840b19f0 msgr2=0x7f27840b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.954+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 shutdown_connections 2024-06-10T00:23:35.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:35.954+0000 7f2788f34640 1 -- 172.21.15.79:0/712635055 wait complete. 2024-06-10T00:23:36.367 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:22:40.800117+0000', 'modified': '2024-06-10T00:23:35.617175+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8031}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8031': {'gid': 8031, 'name': 'a', 'rank': 0, 'incarnation': 71, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/4878507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 4878507}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 4878507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:23:36.367 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8031:up:replay 2024-06-10T00:23:37.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:23:37.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.481+0000 7f57bac1c640 1 Processor -- start 2024-06-10T00:23:37.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.481+0000 7f57bac1c640 1 -- start start 2024-06-10T00:23:37.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.482+0000 7f57bac1c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57b40d2680 0x7f57b415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:37.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.482+0000 7f57bac1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40cef70 0x7f57b40cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:37.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.482+0000 7f57bac1c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b40d0ad0 con 0x7f57b40d1fc0 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.482+0000 7f57bac1c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f57b40d13e0 con 0x7f57b40d2680 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.482+0000 7f57bac1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57b415f890 con 0x7f57b40cef70 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.482+0000 7f57b89b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57b40d2680 0x7f57b415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.482+0000 7f57b89b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57b40d2680 0x7f57b415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41366/0 (socket says 172.21.15.79:41366) 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.482+0000 7f57b89b8640 1 -- 172.21.15.79:0/2767832558 learned_addr learned my addr 172.21.15.79:0/2767832558 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.483+0000 7f57b91b9640 1 --2- 172.21.15.79:0/2767832558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40cef70 0x7f57b40cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.483+0000 7f57b89b8640 1 -- 172.21.15.79:0/2767832558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40cef70 msgr2=0x7f57b40cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.483+0000 7f57b89b8640 1 --2- 172.21.15.79:0/2767832558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40cef70 0x7f57b40cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.483+0000 7f57b89b8640 1 -- 172.21.15.79:0/2767832558 >> v1:172.21.15.117:6789/0 conn(0x7f57b40d1fc0 legacy=0x7f57b40d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.483+0000 7f57b89b8640 1 -- 172.21.15.79:0/2767832558 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b40d0d90 con 0x7f57b40d2680 2024-06-10T00:23:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.483+0000 7f57b91b9640 1 --2- 172.21.15.79:0/2767832558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40cef70 0x7f57b40cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:37.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57b89b8640 1 --2- 172.21.15.79:0/2767832558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40d2680 0x7f57b415f1a0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009870 tx=0x7f57a802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c06ed2ac566b65 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57b37fe640 1 -- 172.21.15.79:0/2767832558 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8037070 con 0x7f57b40d2680 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57b37fe640 1 -- 172.21.15.79:0/2767832558 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a8032440 con 0x7f57b40d2680 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57b37fe640 1 -- 172.21.15.79:0/2767832558 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8032810 con 0x7f57b40d2680 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57bac1c640 1 -- 172.21.15.79:0/2767832558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40d2680 msgr2=0x7f57b415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57bac1c640 1 --2- 172.21.15.79:0/2767832558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40d2680 0x7f57b415f1a0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009870 tx=0x7f57a802a250 comp rx=0 tx=0).stop 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57bac1c640 1 -- 172.21.15.79:0/2767832558 shutdown_connections 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57bac1c640 1 --2- 172.21.15.79:0/2767832558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40cef70 0x7f57b40cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57bac1c640 1 --2- 172.21.15.79:0/2767832558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40d2680 0x7f57b415f1a0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57bac1c640 1 -- 172.21.15.79:0/2767832558 >> 172.21.15.79:0/2767832558 conn(0x7f57b409d3f0 msgr2=0x7f57b40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57bac1c640 1 -- 172.21.15.79:0/2767832558 shutdown_connections 2024-06-10T00:23:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.484+0000 7f57bac1c640 1 -- 172.21.15.79:0/2767832558 wait complete. 2024-06-10T00:23:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.486+0000 7f57bac1c640 1 Processor -- start 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.486+0000 7f57bac1c640 1 -- start start 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.486+0000 7f57bac1c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40cef70 0x7f57b4159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.486+0000 7f57bac1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b40d1fc0 0x7f57b41f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.486+0000 7f57bac1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40d2680 0x7f57b40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.486+0000 7f57bac1c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f57b40d4f00 con 0x7f57b40cef70 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.486+0000 7f57bac1c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57b40d2400 con 0x7f57b40d1fc0 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.486+0000 7f57bac1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57b40d1870 con 0x7f57b40d2680 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40cef70 0x7f57b4159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40cef70 0x7f57b4159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41370/0 (socket says 172.21.15.79:41370) 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 -- 172.21.15.79:0/458358423 learned_addr learned my addr 172.21.15.79:0/458358423 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b91b9640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40d2680 0x7f57b40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b3fff640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b40d1fc0 0x7f57b41f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 -- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40d2680 msgr2=0x7f57b40cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40d2680 0x7f57b40cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 -- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b40d1fc0 msgr2=0x7f57b41f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b40d1fc0 0x7f57b41f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 -- 172.21.15.79:0/458358423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b40cc800 con 0x7f57b40cef70 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b91b9640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40d2680 0x7f57b40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b89b8640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40cef70 0x7f57b4159960 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f57a8000c00 tx=0x7f57a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b17fa640 1 -- 172.21.15.79:0/458358423 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8041020 con 0x7f57b40cef70 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b17fa640 1 -- 172.21.15.79:0/458358423 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a80306c0 con 0x7f57b40cef70 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57b17fa640 1 -- 172.21.15.79:0/458358423 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8037040 con 0x7f57b40cef70 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b40b98d0 con 0x7f57b40cef70 2024-06-10T00:23:37.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.487+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b40cccb0 con 0x7f57b40cef70 2024-06-10T00:23:37.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.488+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b4068430 con 0x7f57b40cef70 2024-06-10T00:23:37.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.489+0000 7f57b17fa640 1 -- 172.21.15.79:0/458358423 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57a8044020 con 0x7f57b40cef70 2024-06-10T00:23:37.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.489+0000 7f57b17fa640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f579806be30 0x7f579806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:37.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.489+0000 7f57b17fa640 1 -- 172.21.15.79:0/458358423 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f57a80ab890 con 0x7f57b40cef70 2024-06-10T00:23:37.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.489+0000 7f57b3fff640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f579806be30 0x7f579806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:37.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.490+0000 7f57b3fff640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f579806be30 0x7f579806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f57b40d2d10 tx=0x7f57a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:37.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.493+0000 7f57b17fa640 1 -- 172.21.15.79:0/458358423 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f57a804b030 con 0x7f57b40cef70 2024-06-10T00:23:37.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.706+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57b40b5910 con 0x7f57b40cef70 2024-06-10T00:23:37.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.707+0000 7f57b17fa640 1 -- 172.21.15.79:0/458358423 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5175 (secure 0 0 0) 0x7f57a807a090 con 0x7f57b40cef70 2024-06-10T00:23:37.707 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:37.707 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:23:36.622096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8031":{"gid":8031,"name":"a","rank":0,"incarnation":71,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6837/4878507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4878507},{"type":"v1","addr":"172.21.15.79:6837","nonce":4878507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-06-10T00:23:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 73 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f579806be30 msgr2=0x7f579806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f579806be30 0x7f579806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f57b40d2d10 tx=0x7f57a0009040 comp rx=0 tx=0).stop 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40cef70 msgr2=0x7f57b4159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40cef70 0x7f57b4159960 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f57a8000c00 tx=0x7f57a80046c0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 shutdown_connections 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f579806be30 0x7f579806e2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b40d2680 0x7f57b40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b40d1fc0 0x7f57b41f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 --2- 172.21.15.79:0/458358423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b40cef70 0x7f57b4159960 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 >> 172.21.15.79:0/458358423 conn(0x7f57b409d3f0 msgr2=0x7f57b415a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 shutdown_connections 2024-06-10T00:23:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:37.709+0000 7f57bac1c640 1 -- 172.21.15.79:0/458358423 wait complete. 2024-06-10T00:23:38.122 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:22:40.800117+0000', 'modified': '2024-06-10T00:23:36.622096+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8031}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8031': {'gid': 8031, 'name': 'a', 'rank': 0, 'incarnation': 71, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6837/4878507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 4878507}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 4878507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:23:38.122 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8031:up:rejoin 2024-06-10T00:23:39.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:23:39.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.234+0000 7f3d1f322640 1 Processor -- start 2024-06-10T00:23:39.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.235+0000 7f3d1f322640 1 -- start start 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.235+0000 7f3d1f322640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d1815f1a0 0x7f3d180d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.235+0000 7f3d1f322640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1815f5e0 con 0x7f3d180cef70 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.235+0000 7f3d1f322640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d180d0ad0 con 0x7f3d180d2680 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.235+0000 7f3d1f322640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3d180d13e0 con 0x7f3d1815f1a0 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d1d8bf640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3d180cef70 0x7f3d180cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42314/0 (socket says 172.21.15.79:42314) 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/471572084 learned_addr learned my addr 172.21.15.79:0/471572084 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d1c8bd640 1 --2- 172.21.15.79:0/471572084 >> v2:172.21.15.117:3300/0 conn(0x7f3d1815f1a0 0x7f3d180d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224614621 0 0) 0x7f3d1815f5e0 con 0x7f3d180cef70 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d04003520 con 0x7f3d180cef70 2024-06-10T00:23:39.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1369845570 0 0) 0x7f3d04003520 con 0x7f3d180cef70 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 >> v2:172.21.15.117:3300/0 conn(0x7f3d1815f1a0 msgr2=0x7f3d180d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 --2- 172.21.15.79:0/471572084 >> v2:172.21.15.117:3300/0 conn(0x7f3d1815f1a0 0x7f3d180d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 >> v1:172.21.15.117:6789/0 conn(0x7f3d180d2680 legacy=0x7f3d180d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1815f890 con 0x7f3d180cef70 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f3d100019f0 con 0x7f3d180cef70 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 >> v1:172.21.15.79:6789/0 conn(0x7f3d180cef70 legacy=0x7f3d180cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d040039b0 0x7f3d04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d04004800 0x7f3d04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d040051c0 0x7f3d0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180d13e0 con 0x7f3d040051c0 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0400c060 con 0x7f3d04004800 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0400c260 con 0x7f3d040039b0 2024-06-10T00:23:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d1d8bf640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d040051c0 0x7f3d0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d1d0be640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d040039b0 0x7f3d04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.236+0000 7f3d1c8bd640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d04004800 0x7f3d04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/471572084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d040039b0 msgr2=0x7f3d04003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d1d8bf640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d040039b0 0x7f3d04003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/471572084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d04004800 msgr2=0x7f3d04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d1d8bf640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d04004800 0x7f3d04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/471572084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d04003520 con 0x7f3d040051c0 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/471572084 reap_dead start 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d1d8bf640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d040051c0 0x7f3d0400b9c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000a860 tx=0x7f3d04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cef330ea46c359 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000a480 con 0x7f3d040051c0 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1002f070 con 0x7f3d040051c0 2024-06-10T00:23:39.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.237+0000 7f3d0ffff640 1 -- 172.21.15.79:0/471572084 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1002bca0 con 0x7f3d040051c0 2024-06-10T00:23:39.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.238+0000 7f3d1f322640 1 -- 172.21.15.79:0/471572084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d040051c0 msgr2=0x7f3d0400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.238+0000 7f3d1f322640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d040051c0 0x7f3d0400b9c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000a860 tx=0x7f3d04005830 comp rx=0 tx=0).stop 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.238+0000 7f3d1f322640 1 -- 172.21.15.79:0/471572084 shutdown_connections 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.238+0000 7f3d1f322640 1 --2- 172.21.15.79:0/471572084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d040051c0 0x7f3d0400b9c0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.238+0000 7f3d1f322640 1 -- 172.21.15.79:0/471572084 >> 172.21.15.79:0/471572084 conn(0x7f3d1809d3f0 msgr2=0x7f3d180d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.238+0000 7f3d1f322640 1 -- 172.21.15.79:0/471572084 shutdown_connections 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.238+0000 7f3d1f322640 1 -- 172.21.15.79:0/471572084 wait complete. 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.239+0000 7f3d1f322640 1 Processor -- start 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.239+0000 7f3d1f322640 1 -- start start 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1f322640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d040051c0 0x7f3d1815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1f322640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d180a1660 0x7f3d1806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1f322640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d1806d700 0x7f3d180cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1f322640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180d4f00 con 0x7f3d1806d700 2024-06-10T00:23:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1f322640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180d1070 con 0x7f3d040051c0 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1f322640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3d180d1870 con 0x7f3d180a1660 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1d8bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d1806d700 0x7f3d180cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1d8bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d1806d700 0x7f3d180cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54956/0 (socket says 172.21.15.79:54956) 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/3631344746 learned_addr learned my addr 172.21.15.79:0/3631344746 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1d0be640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d040051c0 0x7f3d1815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1c8bd640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d180a1660 0x7f3d1806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/3631344746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d180a1660 msgr2=0x7f3d1806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1d8bf640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d180a1660 0x7f3d1806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/3631344746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d040051c0 msgr2=0x7f3d1815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.240+0000 7f3d1d8bf640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d040051c0 0x7f3d1815d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.241+0000 7f3d1d8bf640 1 -- 172.21.15.79:0/3631344746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d18159960 con 0x7f3d1806d700 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.241+0000 7f3d1d8bf640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d1806d700 0x7f3d180cb190 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f3d1002b530 tx=0x7f3d1002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:39.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.241+0000 7f3d0dffb640 1 -- 172.21.15.79:0/3631344746 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000a480 con 0x7f3d1806d700 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.241+0000 7f3d0dffb640 1 -- 172.21.15.79:0/3631344746 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10034670 con 0x7f3d1806d700 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.241+0000 7f3d0dffb640 1 -- 172.21.15.79:0/3631344746 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10034a40 con 0x7f3d1806d700 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.241+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1815a7e0 con 0x7f3d1806d700 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.241+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d180cd6d0 con 0x7f3d1806d700 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.242+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d18068430 con 0x7f3d1806d700 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.243+0000 7f3d0dffb640 1 -- 172.21.15.79:0/3631344746 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d10034be0 con 0x7f3d1806d700 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.243+0000 7f3d0dffb640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3cfc06be30 0x7f3cfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.243+0000 7f3d1d0be640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3cfc06be30 0x7f3cfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.243+0000 7f3d0dffb640 1 -- 172.21.15.79:0/3631344746 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f3d100ab090 con 0x7f3d1806d700 2024-06-10T00:23:39.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.244+0000 7f3d1d0be640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3cfc06be30 0x7f3cfc06e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3d14000c00 tx=0x7f3d14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:39.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.248+0000 7f3d0dffb640 1 -- 172.21.15.79:0/3631344746 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3d1815a7e0 con 0x7f3d1806d700 2024-06-10T00:23:39.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.458+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d180d04e0 con 0x7f3d1806d700 2024-06-10T00:23:39.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.458+0000 7f3d0dffb640 1 -- 172.21.15.79:0/3631344746 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5182 (secure 0 0 0) 0x7f3d10046060 con 0x7f3d1806d700 2024-06-10T00:23:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:39.458 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:23:38.625657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8031":{"gid":8031,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/4878507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":4878507},{"type":"v1","addr":"172.21.15.79:6837","nonce":4878507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8031,"qdb_cluster":[8031]},"id":7}]} 2024-06-10T00:23:39.459 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 74 2024-06-10T00:23:39.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3cfc06be30 msgr2=0x7f3cfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3cfc06be30 0x7f3cfc06e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3d14000c00 tx=0x7f3d14009040 comp rx=0 tx=0).stop 2024-06-10T00:23:39.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d1806d700 msgr2=0x7f3d180cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d1806d700 0x7f3d180cb190 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f3d1002b530 tx=0x7f3d1002d070 comp rx=0 tx=0).stop 2024-06-10T00:23:39.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 shutdown_connections 2024-06-10T00:23:39.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3cfc06be30 0x7f3cfc06e2f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d1806d700 0x7f3d180cb190 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d180a1660 0x7f3d1806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 --2- 172.21.15.79:0/3631344746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d040051c0 0x7f3d1815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 >> 172.21.15.79:0/3631344746 conn(0x7f3d1809d3f0 msgr2=0x7f3d1815fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 shutdown_connections 2024-06-10T00:23:39.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.460+0000 7f3d1f322640 1 -- 172.21.15.79:0/3631344746 wait complete. 2024-06-10T00:23:39.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:22:40.800117+0000', 'modified': '2024-06-10T00:23:38.625657+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8031}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8031': {'gid': 8031, 'name': 'a', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/4878507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 4878507}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 4878507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8031, 'qdb_cluster': [8031]} 2024-06-10T00:23:39.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:23:39.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:23:39.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.977+0000 7fcd3f5c8640 1 Processor -- start 2024-06-10T00:23:39.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.977+0000 7fcd3f5c8640 1 -- start start 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.978+0000 7fcd3f5c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd38165bf0 0x7fcd380b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.978+0000 7fcd3f5c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd380b4b20 0x7fcd3806e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.978+0000 7fcd3f5c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd3806d160 con 0x7fcd3806e740 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.978+0000 7fcd3f5c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcd3806dd70 con 0x7fcd38165bf0 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.978+0000 7fcd3f5c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3806d440 con 0x7fcd380b4b20 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.978+0000 7fcd3d364640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd38165bf0 0x7fcd380b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.978+0000 7fcd3db65640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcd3806e740 0x7fcd380cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42326/0 (socket says 172.21.15.79:42326) 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.978+0000 7fcd3db65640 1 -- 172.21.15.79:0/942950235 learned_addr learned my addr 172.21.15.79:0/942950235 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:23:39.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/942950235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd380b4b20 0x7fcd3806e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd3d364640 1 -- 172.21.15.79:0/942950235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd380b4b20 msgr2=0x7fcd3806e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd3d364640 1 --2- 172.21.15.79:0/942950235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd380b4b20 0x7fcd3806e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd3d364640 1 -- 172.21.15.79:0/942950235 >> v1:172.21.15.79:6789/0 conn(0x7fcd3806e740 legacy=0x7fcd380cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd3d364640 1 -- 172.21.15.79:0/942950235 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3806d720 con 0x7fcd38165bf0 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd2ffff640 1 -- 172.21.15.79:0/942950235 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127951340 0 0) 0x7fcd3806d160 con 0x7fcd3806e740 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd3d364640 1 --2- 172.21.15.79:0/942950235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd38165bf0 0x7fcd380b3b50 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fcd340097a0 tx=0x7fcd3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81725e78f193570 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd2ffff640 1 -- 172.21.15.79:0/942950235 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34037070 con 0x7fcd38165bf0 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.979+0000 7fcd2ffff640 1 -- 172.21.15.79:0/942950235 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd34032440 con 0x7fcd38165bf0 2024-06-10T00:23:39.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd2ffff640 1 -- 172.21.15.79:0/942950235 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34032810 con 0x7fcd38165bf0 2024-06-10T00:23:39.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/942950235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd38165bf0 msgr2=0x7fcd380b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/942950235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd38165bf0 0x7fcd380b3b50 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fcd340097a0 tx=0x7fcd3402a1a0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/942950235 shutdown_connections 2024-06-10T00:23:39.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/942950235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd380b4b20 0x7fcd3806e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/942950235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd38165bf0 0x7fcd380b3b50 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/942950235 >> 172.21.15.79:0/942950235 conn(0x7fcd380b19f0 msgr2=0x7fcd380b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:39.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/942950235 shutdown_connections 2024-06-10T00:23:39.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.980+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/942950235 wait complete. 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.981+0000 7fcd3f5c8640 1 Processor -- start 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.981+0000 7fcd3f5c8640 1 -- start start 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3f5c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3806e740 0x7fcd38156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3f5c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd380b4b20 0x7fcd38159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3f5c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd38165bf0 0x7fcd3815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3f5c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd380ccd90 con 0x7fcd380b4b20 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3f5c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd380b4f80 con 0x7fcd3806e740 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3f5c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd380ccf10 con 0x7fcd38165bf0 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3cb63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd380b4b20 0x7fcd38159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3cb63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd380b4b20 0x7fcd38159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54964/0 (socket says 172.21.15.79:54964) 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3cb63640 1 -- 172.21.15.79:0/3334146151 learned_addr learned my addr 172.21.15.79:0/3334146151 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3db65640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd38165bf0 0x7fcd3815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3d364640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3806e740 0x7fcd38156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3cb63640 1 -- 172.21.15.79:0/3334146151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd38165bf0 msgr2=0x7fcd3815a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd38165bf0 0x7fcd3815a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3cb63640 1 -- 172.21.15.79:0/3334146151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3806e740 msgr2=0x7fcd38156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3806e740 0x7fcd38156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.982+0000 7fcd3cb63640 1 -- 172.21.15.79:0/3334146151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3815ab00 con 0x7fcd380b4b20 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.983+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd380b4b20 0x7fcd38159f90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800d830 tx=0x7fcd2800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.983+0000 7fcd2dffb640 1 -- 172.21.15.79:0/3334146151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800b6c0 con 0x7fcd380b4b20 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.983+0000 7fcd2dffb640 1 -- 172.21.15.79:0/3334146151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd28019070 con 0x7fcd380b4b20 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.983+0000 7fcd2dffb640 1 -- 172.21.15.79:0/3334146151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800ba80 con 0x7fcd380b4b20 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.983+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/3334146151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd38158660 con 0x7fcd380b4b20 2024-06-10T00:23:39.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.983+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/3334146151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd38158c20 con 0x7fcd380b4b20 2024-06-10T00:23:39.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.984+0000 7fcd2dffb640 1 -- 172.21.15.79:0/3334146151 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd2801e460 con 0x7fcd380b4b20 2024-06-10T00:23:39.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.985+0000 7fcd2dffb640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be30 0x7fcd1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.985+0000 7fcd2dffb640 1 -- 172.21.15.79:0/3334146151 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7fcd2808b780 con 0x7fcd380b4b20 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.985+0000 7fcd3d364640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be30 0x7fcd1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.985+0000 7fcd3d364640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be30 0x7fcd1c06e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fcd34034000 tx=0x7fcd3402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.986+0000 7fcd423b4740 1 Processor -- start 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.986+0000 7fcd423b4740 1 -- start start 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f93d00 0x5619e2f96510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f940e0 0x5619e2f96a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f66960 0x5619e2f6a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd423b4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5619e2ecf740 con 0x5619e2f66960 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd423b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5619e2e6da80 con 0x5619e2f940e0 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd423b4740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5619e2ecb700 con 0x5619e2f93d00 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f66960 0x5619e2f6a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f66960 0x5619e2f6a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54976/0 (socket says 172.21.15.79:54976) 2024-06-10T00:23:39.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 -- 172.21.15.79:0/1536521142 learned_addr learned my addr 172.21.15.79:0/1536521142 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 -- 172.21.15.79:0/1536521142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f93d00 msgr2=0x5619e2f96510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3d364640 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f93d00 0x5619e2f96510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f93d00 0x5619e2f96510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f940e0 0x5619e2f96a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 -- 172.21.15.79:0/1536521142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f940e0 msgr2=0x5619e2f96a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f940e0 0x5619e2f96a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 -- 172.21.15.79:0/1536521142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e2e98fb0 con 0x5619e2f66960 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd3db65640 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f66960 0x5619e2f6a170 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fcd30007330 tx=0x7fcd300077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcaecc807d68181 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd1affd640 1 -- 172.21.15.79:0/1536521142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30019070 con 0x5619e2f66960 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd1affd640 1 -- 172.21.15.79:0/1536521142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd30004d70 con 0x5619e2f66960 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.987+0000 7fcd1affd640 1 -- 172.21.15.79:0/1536521142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30001cb0 con 0x5619e2f66960 2024-06-10T00:23:39.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 -- 172.21.15.79:0/1536521142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f66960 msgr2=0x5619e2f6a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f66960 0x5619e2f6a170 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fcd30007330 tx=0x7fcd300077f0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 -- 172.21.15.79:0/1536521142 shutdown_connections 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f66960 0x5619e2f6a170 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f940e0 0x5619e2f96a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 --2- 172.21.15.79:0/1536521142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f93d00 0x5619e2f96510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 -- 172.21.15.79:0/1536521142 >> 172.21.15.79:0/1536521142 conn(0x5619e2f68bd0 msgr2=0x5619e2fb1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 -- 172.21.15.79:0/1536521142 shutdown_connections 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 -- 172.21.15.79:0/1536521142 wait complete. 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.988+0000 7fcd423b4740 1 -- start start 2024-06-10T00:23:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.989+0000 7fcd423b4740 1 Processor -- start 2024-06-10T00:23:39.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.989+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e2f7c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.989+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.989+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f7bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.989+0000 7fcd423b4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5619e2f6bd80 con 0x5619e2f7bb00 2024-06-10T00:23:39.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.989+0000 7fcd423b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5619e2e58c30 con 0x5619e2f93d00 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.989+0000 7fcd423b4740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5619e2f6c060 con 0x5619e2f940e0 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.989+0000 7fcd423b4740 10 client.0 _ll_register_callbacks cb 0x5619e2e8a7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f7bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f7bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54982/0 (socket says 172.21.15.79:54982) 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 -- 172.21.15.79:0/2163444604 learned_addr learned my addr 172.21.15.79:0/2163444604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3d364640 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e2f7c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 -- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 msgr2=0x5619e2f8db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 -- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 msgr2=0x5619e2f7c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e2f7c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 -- 172.21.15.79:0/2163444604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619e2be32d0 con 0x5619e2f7bb00 2024-06-10T00:23:39.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3d364640 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e2f7c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd3db65640 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f7bf80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x5619e2f6e260 tx=0x7fcd30001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c015f5ccc338cdb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd13fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd13fff640 1 -- 172.21.15.79:0/2163444604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30019070 con 0x5619e2f7bb00 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd13fff640 1 -- 172.21.15.79:0/2163444604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7fcd30014650 con 0x5619e2f7bb00 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd423b4740 1 -- 172.21.15.79:0/2163444604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd30004d70 con 0x5619e2f7bb00 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd13fff640 1 -- 172.21.15.79:0/2163444604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fcd30028050 con 0x5619e2f7bb00 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd423b4740 10 client.8106 fetch_fsmap learned FSMap version 74 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd423b4740 1 -- 172.21.15.79:0/2163444604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x5619e2cad6b0 con 0x5619e2f7bb00 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.990+0000 7fcd13fff640 1 -- 172.21.15.79:0/2163444604 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd30004d70 con 0x5619e2f7bb00 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd13fff640 1 -- 172.21.15.79:0/2163444604 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fcd3002b020 con 0x5619e2f7bb00 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd423b4740 10 client.8106 fetch_fsmap finished waiting for FSMap version 74 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd423b4740 10 client.8106 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:23:39.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd423b4740 20 client.8106 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd423b4740 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x5619e2fb3160 0x5619e2fb3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd423b4740 4 client.8106 mds_command: new command op to 8031 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd423b4740 1 -- 172.21.15.79:0/2163444604 --> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619e2edce70 con 0x5619e2fb3160 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd3d364640 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x5619e2fb3160 0x5619e2fb3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd3d364640 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x5619e2fb3160 0x5619e2fb3540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8b64bdd2d9b11d server_cookie=752b8c62a76ebc67 in_seq=0 out_seq=0 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.991+0000 7fcd13fff640 10 client.8106 ms_handle_connect on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd13fff640 1 -- 172.21.15.79:0/2163444604 <== mds.0 v2:172.21.15.79:6835/4878507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5619e2edce70 con 0x5619e2fb3160 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd13fff640 10 client.8106 handle_command_reply: tid=0 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 client.8106 shutdown 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 -- 172.21.15.79:0/2163444604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 msgr2=0x5619e2f7bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f7bf80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x5619e2f6e260 tx=0x7fcd30001250 comp rx=0 tx=0).stop 2024-06-10T00:23:39.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 -- 172.21.15.79:0/2163444604 shutdown_connections 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x5619e2fb3160 0x5619e2fb3540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f7bf80 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd13fff640 0 client.8106 ms_handle_reset on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 --2- 172.21.15.79:0/2163444604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e2f7c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 -- 172.21.15.79:0/2163444604 >> 172.21.15.79:0/2163444604 conn(0x5619e2f66960 msgr2=0x5619e2f6b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 -- 172.21.15.79:0/2163444604 shutdown_connections 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 1 -- 172.21.15.79:0/2163444604 wait complete. 2024-06-10T00:23:39.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:39.992+0000 7fcd423b4740 20 client.8106 trim_cache size 0 max 16384 2024-06-10T00:23:40.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd423b4740 1 Processor -- start 2024-06-10T00:23:40.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd423b4740 1 -- start start 2024-06-10T00:23:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f7bb00 0x5619e2fb4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f93d00 0x5619e2f91db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd423b4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd38205110 con 0x5619e2f93d00 2024-06-10T00:23:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd423b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd38204130 con 0x5619e2f7bb00 2024-06-10T00:23:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd423b4740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3809b3f0 con 0x5619e2f940e0 2024-06-10T00:23:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd3cb63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f93d00 0x5619e2f91db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd3cb63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f93d00 0x5619e2f91db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54998/0 (socket says 172.21.15.79:54998) 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.011+0000 7fcd3cb63640 1 -- 172.21.15.79:0/3174091566 learned_addr learned my addr 172.21.15.79:0/3174091566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd3cb63640 1 -- 172.21.15.79:0/3174091566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 msgr2=0x5619e2f8d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/3174091566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd3cb63640 1 -- 172.21.15.79:0/3174091566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f7bb00 msgr2=0x5619e2fb4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/3174091566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f7bb00 0x5619e2fb4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd3cb63640 1 -- 172.21.15.79:0/3174091566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e2f936d0 con 0x5619e2f93d00 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/3174091566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f93d00 0x5619e2f91db0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fcd28055c50 tx=0x7fcd28059440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a504d2e72e1725 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd1a7fc640 1 -- 172.21.15.79:0/3174091566 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2805dba0 con 0x5619e2f93d00 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd1a7fc640 1 -- 172.21.15.79:0/3174091566 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd280623d0 con 0x5619e2f93d00 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd1a7fc640 1 -- 172.21.15.79:0/3174091566 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd280600b0 con 0x5619e2f93d00 2024-06-10T00:23:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd423b4740 1 -- 172.21.15.79:0/3174091566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f93d00 msgr2=0x5619e2f91db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.012+0000 7fcd423b4740 1 --2- 172.21.15.79:0/3174091566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f93d00 0x5619e2f91db0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fcd28055c50 tx=0x7fcd28059440 comp rx=0 tx=0).stop 2024-06-10T00:23:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 -- 172.21.15.79:0/3174091566 shutdown_connections 2024-06-10T00:23:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 --2- 172.21.15.79:0/3174091566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 --2- 172.21.15.79:0/3174091566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f93d00 0x5619e2f91db0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 --2- 172.21.15.79:0/3174091566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f7bb00 0x5619e2fb4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 -- 172.21.15.79:0/3174091566 >> 172.21.15.79:0/3174091566 conn(0x5619e2f66960 msgr2=0x5619e2f90a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 -- 172.21.15.79:0/3174091566 shutdown_connections 2024-06-10T00:23:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 -- 172.21.15.79:0/3174091566 wait complete. 2024-06-10T00:23:40.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 -- start start 2024-06-10T00:23:40.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.013+0000 7fcd423b4740 1 Processor -- start 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f8d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e302f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd423b4740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd423b4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5619e2f7a030 con 0x5619e2f7bb00 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd423b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd38203bf0 con 0x5619e2f93d00 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd423b4740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5619e2fb2b60 con 0x5619e2f940e0 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd423b4740 10 client.0 _ll_register_callbacks cb 0x7fcd30001a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3d364640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f8d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3d364640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f8d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55006/0 (socket says 172.21.15.79:55006) 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3d364640 1 -- 172.21.15.79:0/198232145 learned_addr learned my addr 172.21.15.79:0/198232145 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3db65640 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3d364640 1 -- 172.21.15.79:0/198232145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 msgr2=0x5619e2f8d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e302f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3d364640 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3d364640 1 -- 172.21.15.79:0/198232145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 msgr2=0x5619e302f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3d364640 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e302f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.014+0000 7fcd3d364640 1 -- 172.21.15.79:0/198232145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619e2f93940 con 0x5619e2f7bb00 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd3d364640 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f8d1a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fcd34035040 tx=0x7fcd340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd9d2aecbc727f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd13fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd13fff640 1 -- 172.21.15.79:0/198232145 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3405b060 con 0x5619e2f7bb00 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd13fff640 1 -- 172.21.15.79:0/198232145 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7fcd34003960 con 0x5619e2f7bb00 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 1 -- 172.21.15.79:0/198232145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd280623d0 con 0x5619e2f7bb00 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd13fff640 1 -- 172.21.15.79:0/198232145 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fcd34061050 con 0x5619e2f7bb00 2024-06-10T00:23:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 10 client.8112 fetch_fsmap learned FSMap version 74 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 1 -- 172.21.15.79:0/198232145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x5619e2f93300 con 0x5619e2f7bb00 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd13fff640 1 -- 172.21.15.79:0/198232145 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd280623d0 con 0x5619e2f7bb00 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd13fff640 1 -- 172.21.15.79:0/198232145 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fcd34064020 con 0x5619e2f7bb00 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 10 client.8112 fetch_fsmap finished waiting for FSMap version 74 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 10 client.8112 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 20 client.8112 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x5619e2fa6ea0 0x5619e2fa7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 4 client.8112 mds_command: new command op to 8031 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:23:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd423b4740 1 -- 172.21.15.79:0/198232145 --> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] -- command(tid 0: {"prefix": "status"}) -- 0x5619e2ed71c0 con 0x5619e2fa6ea0 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.015+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x5619e2fa6ea0 0x5619e2fa7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd13fff640 10 client.8112 ms_handle_connect on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd3cb63640 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x5619e2fa6ea0 0x5619e2fa7280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ee22f9e6c00c0 server_cookie=e8f9a95e19d9d048 in_seq=0 out_seq=0 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd13fff640 1 -- 172.21.15.79:0/198232145 <== mds.0 v2:172.21.15.79:6835/4878507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5619e2ed71c0 con 0x5619e2fa6ea0 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd13fff640 10 client.8112 handle_command_reply: tid=0 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 client.8112 shutdown 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 -- 172.21.15.79:0/198232145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 msgr2=0x5619e2f8d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f8d1a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fcd34035040 tx=0x7fcd340046c0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 -- 172.21.15.79:0/198232145 shutdown_connections 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x5619e2fa6ea0 0x5619e2fa7280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5619e2f940e0 0x5619e2f8d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5619e2f93d00 0x5619e302f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd13fff640 0 client.8112 ms_handle_reset on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 --2- 172.21.15.79:0/198232145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619e2f7bb00 0x5619e2f8d1a0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 -- 172.21.15.79:0/198232145 >> 172.21.15.79:0/198232145 conn(0x5619e2f66960 msgr2=0x5619e2fb1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 -- 172.21.15.79:0/198232145 shutdown_connections 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 1 -- 172.21.15.79:0/198232145 wait complete. 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.016+0000 7fcd423b4740 20 client.8112 trim_cache size 0 max 16384 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:23:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8031, 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3948620350000001, 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 74, 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 107, 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 107, 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 5.3677276579999997 2024-06-10T00:23:40.031 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:23:40.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be30 msgr2=0x7fcd1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be30 0x7fcd1c06e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fcd34034000 tx=0x7fcd3402e000 comp rx=0 tx=0).stop 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd380b4b20 msgr2=0x7fcd38159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd380b4b20 0x7fcd38159f90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800d830 tx=0x7fcd2800dcf0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/3334146151 shutdown_connections 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd1c06be30 0x7fcd1c06e2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd38165bf0 0x7fcd3815a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd380b4b20 0x7fcd38159f90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 --2- 172.21.15.79:0/3334146151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3806e740 0x7fcd38156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/3334146151 >> 172.21.15.79:0/3334146151 conn(0x7fcd380b19f0 msgr2=0x7fcd38157800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/3334146151 shutdown_connections 2024-06-10T00:23:40.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.017+0000 7fcd3f5c8640 1 -- 172.21.15.79:0/3334146151 wait complete. 2024-06-10T00:23:40.034 DEBUG:teuthology.orchestra.run.smithi079:> sudo daemon-helper kill ceph --cluster ceph -w 2024-06-10T00:23:40.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:23:40.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-06-10T00:23:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.140+0000 7f107e037640 1 Processor -- start 2024-06-10T00:23:40.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.140+0000 7f107e037640 1 -- start start 2024-06-10T00:23:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f107e037640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10780d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f107e037640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10780d1f30 0x7f10780d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f107e037640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107815ec90 con 0x7f10780d0c30 2024-06-10T00:23:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f107e037640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f107815fa50 con 0x7f10780d1f30 2024-06-10T00:23:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f107e037640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10780d1090 con 0x7f107815e670 2024-06-10T00:23:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f1076ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10780d1f30 0x7f10780d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f1076ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10780d1f30 0x7f10780d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55010/0 (socket says 172.21.15.79:55010) 2024-06-10T00:23:40.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f1077fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f10780d0c30 0x7f1078162010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42338/0 (socket says 172.21.15.79:42338) 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.141+0000 7f1076ffd640 1 -- 172.21.15.79:0/3776310861 learned_addr learned my addr 172.21.15.79:0/3776310861 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.142+0000 7f10777fe640 1 --2- 172.21.15.79:0/3776310861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10780d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.142+0000 7f1076ffd640 1 -- 172.21.15.79:0/3776310861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 msgr2=0x7f10780d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.142+0000 7f1076ffd640 1 --2- 172.21.15.79:0/3776310861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10780d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.142+0000 7f1076ffd640 1 -- 172.21.15.79:0/3776310861 >> v1:172.21.15.79:6789/0 conn(0x7f10780d0c30 legacy=0x7f1078162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.142+0000 7f1076ffd640 1 -- 172.21.15.79:0/3776310861 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107815ef70 con 0x7f10780d1f30 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.142+0000 7f10767fc640 1 -- 172.21.15.79:0/3776310861 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563461701 0 0) 0x7f107815ec90 con 0x7f10780d0c30 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.142+0000 7f10777fe640 1 --2- 172.21.15.79:0/3776310861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10780d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.142+0000 7f1076ffd640 1 --2- 172.21.15.79:0/3776310861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780d06f0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f1060009870 tx=0x7f106002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe150ca63792b264 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f10767fc640 1 -- 172.21.15.79:0/3776310861 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060037070 con 0x7f10780d1f30 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f10767fc640 1 -- 172.21.15.79:0/3776310861 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106002ae50 con 0x7f10780d1f30 2024-06-10T00:23:40.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f10767fc640 1 -- 172.21.15.79:0/3776310861 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060032860 con 0x7f10780d1f30 2024-06-10T00:23:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f107e037640 1 -- 172.21.15.79:0/3776310861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 msgr2=0x7f10780d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f107e037640 1 --2- 172.21.15.79:0/3776310861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780d06f0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f1060009870 tx=0x7f106002a300 comp rx=0 tx=0).stop 2024-06-10T00:23:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f107e037640 1 -- 172.21.15.79:0/3776310861 shutdown_connections 2024-06-10T00:23:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f107e037640 1 --2- 172.21.15.79:0/3776310861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780d06f0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f107e037640 1 --2- 172.21.15.79:0/3776310861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10780d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f107e037640 1 -- 172.21.15.79:0/3776310861 >> 172.21.15.79:0/3776310861 conn(0x7f107809d400 msgr2=0x7f10780d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f107e037640 1 -- 172.21.15.79:0/3776310861 shutdown_connections 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.143+0000 7f107e037640 1 -- 172.21.15.79:0/3776310861 wait complete. 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.144+0000 7f107e037640 1 Processor -- start 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f107e037640 1 -- start start 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f107e037640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780d0c30 0x7f10780ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f107e037640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f107e037640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10781f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f107e037640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f107815f530 con 0x7f10780d1f30 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f107e037640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f107815ea50 con 0x7f10780d0c30 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f107e037640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10780d2370 con 0x7f107815e670 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55022/0 (socket says 172.21.15.79:55022) 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.145+0000 7f1076ffd640 1 -- 172.21.15.79:0/352403257 learned_addr learned my addr 172.21.15.79:0/352403257 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f1077fff640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10781f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f10777fe640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780d0c30 0x7f10780ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f1076ffd640 1 -- 172.21.15.79:0/352403257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 msgr2=0x7f10781f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f1076ffd640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10781f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f1076ffd640 1 -- 172.21.15.79:0/352403257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780d0c30 msgr2=0x7f10780ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f1076ffd640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780d0c30 0x7f10780ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f1076ffd640 1 -- 172.21.15.79:0/352403257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10781f4a70 con 0x7f10780d1f30 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f1076ffd640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780c8a40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f1060035040 tx=0x7f10600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f106ffff640 1 -- 172.21.15.79:0/352403257 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060037040 con 0x7f10780d1f30 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f106ffff640 1 -- 172.21.15.79:0/352403257 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060004230 con 0x7f10780d1f30 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f107e037640 1 -- 172.21.15.79:0/352403257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10781f4d50 con 0x7f10780d1f30 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f106ffff640 1 -- 172.21.15.79:0/352403257 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060032e20 con 0x7f10780d1f30 2024-06-10T00:23:40.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.146+0000 7f107e037640 1 -- 172.21.15.79:0/352403257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10780c8520 con 0x7f10780d1f30 2024-06-10T00:23:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.148+0000 7f106ffff640 1 -- 172.21.15.79:0/352403257 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f106003a070 con 0x7f10780d1f30 2024-06-10T00:23:40.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.148+0000 7f106ffff640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f105806be30 0x7f105806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.148+0000 7f106ffff640 1 -- 172.21.15.79:0/352403257 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f10600ab730 con 0x7f10780d1f30 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.148+0000 7f10777fe640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f105806be30 0x7f105806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.149+0000 7f10777fe640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f105806be30 0x7f105806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1068003fd0 tx=0x7f10680039f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.149+0000 7f1080e17740 1 Processor -- start 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.149+0000 7f1080e17740 1 -- start start 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1080e17740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e787918c0 0x558e7876def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1080e17740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e78768f70 0x558e7876e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1080e17740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787704a0 0x558e7876e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1080e17740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e786d1a70 con 0x558e78768f70 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1080e17740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558e7866fca0 con 0x558e787704a0 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1080e17740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558e786cda30 con 0x558e787918c0 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e78768f70 0x558e7876e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e78768f70 0x558e7876e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55024/0 (socket says 172.21.15.79:55024) 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 -- 172.21.15.79:0/1210952249 learned_addr learned my addr 172.21.15.79:0/1210952249 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f10777fe640 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e787918c0 0x558e7876def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1077fff640 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787704a0 0x558e7876e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 -- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e787918c0 msgr2=0x558e7876def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e787918c0 0x558e7876def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 -- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787704a0 msgr2=0x558e7876e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787704a0 0x558e7876e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 -- 172.21.15.79:0/1210952249 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e7869aeb0 con 0x558e78768f70 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1077fff640 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787704a0 0x558e7876e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.150+0000 7f1076ffd640 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e78768f70 0x558e7876e430 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f1060081e50 tx=0x7f1060079100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8f7f1583b99d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f106d7fa640 1 -- 172.21.15.79:0/1210952249 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106004a070 con 0x558e78768f70 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f106d7fa640 1 -- 172.21.15.79:0/1210952249 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106002ae50 con 0x558e78768f70 2024-06-10T00:23:40.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f106d7fa640 1 -- 172.21.15.79:0/1210952249 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106007db50 con 0x558e78768f70 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 -- 172.21.15.79:0/1210952249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e78768f70 msgr2=0x558e7876e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e78768f70 0x558e7876e430 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f1060081e50 tx=0x7f1060079100 comp rx=0 tx=0).stop 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 -- 172.21.15.79:0/1210952249 shutdown_connections 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787704a0 0x558e7876e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e78768f70 0x558e7876e430 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 --2- 172.21.15.79:0/1210952249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e787918c0 0x558e7876def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 -- 172.21.15.79:0/1210952249 >> 172.21.15.79:0/1210952249 conn(0x558e7876b1e0 msgr2=0x558e787b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 -- 172.21.15.79:0/1210952249 shutdown_connections 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.151+0000 7f1080e17740 1 -- 172.21.15.79:0/1210952249 wait complete. 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.152+0000 7f1080e17740 1 -- start start 2024-06-10T00:23:40.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.152+0000 7f1080e17740 1 Processor -- start 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1080e17740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e78798be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1080e17740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7879cb20 0x558e78779e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1080e17740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 0x558e787c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1080e17740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e7876c9b0 con 0x558e787918c0 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1080e17740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558e7865ae50 con 0x558e7879cb20 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1080e17740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558e78791ca0 con 0x558e7877a380 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1080e17740 10 client.0 _ll_register_callbacks cb 0x558e783e4c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e78798be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e78798be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55030/0 (socket says 172.21.15.79:55030) 2024-06-10T00:23:40.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 -- 172.21.15.79:0/21712966 learned_addr learned my addr 172.21.15.79:0/21712966 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1076ffd640 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7879cb20 0x558e78779e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f1077fff640 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 0x558e787c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 -- 172.21.15.79:0/21712966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 msgr2=0x558e787c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 0x558e787c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 -- 172.21.15.79:0/21712966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7879cb20 msgr2=0x558e78779e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7879cb20 0x558e78779e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 -- 172.21.15.79:0/21712966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e784ad7e0 con 0x558e787918c0 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10777fe640 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e78798be0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f1068016a30 tx=0x7f1068004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10cbb5f31928942 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10567fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.153+0000 7f10567fc640 1 -- 172.21.15.79:0/21712966 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068014b60 con 0x558e787918c0 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f10567fc640 1 -- 172.21.15.79:0/21712966 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f1068014d00 con 0x558e787918c0 2024-06-10T00:23:40.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 1 -- 172.21.15.79:0/21712966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f106002ae50 con 0x558e787918c0 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f10567fc640 1 -- 172.21.15.79:0/21712966 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f1068022420 con 0x558e787918c0 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 10 client.8127 fetch_fsmap learned FSMap version 74 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 1 -- 172.21.15.79:0/21712966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x558e7850df70 con 0x558e787918c0 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f10567fc640 1 -- 172.21.15.79:0/21712966 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106002ae50 con 0x558e787918c0 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f10567fc640 1 -- 172.21.15.79:0/21712966 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f1068032080 con 0x558e787918c0 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 10 client.8127 fetch_fsmap finished waiting for FSMap version 74 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 10 client.8127 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 20 client.8127 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x558e7878ad50 0x558e7877c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 4 client.8127 mds_command: new command op to 8031 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1080e17740 1 -- 172.21.15.79:0/21712966 --> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e786df1a0 con 0x558e7878ad50 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1076ffd640 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x558e7878ad50 0x558e7877c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f10567fc640 10 client.8127 ms_handle_connect on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.154+0000 7f1076ffd640 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x558e7878ad50 0x558e7877c130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c512759b6b22ff server_cookie=4f997deb8dcf40d2 in_seq=0 out_seq=0 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f10567fc640 1 -- 172.21.15.79:0/21712966 <== mds.0 v2:172.21.15.79:6835/4878507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558e786df1a0 con 0x558e7878ad50 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f10567fc640 10 client.8127 handle_command_reply: tid=0 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 client.8127 shutdown 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 -- 172.21.15.79:0/21712966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 msgr2=0x558e78798be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e78798be0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f1068016a30 tx=0x7f1068004ab0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 -- 172.21.15.79:0/21712966 shutdown_connections 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x558e7878ad50 0x558e7877c130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 0x558e787c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7879cb20 0x558e78779e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 --2- 172.21.15.79:0/21712966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e78798be0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 -- 172.21.15.79:0/21712966 >> 172.21.15.79:0/21712966 conn(0x558e787704a0 msgr2=0x558e7876ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f10567fc640 0 client.8127 ms_handle_reset on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 -- 172.21.15.79:0/21712966 shutdown_connections 2024-06-10T00:23:40.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 1 -- 172.21.15.79:0/21712966 wait complete. 2024-06-10T00:23:40.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.155+0000 7f1080e17740 20 client.8127 trim_cache size 0 max 16384 2024-06-10T00:23:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.160+0000 7ff07ef28640 1 Processor -- start 2024-06-10T00:23:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07ef28640 1 -- start start 2024-06-10T00:23:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07ef28640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0780d0c70 0x7ff0780d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07ef28640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0780cf740 0x7ff0780b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07ef28640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0780cfce0 con 0x7ff078161a20 2024-06-10T00:23:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07ef28640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff0780cffc0 con 0x7ff0780cf740 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07ef28640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0780b38c0 con 0x7ff0780d0c70 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07ccc4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff078161a20 0x7ff0780d0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42346/0 (socket says 172.21.15.79:42346) 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07ccc4640 1 -- 172.21.15.79:0/1032078346 learned_addr learned my addr 172.21.15.79:0/1032078346 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.161+0000 7ff07d4c5640 1 --2- 172.21.15.79:0/1032078346 >> v2:172.21.15.79:3300/0 conn(0x7ff0780cf740 0x7ff0780b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.162+0000 7ff077fff640 1 --2- 172.21.15.79:0/1032078346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0780d0c70 0x7ff0780d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.162+0000 7ff0777fe640 1 -- 172.21.15.79:0/1032078346 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520621997 0 0) 0x7ff0780cfce0 con 0x7ff078161a20 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.162+0000 7ff0777fe640 1 -- 172.21.15.79:0/1032078346 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff068003520 con 0x7ff078161a20 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.162+0000 7ff07d4c5640 1 -- 172.21.15.79:0/1032078346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0780d0c70 msgr2=0x7ff0780d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.162+0000 7ff07d4c5640 1 --2- 172.21.15.79:0/1032078346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0780d0c70 0x7ff0780d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.162+0000 7ff07d4c5640 1 -- 172.21.15.79:0/1032078346 >> v1:172.21.15.79:6789/0 conn(0x7ff078161a20 legacy=0x7ff0780d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.162+0000 7ff07d4c5640 1 -- 172.21.15.79:0/1032078346 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0780b3ba0 con 0x7ff0780cf740 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.162+0000 7ff07d4c5640 1 --2- 172.21.15.79:0/1032078346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0780cf740 0x7ff0780b43a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff070009d90 tx=0x7ff07002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04addc8e5250b30 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff0777fe640 1 -- 172.21.15.79:0/1032078346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070031600 con 0x7ff0780cf740 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff0777fe640 1 -- 172.21.15.79:0/1032078346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0700317a0 con 0x7ff0780cf740 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff0777fe640 1 -- 172.21.15.79:0/1032078346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070031b70 con 0x7ff0780cf740 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff07ef28640 1 -- 172.21.15.79:0/1032078346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0780cf740 msgr2=0x7ff0780b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff07ef28640 1 --2- 172.21.15.79:0/1032078346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0780cf740 0x7ff0780b43a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff070009d90 tx=0x7ff07002a5d0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff07ef28640 1 -- 172.21.15.79:0/1032078346 shutdown_connections 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff07ef28640 1 --2- 172.21.15.79:0/1032078346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0780cf740 0x7ff0780b43a0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff07ef28640 1 --2- 172.21.15.79:0/1032078346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0780d0c70 0x7ff0780d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff07ef28640 1 -- 172.21.15.79:0/1032078346 >> 172.21.15.79:0/1032078346 conn(0x7ff0780d4090 msgr2=0x7ff0780d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff07ef28640 1 -- 172.21.15.79:0/1032078346 shutdown_connections 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.163+0000 7ff07ef28640 1 -- 172.21.15.79:0/1032078346 wait complete. 2024-06-10T00:23:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.164+0000 7ff07ef28640 1 Processor -- start 2024-06-10T00:23:40.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.164+0000 7ff07ef28640 1 -- start start 2024-06-10T00:23:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ef28640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0780cf740 0x7ff0781f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ef28640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0780d0c70 0x7ff0780d4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ef28640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff078161a20 0x7ff0780d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ef28640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0780d1350 con 0x7ff0780cf740 2024-06-10T00:23:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ef28640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff0780b3e80 con 0x7ff0780d0c70 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ef28640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff078161e00 con 0x7ff078161a20 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ccc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0780cf740 0x7ff0781f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ccc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0780cf740 0x7ff0781f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55054/0 (socket says 172.21.15.79:55054) 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.165+0000 7ff07ccc4640 1 -- 172.21.15.79:0/1344786580 learned_addr learned my addr 172.21.15.79:0/1344786580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07d4c5640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff078161a20 0x7ff0780d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff077fff640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0780d0c70 0x7ff0780d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07ccc4640 1 -- 172.21.15.79:0/1344786580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff078161a20 msgr2=0x7ff0780d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07ccc4640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff078161a20 0x7ff0780d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07ccc4640 1 -- 172.21.15.79:0/1344786580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0780d0c70 msgr2=0x7ff0780d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07ccc4640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0780d0c70 0x7ff0780d4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07ccc4640 1 -- 172.21.15.79:0/1344786580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0780c7c60 con 0x7ff0780cf740 2024-06-10T00:23:40.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff077fff640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0780d0c70 0x7ff0780d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07ccc4640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0780cf740 0x7ff0781f3750 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c460 tx=0x7ff06c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c017070 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c005ce0 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07ef28640 1 -- 172.21.15.79:0/1344786580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0780c7f40 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c007290 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.166+0000 7ff07ef28640 1 -- 172.21.15.79:0/1344786580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0780c8500 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.167+0000 7ff07ef28640 1 -- 172.21.15.79:0/1344786580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7ff0780684a0 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.168+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff06c01a070 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.168+0000 7ff0757fa640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05c06be30 0x7ff05c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.168+0000 7ff077fff640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05c06be30 0x7ff05c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.168+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7ff06c08a830 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.169+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+512 (secure 0 0 0) 0x7ff06c021020 con 0x7ff0780cf740 2024-06-10T00:23:40.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.169+0000 7ff077fff640 1 --2- 172.21.15.79:0/1344786580 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff05c06be30 0x7ff05c06e2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff07815f1d0 tx=0x7ff064008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.169+0000 7ff062ffd640 1 -- 172.21.15.79:0/1344786580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7ff0500034b0 con 0x7ff0780cf740 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.169+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 7 ==== log(2 entries from seq 1058 at 2024-06-10T00:23:38.625727+0000) ==== 389+0+0 (secure 0 0 0) 0x7ff06c088c30 con 0x7ff0780cf740 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stdout: cluster: 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stdout: id: 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stdout: health: HEALTH_OK 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stdout: services: 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-06-10T00:23:40.172 INFO:teuthology.orchestra.run.smithi079.stdout: mgr: y(active, since 9m), standbys: x 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: mds: 1/1 daemons up, 3 standby 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: data: 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: volumes: 1/1 healthy 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: pools: 3 pools, 97 pgs 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: objects: 30 objects, 19 MiB 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: usage: 291 MiB used, 720 GiB / 720 GiB avail 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: pgs: 97 active+clean 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: io: 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:40.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:23:40.174 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:38.625727+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-10T00:23:40.174 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:38.625753+0000 mon.a [INF] Cluster is now healthy 2024-06-10T00:23:40.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.176+0000 7f1080e17740 1 Processor -- start 2024-06-10T00:23:40.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.176+0000 7f1080e17740 1 -- start start 2024-06-10T00:23:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1080e17740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7877a380 0x558e78769cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1080e17740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e7876a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1080e17740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7879cb20 0x558e787d78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1080e17740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1078200ee0 con 0x558e787918c0 2024-06-10T00:23:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1080e17740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10781fff30 con 0x558e7877a380 2024-06-10T00:23:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1080e17740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10781f7f30 con 0x558e7879cb20 2024-06-10T00:23:40.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e7876a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e7876a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55066/0 (socket says 172.21.15.79:55066) 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 -- 172.21.15.79:0/4015347549 learned_addr learned my addr 172.21.15.79:0/4015347549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 -- 172.21.15.79:0/4015347549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7879cb20 msgr2=0x558e787d78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 --2- 172.21.15.79:0/4015347549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7879cb20 0x558e787d78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 -- 172.21.15.79:0/4015347549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7877a380 msgr2=0x558e78769cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 --2- 172.21.15.79:0/4015347549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7877a380 0x558e78769cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 -- 172.21.15.79:0/4015347549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e783a5170 con 0x558e787918c0 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f1076ffd640 1 --2- 172.21.15.79:0/4015347549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e7876a1f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f10600090b0 tx=0x7f106003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e8f61f1f4b6953 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f106cff9640 1 -- 172.21.15.79:0/4015347549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106004a040 con 0x558e787918c0 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f106cff9640 1 -- 172.21.15.79:0/4015347549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10600a8070 con 0x558e787918c0 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.177+0000 7f106cff9640 1 -- 172.21.15.79:0/4015347549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060082380 con 0x558e787918c0 2024-06-10T00:23:40.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 -- 172.21.15.79:0/4015347549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 msgr2=0x558e7876a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 --2- 172.21.15.79:0/4015347549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e7876a1f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f10600090b0 tx=0x7f106003e000 comp rx=0 tx=0).stop 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 -- 172.21.15.79:0/4015347549 shutdown_connections 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 --2- 172.21.15.79:0/4015347549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7879cb20 0x558e787d78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 --2- 172.21.15.79:0/4015347549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e787918c0 0x558e7876a1f0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 --2- 172.21.15.79:0/4015347549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e7877a380 0x558e78769cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 -- 172.21.15.79:0/4015347549 >> 172.21.15.79:0/4015347549 conn(0x558e787704a0 msgr2=0x558e78767e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 -- 172.21.15.79:0/4015347549 shutdown_connections 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.178+0000 7f1080e17740 1 -- 172.21.15.79:0/4015347549 wait complete. 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 1 -- start start 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 1 Processor -- start 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 0x558e787c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787918c0 0x558e7877c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e7879cb20 0x558e7876a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10781ff910 con 0x558e7879cb20 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558e7876d6e0 con 0x558e787918c0 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558e787c2a30 con 0x558e7877a380 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1080e17740 10 client.0 _ll_register_callbacks cb 0x7f1068009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.179+0000 7f1077fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e7879cb20 0x558e7876a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1077fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e7879cb20 0x558e7876a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55068/0 (socket says 172.21.15.79:55068) 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1077fff640 1 -- 172.21.15.79:0/853617913 learned_addr learned my addr 172.21.15.79:0/853617913 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f10777fe640 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 0x558e787c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1076ffd640 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787918c0 0x558e7877c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1077fff640 1 -- 172.21.15.79:0/853617913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 msgr2=0x558e787c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1077fff640 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 0x558e787c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1077fff640 1 -- 172.21.15.79:0/853617913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787918c0 msgr2=0x558e7877c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1077fff640 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787918c0 0x558e7877c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1077fff640 1 -- 172.21.15.79:0/853617913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e7877ca70 con 0x558e7879cb20 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1077fff640 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e7879cb20 0x558e7876a030 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1070000c00 tx=0x7f10700014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34988be2c3ae51de server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f10567fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f10567fc640 1 -- 172.21.15.79:0/853617913 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070010040 con 0x558e7879cb20 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f10567fc640 1 -- 172.21.15.79:0/853617913 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f1070001b40 con 0x558e7879cb20 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1080e17740 1 -- 172.21.15.79:0/853617913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10600a8070 con 0x558e7879cb20 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f10567fc640 1 -- 172.21.15.79:0/853617913 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f1070021050 con 0x558e7879cb20 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1080e17740 10 client.8142 fetch_fsmap learned FSMap version 74 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1080e17740 1 -- 172.21.15.79:0/853617913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x558e7876d3d0 con 0x558e7879cb20 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f10567fc640 1 -- 172.21.15.79:0/853617913 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1070015410 con 0x558e7879cb20 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f10567fc640 1 -- 172.21.15.79:0/853617913 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f1070024020 con 0x558e7879cb20 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1080e17740 10 client.8142 fetch_fsmap finished waiting for FSMap version 74 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1080e17740 10 client.8142 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.180+0000 7f1080e17740 20 client.8142 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.181+0000 7f1080e17740 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x558e787c5d00 0x558e7883e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.181+0000 7f1080e17740 4 client.8142 mds_command: new command op to 8031 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.181+0000 7f1080e17740 1 -- 172.21.15.79:0/853617913 --> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x7f10600a8070 con 0x558e787c5d00 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.181+0000 7f10777fe640 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x558e787c5d00 0x558e7883e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.181+0000 7f10567fc640 10 client.8142 ms_handle_connect on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.181+0000 7f10777fe640 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x558e787c5d00 0x558e7883e4b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29aa9d3fd9c9e28a server_cookie=aaa327ae507a3e84 in_seq=0 out_seq=0 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f10567fc640 1 -- 172.21.15.79:0/853617913 <== mds.0 v2:172.21.15.79:6835/4878507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f10600a8070 con 0x558e787c5d00 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f10567fc640 10 client.8142 handle_command_reply: tid=0 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 client.8142 shutdown 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 -- 172.21.15.79:0/853617913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e7879cb20 msgr2=0x558e7876a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e7879cb20 0x558e7876a030 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1070000c00 tx=0x7f10700014b0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.187 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f9f8a05a640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-06-10T00:23:40.187 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f9f8a05a640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-06-10T00:23:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 -- 172.21.15.79:0/853617913 shutdown_connections 2024-06-10T00:23:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x558e787c5d00 0x558e7883e4b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f10567fc640 0 client.8142 ms_handle_reset on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e7879cb20 0x558e7876a030 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e787918c0 0x558e7877c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 --2- 172.21.15.79:0/853617913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e7877a380 0x558e787c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 -- 172.21.15.79:0/853617913 >> 172.21.15.79:0/853617913 conn(0x558e787704a0 msgr2=0x558e78798b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 -- 172.21.15.79:0/853617913 shutdown_connections 2024-06-10T00:23:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 1 -- 172.21.15.79:0/853617913 wait complete. 2024-06-10T00:23:40.188 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f9f8a05a640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-06-10T00:23:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f1080e17740 20 client.8142 trim_cache size 0 max 16384 2024-06-10T00:23:40.189 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:23:40.182+0000 7f9f8a05a640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-06-10T00:23:40.189 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:23:40.189 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-06-10T00:23:40.189 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "b01af1e3-c959-44fa-8bb9-f6a6c7deb19b", 2024-06-10T00:23:40.189 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-06-10T00:23:40.189 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:23:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 -- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f105806be30 msgr2=0x7f105806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f105806be30 0x7f105806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1068003fd0 tx=0x7f10680039f0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 -- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 msgr2=0x7f10780c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780c8a40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f1060035040 tx=0x7f10600046c0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 -- 172.21.15.79:0/352403257 shutdown_connections 2024-06-10T00:23:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f105806be30 0x7f105806e2f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107815e670 0x7f10781f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10780d1f30 0x7f10780c8a40 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 --2- 172.21.15.79:0/352403257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780d0c30 0x7f10780ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 -- 172.21.15.79:0/352403257 >> 172.21.15.79:0/352403257 conn(0x7f107809d400 msgr2=0x7f107806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 -- 172.21.15.79:0/352403257 shutdown_connections 2024-06-10T00:23:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.183+0000 7f107e037640 1 -- 172.21.15.79:0/352403257 wait complete. 2024-06-10T00:23:40.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:23:40.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-06-10T00:23:40.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.296+0000 7fef016b3640 1 Processor -- start 2024-06-10T00:23:40.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.296+0000 7fef016b3640 1 -- start start 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.296+0000 7fef016b3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feefc0d08f0 0x7feefc0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.296+0000 7fef016b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feefc0d0cd0 0x7feefc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.296+0000 7fef016b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0cf190 0x7feefc0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.296+0000 7fef016b3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7feefc0d1c80 con 0x7feefc0d0cd0 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.296+0000 7fef016b3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7feefc0cf620 con 0x7feefc0d08f0 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.296+0000 7fef016b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feefc0cf8a0 con 0x7feefc0cf190 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feefc0d0cd0 0x7feefc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feefc0d0cd0 0x7feefc0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55076/0 (socket says 172.21.15.79:55076) 2024-06-10T00:23:40.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 -- 172.21.15.79:0/4040527003 learned_addr learned my addr 172.21.15.79:0/4040527003 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefb7fe640 1 --2- 172.21.15.79:0/4040527003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0cf190 0x7feefc0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefaffd640 1 --2- 172.21.15.79:0/4040527003 >> v2:172.21.15.117:3300/0 conn(0x7feefc0d08f0 0x7feefc0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 -- 172.21.15.79:0/4040527003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0cf190 msgr2=0x7feefc0d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 --2- 172.21.15.79:0/4040527003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0cf190 0x7feefc0d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 -- 172.21.15.79:0/4040527003 >> v2:172.21.15.117:3300/0 conn(0x7feefc0d08f0 msgr2=0x7feefc0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 --2- 172.21.15.79:0/4040527003 >> v2:172.21.15.117:3300/0 conn(0x7feefc0d08f0 0x7feefc0b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 -- 172.21.15.79:0/4040527003 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc0cfb80 con 0x7feefc0d0cd0 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefaffd640 1 --2- 172.21.15.79:0/4040527003 >> v2:172.21.15.117:3300/0 conn(0x7feefc0d08f0 0x7feefc0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefb7fe640 1 --2- 172.21.15.79:0/4040527003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0cf190 0x7feefc0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.297+0000 7feefa7fc640 1 --2- 172.21.15.79:0/4040527003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc0cec50 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7feee4009870 tx=0x7feee402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4308f806778450bd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7feef9ffb640 1 -- 172.21.15.79:0/4040527003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4037070 con 0x7feefc0d0cd0 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7feef9ffb640 1 -- 172.21.15.79:0/4040527003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee4032440 con 0x7feefc0d0cd0 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7feef9ffb640 1 -- 172.21.15.79:0/4040527003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4032810 con 0x7feefc0d0cd0 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 -- 172.21.15.79:0/4040527003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 msgr2=0x7feefc0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 --2- 172.21.15.79:0/4040527003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc0cec50 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7feee4009870 tx=0x7feee402a200 comp rx=0 tx=0).stop 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 -- 172.21.15.79:0/4040527003 shutdown_connections 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 --2- 172.21.15.79:0/4040527003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0cf190 0x7feefc0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 --2- 172.21.15.79:0/4040527003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc0cec50 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 --2- 172.21.15.79:0/4040527003 >> v2:172.21.15.117:3300/0 conn(0x7feefc0d08f0 0x7feefc0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 -- 172.21.15.79:0/4040527003 >> 172.21.15.79:0/4040527003 conn(0x7feefc09d3c0 msgr2=0x7feefc0d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 -- 172.21.15.79:0/4040527003 shutdown_connections 2024-06-10T00:23:40.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.298+0000 7fef016b3640 1 -- 172.21.15.79:0/4040527003 wait complete. 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7fef016b3640 1 Processor -- start 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7fef016b3640 1 -- start start 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7fef016b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feefc0cf190 0x7feefc0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7fef016b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0d08f0 0x7feefc1f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7fef016b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc1f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7fef016b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0b50c0 con 0x7feefc0d0cd0 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7fef016b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0d1ed0 con 0x7feefc0cf190 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7fef016b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feefc0d1180 con 0x7feefc0d08f0 2024-06-10T00:23:40.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.300+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc1f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc1f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55078/0 (socket says 172.21.15.79:55078) 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefb7fe640 1 -- 172.21.15.79:0/4116996089 learned_addr learned my addr 172.21.15.79:0/4116996089 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefaffd640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feefc0cf190 0x7feefc0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefa7fc640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0d08f0 0x7feefc1f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefb7fe640 1 -- 172.21.15.79:0/4116996089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0d08f0 msgr2=0x7feefc1f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefb7fe640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0d08f0 0x7feefc1f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefb7fe640 1 -- 172.21.15.79:0/4116996089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feefc0cf190 msgr2=0x7feefc0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefb7fe640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feefc0cf190 0x7feefc0ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefb7fe640 1 -- 172.21.15.79:0/4116996089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc1f5ae0 con 0x7feefc0d0cd0 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feefb7fe640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc1f8110 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7feeec00afd0 tx=0x7feeec00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feef37fe640 1 -- 172.21.15.79:0/4116996089 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec015020 con 0x7feefc0d0cd0 2024-06-10T00:23:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feef37fe640 1 -- 172.21.15.79:0/4116996089 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec004440 con 0x7feefc0d0cd0 2024-06-10T00:23:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7fef016b3640 1 -- 172.21.15.79:0/4116996089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc0cd6d0 con 0x7feefc0d0cd0 2024-06-10T00:23:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7feef37fe640 1 -- 172.21.15.79:0/4116996089 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec003850 con 0x7feefc0d0cd0 2024-06-10T00:23:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.301+0000 7fef016b3640 1 -- 172.21.15.79:0/4116996089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc0cdc90 con 0x7feefc0d0cd0 2024-06-10T00:23:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.303+0000 7feef37fe640 1 -- 172.21.15.79:0/4116996089 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feeec018020 con 0x7feefc0d0cd0 2024-06-10T00:23:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.303+0000 7feef37fe640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feedc06be30 0x7feedc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.303+0000 7feef37fe640 1 -- 172.21.15.79:0/4116996089 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7feeec08ae80 con 0x7feefc0d0cd0 2024-06-10T00:23:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.303+0000 7feefaffd640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feedc06be30 0x7feedc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.304+0000 7feefaffd640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feedc06be30 0x7feedc06e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7feef400f500 tx=0x7feef4007770 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.304+0000 7fef043bf740 1 Processor -- start 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.304+0000 7fef043bf740 1 -- start start 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7fef043bf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49e90120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7fef043bf740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49e8b1a0 0x55fd49e90660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7fef043bf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49e926d0 0x55fd49e90ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7fef043bf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fd49db57e0 con 0x55fd49e926d0 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7fef043bf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fd49df3e80 con 0x55fd49eb3af0 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7fef043bf740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fd49d91700 con 0x55fd49e8b1a0 2024-06-10T00:23:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49e926d0 0x55fd49e90ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49e926d0 0x55fd49e90ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55080/0 (socket says 172.21.15.79:55080) 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 -- 172.21.15.79:0/362882873 learned_addr learned my addr 172.21.15.79:0/362882873 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefa7fc640 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49e8b1a0 0x55fd49e90660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefaffd640 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49e90120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 -- 172.21.15.79:0/362882873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49e8b1a0 msgr2=0x55fd49e90660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49e8b1a0 0x55fd49e90660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 -- 172.21.15.79:0/362882873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 msgr2=0x55fd49e90120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49e90120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 -- 172.21.15.79:0/362882873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd49db0dd0 con 0x55fd49e926d0 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.305+0000 7feefb7fe640 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49e926d0 0x55fd49e90ba0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7feeec061630 tx=0x7feeec061c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acd69771c5a6941 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7feef0ff9640 1 -- 172.21.15.79:0/362882873 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec082b60 con 0x55fd49e926d0 2024-06-10T00:23:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7feef0ff9640 1 -- 172.21.15.79:0/362882873 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec082d00 con 0x55fd49e926d0 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7feef0ff9640 1 -- 172.21.15.79:0/362882873 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec058680 con 0x55fd49e926d0 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 -- 172.21.15.79:0/362882873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49e926d0 msgr2=0x55fd49e90ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49e926d0 0x55fd49e90ba0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7feeec061630 tx=0x7feeec061c20 comp rx=0 tx=0).stop 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 -- 172.21.15.79:0/362882873 shutdown_connections 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49e926d0 0x55fd49e90ba0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49e8b1a0 0x55fd49e90660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 --2- 172.21.15.79:0/362882873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49e90120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 -- 172.21.15.79:0/362882873 >> 172.21.15.79:0/362882873 conn(0x55fd49e8d410 msgr2=0x55fd49ed5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 -- 172.21.15.79:0/362882873 shutdown_connections 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.306+0000 7fef043bf740 1 -- 172.21.15.79:0/362882873 wait complete. 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.307+0000 7fef043bf740 1 -- start start 2024-06-10T00:23:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.307+0000 7fef043bf740 1 Processor -- start 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49eaffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 0x55fd49ea56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49ebce30 0x55fd49eb7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fd49d7c640 con 0x55fd49ebce30 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fd49defe40 con 0x55fd49eb3af0 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fd49e8ebe0 con 0x55fd49eb9ee0 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 10 client.0 _ll_register_callbacks cb 0x55fd49dae430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49ebce30 0x55fd49eb7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49ebce30 0x55fd49eb7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55088/0 (socket says 172.21.15.79:55088) 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 -- 172.21.15.79:0/3566999717 learned_addr learned my addr 172.21.15.79:0/3566999717 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefaffd640 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49eaffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefa7fc640 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 0x55fd49ea56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 -- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 msgr2=0x55fd49ea56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 0x55fd49ea56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 -- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 msgr2=0x55fd49eaffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49eaffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 -- 172.21.15.79:0/3566999717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd49bd17d0 con 0x55fd49ebce30 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefaffd640 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49eaffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feefb7fe640 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49ebce30 0x55fd49eb7d90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7feeec061630 tx=0x7feeec004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bcde95dc80a41 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feed9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feed9ffb640 1 -- 172.21.15.79:0/3566999717 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec082b60 con 0x55fd49ebce30 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feed9ffb640 1 -- 172.21.15.79:0/3566999717 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7feeec077d20 con 0x55fd49ebce30 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 1 -- 172.21.15.79:0/3566999717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeec082d00 con 0x55fd49ebce30 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7feed9ffb640 1 -- 172.21.15.79:0/3566999717 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7feeec0552d0 con 0x55fd49ebce30 2024-06-10T00:23:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 10 client.8154 fetch_fsmap learned FSMap version 74 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.308+0000 7fef043bf740 1 -- 172.21.15.79:0/3566999717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55fd49b073f0 con 0x55fd49ebce30 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7feed9ffb640 1 -- 172.21.15.79:0/3566999717 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec082d00 con 0x55fd49ebce30 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7feed9ffb640 1 -- 172.21.15.79:0/3566999717 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7feeec054f80 con 0x55fd49ebce30 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7fef043bf740 10 client.8154 fetch_fsmap finished waiting for FSMap version 74 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7fef043bf740 10 client.8154 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7fef043bf740 20 client.8154 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7fef043bf740 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x55fd49eb6520 0x55fd49eba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7fef043bf740 4 client.8154 mds_command: new command op to 8031 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7fef043bf740 1 -- 172.21.15.79:0/3566999717 --> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd49e015b0 con 0x55fd49eb6520 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7feefaffd640 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x55fd49eb6520 0x55fd49eba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7feed9ffb640 10 client.8154 ms_handle_connect on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.309+0000 7feefaffd640 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x55fd49eb6520 0x55fd49eba920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76df47341dfbf335 server_cookie=44355a9084c56bd5 in_seq=0 out_seq=0 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7feed9ffb640 1 -- 172.21.15.79:0/3566999717 <== mds.0 v2:172.21.15.79:6835/4878507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fd49e015b0 con 0x55fd49eb6520 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7feed9ffb640 10 client.8154 handle_command_reply: tid=0 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 client.8154 shutdown 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 -- 172.21.15.79:0/3566999717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49ebce30 msgr2=0x55fd49eb7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49ebce30 0x55fd49eb7d90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7feeec061630 tx=0x7feeec004710 comp rx=0 tx=0).stop 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 -- 172.21.15.79:0/3566999717 shutdown_connections 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x55fd49eb6520 0x55fd49eba920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49ebce30 0x55fd49eb7d90 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 0x55fd49ea56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7feed9ffb640 0 client.8154 ms_handle_reset on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 --2- 172.21.15.79:0/3566999717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49eaffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 -- 172.21.15.79:0/3566999717 >> 172.21.15.79:0/3566999717 conn(0x55fd49e926d0 msgr2=0x55fd49eb2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 -- 172.21.15.79:0/3566999717 shutdown_connections 2024-06-10T00:23:40.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 1 -- 172.21.15.79:0/3566999717 wait complete. 2024-06-10T00:23:40.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.310+0000 7fef043bf740 20 client.8154 trim_cache size 0 max 16384 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.328+0000 7fef043bf740 1 Processor -- start 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.328+0000 7fef043bf740 1 -- start start 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7fef043bf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb3af0 0x55fd49ecb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7fef043bf740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 0x55fd49ecbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7fef043bf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49ebce30 0x55fd49ef9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7fef043bf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feefc200f00 con 0x55fd49eb3af0 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7fef043bf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feefc1fff90 con 0x55fd49ebce30 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7fef043bf740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feefc1f48d0 con 0x55fd49eb9ee0 2024-06-10T00:23:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb3af0 0x55fd49ecb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb3af0 0x55fd49ecb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55096/0 (socket says 172.21.15.79:55096) 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 -- 172.21.15.79:0/357687831 learned_addr learned my addr 172.21.15.79:0/357687831 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 -- 172.21.15.79:0/357687831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 msgr2=0x55fd49ecbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 --2- 172.21.15.79:0/357687831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 0x55fd49ecbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 -- 172.21.15.79:0/357687831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49ebce30 msgr2=0x55fd49ef9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 --2- 172.21.15.79:0/357687831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49ebce30 0x55fd49ef9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 -- 172.21.15.79:0/357687831 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd49ac70f0 con 0x55fd49eb3af0 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feefaffd640 1 --2- 172.21.15.79:0/357687831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb3af0 0x55fd49ecb900 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7feef400fd90 tx=0x7feef4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7ccb262c08d426 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feedbfff640 1 -- 172.21.15.79:0/357687831 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4035070 con 0x55fd49eb3af0 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feedbfff640 1 -- 172.21.15.79:0/357687831 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef4030650 con 0x55fd49eb3af0 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.329+0000 7feedbfff640 1 -- 172.21.15.79:0/357687831 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4030a00 con 0x55fd49eb3af0 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 -- 172.21.15.79:0/357687831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb3af0 msgr2=0x55fd49ecb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 --2- 172.21.15.79:0/357687831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb3af0 0x55fd49ecb900 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7feef400fd90 tx=0x7feef4012000 comp rx=0 tx=0).stop 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 -- 172.21.15.79:0/357687831 shutdown_connections 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 --2- 172.21.15.79:0/357687831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49ebce30 0x55fd49ef9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 --2- 172.21.15.79:0/357687831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49eb9ee0 0x55fd49ecbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 --2- 172.21.15.79:0/357687831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb3af0 0x55fd49ecb900 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 -- 172.21.15.79:0/357687831 >> 172.21.15.79:0/357687831 conn(0x55fd49e926d0 msgr2=0x55fd49ea54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 -- 172.21.15.79:0/357687831 shutdown_connections 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 -- 172.21.15.79:0/357687831 wait complete. 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 -- start start 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.330+0000 7fef043bf740 1 Processor -- start 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7fef043bf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49ebd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7fef043bf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb9ee0 0x55fd49ef8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7fef043bf740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49ebce30 0x55fd49ef8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7fef043bf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fd49ecc910 con 0x55fd49eb9ee0 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7fef043bf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feefc14b020 con 0x55fd49eb3af0 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7fef043bf740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fd49eb5e10 con 0x55fd49ebce30 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7fef043bf740 10 client.0 _ll_register_callbacks cb 0x7feeec05d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7feefa7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb9ee0 0x55fd49ef8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7feefa7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb9ee0 0x55fd49ef8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55106/0 (socket says 172.21.15.79:55106) 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7feefa7fc640 1 -- 172.21.15.79:0/21412533 learned_addr learned my addr 172.21.15.79:0/21412533 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7feefb7fe640 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49ebce30 0x55fd49ef8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.331+0000 7feefaffd640 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49ebd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feefa7fc640 1 -- 172.21.15.79:0/21412533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49ebce30 msgr2=0x55fd49ef8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feefa7fc640 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49ebce30 0x55fd49ef8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feefa7fc640 1 -- 172.21.15.79:0/21412533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 msgr2=0x55fd49ebd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feefa7fc640 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49ebd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feefa7fc640 1 -- 172.21.15.79:0/21412533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd49dba560 con 0x55fd49eb9ee0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feefa7fc640 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb9ee0 0x55fd49ef8510 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7feee4009870 tx=0x7feee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20187751cc4ba30 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feed9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feed9ffb640 1 -- 172.21.15.79:0/21412533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee404a060 con 0x55fd49eb9ee0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feed9ffb640 1 -- 172.21.15.79:0/21412533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7feee4032cb0 con 0x55fd49eb9ee0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 1 -- 172.21.15.79:0/21412533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feef4030650 con 0x55fd49eb9ee0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feed9ffb640 1 -- 172.21.15.79:0/21412533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7feee4050050 con 0x55fd49eb9ee0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 10 client.8160 fetch_fsmap learned FSMap version 74 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 1 -- 172.21.15.79:0/21412533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55fd49eba4d0 con 0x55fd49eb9ee0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feed9ffb640 1 -- 172.21.15.79:0/21412533 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef4030650 con 0x55fd49eb9ee0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feed9ffb640 1 -- 172.21.15.79:0/21412533 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7feee4053020 con 0x55fd49eb9ee0 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 10 client.8160 fetch_fsmap finished waiting for FSMap version 74 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 10 client.8160 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:23:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 20 client.8160 populate_metadata read hostname 'smithi079' 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x55fd49f52fb0 0x55fd49ef8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 4 client.8160 mds_command: new command op to 8031 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7fef043bf740 1 -- 172.21.15.79:0/21412533 --> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd49dfb900 con 0x55fd49f52fb0 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.332+0000 7feefaffd640 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x55fd49f52fb0 0x55fd49ef8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7feed9ffb640 10 client.8160 ms_handle_connect on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7feefaffd640 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x55fd49f52fb0 0x55fd49ef8f90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1a019b0a56f717f server_cookie=2b380e382d7b73d1 in_seq=0 out_seq=0 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7feed9ffb640 1 -- 172.21.15.79:0/21412533 <== mds.0 v2:172.21.15.79:6835/4878507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55fd49dfb900 con 0x55fd49f52fb0 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7feed9ffb640 10 client.8160 handle_command_reply: tid=0 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 client.8160 shutdown 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 -- 172.21.15.79:0/21412533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb9ee0 msgr2=0x55fd49ef8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb9ee0 0x55fd49ef8510 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7feee4009870 tx=0x7feee40046c0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 -- 172.21.15.79:0/21412533 shutdown_connections 2024-06-10T00:23:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x55fd49f52fb0 0x55fd49ef8f90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fd49ebce30 0x55fd49ef8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7feed9ffb640 0 client.8160 ms_handle_reset on v2:172.21.15.79:6835/4878507 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd49eb9ee0 0x55fd49ef8510 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 --2- 172.21.15.79:0/21412533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd49eb3af0 0x55fd49ebd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 -- 172.21.15.79:0/21412533 >> 172.21.15.79:0/21412533 conn(0x55fd49e926d0 msgr2=0x55fd49ea54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 -- 172.21.15.79:0/21412533 shutdown_connections 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 1 -- 172.21.15.79:0/21412533 wait complete. 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.333+0000 7fef043bf740 20 client.8160 trim_cache size 0 max 16384 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:23:40.340 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-10T00:23:40.341 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-06-10T00:23:40.341 INFO:teuthology.orchestra.run.smithi079.stdout: "b01af1e3-c959-44fa-8bb9-f6a6c7deb19b": { 2024-06-10T00:23:40.341 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-06-10T00:23:40.341 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "b01af1e3-c959-44fa-8bb9-f6a6c7deb19b", 2024-06-10T00:23:40.341 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,repair" 2024-06-10T00:23:40.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:23:40.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:23:40.341 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:23:40.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 -- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feedc06be30 msgr2=0x7feedc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feedc06be30 0x7feedc06e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7feef400f500 tx=0x7feef4007770 comp rx=0 tx=0).stop 2024-06-10T00:23:40.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 -- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 msgr2=0x7feefc1f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:23:40.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc1f8110 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7feeec00afd0 tx=0x7feeec00ca20 comp rx=0 tx=0).stop 2024-06-10T00:23:40.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 -- 172.21.15.79:0/4116996089 shutdown_connections 2024-06-10T00:23:40.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7feedc06be30 0x7feedc06e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc0d0cd0 0x7feefc1f8110 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feefc0d08f0 0x7feefc1f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 --2- 172.21.15.79:0/4116996089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feefc0cf190 0x7feefc0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:23:40.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 -- 172.21.15.79:0/4116996089 >> 172.21.15.79:0/4116996089 conn(0x7feefc09d3c0 msgr2=0x7feefc0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:23:40.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 -- 172.21.15.79:0/4116996089 shutdown_connections 2024-06-10T00:23:40.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:40.334+0000 7fef016b3640 1 -- 172.21.15.79:0/4116996089 wait complete. 2024-06-10T00:23:40.344 INFO:tasks.cephfs.filesystem:scrub status for tag:b01af1e3-c959-44fa-8bb9-f6a6c7deb19b - {'path': '/', 'tag': 'b01af1e3-c959-44fa-8bb9-f6a6c7deb19b', 'options': 'recursive,repair'} 2024-06-10T00:23:40.622 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:23:40.622+0000 7f9f8e062640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:23:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:41.642+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 8 ==== log(8 entries from seq 1 at 2024-06-10T00:23:40.182429+0000) ==== 1407+0+0 (secure 0 0 0) 0x7ff06c08b000 con 0x7ff0780cf740 2024-06-10T00:23:41.642 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:40.182429+0000 mds.a [INF] scrub queued for path: / 2024-06-10T00:23:41.642 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:40.182433+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-06-10T00:23:41.642 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:40.182437+0000 mds.a [INF] scrub summary: active paths [/] 2024-06-10T00:23:41.642 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:40.183029+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-06-10T00:23:41.642 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:40.183036+0000 mds.a [ERR] inode table repaired for inode: 0x10000000001 2024-06-10T00:23:41.642 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:40.183456+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-06-10T00:23:41.642 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:40.183461+0000 mds.a [ERR] inode table repaired for inode: 0x10000000002 2024-06-10T00:23:41.642 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:40.183657+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-06-10T00:23:45.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:23:45.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:23:46.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:23:46.647+0000 7ff0757fa640 1 -- 172.21.15.79:0/1344786580 <== mon.0 v2:172.21.15.79:3300/0 9 ==== log(1 entries from seq 9 at 2024-06-10T00:23:44.651159+0000) ==== 189+0+0 (secure 0 0 0) 0x7ff06c056c50 con 0x7ff0780cf740 2024-06-10T00:23:46.647 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:23:44.651159+0000 mds.a [INF] scrub summary: idle 2024-06-10T00:24:10.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:10.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-06-10T00:24:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.460+0000 7f290cbce640 1 Processor -- start 2024-06-10T00:24:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.460+0000 7f290cbce640 1 -- start start 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f290cbce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29080cf360 0x7f29080d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f290cbce640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29080cf8a0 con 0x7f29080d08f0 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f290cbce640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29080cfb80 con 0x7f29080b3800 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f290cbce640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f29080d1c80 con 0x7f29080cf360 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f290659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f29080d08f0 0x7f29080d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39710/0 (socket says 172.21.15.79:39710) 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f290659c640 1 -- 172.21.15.79:0/2177184201 learned_addr learned my addr 172.21.15.79:0/2177184201 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f2906d9d640 1 --2- 172.21.15.79:0/2177184201 >> v2:172.21.15.117:3300/0 conn(0x7f29080cf360 0x7f29080d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f2905d9b640 1 -- 172.21.15.79:0/2177184201 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3447350829 0 0) 0x7f29080cf8a0 con 0x7f29080d08f0 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f2905d9b640 1 -- 172.21.15.79:0/2177184201 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28f4003520 con 0x7f29080d08f0 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f2905d9b640 1 -- 172.21.15.79:0/2177184201 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 417134654 0 0) 0x7f28f4003520 con 0x7f29080d08f0 2024-06-10T00:24:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f2906d9d640 1 -- 172.21.15.79:0/2177184201 >> v1:172.21.15.117:6789/0 conn(0x7f29080b3800 legacy=0x7f29080cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f2906d9d640 1 -- 172.21.15.79:0/2177184201 >> v1:172.21.15.79:6789/0 conn(0x7f29080d08f0 legacy=0x7f29080d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.461+0000 7f2906d9d640 1 -- 172.21.15.79:0/2177184201 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29080cfe60 con 0x7f29080cf360 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.462+0000 7f2906d9d640 1 --2- 172.21.15.79:0/2177184201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080cf360 0x7f29080d23f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2900009dc0 tx=0x7f290002a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d7fd84792a1cd23 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.462+0000 7f2905d9b640 1 -- 172.21.15.79:0/2177184201 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8001670 con 0x7f29080cf360 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.462+0000 7f2905d9b640 1 -- 172.21.15.79:0/2177184201 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900007540 con 0x7f29080cf360 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.462+0000 7f2905d9b640 1 -- 172.21.15.79:0/2177184201 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900007910 con 0x7f29080cf360 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.463+0000 7f290cbce640 1 -- 172.21.15.79:0/2177184201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080cf360 msgr2=0x7f29080d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.463+0000 7f290cbce640 1 --2- 172.21.15.79:0/2177184201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080cf360 0x7f29080d23f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2900009dc0 tx=0x7f290002a6c0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.463+0000 7f290cbce640 1 -- 172.21.15.79:0/2177184201 shutdown_connections 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.463+0000 7f290cbce640 1 --2- 172.21.15.79:0/2177184201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080cf360 0x7f29080d23f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.463+0000 7f290cbce640 1 -- 172.21.15.79:0/2177184201 >> 172.21.15.79:0/2177184201 conn(0x7f290809d3c0 msgr2=0x7f29080d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.463+0000 7f290cbce640 1 -- 172.21.15.79:0/2177184201 shutdown_connections 2024-06-10T00:24:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.463+0000 7f290cbce640 1 -- 172.21.15.79:0/2177184201 wait complete. 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.464+0000 7f290cbce640 1 Processor -- start 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.464+0000 7f290cbce640 1 -- start start 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f290cbce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29080b3800 0x7f290814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f290cbce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080cf360 0x7f29080cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f290cbce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080d08f0 0x7f29080caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f290cbce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29080b50c0 con 0x7f29080cf360 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f290cbce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29080b3cb0 con 0x7f29080d08f0 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f290cbce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29080b4a60 con 0x7f29080b3800 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f28fffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080cf360 0x7f29080cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f28fffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080cf360 0x7f29080cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49484/0 (socket says 172.21.15.79:49484) 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f28fffff640 1 -- 172.21.15.79:0/350749232 learned_addr learned my addr 172.21.15.79:0/350749232 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f2906d9d640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080d08f0 0x7f29080caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f290659c640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29080b3800 0x7f290814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f28fffff640 1 -- 172.21.15.79:0/350749232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29080b3800 msgr2=0x7f290814e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f28fffff640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29080b3800 0x7f290814e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f28fffff640 1 -- 172.21.15.79:0/350749232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080d08f0 msgr2=0x7f29080caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f28fffff640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080d08f0 0x7f29080caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.465+0000 7f28fffff640 1 -- 172.21.15.79:0/350749232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29080cccc0 con 0x7f29080cf360 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.466+0000 7f28fffff640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080cf360 0x7f29080cc5d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f28f000c480 tx=0x7f28f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.466+0000 7f28feffd640 1 -- 172.21.15.79:0/350749232 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f00052d0 con 0x7f29080cf360 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.466+0000 7f28feffd640 1 -- 172.21.15.79:0/350749232 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0005470 con 0x7f29080cf360 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.466+0000 7f290cbce640 1 -- 172.21.15.79:0/350749232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29080ccfa0 con 0x7f29080cf360 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.466+0000 7f28feffd640 1 -- 172.21.15.79:0/350749232 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0012870 con 0x7f29080cf360 2024-06-10T00:24:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.466+0000 7f290cbce640 1 -- 172.21.15.79:0/350749232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29080cd560 con 0x7f29080cf360 2024-06-10T00:24:10.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.468+0000 7f28feffd640 1 -- 172.21.15.79:0/350749232 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28f0012a10 con 0x7f29080cf360 2024-06-10T00:24:10.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.468+0000 7f28feffd640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28e806be60 0x7f28e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.468+0000 7f28feffd640 1 -- 172.21.15.79:0/350749232 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f28f008ab50 con 0x7f29080cf360 2024-06-10T00:24:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.468+0000 7f290659c640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28e806be60 0x7f28e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.469+0000 7f290659c640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28e806be60 0x7f28e806e320 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f28f8005880 tx=0x7f28f8000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.469+0000 7f290f9b9740 1 Processor -- start 2024-06-10T00:24:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.469+0000 7f290f9b9740 1 -- start start 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058be1a0 0x559b058c3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058c56d0 0x559b058c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f290f9b9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b057e87e0 con 0x559b058c56d0 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f290f9b9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b05826e80 con 0x559b058be1a0 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f290f9b9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b057c4700 con 0x559b058e6af0 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058c56d0 0x559b058c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058c56d0 0x559b058c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49486/0 (socket says 172.21.15.79:49486) 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 -- 172.21.15.79:0/3798725739 learned_addr learned my addr 172.21.15.79:0/3798725739 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f290659c640 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f28fffff640 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058be1a0 0x559b058c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 -- 172.21.15.79:0/3798725739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 msgr2=0x559b058c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 -- 172.21.15.79:0/3798725739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058be1a0 msgr2=0x559b058c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058be1a0 0x559b058c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 -- 172.21.15.79:0/3798725739 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b057e3dd0 con 0x559b058c56d0 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.470+0000 7f2906d9d640 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058c56d0 0x559b058c3ba0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f2900009ee0 tx=0x7f290002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c44d5386503f7ab server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f28e7fff640 1 -- 172.21.15.79:0/3798725739 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900007980 con 0x559b058c56d0 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f28e7fff640 1 -- 172.21.15.79:0/3798725739 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900007b20 con 0x559b058c56d0 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f28e7fff640 1 -- 172.21.15.79:0/3798725739 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900046480 con 0x559b058c56d0 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 -- 172.21.15.79:0/3798725739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058c56d0 msgr2=0x559b058c3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058c56d0 0x559b058c3ba0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f2900009ee0 tx=0x7f290002e000 comp rx=0 tx=0).stop 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 -- 172.21.15.79:0/3798725739 shutdown_connections 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058c56d0 0x559b058c3ba0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058be1a0 0x559b058c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 --2- 172.21.15.79:0/3798725739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 -- 172.21.15.79:0/3798725739 >> 172.21.15.79:0/3798725739 conn(0x559b058c0410 msgr2=0x559b05908f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:10.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 -- 172.21.15.79:0/3798725739 shutdown_connections 2024-06-10T00:24:10.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.471+0000 7f290f9b9740 1 -- 172.21.15.79:0/3798725739 wait complete. 2024-06-10T00:24:10.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.472+0000 7f290f9b9740 1 -- start start 2024-06-10T00:24:10.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.472+0000 7f290f9b9740 1 Processor -- start 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058dc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e7200 0x559b058e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e1510 0x559b058e1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290f9b9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b057af640 con 0x559b058e6af0 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290f9b9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b05822e40 con 0x559b058e7200 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290f9b9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b058c1be0 con 0x559b058e1510 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290f9b9740 10 client.0 _ll_register_callbacks cb 0x559b057e1430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058dc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058dc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49490/0 (socket says 172.21.15.79:49490) 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 -- 172.21.15.79:0/4134420160 learned_addr learned my addr 172.21.15.79:0/4134420160 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f2906d9d640 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e1510 0x559b058e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f28fffff640 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e7200 0x559b058e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 -- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e1510 msgr2=0x559b058e1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e1510 0x559b058e1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 -- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e7200 msgr2=0x559b058e75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e7200 0x559b058e75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 -- 172.21.15.79:0/4134420160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b056047d0 con 0x559b058e6af0 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f28fffff640 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e7200 0x559b058e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f290659c640 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058dc510 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f28f8014830 tx=0x7f28f80011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e9f7aecd634284 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.473+0000 7f28e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f28e57fa640 1 -- 172.21.15.79:0/4134420160 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8013930 con 0x559b058e6af0 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f28e57fa640 1 -- 172.21.15.79:0/4134420160 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f28f8013ad0 con 0x559b058e6af0 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 1 -- 172.21.15.79:0/4134420160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2900007b20 con 0x559b058e6af0 2024-06-10T00:24:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f28e57fa640 1 -- 172.21.15.79:0/4134420160 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f28f802e050 con 0x559b058e6af0 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 10 client.8172 fetch_fsmap learned FSMap version 74 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 1 -- 172.21.15.79:0/4134420160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x559b0553a3f0 con 0x559b058e6af0 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f28e57fa640 1 -- 172.21.15.79:0/4134420160 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900007b20 con 0x559b058e6af0 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f28e57fa640 1 -- 172.21.15.79:0/4134420160 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f28f8031020 con 0x559b058e6af0 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 10 client.8172 fetch_fsmap finished waiting for FSMap version 74 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 10 client.8172 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 20 client.8172 populate_metadata read hostname 'smithi079' 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x559b058eaed0 0x559b058eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 4 client.8172 mds_command: new command op to 8031 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f290f9b9740 1 -- 172.21.15.79:0/4134420160 --> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b058345b0 con 0x559b058eaed0 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f28fffff640 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x559b058eaed0 0x559b058eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f28fffff640 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x559b058eaed0 0x559b058eb2b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=551c7ccb2e19933a server_cookie=b77969772a136c6f in_seq=0 out_seq=0 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.474+0000 7f28e57fa640 10 client.8172 ms_handle_connect on v2:172.21.15.79:6835/4878507 2024-06-10T00:24:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f28e57fa640 1 -- 172.21.15.79:0/4134420160 <== mds.0 v2:172.21.15.79:6835/4878507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559b058345b0 con 0x559b058eaed0 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f28e57fa640 10 client.8172 handle_command_reply: tid=0 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 client.8172 shutdown 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 -- 172.21.15.79:0/4134420160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 msgr2=0x559b058dc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058dc510 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f28f8014830 tx=0x7f28f80011a0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 -- 172.21.15.79:0/4134420160 shutdown_connections 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x559b058eaed0 0x559b058eb2b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e1510 0x559b058e1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e7200 0x559b058e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f28e57fa640 0 client.8172 ms_handle_reset on v2:172.21.15.79:6835/4878507 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 --2- 172.21.15.79:0/4134420160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058dc510 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 -- 172.21.15.79:0/4134420160 >> 172.21.15.79:0/4134420160 conn(0x559b058c56d0 msgr2=0x559b058c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 -- 172.21.15.79:0/4134420160 shutdown_connections 2024-06-10T00:24:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.475+0000 7f290f9b9740 1 -- 172.21.15.79:0/4134420160 wait complete. 2024-06-10T00:24:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.476+0000 7f290f9b9740 20 client.8172 trim_cache size 0 max 16384 2024-06-10T00:24:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.493+0000 7f290f9b9740 1 Processor -- start 2024-06-10T00:24:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f290f9b9740 1 -- start start 2024-06-10T00:24:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 0x559b058cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058db580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e7200 0x559b058dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f290f9b9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2908200f40 con 0x559b058e6af0 2024-06-10T00:24:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f290f9b9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29081fff50 con 0x559b058e1510 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f290f9b9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f290814fda0 con 0x559b058e7200 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f28fffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058db580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f28fffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058db580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49496/0 (socket says 172.21.15.79:49496) 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.494+0000 7f28fffff640 1 -- 172.21.15.79:0/2188665861 learned_addr learned my addr 172.21.15.79:0/2188665861 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28fffff640 1 -- 172.21.15.79:0/2188665861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e7200 msgr2=0x559b058dbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28fffff640 1 --2- 172.21.15.79:0/2188665861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e7200 0x559b058dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28fffff640 1 -- 172.21.15.79:0/2188665861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 msgr2=0x559b058cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28fffff640 1 --2- 172.21.15.79:0/2188665861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 0x559b058cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28fffff640 1 -- 172.21.15.79:0/2188665861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b054fa0f0 con 0x559b058e6af0 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28fffff640 1 --2- 172.21.15.79:0/2188665861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058db580 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f28f0000f30 tx=0x7f28f0088da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9941fcd7117783e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28e77fe640 1 -- 172.21.15.79:0/2188665861 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0088070 con 0x559b058e6af0 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28e77fe640 1 -- 172.21.15.79:0/2188665861 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0056da0 con 0x559b058e6af0 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f28e77fe640 1 -- 172.21.15.79:0/2188665861 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0012d00 con 0x559b058e6af0 2024-06-10T00:24:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 -- 172.21.15.79:0/2188665861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 msgr2=0x559b058db580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 --2- 172.21.15.79:0/2188665861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058db580 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f28f0000f30 tx=0x7f28f0088da0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 -- 172.21.15.79:0/2188665861 shutdown_connections 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 --2- 172.21.15.79:0/2188665861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e7200 0x559b058dbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 --2- 172.21.15.79:0/2188665861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e6af0 0x559b058db580 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 --2- 172.21.15.79:0/2188665861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 0x559b058cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 -- 172.21.15.79:0/2188665861 >> 172.21.15.79:0/2188665861 conn(0x559b058c56d0 msgr2=0x559b058dc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 -- 172.21.15.79:0/2188665861 shutdown_connections 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.495+0000 7f290f9b9740 1 -- 172.21.15.79:0/2188665861 wait complete. 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.496+0000 7f290f9b9740 1 -- start start 2024-06-10T00:24:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.496+0000 7f290f9b9740 1 Processor -- start 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 0x559b0592c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058ff160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290f9b9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e7200 0x559b058e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290f9b9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29081503f0 con 0x559b058e7200 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290f9b9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b05918850 con 0x559b058e1510 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290f9b9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b0592d110 con 0x559b058e6af0 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290f9b9740 10 client.0 _ll_register_callbacks cb 0x7f28f8014450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f2906d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e7200 0x559b058e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f2906d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e7200 0x559b058e26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49502/0 (socket says 172.21.15.79:49502) 2024-06-10T00:24:10.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f2906d9d640 1 -- 172.21.15.79:0/1169396934 learned_addr learned my addr 172.21.15.79:0/1169396934 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f28fffff640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058ff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290659c640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 0x559b0592c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f2906d9d640 1 -- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 msgr2=0x559b058ff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f2906d9d640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058ff160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f2906d9d640 1 -- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 msgr2=0x559b0592c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f2906d9d640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 0x559b0592c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f2906d9d640 1 -- 172.21.15.79:0/1169396934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b057ed560 con 0x559b058e7200 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f28fffff640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.497+0000 7f290659c640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 0x559b0592c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f2906d9d640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e7200 0x559b058e26c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f290002acb0 tx=0x7f2900004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344f658bbfec416 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f28e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f28e57fa640 1 -- 172.21.15.79:0/1169396934 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900003e40 con 0x559b058e7200 2024-06-10T00:24:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f28e57fa640 1 -- 172.21.15.79:0/1169396934 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7f2900007bc0 con 0x559b058e7200 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 1 -- 172.21.15.79:0/1169396934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f0056da0 con 0x559b058e7200 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f28e57fa640 1 -- 172.21.15.79:0/1169396934 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f290005b050 con 0x559b058e7200 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 10 client.8178 fetch_fsmap learned FSMap version 74 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 1 -- 172.21.15.79:0/1169396934 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x559b0592ce50 con 0x559b058e7200 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f28e57fa640 1 -- 172.21.15.79:0/1169396934 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0056da0 con 0x559b058e7200 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f28e57fa640 1 -- 172.21.15.79:0/1169396934 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f290005e020 con 0x559b058e7200 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 10 client.8178 fetch_fsmap finished waiting for FSMap version 74 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 10 client.8178 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 20 client.8178 populate_metadata read hostname 'smithi079' 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x559b058e1990 0x559b058e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 4 client.8178 mds_command: new command op to 8031 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290f9b9740 1 -- 172.21.15.79:0/1169396934 --> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559b0590bf70 con 0x559b058e1990 2024-06-10T00:24:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.498+0000 7f290659c640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x559b058e1990 0x559b058e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f28e57fa640 10 client.8178 ms_handle_connect on v2:172.21.15.79:6835/4878507 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290659c640 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x559b058e1990 0x559b058e2c00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39dfd8bcc69e1c4c server_cookie=d6721cbee1b578ab in_seq=0 out_seq=0 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f28e57fa640 1 -- 172.21.15.79:0/1169396934 <== mds.0 v2:172.21.15.79:6835/4878507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559b0590bf70 con 0x559b058e1990 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f28e57fa640 10 client.8178 handle_command_reply: tid=0 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 client.8178 shutdown 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 -- 172.21.15.79:0/1169396934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e7200 msgr2=0x559b058e26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e7200 0x559b058e26c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f290002acb0 tx=0x7f2900004ab0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 -- 172.21.15.79:0/1169396934 shutdown_connections 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.79:6835/4878507,v1:172.21.15.79:6837/4878507] conn(0x559b058e1990 0x559b058e2c00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b058e7200 0x559b058e26c0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b058e6af0 0x559b058ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 --2- 172.21.15.79:0/1169396934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b058e1510 0x559b0592c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f28e57fa640 0 client.8178 ms_handle_reset on v2:172.21.15.79:6835/4878507 2024-06-10T00:24:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 -- 172.21.15.79:0/1169396934 >> 172.21.15.79:0/1169396934 conn(0x559b058c56d0 msgr2=0x559b058e4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 -- 172.21.15.79:0/1169396934 shutdown_connections 2024-06-10T00:24:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 1 -- 172.21.15.79:0/1169396934 wait complete. 2024-06-10T00:24:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.499+0000 7f290f9b9740 20 client.8178 trim_cache size 0 max 16384 2024-06-10T00:24:10.506 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:10.506 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-06-10T00:24:10.506 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-06-10T00:24:10.506 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 -- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28e806be60 msgr2=0x7f28e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28e806be60 0x7f28e806e320 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f28f8005880 tx=0x7f28f8000bc0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 -- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080cf360 msgr2=0x7f29080cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080cf360 0x7f29080cc5d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f28f000c480 tx=0x7f28f000c940 comp rx=0 tx=0).stop 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 -- 172.21.15.79:0/350749232 shutdown_connections 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f28e806be60 0x7f28e806e320 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29080d08f0 0x7f29080caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29080cf360 0x7f29080cc5d0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 --2- 172.21.15.79:0/350749232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29080b3800 0x7f290814e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 -- 172.21.15.79:0/350749232 >> 172.21.15.79:0/350749232 conn(0x7f290809d3c0 msgr2=0x7f29080cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 -- 172.21.15.79:0/350749232 shutdown_connections 2024-06-10T00:24:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.500+0000 7f290cbce640 1 -- 172.21.15.79:0/350749232 wait complete. 2024-06-10T00:24:10.511 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-10T00:24:10.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:24:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.712+0000 7fa460c12640 1 Processor -- start 2024-06-10T00:24:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.712+0000 7fa460c12640 1 -- start start 2024-06-10T00:24:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa460c12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa45c0cf360 0x7fa45c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa460c12640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa45c0b3420 con 0x7fa45c0cd230 2024-06-10T00:24:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa460c12640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa45c0cc750 con 0x7fa45c1553c0 2024-06-10T00:24:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa460c12640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa45c0cca30 con 0x7fa45c0cf360 2024-06-10T00:24:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa451d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa45c0cd230 0x7fa45c0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39724/0 (socket says 172.21.15.79:39724) 2024-06-10T00:24:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa451d9b640 1 -- 172.21.15.79:0/1701068440 learned_addr learned my addr 172.21.15.79:0/1701068440 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa45ad9d640 1 --2- 172.21.15.79:0/1701068440 >> v2:172.21.15.117:3300/0 conn(0x7fa45c0cf360 0x7fa45c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958172377 0 0) 0x7fa45c0b3420 con 0x7fa45c0cd230 2024-06-10T00:24:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.713+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa448003520 con 0x7fa45c0cd230 2024-06-10T00:24:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 562993700 0 0) 0x7fa448003520 con 0x7fa45c0cd230 2024-06-10T00:24:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 >> v2:172.21.15.117:3300/0 conn(0x7fa45c0cf360 msgr2=0x7fa45c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 --2- 172.21.15.79:0/1701068440 >> v2:172.21.15.117:3300/0 conn(0x7fa45c0cf360 0x7fa45c0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 >> v1:172.21.15.117:6789/0 conn(0x7fa45c1553c0 legacy=0x7fa45c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c0ccd10 con 0x7fa45c0cd230 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fa444001670 con 0x7fa45c0cd230 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 >> v1:172.21.15.79:6789/0 conn(0x7fa45c0cd230 legacy=0x7fa45c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4480039b0 0x7fa448003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4480043b0 0x7fa448004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa448005080 0x7fa44800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c0cca30 con 0x7fa448005080 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa44800bfe0 con 0x7fa4480043b0 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa44800c1e0 con 0x7fa4480039b0 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa45ad9d640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa448005080 0x7fa44800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa451d9b640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4480043b0 0x7fa448004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa45a59c640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4480039b0 0x7fa448003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa45ad9d640 1 -- 172.21.15.79:0/1701068440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4480039b0 msgr2=0x7fa448003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa45ad9d640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4480039b0 0x7fa448003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa45ad9d640 1 -- 172.21.15.79:0/1701068440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4480043b0 msgr2=0x7fa448004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa45ad9d640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4480043b0 0x7fa448004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.714+0000 7fa45ad9d640 1 -- 172.21.15.79:0/1701068440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa448003520 con 0x7fa448005080 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.715+0000 7fa45ad9d640 1 -- 172.21.15.79:0/1701068440 reap_dead start 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.715+0000 7fa45ad9d640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa448005080 0x7fa44800b9c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fa454009fc0 tx=0x7fa448005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd53c7c4997a01a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.715+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454035020 con 0x7fa448005080 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.715+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa454003bd0 con 0x7fa448005080 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.715+0000 7fa459d9b640 1 -- 172.21.15.79:0/1701068440 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454009c10 con 0x7fa448005080 2024-06-10T00:24:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.716+0000 7fa460c12640 1 -- 172.21.15.79:0/1701068440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa448005080 msgr2=0x7fa44800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.716+0000 7fa460c12640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa448005080 0x7fa44800b9c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fa454009fc0 tx=0x7fa448005830 comp rx=0 tx=0).stop 2024-06-10T00:24:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.716+0000 7fa460c12640 1 -- 172.21.15.79:0/1701068440 shutdown_connections 2024-06-10T00:24:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.716+0000 7fa460c12640 1 --2- 172.21.15.79:0/1701068440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa448005080 0x7fa44800b9c0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.716+0000 7fa460c12640 1 -- 172.21.15.79:0/1701068440 >> 172.21.15.79:0/1701068440 conn(0x7fa45c0b19f0 msgr2=0x7fa45c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.716+0000 7fa460c12640 1 -- 172.21.15.79:0/1701068440 shutdown_connections 2024-06-10T00:24:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.716+0000 7fa460c12640 1 -- 172.21.15.79:0/1701068440 wait complete. 2024-06-10T00:24:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.717+0000 7fa460c12640 1 Processor -- start 2024-06-10T00:24:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.717+0000 7fa460c12640 1 -- start start 2024-06-10T00:24:10.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa460c12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa448005080 0x7fa45c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa460c12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa45c14a9b0 0x7fa45c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa460c12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa45c15cdb0 0x7fa45c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa460c12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c155920 con 0x7fa45c14a9b0 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa460c12640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c1557a0 con 0x7fa45c15cdb0 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa460c12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa45c0b2cf0 con 0x7fa448005080 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa45c14a9b0 0x7fa45c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa45c14a9b0 0x7fa45c0cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49510/0 (socket says 172.21.15.79:49510) 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 -- 172.21.15.79:0/3992458489 learned_addr learned my addr 172.21.15.79:0/3992458489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa45a59c640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa448005080 0x7fa45c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa45ad9d640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa45c15cdb0 0x7fa45c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 -- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa448005080 msgr2=0x7fa45c15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa448005080 0x7fa45c15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 -- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa45c15cdb0 msgr2=0x7fa45c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa45c15cdb0 0x7fa45c0ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 -- 172.21.15.79:0/3992458489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c15d380 con 0x7fa45c14a9b0 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa45ad9d640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa45c15cdb0 0x7fa45c0ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.718+0000 7fa451d9b640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa45c14a9b0 0x7fa45c0cdb40 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fa444004ec0 tx=0x7fa444007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.719+0000 7fa4537fe640 1 -- 172.21.15.79:0/3992458489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44400f7b0 con 0x7fa45c14a9b0 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.719+0000 7fa4537fe640 1 -- 172.21.15.79:0/3992458489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444018070 con 0x7fa45c14a9b0 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.719+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45c15d660 con 0x7fa45c14a9b0 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.719+0000 7fa4537fe640 1 -- 172.21.15.79:0/3992458489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44400fbb0 con 0x7fa45c14a9b0 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.719+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa45c15dc20 con 0x7fa45c14a9b0 2024-06-10T00:24:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.720+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa45c0cec50 con 0x7fa45c14a9b0 2024-06-10T00:24:10.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.720+0000 7fa4537fe640 1 -- 172.21.15.79:0/3992458489 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa44400fd50 con 0x7fa45c14a9b0 2024-06-10T00:24:10.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.720+0000 7fa4537fe640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa43c06be60 0x7fa43c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.721+0000 7fa4537fe640 1 -- 172.21.15.79:0/3992458489 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6274+0+0 (secure 0 0 0) 0x7fa44408af10 con 0x7fa45c14a9b0 2024-06-10T00:24:10.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.721+0000 7fa45a59c640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa43c06be60 0x7fa43c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:10.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.721+0000 7fa45a59c640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa43c06be60 0x7fa43c06e320 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0b4540 tx=0x7fa44c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:10.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.725+0000 7fa4537fe640 1 -- 172.21.15.79:0/3992458489 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa45c0cec50 con 0x7fa45c14a9b0 2024-06-10T00:24:10.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.934+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa45c068430 con 0x7fa45c14a9b0 2024-06-10T00:24:10.935 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:24:10.934+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:24:10.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.936+0000 7fa4537fe640 1 -- 172.21.15.79:0/3992458489 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7fa444059710 con 0x7fa45c14a9b0 2024-06-10T00:24:10.936 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:24:10.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.938+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa43c06be60 msgr2=0x7fa43c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.938+0000 7fa460c12640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa43c06be60 0x7fa43c06e320 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0b4540 tx=0x7fa44c009040 comp rx=0 tx=0).stop 2024-06-10T00:24:10.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.938+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa45c14a9b0 msgr2=0x7fa45c0cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:10.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.938+0000 7fa460c12640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa45c14a9b0 0x7fa45c0cdb40 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fa444004ec0 tx=0x7fa444007430 comp rx=0 tx=0).stop 2024-06-10T00:24:10.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.939+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 shutdown_connections 2024-06-10T00:24:10.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.939+0000 7fa460c12640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa43c06be60 0x7fa43c06e320 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.939+0000 7fa460c12640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa45c15cdb0 0x7fa45c0ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.939+0000 7fa460c12640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa45c14a9b0 0x7fa45c0cdb40 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.939+0000 7fa460c12640 1 --2- 172.21.15.79:0/3992458489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa448005080 0x7fa45c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.939+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 >> 172.21.15.79:0/3992458489 conn(0x7fa45c0b19f0 msgr2=0x7fa45c071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.939+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 shutdown_connections 2024-06-10T00:24:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.939+0000 7fa460c12640 1 -- 172.21.15.79:0/3992458489 wait complete. 2024-06-10T00:24:10.947 INFO:tasks.ceph.mds.a.smithi079.stderr: -1154> 2024-06-10T00:23:40.182+0000 7f9f8a05a640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-06-10T00:24:10.947 INFO:tasks.ceph.mds.a.smithi079.stderr: -1151> 2024-06-10T00:23:40.182+0000 7f9f8a05a640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-06-10T00:24:10.948 INFO:tasks.ceph.mds.a.smithi079.stderr: -1110> 2024-06-10T00:23:40.182+0000 7f9f8a05a640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-06-10T00:24:10.948 INFO:tasks.ceph.mds.a.smithi079.stderr: -1107> 2024-06-10T00:23:40.182+0000 7f9f8a05a640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-06-10T00:24:10.948 INFO:tasks.ceph.mds.a.smithi079.stderr: -999> 2024-06-10T00:23:40.622+0000 7f9f8e062640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:24:10.951 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-06-10T00:24:10.967 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:24:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.991+0000 7f0cc8724280 1 -- start start 2024-06-10T00:24:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.991+0000 7f0cc8724280 1 Processor -- start 2024-06-10T00:24:10.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5dce400 0x55c2c507f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5dcfc00 0x55c2c507eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6000 0x55c2c507fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:10.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c2c5ecc000 con 0x55c2c5dcfc00 2024-06-10T00:24:10.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c2c5ecc180 con 0x55c2c5dce400 2024-06-10T00:24:10.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c2c5ecc300 con 0x55c2c5ec6000 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5dcfc00 0x55c2c507eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5dcfc00 0x55c2c507eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49546/0 (socket says 172.21.15.79:49546) 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 -- 172.21.15.79:0/3999106721 learned_addr learned my addr 172.21.15.79:0/3999106721 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc6bfe640 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6000 0x55c2c507fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc63fd640 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5dce400 0x55c2c507f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 -- 172.21.15.79:0/3999106721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6000 msgr2=0x55c2c507fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6000 0x55c2c507fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 -- 172.21.15.79:0/3999106721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5dce400 msgr2=0x55c2c507f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5dce400 0x55c2c507f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 -- 172.21.15.79:0/3999106721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c503c780 con 0x55c2c5dcfc00 2024-06-10T00:24:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc5bfc640 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5dcfc00 0x55c2c507eb00 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x55c2c5e38d20 tx=0x55c2c5da0480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a985141f19c66909 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc3bf8640 1 -- 172.21.15.79:0/3999106721 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c2c502cb60 con 0x55c2c5dcfc00 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc3bf8640 1 -- 172.21.15.79:0/3999106721 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c2c5032e00 con 0x55c2c5dcfc00 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc3bf8640 1 -- 172.21.15.79:0/3999106721 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c2c502cd00 con 0x55c2c5dcfc00 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 1 -- 172.21.15.79:0/3999106721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c503da40 con 0x55c2c5dcfc00 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 1 -- 172.21.15.79:0/3999106721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55c2c503d860 con 0x55c2c5dcfc00 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.992+0000 7f0cc8724280 4 waiting for MDS map... 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.993+0000 7f0cc3bf8640 1 -- 172.21.15.79:0/3999106721 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x55c2c5eda400 con 0x55c2c5dcfc00 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.993+0000 7f0cc3bf8640 1 -- 172.21.15.79:0/3999106721 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 75) ==== 2885+0+0 (secure 0 0 0) 0x55c2c5061180 con 0x55c2c5dcfc00 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.993+0000 7f0cc8724280 4 Got MDS map 75 2024-06-10T00:24:11.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.993+0000 7f0cc8724280 10 main: main 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.993+0000 7f0cc8724280 4 main: connecting to RADOS... 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.993+0000 7f0cc8724280 1 Processor -- start 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.993+0000 7f0cc8724280 1 -- start start 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec6800 0x55c2c507e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6c00 0x55c2c5080100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec7000 0x55c2c5080680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc8724280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c2c5ecc480 con 0x55c2c5ec6800 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc8724280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c2c5ecc600 con 0x55c2c5ec6c00 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc8724280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c2c5ecc780 con 0x55c2c5ec7000 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec6800 0x55c2c507e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec6800 0x55c2c507e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49548/0 (socket says 172.21.15.79:49548) 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 -- 172.21.15.79:0/170613323 learned_addr learned my addr 172.21.15.79:0/170613323 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc5bfc640 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec7000 0x55c2c5080680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc63fd640 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6c00 0x55c2c5080100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 -- 172.21.15.79:0/170613323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec7000 msgr2=0x55c2c5080680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec7000 0x55c2c5080680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 -- 172.21.15.79:0/170613323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6c00 msgr2=0x55c2c5080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6c00 0x55c2c5080100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 -- 172.21.15.79:0/170613323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c503c3c0 con 0x55c2c5ec6800 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc6bfe640 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec6800 0x55c2c507e580 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x55c2c5ee8690 tx=0x55c2c5ee5800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5997368246cef3d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.994+0000 7f0cc1bf4640 1 -- 172.21.15.79:0/170613323 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c2c502cb60 con 0x55c2c5ec6800 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc1bf4640 1 -- 172.21.15.79:0/170613323 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c2c5032700 con 0x55c2c5ec6800 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc1bf4640 1 -- 172.21.15.79:0/170613323 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c2c502cd00 con 0x55c2c5ec6800 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 -- 172.21.15.79:0/170613323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec6800 msgr2=0x55c2c507e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec6800 0x55c2c507e580 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x55c2c5ee8690 tx=0x55c2c5ee5800 comp rx=0 tx=0).stop 2024-06-10T00:24:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 -- 172.21.15.79:0/170613323 shutdown_connections 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec7000 0x55c2c5080680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6c00 0x55c2c5080100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 --2- 172.21.15.79:0/170613323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec6800 0x55c2c507e580 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 -- 172.21.15.79:0/170613323 >> 172.21.15.79:0/170613323 conn(0x55c2c5ec6400 msgr2=0x55c2c50f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 -- 172.21.15.79:0/170613323 shutdown_connections 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 -- 172.21.15.79:0/170613323 wait complete. 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.995+0000 7f0cc8724280 1 Processor -- start 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc8724280 1 -- start start 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6800 0x55c2c5081700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6c00 0x55c2c5081180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc8724280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec7000 0x55c2c5080c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc8724280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c2c5ecde00 con 0x55c2c5ec7000 2024-06-10T00:24:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc8724280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c2c5ecdc80 con 0x55c2c5ec6800 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc8724280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c2c5ecdb00 con 0x55c2c5ec6c00 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc5bfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec7000 0x55c2c5080c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc5bfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec7000 0x55c2c5080c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49550/0 (socket says 172.21.15.79:49550) 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc5bfc640 1 -- 172.21.15.79:0/826715995 learned_addr learned my addr 172.21.15.79:0/826715995 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc63fd640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6c00 0x55c2c5081180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc6bfe640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6800 0x55c2c5081700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc5bfc640 1 -- 172.21.15.79:0/826715995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6c00 msgr2=0x55c2c5081180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc5bfc640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6c00 0x55c2c5081180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc5bfc640 1 -- 172.21.15.79:0/826715995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6800 msgr2=0x55c2c5081700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc5bfc640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5ec6800 0x55c2c5081700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.996+0000 7f0cc5bfc640 1 -- 172.21.15.79:0/826715995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c503c780 con 0x55c2c5ec7000 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.997+0000 7f0cc5bfc640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec7000 0x55c2c5080c00 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x55c2c5e395f0 tx=0x55c2c5da0420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.997+0000 7f0cc03f1640 1 -- 172.21.15.79:0/826715995 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c2c502c680 con 0x55c2c5ec7000 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.997+0000 7f0cc03f1640 1 -- 172.21.15.79:0/826715995 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c2c5032c40 con 0x55c2c5ec7000 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.997+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2c503c000 con 0x55c2c5ec7000 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.997+0000 7f0cc03f1640 1 -- 172.21.15.79:0/826715995 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c2c502c820 con 0x55c2c5ec7000 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.997+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c503d680 con 0x55c2c5ec7000 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.997+0000 7f0cc8724280 4 main: resolving pool 15 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.998+0000 7f0cc03f1640 1 -- 172.21.15.79:0/826715995 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55c2c5f5ac00 con 0x55c2c5ec7000 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.998+0000 7f0cc03f1640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55c2c5f5f400 0x55c2c5394000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.998+0000 7f0cc03f1640 1 -- 172.21.15.79:0/826715995 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x55c2c5f52e00 con 0x55c2c5ec7000 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.998+0000 7f0cc8724280 4 main: creating IoCtx.. 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.998+0000 7f0cc6bfe640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55c2c5f5f400 0x55c2c5394000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.998+0000 7f0cc8724280 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c2c5f5f800 0x55c2c5080680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.998+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x55c2c5f5fc00 con 0x55c2c5f5f800 2024-06-10T00:24:11.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.999+0000 7f0cc63fd640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c2c5f5f800 0x55c2c5080680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.999+0000 7f0cc6bfe640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55c2c5f5f400 0x55c2c5394000 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55c2c5ee8690 tx=0x55c2c5da1ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:10.999+0000 7f0cc63fd640 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c2c5f5f800 0x55c2c5080680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc63fd640 1 -- 172.21.15.79:0/826715995 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55c2c50fe000 con 0x55c2c5f5f800 2024-06-10T00:24:11.007 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "0": { 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "data": { 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 5, 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "inotable": { 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "projected_free": [ 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "start": 1099511627779, 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "len": 1099511627773 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "free": [ 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "start": 1099511627779, 2024-06-10T00:24:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "len": 1099511627773 2024-06-10T00:24:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-10T00:24:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "result": 0 2024-06-10T00:24:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:11.009 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:11.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c2c5f5f800 msgr2=0x55c2c5080680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55c2c5f5f800 0x55c2c5080680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55c2c5f5f400 msgr2=0x55c2c5394000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55c2c5f5f400 0x55c2c5394000 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55c2c5ee8690 tx=0x55c2c5da1ec0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec7000 msgr2=0x55c2c5080c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 --2- 172.21.15.79:0/826715995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5ec7000 0x55c2c5080c00 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x55c2c5e395f0 tx=0x55c2c5da0420 comp rx=0 tx=0).stop 2024-06-10T00:24:11.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc63fd640 1 -- 172.21.15.79:0/826715995 reap_dead start 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 shutdown_connections 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 >> 172.21.15.79:0/826715995 conn(0x55c2c5ec6400 msgr2=0x55c2c50f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 shutdown_connections 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/826715995 wait complete. 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/3999106721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5dcfc00 msgr2=0x55c2c507eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5dcfc00 0x55c2c507eb00 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x55c2c5e38d20 tx=0x55c2c5da0480 comp rx=0 tx=0).stop 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/3999106721 shutdown_connections 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c2c5ec6000 0x55c2c507fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2c5dcfc00 0x55c2c507eb00 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 --2- 172.21.15.79:0/3999106721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c2c5dce400 0x55c2c507f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/3999106721 >> 172.21.15.79:0/3999106721 conn(0x55c2c5007000 msgr2=0x55c2c50f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:11.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.001+0000 7f0cc8724280 1 -- 172.21.15.79:0/3999106721 shutdown_connections 2024-06-10T00:24:11.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.002+0000 7f0cc8724280 1 -- 172.21.15.79:0/3999106721 wait complete. 2024-06-10T00:24:11.013 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.062142, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-06-10T00:24:11.013 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:24:11.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:24:11.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:24:11.130 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:24:11.130 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:24:11.130 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:11.130 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:11.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:24:11.146 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:24:11.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:11.147 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:24:11.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:24:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-10T00:24:11.205 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:24:11.205 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:24:11.206 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:11.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:24:11.224 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:24:11.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:11.224 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-10T00:24:11.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:24:11.281 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-10T00:24:11.281 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:24:11.281 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:11.281 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:11.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:24:11.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:24:11.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:11.299 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-10T00:24:11.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:24:11.354 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-10T00:24:11.354 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:24:11.355 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:24:11.355 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:11.371 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:24:11.372 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:24:11.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:11.372 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-10T00:24:11.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:24:11.429 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-10T00:24:11.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:11.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.528+0000 7f4d03342640 1 Processor -- start 2024-06-10T00:24:11.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.529+0000 7f4d03342640 1 -- start start 2024-06-10T00:24:11.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4d03342640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4cfc161c10 0x7f4cfc0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4d03342640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cfc0cebb0 con 0x7f4cfc161830 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4d03342640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cfc0d2fc0 con 0x7f4cfc0d1110 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4d03342640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4cfc0d4f20 con 0x7f4cfc161c10 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4d010de640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4cfc161830 0x7f4cfc0d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39750/0 (socket says 172.21.15.79:39750) 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4d010de640 1 -- 172.21.15.79:0/913804028 learned_addr learned my addr 172.21.15.79:0/913804028 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763940099 0 0) 0x7f4cfc0cebb0 con 0x7f4cfc161830 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce8003520 con 0x7f4cfc161830 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4d018df640 1 --2- 172.21.15.79:0/913804028 >> v2:172.21.15.117:3300/0 conn(0x7f4cfc161c10 0x7f4cfc0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 202497873 0 0) 0x7f4ce8003520 con 0x7f4cfc161830 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 >> v2:172.21.15.117:3300/0 conn(0x7f4cfc161c10 msgr2=0x7f4cfc0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 --2- 172.21.15.79:0/913804028 >> v2:172.21.15.117:3300/0 conn(0x7f4cfc161c10 0x7f4cfc0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 >> v1:172.21.15.117:6789/0 conn(0x7f4cfc0d1110 legacy=0x7f4cfc0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc0d2720 con 0x7f4cfc161830 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f4cf0001670 con 0x7f4cfc161830 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 >> v1:172.21.15.79:6789/0 conn(0x7f4cfc161830 legacy=0x7f4cfc0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ce80039b0 0x7f4ce8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce8004800 0x7f4ce8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce80051c0 0x7f4ce800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc0d4f20 con 0x7f4ce8004800 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce800c060 con 0x7f4ce80051c0 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce800c260 con 0x7f4ce80039b0 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.530+0000 7f4d008dd640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce8004800 0x7f4ce8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d018df640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce80051c0 0x7f4ce800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d010de640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ce80039b0 0x7f4ce8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d008dd640 1 -- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ce80039b0 msgr2=0x7f4ce8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d008dd640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ce80039b0 0x7f4ce8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d008dd640 1 -- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce80051c0 msgr2=0x7f4ce800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d008dd640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce80051c0 0x7f4ce800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d008dd640 1 -- 172.21.15.79:0/913804028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce8003520 con 0x7f4ce8004800 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d018df640 1 -- 172.21.15.79:0/913804028 reap_dead start 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d010de640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ce80039b0 0x7f4ce8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4d008dd640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce8004800 0x7f4ce8004c80 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8001750 tx=0x7f4ce8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2266176d2f803317 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.531+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8001370 con 0x7f4ce8004800 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf80052d0 con 0x7f4ce8004800 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4ceffff640 1 -- 172.21.15.79:0/913804028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf802abc0 con 0x7f4ce8004800 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4d03342640 1 -- 172.21.15.79:0/913804028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce8004800 msgr2=0x7f4ce8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4d03342640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce8004800 0x7f4ce8004c80 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8001750 tx=0x7f4ce8005830 comp rx=0 tx=0).stop 2024-06-10T00:24:11.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4d03342640 1 -- 172.21.15.79:0/913804028 shutdown_connections 2024-06-10T00:24:11.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4d03342640 1 --2- 172.21.15.79:0/913804028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ce8004800 0x7f4ce8004c80 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4d03342640 1 -- 172.21.15.79:0/913804028 >> 172.21.15.79:0/913804028 conn(0x7f4cfc09d3e0 msgr2=0x7f4cfc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:11.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4d03342640 1 -- 172.21.15.79:0/913804028 shutdown_connections 2024-06-10T00:24:11.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.532+0000 7f4d03342640 1 -- 172.21.15.79:0/913804028 wait complete. 2024-06-10T00:24:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.533+0000 7f4d03342640 1 Processor -- start 2024-06-10T00:24:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.533+0000 7f4d03342640 1 -- start start 2024-06-10T00:24:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d03342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce8004800 0x7f4cfc153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d03342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cfc160ae0 0x7f4cfc0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d03342640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc0c9030 0x7f4cfc0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d03342640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc0c7bf0 con 0x7f4cfc0c9030 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d03342640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc0d2ce0 con 0x7f4ce8004800 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d03342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc0b5270 con 0x7f4cfc160ae0 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d018df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc0c9030 0x7f4cfc0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d018df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc0c9030 0x7f4cfc0c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49564/0 (socket says 172.21.15.79:49564) 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d018df640 1 -- 172.21.15.79:0/1574627787 learned_addr learned my addr 172.21.15.79:0/1574627787 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d010de640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce8004800 0x7f4cfc153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d008dd640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cfc160ae0 0x7f4cfc0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d018df640 1 -- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cfc160ae0 msgr2=0x7f4cfc0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d018df640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cfc160ae0 0x7f4cfc0cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d018df640 1 -- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce8004800 msgr2=0x7f4cfc153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d018df640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce8004800 0x7f4cfc153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d018df640 1 -- 172.21.15.79:0/1574627787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc0cba50 con 0x7f4cfc0c9030 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.534+0000 7f4d008dd640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cfc160ae0 0x7f4cfc0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.535+0000 7f4d018df640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc0c9030 0x7f4cfc0c94b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0d2650 tx=0x7f4cf400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.535+0000 7f4cedffb640 1 -- 172.21.15.79:0/1574627787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400fce0 con 0x7f4cfc0c9030 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.535+0000 7f4cedffb640 1 -- 172.21.15.79:0/1574627787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf400fe80 con 0x7f4cfc0c9030 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.535+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc0cbd30 con 0x7f4cfc0c9030 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.535+0000 7f4cedffb640 1 -- 172.21.15.79:0/1574627787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4015670 con 0x7f4cfc0c9030 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.535+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc0cc2f0 con 0x7f4cfc0c9030 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.536+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cfc06d990 con 0x7f4cfc0c9030 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.536+0000 7f4cedffb640 1 -- 172.21.15.79:0/1574627787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cf4015810 con 0x7f4cfc0c9030 2024-06-10T00:24:11.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.537+0000 7f4cedffb640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ce006be60 0x7f4ce006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.537+0000 7f4cedffb640 1 -- 172.21.15.79:0/1574627787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7f4cf408bf00 con 0x7f4cfc0c9030 2024-06-10T00:24:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.537+0000 7f4d010de640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ce006be60 0x7f4ce006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.537+0000 7f4d010de640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ce006be60 0x7f4ce006e320 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0001cc0 tx=0x7f4cf0007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.541+0000 7f4cedffb640 1 -- 172.21.15.79:0/1574627787 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4cfc06d990 con 0x7f4cfc0c9030 2024-06-10T00:24:11.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.752+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cfc0b7e40 con 0x7f4cfc0c9030 2024-06-10T00:24:11.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.752+0000 7f4cedffb640 1 -- 172.21.15.79:0/1574627787 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+4351 (secure 0 0 0) 0x7f4cf4019030 con 0x7f4cfc0c9030 2024-06-10T00:24:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:11.753 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:24:10.936551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-06-10T00:24:11.753 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 75 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ce006be60 msgr2=0x7f4ce006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ce006be60 0x7f4ce006e320 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0001cc0 tx=0x7f4cf0007040 comp rx=0 tx=0).stop 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc0c9030 msgr2=0x7f4cfc0c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc0c9030 0x7f4cfc0c94b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0d2650 tx=0x7f4cf400f1b0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 shutdown_connections 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f4ce006be60 0x7f4ce006e320 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc0c9030 0x7f4cfc0c94b0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cfc160ae0 0x7f4cfc0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 --2- 172.21.15.79:0/1574627787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ce8004800 0x7f4cfc153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 >> 172.21.15.79:0/1574627787 conn(0x7f4cfc09d3e0 msgr2=0x7f4cfc0cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:11.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 shutdown_connections 2024-06-10T00:24:11.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.754+0000 7f4d03342640 1 -- 172.21.15.79:0/1574627787 wait complete. 2024-06-10T00:24:11.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:11.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.865+0000 7f114506b640 1 Processor -- start 2024-06-10T00:24:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.865+0000 7f114506b640 1 -- start start 2024-06-10T00:24:11.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f114506b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140161830 0x7f11400b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f114506b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1140161c10 0x7f11400d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f114506b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11400cebb0 con 0x7f11400d0a00 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f114506b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f11400d4cf0 con 0x7f1140161c10 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f114506b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f11400d2fc0 con 0x7f1140161830 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f113e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1140161c10 0x7f11400d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f113e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1140161c10 0x7f11400d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49572/0 (socket says 172.21.15.79:49572) 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f113e59c640 1 -- 172.21.15.79:0/3042874907 learned_addr learned my addr 172.21.15.79:0/3042874907 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f113ed9d640 1 --2- 172.21.15.79:0/3042874907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140161830 0x7f11400b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f113e59c640 1 -- 172.21.15.79:0/3042874907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140161830 msgr2=0x7f11400b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f113e59c640 1 --2- 172.21.15.79:0/3042874907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140161830 0x7f11400b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f113e59c640 1 -- 172.21.15.79:0/3042874907 >> v1:172.21.15.117:6789/0 conn(0x7f11400d0a00 legacy=0x7f11401620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.866+0000 7f113e59c640 1 -- 172.21.15.79:0/3042874907 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11400d4f20 con 0x7f1140161c10 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.867+0000 7f113e59c640 1 --2- 172.21.15.79:0/3042874907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161c10 0x7f11400d47b0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1134009870 tx=0x7f113402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89c54285c43d7c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.867+0000 7f113dd9b640 1 -- 172.21.15.79:0/3042874907 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134037070 con 0x7f1140161c10 2024-06-10T00:24:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.867+0000 7f113dd9b640 1 -- 172.21.15.79:0/3042874907 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1134032440 con 0x7f1140161c10 2024-06-10T00:24:11.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.867+0000 7f113dd9b640 1 -- 172.21.15.79:0/3042874907 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134032810 con 0x7f1140161c10 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.867+0000 7f114506b640 1 -- 172.21.15.79:0/3042874907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161c10 msgr2=0x7f11400d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.867+0000 7f114506b640 1 --2- 172.21.15.79:0/3042874907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161c10 0x7f11400d47b0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1134009870 tx=0x7f113402a210 comp rx=0 tx=0).stop 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.868+0000 7f114506b640 1 -- 172.21.15.79:0/3042874907 shutdown_connections 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.868+0000 7f114506b640 1 --2- 172.21.15.79:0/3042874907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161c10 0x7f11400d47b0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.868+0000 7f114506b640 1 --2- 172.21.15.79:0/3042874907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140161830 0x7f11400b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.868+0000 7f114506b640 1 -- 172.21.15.79:0/3042874907 >> 172.21.15.79:0/3042874907 conn(0x7f114009d3e0 msgr2=0x7f11400d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.868+0000 7f114506b640 1 -- 172.21.15.79:0/3042874907 shutdown_connections 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.868+0000 7f114506b640 1 -- 172.21.15.79:0/3042874907 wait complete. 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.869+0000 7f114506b640 1 Processor -- start 2024-06-10T00:24:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.869+0000 7f114506b640 1 -- start start 2024-06-10T00:24:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f114506b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400d0a00 0x7f11401f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f114506b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161830 0x7f114015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f114506b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1140161c10 0x7f114015d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f114506b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f11400d2ce0 con 0x7f1140161830 2024-06-10T00:24:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f114506b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11400d2a00 con 0x7f1140161c10 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f114506b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f11400d0060 con 0x7f11400d0a00 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161830 0x7f114015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161830 0x7f114015d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49574/0 (socket says 172.21.15.79:49574) 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 -- 172.21.15.79:0/410723920 learned_addr learned my addr 172.21.15.79:0/410723920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113ed9d640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400d0a00 0x7f11401f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113f59e640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1140161c10 0x7f114015d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 -- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400d0a00 msgr2=0x7f11401f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400d0a00 0x7f11401f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 -- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1140161c10 msgr2=0x7f114015d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1140161c10 0x7f114015d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 -- 172.21.15.79:0/410723920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11401547e0 con 0x7f1140161830 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113ed9d640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400d0a00 0x7f11401f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113f59e640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1140161c10 0x7f114015d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f113e59c640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161830 0x7f114015d3a0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f1134000c00 tx=0x7f11340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f11277fe640 1 -- 172.21.15.79:0/410723920 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134037040 con 0x7f1140161830 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f11277fe640 1 -- 172.21.15.79:0/410723920 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1134042070 con 0x7f1140161830 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f11277fe640 1 -- 172.21.15.79:0/410723920 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134030bb0 con 0x7f1140161830 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.870+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11400cdbe0 con 0x7f1140161830 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.871+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11400ce1a0 con 0x7f1140161830 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.872+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11400ce3e0 con 0x7f1140161830 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.872+0000 7f11277fe640 1 -- 172.21.15.79:0/410723920 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1134047460 con 0x7f1140161830 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.872+0000 7f11277fe640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f112c06be30 0x7f112c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.872+0000 7f11277fe640 1 -- 172.21.15.79:0/410723920 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7f11340abd30 con 0x7f1140161830 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.873+0000 7f113ed9d640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f112c06be30 0x7f112c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:11.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.873+0000 7f113ed9d640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f112c06be30 0x7f112c06e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f113000a9d0 tx=0x7f1130008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:11.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:11.877+0000 7f11277fe640 1 -- 172.21.15.79:0/410723920 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f11400ce3e0 con 0x7f1140161830 2024-06-10T00:24:12.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.091+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1140068430 con 0x7f1140161830 2024-06-10T00:24:12.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.091+0000 7f11277fe640 1 -- 172.21.15.79:0/410723920 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5176 (secure 0 0 0) 0x7f1134045360 con 0x7f1140161830 2024-06-10T00:24:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:12.093 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3523408596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3523408596},{"type":"v1","addr":"172.21.15.79:6837","nonce":3523408596}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:24:10.936551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-06-10T00:24:12.093 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 76 2024-06-10T00:24:12.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f112c06be30 msgr2=0x7f112c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f112c06be30 0x7f112c06e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f113000a9d0 tx=0x7f1130008040 comp rx=0 tx=0).stop 2024-06-10T00:24:12.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161830 msgr2=0x7f114015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161830 0x7f114015d3a0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f1134000c00 tx=0x7f11340046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 shutdown_connections 2024-06-10T00:24:12.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f112c06be30 0x7f112c06e2f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1140161c10 0x7f114015d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1140161830 0x7f114015d3a0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 --2- 172.21.15.79:0/410723920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400d0a00 0x7f11401f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.093+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 >> 172.21.15.79:0/410723920 conn(0x7f114009d3e0 msgr2=0x7f114015ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:12.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.094+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 shutdown_connections 2024-06-10T00:24:12.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.094+0000 7f114506b640 1 -- 172.21.15.79:0/410723920 wait complete. 2024-06-10T00:24:12.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:24:12.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.204+0000 7faf0a5ee640 1 Processor -- start 2024-06-10T00:24:12.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.204+0000 7faf0a5ee640 1 -- start start 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf0a5ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf0a5ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf040b3650 0x7faf0406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf0a5ee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faf040cd710 0x7faf0406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf0a5ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7faf0415e7d0 con 0x7faf040b3650 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf0a5ee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faf0406f400 con 0x7faf040cd710 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf0a5ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf0406eb60 con 0x7faf0415e3f0 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf037fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf040b3650 0x7faf0406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf037fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf040b3650 0x7faf0406c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49582/0 (socket says 172.21.15.79:49582) 2024-06-10T00:24:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf037fe640 1 -- 172.21.15.79:0/1649655385 learned_addr learned my addr 172.21.15.79:0/1649655385 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf03fff640 1 --2- 172.21.15.79:0/1649655385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf08b8b640 1 --2- 172.21.15.79:0/1649655385 >> v2:172.21.15.117:3300/0 conn(0x7faf040cd710 0x7faf0406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf037fe640 1 -- 172.21.15.79:0/1649655385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 msgr2=0x7faf040cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf037fe640 1 --2- 172.21.15.79:0/1649655385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf037fe640 1 -- 172.21.15.79:0/1649655385 >> v2:172.21.15.117:3300/0 conn(0x7faf040cd710 msgr2=0x7faf0406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf037fe640 1 --2- 172.21.15.79:0/1649655385 >> v2:172.21.15.117:3300/0 conn(0x7faf040cd710 0x7faf0406c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf037fe640 1 -- 172.21.15.79:0/1649655385 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0406ee40 con 0x7faf040b3650 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.205+0000 7faf08b8b640 1 --2- 172.21.15.79:0/1649655385 >> v2:172.21.15.117:3300/0 conn(0x7faf040cd710 0x7faf0406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf037fe640 1 --2- 172.21.15.79:0/1649655385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040b3650 0x7faf0406c3d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7faf0415faa0 tx=0x7faef802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8064de9cbb14bdfb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf02ffd640 1 -- 172.21.15.79:0/1649655385 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8037070 con 0x7faf040b3650 2024-06-10T00:24:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf02ffd640 1 -- 172.21.15.79:0/1649655385 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef8032440 con 0x7faf040b3650 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf02ffd640 1 -- 172.21.15.79:0/1649655385 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8032810 con 0x7faf040b3650 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf0a5ee640 1 -- 172.21.15.79:0/1649655385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040b3650 msgr2=0x7faf0406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/1649655385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040b3650 0x7faf0406c3d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7faf0415faa0 tx=0x7faef802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf0a5ee640 1 -- 172.21.15.79:0/1649655385 shutdown_connections 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/1649655385 >> v2:172.21.15.117:3300/0 conn(0x7faf040cd710 0x7faf0406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/1649655385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040b3650 0x7faf0406c3d0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/1649655385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.206+0000 7faf0a5ee640 1 -- 172.21.15.79:0/1649655385 >> 172.21.15.79:0/1649655385 conn(0x7faf04071950 msgr2=0x7faf04071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.207+0000 7faf0a5ee640 1 -- 172.21.15.79:0/1649655385 shutdown_connections 2024-06-10T00:24:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.207+0000 7faf0a5ee640 1 -- 172.21.15.79:0/1649655385 wait complete. 2024-06-10T00:24:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.208+0000 7faf0a5ee640 1 Processor -- start 2024-06-10T00:24:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.208+0000 7faf0a5ee640 1 -- start start 2024-06-10T00:24:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf0a5ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b3650 0x7faf04154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf0a5ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040cd710 0x7faf040ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf0a5ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf0a5ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faf040afc50 con 0x7faf040cd710 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf0a5ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf040cf020 con 0x7faf040b3650 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf0a5ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf040afdd0 con 0x7faf0415e3f0 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040cd710 0x7faf040ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040cd710 0x7faf040ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49586/0 (socket says 172.21.15.79:49586) 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 -- 172.21.15.79:0/3064202799 learned_addr learned my addr 172.21.15.79:0/3064202799 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf03fff640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b3650 0x7faf04154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf08b8b640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 -- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 msgr2=0x7faf040b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 -- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b3650 msgr2=0x7faf04154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b3650 0x7faf04154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 -- 172.21.15.79:0/3064202799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf040ae870 con 0x7faf040cd710 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf03fff640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b3650 0x7faf04154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf08b8b640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf037fe640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040cd710 0x7faf040ad880 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7faef8000c00 tx=0x7faef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf00ff9640 1 -- 172.21.15.79:0/3064202799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8041070 con 0x7faf040cd710 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf00ff9640 1 -- 172.21.15.79:0/3064202799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef803c870 con 0x7faf040cd710 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf040adfd0 con 0x7faf040cd710 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf00ff9640 1 -- 172.21.15.79:0/3064202799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8037040 con 0x7faf040cd710 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.209+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf040ae590 con 0x7faf040cd710 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.210+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf04068ad0 con 0x7faf040cd710 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.211+0000 7faf00ff9640 1 -- 172.21.15.79:0/3064202799 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faef8044070 con 0x7faf040cd710 2024-06-10T00:24:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.211+0000 7faf00ff9640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faef006be30 0x7faef006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.211+0000 7faf00ff9640 1 -- 172.21.15.79:0/3064202799 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7faef80abd90 con 0x7faf040cd710 2024-06-10T00:24:12.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.211+0000 7faf03fff640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faef006be30 0x7faef006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.212+0000 7faf03fff640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faef006be30 0x7faef006e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faef4006fd0 tx=0x7faef4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.215+0000 7faf00ff9640 1 -- 172.21.15.79:0/3064202799 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faf04068ad0 con 0x7faf040cd710 2024-06-10T00:24:12.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.387+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf04072830 con 0x7faf040cd710 2024-06-10T00:24:12.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.389+0000 7faf00ff9640 1 -- 172.21.15.79:0/3064202799 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+17234 (secure 0 0 0) 0x7faef807a5d0 con 0x7faf040cd710 2024-06-10T00:24:12.389 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:12.389 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":108,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:24:10.936312+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:22:39.425117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-06-10T00:22:39.768572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.6","mappings":[{"from":6,"to":7}]},{"pgid":"16.1e","mappings":[{"from":5,"to":4}]},{"pgid":"16.3a","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/4878507":"2024-06-11T00:24:10.936290+0000","172.21.15.79:6835/4878507":"2024-06-11T00:24:10.936290+0000","172.21.15.79:6837/2980295924":"2024-06-11T00:23:34.609954+0000","172.21.15.79:6835/2980295924":"2024-06-11T00:23:34.609954+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faef006be30 msgr2=0x7faef006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faef006be30 0x7faef006e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faef4006fd0 tx=0x7faef4008040 comp rx=0 tx=0).stop 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040cd710 msgr2=0x7faf040ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040cd710 0x7faf040ad880 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7faef8000c00 tx=0x7faef80046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 shutdown_connections 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7faef006be30 0x7faef006e2f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0415e3f0 0x7faf040b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf040cd710 0x7faf040ad880 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 --2- 172.21.15.79:0/3064202799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b3650 0x7faf04154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 >> 172.21.15.79:0/3064202799 conn(0x7faf04071950 msgr2=0x7faf040b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 shutdown_connections 2024-06-10T00:24:12.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.391+0000 7faf0a5ee640 1 -- 172.21.15.79:0/3064202799 wait complete. 2024-06-10T00:24:12.403 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:24:12.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.501+0000 7f5033aae640 1 Processor -- start 2024-06-10T00:24:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.502+0000 7f5033aae640 1 -- start start 2024-06-10T00:24:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.502+0000 7f5033aae640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f502c15f1a0 0x7f502c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.502+0000 7f5033aae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f502c0cef70 0x7f502c0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.502+0000 7f5033aae640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c15f5e0 con 0x7f502c0d2680 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.502+0000 7f5033aae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f502c0d13e0 con 0x7f502c0cef70 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.502+0000 7f5033aae640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f502c0d0ad0 con 0x7f502c15f1a0 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.503+0000 7f503204b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f502c0cef70 0x7f502c0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.503+0000 7f503204b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f502c0cef70 0x7f502c0cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49602/0 (socket says 172.21.15.79:49602) 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.503+0000 7f503204b640 1 -- 172.21.15.79:0/3970617737 learned_addr learned my addr 172.21.15.79:0/3970617737 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.503+0000 7f5031049640 1 --2- 172.21.15.79:0/3970617737 >> v2:172.21.15.117:3300/0 conn(0x7f502c15f1a0 0x7f502c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.503+0000 7f503204b640 1 -- 172.21.15.79:0/3970617737 >> v2:172.21.15.117:3300/0 conn(0x7f502c15f1a0 msgr2=0x7f502c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.503+0000 7f503204b640 1 --2- 172.21.15.79:0/3970617737 >> v2:172.21.15.117:3300/0 conn(0x7f502c15f1a0 0x7f502c0d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.503+0000 7f503204b640 1 -- 172.21.15.79:0/3970617737 >> v1:172.21.15.117:6789/0 conn(0x7f502c0d2680 legacy=0x7f502c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.503+0000 7f503204b640 1 -- 172.21.15.79:0/3970617737 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c15f890 con 0x7f502c0cef70 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f503204b640 1 --2- 172.21.15.79:0/3970617737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c0cf3c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f502c0d1560 tx=0x7f501c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76197000a7aca4ad server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5030848640 1 -- 172.21.15.79:0/3970617737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c036070 con 0x7f502c0cef70 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5030848640 1 -- 172.21.15.79:0/3970617737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c031600 con 0x7f502c0cef70 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5030848640 1 -- 172.21.15.79:0/3970617737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c0319d0 con 0x7f502c0cef70 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5033aae640 1 -- 172.21.15.79:0/3970617737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 msgr2=0x7f502c0cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5033aae640 1 --2- 172.21.15.79:0/3970617737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c0cf3c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f502c0d1560 tx=0x7f501c02a730 comp rx=0 tx=0).stop 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5033aae640 1 -- 172.21.15.79:0/3970617737 shutdown_connections 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5033aae640 1 --2- 172.21.15.79:0/3970617737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c0cf3c0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5033aae640 1 --2- 172.21.15.79:0/3970617737 >> v2:172.21.15.117:3300/0 conn(0x7f502c15f1a0 0x7f502c0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5033aae640 1 -- 172.21.15.79:0/3970617737 >> 172.21.15.79:0/3970617737 conn(0x7f502c09d3f0 msgr2=0x7f502c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5033aae640 1 -- 172.21.15.79:0/3970617737 shutdown_connections 2024-06-10T00:24:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.504+0000 7f5033aae640 1 -- 172.21.15.79:0/3970617737 wait complete. 2024-06-10T00:24:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f5033aae640 1 Processor -- start 2024-06-10T00:24:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f5033aae640 1 -- start start 2024-06-10T00:24:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f5033aae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f5033aae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c0d2680 0x7f502c15cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f5033aae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15f1a0 0x7f502c14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f5033aae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f502c0d4f00 con 0x7f502c0cef70 2024-06-10T00:24:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f5033aae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f502c0d1070 con 0x7f502c15f1a0 2024-06-10T00:24:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f5033aae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f502c0d1870 con 0x7f502c0d2680 2024-06-10T00:24:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f503184a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.506+0000 7f503184a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c15c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49616/0 (socket says 172.21.15.79:49616) 2024-06-10T00:24:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f503184a640 1 -- 172.21.15.79:0/884623336 learned_addr learned my addr 172.21.15.79:0/884623336 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f5031049640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c0d2680 0x7f502c15cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f503204b640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15f1a0 0x7f502c14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f503184a640 1 -- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c0d2680 msgr2=0x7f502c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f503184a640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c0d2680 0x7f502c15cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f503184a640 1 -- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15f1a0 msgr2=0x7f502c14e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f503184a640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15f1a0 0x7f502c14e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f503184a640 1 -- 172.21.15.79:0/884623336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c14c0e0 con 0x7f502c0cef70 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f5031049640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c0d2680 0x7f502c15cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f503184a640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c15c840 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f502400c400 tx=0x7f502400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f502a7fc640 1 -- 172.21.15.79:0/884623336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240052d0 con 0x7f502c0cef70 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f502a7fc640 1 -- 172.21.15.79:0/884623336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5024005490 con 0x7f502c0cef70 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c15d710 con 0x7f502c0cef70 2024-06-10T00:24:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f502a7fc640 1 -- 172.21.15.79:0/884623336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024007260 con 0x7f502c0cef70 2024-06-10T00:24:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.507+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c15dcd0 con 0x7f502c0cef70 2024-06-10T00:24:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.508+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502c068430 con 0x7f502c0cef70 2024-06-10T00:24:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.508+0000 7f502a7fc640 1 -- 172.21.15.79:0/884623336 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5024007400 con 0x7f502c0cef70 2024-06-10T00:24:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.509+0000 7f502a7fc640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501806be60 0x7f501806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.509+0000 7f502a7fc640 1 -- 172.21.15.79:0/884623336 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7f502408a5a0 con 0x7f502c0cef70 2024-06-10T00:24:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.509+0000 7f5031049640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501806be60 0x7f501806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.509+0000 7f5031049640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501806be60 0x7f501806e320 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f502c15ad20 tx=0x7f5020008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.513+0000 7f502a7fc640 1 -- 172.21.15.79:0/884623336 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5024058d50 con 0x7f502c0cef70 2024-06-10T00:24:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.723+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f502c0d41a0 con 0x7f502c0cef70 2024-06-10T00:24:12.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.723+0000 7f502a7fc640 1 -- 172.21.15.79:0/884623336 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5176 (secure 0 0 0) 0x7f5024058650 con 0x7f502c0cef70 2024-06-10T00:24:12.724 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:12.724 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3523408596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3523408596},{"type":"v1","addr":"172.21.15.79:6837","nonce":3523408596}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:24:10.936551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-06-10T00:24:12.724 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 76 2024-06-10T00:24:12.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501806be60 msgr2=0x7f501806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501806be60 0x7f501806e320 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f502c15ad20 tx=0x7f5020008040 comp rx=0 tx=0).stop 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 msgr2=0x7f502c15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c15c840 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f502400c400 tx=0x7f502400c8c0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 shutdown_connections 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f501806be60 0x7f501806e320 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15f1a0 0x7f502c14e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c0d2680 0x7f502c15cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 --2- 172.21.15.79:0/884623336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c0cef70 0x7f502c15c840 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.725+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 >> 172.21.15.79:0/884623336 conn(0x7f502c09d3f0 msgr2=0x7f502c0cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.726+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 shutdown_connections 2024-06-10T00:24:12.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.726+0000 7f5033aae640 1 -- 172.21.15.79:0/884623336 wait complete. 2024-06-10T00:24:12.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.837+0000 7fa35ba83640 1 Processor -- start 2024-06-10T00:24:12.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.837+0000 7fa35ba83640 1 -- start start 2024-06-10T00:24:12.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35ba83640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa354072370 0x7fa354166c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35ba83640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa354072820 con 0x7fa3540b46d0 2024-06-10T00:24:12.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35ba83640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa354072b00 con 0x7fa3540cc6d0 2024-06-10T00:24:12.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35ba83640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa354072de0 con 0x7fa354072370 2024-06-10T00:24:12.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35901e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa3540b46d0 0x7fa354071c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39756/0 (socket says 172.21.15.79:39756) 2024-06-10T00:24:12.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35901e640 1 -- 172.21.15.79:0/189278561 learned_addr learned my addr 172.21.15.79:0/189278561 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353523053 0 0) 0x7fa354072820 con 0x7fa3540b46d0 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa340003520 con 0x7fa3540b46d0 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35a020640 1 --2- 172.21.15.79:0/189278561 >> v2:172.21.15.117:3300/0 conn(0x7fa354072370 0x7fa354166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 519978834 0 0) 0x7fa340003520 con 0x7fa3540b46d0 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 >> v2:172.21.15.117:3300/0 conn(0x7fa354072370 msgr2=0x7fa354166c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 --2- 172.21.15.79:0/189278561 >> v2:172.21.15.117:3300/0 conn(0x7fa354072370 0x7fa354166c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 >> v1:172.21.15.117:6789/0 conn(0x7fa3540cc6d0 legacy=0x7fa3540ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3540b31a0 con 0x7fa3540b46d0 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fa350001670 con 0x7fa3540b46d0 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35a020640 1 --2- 172.21.15.79:0/189278561 >> v2:172.21.15.117:3300/0 conn(0x7fa354072370 0x7fa354166c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 >> v1:172.21.15.79:6789/0 conn(0x7fa3540b46d0 legacy=0x7fa354071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3400039b0 0x7fa340003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa340004800 0x7fa340004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa34000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa354072de0 con 0x7fa3400051c0 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa34000c110 con 0x7fa340004800 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa34000c310 con 0x7fa3400039b0 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.838+0000 7fa35a020640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa34000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35901e640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa340004800 0x7fa340004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35981f640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3400039b0 0x7fa340003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35a020640 1 -- 172.21.15.79:0/189278561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3400039b0 msgr2=0x7fa340003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35a020640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3400039b0 0x7fa340003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35a020640 1 -- 172.21.15.79:0/189278561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa340004800 msgr2=0x7fa340004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35a020640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa340004800 0x7fa340004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35a020640 1 -- 172.21.15.79:0/189278561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa340003520 con 0x7fa3400051c0 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35a020640 1 -- 172.21.15.79:0/189278561 reap_dead start 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35a020640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa34000b9c0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0073b0 tx=0x7fa340005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b692cc4f64fe85f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.839+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c009c80 con 0x7fa3400051c0 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34c003b90 con 0x7fa3400051c0 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35881d640 1 -- 172.21.15.79:0/189278561 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c004020 con 0x7fa3400051c0 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35ba83640 1 -- 172.21.15.79:0/189278561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 msgr2=0x7fa34000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35ba83640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa34000b9c0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0073b0 tx=0x7fa340005830 comp rx=0 tx=0).stop 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35ba83640 1 -- 172.21.15.79:0/189278561 shutdown_connections 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35ba83640 1 --2- 172.21.15.79:0/189278561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa34000b9c0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35ba83640 1 -- 172.21.15.79:0/189278561 >> 172.21.15.79:0/189278561 conn(0x7fa3540b19f0 msgr2=0x7fa3540b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35ba83640 1 -- 172.21.15.79:0/189278561 shutdown_connections 2024-06-10T00:24:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.840+0000 7fa35ba83640 1 -- 172.21.15.79:0/189278561 wait complete. 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.841+0000 7fa35ba83640 1 Processor -- start 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.841+0000 7fa35ba83640 1 -- start start 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35ba83640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa3541f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35ba83640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35406e540 0x7fa3540ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35ba83640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3540ce920 0x7fa35409bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35ba83640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa354071c60 con 0x7fa3400051c0 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35ba83640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa354159f60 con 0x7fa3540ce920 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35ba83640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa354071de0 con 0x7fa35406e540 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35981f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa3541f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35981f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa3541f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49632/0 (socket says 172.21.15.79:49632) 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35981f640 1 -- 172.21.15.79:0/576748295 learned_addr learned my addr 172.21.15.79:0/576748295 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35901e640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35406e540 0x7fa3540ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35a020640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3540ce920 0x7fa35409bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35981f640 1 -- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35406e540 msgr2=0x7fa3540ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35981f640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35406e540 0x7fa3540ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35981f640 1 -- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3540ce920 msgr2=0x7fa35409bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35981f640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3540ce920 0x7fa35409bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35981f640 1 -- 172.21.15.79:0/576748295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3541f44a0 con 0x7fa3400051c0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.842+0000 7fa35a020640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3540ce920 0x7fa35409bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.843+0000 7fa35981f640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa3541f3be0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa34800f5f0 tx=0x7fa34800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.843+0000 7fa3467fc640 1 -- 172.21.15.79:0/576748295 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3480052e0 con 0x7fa3400051c0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.843+0000 7fa3467fc640 1 -- 172.21.15.79:0/576748295 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa348018070 con 0x7fa3400051c0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.843+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3541f4780 con 0x7fa3400051c0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.843+0000 7fa3467fc640 1 -- 172.21.15.79:0/576748295 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348003810 con 0x7fa3400051c0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.843+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3540cdec0 con 0x7fa3400051c0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.844+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa354068430 con 0x7fa3400051c0 2024-06-10T00:24:12.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.844+0000 7fa3467fc640 1 -- 172.21.15.79:0/576748295 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3480039b0 con 0x7fa3400051c0 2024-06-10T00:24:12.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.845+0000 7fa3467fc640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa33806be30 0x7fa33806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:12.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.845+0000 7fa3467fc640 1 -- 172.21.15.79:0/576748295 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7fa34808ad00 con 0x7fa3400051c0 2024-06-10T00:24:12.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.845+0000 7fa35901e640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa33806be30 0x7fa33806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:12.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.845+0000 7fa35901e640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa33806be30 0x7fa33806e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa35406da50 tx=0x7fa350001c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:12.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:12.849+0000 7fa3467fc640 1 -- 172.21.15.79:0/576748295 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa3480594b0 con 0x7fa3400051c0 2024-06-10T00:24:13.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.059+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3540cc450 con 0x7fa3400051c0 2024-06-10T00:24:13.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.060+0000 7fa3467fc640 1 -- 172.21.15.79:0/576748295 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5176 (secure 0 0 0) 0x7fa348058db0 con 0x7fa3400051c0 2024-06-10T00:24:13.061 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:13.061 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3523408596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3523408596},{"type":"v1","addr":"172.21.15.79:6837","nonce":3523408596}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:22:40.800117+0000","modified":"2024-06-10T00:24:10.936551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-06-10T00:24:13.061 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 76 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa33806be30 msgr2=0x7fa33806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa33806be30 0x7fa33806e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa35406da50 tx=0x7fa350001c60 comp rx=0 tx=0).stop 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 msgr2=0x7fa3541f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa3541f3be0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa34800f5f0 tx=0x7fa34800fab0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 shutdown_connections 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa33806be30 0x7fa33806e2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3540ce920 0x7fa35409bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa35406e540 0x7fa3540ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 --2- 172.21.15.79:0/576748295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3400051c0 0x7fa3541f3be0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 >> 172.21.15.79:0/576748295 conn(0x7fa3540b19f0 msgr2=0x7fa35415eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 shutdown_connections 2024-06-10T00:24:13.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.062+0000 7fa35ba83640 1 -- 172.21.15.79:0/576748295 wait complete. 2024-06-10T00:24:13.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:24:13.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.172+0000 7f9761cda640 1 Processor -- start 2024-06-10T00:24:13.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.172+0000 7f9761cda640 1 -- start start 2024-06-10T00:24:13.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f9761cda640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c0cc6d0 0x7f975c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f9761cda640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f975c0720e0 0x7f975c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f9761cda640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975c0ccff0 con 0x7f975c071c60 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f9761cda640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f975c072550 con 0x7f975c0720e0 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f9761cda640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f975c072820 con 0x7f975c0cc6d0 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f975bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f975c0720e0 0x7f975c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f975bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f975c0720e0 0x7f975c0b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49642/0 (socket says 172.21.15.79:49642) 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f975bfff640 1 -- 172.21.15.79:0/703198400 learned_addr learned my addr 172.21.15.79:0/703198400 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f975b7fe640 1 --2- 172.21.15.79:0/703198400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c0cc6d0 0x7f975c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f975bfff640 1 -- 172.21.15.79:0/703198400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c0cc6d0 msgr2=0x7f975c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f975bfff640 1 --2- 172.21.15.79:0/703198400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c0cc6d0 0x7f975c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f975bfff640 1 -- 172.21.15.79:0/703198400 >> v1:172.21.15.117:6789/0 conn(0x7f975c071c60 legacy=0x7f975c0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.173+0000 7f975bfff640 1 -- 172.21.15.79:0/703198400 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c072b00 con 0x7f975c0720e0 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.174+0000 7f975bfff640 1 --2- 172.21.15.79:0/703198400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0720e0 0x7f975c0b3dd0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f9754009e50 tx=0x7f975402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1171b78a3bcb4115 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.174+0000 7f975a7fc640 1 -- 172.21.15.79:0/703198400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754036070 con 0x7f975c0720e0 2024-06-10T00:24:13.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.174+0000 7f975a7fc640 1 -- 172.21.15.79:0/703198400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9754031600 con 0x7f975c0720e0 2024-06-10T00:24:13.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.174+0000 7f975a7fc640 1 -- 172.21.15.79:0/703198400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97540319d0 con 0x7f975c0720e0 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.175+0000 7f9761cda640 1 -- 172.21.15.79:0/703198400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0720e0 msgr2=0x7f975c0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.175+0000 7f9761cda640 1 --2- 172.21.15.79:0/703198400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0720e0 0x7f975c0b3dd0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f9754009e50 tx=0x7f975402a6c0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.175+0000 7f9761cda640 1 -- 172.21.15.79:0/703198400 shutdown_connections 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.175+0000 7f9761cda640 1 --2- 172.21.15.79:0/703198400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0720e0 0x7f975c0b3dd0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.175+0000 7f9761cda640 1 --2- 172.21.15.79:0/703198400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c0cc6d0 0x7f975c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.175+0000 7f9761cda640 1 -- 172.21.15.79:0/703198400 >> 172.21.15.79:0/703198400 conn(0x7f975c0b19f0 msgr2=0x7f975c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.175+0000 7f9761cda640 1 -- 172.21.15.79:0/703198400 shutdown_connections 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.175+0000 7f9761cda640 1 -- 172.21.15.79:0/703198400 wait complete. 2024-06-10T00:24:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.176+0000 7f9761cda640 1 Processor -- start 2024-06-10T00:24:13.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.176+0000 7f9761cda640 1 -- start start 2024-06-10T00:24:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f9761cda640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c071c60 0x7f975c155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f9761cda640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c0720e0 0x7f975c158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f9761cda640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0cc6d0 0x7f975c159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f9761cda640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f975c15c890 con 0x7f975c0cc6d0 2024-06-10T00:24:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f9761cda640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f975c0b31a0 con 0x7f975c0720e0 2024-06-10T00:24:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f9761cda640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f975c159f60 con 0x7f975c071c60 2024-06-10T00:24:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0cc6d0 0x7f975c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0cc6d0 0x7f975c159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49644/0 (socket says 172.21.15.79:49644) 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 -- 172.21.15.79:0/2239779562 learned_addr learned my addr 172.21.15.79:0/2239779562 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975b7fe640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c071c60 0x7f975c155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975affd640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c0720e0 0x7f975c158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 -- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c071c60 msgr2=0x7f975c155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c071c60 0x7f975c155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 -- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c0720e0 msgr2=0x7f975c158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c0720e0 0x7f975c158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 -- 172.21.15.79:0/2239779562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c1f1f90 con 0x7f975c0cc6d0 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975affd640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c0720e0 0x7f975c158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.177+0000 7f975bfff640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0cc6d0 0x7f975c159200 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f9754009e50 tx=0x7f9754004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.178+0000 7f9743fff640 1 -- 172.21.15.79:0/2239779562 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754036050 con 0x7f975c0cc6d0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.178+0000 7f9743fff640 1 -- 172.21.15.79:0/2239779562 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9754042070 con 0x7f975c0cc6d0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.178+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c1f2270 con 0x7f975c0cc6d0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.178+0000 7f9743fff640 1 -- 172.21.15.79:0/2239779562 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754009510 con 0x7f975c0cc6d0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.178+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c1f2830 con 0x7f975c0cc6d0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.179+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c068430 con 0x7f975c0cc6d0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.179+0000 7f9743fff640 1 -- 172.21.15.79:0/2239779562 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9754007bd0 con 0x7f975c0cc6d0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.179+0000 7f9743fff640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f974806be30 0x7f974806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.180+0000 7f9743fff640 1 -- 172.21.15.79:0/2239779562 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7f97540abf60 con 0x7f975c0cc6d0 2024-06-10T00:24:13.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.180+0000 7f975b7fe640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f974806be30 0x7f974806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.180+0000 7f975b7fe640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f974806be30 0x7f974806e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f974c006fd0 tx=0x7f974c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:13.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.184+0000 7f9743fff640 1 -- 172.21.15.79:0/2239779562 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f975407a680 con 0x7f975c0cc6d0 2024-06-10T00:24:13.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.361+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f975c074a40 con 0x7f975c0cc6d0 2024-06-10T00:24:13.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.362+0000 7f9743fff640 1 -- 172.21.15.79:0/2239779562 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+17234 (secure 0 0 0) 0x7f9754079f80 con 0x7f975c0cc6d0 2024-06-10T00:24:13.363 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:13.363 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":108,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:24:10.936312+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:22:39.425117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-06-10T00:22:39.768572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.6","mappings":[{"from":6,"to":7}]},{"pgid":"16.1e","mappings":[{"from":5,"to":4}]},{"pgid":"16.3a","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/4878507":"2024-06-11T00:24:10.936290+0000","172.21.15.79:6835/4878507":"2024-06-11T00:24:10.936290+0000","172.21.15.79:6837/2980295924":"2024-06-11T00:23:34.609954+0000","172.21.15.79:6835/2980295924":"2024-06-11T00:23:34.609954+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:24:13.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f974806be30 msgr2=0x7f974806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f974806be30 0x7f974806e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f974c006fd0 tx=0x7f974c008040 comp rx=0 tx=0).stop 2024-06-10T00:24:13.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0cc6d0 msgr2=0x7f975c159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0cc6d0 0x7f975c159200 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f9754009e50 tx=0x7f9754004a40 comp rx=0 tx=0).stop 2024-06-10T00:24:13.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 shutdown_connections 2024-06-10T00:24:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f974806be30 0x7f974806e2f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f975c0cc6d0 0x7f975c159200 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c0720e0 0x7f975c158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 --2- 172.21.15.79:0/2239779562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f975c071c60 0x7f975c155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.364+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 >> 172.21.15.79:0/2239779562 conn(0x7f975c0b19f0 msgr2=0x7f975c0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.365+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 shutdown_connections 2024-06-10T00:24:13.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.365+0000 7f9761cda640 1 -- 172.21.15.79:0/2239779562 wait complete. 2024-06-10T00:24:13.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:24:13.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.477+0000 7f4187977640 1 Processor -- start 2024-06-10T00:24:13.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.477+0000 7f4187977640 1 -- start start 2024-06-10T00:24:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4187977640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41800cd230 0x7f41800b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4187977640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41800cec50 0x7f41800cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4187977640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41800b3420 con 0x7f41801553c0 2024-06-10T00:24:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4187977640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f41800cc750 con 0x7f41800cd230 2024-06-10T00:24:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4187977640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f41800cca30 con 0x7f41800cec50 2024-06-10T00:24:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4184f12640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41800cd230 0x7f41800b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4185713640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f41801553c0 0x7f418015beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39758/0 (socket says 172.21.15.79:39758) 2024-06-10T00:24:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4185713640 1 -- 172.21.15.79:0/2474893792 learned_addr learned my addr 172.21.15.79:0/2474893792 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4185f14640 1 --2- 172.21.15.79:0/2474893792 >> v2:172.21.15.117:3300/0 conn(0x7f41800cec50 0x7f41800cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4184f12640 1 -- 172.21.15.79:0/2474893792 >> v2:172.21.15.117:3300/0 conn(0x7f41800cec50 msgr2=0x7f41800cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4184f12640 1 --2- 172.21.15.79:0/2474893792 >> v2:172.21.15.117:3300/0 conn(0x7f41800cec50 0x7f41800cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4184f12640 1 -- 172.21.15.79:0/2474893792 >> v1:172.21.15.79:6789/0 conn(0x7f41801553c0 legacy=0x7f418015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4184f12640 1 -- 172.21.15.79:0/2474893792 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41800ccd10 con 0x7f41800cd230 2024-06-10T00:24:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.478+0000 7f4177fff640 1 -- 172.21.15.79:0/2474893792 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206929746 0 0) 0x7f41800b3420 con 0x7f41801553c0 2024-06-10T00:24:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.479+0000 7f4184f12640 1 --2- 172.21.15.79:0/2474893792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f41800b2cf0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f41800b41f0 tx=0x7f417002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df251cd47e7e884e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.479+0000 7f4177fff640 1 -- 172.21.15.79:0/2474893792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170037070 con 0x7f41800cd230 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.479+0000 7f4177fff640 1 -- 172.21.15.79:0/2474893792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4170032440 con 0x7f41800cd230 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.479+0000 7f4177fff640 1 -- 172.21.15.79:0/2474893792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170032810 con 0x7f41800cd230 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.480+0000 7f4187977640 1 -- 172.21.15.79:0/2474893792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 msgr2=0x7f41800b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.480+0000 7f4187977640 1 --2- 172.21.15.79:0/2474893792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f41800b2cf0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f41800b41f0 tx=0x7f417002a1a0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.480+0000 7f4187977640 1 -- 172.21.15.79:0/2474893792 shutdown_connections 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.480+0000 7f4187977640 1 --2- 172.21.15.79:0/2474893792 >> v2:172.21.15.117:3300/0 conn(0x7f41800cec50 0x7f41800cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.480+0000 7f4187977640 1 --2- 172.21.15.79:0/2474893792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f41800b2cf0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.480+0000 7f4187977640 1 -- 172.21.15.79:0/2474893792 >> 172.21.15.79:0/2474893792 conn(0x7f41800b19f0 msgr2=0x7f41800b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.480+0000 7f4187977640 1 -- 172.21.15.79:0/2474893792 shutdown_connections 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.480+0000 7f4187977640 1 -- 172.21.15.79:0/2474893792 wait complete. 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.481+0000 7f4187977640 1 Processor -- start 2024-06-10T00:24:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.481+0000 7f4187977640 1 -- start start 2024-06-10T00:24:13.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4187977640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f418009d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4187977640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800cec50 0x7f418009c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4187977640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41801553c0 0x7f418015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4187977640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4180155920 con 0x7f41800cd230 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4187977640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41801557a0 con 0x7f41800cec50 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4187977640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4180071030 con 0x7f41801553c0 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f418009d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f418009d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49660/0 (socket says 172.21.15.79:49660) 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 -- 172.21.15.79:0/3273136674 learned_addr learned my addr 172.21.15.79:0/3273136674 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 -- 172.21.15.79:0/3273136674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41801553c0 msgr2=0x7f418015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41801553c0 0x7f418015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 -- 172.21.15.79:0/3273136674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800cec50 msgr2=0x7f418009c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800cec50 0x7f418009c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 -- 172.21.15.79:0/3273136674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418009c610 con 0x7f41800cd230 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4185713640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f418009d760 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c430 tx=0x7f417c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4175ffb640 1 -- 172.21.15.79:0/3273136674 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0074e0 con 0x7f41800cd230 2024-06-10T00:24:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4175ffb640 1 -- 172.21.15.79:0/3273136674 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0047e0 con 0x7f41800cd230 2024-06-10T00:24:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418014fc00 con 0x7f41800cd230 2024-06-10T00:24:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.482+0000 7f4175ffb640 1 -- 172.21.15.79:0/3273136674 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c004bd0 con 0x7f41800cd230 2024-06-10T00:24:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.483+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41801501c0 con 0x7f41800cd230 2024-06-10T00:24:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.484+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4180068430 con 0x7f41800cd230 2024-06-10T00:24:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.484+0000 7f4175ffb640 1 -- 172.21.15.79:0/3273136674 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f417c011070 con 0x7f41800cd230 2024-06-10T00:24:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.484+0000 7f4175ffb640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f416406be30 0x7f416406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:13.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.484+0000 7f4175ffb640 1 -- 172.21.15.79:0/3273136674 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7f417c08adb0 con 0x7f41800cd230 2024-06-10T00:24:13.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.484+0000 7f4184f12640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f416406be30 0x7f416406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:13.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.485+0000 7f4184f12640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f416406be30 0x7f416406e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4170034000 tx=0x7f417002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:13.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.488+0000 7f4175ffb640 1 -- 172.21.15.79:0/3273136674 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f417c0594d0 con 0x7f41800cd230 2024-06-10T00:24:13.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:13.697+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f41800cd750 con 0x7f41800cd230 2024-06-10T00:24:14.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.691+0000 7f4175ffb640 1 -- 172.21.15.79:0/3273136674 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 161+0+0 (secure 0 0 0) 0x7f417c058dd0 con 0x7f41800cd230 2024-06-10T00:24:14.692 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:24:14.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f416406be30 msgr2=0x7f416406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:14.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f416406be30 0x7f416406e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4170034000 tx=0x7f417002c000 comp rx=0 tx=0).stop 2024-06-10T00:24:14.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 msgr2=0x7f418009d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f418009d760 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c430 tx=0x7f417c00c8f0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 shutdown_connections 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f416406be30 0x7f416406e2f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41801553c0 0x7f418015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800cec50 0x7f418009c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 --2- 172.21.15.79:0/3273136674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41800cd230 0x7f418009d760 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 >> 172.21.15.79:0/3273136674 conn(0x7f41800b19f0 msgr2=0x7f41800cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 shutdown_connections 2024-06-10T00:24:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.695+0000 7f4187977640 1 -- 172.21.15.79:0/3273136674 wait complete. 2024-06-10T00:24:14.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-10T00:24:14.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.815+0000 7fd517b77640 1 Processor -- start 2024-06-10T00:24:14.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.816+0000 7fd517b77640 1 -- start start 2024-06-10T00:24:14.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.816+0000 7fd517b77640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5100d08f0 0x7fd5100b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:14.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.816+0000 7fd517b77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100d0cd0 0x7fd5100cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.816+0000 7fd517b77640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5100cf620 con 0x7fd5100cf190 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.816+0000 7fd517b77640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd5100d1c80 con 0x7fd5100d08f0 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.816+0000 7fd517b77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5100cf8a0 con 0x7fd5100d0cd0 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd515913640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5100d08f0 0x7fd5100b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd516114640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd5100cf190 0x7fd5100d23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39764/0 (socket says 172.21.15.79:39764) 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd515913640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5100d08f0 0x7fd5100b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49672/0 (socket says 172.21.15.79:49672) 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd516114640 1 -- 172.21.15.79:0/1609104649 learned_addr learned my addr 172.21.15.79:0/1609104649 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd515112640 1 --2- 172.21.15.79:0/1609104649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100d0cd0 0x7fd5100cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd515913640 1 -- 172.21.15.79:0/1609104649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100d0cd0 msgr2=0x7fd5100cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd515913640 1 --2- 172.21.15.79:0/1609104649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100d0cd0 0x7fd5100cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd515913640 1 -- 172.21.15.79:0/1609104649 >> v1:172.21.15.79:6789/0 conn(0x7fd5100cf190 legacy=0x7fd5100d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd515913640 1 -- 172.21.15.79:0/1609104649 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5100cfb80 con 0x7fd5100d08f0 2024-06-10T00:24:14.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd514911640 1 -- 172.21.15.79:0/1609104649 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3060244131 0 0) 0x7fd508001110 con 0x7fd5100cf190 2024-06-10T00:24:14.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.817+0000 7fd515112640 1 --2- 172.21.15.79:0/1609104649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100d0cd0 0x7fd5100cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd515913640 1 --2- 172.21.15.79:0/1609104649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100b3800 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fd500009d90 tx=0x7fd50002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c386d9ee8683637e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd514911640 1 -- 172.21.15.79:0/1609104649 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500007740 con 0x7fd5100d08f0 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd514911640 1 -- 172.21.15.79:0/1609104649 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5000078e0 con 0x7fd5100d08f0 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd514911640 1 -- 172.21.15.79:0/1609104649 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500007cb0 con 0x7fd5100d08f0 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd517b77640 1 -- 172.21.15.79:0/1609104649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 msgr2=0x7fd5100b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd517b77640 1 --2- 172.21.15.79:0/1609104649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100b3800 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fd500009d90 tx=0x7fd50002a660 comp rx=0 tx=0).stop 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd517b77640 1 -- 172.21.15.79:0/1609104649 shutdown_connections 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd517b77640 1 --2- 172.21.15.79:0/1609104649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100d0cd0 0x7fd5100cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd517b77640 1 --2- 172.21.15.79:0/1609104649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100b3800 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd517b77640 1 -- 172.21.15.79:0/1609104649 >> 172.21.15.79:0/1609104649 conn(0x7fd51009d3c0 msgr2=0x7fd5100d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd517b77640 1 -- 172.21.15.79:0/1609104649 shutdown_connections 2024-06-10T00:24:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.818+0000 7fd517b77640 1 -- 172.21.15.79:0/1609104649 wait complete. 2024-06-10T00:24:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.819+0000 7fd517b77640 1 Processor -- start 2024-06-10T00:24:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd517b77640 1 -- start start 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd517b77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100cf190 0x7fd5100cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd517b77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd517b77640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d0cd0 0x7fd5100cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd517b77640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd5100b50c0 con 0x7fd5100d08f0 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd517b77640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5100d1ed0 con 0x7fd5100d0cd0 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd517b77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5100d1150 con 0x7fd5100cf190 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd515112640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd515112640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49684/0 (socket says 172.21.15.79:49684) 2024-06-10T00:24:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.820+0000 7fd515112640 1 -- 172.21.15.79:0/4199363836 learned_addr learned my addr 172.21.15.79:0/4199363836 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd515112640 1 -- 172.21.15.79:0/4199363836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100cf190 msgr2=0x7fd5100cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd515913640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100cf190 0x7fd5100cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd515112640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100cf190 0x7fd5100cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd515112640 1 -- 172.21.15.79:0/4199363836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d0cd0 msgr2=0x7fd5100cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd515112640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d0cd0 0x7fd5100cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd515112640 1 -- 172.21.15.79:0/4199363836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5100c8f20 con 0x7fd5100d08f0 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd515112640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100c9f90 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c7f0 tx=0x7fd50400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd50e7fc640 1 -- 172.21.15.79:0/4199363836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504015070 con 0x7fd5100d08f0 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd50e7fc640 1 -- 172.21.15.79:0/4199363836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd504007820 con 0x7fd5100d08f0 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5100cb180 con 0x7fd5100d08f0 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd50e7fc640 1 -- 172.21.15.79:0/4199363836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504007bd0 con 0x7fd5100d08f0 2024-06-10T00:24:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.821+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5100cba20 con 0x7fd5100d08f0 2024-06-10T00:24:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.822+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5100683c0 con 0x7fd5100d08f0 2024-06-10T00:24:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.822+0000 7fd50e7fc640 1 -- 172.21.15.79:0/4199363836 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd504018070 con 0x7fd5100d08f0 2024-06-10T00:24:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.823+0000 7fd50e7fc640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be60 0x7fd4fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.823+0000 7fd50e7fc640 1 -- 172.21.15.79:0/4199363836 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7fd50408b240 con 0x7fd5100d08f0 2024-06-10T00:24:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.823+0000 7fd515913640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be60 0x7fd4fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:14.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.823+0000 7fd515913640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be60 0x7fd4fc06e320 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd500034000 tx=0x7fd50002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:14.827+0000 7fd50e7fc640 1 -- 172.21.15.79:0/4199363836 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd5100c8f20 con 0x7fd5100d08f0 2024-06-10T00:24:15.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.046+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd51008e170 con 0x7fd5100d08f0 2024-06-10T00:24:15.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:24:15.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:24:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.696+0000 7fd50e7fc640 1 -- 172.21.15.79:0/4199363836 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) ==== 104+0+0 (secure 0 0 0) 0x7fd5040598d0 con 0x7fd5100d08f0 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be60 msgr2=0x7fd4fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be60 0x7fd4fc06e320 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd500034000 tx=0x7fd50002f000 comp rx=0 tx=0).stop 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 msgr2=0x7fd5100c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100c9f90 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c7f0 tx=0x7fd50400ccb0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 shutdown_connections 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd4fc06be60 0x7fd4fc06e320 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d0cd0 0x7fd5100cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5100d08f0 0x7fd5100c9f90 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 --2- 172.21.15.79:0/4199363836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5100cf190 0x7fd5100cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 >> 172.21.15.79:0/4199363836 conn(0x7fd51009d3c0 msgr2=0x7fd5100b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:15.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 shutdown_connections 2024-06-10T00:24:15.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.699+0000 7fd517b77640 1 -- 172.21.15.79:0/4199363836 wait complete. 2024-06-10T00:24:15.712 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-10T00:24:15.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.815+0000 7fb98bfce640 1 Processor -- start 2024-06-10T00:24:15.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.815+0000 7fb98bfce640 1 -- start start 2024-06-10T00:24:15.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.816+0000 7fb98bfce640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb98415be50 0x7fb984071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:15.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.816+0000 7fb98bfce640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb984072570 con 0x7fb9840ccd30 2024-06-10T00:24:15.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.816+0000 7fb98bfce640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb984072850 con 0x7fb9840720d0 2024-06-10T00:24:15.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.816+0000 7fb98bfce640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb9840b3020 con 0x7fb98415be50 2024-06-10T00:24:15.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.816+0000 7fb989d6a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb98415be50 0x7fb984071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:15.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.816+0000 7fb98a56b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb9840ccd30 0x7fb9840b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39766/0 (socket says 172.21.15.79:39766) 2024-06-10T00:24:15.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.816+0000 7fb98a56b640 1 -- 172.21.15.79:0/155514209 learned_addr learned my addr 172.21.15.79:0/155514209 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:15.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.817+0000 7fb989d6a640 1 -- 172.21.15.79:0/155514209 >> v1:172.21.15.117:6789/0 conn(0x7fb9840720d0 legacy=0x7fb9840cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:15.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.817+0000 7fb989d6a640 1 -- 172.21.15.79:0/155514209 >> v1:172.21.15.79:6789/0 conn(0x7fb9840ccd30 legacy=0x7fb9840b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:15.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.817+0000 7fb989d6a640 1 -- 172.21.15.79:0/155514209 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb984072b30 con 0x7fb98415be50 2024-06-10T00:24:15.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.817+0000 7fb988d68640 1 -- 172.21.15.79:0/155514209 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2411762370 0 0) 0x7fb984072570 con 0x7fb9840ccd30 2024-06-10T00:24:15.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.817+0000 7fb989d6a640 1 --2- 172.21.15.79:0/155514209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb98415be50 0x7fb984071b90 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb9800097a0 tx=0x7fb98002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3baa9bb78d2c83f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.817+0000 7fb988d68640 1 -- 172.21.15.79:0/155514209 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980037070 con 0x7fb98415be50 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.817+0000 7fb988d68640 1 -- 172.21.15.79:0/155514209 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb980032440 con 0x7fb98415be50 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.817+0000 7fb988d68640 1 -- 172.21.15.79:0/155514209 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980032810 con 0x7fb98415be50 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.818+0000 7fb98bfce640 1 -- 172.21.15.79:0/155514209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb98415be50 msgr2=0x7fb984071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.818+0000 7fb98bfce640 1 --2- 172.21.15.79:0/155514209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb98415be50 0x7fb984071b90 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb9800097a0 tx=0x7fb98002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.818+0000 7fb98bfce640 1 -- 172.21.15.79:0/155514209 shutdown_connections 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.818+0000 7fb98bfce640 1 --2- 172.21.15.79:0/155514209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb98415be50 0x7fb984071b90 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.818+0000 7fb98bfce640 1 -- 172.21.15.79:0/155514209 >> 172.21.15.79:0/155514209 conn(0x7fb9840b1980 msgr2=0x7fb9840b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.818+0000 7fb98bfce640 1 -- 172.21.15.79:0/155514209 shutdown_connections 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.818+0000 7fb98bfce640 1 -- 172.21.15.79:0/155514209 wait complete. 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.819+0000 7fb98bfce640 1 Processor -- start 2024-06-10T00:24:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.819+0000 7fb98bfce640 1 -- start start 2024-06-10T00:24:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb98bfce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9840720d0 0x7fb9840d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb98bfce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9840ccd30 0x7fb98406cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb98bfce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb98415be50 0x7fb984153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb98bfce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb98415c950 con 0x7fb9840ccd30 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb98bfce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb984072ed0 con 0x7fb98415be50 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb98bfce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb98415c230 con 0x7fb9840720d0 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9840ccd30 0x7fb98406cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9840ccd30 0x7fb98406cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49704/0 (socket says 172.21.15.79:49704) 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 -- 172.21.15.79:0/3095162846 learned_addr learned my addr 172.21.15.79:0/3095162846 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb98a56b640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb98415be50 0x7fb984153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989d6a640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9840720d0 0x7fb9840d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 -- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9840720d0 msgr2=0x7fb9840d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9840720d0 0x7fb9840d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 -- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb98415be50 msgr2=0x7fb984153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb98415be50 0x7fb984153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 -- 172.21.15.79:0/3095162846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98406d2d0 con 0x7fb9840ccd30 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989d6a640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9840720d0 0x7fb9840d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.820+0000 7fb989569640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9840ccd30 0x7fb98406cd90 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb97400c3f0 tx=0x7fb97400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.821+0000 7fb97a7fc640 1 -- 172.21.15.79:0/3095162846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974007020 con 0x7fb9840ccd30 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.821+0000 7fb97a7fc640 1 -- 172.21.15.79:0/3095162846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9740071c0 con 0x7fb9840ccd30 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.821+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb984154e30 con 0x7fb9840ccd30 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.821+0000 7fb97a7fc640 1 -- 172.21.15.79:0/3095162846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974007590 con 0x7fb9840ccd30 2024-06-10T00:24:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.821+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98406d850 con 0x7fb9840ccd30 2024-06-10T00:24:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.822+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb984068540 con 0x7fb9840ccd30 2024-06-10T00:24:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.822+0000 7fb97a7fc640 1 -- 172.21.15.79:0/3095162846 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb974019020 con 0x7fb9840ccd30 2024-06-10T00:24:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.822+0000 7fb97a7fc640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb96806be30 0x7fb96806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.822+0000 7fb97a7fc640 1 -- 172.21.15.79:0/3095162846 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6360+0+0 (secure 0 0 0) 0x7fb97408a870 con 0x7fb9840ccd30 2024-06-10T00:24:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.822+0000 7fb989d6a640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb96806be30 0x7fb96806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.823+0000 7fb989d6a640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb96806be30 0x7fb96806e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb980034000 tx=0x7fb98002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:15.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:15.827+0000 7fb97a7fc640 1 -- 172.21.15.79:0/3095162846 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb974059020 con 0x7fb9840ccd30 2024-06-10T00:24:16.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.001+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb9840ad530 con 0x7fb9840ccd30 2024-06-10T00:24:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.698+0000 7fb97a7fc640 1 -- 172.21.15.79:0/3095162846 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) ==== 181+0+0 (secure 0 0 0) 0x7fb974058920 con 0x7fb9840ccd30 2024-06-10T00:24:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-06-10T00:24:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.700+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb96806be30 msgr2=0x7fb96806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.700+0000 7fb98bfce640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb96806be30 0x7fb96806e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb980034000 tx=0x7fb98002e000 comp rx=0 tx=0).stop 2024-06-10T00:24:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.700+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9840ccd30 msgr2=0x7fb98406cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.700+0000 7fb98bfce640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9840ccd30 0x7fb98406cd90 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb97400c3f0 tx=0x7fb97400c8b0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.701+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 shutdown_connections 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.701+0000 7fb98bfce640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb96806be30 0x7fb96806e2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.701+0000 7fb98bfce640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb98415be50 0x7fb984153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.701+0000 7fb98bfce640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9840ccd30 0x7fb98406cd90 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.701+0000 7fb98bfce640 1 --2- 172.21.15.79:0/3095162846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9840720d0 0x7fb9840d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.701+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 >> 172.21.15.79:0/3095162846 conn(0x7fb9840b1980 msgr2=0x7fb98409ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.701+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 shutdown_connections 2024-06-10T00:24:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.701+0000 7fb98bfce640 1 -- 172.21.15.79:0/3095162846 wait complete. 2024-06-10T00:24:16.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-10T00:24:16.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.825+0000 7f8f28bb7640 1 Processor -- start 2024-06-10T00:24:16.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.825+0000 7f8f28bb7640 1 -- start start 2024-06-10T00:24:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.826+0000 7f8f28bb7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8f2415c740 0x7f8f240cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.826+0000 7f8f28bb7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f2415c230 0x7f8f240ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.826+0000 7f8f28bb7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f240722a0 con 0x7f8f2415be50 2024-06-10T00:24:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.826+0000 7f8f28bb7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8f240b3020 con 0x7f8f2415c230 2024-06-10T00:24:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.826+0000 7f8f28bb7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8f24072570 con 0x7f8f2415c740 2024-06-10T00:24:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.826+0000 7f8f22d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f2415c230 0x7f8f240ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.826+0000 7f8f22d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f2415c230 0x7f8f240ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49706/0 (socket says 172.21.15.79:49706) 2024-06-10T00:24:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.826+0000 7f8f22d9d640 1 -- 172.21.15.79:0/2034238740 learned_addr learned my addr 172.21.15.79:0/2034238740 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.827+0000 7f8f22d9d640 1 -- 172.21.15.79:0/2034238740 >> v2:172.21.15.117:3300/0 conn(0x7f8f2415c740 msgr2=0x7f8f240cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.827+0000 7f8f22d9d640 1 --2- 172.21.15.79:0/2034238740 >> v2:172.21.15.117:3300/0 conn(0x7f8f2415c740 0x7f8f240cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.827+0000 7f8f22d9d640 1 -- 172.21.15.79:0/2034238740 >> v1:172.21.15.117:6789/0 conn(0x7f8f2415be50 legacy=0x7f8f24071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.827+0000 7f8f22d9d640 1 -- 172.21.15.79:0/2034238740 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f24072850 con 0x7f8f2415c230 2024-06-10T00:24:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.827+0000 7f8f22d9d640 1 --2- 172.21.15.79:0/2034238740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c230 0x7f8f240ccb60 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8f2406f4d0 tx=0x7f8f1c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da15d90db866583d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.827+0000 7f8f2159a640 1 -- 172.21.15.79:0/2034238740 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c036070 con 0x7f8f2415c230 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.827+0000 7f8f2159a640 1 -- 172.21.15.79:0/2034238740 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c031600 con 0x7f8f2415c230 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f2159a640 1 -- 172.21.15.79:0/2034238740 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c0319d0 con 0x7f8f2415c230 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f28bb7640 1 -- 172.21.15.79:0/2034238740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c230 msgr2=0x7f8f240ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/2034238740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c230 0x7f8f240ccb60 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8f2406f4d0 tx=0x7f8f1c02a6f0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f28bb7640 1 -- 172.21.15.79:0/2034238740 shutdown_connections 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/2034238740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c230 0x7f8f240ccb60 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/2034238740 >> v2:172.21.15.117:3300/0 conn(0x7f8f2415c740 0x7f8f240cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f28bb7640 1 -- 172.21.15.79:0/2034238740 >> 172.21.15.79:0/2034238740 conn(0x7f8f240b1980 msgr2=0x7f8f240b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f28bb7640 1 -- 172.21.15.79:0/2034238740 shutdown_connections 2024-06-10T00:24:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.828+0000 7f8f28bb7640 1 -- 172.21.15.79:0/2034238740 wait complete. 2024-06-10T00:24:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.829+0000 7f8f28bb7640 1 Processor -- start 2024-06-10T00:24:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.829+0000 7f8f28bb7640 1 -- start start 2024-06-10T00:24:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f28bb7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f2415be50 0x7f8f24149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f28bb7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2415c230 0x7f8f2415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f28bb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c740 0x7f8f2415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f28bb7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f240b34b0 con 0x7f8f2415c740 2024-06-10T00:24:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f28bb7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24072e10 con 0x7f8f2415c230 2024-06-10T00:24:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f28bb7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f240b3630 con 0x7f8f2415be50 2024-06-10T00:24:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f22d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c740 0x7f8f2415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f22d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c740 0x7f8f2415a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49722/0 (socket says 172.21.15.79:49722) 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f22d9d640 1 -- 172.21.15.79:0/531845557 learned_addr learned my addr 172.21.15.79:0/531845557 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f2259c640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f2415be50 0x7f8f24149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f21d9b640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2415c230 0x7f8f2415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f22d9d640 1 -- 172.21.15.79:0/531845557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f2415be50 msgr2=0x7f8f24149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f22d9d640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f2415be50 0x7f8f24149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f22d9d640 1 -- 172.21.15.79:0/531845557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2415c230 msgr2=0x7f8f2415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.830+0000 7f8f22d9d640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2415c230 0x7f8f2415a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.831+0000 7f8f22d9d640 1 -- 172.21.15.79:0/531845557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2409bcb0 con 0x7f8f2415c740 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.831+0000 7f8f22d9d640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c740 0x7f8f2415a990 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c034040 tx=0x7f8f1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.831+0000 7f8f12ffd640 1 -- 172.21.15.79:0/531845557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c041020 con 0x7f8f2415c740 2024-06-10T00:24:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.831+0000 7f8f12ffd640 1 -- 172.21.15.79:0/531845557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c007780 con 0x7f8f2415c740 2024-06-10T00:24:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.831+0000 7f8f12ffd640 1 -- 172.21.15.79:0/531845557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c036040 con 0x7f8f2415c740 2024-06-10T00:24:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.831+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2409bf90 con 0x7f8f2415c740 2024-06-10T00:24:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.831+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2409c550 con 0x7f8f2415c740 2024-06-10T00:24:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.832+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f24068540 con 0x7f8f2415c740 2024-06-10T00:24:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.832+0000 7f8f12ffd640 1 -- 172.21.15.79:0/531845557 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f1c044020 con 0x7f8f2415c740 2024-06-10T00:24:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.833+0000 7f8f12ffd640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8f0406be30 0x7f8f0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.833+0000 7f8f12ffd640 1 -- 172.21.15.79:0/531845557 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5922+0+0 (secure 0 0 0) 0x7f8f1c0abd30 con 0x7f8f2415c740 2024-06-10T00:24:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.833+0000 7f8f2259c640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8f0406be30 0x7f8f0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.833+0000 7f8f2259c640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8f0406be30 0x7f8f0406e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8f2409d5e0 tx=0x7f8f14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:16.838+0000 7f8f12ffd640 1 -- 172.21.15.79:0/531845557 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8f1c04b030 con 0x7f8f2415c740 2024-06-10T00:24:17.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.014+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8f24075430 con 0x7f8f2415c740 2024-06-10T00:24:17.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.714+0000 7f8f12ffd640 1 -- 172.21.15.79:0/531845557 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) ==== 169+0+0 (secure 0 0 0) 0x7f8f1c07a6c0 con 0x7f8f2415c740 2024-06-10T00:24:17.715 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-06-10T00:24:17.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8f0406be30 msgr2=0x7f8f0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:17.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8f0406be30 0x7f8f0406e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8f2409d5e0 tx=0x7f8f14009040 comp rx=0 tx=0).stop 2024-06-10T00:24:17.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c740 msgr2=0x7f8f2415a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:17.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c740 0x7f8f2415a990 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c034040 tx=0x7f8f1c004a40 comp rx=0 tx=0).stop 2024-06-10T00:24:17.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 shutdown_connections 2024-06-10T00:24:17.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8f0406be30 0x7f8f0406e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f2415c740 0x7f8f2415a990 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2415c230 0x7f8f2415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 --2- 172.21.15.79:0/531845557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f2415be50 0x7f8f24149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 >> 172.21.15.79:0/531845557 conn(0x7f8f240b1980 msgr2=0x7f8f24071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:17.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.716+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 shutdown_connections 2024-06-10T00:24:17.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.717+0000 7f8f28bb7640 1 -- 172.21.15.79:0/531845557 wait complete. 2024-06-10T00:24:17.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-10T00:24:17.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.831+0000 7fbc51363640 1 Processor -- start 2024-06-10T00:24:17.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.831+0000 7fbc51363640 1 -- start start 2024-06-10T00:24:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc51363640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4c15e460 0x7fbc4c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc51363640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc4c0ce6f0 0x7fbc4c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc51363640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc4c0cf090 0x7fbc4c06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc51363640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4c0d1570 con 0x7fbc4c0ce6f0 2024-06-10T00:24:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc51363640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4c0cf520 con 0x7fbc4c0cf090 2024-06-10T00:24:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc51363640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c15e840 con 0x7fbc4c15e460 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc4a7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc4c0ce6f0 0x7fbc4c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc4a7fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc4c0ce6f0 0x7fbc4c0ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49726/0 (socket says 172.21.15.79:49726) 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/2201526223 learned_addr learned my addr 172.21.15.79:0/2201526223 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/2201526223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4c15e460 msgr2=0x7fbc4c0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc4a7fc640 1 --2- 172.21.15.79:0/2201526223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4c15e460 0x7fbc4c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/2201526223 >> v2:172.21.15.117:3300/0 conn(0x7fbc4c0cf090 msgr2=0x7fbc4c06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc4a7fc640 1 --2- 172.21.15.79:0/2201526223 >> v2:172.21.15.117:3300/0 conn(0x7fbc4c0cf090 0x7fbc4c06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.832+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/2201526223 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c0d1290 con 0x7fbc4c0ce6f0 2024-06-10T00:24:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.833+0000 7fbc4a7fc640 1 --2- 172.21.15.79:0/2201526223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0ce6f0 0x7fbc4c0ceb50 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0d2f50 tx=0x7fbc4002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbc167023dc2740 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:17.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.833+0000 7fbc49ffb640 1 -- 172.21.15.79:0/2201526223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40037070 con 0x7fbc4c0ce6f0 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.833+0000 7fbc49ffb640 1 -- 172.21.15.79:0/2201526223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40032440 con 0x7fbc4c0ce6f0 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.833+0000 7fbc49ffb640 1 -- 172.21.15.79:0/2201526223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40032810 con 0x7fbc4c0ce6f0 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 -- 172.21.15.79:0/2201526223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0ce6f0 msgr2=0x7fbc4c0ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 --2- 172.21.15.79:0/2201526223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0ce6f0 0x7fbc4c0ceb50 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0d2f50 tx=0x7fbc4002a140 comp rx=0 tx=0).stop 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 -- 172.21.15.79:0/2201526223 shutdown_connections 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 --2- 172.21.15.79:0/2201526223 >> v2:172.21.15.117:3300/0 conn(0x7fbc4c0cf090 0x7fbc4c06f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 --2- 172.21.15.79:0/2201526223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0ce6f0 0x7fbc4c0ceb50 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 --2- 172.21.15.79:0/2201526223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4c15e460 0x7fbc4c0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 -- 172.21.15.79:0/2201526223 >> 172.21.15.79:0/2201526223 conn(0x7fbc4c0d1e70 msgr2=0x7fbc4c0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 -- 172.21.15.79:0/2201526223 shutdown_connections 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.834+0000 7fbc51363640 1 -- 172.21.15.79:0/2201526223 wait complete. 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.835+0000 7fbc51363640 1 Processor -- start 2024-06-10T00:24:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.835+0000 7fbc51363640 1 -- start start 2024-06-10T00:24:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc51363640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4c0ce6f0 0x7fbc4c1f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc51363640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0cf090 0x7fbc4c0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc51363640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc4c15e460 0x7fbc4c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc51363640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c0ccbb0 con 0x7fbc4c0cf090 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc51363640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c0cc8d0 con 0x7fbc4c15e460 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc51363640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c0706e0 con 0x7fbc4c0ce6f0 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0cf090 0x7fbc4c0c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0cf090 0x7fbc4c0c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49732/0 (socket says 172.21.15.79:49732) 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/1635292304 learned_addr learned my addr 172.21.15.79:0/1635292304 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/1635292304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4c0ce6f0 msgr2=0x7fbc4c1f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4c0ce6f0 0x7fbc4c1f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/1635292304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc4c15e460 msgr2=0x7fbc4c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc4c15e460 0x7fbc4c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 -- 172.21.15.79:0/1635292304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c0c6380 con 0x7fbc4c0cf090 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc4a7fc640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0cf090 0x7fbc4c0c59a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbc40000c00 tx=0x7fbc400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:17.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc337fe640 1 -- 172.21.15.79:0/1635292304 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40041020 con 0x7fbc4c0cf090 2024-06-10T00:24:17.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc337fe640 1 -- 172.21.15.79:0/1635292304 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40030970 con 0x7fbc4c0cf090 2024-06-10T00:24:17.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.836+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4c0c6660 con 0x7fbc4c0cf090 2024-06-10T00:24:17.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.837+0000 7fbc337fe640 1 -- 172.21.15.79:0/1635292304 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40037040 con 0x7fbc4c0cf090 2024-06-10T00:24:17.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.837+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4c0c6c20 con 0x7fbc4c0cf090 2024-06-10T00:24:17.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.838+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4c0683c0 con 0x7fbc4c0cf090 2024-06-10T00:24:17.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.838+0000 7fbc337fe640 1 -- 172.21.15.79:0/1635292304 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc40044020 con 0x7fbc4c0cf090 2024-06-10T00:24:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.838+0000 7fbc337fe640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.839+0000 7fbc337fe640 1 -- 172.21.15.79:0/1635292304 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7fbc400ab780 con 0x7fbc4c0cf090 2024-06-10T00:24:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.839+0000 7fbc4affd640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.839+0000 7fbc4affd640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc3806be30 0x7fbc3806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009670 tx=0x7fbc3c006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:17.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:17.844+0000 7fbc337fe640 1 -- 172.21.15.79:0/1635292304 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc4004b030 con 0x7fbc4c0cf090 2024-06-10T00:24:18.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.030+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbc4c0cdda0 con 0x7fbc4c0cf090 2024-06-10T00:24:18.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.034+0000 7fbc337fe640 1 -- 172.21.15.79:0/1635292304 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7fbc4007a250 con 0x7fbc4c0cf090 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc3806be30 msgr2=0x7fbc3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc3806be30 0x7fbc3806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009670 tx=0x7fbc3c006bf0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0cf090 msgr2=0x7fbc4c0c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0cf090 0x7fbc4c0c59a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbc40000c00 tx=0x7fbc400046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 shutdown_connections 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc4c15e460 0x7fbc4c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4c0cf090 0x7fbc4c0c59a0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 --2- 172.21.15.79:0/1635292304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4c0ce6f0 0x7fbc4c1f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 >> 172.21.15.79:0/1635292304 conn(0x7fbc4c0d1e70 msgr2=0x7fbc4c0b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 shutdown_connections 2024-06-10T00:24:18.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.036+0000 7fbc51363640 1 -- 172.21.15.79:0/1635292304 wait complete. 2024-06-10T00:24:18.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-06-10T00:24:18.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.146+0000 7f8a8aa10640 1 Processor -- start 2024-06-10T00:24:18.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.146+0000 7f8a8aa10640 1 -- start start 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a8aa10640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a8415a870 0x7f8a8406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a8aa10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a840aef70 0x7f8a840b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a8aa10640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8a840af3d0 0x7f8a840b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a8aa10640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8a840b4fe0 con 0x7f8a840af3d0 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a8aa10640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8a8406e390 con 0x7f8a8415a870 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a8aa10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8415ac50 con 0x7f8a840aef70 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a88fad640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8a840af3d0 0x7f8a840b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a88fad640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8a840af3d0 0x7f8a840b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59720/0 (socket says 172.21.15.79:59720) 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a88fad640 1 -- 172.21.15.79:0/4136552285 learned_addr learned my addr 172.21.15.79:0/4136552285 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a88fad640 1 -- 172.21.15.79:0/4136552285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a840aef70 msgr2=0x7f8a840b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:18.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a88fad640 1 --2- 172.21.15.79:0/4136552285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a840aef70 0x7f8a840b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a88fad640 1 -- 172.21.15.79:0/4136552285 >> v2:172.21.15.117:3300/0 conn(0x7f8a8415a870 msgr2=0x7f8a8406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:18.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a88fad640 1 --2- 172.21.15.79:0/4136552285 >> v2:172.21.15.117:3300/0 conn(0x7f8a8415a870 0x7f8a8406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.147+0000 7f8a88fad640 1 -- 172.21.15.79:0/4136552285 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8406cdb0 con 0x7f8a840af3d0 2024-06-10T00:24:18.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a88fad640 1 --2- 172.21.15.79:0/4136552285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a840b4aa0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8a84075030 tx=0x7f8a7c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167eda5f6a6a56d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:18.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a82ffd640 1 -- 172.21.15.79:0/4136552285 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c036070 con 0x7f8a840af3d0 2024-06-10T00:24:18.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a82ffd640 1 -- 172.21.15.79:0/4136552285 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7c031600 con 0x7f8a840af3d0 2024-06-10T00:24:18.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a82ffd640 1 -- 172.21.15.79:0/4136552285 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0319d0 con 0x7f8a840af3d0 2024-06-10T00:24:18.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 -- 172.21.15.79:0/4136552285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 msgr2=0x7f8a840b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/4136552285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a840b4aa0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8a84075030 tx=0x7f8a7c02a610 comp rx=0 tx=0).stop 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 -- 172.21.15.79:0/4136552285 shutdown_connections 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/4136552285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a840b4aa0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/4136552285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a840aef70 0x7f8a840b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/4136552285 >> v2:172.21.15.117:3300/0 conn(0x7f8a8415a870 0x7f8a8406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 -- 172.21.15.79:0/4136552285 >> 172.21.15.79:0/4136552285 conn(0x7f8a840b19f0 msgr2=0x7f8a840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 -- 172.21.15.79:0/4136552285 shutdown_connections 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.148+0000 7f8a8aa10640 1 -- 172.21.15.79:0/4136552285 wait complete. 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.150+0000 7f8a8aa10640 1 Processor -- start 2024-06-10T00:24:18.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.150+0000 7f8a8aa10640 1 -- start start 2024-06-10T00:24:18.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.150+0000 7f8a8aa10640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a840aef70 0x7f8a8414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.150+0000 7f8a8aa10640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a8415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.150+0000 7f8a8aa10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a8415a870 0x7f8a8409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.150+0000 7f8a8aa10640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8406d650 con 0x7f8a840af3d0 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.150+0000 7f8a8aa10640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8406d370 con 0x7f8a840aef70 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.150+0000 7f8a8aa10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8406d930 con 0x7f8a8415a870 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a8415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a8415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59726/0 (socket says 172.21.15.79:59726) 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 -- 172.21.15.79:0/132294925 learned_addr learned my addr 172.21.15.79:0/132294925 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a88fad640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a8415a870 0x7f8a8409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a83fff640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a840aef70 0x7f8a8414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 -- 172.21.15.79:0/132294925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a8415a870 msgr2=0x7f8a8409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a8415a870 0x7f8a8409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 -- 172.21.15.79:0/132294925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a840aef70 msgr2=0x7f8a8414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a840aef70 0x7f8a8414e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 -- 172.21.15.79:0/132294925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8415cac0 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a837fe640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a8415c230 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800b440 tx=0x7f8a7800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a80ff9640 1 -- 172.21.15.79:0/132294925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78015020 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a80ff9640 1 -- 172.21.15.79:0/132294925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a78011890 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8415cd60 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a80ff9640 1 -- 172.21.15.79:0/132294925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78011c80 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.151+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8415d320 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.152+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a84068430 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.153+0000 7f8a80ff9640 1 -- 172.21.15.79:0/132294925 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a78018020 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.153+0000 7f8a80ff9640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8a7006be30 0x7f8a7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.153+0000 7f8a80ff9640 1 -- 172.21.15.79:0/132294925 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f8a7808ae10 con 0x7f8a840af3d0 2024-06-10T00:24:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.153+0000 7f8a83fff640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8a7006be30 0x7f8a7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.154+0000 7f8a83fff640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8a7006be30 0x7f8a7006e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8a84155b10 tx=0x7f8a74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.159+0000 7f8a80ff9640 1 -- 172.21.15.79:0/132294925 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8a7801f020 con 0x7f8a840af3d0 2024-06-10T00:24:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.397+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f8a840b2650 con 0x7f8a840af3d0 2024-06-10T00:24:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.715+0000 7f8a80ff9640 1 -- 172.21.15.79:0/132294925 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v430) ==== 146+0+0 (secure 0 0 0) 0x7f8a7800d040 con 0x7f8a840af3d0 2024-06-10T00:24:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8a7006be30 msgr2=0x7f8a7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8a7006be30 0x7f8a7006e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8a84155b10 tx=0x7f8a74008040 comp rx=0 tx=0).stop 2024-06-10T00:24:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 msgr2=0x7f8a8415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a8415c230 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800b440 tx=0x7f8a7800b900 comp rx=0 tx=0).stop 2024-06-10T00:24:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 shutdown_connections 2024-06-10T00:24:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f8a7006be30 0x7f8a7006e2f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a8415a870 0x7f8a8409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a840af3d0 0x7f8a8415c230 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 --2- 172.21.15.79:0/132294925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a840aef70 0x7f8a8414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 >> 172.21.15.79:0/132294925 conn(0x7f8a840b19f0 msgr2=0x7f8a8406e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.718+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 shutdown_connections 2024-06-10T00:24:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.719+0000 7f8a8aa10640 1 -- 172.21.15.79:0/132294925 wait complete. 2024-06-10T00:24:18.731 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-06-10T00:24:18.731 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-06-10T00:24:18.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:24:18.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.831+0000 7f309adee640 1 Processor -- start 2024-06-10T00:24:18.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.831+0000 7f309adee640 1 -- start start 2024-06-10T00:24:18.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f309adee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094161cc0 0x7f30940d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f309adee640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30940d03e0 con 0x7f30940d4cd0 2024-06-10T00:24:18.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f309adee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30940d0100 con 0x7f30941618e0 2024-06-10T00:24:18.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f309adee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30940b4130 con 0x7f3094161cc0 2024-06-10T00:24:18.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f309938b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f30940d4cd0 0x7f30940b45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59608/0 (socket says 172.21.15.79:59608) 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f309938b640 1 -- 172.21.15.79:0/3611579470 learned_addr learned my addr 172.21.15.79:0/3611579470 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308bfff640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094161cc0 0x7f30940d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932685461 0 0) 0x7f30940d03e0 con 0x7f30940d4cd0 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f307c003520 con 0x7f30940d4cd0 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3080057415 0 0) 0x7f307c003520 con 0x7f30940d4cd0 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094161cc0 msgr2=0x7f30940d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308b7fe640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094161cc0 0x7f30940d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 >> v1:172.21.15.117:6789/0 conn(0x7f30941618e0 legacy=0x7f30940cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30940b3ae0 con 0x7f30940d4cd0 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.832+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f308c0019f0 con 0x7f30940d4cd0 2024-06-10T00:24:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 >> v1:172.21.15.79:6789/0 conn(0x7f30940d4cd0 legacy=0x7f30940b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f308b7fe640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307c0039e0 0x7f307c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f308b7fe640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094161cc0 0x7f307c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f308b7fe640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c004d40 0x7f307c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30940b4130 con 0x7f307c004d40 2024-06-10T00:24:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f307c00ba70 con 0x7f307c0039e0 2024-06-10T00:24:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f307c00bc70 con 0x7f3094161cc0 2024-06-10T00:24:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f309938b640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c004d40 0x7f307c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f3098b8a640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307c0039e0 0x7f307c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f308bfff640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094161cc0 0x7f307c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f309938b640 1 -- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094161cc0 msgr2=0x7f307c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f309938b640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094161cc0 0x7f307c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f309938b640 1 -- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307c0039e0 msgr2=0x7f307c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f309938b640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307c0039e0 0x7f307c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.833+0000 7f309938b640 1 -- 172.21.15.79:0/3611579470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c003520 con 0x7f307c004d40 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f309938b640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c004d40 0x7f307c0051c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f308c002230 tx=0x7f307c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa70a8bc0b236c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c00a4a0 con 0x7f307c004d40 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308c02f070 con 0x7f307c004d40 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f308b7fe640 1 -- 172.21.15.79:0/3611579470 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c02bcb0 con 0x7f307c004d40 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f309adee640 1 -- 172.21.15.79:0/3611579470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c004d40 msgr2=0x7f307c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f309adee640 1 --2- 172.21.15.79:0/3611579470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c004d40 0x7f307c0051c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f308c002230 tx=0x7f307c005830 comp rx=0 tx=0).stop 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f309938b640 1 -- 172.21.15.79:0/3611579470 reap_dead start 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f309adee640 1 -- 172.21.15.79:0/3611579470 shutdown_connections 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f309adee640 1 -- 172.21.15.79:0/3611579470 >> 172.21.15.79:0/3611579470 conn(0x7f309409d410 msgr2=0x7f30940d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f309adee640 1 -- 172.21.15.79:0/3611579470 shutdown_connections 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.834+0000 7f309adee640 1 -- 172.21.15.79:0/3611579470 wait complete. 2024-06-10T00:24:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.836+0000 7f309adee640 1 Processor -- start 2024-06-10T00:24:18.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.836+0000 7f309adee640 1 -- start start 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.836+0000 7f309adee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f307c004d40 0x7f309415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.836+0000 7f309adee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30940cd940 0x7f309415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.836+0000 7f309adee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30940cc820 0x7f309415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.836+0000 7f309adee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30940d2690 con 0x7f30940cd940 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.836+0000 7f309adee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30940d2510 con 0x7f30940cc820 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.836+0000 7f309adee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30940d2810 con 0x7f307c004d40 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30940cd940 0x7f309415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30940cd940 0x7f309415e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59750/0 (socket says 172.21.15.79:59750) 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 -- 172.21.15.79:0/1660176845 learned_addr learned my addr 172.21.15.79:0/1660176845 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 -- 172.21.15.79:0/1660176845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f307c004d40 msgr2=0x7f309415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f307c004d40 0x7f309415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 -- 172.21.15.79:0/1660176845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30940cc820 msgr2=0x7f309415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30940cc820 0x7f309415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 -- 172.21.15.79:0/1660176845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30940cddd0 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f308bfff640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30940cd940 0x7f309415e9a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f30840119d0 tx=0x7f3084011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f30897fa640 1 -- 172.21.15.79:0/1660176845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308400fa70 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f30897fa640 1 -- 172.21.15.79:0/1660176845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308400fc10 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30940cbd40 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f30897fa640 1 -- 172.21.15.79:0/1660176845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084014440 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.837+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30940b8470 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.838+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3094068430 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.839+0000 7f30897fa640 1 -- 172.21.15.79:0/1660176845 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3084012040 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.839+0000 7f30897fa640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f308006be30 0x7f308006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.839+0000 7f30897fa640 1 -- 172.21.15.79:0/1660176845 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f308408b340 con 0x7f30940cd940 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.839+0000 7f3098b8a640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f308006be30 0x7f308006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.840+0000 7f3098b8a640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f308006be30 0x7f308006e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f30941f7200 tx=0x7f3090009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:18.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:18.843+0000 7f30897fa640 1 -- 172.21.15.79:0/1660176845 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3084019030 con 0x7f30940cd940 2024-06-10T00:24:19.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.024+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30940b54f0 con 0x7f30940cd940 2024-06-10T00:24:19.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.025+0000 7f30897fa640 1 -- 172.21.15.79:0/1660176845 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+13379 (secure 0 0 0) 0x7f3084059e10 con 0x7f30940cd940 2024-06-10T00:24:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:19.024 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":110,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:24:17.709431+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/4878507":"2024-06-11T00:24:10.936290+0000","172.21.15.79:6835/4878507":"2024-06-11T00:24:10.936290+0000","172.21.15.79:6837/2980295924":"2024-06-11T00:23:34.609954+0000","172.21.15.79:6835/2980295924":"2024-06-11T00:23:34.609954+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f308006be30 msgr2=0x7f308006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f308006be30 0x7f308006e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f30941f7200 tx=0x7f3090009040 comp rx=0 tx=0).stop 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30940cd940 msgr2=0x7f309415e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30940cd940 0x7f309415e9a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f30840119d0 tx=0x7f3084011e90 comp rx=0 tx=0).stop 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 shutdown_connections 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f308006be30 0x7f308006e2f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30940cc820 0x7f309415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30940cd940 0x7f309415e9a0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 --2- 172.21.15.79:0/1660176845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f307c004d40 0x7f309415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 >> 172.21.15.79:0/1660176845 conn(0x7f309409d410 msgr2=0x7f30940b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:19.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 shutdown_connections 2024-06-10T00:24:19.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.027+0000 7f309adee640 1 -- 172.21.15.79:0/1660176845 wait complete. 2024-06-10T00:24:19.038 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-10T00:14:31.177808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-10T00:24:19.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-10T00:24:19.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.140+0000 7f817cc15640 1 Processor -- start 2024-06-10T00:24:19.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.140+0000 7f817cc15640 1 -- start start 2024-06-10T00:24:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.141+0000 7f817cc15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 0x7f81780b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.141+0000 7f817cc15640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81780d0730 0x7f81780b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.141+0000 7f817cc15640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817815c870 con 0x7f81780b48e0 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.141+0000 7f817cc15640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f817815cb50 con 0x7f81780d0730 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.141+0000 7f817cc15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f817815ce30 con 0x7f81780b3b40 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f8175d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f81780b48e0 0x7f81780d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59616/0 (socket says 172.21.15.79:59616) 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f8175d9b640 1 -- 172.21.15.79:0/2422726639 learned_addr learned my addr 172.21.15.79:0/2422726639 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228772917 0 0) 0x7f817815c870 con 0x7f81780b48e0 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8164003520 con 0x7f81780b48e0 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f8176d9d640 1 --2- 172.21.15.79:0/2422726639 >> v2:172.21.15.117:3300/0 conn(0x7f81780d0730 0x7f81780b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817659c640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 0x7f81780b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 803392564 0 0) 0x7f8164003520 con 0x7f81780b48e0 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 msgr2=0x7f81780b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 0x7f81780b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 >> v2:172.21.15.117:3300/0 conn(0x7f81780d0730 msgr2=0x7f81780b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 --2- 172.21.15.79:0/2422726639 >> v2:172.21.15.117:3300/0 conn(0x7f81780d0730 0x7f81780b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817815d110 con 0x7f81780b48e0 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f8160001670 con 0x7f81780b48e0 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 >> v1:172.21.15.79:6789/0 conn(0x7f81780b48e0 legacy=0x7f81780d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81640039b0 0x7f8164003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8164004800 0x7f8164004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 0x7f81640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f817815cb50 con 0x7f8164004800 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f817815ce30 con 0x7f81640039b0 2024-06-10T00:24:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f816400ba70 con 0x7f81780b3b40 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f8176d9d640 1 --2- 172.21.15.79:0/2422726639 >> v2:172.21.15.117:3300/0 conn(0x7f81780d0730 0x7f81780b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f8175d9b640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8164004800 0x7f8164004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f817659c640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81640039b0 0x7f8164003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.142+0000 7f8176d9d640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 0x7f81640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f8175d9b640 1 -- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 msgr2=0x7f81640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f8175d9b640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 0x7f81640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f8175d9b640 1 -- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81640039b0 msgr2=0x7f8164003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f8175d9b640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81640039b0 0x7f8164003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f8175d9b640 1 -- 172.21.15.79:0/2422726639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8164003520 con 0x7f8164004800 2024-06-10T00:24:19.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f8176d9d640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81780b3b40 0x7f81640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f8175d9b640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8164004800 0x7f8164004c80 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8160007fd0 tx=0x7f8164005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bf6b9609642773 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160007d50 con 0x7f8164004800 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81600058d0 con 0x7f8164004800 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.143+0000 7f817559a640 1 -- 172.21.15.79:0/2422726639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160005d00 con 0x7f8164004800 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.144+0000 7f817cc15640 1 -- 172.21.15.79:0/2422726639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8164004800 msgr2=0x7f8164004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.144+0000 7f817cc15640 1 --2- 172.21.15.79:0/2422726639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8164004800 0x7f8164004c80 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8160007fd0 tx=0x7f8164005830 comp rx=0 tx=0).stop 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.144+0000 7f8176d9d640 1 -- 172.21.15.79:0/2422726639 reap_dead start 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.144+0000 7f817cc15640 1 -- 172.21.15.79:0/2422726639 shutdown_connections 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.144+0000 7f817cc15640 1 -- 172.21.15.79:0/2422726639 >> 172.21.15.79:0/2422726639 conn(0x7f81780b1d10 msgr2=0x7f81780b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.144+0000 7f817cc15640 1 -- 172.21.15.79:0/2422726639 shutdown_connections 2024-06-10T00:24:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.144+0000 7f817cc15640 1 -- 172.21.15.79:0/2422726639 wait complete. 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.145+0000 7f817cc15640 1 Processor -- start 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.145+0000 7f817cc15640 1 -- start start 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f817cc15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8164004800 0x7f8178153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f817cc15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8178158650 0x7f8178158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f817cc15640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81781566a0 0x7f8178156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f817cc15640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f817815c490 con 0x7f8178158650 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f817cc15640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f81780b3f20 con 0x7f81781566a0 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f817cc15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f817815c610 con 0x7f8164004800 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f8175d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8178158650 0x7f8178158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f8175d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8178158650 0x7f8178158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59764/0 (socket says 172.21.15.79:59764) 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f8175d9b640 1 -- 172.21.15.79:0/2926693155 learned_addr learned my addr 172.21.15.79:0/2926693155 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f817659c640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8164004800 0x7f8178153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f8176d9d640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81781566a0 0x7f8178156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f8175d9b640 1 -- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8164004800 msgr2=0x7f8178153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.146+0000 7f8175d9b640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8164004800 0x7f8178153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f8175d9b640 1 -- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81781566a0 msgr2=0x7f8178156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f8175d9b640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81781566a0 0x7f8178156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f8175d9b640 1 -- 172.21.15.79:0/2926693155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817809b5d0 con 0x7f8178158650 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f8176d9d640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81781566a0 0x7f8178156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f8175d9b640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8178158650 0x7f8178158ad0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f816000c350 tx=0x7f817815d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f816effd640 1 -- 172.21.15.79:0/2926693155 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160001c80 con 0x7f8178158650 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f816effd640 1 -- 172.21.15.79:0/2926693155 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8160041070 con 0x7f8178158650 2024-06-10T00:24:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81781f4050 con 0x7f8178158650 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f816effd640 1 -- 172.21.15.79:0/2926693155 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81600049f0 con 0x7f8178158650 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.147+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81781f4610 con 0x7f8178158650 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.148+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81780683c0 con 0x7f8178158650 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.148+0000 7f816effd640 1 -- 172.21.15.79:0/2926693155 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f816003b070 con 0x7f8178158650 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.149+0000 7f816effd640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f815806be60 0x7f815806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.149+0000 7f816effd640 1 -- 172.21.15.79:0/2926693155 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f81600aa410 con 0x7f8178158650 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.149+0000 7f817659c640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f815806be60 0x7f815806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.149+0000 7f817659c640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f815806be60 0x7f815806e320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8170003b80 tx=0x7f8170009760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.153+0000 7f816effd640 1 -- 172.21.15.79:0/2926693155 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f817809b5d0 con 0x7f8178158650 2024-06-10T00:24:19.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.326+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f81780cc6b0 con 0x7f8178158650 2024-06-10T00:24:19.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.326+0000 7f816effd640 1 -- 172.21.15.79:0/2926693155 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) ==== 93+0+10 (secure 0 0 0) 0x7f8160078ee0 con 0x7f8178158650 2024-06-10T00:24:19.326 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-06-10T00:24:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f815806be60 msgr2=0x7f815806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f815806be60 0x7f815806e320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8170003b80 tx=0x7f8170009760 comp rx=0 tx=0).stop 2024-06-10T00:24:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8178158650 msgr2=0x7f8178158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8178158650 0x7f8178158ad0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f816000c350 tx=0x7f817815d2e0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 shutdown_connections 2024-06-10T00:24:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f815806be60 0x7f815806e320 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81781566a0 0x7f8178156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8178158650 0x7f8178158ad0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 --2- 172.21.15.79:0/2926693155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8164004800 0x7f8178153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 >> 172.21.15.79:0/2926693155 conn(0x7f81780b1d10 msgr2=0x7f81780cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 shutdown_connections 2024-06-10T00:24:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.328+0000 7f817cc15640 1 -- 172.21.15.79:0/2926693155 wait complete. 2024-06-10T00:24:19.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-06-10T00:24:19.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.439+0000 7fc213c4d640 1 Processor -- start 2024-06-10T00:24:19.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.439+0000 7fc213c4d640 1 -- start start 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc213c4d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc20c15f1a0 0x7fc20c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc213c4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc20c0cef70 0x7fc20c0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc213c4d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20c15f5e0 con 0x7fc20c0d2680 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc213c4d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc20c0d13e0 con 0x7fc20c0cef70 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc213c4d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc20c0d0ad0 con 0x7fc20c15f1a0 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc2121ea640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc20c0cef70 0x7fc20c0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc2119e9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc20c0d2680 0x7fc20c0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59626/0 (socket says 172.21.15.79:59626) 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc2119e9640 1 -- 172.21.15.79:0/3422496237 learned_addr learned my addr 172.21.15.79:0/3422496237 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc2111e8640 1 --2- 172.21.15.79:0/3422496237 >> v2:172.21.15.117:3300/0 conn(0x7fc20c15f1a0 0x7fc20c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc2121ea640 1 -- 172.21.15.79:0/3422496237 >> v2:172.21.15.117:3300/0 conn(0x7fc20c15f1a0 msgr2=0x7fc20c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:19.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc2121ea640 1 --2- 172.21.15.79:0/3422496237 >> v2:172.21.15.117:3300/0 conn(0x7fc20c15f1a0 0x7fc20c0d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc2121ea640 1 -- 172.21.15.79:0/3422496237 >> v1:172.21.15.79:6789/0 conn(0x7fc20c0d2680 legacy=0x7fc20c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.440+0000 7fc2121ea640 1 -- 172.21.15.79:0/3422496237 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c15f890 con 0x7fc20c0cef70 2024-06-10T00:24:19.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.441+0000 7fc2121ea640 1 --2- 172.21.15.79:0/3422496237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0cf3c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0d1560 tx=0x7fc20402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccb85b138404210 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.441+0000 7fc2109e7640 1 -- 172.21.15.79:0/3422496237 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc204007740 con 0x7fc20c0cef70 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.441+0000 7fc2109e7640 1 -- 172.21.15.79:0/3422496237 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2040078e0 con 0x7fc20c0cef70 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.441+0000 7fc2109e7640 1 -- 172.21.15.79:0/3422496237 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc204007cb0 con 0x7fc20c0cef70 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.442+0000 7fc213c4d640 1 -- 172.21.15.79:0/3422496237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 msgr2=0x7fc20c0cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.442+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3422496237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0cf3c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0d1560 tx=0x7fc20402a660 comp rx=0 tx=0).stop 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.442+0000 7fc213c4d640 1 -- 172.21.15.79:0/3422496237 shutdown_connections 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.442+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3422496237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0cf3c0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.442+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3422496237 >> v2:172.21.15.117:3300/0 conn(0x7fc20c15f1a0 0x7fc20c0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.442+0000 7fc213c4d640 1 -- 172.21.15.79:0/3422496237 >> 172.21.15.79:0/3422496237 conn(0x7fc20c09d3f0 msgr2=0x7fc20c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.442+0000 7fc213c4d640 1 -- 172.21.15.79:0/3422496237 shutdown_connections 2024-06-10T00:24:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.442+0000 7fc213c4d640 1 -- 172.21.15.79:0/3422496237 wait complete. 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.443+0000 7fc213c4d640 1 Processor -- start 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.443+0000 7fc213c4d640 1 -- start start 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc213c4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc213c4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc20c0d2680 0x7fc20c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc213c4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc20c15f1a0 0x7fc20c15d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc213c4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c0d4f00 con 0x7fc20c0cef70 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc213c4d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c0d1070 con 0x7fc20c0d2680 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc213c4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc20c0d1870 con 0x7fc20c15f1a0 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59776/0 (socket says 172.21.15.79:59776) 2024-06-10T00:24:19.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 -- 172.21.15.79:0/3966944563 learned_addr learned my addr 172.21.15.79:0/3966944563 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2111e8640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc20c0d2680 0x7fc20c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2121ea640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc20c15f1a0 0x7fc20c15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 -- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc20c15f1a0 msgr2=0x7fc20c15d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc20c15f1a0 0x7fc20c15d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 -- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc20c0d2680 msgr2=0x7fc20c15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc20c0d2680 0x7fc20c15cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 -- 172.21.15.79:0/3966944563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c0b56d0 con 0x7fc20c0cef70 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2121ea640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc20c15f1a0 0x7fc20c15d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2119e9640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0b5190 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fc20800c400 tx=0x7fc20800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2027fc640 1 -- 172.21.15.79:0/3966944563 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208017070 con 0x7fc20c0cef70 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2027fc640 1 -- 172.21.15.79:0/3966944563 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc208005ce0 con 0x7fc20c0cef70 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20c15db10 con 0x7fc20c0cef70 2024-06-10T00:24:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc2027fc640 1 -- 172.21.15.79:0/3966944563 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2080072f0 con 0x7fc20c0cef70 2024-06-10T00:24:19.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.444+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20c0b71d0 con 0x7fc20c0cef70 2024-06-10T00:24:19.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.445+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20c068430 con 0x7fc20c0cef70 2024-06-10T00:24:19.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.446+0000 7fc2027fc640 1 -- 172.21.15.79:0/3966944563 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc20801a070 con 0x7fc20c0cef70 2024-06-10T00:24:19.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.446+0000 7fc2027fc640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1f006be60 0x7fc1f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.446+0000 7fc2111e8640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1f006be60 0x7fc1f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.446+0000 7fc2027fc640 1 -- 172.21.15.79:0/3966944563 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7fc20808a0b0 con 0x7fc20c0cef70 2024-06-10T00:24:19.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.447+0000 7fc2111e8640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1f006be60 0x7fc1f006e320 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc20c15e5f0 tx=0x7fc1fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.451+0000 7fc2027fc640 1 -- 172.21.15.79:0/3966944563 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc208058c10 con 0x7fc20c0cef70 2024-06-10T00:24:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.691+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7fc20c0d04e0 con 0x7fc20c0cef70 2024-06-10T00:24:19.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.721+0000 7fc2027fc640 1 -- 172.21.15.79:0/3966944563 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v431) ==== 147+0+0 (secure 0 0 0) 0x7fc208058510 con 0x7fc20c0cef70 2024-06-10T00:24:19.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1f006be60 msgr2=0x7fc1f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1f006be60 0x7fc1f006e320 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc20c15e5f0 tx=0x7fc1fc008040 comp rx=0 tx=0).stop 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 msgr2=0x7fc20c0b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0b5190 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fc20800c400 tx=0x7fc20800c8c0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 shutdown_connections 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc1f006be60 0x7fc1f006e320 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc20c15f1a0 0x7fc20c15d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc20c0d2680 0x7fc20c15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 --2- 172.21.15.79:0/3966944563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc20c0cef70 0x7fc20c0b5190 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 >> 172.21.15.79:0/3966944563 conn(0x7fc20c09d3f0 msgr2=0x7fc20c0c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 shutdown_connections 2024-06-10T00:24:19.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.723+0000 7fc213c4d640 1 -- 172.21.15.79:0/3966944563 wait complete. 2024-06-10T00:24:19.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-10T00:24:19.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.836+0000 7f0253a2c640 1 Processor -- start 2024-06-10T00:24:19.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.836+0000 7f0253a2c640 1 -- start start 2024-06-10T00:24:19.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.837+0000 7f0253a2c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f024c155320 0x7f024c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.837+0000 7f0253a2c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f024c155700 con 0x7f024c0d0730 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.837+0000 7f0253a2c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f024c15b6b0 con 0x7f024c0b34e0 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.837+0000 7f0253a2c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f024c15b990 con 0x7f024c155320 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.837+0000 7f0251fc9640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f024c0d0730 0x7f024c06e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59634/0 (socket says 172.21.15.79:59634) 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.837+0000 7f0251fc9640 1 -- 172.21.15.79:0/459277834 learned_addr learned my addr 172.21.15.79:0/459277834 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.837+0000 7f02517c8640 1 --2- 172.21.15.79:0/459277834 >> v2:172.21.15.117:3300/0 conn(0x7f024c155320 0x7f024c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904531628 0 0) 0x7f024c155700 con 0x7f024c0d0730 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0238003520 con 0x7f024c0d0730 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 908431548 0 0) 0x7f0238003520 con 0x7f024c0d0730 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 >> v2:172.21.15.117:3300/0 conn(0x7f024c155320 msgr2=0x7f024c0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 --2- 172.21.15.79:0/459277834 >> v2:172.21.15.117:3300/0 conn(0x7f024c155320 0x7f024c0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 >> v1:172.21.15.117:6789/0 conn(0x7f024c0b34e0 legacy=0x7f024c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c15bc70 con 0x7f024c0d0730 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f02440019f0 con 0x7f024c0d0730 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 >> v1:172.21.15.79:6789/0 conn(0x7f024c0d0730 legacy=0x7f024c06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380039b0 0x7f0238003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0238004800 0x7f0238004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380051c0 0x7f023800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f024c15b990 con 0x7f0238004800 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f023800c060 con 0x7f02380051c0 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f023800c260 con 0x7f02380039b0 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0250fc7640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0238004800 0x7f0238004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f02517c8640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380039b0 0x7f0238003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0251fc9640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380051c0 0x7f023800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0250fc7640 1 -- 172.21.15.79:0/459277834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380039b0 msgr2=0x7f0238003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0250fc7640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380039b0 0x7f0238003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0250fc7640 1 -- 172.21.15.79:0/459277834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380051c0 msgr2=0x7f023800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0250fc7640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380051c0 0x7f023800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0251fc9640 1 -- 172.21.15.79:0/459277834 reap_dead start 2024-06-10T00:24:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.838+0000 7f0250fc7640 1 -- 172.21.15.79:0/459277834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0238003520 con 0x7f0238004800 2024-06-10T00:24:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.839+0000 7f0250fc7640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0238004800 0x7f0238004c80 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f023c001750 tx=0x7f0238005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290888e6ba863384 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.839+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c001370 con 0x7f0238004800 2024-06-10T00:24:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.839+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023c0052d0 con 0x7f0238004800 2024-06-10T00:24:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.839+0000 7f0243fff640 1 -- 172.21.15.79:0/459277834 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c02abc0 con 0x7f0238004800 2024-06-10T00:24:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.840+0000 7f0253a2c640 1 -- 172.21.15.79:0/459277834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0238004800 msgr2=0x7f0238004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.840+0000 7f0253a2c640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0238004800 0x7f0238004c80 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f023c001750 tx=0x7f0238005830 comp rx=0 tx=0).stop 2024-06-10T00:24:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.840+0000 7f0253a2c640 1 -- 172.21.15.79:0/459277834 shutdown_connections 2024-06-10T00:24:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.840+0000 7f0253a2c640 1 --2- 172.21.15.79:0/459277834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0238004800 0x7f0238004c80 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.840+0000 7f0253a2c640 1 -- 172.21.15.79:0/459277834 >> 172.21.15.79:0/459277834 conn(0x7f024c0b1d10 msgr2=0x7f024c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.840+0000 7f0253a2c640 1 -- 172.21.15.79:0/459277834 shutdown_connections 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.840+0000 7f0253a2c640 1 -- 172.21.15.79:0/459277834 wait complete. 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.841+0000 7f0253a2c640 1 Processor -- start 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.841+0000 7f0253a2c640 1 -- start start 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0253a2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0238004800 0x7f024c156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0253a2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024c0cb510 0x7f024c1e7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0253a2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c1e4ef0 0x7f024c1e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0253a2c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f024c15b470 con 0x7f024c0cb510 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0253a2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f024c15b2f0 con 0x7f024c1e4ef0 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0253a2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f024c0b2fa0 con 0x7f0238004800 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024c0cb510 0x7f024c1e7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024c0cb510 0x7f024c1e7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59794/0 (socket says 172.21.15.79:59794) 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 -- 172.21.15.79:0/864420489 learned_addr learned my addr 172.21.15.79:0/864420489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0251fc9640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c1e4ef0 0x7f024c1e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f02517c8640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0238004800 0x7f024c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 -- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0238004800 msgr2=0x7f024c156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0238004800 0x7f024c156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 -- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c1e4ef0 msgr2=0x7f024c1e53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c1e4ef0 0x7f024c1e53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 -- 172.21.15.79:0/864420489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c1e83d0 con 0x7f024c0cb510 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f02517c8640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0238004800 0x7f024c156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.842+0000 7f0250fc7640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024c0cb510 0x7f024c1e7e90 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f023c005040 tx=0x7f023c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.843+0000 7f0241ffb640 1 -- 172.21.15.79:0/864420489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c03f020 con 0x7f024c0cb510 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.843+0000 7f0241ffb640 1 -- 172.21.15.79:0/864420489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023c005480 con 0x7f024c0cb510 2024-06-10T00:24:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.843+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c156b20 con 0x7f024c0cb510 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.843+0000 7f0241ffb640 1 -- 172.21.15.79:0/864420489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c037040 con 0x7f024c0cb510 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.843+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c1570e0 con 0x7f024c0cb510 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.844+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024c0683c0 con 0x7f024c0cb510 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.844+0000 7f0241ffb640 1 -- 172.21.15.79:0/864420489 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f023c042020 con 0x7f024c0cb510 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.845+0000 7f0241ffb640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f023006be60 0x7f023006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.845+0000 7f0241ffb640 1 -- 172.21.15.79:0/864420489 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f023c0aaa90 con 0x7f024c0cb510 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.845+0000 7f02517c8640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f023006be60 0x7f023006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.845+0000 7f02517c8640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f023006be60 0x7f023006e320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0248009c40 tx=0x7f0248008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:19.849+0000 7f0241ffb640 1 -- 172.21.15.79:0/864420489 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f023c049020 con 0x7f024c0cb510 2024-06-10T00:24:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.023+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f024c155700 con 0x7f024c0cb510 2024-06-10T00:24:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.026+0000 7f0241ffb640 1 -- 172.21.15.79:0/864420489 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f024c1e83d0 con 0x7f024c0cb510 2024-06-10T00:24:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f023006be60 msgr2=0x7f023006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f023006be60 0x7f023006e320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0248009c40 tx=0x7f0248008040 comp rx=0 tx=0).stop 2024-06-10T00:24:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024c0cb510 msgr2=0x7f024c1e7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024c0cb510 0x7f024c1e7e90 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f023c005040 tx=0x7f023c001120 comp rx=0 tx=0).stop 2024-06-10T00:24:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 shutdown_connections 2024-06-10T00:24:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f023006be60 0x7f023006e320 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c1e4ef0 0x7f024c1e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024c0cb510 0x7f024c1e7e90 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 --2- 172.21.15.79:0/864420489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0238004800 0x7f024c156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 >> 172.21.15.79:0/864420489 conn(0x7f024c0b1d10 msgr2=0x7f024c072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.028+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 shutdown_connections 2024-06-10T00:24:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.029+0000 7f0253a2c640 1 -- 172.21.15.79:0/864420489 wait complete. 2024-06-10T00:24:20.039 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:24:20.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:24:20.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:24:20.125 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:24:20.126 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:20.126 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:20.142 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:24:20.142 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:24:20.142 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:20.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:24:20.160 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:20.160 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:20.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:24:20.198 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:24:20.198 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:20.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:24:20.218 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-10T00:24:20.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:20.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.337+0000 7f7372516640 1 Processor -- start 2024-06-10T00:24:20.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.337+0000 7f7372516640 1 -- start start 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.338+0000 7f7372516640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f736c0ae910 0x7f736c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.338+0000 7f7372516640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.338+0000 7f7372516640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f736c0cf620 con 0x7f736c0cf190 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.338+0000 7f7372516640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f736c06ee60 con 0x7f736c0ae910 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.338+0000 7f7372516640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f736c06d130 con 0x7f736c06ea20 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f736c0ae910 0x7f736c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:53162/0 (socket says 172.21.15.79:53162) 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736b7fe640 1 -- 172.21.15.79:0/1487567301 learned_addr learned my addr 172.21.15.79:0/1487567301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f7370ab3640 1 --1- 172.21.15.79:0/1487567301 >> v1:172.21.15.117:6789/0 conn(0x7f736c0cf190 0x7f736c15ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:60486/0 (socket says 172.21.15.79:60486) 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736b7fe640 1 -- 172.21.15.79:0/1487567301 >> v2:172.21.15.117:3300/0 conn(0x7f736c0ae910 msgr2=0x7f736c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736b7fe640 1 --2- 172.21.15.79:0/1487567301 >> v2:172.21.15.117:3300/0 conn(0x7f736c0ae910 0x7f736c06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736b7fe640 1 -- 172.21.15.79:0/1487567301 >> v1:172.21.15.117:6789/0 conn(0x7f736c0cf190 legacy=0x7f736c15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:20.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736b7fe640 1 -- 172.21.15.79:0/1487567301 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c06d410 con 0x7f736c06ea20 2024-06-10T00:24:20.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.339+0000 7f736bfff640 1 --2- 172.21.15.79:0/1487567301 >> v2:172.21.15.117:3300/0 conn(0x7f736c0ae910 0x7f736c06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:24:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f736b7fe640 1 --2- 172.21.15.79:0/1487567301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cec50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73600098a0 tx=0x7f736002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2e9770b4f6a6299 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f736affd640 1 -- 172.21.15.79:0/1487567301 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360037070 con 0x7f736c06ea20 2024-06-10T00:24:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f736affd640 1 -- 172.21.15.79:0/1487567301 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7360032440 con 0x7f736c06ea20 2024-06-10T00:24:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f736affd640 1 -- 172.21.15.79:0/1487567301 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360032810 con 0x7f736c06ea20 2024-06-10T00:24:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f7372516640 1 -- 172.21.15.79:0/1487567301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 msgr2=0x7f736c0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f7372516640 1 --2- 172.21.15.79:0/1487567301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cec50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73600098a0 tx=0x7f736002a200 comp rx=0 tx=0).stop 2024-06-10T00:24:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f7372516640 1 -- 172.21.15.79:0/1487567301 shutdown_connections 2024-06-10T00:24:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f7372516640 1 --2- 172.21.15.79:0/1487567301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cec50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f7372516640 1 --2- 172.21.15.79:0/1487567301 >> v2:172.21.15.117:3300/0 conn(0x7f736c0ae910 0x7f736c06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f7372516640 1 -- 172.21.15.79:0/1487567301 >> 172.21.15.79:0/1487567301 conn(0x7f736c0b19f0 msgr2=0x7f736c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f7372516640 1 -- 172.21.15.79:0/1487567301 shutdown_connections 2024-06-10T00:24:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.340+0000 7f7372516640 1 -- 172.21.15.79:0/1487567301 wait complete. 2024-06-10T00:24:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.342+0000 7f7372516640 1 Processor -- start 2024-06-10T00:24:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.342+0000 7f7372516640 1 -- start start 2024-06-10T00:24:20.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.342+0000 7f7372516640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:20.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.342+0000 7f7372516640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c0ae910 0x7f736c0d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.342+0000 7f7372516640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f736c0cf190 0x7f736c1e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.342+0000 7f7372516640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f736c0aecf0 con 0x7f736c0cf190 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.342+0000 7f7372516640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f736c06d9d0 con 0x7f736c0ae910 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.342+0000 7f7372516640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f736c0add50 con 0x7f736c06ea20 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f736c0cf190 0x7f736c1e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f736c0cf190 0x7f736c1e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59810/0 (socket says 172.21.15.79:59810) 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 -- 172.21.15.79:0/3596336602 learned_addr learned my addr 172.21.15.79:0/3596336602 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f736bfff640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f736b7fe640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c0ae910 0x7f736c0d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 -- 172.21.15.79:0/3596336602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 msgr2=0x7f736c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 -- 172.21.15.79:0/3596336602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c0ae910 msgr2=0x7f736c0d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c0ae910 0x7f736c0d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 -- 172.21.15.79:0/3596336602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c15cfc0 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7370ab3640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f736c0cf190 0x7f736c1e3770 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f736400c7b0 tx=0x7f736400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7368ff9640 1 -- 172.21.15.79:0/3596336602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364017070 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7368ff9640 1 -- 172.21.15.79:0/3596336602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736400a640 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c15d2a0 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7368ff9640 1 -- 172.21.15.79:0/3596336602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736400a9f0 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.343+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c09b170 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.344+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f736c068430 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.345+0000 7f7368ff9640 1 -- 172.21.15.79:0/3596336602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f736401a070 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.345+0000 7f7368ff9640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f735806be30 0x7f735806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.345+0000 7f7368ff9640 1 -- 172.21.15.79:0/3596336602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f736408a250 con 0x7f736c0cf190 2024-06-10T00:24:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.345+0000 7f736bfff640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f735806be30 0x7f735806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.346+0000 7f736bfff640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f735806be30 0x7f735806e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f735c009560 tx=0x7f735c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:20.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.349+0000 7f7368ff9640 1 -- 172.21.15.79:0/3596336602 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f73640586e0 con 0x7f736c0cf190 2024-06-10T00:24:20.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.559+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f736c09de00 con 0x7f736c0cf190 2024-06-10T00:24:20.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.559+0000 7f7368ff9640 1 -- 172.21.15.79:0/3596336602 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+3875 (secure 0 0 0) 0x7f736405c9e0 con 0x7f736c0cf190 2024-06-10T00:24:20.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:20.559 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3244633308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3244633308},{"type":"v1","addr":"172.21.15.117:6835","nonce":3244633308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6496,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2123107205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2123107205},{"type":"v1","addr":"172.21.15.117:6834","nonce":2123107205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/1412645467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1412645467},{"type":"v1","addr":"172.21.15.79:6836","nonce":1412645467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3523408596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3523408596},{"type":"v1","addr":"172.21.15.79:6837","nonce":3523408596}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[]} 2024-06-10T00:24:20.559 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 78 2024-06-10T00:24:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f735806be30 msgr2=0x7f735806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f735806be30 0x7f735806e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f735c009560 tx=0x7f735c008040 comp rx=0 tx=0).stop 2024-06-10T00:24:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f736c0cf190 msgr2=0x7f736c1e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f736c0cf190 0x7f736c1e3770 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f736400c7b0 tx=0x7f736400cc70 comp rx=0 tx=0).stop 2024-06-10T00:24:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 shutdown_connections 2024-06-10T00:24:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f735806be30 0x7f735806e2f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f736c0cf190 0x7f736c1e3770 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c0ae910 0x7f736c0d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 --2- 172.21.15.79:0/3596336602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736c06ea20 0x7f736c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 >> 172.21.15.79:0/3596336602 conn(0x7f736c0b19f0 msgr2=0x7f736c0b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 shutdown_connections 2024-06-10T00:24:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:20.561+0000 7f7372516640 1 -- 172.21.15.79:0/3596336602 wait complete. 2024-06-10T00:24:20.572 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-10T00:24:20.572 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-10T00:24:20.573 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-10T00:24:20.573 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:24:20.573 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-10T00:24:20.573 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-10T00:24:20.573 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-10T00:24:20.573 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:24:20.573 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-10T00:24:20.573 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-10T00:24:20.574 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-10T00:24:20.574 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:24:20.574 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-10T00:24:20.574 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-10T00:24:20.574 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-10T00:24:20.574 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:24:20.584 INFO:tasks.ceph.mds.a:Stopped 2024-06-10T00:24:20.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-10T00:24:20.585 INFO:tasks.ceph.mds.c:Stopped 2024-06-10T00:24:20.585 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-10T00:24:20.587 INFO:tasks.ceph.mds.b:Stopped 2024-06-10T00:24:20.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-10T00:24:20.627 INFO:tasks.ceph.mds.a:Started 2024-06-10T00:24:20.627 DEBUG:teuthology.parallel:result is None 2024-06-10T00:24:20.628 INFO:tasks.ceph.mds.c:Started 2024-06-10T00:24:20.628 DEBUG:teuthology.parallel:result is None 2024-06-10T00:24:20.630 INFO:tasks.ceph.mds.b:Started 2024-06-10T00:24:20.630 DEBUG:teuthology.parallel:result is None 2024-06-10T00:24:20.701 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:24:20.701 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2024-06-10T00:24:20.702 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:24:20.702+0000 7fa5c4406640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-06-10T00:24:20.713 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-06-10T00:24:22.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-06-10T00:24:26.587 INFO:tasks.ceph.mds.d:Stopped 2024-06-10T00:24:26.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-10T00:24:26.590 INFO:tasks.ceph.mds.d:Started 2024-06-10T00:24:26.590 DEBUG:teuthology.parallel:result is None 2024-06-10T00:24:26.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-10T00:24:26.674 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-06-10T00:24:26.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.704+0000 7f1736464640 1 Processor -- start 2024-06-10T00:24:26.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.704+0000 7f1736464640 1 -- start start 2024-06-10T00:24:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1736464640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f173006ebf0 0x7f17300cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1736464640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17300cf190 0x7f17300acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1736464640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17300cf600 con 0x7f17300ae910 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1736464640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f173006d130 con 0x7f17300cf190 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1736464640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f173006d410 con 0x7f173006ebf0 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1734a01640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17300cf190 0x7f17300acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1734a01640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17300cf190 0x7f17300acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59838/0 (socket says 172.21.15.79:59838) 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f172ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f17300ae910 0x7f173006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:60498/0 (socket says 172.21.15.79:60498) 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1734a01640 1 -- 172.21.15.79:0/2320839948 learned_addr learned my addr 172.21.15.79:0/2320839948 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f172f7fe640 1 --2- 172.21.15.79:0/2320839948 >> v2:172.21.15.117:3300/0 conn(0x7f173006ebf0 0x7f17300cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1734a01640 1 -- 172.21.15.79:0/2320839948 >> v2:172.21.15.117:3300/0 conn(0x7f173006ebf0 msgr2=0x7f17300cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1734a01640 1 --2- 172.21.15.79:0/2320839948 >> v2:172.21.15.117:3300/0 conn(0x7f173006ebf0 0x7f17300cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1734a01640 1 -- 172.21.15.79:0/2320839948 >> v1:172.21.15.117:6789/0 conn(0x7f17300ae910 legacy=0x7f173006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.705+0000 7f1734a01640 1 -- 172.21.15.79:0/2320839948 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173006d6f0 con 0x7f17300cf190 2024-06-10T00:24:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.706+0000 7f1734a01640 1 --2- 172.21.15.79:0/2320839948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17300cf190 0x7f17300acd40 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1730070c80 tx=0x7f172802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e29a94b09ec087 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.706+0000 7f172effd640 1 -- 172.21.15.79:0/2320839948 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728036070 con 0x7f17300cf190 2024-06-10T00:24:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.706+0000 7f172effd640 1 -- 172.21.15.79:0/2320839948 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1728031600 con 0x7f17300cf190 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.706+0000 7f172effd640 1 -- 172.21.15.79:0/2320839948 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17280319d0 con 0x7f17300cf190 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.707+0000 7f1736464640 1 -- 172.21.15.79:0/2320839948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17300cf190 msgr2=0x7f17300acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.707+0000 7f1736464640 1 --2- 172.21.15.79:0/2320839948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17300cf190 0x7f17300acd40 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1730070c80 tx=0x7f172802a6a0 comp rx=0 tx=0).stop 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.707+0000 7f1736464640 1 -- 172.21.15.79:0/2320839948 shutdown_connections 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.707+0000 7f1736464640 1 --2- 172.21.15.79:0/2320839948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17300cf190 0x7f17300acd40 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.707+0000 7f1736464640 1 --2- 172.21.15.79:0/2320839948 >> v2:172.21.15.117:3300/0 conn(0x7f173006ebf0 0x7f17300cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.707+0000 7f1736464640 1 -- 172.21.15.79:0/2320839948 >> 172.21.15.79:0/2320839948 conn(0x7f17300b19f0 msgr2=0x7f17300b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.707+0000 7f1736464640 1 -- 172.21.15.79:0/2320839948 shutdown_connections 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.707+0000 7f1736464640 1 -- 172.21.15.79:0/2320839948 wait complete. 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.708+0000 7f1736464640 1 Processor -- start 2024-06-10T00:24:26.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.708+0000 7f1736464640 1 -- start start 2024-06-10T00:24:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f1736464640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f173006ebf0 0x7f1730154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f1736464640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17300ae910 0x7f17300b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f1736464640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17300cf190 0x7f17301f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f1736464640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f17300ad280 con 0x7f173006ebf0 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f1736464640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f17300aecf0 con 0x7f17300ae910 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f1736464640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f17300ad400 con 0x7f17300cf190 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f173006ebf0 0x7f1730154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f173006ebf0 0x7f1730154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59846/0 (socket says 172.21.15.79:59846) 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172ffff640 1 -- 172.21.15.79:0/2920546882 learned_addr learned my addr 172.21.15.79:0/2920546882 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172f7fe640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17300ae910 0x7f17300b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f1734a01640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17300cf190 0x7f17301f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172ffff640 1 -- 172.21.15.79:0/2920546882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17300cf190 msgr2=0x7f17301f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172ffff640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17300cf190 0x7f17301f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172ffff640 1 -- 172.21.15.79:0/2920546882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17300ae910 msgr2=0x7f17300b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172ffff640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17300ae910 0x7f17300b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.709+0000 7f172ffff640 1 -- 172.21.15.79:0/2920546882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17300b07c0 con 0x7f173006ebf0 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.710+0000 7f172ffff640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f173006ebf0 0x7f1730154cf0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f172000c400 tx=0x7f172000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.710+0000 7f172cff9640 1 -- 172.21.15.79:0/2920546882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17200074e0 con 0x7f173006ebf0 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.710+0000 7f172cff9640 1 -- 172.21.15.79:0/2920546882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1720007680 con 0x7f173006ebf0 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.710+0000 7f172cff9640 1 -- 172.21.15.79:0/2920546882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720004a00 con 0x7f173006ebf0 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.710+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17300b0aa0 con 0x7f173006ebf0 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.710+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17300b1060 con 0x7f173006ebf0 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.711+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1730068430 con 0x7f173006ebf0 2024-06-10T00:24:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.711+0000 7f172cff9640 1 -- 172.21.15.79:0/2920546882 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f172001a020 con 0x7f173006ebf0 2024-06-10T00:24:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.712+0000 7f172cff9640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f171006be30 0x7f171006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.712+0000 7f172cff9640 1 -- 172.21.15.79:0/2920546882 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5421+0+0 (secure 0 0 0) 0x7f172008a410 con 0x7f173006ebf0 2024-06-10T00:24:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.712+0000 7f172f7fe640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f171006be30 0x7f171006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.712+0000 7f172f7fe640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f171006be30 0x7f171006e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1730155230 tx=0x7f1718009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.716+0000 7f172cff9640 1 -- 172.21.15.79:0/2920546882 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1720058890 con 0x7f173006ebf0 2024-06-10T00:24:26.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:26.902+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f17300b20e0 con 0x7f173006ebf0 2024-06-10T00:24:28.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.037+0000 7f172cff9640 1 -- 172.21.15.79:0/2920546882 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v115) ==== 97+0+0 (secure 0 0 0) 0x7f172005cb90 con 0x7f173006ebf0 2024-06-10T00:24:28.037 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f171006be30 msgr2=0x7f171006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f171006be30 0x7f171006e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1730155230 tx=0x7f1718009190 comp rx=0 tx=0).stop 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f173006ebf0 msgr2=0x7f1730154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f173006ebf0 0x7f1730154cf0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f172000c400 tx=0x7f172000c8c0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 shutdown_connections 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f171006be30 0x7f171006e2f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17300cf190 0x7f17301f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17300ae910 0x7f17300b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 --2- 172.21.15.79:0/2920546882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f173006ebf0 0x7f1730154cf0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 >> 172.21.15.79:0/2920546882 conn(0x7f17300b19f0 msgr2=0x7f1730071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:28.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 shutdown_connections 2024-06-10T00:24:28.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.041+0000 7f1736464640 1 -- 172.21.15.79:0/2920546882 wait complete. 2024-06-10T00:24:28.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-10T00:24:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.160+0000 7f95a5389640 1 Processor -- start 2024-06-10T00:24:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.160+0000 7f95a5389640 1 -- start start 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f95a5389640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95a0073080 0x7f95a00cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f95a5389640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a00ca9f0 con 0x7f95a00cc180 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f95a5389640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a00cacb0 con 0x7f95a0072ca0 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f95a5389640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f95a00cba70 con 0x7f95a0073080 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f95967fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95a0073080 0x7f95a00cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f959f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f95a00cc180 0x7f95a00cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42236/0 (socket says 172.21.15.79:42236) 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f959f7fe640 1 -- 172.21.15.79:0/4097925671 learned_addr learned my addr 172.21.15.79:0/4097925671 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f95967fc640 1 -- 172.21.15.79:0/4097925671 >> v1:172.21.15.117:6789/0 conn(0x7f95a0072ca0 legacy=0x7f95a006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f95967fc640 1 -- 172.21.15.79:0/4097925671 >> v1:172.21.15.79:6789/0 conn(0x7f95a00cc180 legacy=0x7f95a00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f959e7fc640 1 -- 172.21.15.79:0/4097925671 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690840732 0 0) 0x7f95a00ca9f0 con 0x7f95a00cc180 2024-06-10T00:24:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.161+0000 7f95967fc640 1 -- 172.21.15.79:0/4097925671 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a00caf90 con 0x7f95a0073080 2024-06-10T00:24:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.162+0000 7f95967fc640 1 --2- 172.21.15.79:0/4097925671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cbc40 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f95880097a0 tx=0x7f958802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731256e225c4819b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.162+0000 7f959e7fc640 1 -- 172.21.15.79:0/4097925671 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588037070 con 0x7f95a0073080 2024-06-10T00:24:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.162+0000 7f959e7fc640 1 -- 172.21.15.79:0/4097925671 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9588032440 con 0x7f95a0073080 2024-06-10T00:24:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.162+0000 7f959e7fc640 1 -- 172.21.15.79:0/4097925671 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588032810 con 0x7f95a0073080 2024-06-10T00:24:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.163+0000 7f95a5389640 1 -- 172.21.15.79:0/4097925671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 msgr2=0x7f95a00cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.163+0000 7f95a5389640 1 --2- 172.21.15.79:0/4097925671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cbc40 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f95880097a0 tx=0x7f958802a1e0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.163+0000 7f95a5389640 1 -- 172.21.15.79:0/4097925671 shutdown_connections 2024-06-10T00:24:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.163+0000 7f95a5389640 1 --2- 172.21.15.79:0/4097925671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cbc40 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.163+0000 7f95a5389640 1 -- 172.21.15.79:0/4097925671 >> 172.21.15.79:0/4097925671 conn(0x7f95a00b1bb0 msgr2=0x7f95a00b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.163+0000 7f95a5389640 1 -- 172.21.15.79:0/4097925671 shutdown_connections 2024-06-10T00:24:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.163+0000 7f95a5389640 1 -- 172.21.15.79:0/4097925671 wait complete. 2024-06-10T00:24:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.164+0000 7f95a5389640 1 Processor -- start 2024-06-10T00:24:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.164+0000 7f95a5389640 1 -- start start 2024-06-10T00:24:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95a5389640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95a0072ca0 0x7f95a00b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95a5389640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95a5389640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95a00cc180 0x7f95a00c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95a5389640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95a006f0b0 con 0x7f95a0073080 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95a5389640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f95a00cb5e0 con 0x7f95a0072ca0 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95a5389640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95a00ca670 con 0x7f95a00cc180 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95967fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95967fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36550/0 (socket says 172.21.15.79:36550) 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95967fc640 1 -- 172.21.15.79:0/2040527709 learned_addr learned my addr 172.21.15.79:0/2040527709 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f959effd640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95a0072ca0 0x7f95a00b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95967fc640 1 -- 172.21.15.79:0/2040527709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95a00cc180 msgr2=0x7f95a00c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95967fc640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95a00cc180 0x7f95a00c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95967fc640 1 -- 172.21.15.79:0/2040527709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95a0072ca0 msgr2=0x7f95a00b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.165+0000 7f95967fc640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95a0072ca0 0x7f95a00b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.166+0000 7f95967fc640 1 -- 172.21.15.79:0/2040527709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a01f82e0 con 0x7f95a0073080 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.166+0000 7f959effd640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95a0072ca0 0x7f95a00b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.166+0000 7f95967fc640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cf5a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f95880098c0 tx=0x7f95880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.166+0000 7f9597fff640 1 -- 172.21.15.79:0/2040527709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588041070 con 0x7f95a0073080 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.166+0000 7f9597fff640 1 -- 172.21.15.79:0/2040527709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958803c870 con 0x7f95a0073080 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.166+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a01f7760 con 0x7f95a0073080 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.166+0000 7f9597fff640 1 -- 172.21.15.79:0/2040527709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588037040 con 0x7f95a0073080 2024-06-10T00:24:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.166+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01f7d20 con 0x7f95a0073080 2024-06-10T00:24:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.167+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a0068430 con 0x7f95a0073080 2024-06-10T00:24:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.167+0000 7f9597fff640 1 -- 172.21.15.79:0/2040527709 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9588044070 con 0x7f95a0073080 2024-06-10T00:24:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.168+0000 7f9597fff640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f958006be30 0x7f958006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.168+0000 7f9597fff640 1 -- 172.21.15.79:0/2040527709 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5249+0+0 (secure 0 0 0) 0x7f95880ab7e0 con 0x7f95a0073080 2024-06-10T00:24:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.168+0000 7f959effd640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f958006be30 0x7f958006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.168+0000 7f959effd640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f958006be30 0x7f958006e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9590007fd0 tx=0x7f9590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.172+0000 7f9597fff640 1 -- 172.21.15.79:0/2040527709 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f958807a470 con 0x7f95a0073080 2024-06-10T00:24:28.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.415+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f95a00d0c00 con 0x7f95a0073080 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.415+0000 7f9597fff640 1 -- 172.21.15.79:0/2040527709 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f9588079d70 con 0x7f95a0073080 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmeSXwHBAAj13lh50hKjaftHdnMglgkA==", 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZm1v+EKBAAej/8Gclz+ULSmPE5wuIEow==", 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmNNnzIxAARtrvIEsFpUTR4KARk6enOQ==", 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmPj1yLxAAR5nFnbhWgw4C/moKCeZ7Gw==", 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2024-06-10T00:24:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA9RWZmG264DhAAsrdXNzMfT1O6Y4cvuKApWw==", 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBARWZmtlBODhAAd7jgp+88ltVJ6mAJr8eVhg==", 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:24:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBDRWZmH+8pDBAA6sDXfwjDFh+SUJOAyx/fLg==", 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2024-06-10T00:24:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBGRWZmyqNfChAANhUGP9xE+M9orgLu+C6W7g==", 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBMRWZmTaRYDRAA68E+mMx11q3UCrbUikrdJw==", 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBPRWZmpELsCxAA7Knl0l052IGTRbnl/FS5mw==", 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2024-06-10T00:24:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBSRWZm6Xo7ChAAra7c2j24c+1oe/uJAqlTAQ==", 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQBVRWZmaZp5CxAAgTnBrH63LTscJcoSFgpogA==", 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw==", 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmGKGgABAAd1O4SY1xzsZHnaQIjhEKCA==", 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmnTcDORAASdb+z25MKRdAQvUKXTTz4A==", 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:24:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA6RWZmRDswBhAAERAxn4X+5va2wEuZFE8aFw==", 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmQYVlARAAk+Jo8bykvpKKZY5XAPe2ZA==", 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmgbrEGRAAk0GfSkclvFSj2NYY7tzJBA==", 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQA5RWZmVRnWFRAA/0mUJq2z2T2ZG/xihFt9kw==", 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-10T00:24:28.429 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f958006be30 msgr2=0x7f958006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f958006be30 0x7f958006e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9590007fd0 tx=0x7f9590009040 comp rx=0 tx=0).stop 2024-06-10T00:24:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 msgr2=0x7f95a00cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cf5a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f95880098c0 tx=0x7f95880046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 shutdown_connections 2024-06-10T00:24:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f958006be30 0x7f958006e2f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95a00cc180 0x7f95a00c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0073080 0x7f95a00cf5a0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 --2- 172.21.15.79:0/2040527709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95a0072ca0 0x7f95a00b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.417+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 >> 172.21.15.79:0/2040527709 conn(0x7f95a00b1bb0 msgr2=0x7f95a00acf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.418+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 shutdown_connections 2024-06-10T00:24:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.418+0000 7f95a5389640 1 -- 172.21.15.79:0/2040527709 wait complete. 2024-06-10T00:24:28.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-10T00:24:28.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.531+0000 7f7e4d8ba640 1 Processor -- start 2024-06-10T00:24:28.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.531+0000 7f7e4d8ba640 1 -- start start 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e4d8ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e480730d0 0x7f7e480b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e4d8ba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e480b5f80 con 0x7f7e48072350 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e4d8ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e480b56e0 con 0x7f7e480b5140 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e4d8ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7e480b59c0 con 0x7f7e480730d0 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e46ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7e48072350 0x7f7e48072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42246/0 (socket says 172.21.15.79:42246) 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e46ffd640 1 -- 172.21.15.79:0/3156230837 learned_addr learned my addr 172.21.15.79:0/3156230837 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e3e7fc640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e480730d0 0x7f7e480b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612008721 0 0) 0x7f7e480b5f80 con 0x7f7e48072350 2024-06-10T00:24:28.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e34003520 con 0x7f7e48072350 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 698159556 0 0) 0x7f7e34003520 con 0x7f7e48072350 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e480730d0 msgr2=0x7f7e480b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e480730d0 0x7f7e480b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 >> v1:172.21.15.117:6789/0 conn(0x7f7e480b5140 legacy=0x7f7e480cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e480b5ca0 con 0x7f7e48072350 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f7e38001670 con 0x7f7e48072350 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 >> v1:172.21.15.79:6789/0 conn(0x7f7e48072350 legacy=0x7f7e48072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e340039e0 0x7f7e34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e34004390 0x7f7e34004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e480730d0 0x7f7e34005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e480b59c0 con 0x7f7e340039e0 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3400ba70 con 0x7f7e34004390 2024-06-10T00:24:28.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7e3400bc70 con 0x7f7e480730d0 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.532+0000 7f7e46ffd640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e340039e0 0x7f7e34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.533+0000 7f7e3e7fc640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e34004390 0x7f7e34004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.533+0000 7f7e477fe640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e480730d0 0x7f7e34005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.533+0000 7f7e46ffd640 1 -- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e480730d0 msgr2=0x7f7e34005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.533+0000 7f7e46ffd640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e480730d0 0x7f7e34005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.533+0000 7f7e46ffd640 1 -- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e34004390 msgr2=0x7f7e34004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.533+0000 7f7e46ffd640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e34004390 0x7f7e34004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.533+0000 7f7e46ffd640 1 -- 172.21.15.79:0/3156230837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e34003520 con 0x7f7e340039e0 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.533+0000 7f7e46ffd640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e340039e0 0x7f7e34003dc0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c210 tx=0x7f7e34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95d2e40639dbf2f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38007ce0 con 0x7f7e340039e0 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e38005af0 con 0x7f7e340039e0 2024-06-10T00:24:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e467fc640 1 -- 172.21.15.79:0/3156230837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38007070 con 0x7f7e340039e0 2024-06-10T00:24:28.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/3156230837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e340039e0 msgr2=0x7f7e34003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e4d8ba640 1 --2- 172.21.15.79:0/3156230837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e340039e0 0x7f7e34003dc0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c210 tx=0x7f7e34005830 comp rx=0 tx=0).stop 2024-06-10T00:24:28.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e477fe640 1 -- 172.21.15.79:0/3156230837 reap_dead start 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/3156230837 shutdown_connections 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/3156230837 >> 172.21.15.79:0/3156230837 conn(0x7f7e480b2ae0 msgr2=0x7f7e480b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/3156230837 shutdown_connections 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.534+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/3156230837 wait complete. 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.535+0000 7f7e4d8ba640 1 Processor -- start 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.535+0000 7f7e4d8ba640 1 -- start start 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e4d8ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e340039e0 0x7f7e4815f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e4d8ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e48152760 0x7f7e480af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e4d8ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e48145740 0x7f7e4815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e4d8ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4815c630 con 0x7f7e48145740 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e4d8ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4815c4b0 con 0x7f7e340039e0 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e4d8ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7e480b4c00 con 0x7f7e48152760 2024-06-10T00:24:28.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e48145740 0x7f7e4815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e48145740 0x7f7e4815d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36564/0 (socket says 172.21.15.79:36564) 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e477fe640 1 -- 172.21.15.79:0/2103787659 learned_addr learned my addr 172.21.15.79:0/2103787659 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e3e7fc640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e48152760 0x7f7e480af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.536+0000 7f7e46ffd640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e340039e0 0x7f7e4815f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e477fe640 1 -- 172.21.15.79:0/2103787659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e48152760 msgr2=0x7f7e480af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e477fe640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e48152760 0x7f7e480af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e477fe640 1 -- 172.21.15.79:0/2103787659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e340039e0 msgr2=0x7f7e4815f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e477fe640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e340039e0 0x7f7e4815f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e477fe640 1 -- 172.21.15.79:0/2103787659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e480ae770 con 0x7f7e48145740 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e477fe640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e48145740 0x7f7e4815d270 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7e48071f00 tx=0x7f7e4000feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e44ff9640 1 -- 172.21.15.79:0/2103787659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40019070 con 0x7f7e48145740 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e44ff9640 1 -- 172.21.15.79:0/2103787659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e40006e20 con 0x7f7e48145740 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e48156ed0 con 0x7f7e48145740 2024-06-10T00:24:28.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e44ff9640 1 -- 172.21.15.79:0/2103787659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40003bb0 con 0x7f7e48145740 2024-06-10T00:24:28.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.537+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e480ae9e0 con 0x7f7e48145740 2024-06-10T00:24:28.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.538+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e48068430 con 0x7f7e48145740 2024-06-10T00:24:28.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.538+0000 7f7e44ff9640 1 -- 172.21.15.79:0/2103787659 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e4001c070 con 0x7f7e48145740 2024-06-10T00:24:28.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.539+0000 7f7e44ff9640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7e2806be30 0x7f7e2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.539+0000 7f7e44ff9640 1 -- 172.21.15.79:0/2103787659 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5249+0+0 (secure 0 0 0) 0x7f7e40089e50 con 0x7f7e48145740 2024-06-10T00:24:28.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.539+0000 7f7e46ffd640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7e2806be30 0x7f7e2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.539+0000 7f7e46ffd640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7e2806be30 0x7f7e2806e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7e38032000 tx=0x7f7e38034040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.543+0000 7f7e44ff9640 1 -- 172.21.15.79:0/2103787659 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7e40058370 con 0x7f7e48145740 2024-06-10T00:24:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.717+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7e480afde0 con 0x7f7e48145740 2024-06-10T00:24:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.717+0000 7f7e44ff9640 1 -- 172.21.15.79:0/2103787659 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v115) ==== 84+0+65 (secure 0 0 0) 0x7f7e4005c670 con 0x7f7e48145740 2024-06-10T00:24:28.717 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:28.717 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-06-10T00:24:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-06-10T00:24:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-06-10T00:24:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-06-10T00:24:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:28.718 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-06-10T00:24:28.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.719+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7e2806be30 msgr2=0x7f7e2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.719+0000 7f7e4d8ba640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7e2806be30 0x7f7e2806e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7e38032000 tx=0x7f7e38034040 comp rx=0 tx=0).stop 2024-06-10T00:24:28.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.719+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e48145740 msgr2=0x7f7e4815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.719+0000 7f7e4d8ba640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e48145740 0x7f7e4815d270 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7e48071f00 tx=0x7f7e4000feb0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.720+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 shutdown_connections 2024-06-10T00:24:28.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.720+0000 7f7e4d8ba640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7e2806be30 0x7f7e2806e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.720+0000 7f7e4d8ba640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e48145740 0x7f7e4815d270 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.720+0000 7f7e4d8ba640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e48152760 0x7f7e480af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.720+0000 7f7e4d8ba640 1 --2- 172.21.15.79:0/2103787659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e340039e0 0x7f7e4815f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.720+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 >> 172.21.15.79:0/2103787659 conn(0x7f7e480b2ae0 msgr2=0x7f7e480b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:28.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.720+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 shutdown_connections 2024-06-10T00:24:28.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.720+0000 7f7e4d8ba640 1 -- 172.21.15.79:0/2103787659 wait complete. 2024-06-10T00:24:28.730 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-10T00:24:28.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-10T00:24:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.834+0000 7efd07ee1640 1 Processor -- start 2024-06-10T00:24:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.834+0000 7efd07ee1640 1 -- start start 2024-06-10T00:24:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd07ee1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efd0015a810 0x7efd000b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd07ee1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd000b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd07ee1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd00073270 con 0x7efd000af420 2024-06-10T00:24:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd07ee1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efd000ce560 con 0x7efd0015a810 2024-06-10T00:24:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd07ee1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efd000b4e30 con 0x7efd00072020 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd0647e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd000b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd05c7d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efd0015a810 0x7efd000b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd0547c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7efd000af420 0x7efd0015e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:49394/0 (socket says 172.21.15.79:49394) 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd0547c640 1 -- 172.21.15.79:0/1995084398 learned_addr learned my addr 172.21.15.79:0/1995084398 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd0647e640 1 -- 172.21.15.79:0/1995084398 >> v2:172.21.15.117:3300/0 conn(0x7efd0015a810 msgr2=0x7efd000b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd0647e640 1 --2- 172.21.15.79:0/1995084398 >> v2:172.21.15.117:3300/0 conn(0x7efd0015a810 0x7efd000b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd0647e640 1 -- 172.21.15.79:0/1995084398 >> v1:172.21.15.117:6789/0 conn(0x7efd000af420 legacy=0x7efd0015e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd0647e640 1 -- 172.21.15.79:0/1995084398 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0015abf0 con 0x7efd00072020 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.835+0000 7efd05c7d640 1 --2- 172.21.15.79:0/1995084398 >> v2:172.21.15.117:3300/0 conn(0x7efd0015a810 0x7efd000b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.836+0000 7efd0647e640 1 --2- 172.21.15.79:0/1995084398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd000b48f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009d90 tx=0x7efcf802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f972d53fde553682 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.836+0000 7efd04c7b640 1 -- 172.21.15.79:0/1995084398 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8007740 con 0x7efd00072020 2024-06-10T00:24:28.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.836+0000 7efd04c7b640 1 -- 172.21.15.79:0/1995084398 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf80078e0 con 0x7efd00072020 2024-06-10T00:24:28.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.836+0000 7efd04c7b640 1 -- 172.21.15.79:0/1995084398 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8007cb0 con 0x7efd00072020 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.837+0000 7efd07ee1640 1 -- 172.21.15.79:0/1995084398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 msgr2=0x7efd000b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.837+0000 7efd07ee1640 1 --2- 172.21.15.79:0/1995084398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd000b48f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009d90 tx=0x7efcf802a660 comp rx=0 tx=0).stop 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.837+0000 7efd07ee1640 1 -- 172.21.15.79:0/1995084398 shutdown_connections 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.837+0000 7efd07ee1640 1 --2- 172.21.15.79:0/1995084398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd000b48f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.837+0000 7efd07ee1640 1 --2- 172.21.15.79:0/1995084398 >> v2:172.21.15.117:3300/0 conn(0x7efd0015a810 0x7efd000b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.837+0000 7efd07ee1640 1 -- 172.21.15.79:0/1995084398 >> 172.21.15.79:0/1995084398 conn(0x7efd000b1980 msgr2=0x7efd000b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.837+0000 7efd07ee1640 1 -- 172.21.15.79:0/1995084398 shutdown_connections 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.837+0000 7efd07ee1640 1 -- 172.21.15.79:0/1995084398 wait complete. 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.838+0000 7efd07ee1640 1 Processor -- start 2024-06-10T00:24:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.838+0000 7efd07ee1640 1 -- start start 2024-06-10T00:24:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd07ee1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd0014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd07ee1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd000af420 0x7efd0014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd07ee1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0015a810 0x7efd00147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd07ee1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd000ced70 con 0x7efd000af420 2024-06-10T00:24:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd07ee1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efd000cea90 con 0x7efd0015a810 2024-06-10T00:24:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd07ee1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efd000cf050 con 0x7efd00072020 2024-06-10T00:24:28.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0547c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd000af420 0x7efd0014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0547c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd000af420 0x7efd0014fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36576/0 (socket says 172.21.15.79:36576) 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0547c640 1 -- 172.21.15.79:0/3000485734 learned_addr learned my addr 172.21.15.79:0/3000485734 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd05c7d640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd0014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0647e640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0015a810 0x7efd00147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0547c640 1 -- 172.21.15.79:0/3000485734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 msgr2=0x7efd0014a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0547c640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd0014a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0547c640 1 -- 172.21.15.79:0/3000485734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0015a810 msgr2=0x7efd00147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0547c640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0015a810 0x7efd00147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.839+0000 7efd0547c640 1 -- 172.21.15.79:0/3000485734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0014ee30 con 0x7efd000af420 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.840+0000 7efd0547c640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd000af420 0x7efd0014fed0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c430 tx=0x7efcfc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.840+0000 7efcf27fc640 1 -- 172.21.15.79:0/3000485734 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc017070 con 0x7efd000af420 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.840+0000 7efcf27fc640 1 -- 172.21.15.79:0/3000485734 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcfc005ce0 con 0x7efd000af420 2024-06-10T00:24:28.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.840+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0014f110 con 0x7efd000af420 2024-06-10T00:24:28.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.840+0000 7efcf27fc640 1 -- 172.21.15.79:0/3000485734 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0072f0 con 0x7efd000af420 2024-06-10T00:24:28.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.840+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0014f6d0 con 0x7efd000af420 2024-06-10T00:24:28.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.841+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd00068540 con 0x7efd000af420 2024-06-10T00:24:28.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.841+0000 7efcf27fc640 1 -- 172.21.15.79:0/3000485734 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcfc01a070 con 0x7efd000af420 2024-06-10T00:24:28.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.842+0000 7efcf27fc640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efce406be30 0x7efce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:28.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.842+0000 7efcf27fc640 1 -- 172.21.15.79:0/3000485734 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5249+0+0 (secure 0 0 0) 0x7efcfc08a020 con 0x7efd000af420 2024-06-10T00:24:28.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.842+0000 7efd05c7d640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efce406be30 0x7efce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:28.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.842+0000 7efd05c7d640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efce406be30 0x7efce406e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efd00068f40 tx=0x7efcf4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:28.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:28.846+0000 7efcf27fc640 1 -- 172.21.15.79:0/3000485734 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efcfc058540 con 0x7efd000af420 2024-06-10T00:24:28.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-06-10T00:24:29.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.021+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efd000b25e0 con 0x7efd000af420 2024-06-10T00:24:29.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.050+0000 7efcf27fc640 1 -- 172.21.15.79:0/3000485734 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v116) ==== 138+0+0 (secure 0 0 0) 0x7efcfc05c840 con 0x7efd000af420 2024-06-10T00:24:29.050 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-06-10T00:24:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.053+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efce406be30 msgr2=0x7efce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.053+0000 7efd07ee1640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efce406be30 0x7efce406e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efd00068f40 tx=0x7efcf4009190 comp rx=0 tx=0).stop 2024-06-10T00:24:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.053+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd000af420 msgr2=0x7efd0014fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.053+0000 7efd07ee1640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd000af420 0x7efd0014fed0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c430 tx=0x7efcfc00c8f0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.054+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 shutdown_connections 2024-06-10T00:24:29.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.054+0000 7efd07ee1640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7efce406be30 0x7efce406e2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.054+0000 7efd07ee1640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0015a810 0x7efd00147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.054+0000 7efd07ee1640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd000af420 0x7efd0014fed0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.054+0000 7efd07ee1640 1 --2- 172.21.15.79:0/3000485734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd00072020 0x7efd0014a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.054+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 >> 172.21.15.79:0/3000485734 conn(0x7efd000b1980 msgr2=0x7efd001549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:29.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.054+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 shutdown_connections 2024-06-10T00:24:29.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.054+0000 7efd07ee1640 1 -- 172.21.15.79:0/3000485734 wait complete. 2024-06-10T00:24:29.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-10T00:24:29.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.174+0000 7fb5a27a2640 1 Processor -- start 2024-06-10T00:24:29.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.174+0000 7fb5a27a2640 1 -- start start 2024-06-10T00:24:29.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb5a27a2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb59c15e1c0 0x7fb59c0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:29.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb5a27a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb59c0b2f60 0x7fb59c0d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:29.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb5a27a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e5a0 0x7fb59c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:29.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb5a27a2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb59c0cf9a0 con 0x7fb59c15e1c0 2024-06-10T00:24:29.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb5a27a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb59c0cfc70 con 0x7fb59c0b2f60 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb5a27a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb59c0cff50 con 0x7fb59c15e5a0 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb59bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb59c15e1c0 0x7fb59c0d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb59bfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb59c15e1c0 0x7fb59c0d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36584/0 (socket says 172.21.15.79:36584) 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.175+0000 7fb59bfff640 1 -- 172.21.15.79:0/3372918066 learned_addr learned my addr 172.21.15.79:0/3372918066 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.176+0000 7fb59bfff640 1 -- 172.21.15.79:0/3372918066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e5a0 msgr2=0x7fb59c0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.176+0000 7fb59bfff640 1 --2- 172.21.15.79:0/3372918066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e5a0 0x7fb59c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.176+0000 7fb59b7fe640 1 --2- 172.21.15.79:0/3372918066 >> v2:172.21.15.117:3300/0 conn(0x7fb59c0b2f60 0x7fb59c0d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.176+0000 7fb59bfff640 1 -- 172.21.15.79:0/3372918066 >> v2:172.21.15.117:3300/0 conn(0x7fb59c0b2f60 msgr2=0x7fb59c0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.176+0000 7fb59bfff640 1 --2- 172.21.15.79:0/3372918066 >> v2:172.21.15.117:3300/0 conn(0x7fb59c0b2f60 0x7fb59c0d0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.176+0000 7fb59bfff640 1 -- 172.21.15.79:0/3372918066 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c0d0230 con 0x7fb59c15e1c0 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.176+0000 7fb59bfff640 1 --2- 172.21.15.79:0/3372918066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e1c0 0x7fb59c0d4bc0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb59c06be40 tx=0x7fb58c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565da0fd6073a0f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb59affd640 1 -- 172.21.15.79:0/3372918066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c037070 con 0x7fb59c15e1c0 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb59affd640 1 -- 172.21.15.79:0/3372918066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c032440 con 0x7fb59c15e1c0 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb59affd640 1 -- 172.21.15.79:0/3372918066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c032810 con 0x7fb59c15e1c0 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 -- 172.21.15.79:0/3372918066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e1c0 msgr2=0x7fb59c0d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/3372918066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e1c0 0x7fb59c0d4bc0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb59c06be40 tx=0x7fb58c02a200 comp rx=0 tx=0).stop 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 -- 172.21.15.79:0/3372918066 shutdown_connections 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/3372918066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e5a0 0x7fb59c0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/3372918066 >> v2:172.21.15.117:3300/0 conn(0x7fb59c0b2f60 0x7fb59c0d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/3372918066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e1c0 0x7fb59c0d4bc0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 -- 172.21.15.79:0/3372918066 >> 172.21.15.79:0/3372918066 conn(0x7fb59c09d3e0 msgr2=0x7fb59c0d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:29.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 -- 172.21.15.79:0/3372918066 shutdown_connections 2024-06-10T00:24:29.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.177+0000 7fb5a27a2640 1 -- 172.21.15.79:0/3372918066 wait complete. 2024-06-10T00:24:29.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.178+0000 7fb5a27a2640 1 Processor -- start 2024-06-10T00:24:29.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a27a2640 1 -- start start 2024-06-10T00:24:29.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a27a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb59c0b2f60 0x7fb59c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:29.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a27a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e1c0 0x7fb59c0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:29.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a27a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e5a0 0x7fb59c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:29.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a27a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c0b0cd0 con 0x7fb59c15e5a0 2024-06-10T00:24:29.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a27a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c0d1d40 con 0x7fb59c0b2f60 2024-06-10T00:24:29.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a27a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb59c0b0e50 con 0x7fb59c15e1c0 2024-06-10T00:24:29.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a0d3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e5a0 0x7fb59c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:29.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a0d3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e5a0 0x7fb59c151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36598/0 (socket says 172.21.15.79:36598) 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb5a0d3f640 1 -- 172.21.15.79:0/1424422714 learned_addr learned my addr 172.21.15.79:0/1424422714 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb59bfff640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb59c0b2f60 0x7fb59c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.179+0000 7fb59b7fe640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e1c0 0x7fb59c0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb5a0d3f640 1 -- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e1c0 msgr2=0x7fb59c0c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb5a0d3f640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e1c0 0x7fb59c0c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb5a0d3f640 1 -- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb59c0b2f60 msgr2=0x7fb59c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb5a0d3f640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb59c0b2f60 0x7fb59c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb5a0d3f640 1 -- 172.21.15.79:0/1424422714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c15fa80 con 0x7fb59c15e5a0 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb59b7fe640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e1c0 0x7fb59c0c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb5a0d3f640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e5a0 0x7fb59c151ed0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb59400b9e0 tx=0x7fb59400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb598ff9640 1 -- 172.21.15.79:0/1424422714 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594019070 con 0x7fb59c15e5a0 2024-06-10T00:24:29.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb598ff9640 1 -- 172.21.15.79:0/1424422714 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59400cb20 con 0x7fb59c15e5a0 2024-06-10T00:24:29.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb598ff9640 1 -- 172.21.15.79:0/1424422714 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594014440 con 0x7fb59c15e5a0 2024-06-10T00:24:29.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59c15fd60 con 0x7fb59c15e5a0 2024-06-10T00:24:29.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.180+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb59c160600 con 0x7fb59c15e5a0 2024-06-10T00:24:29.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.181+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb59c15ff30 con 0x7fb59c15e5a0 2024-06-10T00:24:29.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.182+0000 7fb598ff9640 1 -- 172.21.15.79:0/1424422714 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb59401c070 con 0x7fb59c15e5a0 2024-06-10T00:24:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.182+0000 7fb598ff9640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb58806be60 0x7fb58806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.182+0000 7fb59bfff640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb58806be60 0x7fb58806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.182+0000 7fb598ff9640 1 -- 172.21.15.79:0/1424422714 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5619+0+0 (secure 0 0 0) 0x7fb59408a9e0 con 0x7fb59c15e5a0 2024-06-10T00:24:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.183+0000 7fb59bfff640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb58806be60 0x7fb58806e320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb58c034000 tx=0x7fb58c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:29.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.187+0000 7fb598ff9640 1 -- 172.21.15.79:0/1424422714 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb594058d90 con 0x7fb59c15e5a0 2024-06-10T00:24:29.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:29.361+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb59c0683c0 con 0x7fb59c15e5a0 2024-06-10T00:24:30.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.055+0000 7fb598ff9640 1 -- 172.21.15.79:0/1424422714 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v117) ==== 170+0+0 (secure 0 0 0) 0x7fb59405d090 con 0x7fb59c15e5a0 2024-06-10T00:24:30.055 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb58806be60 msgr2=0x7fb58806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb58806be60 0x7fb58806e320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb58c034000 tx=0x7fb58c02e000 comp rx=0 tx=0).stop 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e5a0 msgr2=0x7fb59c151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e5a0 0x7fb59c151ed0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb59400b9e0 tx=0x7fb59400bea0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 shutdown_connections 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb58806be60 0x7fb58806e320 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59c15e5a0 0x7fb59c151ed0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59c15e1c0 0x7fb59c0c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 --2- 172.21.15.79:0/1424422714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb59c0b2f60 0x7fb59c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 >> 172.21.15.79:0/1424422714 conn(0x7fb59c09d3e0 msgr2=0x7fb59c15d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:30.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 shutdown_connections 2024-06-10T00:24:30.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.058+0000 7fb5a27a2640 1 -- 172.21.15.79:0/1424422714 wait complete. 2024-06-10T00:24:30.082 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-10T00:24:30.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.185+0000 7f383d458640 1 Processor -- start 2024-06-10T00:24:30.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.185+0000 7f383d458640 1 -- start start 2024-06-10T00:24:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f383d458640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38380b3bf0 0x7f383806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f383d458640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f383806d500 0x7f3838071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f383d458640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3838155000 con 0x7f3838154c20 2024-06-10T00:24:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f383d458640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f383806dd30 con 0x7f383806d500 2024-06-10T00:24:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f383d458640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f383806e010 con 0x7f38380b3bf0 2024-06-10T00:24:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f38377fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f383806d500 0x7f3838071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f38377fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f383806d500 0x7f3838071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36610/0 (socket says 172.21.15.79:36610) 2024-06-10T00:24:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f38377fe640 1 -- 172.21.15.79:0/3166154330 learned_addr learned my addr 172.21.15.79:0/3166154330 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.186+0000 7f38367fc640 1 --2- 172.21.15.79:0/3166154330 >> v2:172.21.15.117:3300/0 conn(0x7f38380b3bf0 0x7f383806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.187+0000 7f38377fe640 1 -- 172.21.15.79:0/3166154330 >> v2:172.21.15.117:3300/0 conn(0x7f38380b3bf0 msgr2=0x7f383806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.187+0000 7f38377fe640 1 --2- 172.21.15.79:0/3166154330 >> v2:172.21.15.117:3300/0 conn(0x7f38380b3bf0 0x7f383806cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.187+0000 7f38377fe640 1 -- 172.21.15.79:0/3166154330 >> v1:172.21.15.117:6789/0 conn(0x7f3838154c20 legacy=0x7f38380b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.187+0000 7f38377fe640 1 -- 172.21.15.79:0/3166154330 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383806e2f0 con 0x7f383806d500 2024-06-10T00:24:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.187+0000 7f38377fe640 1 --2- 172.21.15.79:0/3166154330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f383806d500 0x7f3838071550 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f38380cf710 tx=0x7f383002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c2bcb908def569 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.187+0000 7f3835ffb640 1 -- 172.21.15.79:0/3166154330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830036070 con 0x7f383806d500 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.187+0000 7f3835ffb640 1 -- 172.21.15.79:0/3166154330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3830031600 con 0x7f383806d500 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.187+0000 7f3835ffb640 1 -- 172.21.15.79:0/3166154330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300319d0 con 0x7f383806d500 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.188+0000 7f383d458640 1 -- 172.21.15.79:0/3166154330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f383806d500 msgr2=0x7f3838071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.188+0000 7f383d458640 1 --2- 172.21.15.79:0/3166154330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f383806d500 0x7f3838071550 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f38380cf710 tx=0x7f383002a6f0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.188+0000 7f383d458640 1 -- 172.21.15.79:0/3166154330 shutdown_connections 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.188+0000 7f383d458640 1 --2- 172.21.15.79:0/3166154330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f383806d500 0x7f3838071550 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.188+0000 7f383d458640 1 --2- 172.21.15.79:0/3166154330 >> v2:172.21.15.117:3300/0 conn(0x7f38380b3bf0 0x7f383806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.188+0000 7f383d458640 1 -- 172.21.15.79:0/3166154330 >> 172.21.15.79:0/3166154330 conn(0x7f38380b1d10 msgr2=0x7f38380b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.188+0000 7f383d458640 1 -- 172.21.15.79:0/3166154330 shutdown_connections 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.188+0000 7f383d458640 1 -- 172.21.15.79:0/3166154330 wait complete. 2024-06-10T00:24:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.189+0000 7f383d458640 1 Processor -- start 2024-06-10T00:24:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.189+0000 7f383d458640 1 -- start start 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f383d458640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f383806d500 0x7f383814a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f383d458640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38380b3bf0 0x7f3838159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f383d458640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3838154c20 0x7f38380b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f383d458640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f383806daf0 con 0x7f3838154c20 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f383d458640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f383806d970 con 0x7f383806d500 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f383d458640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f38380d0020 con 0x7f38380b3bf0 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3838154c20 0x7f38380b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3838154c20 0x7f38380b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36614/0 (socket says 172.21.15.79:36614) 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38377fe640 1 -- 172.21.15.79:0/654488000 learned_addr learned my addr 172.21.15.79:0/654488000 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f3836ffd640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f383806d500 0x7f383814a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38367fc640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38380b3bf0 0x7f3838159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38377fe640 1 -- 172.21.15.79:0/654488000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38380b3bf0 msgr2=0x7f3838159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38377fe640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38380b3bf0 0x7f3838159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38377fe640 1 -- 172.21.15.79:0/654488000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f383806d500 msgr2=0x7f383814a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38377fe640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f383806d500 0x7f383814a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.190+0000 7f38377fe640 1 -- 172.21.15.79:0/654488000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383814be00 con 0x7f3838154c20 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.191+0000 7f38377fe640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3838154c20 0x7f38380b08e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f3830009f40 tx=0x7f3830004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.191+0000 7f381f7fe640 1 -- 172.21.15.79:0/654488000 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830036050 con 0x7f3838154c20 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.191+0000 7f381f7fe640 1 -- 172.21.15.79:0/654488000 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3830042070 con 0x7f3838154c20 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.191+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383809abb0 con 0x7f3838154c20 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.191+0000 7f381f7fe640 1 -- 172.21.15.79:0/654488000 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830009510 con 0x7f3838154c20 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.191+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f383814c340 con 0x7f3838154c20 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.192+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38380683c0 con 0x7f3838154c20 2024-06-10T00:24:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.193+0000 7f381f7fe640 1 -- 172.21.15.79:0/654488000 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3830007bd0 con 0x7f3838154c20 2024-06-10T00:24:30.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.193+0000 7f381f7fe640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f382406be30 0x7f382406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:30.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.193+0000 7f3836ffd640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f382406be30 0x7f382406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:30.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.193+0000 7f381f7fe640 1 -- 172.21.15.79:0/654488000 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6001+0+0 (secure 0 0 0) 0x7f38300abc70 con 0x7f3838154c20 2024-06-10T00:24:30.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.194+0000 7f3836ffd640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f382406be30 0x7f382406e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f383815a1f0 tx=0x7f3828009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:30.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.198+0000 7f381f7fe640 1 -- 172.21.15.79:0/654488000 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3830079f30 con 0x7f3838154c20 2024-06-10T00:24:30.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:30.407+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3838071de0 con 0x7f3838154c20 2024-06-10T00:24:31.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.057+0000 7f381f7fe640 1 -- 172.21.15.79:0/654488000 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v81) ==== 174+0+0 (secure 0 0 0) 0x7f383007e230 con 0x7f3838154c20 2024-06-10T00:24:31.057 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 17 and data pool 18 2024-06-10T00:24:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.062+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f382406be30 msgr2=0x7f382406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.062+0000 7f383d458640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f382406be30 0x7f382406e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f383815a1f0 tx=0x7f3828009060 comp rx=0 tx=0).stop 2024-06-10T00:24:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.062+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3838154c20 msgr2=0x7f38380b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.062+0000 7f383d458640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3838154c20 0x7f38380b08e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f3830009f40 tx=0x7f3830004a40 comp rx=0 tx=0).stop 2024-06-10T00:24:31.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.063+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 shutdown_connections 2024-06-10T00:24:31.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.063+0000 7f383d458640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f382406be30 0x7f382406e2f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.063+0000 7f383d458640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3838154c20 0x7f38380b08e0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.063+0000 7f383d458640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38380b3bf0 0x7f3838159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.063+0000 7f383d458640 1 --2- 172.21.15.79:0/654488000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f383806d500 0x7f383814a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.063+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 >> 172.21.15.79:0/654488000 conn(0x7f38380b1d10 msgr2=0x7f38380cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:31.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.067+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 shutdown_connections 2024-06-10T00:24:31.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.067+0000 7f383d458640 1 -- 172.21.15.79:0/654488000 wait complete. 2024-06-10T00:24:31.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:24:31.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.193+0000 7f71bf112640 1 Processor -- start 2024-06-10T00:24:31.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.193+0000 7f71bf112640 1 -- start start 2024-06-10T00:24:31.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bf112640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71b80ae910 0x7f71b806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bf112640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71b806ea20 0x7f71b80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bf112640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b806d130 con 0x7f71b80cf190 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bf112640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f71b806ee90 con 0x7f71b80ae910 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bf112640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f71b806d410 con 0x7f71b806ea20 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bceae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71b80ae910 0x7f71b806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bd6af640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f71b80cf190 0x7f71b815ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42254/0 (socket says 172.21.15.79:42254) 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bceae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71b80ae910 0x7f71b806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36630/0 (socket says 172.21.15.79:36630) 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.194+0000 7f71bd6af640 1 -- 172.21.15.79:0/2602571235 learned_addr learned my addr 172.21.15.79:0/2602571235 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.195+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2602571235 >> v2:172.21.15.117:3300/0 conn(0x7f71b806ea20 0x7f71b80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.195+0000 7f71bceae640 1 -- 172.21.15.79:0/2602571235 >> v2:172.21.15.117:3300/0 conn(0x7f71b806ea20 msgr2=0x7f71b80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.195+0000 7f71bceae640 1 --2- 172.21.15.79:0/2602571235 >> v2:172.21.15.117:3300/0 conn(0x7f71b806ea20 0x7f71b80cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.195+0000 7f71bceae640 1 -- 172.21.15.79:0/2602571235 >> v1:172.21.15.79:6789/0 conn(0x7f71b80cf190 legacy=0x7f71b815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.195+0000 7f71bceae640 1 -- 172.21.15.79:0/2602571235 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b806d6f0 con 0x7f71b80ae910 2024-06-10T00:24:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.195+0000 7f71b77fe640 1 -- 172.21.15.79:0/2602571235 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119886585 0 0) 0x7f71b806d130 con 0x7f71b80cf190 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.195+0000 7f71bceae640 1 --2- 172.21.15.79:0/2602571235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b80ae910 0x7f71b806e4e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f71b8070c80 tx=0x7f71b002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e23b2865ae9c6e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71b77fe640 1 -- 172.21.15.79:0/2602571235 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0007740 con 0x7f71b80ae910 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71b77fe640 1 -- 172.21.15.79:0/2602571235 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b00078e0 con 0x7f71b80ae910 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71b77fe640 1 -- 172.21.15.79:0/2602571235 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0007cb0 con 0x7f71b80ae910 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71bf112640 1 -- 172.21.15.79:0/2602571235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b80ae910 msgr2=0x7f71b806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71bf112640 1 --2- 172.21.15.79:0/2602571235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b80ae910 0x7f71b806e4e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f71b8070c80 tx=0x7f71b002a5f0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71bf112640 1 -- 172.21.15.79:0/2602571235 shutdown_connections 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71bf112640 1 --2- 172.21.15.79:0/2602571235 >> v2:172.21.15.117:3300/0 conn(0x7f71b806ea20 0x7f71b80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71bf112640 1 --2- 172.21.15.79:0/2602571235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b80ae910 0x7f71b806e4e0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71bf112640 1 -- 172.21.15.79:0/2602571235 >> 172.21.15.79:0/2602571235 conn(0x7f71b80b19f0 msgr2=0x7f71b80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71bf112640 1 -- 172.21.15.79:0/2602571235 shutdown_connections 2024-06-10T00:24:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.196+0000 7f71bf112640 1 -- 172.21.15.79:0/2602571235 wait complete. 2024-06-10T00:24:31.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.197+0000 7f71bf112640 1 Processor -- start 2024-06-10T00:24:31.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.197+0000 7f71bf112640 1 -- start start 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bf112640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b806ea20 0x7f71b81516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bf112640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71b80ae910 0x7f71b8159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bf112640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b80cf190 0x7f71b8159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bf112640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80aecf0 con 0x7f71b806ea20 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bf112640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80cf5e0 con 0x7f71b80cf190 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bf112640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f71b80add50 con 0x7f71b80ae910 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bceae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b806ea20 0x7f71b81516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bceae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b806ea20 0x7f71b81516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36634/0 (socket says 172.21.15.79:36634) 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bceae640 1 -- 172.21.15.79:0/2772153508 learned_addr learned my addr 172.21.15.79:0/2772153508 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bd6af640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b80cf190 0x7f71b8159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71b80ae910 0x7f71b8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bceae640 1 -- 172.21.15.79:0/2772153508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71b80ae910 msgr2=0x7f71b8159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.198+0000 7f71bceae640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71b80ae910 0x7f71b8159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71bceae640 1 -- 172.21.15.79:0/2772153508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b80cf190 msgr2=0x7f71b8159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71bceae640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b80cf190 0x7f71b8159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71bceae640 1 -- 172.21.15.79:0/2772153508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b809b430 con 0x7f71b806ea20 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71bceae640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b806ea20 0x7f71b81516e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e80 tx=0x7f71b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71b57fa640 1 -- 172.21.15.79:0/2772153508 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0040070 con 0x7f71b806ea20 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71b57fa640 1 -- 172.21.15.79:0/2772153508 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b0031c40 con 0x7f71b806ea20 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71b57fa640 1 -- 172.21.15.79:0/2772153508 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b003c420 con 0x7f71b806ea20 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b809b710 con 0x7f71b806ea20 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.199+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b809af60 con 0x7f71b806ea20 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.200+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b8068430 con 0x7f71b806ea20 2024-06-10T00:24:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.200+0000 7f71b57fa640 1 -- 172.21.15.79:0/2772153508 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71b0039040 con 0x7f71b806ea20 2024-06-10T00:24:31.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.201+0000 7f71b57fa640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406be30 0x7f71a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.201+0000 7f71b57fa640 1 -- 172.21.15.79:0/2772153508 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f71b00ac540 con 0x7f71b806ea20 2024-06-10T00:24:31.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.201+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406be30 0x7f71a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.201+0000 7f71b7fff640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406be30 0x7f71a406e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f71ac006fd0 tx=0x7f71ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.205+0000 7f71b57fa640 1 -- 172.21.15.79:0/2772153508 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f71b007adf0 con 0x7f71b806ea20 2024-06-10T00:24:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.384+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71b8075430 con 0x7f71b806ea20 2024-06-10T00:24:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.385+0000 7f71b57fa640 1 -- 172.21.15.79:0/2772153508 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16917 (secure 0 0 0) 0x7f71b007a6f0 con 0x7f71b806ea20 2024-06-10T00:24:31.385 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:31.385 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":118,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:24:30.408472+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:24:29.040364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-06-10T00:24:29.380624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:24:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.387+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406be30 msgr2=0x7f71a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.387+0000 7f71bf112640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406be30 0x7f71a406e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f71ac006fd0 tx=0x7f71ac008040 comp rx=0 tx=0).stop 2024-06-10T00:24:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.387+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b806ea20 msgr2=0x7f71b81516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.387+0000 7f71bf112640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b806ea20 0x7f71b81516e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e80 tx=0x7f71b0004a40 comp rx=0 tx=0).stop 2024-06-10T00:24:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.388+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 shutdown_connections 2024-06-10T00:24:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.388+0000 7f71bf112640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f71a406be30 0x7f71a406e2f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.388+0000 7f71bf112640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b80cf190 0x7f71b8159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.388+0000 7f71bf112640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71b80ae910 0x7f71b8159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.388+0000 7f71bf112640 1 --2- 172.21.15.79:0/2772153508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71b806ea20 0x7f71b81516e0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.388+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 >> 172.21.15.79:0/2772153508 conn(0x7f71b80b19f0 msgr2=0x7f71b80748f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.388+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 shutdown_connections 2024-06-10T00:24:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.388+0000 7f71bf112640 1 -- 172.21.15.79:0/2772153508 wait complete. 2024-06-10T00:24:31.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:24:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.497+0000 7fce6b912640 1 Processor -- start 2024-06-10T00:24:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.498+0000 7fce6b912640 1 -- start start 2024-06-10T00:24:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce6b912640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce6415c7f0 0x7fce640cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce6b912640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce640b4530 0x7fce640ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce6b912640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce640725f0 con 0x7fce64156830 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce6b912640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fce640b3090 con 0x7fce640b4530 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce6b912640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fce640728d0 con 0x7fce6415c7f0 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce69eaf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce640b4530 0x7fce640ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce69eaf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce640b4530 0x7fce640ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36644/0 (socket says 172.21.15.79:36644) 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce69eaf640 1 -- 172.21.15.79:0/2811293382 learned_addr learned my addr 172.21.15.79:0/2811293382 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce68ead640 1 --2- 172.21.15.79:0/2811293382 >> v2:172.21.15.117:3300/0 conn(0x7fce6415c7f0 0x7fce640cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce69eaf640 1 -- 172.21.15.79:0/2811293382 >> v2:172.21.15.117:3300/0 conn(0x7fce6415c7f0 msgr2=0x7fce640cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce69eaf640 1 --2- 172.21.15.79:0/2811293382 >> v2:172.21.15.117:3300/0 conn(0x7fce6415c7f0 0x7fce640cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce69eaf640 1 -- 172.21.15.79:0/2811293382 >> v1:172.21.15.117:6789/0 conn(0x7fce64156830 legacy=0x7fce64071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.499+0000 7fce69eaf640 1 -- 172.21.15.79:0/2811293382 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce64072bb0 con 0x7fce640b4530 2024-06-10T00:24:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce69eaf640 1 --2- 172.21.15.79:0/2811293382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce640b4530 0x7fce640ccbb0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fce640d0d40 tx=0x7fce5402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dcf29fd806bbc6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce63fff640 1 -- 172.21.15.79:0/2811293382 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54037070 con 0x7fce640b4530 2024-06-10T00:24:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce63fff640 1 -- 172.21.15.79:0/2811293382 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce54032440 con 0x7fce640b4530 2024-06-10T00:24:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce63fff640 1 -- 172.21.15.79:0/2811293382 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54032810 con 0x7fce640b4530 2024-06-10T00:24:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce6b912640 1 -- 172.21.15.79:0/2811293382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce640b4530 msgr2=0x7fce640ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce6b912640 1 --2- 172.21.15.79:0/2811293382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce640b4530 0x7fce640ccbb0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fce640d0d40 tx=0x7fce5402a230 comp rx=0 tx=0).stop 2024-06-10T00:24:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce6b912640 1 -- 172.21.15.79:0/2811293382 shutdown_connections 2024-06-10T00:24:31.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce6b912640 1 --2- 172.21.15.79:0/2811293382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce640b4530 0x7fce640ccbb0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce6b912640 1 --2- 172.21.15.79:0/2811293382 >> v2:172.21.15.117:3300/0 conn(0x7fce6415c7f0 0x7fce640cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce6b912640 1 -- 172.21.15.79:0/2811293382 >> 172.21.15.79:0/2811293382 conn(0x7fce640b19f0 msgr2=0x7fce640b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce6b912640 1 -- 172.21.15.79:0/2811293382 shutdown_connections 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.500+0000 7fce6b912640 1 -- 172.21.15.79:0/2811293382 wait complete. 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce6b912640 1 Processor -- start 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce6b912640 1 -- start start 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce6b912640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce640b4530 0x7fce64151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce6b912640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce64156830 0x7fce64150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce6b912640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce6415c7f0 0x7fce640afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce6b912640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce64165cc0 con 0x7fce64156830 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce6b912640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce64072300 con 0x7fce640b4530 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce6b912640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce64165e40 con 0x7fce6415c7f0 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce68ead640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce64156830 0x7fce64150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce68ead640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce64156830 0x7fce64150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36650/0 (socket says 172.21.15.79:36650) 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.502+0000 7fce68ead640 1 -- 172.21.15.79:0/2425541144 learned_addr learned my addr 172.21.15.79:0/2425541144 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce696ae640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce640b4530 0x7fce64151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce69eaf640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce6415c7f0 0x7fce640afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce68ead640 1 -- 172.21.15.79:0/2425541144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce6415c7f0 msgr2=0x7fce640afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce68ead640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce6415c7f0 0x7fce640afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce68ead640 1 -- 172.21.15.79:0/2425541144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce640b4530 msgr2=0x7fce64151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce68ead640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce640b4530 0x7fce64151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce68ead640 1 -- 172.21.15.79:0/2425541144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce64150b60 con 0x7fce64156830 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce68ead640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce64156830 0x7fce64150330 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fce5800c7f0 tx=0x7fce5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce61ffb640 1 -- 172.21.15.79:0/2425541144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58015070 con 0x7fce64156830 2024-06-10T00:24:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce61ffb640 1 -- 172.21.15.79:0/2425541144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce58004220 con 0x7fce64156830 2024-06-10T00:24:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce61ffb640 1 -- 172.21.15.79:0/2425541144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58007620 con 0x7fce64156830 2024-06-10T00:24:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce64150e40 con 0x7fce64156830 2024-06-10T00:24:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.503+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce64151400 con 0x7fce64156830 2024-06-10T00:24:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.504+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce64068430 con 0x7fce64156830 2024-06-10T00:24:31.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.505+0000 7fce61ffb640 1 -- 172.21.15.79:0/2425541144 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce580079d0 con 0x7fce64156830 2024-06-10T00:24:31.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.505+0000 7fce61ffb640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce5006be30 0x7fce5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.505+0000 7fce61ffb640 1 -- 172.21.15.79:0/2425541144 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fce5808b330 con 0x7fce64156830 2024-06-10T00:24:31.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.505+0000 7fce696ae640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce5006be30 0x7fce5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.506+0000 7fce696ae640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce5006be30 0x7fce5006e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fce5c005520 tx=0x7fce5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.509+0000 7fce61ffb640 1 -- 172.21.15.79:0/2425541144 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fce58059be0 con 0x7fce64156830 2024-06-10T00:24:31.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.683+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce640ae370 con 0x7fce64156830 2024-06-10T00:24:31.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.684+0000 7fce61ffb640 1 -- 172.21.15.79:0/2425541144 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16917 (secure 0 0 0) 0x7fce580594e0 con 0x7fce64156830 2024-06-10T00:24:31.684 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:31.684 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":118,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:24:30.408472+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:24:29.040364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-06-10T00:24:29.380624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce5006be30 msgr2=0x7fce5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce5006be30 0x7fce5006e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fce5c005520 tx=0x7fce5c009040 comp rx=0 tx=0).stop 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce64156830 msgr2=0x7fce64150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce64156830 0x7fce64150330 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fce5800c7f0 tx=0x7fce5800ccb0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 shutdown_connections 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fce5006be30 0x7fce5006e2f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce6415c7f0 0x7fce640afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce64156830 0x7fce64150330 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 --2- 172.21.15.79:0/2425541144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce640b4530 0x7fce64151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 >> 172.21.15.79:0/2425541144 conn(0x7fce640b19f0 msgr2=0x7fce64155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:31.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 shutdown_connections 2024-06-10T00:24:31.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.686+0000 7fce6b912640 1 -- 172.21.15.79:0/2425541144 wait complete. 2024-06-10T00:24:31.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-10T00:24:31.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.799+0000 7fe2e0838640 1 Processor -- start 2024-06-10T00:24:31.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.799+0000 7fe2e0838640 1 -- start start 2024-06-10T00:24:31.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2e0838640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 0x7fe2dc0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2e0838640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2dc0b48e0 0x7fe2dc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2e0838640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2dc0d0020 0x7fe2dc0d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2e0838640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe2dc0d09b0 con 0x7fe2dc0b48e0 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2e0838640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe2dc15c870 con 0x7fe2dc0d0020 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2e0838640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2dc15cb50 con 0x7fe2dc0b3b40 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2d9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2dc0b48e0 0x7fe2dc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2d9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2dc0b48e0 0x7fe2dc0b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36662/0 (socket says 172.21.15.79:36662) 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2d9d9b640 1 -- 172.21.15.79:0/4028848023 learned_addr learned my addr 172.21.15.79:0/4028848023 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2da59c640 1 --2- 172.21.15.79:0/4028848023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 0x7fe2dc0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.800+0000 7fe2dad9d640 1 --2- 172.21.15.79:0/4028848023 >> v2:172.21.15.117:3300/0 conn(0x7fe2dc0d0020 0x7fe2dc0d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d9d9b640 1 -- 172.21.15.79:0/4028848023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 msgr2=0x7fe2dc0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d9d9b640 1 --2- 172.21.15.79:0/4028848023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 0x7fe2dc0b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d9d9b640 1 -- 172.21.15.79:0/4028848023 >> v2:172.21.15.117:3300/0 conn(0x7fe2dc0d0020 msgr2=0x7fe2dc0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:31.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d9d9b640 1 --2- 172.21.15.79:0/4028848023 >> v2:172.21.15.117:3300/0 conn(0x7fe2dc0d0020 0x7fe2dc0d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d9d9b640 1 -- 172.21.15.79:0/4028848023 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc15ce30 con 0x7fe2dc0b48e0 2024-06-10T00:24:31.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d9d9b640 1 --2- 172.21.15.79:0/4028848023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0b48e0 0x7fe2dc0b4d40 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0ae290 tx=0x7fe2d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2894af9b50d7c0ba server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d959a640 1 -- 172.21.15.79:0/4028848023 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0037070 con 0x7fe2dc0b48e0 2024-06-10T00:24:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d959a640 1 -- 172.21.15.79:0/4028848023 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d0032440 con 0x7fe2dc0b48e0 2024-06-10T00:24:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.801+0000 7fe2d959a640 1 -- 172.21.15.79:0/4028848023 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0032810 con 0x7fe2dc0b48e0 2024-06-10T00:24:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 -- 172.21.15.79:0/4028848023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0b48e0 msgr2=0x7fe2dc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 --2- 172.21.15.79:0/4028848023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0b48e0 0x7fe2dc0b4d40 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0ae290 tx=0x7fe2d002a140 comp rx=0 tx=0).stop 2024-06-10T00:24:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 -- 172.21.15.79:0/4028848023 shutdown_connections 2024-06-10T00:24:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 --2- 172.21.15.79:0/4028848023 >> v2:172.21.15.117:3300/0 conn(0x7fe2dc0d0020 0x7fe2dc0d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 --2- 172.21.15.79:0/4028848023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0b48e0 0x7fe2dc0b4d40 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 --2- 172.21.15.79:0/4028848023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 0x7fe2dc0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 -- 172.21.15.79:0/4028848023 >> 172.21.15.79:0/4028848023 conn(0x7fe2dc0b1d10 msgr2=0x7fe2dc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 -- 172.21.15.79:0/4028848023 shutdown_connections 2024-06-10T00:24:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.802+0000 7fe2e0838640 1 -- 172.21.15.79:0/4028848023 wait complete. 2024-06-10T00:24:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.803+0000 7fe2e0838640 1 Processor -- start 2024-06-10T00:24:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2e0838640 1 -- start start 2024-06-10T00:24:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2e0838640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 0x7fe2dc1e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2e0838640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2dc0b48e0 0x7fe2dc0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2e0838640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0d0020 0x7fe2dc1f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2e0838640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc0b3f20 con 0x7fe2dc0d0020 2024-06-10T00:24:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2e0838640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc15d3f0 con 0x7fe2dc0b48e0 2024-06-10T00:24:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2e0838640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2dc15c490 con 0x7fe2dc0b3b40 2024-06-10T00:24:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2dad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0d0020 0x7fe2dc1f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2dad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0d0020 0x7fe2dc1f23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36668/0 (socket says 172.21.15.79:36668) 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2dad9d640 1 -- 172.21.15.79:0/2538495538 learned_addr learned my addr 172.21.15.79:0/2538495538 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2da59c640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 0x7fe2dc1e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.804+0000 7fe2d9d9b640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2dc0b48e0 0x7fe2dc0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2dad9d640 1 -- 172.21.15.79:0/2538495538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 msgr2=0x7fe2dc1e45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2dad9d640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 0x7fe2dc1e45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2dad9d640 1 -- 172.21.15.79:0/2538495538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2dc0b48e0 msgr2=0x7fe2dc0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2dad9d640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2dc0b48e0 0x7fe2dc0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2dad9d640 1 -- 172.21.15.79:0/2538495538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc1f2920 con 0x7fe2dc0d0020 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2dad9d640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0d0020 0x7fe2dc1f23e0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4007e60 tx=0x7fe2d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2caffd640 1 -- 172.21.15.79:0/2538495538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4014420 con 0x7fe2dc0d0020 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2caffd640 1 -- 172.21.15.79:0/2538495538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d4019070 con 0x7fe2dc0d0020 2024-06-10T00:24:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2dc0afbf0 con 0x7fe2dc0d0020 2024-06-10T00:24:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2caffd640 1 -- 172.21.15.79:0/2538495538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4014820 con 0x7fe2dc0d0020 2024-06-10T00:24:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.805+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2dc0b01b0 con 0x7fe2dc0d0020 2024-06-10T00:24:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.806+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2dc0683c0 con 0x7fe2dc0d0020 2024-06-10T00:24:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.806+0000 7fe2caffd640 1 -- 172.21.15.79:0/2538495538 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2d40149c0 con 0x7fe2dc0d0020 2024-06-10T00:24:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.807+0000 7fe2caffd640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2bc06be30 0x7fe2bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.807+0000 7fe2caffd640 1 -- 172.21.15.79:0/2538495538 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fe2d408b670 con 0x7fe2dc0d0020 2024-06-10T00:24:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.807+0000 7fe2da59c640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2bc06be30 0x7fe2bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.807+0000 7fe2da59c640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2bc06be30 0x7fe2bc06e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc006fd0 tx=0x7fe2cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:31.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:31.811+0000 7fe2caffd640 1 -- 172.21.15.79:0/2538495538 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe2d4059840 con 0x7fe2dc0d0020 2024-06-10T00:24:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.022+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe2dc0cf330 con 0x7fe2dc0d0020 2024-06-10T00:24:32.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.075+0000 7fe2caffd640 1 -- 172.21.15.79:0/2538495538 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7fe2d405db40 con 0x7fe2dc0d0020 2024-06-10T00:24:32.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2bc06be30 msgr2=0x7fe2bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:32.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2bc06be30 0x7fe2bc06e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc006fd0 tx=0x7fe2cc008040 comp rx=0 tx=0).stop 2024-06-10T00:24:32.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0d0020 msgr2=0x7fe2dc1f23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:32.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0d0020 0x7fe2dc1f23e0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4007e60 tx=0x7fe2d400e4b0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 shutdown_connections 2024-06-10T00:24:32.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe2bc06be30 0x7fe2bc06e2f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2dc0d0020 0x7fe2dc1f23e0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2dc0b48e0 0x7fe2dc0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 --2- 172.21.15.79:0/2538495538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2dc0b3b40 0x7fe2dc1e45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 >> 172.21.15.79:0/2538495538 conn(0x7fe2dc0b1d10 msgr2=0x7fe2dc0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:32.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 shutdown_connections 2024-06-10T00:24:32.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.077+0000 7fe2e0838640 1 -- 172.21.15.79:0/2538495538 wait complete. 2024-06-10T00:24:32.090 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-10T00:24:32.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-10T00:24:32.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.206+0000 7f27fd1b7640 1 Processor -- start 2024-06-10T00:24:32.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.206+0000 7f27fd1b7640 1 -- start start 2024-06-10T00:24:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27fd1b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27f8155320 0x7f27f80b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27fd1b7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80d0730 0x7f27f806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27fd1b7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f8155700 con 0x7f27f80b34e0 2024-06-10T00:24:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27fd1b7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f27f815b6b0 con 0x7f27f8155320 2024-06-10T00:24:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27fd1b7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f27f815b990 con 0x7f27f80d0730 2024-06-10T00:24:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27f6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27f8155320 0x7f27f80b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27f6d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27f8155320 0x7f27f80b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36682/0 (socket says 172.21.15.79:36682) 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27f6d9d640 1 -- 172.21.15.79:0/1978019655 learned_addr learned my addr 172.21.15.79:0/1978019655 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27f6d9d640 1 -- 172.21.15.79:0/1978019655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80d0730 msgr2=0x7f27f806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.207+0000 7f27f6d9d640 1 --2- 172.21.15.79:0/1978019655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80d0730 0x7f27f806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.208+0000 7f27f6d9d640 1 -- 172.21.15.79:0/1978019655 >> v1:172.21.15.117:6789/0 conn(0x7f27f80b34e0 legacy=0x7f27f80d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.208+0000 7f27f6d9d640 1 -- 172.21.15.79:0/1978019655 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f815bc70 con 0x7f27f8155320 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.208+0000 7f27f6d9d640 1 --2- 172.21.15.79:0/1978019655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f8155320 0x7f27f80b2fa0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f27e800bb10 tx=0x7f27e802c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6bd6c23a1365a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.208+0000 7f27f659c640 1 -- 172.21.15.79:0/1978019655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8032790 con 0x7f27f8155320 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.208+0000 7f27f659c640 1 -- 172.21.15.79:0/1978019655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e8038070 con 0x7f27f8155320 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.208+0000 7f27f659c640 1 -- 172.21.15.79:0/1978019655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8032b50 con 0x7f27f8155320 2024-06-10T00:24:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.209+0000 7f27fd1b7640 1 -- 172.21.15.79:0/1978019655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f8155320 msgr2=0x7f27f80b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.209+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/1978019655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f8155320 0x7f27f80b2fa0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f27e800bb10 tx=0x7f27e802c8d0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.209+0000 7f27fd1b7640 1 -- 172.21.15.79:0/1978019655 shutdown_connections 2024-06-10T00:24:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.209+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/1978019655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80d0730 0x7f27f806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.209+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/1978019655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f8155320 0x7f27f80b2fa0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.209+0000 7f27fd1b7640 1 -- 172.21.15.79:0/1978019655 >> 172.21.15.79:0/1978019655 conn(0x7f27f80b1d10 msgr2=0x7f27f80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.209+0000 7f27fd1b7640 1 -- 172.21.15.79:0/1978019655 shutdown_connections 2024-06-10T00:24:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.209+0000 7f27fd1b7640 1 -- 172.21.15.79:0/1978019655 wait complete. 2024-06-10T00:24:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.210+0000 7f27fd1b7640 1 Processor -- start 2024-06-10T00:24:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.210+0000 7f27fd1b7640 1 -- start start 2024-06-10T00:24:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27fd1b7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80b34e0 0x7f27f8072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27fd1b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80d0730 0x7f27f81574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27fd1b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f8155320 0x7f27f8152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27fd1b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27f815b470 con 0x7f27f80d0730 2024-06-10T00:24:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27fd1b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f27f815b2f0 con 0x7f27f8155320 2024-06-10T00:24:32.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27fd1b7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f27f806e730 con 0x7f27f80b34e0 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80d0730 0x7f27f81574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80d0730 0x7f27f81574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36690/0 (socket says 172.21.15.79:36690) 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27effff640 1 -- 172.21.15.79:0/2605268811 learned_addr learned my addr 172.21.15.79:0/2605268811 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27f6d9d640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80b34e0 0x7f27f8072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27f759e640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f8155320 0x7f27f8152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27effff640 1 -- 172.21.15.79:0/2605268811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80b34e0 msgr2=0x7f27f8072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27effff640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80b34e0 0x7f27f8072db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27effff640 1 -- 172.21.15.79:0/2605268811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f8155320 msgr2=0x7f27f8152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27effff640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f8155320 0x7f27f8152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:32.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.211+0000 7f27effff640 1 -- 172.21.15.79:0/2605268811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f8155b30 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.212+0000 7f27effff640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80d0730 0x7f27f81574d0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c440 tx=0x7f27e000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.212+0000 7f27ef7fe640 1 -- 172.21.15.79:0/2605268811 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0017070 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.212+0000 7f27ef7fe640 1 -- 172.21.15.79:0/2605268811 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e00035f0 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.212+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f8155e10 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.212+0000 7f27ef7fe640 1 -- 172.21.15.79:0/2605268811 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e00039e0 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.212+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f81563d0 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.213+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f80b4800 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.213+0000 7f27ef7fe640 1 -- 172.21.15.79:0/2605268811 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27e001a070 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.214+0000 7f27ef7fe640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27d806be30 0x7f27d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.214+0000 7f27ef7fe640 1 -- 172.21.15.79:0/2605268811 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f27e008a2e0 con 0x7f27f80d0730 2024-06-10T00:24:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.214+0000 7f27f6d9d640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27d806be30 0x7f27d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:32.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.214+0000 7f27f6d9d640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27d806be30 0x7f27d806e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f27e8037000 tx=0x7f27e8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:32.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.218+0000 7f27ef7fe640 1 -- 172.21.15.79:0/2605268811 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f27f80b4800 con 0x7f27f80d0730 2024-06-10T00:24:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:32.427+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f27f80683c0 con 0x7f27f80d0730 2024-06-10T00:24:33.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.076+0000 7f27ef7fe640 1 -- 172.21.15.79:0/2605268811 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7f27e00010c0 con 0x7f27f80d0730 2024-06-10T00:24:33.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27d806be30 msgr2=0x7f27d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27d806be30 0x7f27d806e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f27e8037000 tx=0x7f27e8032000 comp rx=0 tx=0).stop 2024-06-10T00:24:33.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80d0730 msgr2=0x7f27f81574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80d0730 0x7f27f81574d0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c440 tx=0x7f27e000c900 comp rx=0 tx=0).stop 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 shutdown_connections 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f27d806be30 0x7f27d806e2f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f8155320 0x7f27f8152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80d0730 0x7f27f81574d0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 --2- 172.21.15.79:0/2605268811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f80b34e0 0x7f27f8072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 >> 172.21.15.79:0/2605268811 conn(0x7f27f80b1d10 msgr2=0x7f27f815a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 shutdown_connections 2024-06-10T00:24:33.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.079+0000 7f27fd1b7640 1 -- 172.21.15.79:0/2605268811 wait complete. 2024-06-10T00:24:33.090 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-10T00:24:33.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:33.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.191+0000 7f3bd4c12640 1 Processor -- start 2024-06-10T00:24:33.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.191+0000 7f3bd4c12640 1 -- start start 2024-06-10T00:24:33.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bd4c12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3bd015a870 0x7f3bd006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bd4c12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd00aef70 0x7f3bd00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bd4c12640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd006e390 con 0x7f3bd00af3d0 2024-06-10T00:24:33.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bd4c12640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd015ac50 con 0x7f3bd015a870 2024-06-10T00:24:33.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bd4c12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd006cdb0 con 0x7f3bd00aef70 2024-06-10T00:24:33.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bced9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3bd00af3d0 0x7f3bd00cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42268/0 (socket says 172.21.15.79:42268) 2024-06-10T00:24:33.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bced9d640 1 -- 172.21.15.79:0/1955640408 learned_addr learned my addr 172.21.15.79:0/1955640408 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:33.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bce59c640 1 --2- 172.21.15.79:0/1955640408 >> v2:172.21.15.117:3300/0 conn(0x7f3bd015a870 0x7f3bd006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bc7fff640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd00aef70 0x7f3bd00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282353137 0 0) 0x7f3bd006e390 con 0x7f3bd00af3d0 2024-06-10T00:24:33.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bbc003520 con 0x7f3bd00af3d0 2024-06-10T00:24:33.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1900139309 0 0) 0x7f3bbc003520 con 0x7f3bd00af3d0 2024-06-10T00:24:33.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd00aef70 msgr2=0x7f3bd00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:33.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd00aef70 0x7f3bd00b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 >> v2:172.21.15.117:3300/0 conn(0x7f3bd015a870 msgr2=0x7f3bd006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 --2- 172.21.15.79:0/1955640408 >> v2:172.21.15.117:3300/0 conn(0x7f3bd015a870 0x7f3bd006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd006d090 con 0x7f3bd00af3d0 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f3bc80019f0 con 0x7f3bd00af3d0 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 >> v1:172.21.15.79:6789/0 conn(0x7f3bd00af3d0 legacy=0x7f3bd00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bbc0039b0 0x7f3bbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc004800 0x7f3bbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd00aef70 0x7f3bbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd015ac50 con 0x7f3bbc0039b0 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd006cdb0 con 0x7f3bbc004800 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.192+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3bbc00b9c0 con 0x7f3bd00aef70 2024-06-10T00:24:33.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.193+0000 7f3bce59c640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bbc0039b0 0x7f3bbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.193+0000 7f3bced9d640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd00aef70 0x7f3bbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.193+0000 7f3bc7fff640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc004800 0x7f3bbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.193+0000 7f3bce59c640 1 -- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd00aef70 msgr2=0x7f3bbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.193+0000 7f3bce59c640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd00aef70 0x7f3bbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.193+0000 7f3bce59c640 1 -- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc004800 msgr2=0x7f3bbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.193+0000 7f3bce59c640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc004800 0x7f3bbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.193+0000 7f3bce59c640 1 -- 172.21.15.79:0/1955640408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bbc003520 con 0x7f3bbc0039b0 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bce59c640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bbc0039b0 0x7f3bbc003dd0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009af0 tx=0x7f3bbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45378d126f408c72 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0036070 con 0x7f3bbc0039b0 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc0031400 con 0x7f3bbc0039b0 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bcdd9b640 1 -- 172.21.15.79:0/1955640408 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0009690 con 0x7f3bbc0039b0 2024-06-10T00:24:33.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bd4c12640 1 -- 172.21.15.79:0/1955640408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bbc0039b0 msgr2=0x7f3bbc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bd4c12640 1 --2- 172.21.15.79:0/1955640408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bbc0039b0 0x7f3bbc003dd0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009af0 tx=0x7f3bbc005830 comp rx=0 tx=0).stop 2024-06-10T00:24:33.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bced9d640 1 -- 172.21.15.79:0/1955640408 reap_dead start 2024-06-10T00:24:33.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bd4c12640 1 -- 172.21.15.79:0/1955640408 shutdown_connections 2024-06-10T00:24:33.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bd4c12640 1 -- 172.21.15.79:0/1955640408 >> 172.21.15.79:0/1955640408 conn(0x7f3bd00b19f0 msgr2=0x7f3bd00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:33.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bd4c12640 1 -- 172.21.15.79:0/1955640408 shutdown_connections 2024-06-10T00:24:33.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.194+0000 7f3bd4c12640 1 -- 172.21.15.79:0/1955640408 wait complete. 2024-06-10T00:24:33.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bd4c12640 1 Processor -- start 2024-06-10T00:24:33.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bd4c12640 1 -- start start 2024-06-10T00:24:33.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bd4c12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc0039b0 0x7f3bd01efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bd4c12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd01550f0 0x7f3bd0155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bd4c12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd009ce80 0x7f3bd009d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bd4c12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd006d930 con 0x7f3bd009ce80 2024-06-10T00:24:33.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bd4c12640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd006d650 con 0x7f3bbc0039b0 2024-06-10T00:24:33.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bd4c12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd00b2e40 con 0x7f3bd01550f0 2024-06-10T00:24:33.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd009ce80 0x7f3bd009d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd009ce80 0x7f3bd009d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36704/0 (socket says 172.21.15.79:36704) 2024-06-10T00:24:33.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.196+0000 7f3bced9d640 1 -- 172.21.15.79:0/2829632421 learned_addr learned my addr 172.21.15.79:0/2829632421 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:33.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bc7fff640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd01550f0 0x7f3bd0155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bce59c640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc0039b0 0x7f3bd01efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bced9d640 1 -- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd01550f0 msgr2=0x7f3bd0155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bced9d640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd01550f0 0x7f3bd0155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bced9d640 1 -- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc0039b0 msgr2=0x7f3bd01efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bced9d640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc0039b0 0x7f3bd01efeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bced9d640 1 -- 172.21.15.79:0/2829632421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd009d850 con 0x7f3bd009ce80 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bc7fff640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd01550f0 0x7f3bd0155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bce59c640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc0039b0 0x7f3bd01efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bced9d640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd009ce80 0x7f3bd009d310 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8002230 tx=0x7f3bc800a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bc6ffd640 1 -- 172.21.15.79:0/2829632421 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc800ad90 con 0x7f3bd009ce80 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bc6ffd640 1 -- 172.21.15.79:0/2829632421 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc8018070 con 0x7f3bd009ce80 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd01f0a70 con 0x7f3bd009ce80 2024-06-10T00:24:33.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bc6ffd640 1 -- 172.21.15.79:0/2829632421 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8013630 con 0x7f3bd009ce80 2024-06-10T00:24:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.197+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd0155f40 con 0x7f3bd009ce80 2024-06-10T00:24:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.198+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd0068430 con 0x7f3bd009ce80 2024-06-10T00:24:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.199+0000 7f3bc6ffd640 1 -- 172.21.15.79:0/2829632421 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bc80137d0 con 0x7f3bd009ce80 2024-06-10T00:24:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.199+0000 7f3bc6ffd640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3bb006be60 0x7f3bb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.199+0000 7f3bc6ffd640 1 -- 172.21.15.79:0/2829632421 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f3bc808b680 con 0x7f3bd009ce80 2024-06-10T00:24:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.199+0000 7f3bce59c640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3bb006be60 0x7f3bb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.199+0000 7f3bce59c640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3bb006be60 0x7f3bb006e320 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0033000 tx=0x7f3bc0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.203+0000 7f3bc6ffd640 1 -- 172.21.15.79:0/2829632421 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3bc8059f30 con 0x7f3bd009ce80 2024-06-10T00:24:33.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.416+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3bd00b2650 con 0x7f3bd009ce80 2024-06-10T00:24:33.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.417+0000 7f3bc6ffd640 1 -- 172.21.15.79:0/2829632421 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5189 (secure 0 0 0) 0x7f3bc8059830 con 0x7f3bd009ce80 2024-06-10T00:24:33.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:33.416 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":83,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:24:32.428936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8331":{"gid":8331,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/3594456696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3594456696},{"type":"v1","addr":"172.21.15.79:6837","nonce":3594456696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8331,"qdb_cluster":[8331]},"id":8}]} 2024-06-10T00:24:33.417 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 83 2024-06-10T00:24:33.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3bb006be60 msgr2=0x7f3bb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3bb006be60 0x7f3bb006e320 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0033000 tx=0x7f3bc0008030 comp rx=0 tx=0).stop 2024-06-10T00:24:33.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd009ce80 msgr2=0x7f3bd009d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd009ce80 0x7f3bd009d310 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8002230 tx=0x7f3bc800a790 comp rx=0 tx=0).stop 2024-06-10T00:24:33.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 shutdown_connections 2024-06-10T00:24:33.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f3bb006be60 0x7f3bb006e320 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd009ce80 0x7f3bd009d310 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bd01550f0 0x7f3bd0155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 --2- 172.21.15.79:0/2829632421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bbc0039b0 0x7f3bd01efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 >> 172.21.15.79:0/2829632421 conn(0x7f3bd00b19f0 msgr2=0x7f3bd01581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:33.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 shutdown_connections 2024-06-10T00:24:33.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.419+0000 7f3bd4c12640 1 -- 172.21.15.79:0/2829632421 wait complete. 2024-06-10T00:24:33.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:24:33.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.529+0000 7f646fa37640 1 Processor -- start 2024-06-10T00:24:33.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.529+0000 7f646fa37640 1 -- start start 2024-06-10T00:24:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646fa37640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64681553c0 0x7f64680cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646fa37640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f64680cec50 0x7f64680cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646fa37640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64680b31a0 con 0x7f64680b2cf0 2024-06-10T00:24:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646fa37640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f64680b3420 con 0x7f64681553c0 2024-06-10T00:24:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646fa37640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f64680cc750 con 0x7f64680cec50 2024-06-10T00:24:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646d7d3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64681553c0 0x7f64680cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646cfd2640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f64680b2cf0 0x7f646815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42278/0 (socket says 172.21.15.79:42278) 2024-06-10T00:24:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646cfd2640 1 -- 172.21.15.79:0/1370316733 learned_addr learned my addr 172.21.15.79:0/1370316733 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646dfd4640 1 --2- 172.21.15.79:0/1370316733 >> v2:172.21.15.117:3300/0 conn(0x7f64680cec50 0x7f64680cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646d7d3640 1 -- 172.21.15.79:0/1370316733 >> v2:172.21.15.117:3300/0 conn(0x7f64680cec50 msgr2=0x7f64680cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646d7d3640 1 --2- 172.21.15.79:0/1370316733 >> v2:172.21.15.117:3300/0 conn(0x7f64680cec50 0x7f64680cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646d7d3640 1 -- 172.21.15.79:0/1370316733 >> v1:172.21.15.79:6789/0 conn(0x7f64680b2cf0 legacy=0x7f646815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f645ffff640 1 -- 172.21.15.79:0/1370316733 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307033638 0 0) 0x7f6458001110 con 0x7f64680b2cf0 2024-06-10T00:24:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646d7d3640 1 -- 172.21.15.79:0/1370316733 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64680cca30 con 0x7f64681553c0 2024-06-10T00:24:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.530+0000 7f646dfd4640 1 --2- 172.21.15.79:0/1370316733 >> v2:172.21.15.117:3300/0 conn(0x7f64680cec50 0x7f64680cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.531+0000 7f646d7d3640 1 --2- 172.21.15.79:0/1370316733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64681553c0 0x7f64680cd230 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f64640097a0 tx=0x7f646402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f973ec946fef4b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.531+0000 7f645ffff640 1 -- 172.21.15.79:0/1370316733 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464037070 con 0x7f64681553c0 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.531+0000 7f645ffff640 1 -- 172.21.15.79:0/1370316733 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464032440 con 0x7f64681553c0 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.531+0000 7f645ffff640 1 -- 172.21.15.79:0/1370316733 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464032810 con 0x7f64681553c0 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.532+0000 7f646fa37640 1 -- 172.21.15.79:0/1370316733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64681553c0 msgr2=0x7f64680cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.532+0000 7f646fa37640 1 --2- 172.21.15.79:0/1370316733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64681553c0 0x7f64680cd230 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f64640097a0 tx=0x7f646402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.532+0000 7f646fa37640 1 -- 172.21.15.79:0/1370316733 shutdown_connections 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.532+0000 7f646fa37640 1 --2- 172.21.15.79:0/1370316733 >> v2:172.21.15.117:3300/0 conn(0x7f64680cec50 0x7f64680cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.532+0000 7f646fa37640 1 --2- 172.21.15.79:0/1370316733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64681553c0 0x7f64680cd230 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.532+0000 7f646fa37640 1 -- 172.21.15.79:0/1370316733 >> 172.21.15.79:0/1370316733 conn(0x7f64680b19f0 msgr2=0x7f64680b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.532+0000 7f646fa37640 1 -- 172.21.15.79:0/1370316733 shutdown_connections 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.532+0000 7f646fa37640 1 -- 172.21.15.79:0/1370316733 wait complete. 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.533+0000 7f646fa37640 1 Processor -- start 2024-06-10T00:24:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.533+0000 7f646fa37640 1 -- start start 2024-06-10T00:24:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646fa37640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680b2cf0 0x7f646809c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646fa37640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64680cec50 0x7f646809b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646fa37640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64681553c0 0x7f646815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646fa37640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f64681557a0 con 0x7f64680b2cf0 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646fa37640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f64680b3700 con 0x7f64681553c0 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646fa37640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6468155920 con 0x7f64680cec50 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680b2cf0 0x7f646809c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680b2cf0 0x7f646809c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36716/0 (socket says 172.21.15.79:36716) 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 -- 172.21.15.79:0/2638335149 learned_addr learned my addr 172.21.15.79:0/2638335149 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646cfd2640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64680cec50 0x7f646809b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646dfd4640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64681553c0 0x7f646815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 -- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64680cec50 msgr2=0x7f646809b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64680cec50 0x7f646809b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 -- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64681553c0 msgr2=0x7f646815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64681553c0 0x7f646815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 -- 172.21.15.79:0/2638335149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646815bf50 con 0x7f64680b2cf0 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646dfd4640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64681553c0 0x7f646815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646d7d3640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680b2cf0 0x7f646809c7e0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6464035040 tx=0x7f64640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f645dffb640 1 -- 172.21.15.79:0/2638335149 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464037040 con 0x7f64680b2cf0 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f645dffb640 1 -- 172.21.15.79:0/2638335149 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464030770 con 0x7f64680b2cf0 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.534+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646809bee0 con 0x7f64680b2cf0 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.535+0000 7f645dffb640 1 -- 172.21.15.79:0/2638335149 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464030b80 con 0x7f64680b2cf0 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.535+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646815c4a0 con 0x7f64680b2cf0 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.536+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6468068430 con 0x7f64680b2cf0 2024-06-10T00:24:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.536+0000 7f645dffb640 1 -- 172.21.15.79:0/2638335149 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6464044020 con 0x7f64680b2cf0 2024-06-10T00:24:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.536+0000 7f645dffb640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f644c06be30 0x7f644c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.537+0000 7f645dffb640 1 -- 172.21.15.79:0/2638335149 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f64640ab5f0 con 0x7f64680b2cf0 2024-06-10T00:24:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.537+0000 7f646cfd2640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f644c06be30 0x7f644c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.537+0000 7f646cfd2640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f644c06be30 0x7f644c06e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f64680cbed0 tx=0x7f6458009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.541+0000 7f645dffb640 1 -- 172.21.15.79:0/2638335149 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6464032e20 con 0x7f64680b2cf0 2024-06-10T00:24:33.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.716+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64680ae650 con 0x7f64680b2cf0 2024-06-10T00:24:33.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.717+0000 7f645dffb640 1 -- 172.21.15.79:0/2638335149 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16904 (secure 0 0 0) 0x7f64640313a0 con 0x7f64680b2cf0 2024-06-10T00:24:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:33.717 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":119,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:24:32.069460+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:24:29.040364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-06-10T00:24:29.380624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:24:33.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f644c06be30 msgr2=0x7f644c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f644c06be30 0x7f644c06e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f64680cbed0 tx=0x7f6458009040 comp rx=0 tx=0).stop 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680b2cf0 msgr2=0x7f646809c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680b2cf0 0x7f646809c7e0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6464035040 tx=0x7f64640046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 shutdown_connections 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f644c06be30 0x7f644c06e2f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64681553c0 0x7f646815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64680cec50 0x7f646809b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 --2- 172.21.15.79:0/2638335149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680b2cf0 0x7f646809c7e0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 >> 172.21.15.79:0/2638335149 conn(0x7f64680b19f0 msgr2=0x7f64680acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 shutdown_connections 2024-06-10T00:24:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.720+0000 7f646fa37640 1 -- 172.21.15.79:0/2638335149 wait complete. 2024-06-10T00:24:33.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:24:33.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:24:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.829+0000 7f9387da9640 1 Processor -- start 2024-06-10T00:24:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.829+0000 7f9387da9640 1 -- start start 2024-06-10T00:24:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.830+0000 7f9387da9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93800ccd80 0x7f9380166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.830+0000 7f9387da9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93800725f0 con 0x7f9380156830 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.830+0000 7f9387da9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93800728d0 con 0x7f938015c7f0 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.830+0000 7f9387da9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93800b3090 con 0x7f93800ccd80 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.830+0000 7f9385b45640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9380156830 0x7f9380071bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42284/0 (socket says 172.21.15.79:42284) 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.830+0000 7f9385b45640 1 -- 172.21.15.79:0/2640298195 learned_addr learned my addr 172.21.15.79:0/2640298195 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.831+0000 7f9386346640 1 --2- 172.21.15.79:0/2640298195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93800ccd80 0x7f9380166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.831+0000 7f9384b43640 1 -- 172.21.15.79:0/2640298195 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446927449 0 0) 0x7f93800725f0 con 0x7f9380156830 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.831+0000 7f9384b43640 1 -- 172.21.15.79:0/2640298195 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f936c003520 con 0x7f9380156830 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.831+0000 7f9384b43640 1 -- 172.21.15.79:0/2640298195 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525173463 0 0) 0x7f93800728d0 con 0x7f938015c7f0 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.831+0000 7f9386346640 1 -- 172.21.15.79:0/2640298195 >> v1:172.21.15.117:6789/0 conn(0x7f938015c7f0 legacy=0x7f93800cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.831+0000 7f9386346640 1 -- 172.21.15.79:0/2640298195 >> v1:172.21.15.79:6789/0 conn(0x7f9380156830 legacy=0x7f9380071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.831+0000 7f9386346640 1 -- 172.21.15.79:0/2640298195 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9380072bb0 con 0x7f93800ccd80 2024-06-10T00:24:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9386346640 1 --2- 172.21.15.79:0/2640298195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93800ccd80 0x7f9380166cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9378009dc0 tx=0x7f937802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ee3eff1d1adfc5b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9384b43640 1 -- 172.21.15.79:0/2640298195 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378035020 con 0x7f93800ccd80 2024-06-10T00:24:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9384b43640 1 -- 172.21.15.79:0/2640298195 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9378007540 con 0x7f93800ccd80 2024-06-10T00:24:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9384b43640 1 -- 172.21.15.79:0/2640298195 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c001610 con 0x7f93800ccd80 2024-06-10T00:24:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9387da9640 1 -- 172.21.15.79:0/2640298195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93800ccd80 msgr2=0x7f9380166cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9387da9640 1 --2- 172.21.15.79:0/2640298195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93800ccd80 0x7f9380166cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9378009dc0 tx=0x7f937802a640 comp rx=0 tx=0).stop 2024-06-10T00:24:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9387da9640 1 -- 172.21.15.79:0/2640298195 shutdown_connections 2024-06-10T00:24:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9387da9640 1 --2- 172.21.15.79:0/2640298195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93800ccd80 0x7f9380166cd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9387da9640 1 -- 172.21.15.79:0/2640298195 >> 172.21.15.79:0/2640298195 conn(0x7f93800b19f0 msgr2=0x7f93800b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.832+0000 7f9387da9640 1 -- 172.21.15.79:0/2640298195 shutdown_connections 2024-06-10T00:24:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.833+0000 7f9387da9640 1 -- 172.21.15.79:0/2640298195 wait complete. 2024-06-10T00:24:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9387da9640 1 Processor -- start 2024-06-10T00:24:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9387da9640 1 -- start start 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9387da9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800ccd80 0x7f938006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9387da9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9380156830 0x7f9380152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9387da9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015c7f0 0x7f938015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9387da9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93800b4530 con 0x7f93800ccd80 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9387da9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9380072300 con 0x7f9380156830 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9387da9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93800b46b0 con 0x7f938015c7f0 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9385b45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800ccd80 0x7f938006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9385b45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800ccd80 0x7f938006cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36726/0 (socket says 172.21.15.79:36726) 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.834+0000 7f9385b45640 1 -- 172.21.15.79:0/3844656587 learned_addr learned my addr 172.21.15.79:0/3844656587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9386346640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015c7f0 0x7f938015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9385344640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9380156830 0x7f9380152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9385b45640 1 -- 172.21.15.79:0/3844656587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015c7f0 msgr2=0x7f938015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9385b45640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015c7f0 0x7f938015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9385b45640 1 -- 172.21.15.79:0/3844656587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9380156830 msgr2=0x7f9380152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9385b45640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9380156830 0x7f9380152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9385b45640 1 -- 172.21.15.79:0/3844656587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93801f3b40 con 0x7f93800ccd80 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9385b45640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800ccd80 0x7f938006cdb0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f937c001200 tx=0x7f937c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f93767fc640 1 -- 172.21.15.79:0/3844656587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c018070 con 0x7f93800ccd80 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f93767fc640 1 -- 172.21.15.79:0/3844656587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c0072d0 con 0x7f93800ccd80 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f93767fc640 1 -- 172.21.15.79:0/3844656587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c0047e0 con 0x7f93800ccd80 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93800d0060 con 0x7f93800ccd80 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.835+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93800d0620 con 0x7f93800ccd80 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.836+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9380068430 con 0x7f93800ccd80 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.836+0000 7f93767fc640 1 -- 172.21.15.79:0/3844656587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f937c004980 con 0x7f93800ccd80 2024-06-10T00:24:33.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.837+0000 7f93767fc640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936406be30 0x7f936406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:33.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.837+0000 7f9385344640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936406be30 0x7f936406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:33.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.837+0000 7f93767fc640 1 -- 172.21.15.79:0/3844656587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f937c08a4d0 con 0x7f93800ccd80 2024-06-10T00:24:33.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.837+0000 7f9385344640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936406be30 0x7f936406e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9370007fd0 tx=0x7f9370009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:33.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:33.841+0000 7f93767fc640 1 -- 172.21.15.79:0/3844656587 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f93801f3b40 con 0x7f93800ccd80 2024-06-10T00:24:34.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.011+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93801f3d20 con 0x7f936406be30 2024-06-10T00:24:34.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.017+0000 7f93767fc640 1 -- 172.21.15.79:0/3844656587 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252414 (secure 0 0 0) 0x7f93801f3d20 con 0x7f936406be30 2024-06-10T00:24:34.019 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:34.021 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936406be30 msgr2=0x7f936406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936406be30 0x7f936406e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9370007fd0 tx=0x7f9370009040 comp rx=0 tx=0).stop 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800ccd80 msgr2=0x7f938006cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800ccd80 0x7f938006cdb0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f937c001200 tx=0x7f937c00cb30 comp rx=0 tx=0).stop 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 shutdown_connections 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f936406be30 0x7f936406e2f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f938015c7f0 0x7f938015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9380156830 0x7f9380152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 --2- 172.21.15.79:0/3844656587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93800ccd80 0x7f938006cdb0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 >> 172.21.15.79:0/3844656587 conn(0x7f93800b19f0 msgr2=0x7f93801558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 shutdown_connections 2024-06-10T00:24:34.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.020+0000 7f9387da9640 1 -- 172.21.15.79:0/3844656587 wait complete. 2024-06-10T00:24:34.030 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":413,"stamp":"2024-06-10T00:24:33.282011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262000,"kb_used_data":12552,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712720,"statfs":{"total":773094113280,"available":772825825280,"internally_reserved":0,"allocated":12853248,"data_stored":6609632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.230123"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074850+0000","last_change":"2024-06-10T00:24:31.069772+0000","last_active":"2024-06-10T00:24:31.074850+0000","last_peered":"2024-06-10T00:24:31.074850+0000","last_clean":"2024-06-10T00:24:31.074850+0000","last_became_active":"2024-06-10T00:24:31.069415+0000","last_became_peered":"2024-06-10T00:24:31.069415+0000","last_unstale":"2024-06-10T00:24:31.074850+0000","last_undegraded":"2024-06-10T00:24:31.074850+0000","last_fullsized":"2024-06-10T00:24:31.074850+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:34.130476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088815+0000","last_change":"2024-06-10T00:24:31.085958+0000","last_active":"2024-06-10T00:24:31.088815+0000","last_peered":"2024-06-10T00:24:31.088815+0000","last_clean":"2024-06-10T00:24:31.088815+0000","last_became_active":"2024-06-10T00:24:31.085487+0000","last_became_peered":"2024-06-10T00:24:31.085487+0000","last_unstale":"2024-06-10T00:24:31.088815+0000","last_undegraded":"2024-06-10T00:24:31.088815+0000","last_fullsized":"2024-06-10T00:24:31.088815+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:44:49.483750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.084817+0000","last_change":"2024-06-10T00:24:31.082914+0000","last_active":"2024-06-10T00:24:31.084817+0000","last_peered":"2024-06-10T00:24:31.084817+0000","last_clean":"2024-06-10T00:24:31.084817+0000","last_became_active":"2024-06-10T00:24:31.081885+0000","last_became_peered":"2024-06-10T00:24:31.081885+0000","last_unstale":"2024-06-10T00:24:31.084817+0000","last_undegraded":"2024-06-10T00:24:31.084817+0000","last_fullsized":"2024-06-10T00:24:31.084817+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:43.462262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092128+0000","last_change":"2024-06-10T00:24:31.084788+0000","last_active":"2024-06-10T00:24:31.092128+0000","last_peered":"2024-06-10T00:24:31.092128+0000","last_clean":"2024-06-10T00:24:31.092128+0000","last_became_active":"2024-06-10T00:24:31.084554+0000","last_became_peered":"2024-06-10T00:24:31.084554+0000","last_unstale":"2024-06-10T00:24:31.092128+0000","last_undegraded":"2024-06-10T00:24:31.092128+0000","last_fullsized":"2024-06-10T00:24:31.092128+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:07:45.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.076758+0000","last_change":"2024-06-10T00:24:31.074642+0000","last_active":"2024-06-10T00:24:31.076758+0000","last_peered":"2024-06-10T00:24:31.076758+0000","last_clean":"2024-06-10T00:24:31.076758+0000","last_became_active":"2024-06-10T00:24:31.074343+0000","last_became_peered":"2024-06-10T00:24:31.074343+0000","last_unstale":"2024-06-10T00:24:31.076758+0000","last_undegraded":"2024-06-10T00:24:31.076758+0000","last_fullsized":"2024-06-10T00:24:31.076758+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:12:01.461104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092045+0000","last_change":"2024-06-10T00:24:31.090125+0000","last_active":"2024-06-10T00:24:31.092045+0000","last_peered":"2024-06-10T00:24:31.092045+0000","last_clean":"2024-06-10T00:24:31.092045+0000","last_became_active":"2024-06-10T00:24:31.089872+0000","last_became_peered":"2024-06-10T00:24:31.089872+0000","last_unstale":"2024-06-10T00:24:31.092045+0000","last_undegraded":"2024-06-10T00:24:31.092045+0000","last_fullsized":"2024-06-10T00:24:31.092045+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:11:55.506289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.093557+0000","last_change":"2024-06-10T00:24:31.093094+0000","last_active":"2024-06-10T00:24:31.093557+0000","last_peered":"2024-06-10T00:24:31.093557+0000","last_clean":"2024-06-10T00:24:31.093557+0000","last_became_active":"2024-06-10T00:24:31.092847+0000","last_became_peered":"2024-06-10T00:24:31.092847+0000","last_unstale":"2024-06-10T00:24:31.093557+0000","last_undegraded":"2024-06-10T00:24:31.093557+0000","last_fullsized":"2024-06-10T00:24:31.093557+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:05.078557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086080+0000","last_change":"2024-06-10T00:24:31.079272+0000","last_active":"2024-06-10T00:24:31.086080+0000","last_peered":"2024-06-10T00:24:31.086080+0000","last_clean":"2024-06-10T00:24:31.086080+0000","last_became_active":"2024-06-10T00:24:31.078974+0000","last_became_peered":"2024-06-10T00:24:31.078974+0000","last_unstale":"2024-06-10T00:24:31.086080+0000","last_undegraded":"2024-06-10T00:24:31.086080+0000","last_fullsized":"2024-06-10T00:24:31.086080+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:31.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092817+0000","last_change":"2024-06-10T00:24:31.089319+0000","last_active":"2024-06-10T00:24:31.092817+0000","last_peered":"2024-06-10T00:24:31.092817+0000","last_clean":"2024-06-10T00:24:31.092817+0000","last_became_active":"2024-06-10T00:24:31.089021+0000","last_became_peered":"2024-06-10T00:24:31.089021+0000","last_unstale":"2024-06-10T00:24:31.092817+0000","last_undegraded":"2024-06-10T00:24:31.092817+0000","last_fullsized":"2024-06-10T00:24:31.092817+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:47:01.357843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.084388+0000","last_change":"2024-06-10T00:24:31.083407+0000","last_active":"2024-06-10T00:24:31.084388+0000","last_peered":"2024-06-10T00:24:31.084388+0000","last_clean":"2024-06-10T00:24:31.084388+0000","last_became_active":"2024-06-10T00:24:31.083133+0000","last_became_peered":"2024-06-10T00:24:31.083133+0000","last_unstale":"2024-06-10T00:24:31.084388+0000","last_undegraded":"2024-06-10T00:24:31.084388+0000","last_fullsized":"2024-06-10T00:24:31.084388+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:03.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074921+0000","last_change":"2024-06-10T00:24:31.073233+0000","last_active":"2024-06-10T00:24:31.074921+0000","last_peered":"2024-06-10T00:24:31.074921+0000","last_clean":"2024-06-10T00:24:31.074921+0000","last_became_active":"2024-06-10T00:24:31.072710+0000","last_became_peered":"2024-06-10T00:24:31.072710+0000","last_unstale":"2024-06-10T00:24:31.074921+0000","last_undegraded":"2024-06-10T00:24:31.074921+0000","last_fullsized":"2024-06-10T00:24:31.074921+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:14:27.675864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091720+0000","last_change":"2024-06-10T00:24:31.087854+0000","last_active":"2024-06-10T00:24:31.091720+0000","last_peered":"2024-06-10T00:24:31.091720+0000","last_clean":"2024-06-10T00:24:31.091720+0000","last_became_active":"2024-06-10T00:24:31.086787+0000","last_became_peered":"2024-06-10T00:24:31.086787+0000","last_unstale":"2024-06-10T00:24:31.091720+0000","last_undegraded":"2024-06-10T00:24:31.091720+0000","last_fullsized":"2024-06-10T00:24:31.091720+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:36.074546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.079457+0000","last_change":"2024-06-10T00:24:31.073422+0000","last_active":"2024-06-10T00:24:31.079457+0000","last_peered":"2024-06-10T00:24:31.079457+0000","last_clean":"2024-06-10T00:24:31.079457+0000","last_became_active":"2024-06-10T00:24:31.073003+0000","last_became_peered":"2024-06-10T00:24:31.073003+0000","last_unstale":"2024-06-10T00:24:31.079457+0000","last_undegraded":"2024-06-10T00:24:31.079457+0000","last_fullsized":"2024-06-10T00:24:31.079457+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:14:27.675864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.084838+0000","last_change":"2024-06-10T00:24:31.082904+0000","last_active":"2024-06-10T00:24:31.084838+0000","last_peered":"2024-06-10T00:24:31.084838+0000","last_clean":"2024-06-10T00:24:31.084838+0000","last_became_active":"2024-06-10T00:24:31.081842+0000","last_became_peered":"2024-06-10T00:24:31.081842+0000","last_unstale":"2024-06-10T00:24:31.084838+0000","last_undegraded":"2024-06-10T00:24:31.084838+0000","last_fullsized":"2024-06-10T00:24:31.084838+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:07:45.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.083635+0000","last_change":"2024-06-10T00:24:31.080343+0000","last_active":"2024-06-10T00:24:31.083635+0000","last_peered":"2024-06-10T00:24:31.083635+0000","last_clean":"2024-06-10T00:24:31.083635+0000","last_became_active":"2024-06-10T00:24:31.080072+0000","last_became_peered":"2024-06-10T00:24:31.080072+0000","last_unstale":"2024-06-10T00:24:31.083635+0000","last_undegraded":"2024-06-10T00:24:31.083635+0000","last_fullsized":"2024-06-10T00:24:31.083635+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:24.863644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091737+0000","last_change":"2024-06-10T00:24:31.087305+0000","last_active":"2024-06-10T00:24:31.091737+0000","last_peered":"2024-06-10T00:24:31.091737+0000","last_clean":"2024-06-10T00:24:31.091737+0000","last_became_active":"2024-06-10T00:24:31.086552+0000","last_became_peered":"2024-06-10T00:24:31.086552+0000","last_unstale":"2024-06-10T00:24:31.091737+0000","last_undegraded":"2024-06-10T00:24:31.091737+0000","last_fullsized":"2024-06-10T00:24:31.091737+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:10:20.362524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.082731+0000","last_change":"2024-06-10T00:24:31.078492+0000","last_active":"2024-06-10T00:24:31.082731+0000","last_peered":"2024-06-10T00:24:31.082731+0000","last_clean":"2024-06-10T00:24:31.082731+0000","last_became_active":"2024-06-10T00:24:31.078204+0000","last_became_peered":"2024-06-10T00:24:31.078204+0000","last_unstale":"2024-06-10T00:24:31.082731+0000","last_undegraded":"2024-06-10T00:24:31.082731+0000","last_fullsized":"2024-06-10T00:24:31.082731+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:24.863644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088796+0000","last_change":"2024-06-10T00:24:31.085734+0000","last_active":"2024-06-10T00:24:31.088796+0000","last_peered":"2024-06-10T00:24:31.088796+0000","last_clean":"2024-06-10T00:24:31.088796+0000","last_became_active":"2024-06-10T00:24:31.085110+0000","last_became_peered":"2024-06-10T00:24:31.085110+0000","last_unstale":"2024-06-10T00:24:31.088796+0000","last_undegraded":"2024-06-10T00:24:31.088796+0000","last_fullsized":"2024-06-10T00:24:31.088796+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:03:56.712383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.095699+0000","last_change":"2024-06-10T00:24:31.088907+0000","last_active":"2024-06-10T00:24:31.095699+0000","last_peered":"2024-06-10T00:24:31.095699+0000","last_clean":"2024-06-10T00:24:31.095699+0000","last_became_active":"2024-06-10T00:24:31.088629+0000","last_became_peered":"2024-06-10T00:24:31.088629+0000","last_unstale":"2024-06-10T00:24:31.095699+0000","last_undegraded":"2024-06-10T00:24:31.095699+0000","last_fullsized":"2024-06-10T00:24:31.095699+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:45.245918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086221+0000","last_change":"2024-06-10T00:24:31.083737+0000","last_active":"2024-06-10T00:24:31.086221+0000","last_peered":"2024-06-10T00:24:31.086221+0000","last_clean":"2024-06-10T00:24:31.086221+0000","last_became_active":"2024-06-10T00:24:31.083471+0000","last_became_peered":"2024-06-10T00:24:31.083471+0000","last_unstale":"2024-06-10T00:24:31.086221+0000","last_undegraded":"2024-06-10T00:24:31.086221+0000","last_fullsized":"2024-06-10T00:24:31.086221+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:48:30.370835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092811+0000","last_change":"2024-06-10T00:24:31.089619+0000","last_active":"2024-06-10T00:24:31.092811+0000","last_peered":"2024-06-10T00:24:31.092811+0000","last_clean":"2024-06-10T00:24:31.092811+0000","last_became_active":"2024-06-10T00:24:31.088712+0000","last_became_peered":"2024-06-10T00:24:31.088712+0000","last_unstale":"2024-06-10T00:24:31.092811+0000","last_undegraded":"2024-06-10T00:24:31.092811+0000","last_fullsized":"2024-06-10T00:24:31.092811+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:03:56.712383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.080760+0000","last_change":"2024-06-10T00:24:31.075388+0000","last_active":"2024-06-10T00:24:31.080760+0000","last_peered":"2024-06-10T00:24:31.080760+0000","last_clean":"2024-06-10T00:24:31.080760+0000","last_became_active":"2024-06-10T00:24:31.075083+0000","last_became_peered":"2024-06-10T00:24:31.075083+0000","last_unstale":"2024-06-10T00:24:31.080760+0000","last_undegraded":"2024-06-10T00:24:31.080760+0000","last_fullsized":"2024-06-10T00:24:31.080760+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:35:14.271479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092845+0000","last_change":"2024-06-10T00:24:31.091250+0000","last_active":"2024-06-10T00:24:31.092845+0000","last_peered":"2024-06-10T00:24:31.092845+0000","last_clean":"2024-06-10T00:24:31.092845+0000","last_became_active":"2024-06-10T00:24:31.090912+0000","last_became_peered":"2024-06-10T00:24:31.090912+0000","last_unstale":"2024-06-10T00:24:31.092845+0000","last_undegraded":"2024-06-10T00:24:31.092845+0000","last_fullsized":"2024-06-10T00:24:31.092845+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:22:40.851908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085842+0000","last_change":"2024-06-10T00:24:31.078321+0000","last_active":"2024-06-10T00:24:31.085842+0000","last_peered":"2024-06-10T00:24:31.085842+0000","last_clean":"2024-06-10T00:24:31.085842+0000","last_became_active":"2024-06-10T00:24:31.077003+0000","last_became_peered":"2024-06-10T00:24:31.077003+0000","last_unstale":"2024-06-10T00:24:31.085842+0000","last_undegraded":"2024-06-10T00:24:31.085842+0000","last_fullsized":"2024-06-10T00:24:31.085842+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:24.863644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085731+0000","last_change":"2024-06-10T00:24:31.075171+0000","last_active":"2024-06-10T00:24:31.085731+0000","last_peered":"2024-06-10T00:24:31.085731+0000","last_clean":"2024-06-10T00:24:31.085731+0000","last_became_active":"2024-06-10T00:24:31.074766+0000","last_became_peered":"2024-06-10T00:24:31.074766+0000","last_unstale":"2024-06-10T00:24:31.085731+0000","last_undegraded":"2024-06-10T00:24:31.085731+0000","last_fullsized":"2024-06-10T00:24:31.085731+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:15:29.225344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074350+0000","last_change":"2024-06-10T00:24:31.071570+0000","last_active":"2024-06-10T00:24:31.074350+0000","last_peered":"2024-06-10T00:24:31.074350+0000","last_clean":"2024-06-10T00:24:31.074350+0000","last_became_active":"2024-06-10T00:24:31.071278+0000","last_became_peered":"2024-06-10T00:24:31.071278+0000","last_unstale":"2024-06-10T00:24:31.074350+0000","last_undegraded":"2024-06-10T00:24:31.074350+0000","last_fullsized":"2024-06-10T00:24:31.074350+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:30:21.895560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086860+0000","last_change":"2024-06-10T00:24:31.085369+0000","last_active":"2024-06-10T00:24:31.086860+0000","last_peered":"2024-06-10T00:24:31.086860+0000","last_clean":"2024-06-10T00:24:31.086860+0000","last_became_active":"2024-06-10T00:24:31.085055+0000","last_became_peered":"2024-06-10T00:24:31.085055+0000","last_unstale":"2024-06-10T00:24:31.086860+0000","last_undegraded":"2024-06-10T00:24:31.086860+0000","last_fullsized":"2024-06-10T00:24:31.086860+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:02:50.272649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092094+0000","last_change":"2024-06-10T00:24:31.089799+0000","last_active":"2024-06-10T00:24:31.092094+0000","last_peered":"2024-06-10T00:24:31.092094+0000","last_clean":"2024-06-10T00:24:31.092094+0000","last_became_active":"2024-06-10T00:24:31.089523+0000","last_became_peered":"2024-06-10T00:24:31.089523+0000","last_unstale":"2024-06-10T00:24:31.092094+0000","last_undegraded":"2024-06-10T00:24:31.092094+0000","last_fullsized":"2024-06-10T00:24:31.092094+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:11.184035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074453+0000","last_change":"2024-06-10T00:24:31.072925+0000","last_active":"2024-06-10T00:24:31.074453+0000","last_peered":"2024-06-10T00:24:31.074453+0000","last_clean":"2024-06-10T00:24:31.074453+0000","last_became_active":"2024-06-10T00:24:31.072656+0000","last_became_peered":"2024-06-10T00:24:31.072656+0000","last_unstale":"2024-06-10T00:24:31.074453+0000","last_undegraded":"2024-06-10T00:24:31.074453+0000","last_fullsized":"2024-06-10T00:24:31.074453+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:08:07.102455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.082605+0000","last_change":"2024-06-10T00:24:31.076763+0000","last_active":"2024-06-10T00:24:31.082605+0000","last_peered":"2024-06-10T00:24:31.082605+0000","last_clean":"2024-06-10T00:24:31.082605+0000","last_became_active":"2024-06-10T00:24:31.075746+0000","last_became_peered":"2024-06-10T00:24:31.075746+0000","last_unstale":"2024-06-10T00:24:31.082605+0000","last_undegraded":"2024-06-10T00:24:31.082605+0000","last_fullsized":"2024-06-10T00:24:31.082605+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:16:56.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085668+0000","last_change":"2024-06-10T00:24:31.076308+0000","last_active":"2024-06-10T00:24:31.085668+0000","last_peered":"2024-06-10T00:24:31.085668+0000","last_clean":"2024-06-10T00:24:31.085668+0000","last_became_active":"2024-06-10T00:24:31.075439+0000","last_became_peered":"2024-06-10T00:24:31.075439+0000","last_unstale":"2024-06-10T00:24:31.085668+0000","last_undegraded":"2024-06-10T00:24:31.085668+0000","last_fullsized":"2024-06-10T00:24:31.085668+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:14:27.675864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085559+0000","last_change":"2024-06-10T00:24:31.076944+0000","last_active":"2024-06-10T00:24:31.085559+0000","last_peered":"2024-06-10T00:24:31.085559+0000","last_clean":"2024-06-10T00:24:31.085559+0000","last_became_active":"2024-06-10T00:24:31.076636+0000","last_became_peered":"2024-06-10T00:24:31.076636+0000","last_unstale":"2024-06-10T00:24:31.085559+0000","last_undegraded":"2024-06-10T00:24:31.085559+0000","last_fullsized":"2024-06-10T00:24:31.085559+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:35:14.271479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088969+0000","last_change":"2024-06-10T00:24:31.084193+0000","last_active":"2024-06-10T00:24:31.088969+0000","last_peered":"2024-06-10T00:24:31.088969+0000","last_clean":"2024-06-10T00:24:31.088969+0000","last_became_active":"2024-06-10T00:24:31.083871+0000","last_became_peered":"2024-06-10T00:24:31.083871+0000","last_unstale":"2024-06-10T00:24:31.088969+0000","last_undegraded":"2024-06-10T00:24:31.088969+0000","last_fullsized":"2024-06-10T00:24:31.088969+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:42:24.679427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"118'4","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.089145+0000","last_change":"2024-06-10T00:24:30.075521+0000","last_active":"2024-06-10T00:24:31.089145+0000","last_peered":"2024-06-10T00:24:31.089145+0000","last_clean":"2024-06-10T00:24:31.089145+0000","last_became_active":"2024-06-10T00:24:30.075224+0000","last_became_peered":"2024-06-10T00:24:30.075224+0000","last_unstale":"2024-06-10T00:24:31.089145+0000","last_undegraded":"2024-06-10T00:24:31.089145+0000","last_fullsized":"2024-06-10T00:24:31.089145+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:23.857883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091981+0000","last_change":"2024-06-10T00:24:31.089705+0000","last_active":"2024-06-10T00:24:31.091981+0000","last_peered":"2024-06-10T00:24:31.091981+0000","last_clean":"2024-06-10T00:24:31.091981+0000","last_became_active":"2024-06-10T00:24:31.089440+0000","last_became_peered":"2024-06-10T00:24:31.089440+0000","last_unstale":"2024-06-10T00:24:31.091981+0000","last_undegraded":"2024-06-10T00:24:31.091981+0000","last_fullsized":"2024-06-10T00:24:31.091981+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:40:33.772740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.075281+0000","last_change":"2024-06-10T00:24:30.067093+0000","last_active":"2024-06-10T00:24:31.075281+0000","last_peered":"2024-06-10T00:24:31.075281+0000","last_clean":"2024-06-10T00:24:31.075281+0000","last_became_active":"2024-06-10T00:24:30.066850+0000","last_became_peered":"2024-06-10T00:24:30.066850+0000","last_unstale":"2024-06-10T00:24:31.075281+0000","last_undegraded":"2024-06-10T00:24:31.075281+0000","last_fullsized":"2024-06-10T00:24:31.075281+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:26:45.497922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088754+0000","last_change":"2024-06-10T00:24:31.086085+0000","last_active":"2024-06-10T00:24:31.088754+0000","last_peered":"2024-06-10T00:24:31.088754+0000","last_clean":"2024-06-10T00:24:31.088754+0000","last_became_active":"2024-06-10T00:24:31.085366+0000","last_became_peered":"2024-06-10T00:24:31.085366+0000","last_unstale":"2024-06-10T00:24:31.088754+0000","last_undegraded":"2024-06-10T00:24:31.088754+0000","last_fullsized":"2024-06-10T00:24:31.088754+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:45.245918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092035+0000","last_change":"2024-06-10T00:24:30.075019+0000","last_active":"2024-06-10T00:24:31.092035+0000","last_peered":"2024-06-10T00:24:31.092035+0000","last_clean":"2024-06-10T00:24:31.092035+0000","last_became_active":"2024-06-10T00:24:30.074691+0000","last_became_peered":"2024-06-10T00:24:30.074691+0000","last_unstale":"2024-06-10T00:24:31.092035+0000","last_undegraded":"2024-06-10T00:24:31.092035+0000","last_fullsized":"2024-06-10T00:24:31.092035+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:16:55.578217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092841+0000","last_change":"2024-06-10T00:24:31.090891+0000","last_active":"2024-06-10T00:24:31.092841+0000","last_peered":"2024-06-10T00:24:31.092841+0000","last_clean":"2024-06-10T00:24:31.092841+0000","last_became_active":"2024-06-10T00:24:31.089530+0000","last_became_peered":"2024-06-10T00:24:31.089530+0000","last_unstale":"2024-06-10T00:24:31.092841+0000","last_undegraded":"2024-06-10T00:24:31.092841+0000","last_fullsized":"2024-06-10T00:24:31.092841+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:44:35.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.081112+0000","last_change":"2024-06-10T00:24:30.065445+0000","last_active":"2024-06-10T00:24:31.081112+0000","last_peered":"2024-06-10T00:24:31.081112+0000","last_clean":"2024-06-10T00:24:31.081112+0000","last_became_active":"2024-06-10T00:24:30.065139+0000","last_became_peered":"2024-06-10T00:24:30.065139+0000","last_unstale":"2024-06-10T00:24:31.081112+0000","last_undegraded":"2024-06-10T00:24:31.081112+0000","last_fullsized":"2024-06-10T00:24:31.081112+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:27.900794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.082212+0000","last_change":"2024-06-10T00:24:31.075313+0000","last_active":"2024-06-10T00:24:31.082212+0000","last_peered":"2024-06-10T00:24:31.082212+0000","last_clean":"2024-06-10T00:24:31.082212+0000","last_became_active":"2024-06-10T00:24:31.075055+0000","last_became_peered":"2024-06-10T00:24:31.075055+0000","last_unstale":"2024-06-10T00:24:31.082212+0000","last_undegraded":"2024-06-10T00:24:31.082212+0000","last_fullsized":"2024-06-10T00:24:31.082212+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:35:14.271479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.079689+0000","last_change":"2024-06-10T00:24:30.066149+0000","last_active":"2024-06-10T00:24:31.079689+0000","last_peered":"2024-06-10T00:24:31.079689+0000","last_clean":"2024-06-10T00:24:31.079689+0000","last_became_active":"2024-06-10T00:24:30.065836+0000","last_became_peered":"2024-06-10T00:24:30.065836+0000","last_unstale":"2024-06-10T00:24:31.079689+0000","last_undegraded":"2024-06-10T00:24:31.079689+0000","last_fullsized":"2024-06-10T00:24:31.079689+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:27.900794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088481+0000","last_change":"2024-06-10T00:24:31.085179+0000","last_active":"2024-06-10T00:24:31.088481+0000","last_peered":"2024-06-10T00:24:31.088481+0000","last_clean":"2024-06-10T00:24:31.088481+0000","last_became_active":"2024-06-10T00:24:31.084911+0000","last_became_peered":"2024-06-10T00:24:31.084911+0000","last_unstale":"2024-06-10T00:24:31.088481+0000","last_undegraded":"2024-06-10T00:24:31.088481+0000","last_fullsized":"2024-06-10T00:24:31.088481+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:03.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.089587+0000","last_change":"2024-06-10T00:24:30.077958+0000","last_active":"2024-06-10T00:24:31.089587+0000","last_peered":"2024-06-10T00:24:31.089587+0000","last_clean":"2024-06-10T00:24:31.089587+0000","last_became_active":"2024-06-10T00:24:30.077500+0000","last_became_peered":"2024-06-10T00:24:30.077500+0000","last_unstale":"2024-06-10T00:24:31.089587+0000","last_undegraded":"2024-06-10T00:24:31.089587+0000","last_fullsized":"2024-06-10T00:24:31.089587+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:14:33.287738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.078067+0000","last_change":"2024-06-10T00:24:31.072405+0000","last_active":"2024-06-10T00:24:31.078067+0000","last_peered":"2024-06-10T00:24:31.078067+0000","last_clean":"2024-06-10T00:24:31.078067+0000","last_became_active":"2024-06-10T00:24:31.072146+0000","last_became_peered":"2024-06-10T00:24:31.072146+0000","last_unstale":"2024-06-10T00:24:31.078067+0000","last_undegraded":"2024-06-10T00:24:31.078067+0000","last_fullsized":"2024-06-10T00:24:31.078067+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:09:06.545820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.066075+0000","last_change":"2024-06-10T00:24:30.071732+0000","last_active":"2024-06-10T00:24:31.066075+0000","last_peered":"2024-06-10T00:24:31.066075+0000","last_clean":"2024-06-10T00:24:31.066075+0000","last_became_active":"2024-06-10T00:24:30.071321+0000","last_became_peered":"2024-06-10T00:24:30.071321+0000","last_unstale":"2024-06-10T00:24:31.066075+0000","last_undegraded":"2024-06-10T00:24:31.066075+0000","last_fullsized":"2024-06-10T00:24:31.066075+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:27.900794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.079404+0000","last_change":"2024-06-10T00:24:31.072263+0000","last_active":"2024-06-10T00:24:31.079404+0000","last_peered":"2024-06-10T00:24:31.079404+0000","last_clean":"2024-06-10T00:24:31.079404+0000","last_became_active":"2024-06-10T00:24:31.072027+0000","last_became_peered":"2024-06-10T00:24:31.072027+0000","last_unstale":"2024-06-10T00:24:31.079404+0000","last_undegraded":"2024-06-10T00:24:31.079404+0000","last_fullsized":"2024-06-10T00:24:31.079404+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:15:29.225344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077085+0000","last_change":"2024-06-10T00:24:30.080362+0000","last_active":"2024-06-10T00:24:31.077085+0000","last_peered":"2024-06-10T00:24:31.077085+0000","last_clean":"2024-06-10T00:24:31.077085+0000","last_became_active":"2024-06-10T00:24:30.080071+0000","last_became_peered":"2024-06-10T00:24:30.080071+0000","last_unstale":"2024-06-10T00:24:31.077085+0000","last_undegraded":"2024-06-10T00:24:31.077085+0000","last_fullsized":"2024-06-10T00:24:31.077085+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:33:41.285091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.095726+0000","last_change":"2024-06-10T00:24:31.089836+0000","last_active":"2024-06-10T00:24:31.095726+0000","last_peered":"2024-06-10T00:24:31.095726+0000","last_clean":"2024-06-10T00:24:31.095726+0000","last_became_active":"2024-06-10T00:24:31.089547+0000","last_became_peered":"2024-06-10T00:24:31.089547+0000","last_unstale":"2024-06-10T00:24:31.095726+0000","last_undegraded":"2024-06-10T00:24:31.095726+0000","last_fullsized":"2024-06-10T00:24:31.095726+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:53:27.858123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.072790+0000","last_change":"2024-06-10T00:24:30.080344+0000","last_active":"2024-06-10T00:24:31.072790+0000","last_peered":"2024-06-10T00:24:31.072790+0000","last_clean":"2024-06-10T00:24:31.072790+0000","last_became_active":"2024-06-10T00:24:30.080016+0000","last_became_peered":"2024-06-10T00:24:30.080016+0000","last_unstale":"2024-06-10T00:24:31.072790+0000","last_undegraded":"2024-06-10T00:24:31.072790+0000","last_fullsized":"2024-06-10T00:24:31.072790+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:12:00.455343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085636+0000","last_change":"2024-06-10T00:24:31.076558+0000","last_active":"2024-06-10T00:24:31.085636+0000","last_peered":"2024-06-10T00:24:31.085636+0000","last_clean":"2024-06-10T00:24:31.085636+0000","last_became_active":"2024-06-10T00:24:31.076256+0000","last_became_peered":"2024-06-10T00:24:31.076256+0000","last_unstale":"2024-06-10T00:24:31.085636+0000","last_undegraded":"2024-06-10T00:24:31.085636+0000","last_fullsized":"2024-06-10T00:24:31.085636+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:12:01.461104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.066612+0000","last_change":"2024-06-10T00:24:30.068093+0000","last_active":"2024-06-10T00:24:31.066612+0000","last_peered":"2024-06-10T00:24:31.066612+0000","last_clean":"2024-06-10T00:24:31.066612+0000","last_became_active":"2024-06-10T00:24:30.067772+0000","last_became_peered":"2024-06-10T00:24:30.067772+0000","last_unstale":"2024-06-10T00:24:31.066612+0000","last_undegraded":"2024-06-10T00:24:31.066612+0000","last_fullsized":"2024-06-10T00:24:31.066612+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:26:45.497922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.084897+0000","last_change":"2024-06-10T00:24:31.080533+0000","last_active":"2024-06-10T00:24:31.084897+0000","last_peered":"2024-06-10T00:24:31.084897+0000","last_clean":"2024-06-10T00:24:31.084897+0000","last_became_active":"2024-06-10T00:24:31.080280+0000","last_became_peered":"2024-06-10T00:24:31.080280+0000","last_unstale":"2024-06-10T00:24:31.084897+0000","last_undegraded":"2024-06-10T00:24:31.084897+0000","last_fullsized":"2024-06-10T00:24:31.084897+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:35:27.890911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"118'3","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092639+0000","last_change":"2024-06-10T00:24:30.067439+0000","last_active":"2024-06-10T00:24:31.092639+0000","last_peered":"2024-06-10T00:24:31.092639+0000","last_clean":"2024-06-10T00:24:31.092639+0000","last_became_active":"2024-06-10T00:24:30.067024+0000","last_became_peered":"2024-06-10T00:24:30.067024+0000","last_unstale":"2024-06-10T00:24:31.092639+0000","last_undegraded":"2024-06-10T00:24:31.092639+0000","last_fullsized":"2024-06-10T00:24:31.092639+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:33.124715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085814+0000","last_change":"2024-06-10T00:24:31.078950+0000","last_active":"2024-06-10T00:24:31.085814+0000","last_peered":"2024-06-10T00:24:31.085814+0000","last_clean":"2024-06-10T00:24:31.085814+0000","last_became_active":"2024-06-10T00:24:31.077587+0000","last_became_peered":"2024-06-10T00:24:31.077587+0000","last_unstale":"2024-06-10T00:24:31.085814+0000","last_undegraded":"2024-06-10T00:24:31.085814+0000","last_fullsized":"2024-06-10T00:24:31.085814+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:42:24.679427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"118'6","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.094105+0000","last_change":"2024-06-10T00:24:30.073934+0000","last_active":"2024-06-10T00:24:31.094105+0000","last_peered":"2024-06-10T00:24:31.094105+0000","last_clean":"2024-06-10T00:24:31.094105+0000","last_became_active":"2024-06-10T00:24:30.073638+0000","last_became_peered":"2024-06-10T00:24:30.073638+0000","last_unstale":"2024-06-10T00:24:31.094105+0000","last_undegraded":"2024-06-10T00:24:31.094105+0000","last_fullsized":"2024-06-10T00:24:31.094105+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:23.857883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.087583+0000","last_change":"2024-06-10T00:24:31.083012+0000","last_active":"2024-06-10T00:24:31.087583+0000","last_peered":"2024-06-10T00:24:31.087583+0000","last_clean":"2024-06-10T00:24:31.087583+0000","last_became_active":"2024-06-10T00:24:31.082748+0000","last_became_peered":"2024-06-10T00:24:31.082748+0000","last_unstale":"2024-06-10T00:24:31.087583+0000","last_undegraded":"2024-06-10T00:24:31.087583+0000","last_fullsized":"2024-06-10T00:24:31.087583+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:42:24.679427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091132+0000","last_change":"2024-06-10T00:24:30.075971+0000","last_active":"2024-06-10T00:24:31.091132+0000","last_peered":"2024-06-10T00:24:31.091132+0000","last_clean":"2024-06-10T00:24:31.091132+0000","last_became_active":"2024-06-10T00:24:30.075612+0000","last_became_peered":"2024-06-10T00:24:30.075612+0000","last_unstale":"2024-06-10T00:24:31.091132+0000","last_undegraded":"2024-06-10T00:24:31.091132+0000","last_fullsized":"2024-06-10T00:24:31.091132+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:42:23.673666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.089471+0000","last_change":"2024-06-10T00:24:31.085638+0000","last_active":"2024-06-10T00:24:31.089471+0000","last_peered":"2024-06-10T00:24:31.089471+0000","last_clean":"2024-06-10T00:24:31.089471+0000","last_became_active":"2024-06-10T00:24:31.085392+0000","last_became_peered":"2024-06-10T00:24:31.085392+0000","last_unstale":"2024-06-10T00:24:31.089471+0000","last_undegraded":"2024-06-10T00:24:31.089471+0000","last_fullsized":"2024-06-10T00:24:31.089471+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:45.245918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.066503+0000","last_change":"2024-06-10T00:24:30.072554+0000","last_active":"2024-06-10T00:24:31.066503+0000","last_peered":"2024-06-10T00:24:31.066503+0000","last_clean":"2024-06-10T00:24:31.066503+0000","last_became_active":"2024-06-10T00:24:30.072256+0000","last_became_peered":"2024-06-10T00:24:30.072256+0000","last_unstale":"2024-06-10T00:24:31.066503+0000","last_undegraded":"2024-06-10T00:24:31.066503+0000","last_fullsized":"2024-06-10T00:24:31.066503+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:02:49.266888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.075951+0000","last_change":"2024-06-10T00:24:31.075057+0000","last_active":"2024-06-10T00:24:31.075951+0000","last_peered":"2024-06-10T00:24:31.075951+0000","last_clean":"2024-06-10T00:24:31.075951+0000","last_became_active":"2024-06-10T00:24:31.074732+0000","last_became_peered":"2024-06-10T00:24:31.074732+0000","last_unstale":"2024-06-10T00:24:31.075951+0000","last_undegraded":"2024-06-10T00:24:31.075951+0000","last_fullsized":"2024-06-10T00:24:31.075951+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.804260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.067302+0000","last_change":"2024-06-10T00:24:30.072885+0000","last_active":"2024-06-10T00:24:31.067302+0000","last_peered":"2024-06-10T00:24:31.067302+0000","last_clean":"2024-06-10T00:24:31.067302+0000","last_became_active":"2024-06-10T00:24:30.072626+0000","last_became_peered":"2024-06-10T00:24:30.072626+0000","last_unstale":"2024-06-10T00:24:31.067302+0000","last_undegraded":"2024-06-10T00:24:31.067302+0000","last_fullsized":"2024-06-10T00:24:31.067302+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:44.240157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086606+0000","last_change":"2024-06-10T00:24:31.084978+0000","last_active":"2024-06-10T00:24:31.086606+0000","last_peered":"2024-06-10T00:24:31.086606+0000","last_clean":"2024-06-10T00:24:31.086606+0000","last_became_active":"2024-06-10T00:24:31.084677+0000","last_became_peered":"2024-06-10T00:24:31.084677+0000","last_unstale":"2024-06-10T00:24:31.086606+0000","last_undegraded":"2024-06-10T00:24:31.086606+0000","last_fullsized":"2024-06-10T00:24:31.086606+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:02:50.272649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.081366+0000","last_change":"2024-06-10T00:24:30.077022+0000","last_active":"2024-06-10T00:24:31.081366+0000","last_peered":"2024-06-10T00:24:31.081366+0000","last_clean":"2024-06-10T00:24:31.081366+0000","last_became_active":"2024-06-10T00:24:30.076758+0000","last_became_peered":"2024-06-10T00:24:30.076758+0000","last_unstale":"2024-06-10T00:24:31.081366+0000","last_undegraded":"2024-06-10T00:24:31.081366+0000","last_fullsized":"2024-06-10T00:24:31.081366+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:33.124715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074899+0000","last_change":"2024-06-10T00:24:31.071600+0000","last_active":"2024-06-10T00:24:31.074899+0000","last_peered":"2024-06-10T00:24:31.074899+0000","last_clean":"2024-06-10T00:24:31.074899+0000","last_became_active":"2024-06-10T00:24:31.071286+0000","last_became_peered":"2024-06-10T00:24:31.071286+0000","last_unstale":"2024-06-10T00:24:31.074899+0000","last_undegraded":"2024-06-10T00:24:31.074899+0000","last_fullsized":"2024-06-10T00:24:31.074899+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:15:29.225344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.076289+0000","last_change":"2024-06-10T00:24:30.073520+0000","last_active":"2024-06-10T00:24:31.076289+0000","last_peered":"2024-06-10T00:24:31.076289+0000","last_clean":"2024-06-10T00:24:31.076289+0000","last_became_active":"2024-06-10T00:24:30.073211+0000","last_became_peered":"2024-06-10T00:24:30.073211+0000","last_unstale":"2024-06-10T00:24:31.076289+0000","last_undegraded":"2024-06-10T00:24:31.076289+0000","last_fullsized":"2024-06-10T00:24:31.076289+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:38:11.377531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.090677+0000","last_change":"2024-06-10T00:24:31.086799+0000","last_active":"2024-06-10T00:24:31.090677+0000","last_peered":"2024-06-10T00:24:31.090677+0000","last_clean":"2024-06-10T00:24:31.090677+0000","last_became_active":"2024-06-10T00:24:31.086513+0000","last_became_peered":"2024-06-10T00:24:31.086513+0000","last_unstale":"2024-06-10T00:24:31.090677+0000","last_undegraded":"2024-06-10T00:24:31.090677+0000","last_fullsized":"2024-06-10T00:24:31.090677+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:08:20.986637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092007+0000","last_change":"2024-06-10T00:24:30.078003+0000","last_active":"2024-06-10T00:24:31.092007+0000","last_peered":"2024-06-10T00:24:31.092007+0000","last_clean":"2024-06-10T00:24:31.092007+0000","last_became_active":"2024-06-10T00:24:30.077646+0000","last_became_peered":"2024-06-10T00:24:30.077646+0000","last_unstale":"2024-06-10T00:24:31.092007+0000","last_undegraded":"2024-06-10T00:24:31.092007+0000","last_fullsized":"2024-06-10T00:24:31.092007+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:30.398235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091770+0000","last_change":"2024-06-10T00:24:31.086825+0000","last_active":"2024-06-10T00:24:31.091770+0000","last_peered":"2024-06-10T00:24:31.091770+0000","last_clean":"2024-06-10T00:24:31.091770+0000","last_became_active":"2024-06-10T00:24:31.086511+0000","last_became_peered":"2024-06-10T00:24:31.086511+0000","last_unstale":"2024-06-10T00:24:31.091770+0000","last_undegraded":"2024-06-10T00:24:31.091770+0000","last_fullsized":"2024-06-10T00:24:31.091770+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:53:27.858123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.075542+0000","last_change":"2024-06-10T00:24:30.080621+0000","last_active":"2024-06-10T00:24:31.075542+0000","last_peered":"2024-06-10T00:24:31.075542+0000","last_clean":"2024-06-10T00:24:31.075542+0000","last_became_active":"2024-06-10T00:24:30.080355+0000","last_became_peered":"2024-06-10T00:24:30.080355+0000","last_unstale":"2024-06-10T00:24:31.075542+0000","last_undegraded":"2024-06-10T00:24:31.075542+0000","last_fullsized":"2024-06-10T00:24:31.075542+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:09:05.540059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.090494+0000","last_change":"2024-06-10T00:24:31.086115+0000","last_active":"2024-06-10T00:24:31.090494+0000","last_peered":"2024-06-10T00:24:31.090494+0000","last_clean":"2024-06-10T00:24:31.090494+0000","last_became_active":"2024-06-10T00:24:31.085839+0000","last_became_peered":"2024-06-10T00:24:31.085839+0000","last_unstale":"2024-06-10T00:24:31.090494+0000","last_undegraded":"2024-06-10T00:24:31.090494+0000","last_fullsized":"2024-06-10T00:24:31.090494+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:00:46.684793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092568+0000","last_change":"2024-06-10T00:24:30.079879+0000","last_active":"2024-06-10T00:24:31.092568+0000","last_peered":"2024-06-10T00:24:31.092568+0000","last_clean":"2024-06-10T00:24:31.092568+0000","last_became_active":"2024-06-10T00:24:30.079612+0000","last_became_peered":"2024-06-10T00:24:30.079612+0000","last_unstale":"2024-06-10T00:24:31.092568+0000","last_undegraded":"2024-06-10T00:24:31.092568+0000","last_fullsized":"2024-06-10T00:24:31.092568+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:23:42.653286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086104+0000","last_change":"2024-06-10T00:24:31.080116+0000","last_active":"2024-06-10T00:24:31.086104+0000","last_peered":"2024-06-10T00:24:31.086104+0000","last_clean":"2024-06-10T00:24:31.086104+0000","last_became_active":"2024-06-10T00:24:31.079845+0000","last_became_peered":"2024-06-10T00:24:31.079845+0000","last_unstale":"2024-06-10T00:24:31.086104+0000","last_undegraded":"2024-06-10T00:24:31.086104+0000","last_fullsized":"2024-06-10T00:24:31.086104+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:25:32.468101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.078599+0000","last_change":"2024-06-10T00:24:30.077661+0000","last_active":"2024-06-10T00:24:31.078599+0000","last_peered":"2024-06-10T00:24:31.078599+0000","last_clean":"2024-06-10T00:24:31.078599+0000","last_became_active":"2024-06-10T00:24:30.077381+0000","last_became_peered":"2024-06-10T00:24:30.077381+0000","last_unstale":"2024-06-10T00:24:31.078599+0000","last_undegraded":"2024-06-10T00:24:31.078599+0000","last_fullsized":"2024-06-10T00:24:31.078599+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:25:31.462340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.078219+0000","last_change":"2024-06-10T00:24:31.076277+0000","last_active":"2024-06-10T00:24:31.078219+0000","last_peered":"2024-06-10T00:24:31.078219+0000","last_clean":"2024-06-10T00:24:31.078219+0000","last_became_active":"2024-06-10T00:24:31.074264+0000","last_became_peered":"2024-06-10T00:24:31.074264+0000","last_unstale":"2024-06-10T00:24:31.078219+0000","last_undegraded":"2024-06-10T00:24:31.078219+0000","last_fullsized":"2024-06-10T00:24:31.078219+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:50:15.898899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.067361+0000","last_change":"2024-06-10T00:24:30.074084+0000","last_active":"2024-06-10T00:24:31.067361+0000","last_peered":"2024-06-10T00:24:31.067361+0000","last_clean":"2024-06-10T00:24:31.067361+0000","last_became_active":"2024-06-10T00:24:30.073840+0000","last_became_peered":"2024-06-10T00:24:30.073840+0000","last_unstale":"2024-06-10T00:24:31.067361+0000","last_undegraded":"2024-06-10T00:24:31.067361+0000","last_fullsized":"2024-06-10T00:24:31.067361+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:53:26.852362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085784+0000","last_change":"2024-06-10T00:24:31.078615+0000","last_active":"2024-06-10T00:24:31.085784+0000","last_peered":"2024-06-10T00:24:31.085784+0000","last_clean":"2024-06-10T00:24:31.085784+0000","last_became_active":"2024-06-10T00:24:31.078326+0000","last_became_peered":"2024-06-10T00:24:31.078326+0000","last_unstale":"2024-06-10T00:24:31.085784+0000","last_undegraded":"2024-06-10T00:24:31.085784+0000","last_fullsized":"2024-06-10T00:24:31.085784+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:03.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077600+0000","last_change":"2024-06-10T00:24:30.075104+0000","last_active":"2024-06-10T00:24:31.077600+0000","last_peered":"2024-06-10T00:24:31.077600+0000","last_clean":"2024-06-10T00:24:31.077600+0000","last_became_active":"2024-06-10T00:24:30.074786+0000","last_became_peered":"2024-06-10T00:24:30.074786+0000","last_unstale":"2024-06-10T00:24:31.077600+0000","last_undegraded":"2024-06-10T00:24:31.077600+0000","last_fullsized":"2024-06-10T00:24:31.077600+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:48:06.390100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.087664+0000","last_change":"2024-06-10T00:24:31.083801+0000","last_active":"2024-06-10T00:24:31.087664+0000","last_peered":"2024-06-10T00:24:31.087664+0000","last_clean":"2024-06-10T00:24:31.087664+0000","last_became_active":"2024-06-10T00:24:31.083482+0000","last_became_peered":"2024-06-10T00:24:31.083482+0000","last_unstale":"2024-06-10T00:24:31.087664+0000","last_undegraded":"2024-06-10T00:24:31.087664+0000","last_fullsized":"2024-06-10T00:24:31.087664+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:09:17.946428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091579+0000","last_change":"2024-06-10T00:24:30.081356+0000","last_active":"2024-06-10T00:24:31.091579+0000","last_peered":"2024-06-10T00:24:31.091579+0000","last_clean":"2024-06-10T00:24:31.091579+0000","last_became_active":"2024-06-10T00:24:30.081056+0000","last_became_peered":"2024-06-10T00:24:30.081056+0000","last_unstale":"2024-06-10T00:24:31.091579+0000","last_undegraded":"2024-06-10T00:24:31.091579+0000","last_fullsized":"2024-06-10T00:24:31.091579+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:08:19.147100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.082178+0000","last_change":"2024-06-10T00:24:31.075023+0000","last_active":"2024-06-10T00:24:31.082178+0000","last_peered":"2024-06-10T00:24:31.082178+0000","last_clean":"2024-06-10T00:24:31.082178+0000","last_became_active":"2024-06-10T00:24:31.074711+0000","last_became_peered":"2024-06-10T00:24:31.074711+0000","last_unstale":"2024-06-10T00:24:31.082178+0000","last_undegraded":"2024-06-10T00:24:31.082178+0000","last_fullsized":"2024-06-10T00:24:31.082178+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:12:01.461104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.073566+0000","last_change":"2024-06-10T00:24:30.076359+0000","last_active":"2024-06-10T00:24:31.073566+0000","last_peered":"2024-06-10T00:24:31.073566+0000","last_clean":"2024-06-10T00:24:31.073566+0000","last_became_active":"2024-06-10T00:24:30.076057+0000","last_became_peered":"2024-06-10T00:24:30.076057+0000","last_unstale":"2024-06-10T00:24:31.073566+0000","last_undegraded":"2024-06-10T00:24:31.073566+0000","last_fullsized":"2024-06-10T00:24:31.073566+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:02.853379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092866+0000","last_change":"2024-06-10T00:24:31.089102+0000","last_active":"2024-06-10T00:24:31.092866+0000","last_peered":"2024-06-10T00:24:31.092866+0000","last_clean":"2024-06-10T00:24:31.092866+0000","last_became_active":"2024-06-10T00:24:31.086504+0000","last_became_peered":"2024-06-10T00:24:31.086504+0000","last_unstale":"2024-06-10T00:24:31.092866+0000","last_undegraded":"2024-06-10T00:24:31.092866+0000","last_fullsized":"2024-06-10T00:24:31.092866+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:43.462262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.072898+0000","last_change":"2024-06-10T00:24:30.073671+0000","last_active":"2024-06-10T00:24:31.072898+0000","last_peered":"2024-06-10T00:24:31.072898+0000","last_clean":"2024-06-10T00:24:31.072898+0000","last_became_active":"2024-06-10T00:24:30.073419+0000","last_became_peered":"2024-06-10T00:24:30.073419+0000","last_unstale":"2024-06-10T00:24:31.072898+0000","last_undegraded":"2024-06-10T00:24:31.072898+0000","last_fullsized":"2024-06-10T00:24:31.072898+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:35:13.265718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.083239+0000","last_change":"2024-06-10T00:24:31.078769+0000","last_active":"2024-06-10T00:24:31.083239+0000","last_peered":"2024-06-10T00:24:31.083239+0000","last_clean":"2024-06-10T00:24:31.083239+0000","last_became_active":"2024-06-10T00:24:31.078508+0000","last_became_peered":"2024-06-10T00:24:31.078508+0000","last_unstale":"2024-06-10T00:24:31.083239+0000","last_undegraded":"2024-06-10T00:24:31.083239+0000","last_fullsized":"2024-06-10T00:24:31.083239+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:41:59.986491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.081456+0000","last_change":"2024-06-10T00:24:30.076879+0000","last_active":"2024-06-10T00:24:31.081456+0000","last_peered":"2024-06-10T00:24:31.081456+0000","last_clean":"2024-06-10T00:24:31.081456+0000","last_became_active":"2024-06-10T00:24:30.076532+0000","last_became_peered":"2024-06-10T00:24:30.076532+0000","last_unstale":"2024-06-10T00:24:31.081456+0000","last_undegraded":"2024-06-10T00:24:31.081456+0000","last_fullsized":"2024-06-10T00:24:31.081456+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:57:18.628926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091759+0000","last_change":"2024-06-10T00:24:31.087836+0000","last_active":"2024-06-10T00:24:31.091759+0000","last_peered":"2024-06-10T00:24:31.091759+0000","last_clean":"2024-06-10T00:24:31.091759+0000","last_became_active":"2024-06-10T00:24:31.087562+0000","last_became_peered":"2024-06-10T00:24:31.087562+0000","last_unstale":"2024-06-10T00:24:31.091759+0000","last_undegraded":"2024-06-10T00:24:31.091759+0000","last_fullsized":"2024-06-10T00:24:31.091759+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:11:44.523658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.067512+0000","last_change":"2024-06-10T00:24:30.069425+0000","last_active":"2024-06-10T00:24:31.067512+0000","last_peered":"2024-06-10T00:24:31.067512+0000","last_clean":"2024-06-10T00:24:31.067512+0000","last_became_active":"2024-06-10T00:24:30.069159+0000","last_became_peered":"2024-06-10T00:24:30.069159+0000","last_unstale":"2024-06-10T00:24:31.067512+0000","last_undegraded":"2024-06-10T00:24:31.067512+0000","last_fullsized":"2024-06-10T00:24:31.067512+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:26:45.497922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086084+0000","last_change":"2024-06-10T00:24:31.075576+0000","last_active":"2024-06-10T00:24:31.086084+0000","last_peered":"2024-06-10T00:24:31.086084+0000","last_clean":"2024-06-10T00:24:31.086084+0000","last_became_active":"2024-06-10T00:24:31.074141+0000","last_became_peered":"2024-06-10T00:24:31.074141+0000","last_unstale":"2024-06-10T00:24:31.086084+0000","last_undegraded":"2024-06-10T00:24:31.086084+0000","last_fullsized":"2024-06-10T00:24:31.086084+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:48:07.395861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.066134+0000","last_change":"2024-06-10T00:24:30.065487+0000","last_active":"2024-06-10T00:24:31.066134+0000","last_peered":"2024-06-10T00:24:31.066134+0000","last_clean":"2024-06-10T00:24:31.066134+0000","last_became_active":"2024-06-10T00:24:30.065176+0000","last_became_peered":"2024-06-10T00:24:30.065176+0000","last_unstale":"2024-06-10T00:24:31.066134+0000","last_undegraded":"2024-06-10T00:24:31.066134+0000","last_fullsized":"2024-06-10T00:24:31.066134+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:07:03.190270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092087+0000","last_change":"2024-06-10T00:24:31.084774+0000","last_active":"2024-06-10T00:24:31.092087+0000","last_peered":"2024-06-10T00:24:31.092087+0000","last_clean":"2024-06-10T00:24:31.092087+0000","last_became_active":"2024-06-10T00:24:31.084476+0000","last_became_peered":"2024-06-10T00:24:31.084476+0000","last_unstale":"2024-06-10T00:24:31.092087+0000","last_undegraded":"2024-06-10T00:24:31.092087+0000","last_fullsized":"2024-06-10T00:24:31.092087+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:35:27.890911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077773+0000","last_change":"2024-06-10T00:24:30.073851+0000","last_active":"2024-06-10T00:24:31.077773+0000","last_peered":"2024-06-10T00:24:31.077773+0000","last_clean":"2024-06-10T00:24:31.077773+0000","last_became_active":"2024-06-10T00:24:30.073444+0000","last_became_peered":"2024-06-10T00:24:30.073444+0000","last_unstale":"2024-06-10T00:24:31.077773+0000","last_undegraded":"2024-06-10T00:24:31.077773+0000","last_fullsized":"2024-06-10T00:24:31.077773+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:43:31.093814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.089496+0000","last_change":"2024-06-10T00:24:31.085030+0000","last_active":"2024-06-10T00:24:31.089496+0000","last_peered":"2024-06-10T00:24:31.089496+0000","last_clean":"2024-06-10T00:24:31.089496+0000","last_became_active":"2024-06-10T00:24:31.084772+0000","last_became_peered":"2024-06-10T00:24:31.084772+0000","last_unstale":"2024-06-10T00:24:31.089496+0000","last_undegraded":"2024-06-10T00:24:31.089496+0000","last_fullsized":"2024-06-10T00:24:31.089496+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:02:50.272649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077775+0000","last_change":"2024-06-10T00:24:30.075104+0000","last_active":"2024-06-10T00:24:31.077775+0000","last_peered":"2024-06-10T00:24:31.077775+0000","last_clean":"2024-06-10T00:24:31.077775+0000","last_became_active":"2024-06-10T00:24:30.074797+0000","last_became_peered":"2024-06-10T00:24:30.074797+0000","last_unstale":"2024-06-10T00:24:31.077775+0000","last_undegraded":"2024-06-10T00:24:31.077775+0000","last_fullsized":"2024-06-10T00:24:31.077775+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:50:14.893138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092838+0000","last_change":"2024-06-10T00:24:31.090827+0000","last_active":"2024-06-10T00:24:31.092838+0000","last_peered":"2024-06-10T00:24:31.092838+0000","last_clean":"2024-06-10T00:24:31.092838+0000","last_became_active":"2024-06-10T00:24:31.089349+0000","last_became_peered":"2024-06-10T00:24:31.089349+0000","last_unstale":"2024-06-10T00:24:31.092838+0000","last_undegraded":"2024-06-10T00:24:31.092838+0000","last_fullsized":"2024-06-10T00:24:31.092838+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:44:49.483750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"118'8","reported_seq":20,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092715+0000","last_change":"2024-06-10T00:24:30.070872+0000","last_active":"2024-06-10T00:24:31.092715+0000","last_peered":"2024-06-10T00:24:31.092715+0000","last_clean":"2024-06-10T00:24:31.092715+0000","last_became_active":"2024-06-10T00:24:30.070609+0000","last_became_peered":"2024-06-10T00:24:30.070609+0000","last_unstale":"2024-06-10T00:24:31.092715+0000","last_undegraded":"2024-06-10T00:24:31.092715+0000","last_fullsized":"2024-06-10T00:24:31.092715+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:02.853379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":349,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077923+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:24:31.077923+0000","last_peered":"2024-06-10T00:24:31.077923+0000","last_clean":"2024-06-10T00:24:31.077923+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:24:31.077923+0000","last_undegraded":"2024-06-10T00:24:31.077923+0000","last_fullsized":"2024-06-10T00:24:31.077923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2052096,"data_stored":1268980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574972,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2052096,"data_stored":1268980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:24:34.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:24:34.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.170+0000 7fcfdc67d640 1 Processor -- start 2024-06-10T00:24:34.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.170+0000 7fcfdc67d640 1 -- start start 2024-06-10T00:24:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfdc67d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd406ebf0 0x7fcfd40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfdc67d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfd40cf190 0x7fcfd40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfdc67d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfd40cf640 con 0x7fcfd40ae910 2024-06-10T00:24:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfdc67d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcfd406d130 con 0x7fcfd40cf190 2024-06-10T00:24:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfdc67d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd406d410 con 0x7fcfd406ebf0 2024-06-10T00:24:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfda419640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcfd40ae910 0x7fcfd406e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42290/0 (socket says 172.21.15.79:42290) 2024-06-10T00:24:34.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfda419640 1 -- 172.21.15.79:0/3371941999 learned_addr learned my addr 172.21.15.79:0/3371941999 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfd9c18640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd406ebf0 0x7fcfd40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfdac1a640 1 --2- 172.21.15.79:0/3371941999 >> v2:172.21.15.117:3300/0 conn(0x7fcfd40cf190 0x7fcfd40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230521161 0 0) 0x7fcfd40cf640 con 0x7fcfd40ae910 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.171+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfc0003520 con 0x7fcfd40ae910 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3130747278 0 0) 0x7fcfc0003520 con 0x7fcfd40ae910 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd406ebf0 msgr2=0x7fcfd40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd406ebf0 0x7fcfd40cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 >> v2:172.21.15.117:3300/0 conn(0x7fcfd40cf190 msgr2=0x7fcfd40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 --2- 172.21.15.79:0/3371941999 >> v2:172.21.15.117:3300/0 conn(0x7fcfd40cf190 0x7fcfd40acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd406d6f0 con 0x7fcfd40ae910 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fcfd0001670 con 0x7fcfd40ae910 2024-06-10T00:24:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 >> v1:172.21.15.79:6789/0 conn(0x7fcfd40ae910 legacy=0x7fcfd406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd406ebf0 0x7fcfc00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfc0004d40 0x7fcfc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd406d130 con 0x7fcfc0003f30 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd406d410 con 0x7fcfc0004d40 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc000ba10 con 0x7fcfd406ebf0 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9c18640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfda419640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd406ebf0 0x7fcfc00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfdac1a640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfc0004d40 0x7fcfc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9c18640 1 -- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd406ebf0 msgr2=0x7fcfc00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9c18640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd406ebf0 0x7fcfc00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9c18640 1 -- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfc0004d40 msgr2=0x7fcfc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9c18640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfc0004d40 0x7fcfc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.172+0000 7fcfd9c18640 1 -- 172.21.15.79:0/3371941999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc0003520 con 0x7fcfc0003f30 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.173+0000 7fcfd9c18640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfc0004800 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4009af0 tx=0x7fcfc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735a8ada2d3b6f95 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.173+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4036070 con 0x7fcfc0003f30 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.173+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc4031400 con 0x7fcfc0003f30 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.173+0000 7fcfd9417640 1 -- 172.21.15.79:0/3371941999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4009690 con 0x7fcfc0003f30 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.173+0000 7fcfdc67d640 1 -- 172.21.15.79:0/3371941999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 msgr2=0x7fcfc0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.173+0000 7fcfdc67d640 1 --2- 172.21.15.79:0/3371941999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfc0004800 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4009af0 tx=0x7fcfc0005830 comp rx=0 tx=0).stop 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.173+0000 7fcfdac1a640 1 -- 172.21.15.79:0/3371941999 reap_dead start 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.174+0000 7fcfdc67d640 1 -- 172.21.15.79:0/3371941999 shutdown_connections 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.174+0000 7fcfdc67d640 1 -- 172.21.15.79:0/3371941999 >> 172.21.15.79:0/3371941999 conn(0x7fcfd40b19f0 msgr2=0x7fcfd40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.174+0000 7fcfdc67d640 1 -- 172.21.15.79:0/3371941999 shutdown_connections 2024-06-10T00:24:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.174+0000 7fcfdc67d640 1 -- 172.21.15.79:0/3371941999 wait complete. 2024-06-10T00:24:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfdc67d640 1 Processor -- start 2024-06-10T00:24:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfdc67d640 1 -- start start 2024-06-10T00:24:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfdc67d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfd415d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfdc67d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd4150d30 0x7fcfd41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfdc67d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd4156b00 0x7fcfd409bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfdc67d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd40ad280 con 0x7fcfc0003f30 2024-06-10T00:24:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfdc67d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd40aecf0 con 0x7fcfd4156b00 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfdc67d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd40ad400 con 0x7fcfd4150d30 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.175+0000 7fcfda419640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfd415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfda419640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfd415d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36738/0 (socket says 172.21.15.79:36738) 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfda419640 1 -- 172.21.15.79:0/1095421840 learned_addr learned my addr 172.21.15.79:0/1095421840 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfd9c18640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd4150d30 0x7fcfd41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfdac1a640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd4156b00 0x7fcfd409bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfda419640 1 -- 172.21.15.79:0/1095421840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd4150d30 msgr2=0x7fcfd41565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfda419640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd4150d30 0x7fcfd41565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfda419640 1 -- 172.21.15.79:0/1095421840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd4156b00 msgr2=0x7fcfd409bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfda419640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd4156b00 0x7fcfd409bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfda419640 1 -- 172.21.15.79:0/1095421840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd409aa10 con 0x7fcfc0003f30 2024-06-10T00:24:34.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfda419640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfd415d930 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000e7b0 tx=0x7fcfd000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfcaffd640 1 -- 172.21.15.79:0/1095421840 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd000c870 con 0x7fcfc0003f30 2024-06-10T00:24:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfcaffd640 1 -- 172.21.15.79:0/1095421840 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd0018070 con 0x7fcfc0003f30 2024-06-10T00:24:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfcaffd640 1 -- 172.21.15.79:0/1095421840 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd000cc70 con 0x7fcfc0003f30 2024-06-10T00:24:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd409acf0 con 0x7fcfc0003f30 2024-06-10T00:24:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.176+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd409b590 con 0x7fcfc0003f30 2024-06-10T00:24:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.177+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd409aec0 con 0x7fcfc0003f30 2024-06-10T00:24:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.178+0000 7fcfcaffd640 1 -- 172.21.15.79:0/1095421840 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfd001d460 con 0x7fcfc0003f30 2024-06-10T00:24:34.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.178+0000 7fcfcaffd640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcfb806be30 0x7fcfb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.178+0000 7fcfcaffd640 1 -- 172.21.15.79:0/1095421840 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7fcfd008aea0 con 0x7fcfc0003f30 2024-06-10T00:24:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.178+0000 7fcfd9c18640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcfb806be30 0x7fcfb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.178+0000 7fcfd9c18640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcfb806be30 0x7fcfb806e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4033000 tx=0x7fcfc4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.182+0000 7fcfcaffd640 1 -- 172.21.15.79:0/1095421840 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcfd00596c0 con 0x7fcfc0003f30 2024-06-10T00:24:34.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.353+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcfd4068430 con 0x7fcfb806be30 2024-06-10T00:24:34.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.358+0000 7fcfcaffd640 1 -- 172.21.15.79:0/1095421840 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252414 (secure 0 0 0) 0x7fcfd4068430 con 0x7fcfb806be30 2024-06-10T00:24:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:34.362 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:24:34.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcfb806be30 msgr2=0x7fcfb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcfb806be30 0x7fcfb806e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4033000 tx=0x7fcfc4008030 comp rx=0 tx=0).stop 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 msgr2=0x7fcfd415d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfd415d930 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000e7b0 tx=0x7fcfd000ec70 comp rx=0 tx=0).stop 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 shutdown_connections 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcfb806be30 0x7fcfb806e2f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd4156b00 0x7fcfd409bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd4150d30 0x7fcfd41565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 --2- 172.21.15.79:0/1095421840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfc0003f30 0x7fcfd415d930 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 >> 172.21.15.79:0/1095421840 conn(0x7fcfd40b19f0 msgr2=0x7fcfd40cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 shutdown_connections 2024-06-10T00:24:34.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.361+0000 7fcfdc67d640 1 -- 172.21.15.79:0/1095421840 wait complete. 2024-06-10T00:24:34.371 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":413,"stamp":"2024-06-10T00:24:33.282011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262000,"kb_used_data":12552,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712720,"statfs":{"total":773094113280,"available":772825825280,"internally_reserved":0,"allocated":12853248,"data_stored":6609632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.230123"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074850+0000","last_change":"2024-06-10T00:24:31.069772+0000","last_active":"2024-06-10T00:24:31.074850+0000","last_peered":"2024-06-10T00:24:31.074850+0000","last_clean":"2024-06-10T00:24:31.074850+0000","last_became_active":"2024-06-10T00:24:31.069415+0000","last_became_peered":"2024-06-10T00:24:31.069415+0000","last_unstale":"2024-06-10T00:24:31.074850+0000","last_undegraded":"2024-06-10T00:24:31.074850+0000","last_fullsized":"2024-06-10T00:24:31.074850+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:34.130476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088815+0000","last_change":"2024-06-10T00:24:31.085958+0000","last_active":"2024-06-10T00:24:31.088815+0000","last_peered":"2024-06-10T00:24:31.088815+0000","last_clean":"2024-06-10T00:24:31.088815+0000","last_became_active":"2024-06-10T00:24:31.085487+0000","last_became_peered":"2024-06-10T00:24:31.085487+0000","last_unstale":"2024-06-10T00:24:31.088815+0000","last_undegraded":"2024-06-10T00:24:31.088815+0000","last_fullsized":"2024-06-10T00:24:31.088815+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:44:49.483750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.084817+0000","last_change":"2024-06-10T00:24:31.082914+0000","last_active":"2024-06-10T00:24:31.084817+0000","last_peered":"2024-06-10T00:24:31.084817+0000","last_clean":"2024-06-10T00:24:31.084817+0000","last_became_active":"2024-06-10T00:24:31.081885+0000","last_became_peered":"2024-06-10T00:24:31.081885+0000","last_unstale":"2024-06-10T00:24:31.084817+0000","last_undegraded":"2024-06-10T00:24:31.084817+0000","last_fullsized":"2024-06-10T00:24:31.084817+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:43.462262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092128+0000","last_change":"2024-06-10T00:24:31.084788+0000","last_active":"2024-06-10T00:24:31.092128+0000","last_peered":"2024-06-10T00:24:31.092128+0000","last_clean":"2024-06-10T00:24:31.092128+0000","last_became_active":"2024-06-10T00:24:31.084554+0000","last_became_peered":"2024-06-10T00:24:31.084554+0000","last_unstale":"2024-06-10T00:24:31.092128+0000","last_undegraded":"2024-06-10T00:24:31.092128+0000","last_fullsized":"2024-06-10T00:24:31.092128+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:07:45.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.076758+0000","last_change":"2024-06-10T00:24:31.074642+0000","last_active":"2024-06-10T00:24:31.076758+0000","last_peered":"2024-06-10T00:24:31.076758+0000","last_clean":"2024-06-10T00:24:31.076758+0000","last_became_active":"2024-06-10T00:24:31.074343+0000","last_became_peered":"2024-06-10T00:24:31.074343+0000","last_unstale":"2024-06-10T00:24:31.076758+0000","last_undegraded":"2024-06-10T00:24:31.076758+0000","last_fullsized":"2024-06-10T00:24:31.076758+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:12:01.461104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092045+0000","last_change":"2024-06-10T00:24:31.090125+0000","last_active":"2024-06-10T00:24:31.092045+0000","last_peered":"2024-06-10T00:24:31.092045+0000","last_clean":"2024-06-10T00:24:31.092045+0000","last_became_active":"2024-06-10T00:24:31.089872+0000","last_became_peered":"2024-06-10T00:24:31.089872+0000","last_unstale":"2024-06-10T00:24:31.092045+0000","last_undegraded":"2024-06-10T00:24:31.092045+0000","last_fullsized":"2024-06-10T00:24:31.092045+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:11:55.506289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.093557+0000","last_change":"2024-06-10T00:24:31.093094+0000","last_active":"2024-06-10T00:24:31.093557+0000","last_peered":"2024-06-10T00:24:31.093557+0000","last_clean":"2024-06-10T00:24:31.093557+0000","last_became_active":"2024-06-10T00:24:31.092847+0000","last_became_peered":"2024-06-10T00:24:31.092847+0000","last_unstale":"2024-06-10T00:24:31.093557+0000","last_undegraded":"2024-06-10T00:24:31.093557+0000","last_fullsized":"2024-06-10T00:24:31.093557+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:05.078557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086080+0000","last_change":"2024-06-10T00:24:31.079272+0000","last_active":"2024-06-10T00:24:31.086080+0000","last_peered":"2024-06-10T00:24:31.086080+0000","last_clean":"2024-06-10T00:24:31.086080+0000","last_became_active":"2024-06-10T00:24:31.078974+0000","last_became_peered":"2024-06-10T00:24:31.078974+0000","last_unstale":"2024-06-10T00:24:31.086080+0000","last_undegraded":"2024-06-10T00:24:31.086080+0000","last_fullsized":"2024-06-10T00:24:31.086080+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:31.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092817+0000","last_change":"2024-06-10T00:24:31.089319+0000","last_active":"2024-06-10T00:24:31.092817+0000","last_peered":"2024-06-10T00:24:31.092817+0000","last_clean":"2024-06-10T00:24:31.092817+0000","last_became_active":"2024-06-10T00:24:31.089021+0000","last_became_peered":"2024-06-10T00:24:31.089021+0000","last_unstale":"2024-06-10T00:24:31.092817+0000","last_undegraded":"2024-06-10T00:24:31.092817+0000","last_fullsized":"2024-06-10T00:24:31.092817+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:47:01.357843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.084388+0000","last_change":"2024-06-10T00:24:31.083407+0000","last_active":"2024-06-10T00:24:31.084388+0000","last_peered":"2024-06-10T00:24:31.084388+0000","last_clean":"2024-06-10T00:24:31.084388+0000","last_became_active":"2024-06-10T00:24:31.083133+0000","last_became_peered":"2024-06-10T00:24:31.083133+0000","last_unstale":"2024-06-10T00:24:31.084388+0000","last_undegraded":"2024-06-10T00:24:31.084388+0000","last_fullsized":"2024-06-10T00:24:31.084388+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:03.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074921+0000","last_change":"2024-06-10T00:24:31.073233+0000","last_active":"2024-06-10T00:24:31.074921+0000","last_peered":"2024-06-10T00:24:31.074921+0000","last_clean":"2024-06-10T00:24:31.074921+0000","last_became_active":"2024-06-10T00:24:31.072710+0000","last_became_peered":"2024-06-10T00:24:31.072710+0000","last_unstale":"2024-06-10T00:24:31.074921+0000","last_undegraded":"2024-06-10T00:24:31.074921+0000","last_fullsized":"2024-06-10T00:24:31.074921+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:14:27.675864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091720+0000","last_change":"2024-06-10T00:24:31.087854+0000","last_active":"2024-06-10T00:24:31.091720+0000","last_peered":"2024-06-10T00:24:31.091720+0000","last_clean":"2024-06-10T00:24:31.091720+0000","last_became_active":"2024-06-10T00:24:31.086787+0000","last_became_peered":"2024-06-10T00:24:31.086787+0000","last_unstale":"2024-06-10T00:24:31.091720+0000","last_undegraded":"2024-06-10T00:24:31.091720+0000","last_fullsized":"2024-06-10T00:24:31.091720+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:36.074546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.079457+0000","last_change":"2024-06-10T00:24:31.073422+0000","last_active":"2024-06-10T00:24:31.079457+0000","last_peered":"2024-06-10T00:24:31.079457+0000","last_clean":"2024-06-10T00:24:31.079457+0000","last_became_active":"2024-06-10T00:24:31.073003+0000","last_became_peered":"2024-06-10T00:24:31.073003+0000","last_unstale":"2024-06-10T00:24:31.079457+0000","last_undegraded":"2024-06-10T00:24:31.079457+0000","last_fullsized":"2024-06-10T00:24:31.079457+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:14:27.675864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.084838+0000","last_change":"2024-06-10T00:24:31.082904+0000","last_active":"2024-06-10T00:24:31.084838+0000","last_peered":"2024-06-10T00:24:31.084838+0000","last_clean":"2024-06-10T00:24:31.084838+0000","last_became_active":"2024-06-10T00:24:31.081842+0000","last_became_peered":"2024-06-10T00:24:31.081842+0000","last_unstale":"2024-06-10T00:24:31.084838+0000","last_undegraded":"2024-06-10T00:24:31.084838+0000","last_fullsized":"2024-06-10T00:24:31.084838+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:07:45.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.083635+0000","last_change":"2024-06-10T00:24:31.080343+0000","last_active":"2024-06-10T00:24:31.083635+0000","last_peered":"2024-06-10T00:24:31.083635+0000","last_clean":"2024-06-10T00:24:31.083635+0000","last_became_active":"2024-06-10T00:24:31.080072+0000","last_became_peered":"2024-06-10T00:24:31.080072+0000","last_unstale":"2024-06-10T00:24:31.083635+0000","last_undegraded":"2024-06-10T00:24:31.083635+0000","last_fullsized":"2024-06-10T00:24:31.083635+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:24.863644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091737+0000","last_change":"2024-06-10T00:24:31.087305+0000","last_active":"2024-06-10T00:24:31.091737+0000","last_peered":"2024-06-10T00:24:31.091737+0000","last_clean":"2024-06-10T00:24:31.091737+0000","last_became_active":"2024-06-10T00:24:31.086552+0000","last_became_peered":"2024-06-10T00:24:31.086552+0000","last_unstale":"2024-06-10T00:24:31.091737+0000","last_undegraded":"2024-06-10T00:24:31.091737+0000","last_fullsized":"2024-06-10T00:24:31.091737+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:10:20.362524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.082731+0000","last_change":"2024-06-10T00:24:31.078492+0000","last_active":"2024-06-10T00:24:31.082731+0000","last_peered":"2024-06-10T00:24:31.082731+0000","last_clean":"2024-06-10T00:24:31.082731+0000","last_became_active":"2024-06-10T00:24:31.078204+0000","last_became_peered":"2024-06-10T00:24:31.078204+0000","last_unstale":"2024-06-10T00:24:31.082731+0000","last_undegraded":"2024-06-10T00:24:31.082731+0000","last_fullsized":"2024-06-10T00:24:31.082731+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:24.863644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088796+0000","last_change":"2024-06-10T00:24:31.085734+0000","last_active":"2024-06-10T00:24:31.088796+0000","last_peered":"2024-06-10T00:24:31.088796+0000","last_clean":"2024-06-10T00:24:31.088796+0000","last_became_active":"2024-06-10T00:24:31.085110+0000","last_became_peered":"2024-06-10T00:24:31.085110+0000","last_unstale":"2024-06-10T00:24:31.088796+0000","last_undegraded":"2024-06-10T00:24:31.088796+0000","last_fullsized":"2024-06-10T00:24:31.088796+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:03:56.712383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.095699+0000","last_change":"2024-06-10T00:24:31.088907+0000","last_active":"2024-06-10T00:24:31.095699+0000","last_peered":"2024-06-10T00:24:31.095699+0000","last_clean":"2024-06-10T00:24:31.095699+0000","last_became_active":"2024-06-10T00:24:31.088629+0000","last_became_peered":"2024-06-10T00:24:31.088629+0000","last_unstale":"2024-06-10T00:24:31.095699+0000","last_undegraded":"2024-06-10T00:24:31.095699+0000","last_fullsized":"2024-06-10T00:24:31.095699+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:45.245918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086221+0000","last_change":"2024-06-10T00:24:31.083737+0000","last_active":"2024-06-10T00:24:31.086221+0000","last_peered":"2024-06-10T00:24:31.086221+0000","last_clean":"2024-06-10T00:24:31.086221+0000","last_became_active":"2024-06-10T00:24:31.083471+0000","last_became_peered":"2024-06-10T00:24:31.083471+0000","last_unstale":"2024-06-10T00:24:31.086221+0000","last_undegraded":"2024-06-10T00:24:31.086221+0000","last_fullsized":"2024-06-10T00:24:31.086221+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:48:30.370835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092811+0000","last_change":"2024-06-10T00:24:31.089619+0000","last_active":"2024-06-10T00:24:31.092811+0000","last_peered":"2024-06-10T00:24:31.092811+0000","last_clean":"2024-06-10T00:24:31.092811+0000","last_became_active":"2024-06-10T00:24:31.088712+0000","last_became_peered":"2024-06-10T00:24:31.088712+0000","last_unstale":"2024-06-10T00:24:31.092811+0000","last_undegraded":"2024-06-10T00:24:31.092811+0000","last_fullsized":"2024-06-10T00:24:31.092811+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:03:56.712383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.080760+0000","last_change":"2024-06-10T00:24:31.075388+0000","last_active":"2024-06-10T00:24:31.080760+0000","last_peered":"2024-06-10T00:24:31.080760+0000","last_clean":"2024-06-10T00:24:31.080760+0000","last_became_active":"2024-06-10T00:24:31.075083+0000","last_became_peered":"2024-06-10T00:24:31.075083+0000","last_unstale":"2024-06-10T00:24:31.080760+0000","last_undegraded":"2024-06-10T00:24:31.080760+0000","last_fullsized":"2024-06-10T00:24:31.080760+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:35:14.271479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092845+0000","last_change":"2024-06-10T00:24:31.091250+0000","last_active":"2024-06-10T00:24:31.092845+0000","last_peered":"2024-06-10T00:24:31.092845+0000","last_clean":"2024-06-10T00:24:31.092845+0000","last_became_active":"2024-06-10T00:24:31.090912+0000","last_became_peered":"2024-06-10T00:24:31.090912+0000","last_unstale":"2024-06-10T00:24:31.092845+0000","last_undegraded":"2024-06-10T00:24:31.092845+0000","last_fullsized":"2024-06-10T00:24:31.092845+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:22:40.851908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085842+0000","last_change":"2024-06-10T00:24:31.078321+0000","last_active":"2024-06-10T00:24:31.085842+0000","last_peered":"2024-06-10T00:24:31.085842+0000","last_clean":"2024-06-10T00:24:31.085842+0000","last_became_active":"2024-06-10T00:24:31.077003+0000","last_became_peered":"2024-06-10T00:24:31.077003+0000","last_unstale":"2024-06-10T00:24:31.085842+0000","last_undegraded":"2024-06-10T00:24:31.085842+0000","last_fullsized":"2024-06-10T00:24:31.085842+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:24.863644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085731+0000","last_change":"2024-06-10T00:24:31.075171+0000","last_active":"2024-06-10T00:24:31.085731+0000","last_peered":"2024-06-10T00:24:31.085731+0000","last_clean":"2024-06-10T00:24:31.085731+0000","last_became_active":"2024-06-10T00:24:31.074766+0000","last_became_peered":"2024-06-10T00:24:31.074766+0000","last_unstale":"2024-06-10T00:24:31.085731+0000","last_undegraded":"2024-06-10T00:24:31.085731+0000","last_fullsized":"2024-06-10T00:24:31.085731+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:15:29.225344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074350+0000","last_change":"2024-06-10T00:24:31.071570+0000","last_active":"2024-06-10T00:24:31.074350+0000","last_peered":"2024-06-10T00:24:31.074350+0000","last_clean":"2024-06-10T00:24:31.074350+0000","last_became_active":"2024-06-10T00:24:31.071278+0000","last_became_peered":"2024-06-10T00:24:31.071278+0000","last_unstale":"2024-06-10T00:24:31.074350+0000","last_undegraded":"2024-06-10T00:24:31.074350+0000","last_fullsized":"2024-06-10T00:24:31.074350+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:30:21.895560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086860+0000","last_change":"2024-06-10T00:24:31.085369+0000","last_active":"2024-06-10T00:24:31.086860+0000","last_peered":"2024-06-10T00:24:31.086860+0000","last_clean":"2024-06-10T00:24:31.086860+0000","last_became_active":"2024-06-10T00:24:31.085055+0000","last_became_peered":"2024-06-10T00:24:31.085055+0000","last_unstale":"2024-06-10T00:24:31.086860+0000","last_undegraded":"2024-06-10T00:24:31.086860+0000","last_fullsized":"2024-06-10T00:24:31.086860+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:02:50.272649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092094+0000","last_change":"2024-06-10T00:24:31.089799+0000","last_active":"2024-06-10T00:24:31.092094+0000","last_peered":"2024-06-10T00:24:31.092094+0000","last_clean":"2024-06-10T00:24:31.092094+0000","last_became_active":"2024-06-10T00:24:31.089523+0000","last_became_peered":"2024-06-10T00:24:31.089523+0000","last_unstale":"2024-06-10T00:24:31.092094+0000","last_undegraded":"2024-06-10T00:24:31.092094+0000","last_fullsized":"2024-06-10T00:24:31.092094+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:51:11.184035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074453+0000","last_change":"2024-06-10T00:24:31.072925+0000","last_active":"2024-06-10T00:24:31.074453+0000","last_peered":"2024-06-10T00:24:31.074453+0000","last_clean":"2024-06-10T00:24:31.074453+0000","last_became_active":"2024-06-10T00:24:31.072656+0000","last_became_peered":"2024-06-10T00:24:31.072656+0000","last_unstale":"2024-06-10T00:24:31.074453+0000","last_undegraded":"2024-06-10T00:24:31.074453+0000","last_fullsized":"2024-06-10T00:24:31.074453+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:08:07.102455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.082605+0000","last_change":"2024-06-10T00:24:31.076763+0000","last_active":"2024-06-10T00:24:31.082605+0000","last_peered":"2024-06-10T00:24:31.082605+0000","last_clean":"2024-06-10T00:24:31.082605+0000","last_became_active":"2024-06-10T00:24:31.075746+0000","last_became_peered":"2024-06-10T00:24:31.075746+0000","last_unstale":"2024-06-10T00:24:31.082605+0000","last_undegraded":"2024-06-10T00:24:31.082605+0000","last_fullsized":"2024-06-10T00:24:31.082605+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:16:56.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085668+0000","last_change":"2024-06-10T00:24:31.076308+0000","last_active":"2024-06-10T00:24:31.085668+0000","last_peered":"2024-06-10T00:24:31.085668+0000","last_clean":"2024-06-10T00:24:31.085668+0000","last_became_active":"2024-06-10T00:24:31.075439+0000","last_became_peered":"2024-06-10T00:24:31.075439+0000","last_unstale":"2024-06-10T00:24:31.085668+0000","last_undegraded":"2024-06-10T00:24:31.085668+0000","last_fullsized":"2024-06-10T00:24:31.085668+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:14:27.675864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085559+0000","last_change":"2024-06-10T00:24:31.076944+0000","last_active":"2024-06-10T00:24:31.085559+0000","last_peered":"2024-06-10T00:24:31.085559+0000","last_clean":"2024-06-10T00:24:31.085559+0000","last_became_active":"2024-06-10T00:24:31.076636+0000","last_became_peered":"2024-06-10T00:24:31.076636+0000","last_unstale":"2024-06-10T00:24:31.085559+0000","last_undegraded":"2024-06-10T00:24:31.085559+0000","last_fullsized":"2024-06-10T00:24:31.085559+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:35:14.271479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088969+0000","last_change":"2024-06-10T00:24:31.084193+0000","last_active":"2024-06-10T00:24:31.088969+0000","last_peered":"2024-06-10T00:24:31.088969+0000","last_clean":"2024-06-10T00:24:31.088969+0000","last_became_active":"2024-06-10T00:24:31.083871+0000","last_became_peered":"2024-06-10T00:24:31.083871+0000","last_unstale":"2024-06-10T00:24:31.088969+0000","last_undegraded":"2024-06-10T00:24:31.088969+0000","last_fullsized":"2024-06-10T00:24:31.088969+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:42:24.679427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"118'4","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.089145+0000","last_change":"2024-06-10T00:24:30.075521+0000","last_active":"2024-06-10T00:24:31.089145+0000","last_peered":"2024-06-10T00:24:31.089145+0000","last_clean":"2024-06-10T00:24:31.089145+0000","last_became_active":"2024-06-10T00:24:30.075224+0000","last_became_peered":"2024-06-10T00:24:30.075224+0000","last_unstale":"2024-06-10T00:24:31.089145+0000","last_undegraded":"2024-06-10T00:24:31.089145+0000","last_fullsized":"2024-06-10T00:24:31.089145+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:23.857883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091981+0000","last_change":"2024-06-10T00:24:31.089705+0000","last_active":"2024-06-10T00:24:31.091981+0000","last_peered":"2024-06-10T00:24:31.091981+0000","last_clean":"2024-06-10T00:24:31.091981+0000","last_became_active":"2024-06-10T00:24:31.089440+0000","last_became_peered":"2024-06-10T00:24:31.089440+0000","last_unstale":"2024-06-10T00:24:31.091981+0000","last_undegraded":"2024-06-10T00:24:31.091981+0000","last_fullsized":"2024-06-10T00:24:31.091981+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:40:33.772740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.075281+0000","last_change":"2024-06-10T00:24:30.067093+0000","last_active":"2024-06-10T00:24:31.075281+0000","last_peered":"2024-06-10T00:24:31.075281+0000","last_clean":"2024-06-10T00:24:31.075281+0000","last_became_active":"2024-06-10T00:24:30.066850+0000","last_became_peered":"2024-06-10T00:24:30.066850+0000","last_unstale":"2024-06-10T00:24:31.075281+0000","last_undegraded":"2024-06-10T00:24:31.075281+0000","last_fullsized":"2024-06-10T00:24:31.075281+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:26:45.497922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088754+0000","last_change":"2024-06-10T00:24:31.086085+0000","last_active":"2024-06-10T00:24:31.088754+0000","last_peered":"2024-06-10T00:24:31.088754+0000","last_clean":"2024-06-10T00:24:31.088754+0000","last_became_active":"2024-06-10T00:24:31.085366+0000","last_became_peered":"2024-06-10T00:24:31.085366+0000","last_unstale":"2024-06-10T00:24:31.088754+0000","last_undegraded":"2024-06-10T00:24:31.088754+0000","last_fullsized":"2024-06-10T00:24:31.088754+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:45.245918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092035+0000","last_change":"2024-06-10T00:24:30.075019+0000","last_active":"2024-06-10T00:24:31.092035+0000","last_peered":"2024-06-10T00:24:31.092035+0000","last_clean":"2024-06-10T00:24:31.092035+0000","last_became_active":"2024-06-10T00:24:30.074691+0000","last_became_peered":"2024-06-10T00:24:30.074691+0000","last_unstale":"2024-06-10T00:24:31.092035+0000","last_undegraded":"2024-06-10T00:24:31.092035+0000","last_fullsized":"2024-06-10T00:24:31.092035+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:16:55.578217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092841+0000","last_change":"2024-06-10T00:24:31.090891+0000","last_active":"2024-06-10T00:24:31.092841+0000","last_peered":"2024-06-10T00:24:31.092841+0000","last_clean":"2024-06-10T00:24:31.092841+0000","last_became_active":"2024-06-10T00:24:31.089530+0000","last_became_peered":"2024-06-10T00:24:31.089530+0000","last_unstale":"2024-06-10T00:24:31.092841+0000","last_undegraded":"2024-06-10T00:24:31.092841+0000","last_fullsized":"2024-06-10T00:24:31.092841+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:44:35.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.081112+0000","last_change":"2024-06-10T00:24:30.065445+0000","last_active":"2024-06-10T00:24:31.081112+0000","last_peered":"2024-06-10T00:24:31.081112+0000","last_clean":"2024-06-10T00:24:31.081112+0000","last_became_active":"2024-06-10T00:24:30.065139+0000","last_became_peered":"2024-06-10T00:24:30.065139+0000","last_unstale":"2024-06-10T00:24:31.081112+0000","last_undegraded":"2024-06-10T00:24:31.081112+0000","last_fullsized":"2024-06-10T00:24:31.081112+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:27.900794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.082212+0000","last_change":"2024-06-10T00:24:31.075313+0000","last_active":"2024-06-10T00:24:31.082212+0000","last_peered":"2024-06-10T00:24:31.082212+0000","last_clean":"2024-06-10T00:24:31.082212+0000","last_became_active":"2024-06-10T00:24:31.075055+0000","last_became_peered":"2024-06-10T00:24:31.075055+0000","last_unstale":"2024-06-10T00:24:31.082212+0000","last_undegraded":"2024-06-10T00:24:31.082212+0000","last_fullsized":"2024-06-10T00:24:31.082212+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:35:14.271479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.079689+0000","last_change":"2024-06-10T00:24:30.066149+0000","last_active":"2024-06-10T00:24:31.079689+0000","last_peered":"2024-06-10T00:24:31.079689+0000","last_clean":"2024-06-10T00:24:31.079689+0000","last_became_active":"2024-06-10T00:24:30.065836+0000","last_became_peered":"2024-06-10T00:24:30.065836+0000","last_unstale":"2024-06-10T00:24:31.079689+0000","last_undegraded":"2024-06-10T00:24:31.079689+0000","last_fullsized":"2024-06-10T00:24:31.079689+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:27.900794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.088481+0000","last_change":"2024-06-10T00:24:31.085179+0000","last_active":"2024-06-10T00:24:31.088481+0000","last_peered":"2024-06-10T00:24:31.088481+0000","last_clean":"2024-06-10T00:24:31.088481+0000","last_became_active":"2024-06-10T00:24:31.084911+0000","last_became_peered":"2024-06-10T00:24:31.084911+0000","last_unstale":"2024-06-10T00:24:31.088481+0000","last_undegraded":"2024-06-10T00:24:31.088481+0000","last_fullsized":"2024-06-10T00:24:31.088481+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:03.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.089587+0000","last_change":"2024-06-10T00:24:30.077958+0000","last_active":"2024-06-10T00:24:31.089587+0000","last_peered":"2024-06-10T00:24:31.089587+0000","last_clean":"2024-06-10T00:24:31.089587+0000","last_became_active":"2024-06-10T00:24:30.077500+0000","last_became_peered":"2024-06-10T00:24:30.077500+0000","last_unstale":"2024-06-10T00:24:31.089587+0000","last_undegraded":"2024-06-10T00:24:31.089587+0000","last_fullsized":"2024-06-10T00:24:31.089587+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:14:33.287738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.078067+0000","last_change":"2024-06-10T00:24:31.072405+0000","last_active":"2024-06-10T00:24:31.078067+0000","last_peered":"2024-06-10T00:24:31.078067+0000","last_clean":"2024-06-10T00:24:31.078067+0000","last_became_active":"2024-06-10T00:24:31.072146+0000","last_became_peered":"2024-06-10T00:24:31.072146+0000","last_unstale":"2024-06-10T00:24:31.078067+0000","last_undegraded":"2024-06-10T00:24:31.078067+0000","last_fullsized":"2024-06-10T00:24:31.078067+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:09:06.545820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.066075+0000","last_change":"2024-06-10T00:24:30.071732+0000","last_active":"2024-06-10T00:24:31.066075+0000","last_peered":"2024-06-10T00:24:31.066075+0000","last_clean":"2024-06-10T00:24:31.066075+0000","last_became_active":"2024-06-10T00:24:30.071321+0000","last_became_peered":"2024-06-10T00:24:30.071321+0000","last_unstale":"2024-06-10T00:24:31.066075+0000","last_undegraded":"2024-06-10T00:24:31.066075+0000","last_fullsized":"2024-06-10T00:24:31.066075+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:51:27.900794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.079404+0000","last_change":"2024-06-10T00:24:31.072263+0000","last_active":"2024-06-10T00:24:31.079404+0000","last_peered":"2024-06-10T00:24:31.079404+0000","last_clean":"2024-06-10T00:24:31.079404+0000","last_became_active":"2024-06-10T00:24:31.072027+0000","last_became_peered":"2024-06-10T00:24:31.072027+0000","last_unstale":"2024-06-10T00:24:31.079404+0000","last_undegraded":"2024-06-10T00:24:31.079404+0000","last_fullsized":"2024-06-10T00:24:31.079404+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:15:29.225344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077085+0000","last_change":"2024-06-10T00:24:30.080362+0000","last_active":"2024-06-10T00:24:31.077085+0000","last_peered":"2024-06-10T00:24:31.077085+0000","last_clean":"2024-06-10T00:24:31.077085+0000","last_became_active":"2024-06-10T00:24:30.080071+0000","last_became_peered":"2024-06-10T00:24:30.080071+0000","last_unstale":"2024-06-10T00:24:31.077085+0000","last_undegraded":"2024-06-10T00:24:31.077085+0000","last_fullsized":"2024-06-10T00:24:31.077085+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:33:41.285091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.095726+0000","last_change":"2024-06-10T00:24:31.089836+0000","last_active":"2024-06-10T00:24:31.095726+0000","last_peered":"2024-06-10T00:24:31.095726+0000","last_clean":"2024-06-10T00:24:31.095726+0000","last_became_active":"2024-06-10T00:24:31.089547+0000","last_became_peered":"2024-06-10T00:24:31.089547+0000","last_unstale":"2024-06-10T00:24:31.095726+0000","last_undegraded":"2024-06-10T00:24:31.095726+0000","last_fullsized":"2024-06-10T00:24:31.095726+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:53:27.858123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.072790+0000","last_change":"2024-06-10T00:24:30.080344+0000","last_active":"2024-06-10T00:24:31.072790+0000","last_peered":"2024-06-10T00:24:31.072790+0000","last_clean":"2024-06-10T00:24:31.072790+0000","last_became_active":"2024-06-10T00:24:30.080016+0000","last_became_peered":"2024-06-10T00:24:30.080016+0000","last_unstale":"2024-06-10T00:24:31.072790+0000","last_undegraded":"2024-06-10T00:24:31.072790+0000","last_fullsized":"2024-06-10T00:24:31.072790+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:12:00.455343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085636+0000","last_change":"2024-06-10T00:24:31.076558+0000","last_active":"2024-06-10T00:24:31.085636+0000","last_peered":"2024-06-10T00:24:31.085636+0000","last_clean":"2024-06-10T00:24:31.085636+0000","last_became_active":"2024-06-10T00:24:31.076256+0000","last_became_peered":"2024-06-10T00:24:31.076256+0000","last_unstale":"2024-06-10T00:24:31.085636+0000","last_undegraded":"2024-06-10T00:24:31.085636+0000","last_fullsized":"2024-06-10T00:24:31.085636+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:12:01.461104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.066612+0000","last_change":"2024-06-10T00:24:30.068093+0000","last_active":"2024-06-10T00:24:31.066612+0000","last_peered":"2024-06-10T00:24:31.066612+0000","last_clean":"2024-06-10T00:24:31.066612+0000","last_became_active":"2024-06-10T00:24:30.067772+0000","last_became_peered":"2024-06-10T00:24:30.067772+0000","last_unstale":"2024-06-10T00:24:31.066612+0000","last_undegraded":"2024-06-10T00:24:31.066612+0000","last_fullsized":"2024-06-10T00:24:31.066612+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:26:45.497922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.084897+0000","last_change":"2024-06-10T00:24:31.080533+0000","last_active":"2024-06-10T00:24:31.084897+0000","last_peered":"2024-06-10T00:24:31.084897+0000","last_clean":"2024-06-10T00:24:31.084897+0000","last_became_active":"2024-06-10T00:24:31.080280+0000","last_became_peered":"2024-06-10T00:24:31.080280+0000","last_unstale":"2024-06-10T00:24:31.084897+0000","last_undegraded":"2024-06-10T00:24:31.084897+0000","last_fullsized":"2024-06-10T00:24:31.084897+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:35:27.890911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"118'3","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092639+0000","last_change":"2024-06-10T00:24:30.067439+0000","last_active":"2024-06-10T00:24:31.092639+0000","last_peered":"2024-06-10T00:24:31.092639+0000","last_clean":"2024-06-10T00:24:31.092639+0000","last_became_active":"2024-06-10T00:24:30.067024+0000","last_became_peered":"2024-06-10T00:24:30.067024+0000","last_unstale":"2024-06-10T00:24:31.092639+0000","last_undegraded":"2024-06-10T00:24:31.092639+0000","last_fullsized":"2024-06-10T00:24:31.092639+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:33.124715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085814+0000","last_change":"2024-06-10T00:24:31.078950+0000","last_active":"2024-06-10T00:24:31.085814+0000","last_peered":"2024-06-10T00:24:31.085814+0000","last_clean":"2024-06-10T00:24:31.085814+0000","last_became_active":"2024-06-10T00:24:31.077587+0000","last_became_peered":"2024-06-10T00:24:31.077587+0000","last_unstale":"2024-06-10T00:24:31.085814+0000","last_undegraded":"2024-06-10T00:24:31.085814+0000","last_fullsized":"2024-06-10T00:24:31.085814+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:42:24.679427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"118'6","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.094105+0000","last_change":"2024-06-10T00:24:30.073934+0000","last_active":"2024-06-10T00:24:31.094105+0000","last_peered":"2024-06-10T00:24:31.094105+0000","last_clean":"2024-06-10T00:24:31.094105+0000","last_became_active":"2024-06-10T00:24:30.073638+0000","last_became_peered":"2024-06-10T00:24:30.073638+0000","last_unstale":"2024-06-10T00:24:31.094105+0000","last_undegraded":"2024-06-10T00:24:31.094105+0000","last_fullsized":"2024-06-10T00:24:31.094105+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:03:23.857883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.087583+0000","last_change":"2024-06-10T00:24:31.083012+0000","last_active":"2024-06-10T00:24:31.087583+0000","last_peered":"2024-06-10T00:24:31.087583+0000","last_clean":"2024-06-10T00:24:31.087583+0000","last_became_active":"2024-06-10T00:24:31.082748+0000","last_became_peered":"2024-06-10T00:24:31.082748+0000","last_unstale":"2024-06-10T00:24:31.087583+0000","last_undegraded":"2024-06-10T00:24:31.087583+0000","last_fullsized":"2024-06-10T00:24:31.087583+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:42:24.679427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091132+0000","last_change":"2024-06-10T00:24:30.075971+0000","last_active":"2024-06-10T00:24:31.091132+0000","last_peered":"2024-06-10T00:24:31.091132+0000","last_clean":"2024-06-10T00:24:31.091132+0000","last_became_active":"2024-06-10T00:24:30.075612+0000","last_became_peered":"2024-06-10T00:24:30.075612+0000","last_unstale":"2024-06-10T00:24:31.091132+0000","last_undegraded":"2024-06-10T00:24:31.091132+0000","last_fullsized":"2024-06-10T00:24:31.091132+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:42:23.673666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.089471+0000","last_change":"2024-06-10T00:24:31.085638+0000","last_active":"2024-06-10T00:24:31.089471+0000","last_peered":"2024-06-10T00:24:31.089471+0000","last_clean":"2024-06-10T00:24:31.089471+0000","last_became_active":"2024-06-10T00:24:31.085392+0000","last_became_peered":"2024-06-10T00:24:31.085392+0000","last_unstale":"2024-06-10T00:24:31.089471+0000","last_undegraded":"2024-06-10T00:24:31.089471+0000","last_fullsized":"2024-06-10T00:24:31.089471+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:45.245918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.066503+0000","last_change":"2024-06-10T00:24:30.072554+0000","last_active":"2024-06-10T00:24:31.066503+0000","last_peered":"2024-06-10T00:24:31.066503+0000","last_clean":"2024-06-10T00:24:31.066503+0000","last_became_active":"2024-06-10T00:24:30.072256+0000","last_became_peered":"2024-06-10T00:24:30.072256+0000","last_unstale":"2024-06-10T00:24:31.066503+0000","last_undegraded":"2024-06-10T00:24:31.066503+0000","last_fullsized":"2024-06-10T00:24:31.066503+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:02:49.266888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.075951+0000","last_change":"2024-06-10T00:24:31.075057+0000","last_active":"2024-06-10T00:24:31.075951+0000","last_peered":"2024-06-10T00:24:31.075951+0000","last_clean":"2024-06-10T00:24:31.075951+0000","last_became_active":"2024-06-10T00:24:31.074732+0000","last_became_peered":"2024-06-10T00:24:31.074732+0000","last_unstale":"2024-06-10T00:24:31.075951+0000","last_undegraded":"2024-06-10T00:24:31.075951+0000","last_fullsized":"2024-06-10T00:24:31.075951+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:35:12.804260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.067302+0000","last_change":"2024-06-10T00:24:30.072885+0000","last_active":"2024-06-10T00:24:31.067302+0000","last_peered":"2024-06-10T00:24:31.067302+0000","last_clean":"2024-06-10T00:24:31.067302+0000","last_became_active":"2024-06-10T00:24:30.072626+0000","last_became_peered":"2024-06-10T00:24:30.072626+0000","last_unstale":"2024-06-10T00:24:31.067302+0000","last_undegraded":"2024-06-10T00:24:31.067302+0000","last_fullsized":"2024-06-10T00:24:31.067302+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:44.240157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086606+0000","last_change":"2024-06-10T00:24:31.084978+0000","last_active":"2024-06-10T00:24:31.086606+0000","last_peered":"2024-06-10T00:24:31.086606+0000","last_clean":"2024-06-10T00:24:31.086606+0000","last_became_active":"2024-06-10T00:24:31.084677+0000","last_became_peered":"2024-06-10T00:24:31.084677+0000","last_unstale":"2024-06-10T00:24:31.086606+0000","last_undegraded":"2024-06-10T00:24:31.086606+0000","last_fullsized":"2024-06-10T00:24:31.086606+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:02:50.272649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.081366+0000","last_change":"2024-06-10T00:24:30.077022+0000","last_active":"2024-06-10T00:24:31.081366+0000","last_peered":"2024-06-10T00:24:31.081366+0000","last_clean":"2024-06-10T00:24:31.081366+0000","last_became_active":"2024-06-10T00:24:30.076758+0000","last_became_peered":"2024-06-10T00:24:30.076758+0000","last_unstale":"2024-06-10T00:24:31.081366+0000","last_undegraded":"2024-06-10T00:24:31.081366+0000","last_fullsized":"2024-06-10T00:24:31.081366+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:24:33.124715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.074899+0000","last_change":"2024-06-10T00:24:31.071600+0000","last_active":"2024-06-10T00:24:31.074899+0000","last_peered":"2024-06-10T00:24:31.074899+0000","last_clean":"2024-06-10T00:24:31.074899+0000","last_became_active":"2024-06-10T00:24:31.071286+0000","last_became_peered":"2024-06-10T00:24:31.071286+0000","last_unstale":"2024-06-10T00:24:31.074899+0000","last_undegraded":"2024-06-10T00:24:31.074899+0000","last_fullsized":"2024-06-10T00:24:31.074899+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:15:29.225344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.076289+0000","last_change":"2024-06-10T00:24:30.073520+0000","last_active":"2024-06-10T00:24:31.076289+0000","last_peered":"2024-06-10T00:24:31.076289+0000","last_clean":"2024-06-10T00:24:31.076289+0000","last_became_active":"2024-06-10T00:24:30.073211+0000","last_became_peered":"2024-06-10T00:24:30.073211+0000","last_unstale":"2024-06-10T00:24:31.076289+0000","last_undegraded":"2024-06-10T00:24:31.076289+0000","last_fullsized":"2024-06-10T00:24:31.076289+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:38:11.377531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.090677+0000","last_change":"2024-06-10T00:24:31.086799+0000","last_active":"2024-06-10T00:24:31.090677+0000","last_peered":"2024-06-10T00:24:31.090677+0000","last_clean":"2024-06-10T00:24:31.090677+0000","last_became_active":"2024-06-10T00:24:31.086513+0000","last_became_peered":"2024-06-10T00:24:31.086513+0000","last_unstale":"2024-06-10T00:24:31.090677+0000","last_undegraded":"2024-06-10T00:24:31.090677+0000","last_fullsized":"2024-06-10T00:24:31.090677+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T03:08:20.986637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092007+0000","last_change":"2024-06-10T00:24:30.078003+0000","last_active":"2024-06-10T00:24:31.092007+0000","last_peered":"2024-06-10T00:24:31.092007+0000","last_clean":"2024-06-10T00:24:31.092007+0000","last_became_active":"2024-06-10T00:24:30.077646+0000","last_became_peered":"2024-06-10T00:24:30.077646+0000","last_unstale":"2024-06-10T00:24:31.092007+0000","last_undegraded":"2024-06-10T00:24:31.092007+0000","last_fullsized":"2024-06-10T00:24:31.092007+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:35:30.398235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091770+0000","last_change":"2024-06-10T00:24:31.086825+0000","last_active":"2024-06-10T00:24:31.091770+0000","last_peered":"2024-06-10T00:24:31.091770+0000","last_clean":"2024-06-10T00:24:31.091770+0000","last_became_active":"2024-06-10T00:24:31.086511+0000","last_became_peered":"2024-06-10T00:24:31.086511+0000","last_unstale":"2024-06-10T00:24:31.091770+0000","last_undegraded":"2024-06-10T00:24:31.091770+0000","last_fullsized":"2024-06-10T00:24:31.091770+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:53:27.858123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.075542+0000","last_change":"2024-06-10T00:24:30.080621+0000","last_active":"2024-06-10T00:24:31.075542+0000","last_peered":"2024-06-10T00:24:31.075542+0000","last_clean":"2024-06-10T00:24:31.075542+0000","last_became_active":"2024-06-10T00:24:30.080355+0000","last_became_peered":"2024-06-10T00:24:30.080355+0000","last_unstale":"2024-06-10T00:24:31.075542+0000","last_undegraded":"2024-06-10T00:24:31.075542+0000","last_fullsized":"2024-06-10T00:24:31.075542+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:09:05.540059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.090494+0000","last_change":"2024-06-10T00:24:31.086115+0000","last_active":"2024-06-10T00:24:31.090494+0000","last_peered":"2024-06-10T00:24:31.090494+0000","last_clean":"2024-06-10T00:24:31.090494+0000","last_became_active":"2024-06-10T00:24:31.085839+0000","last_became_peered":"2024-06-10T00:24:31.085839+0000","last_unstale":"2024-06-10T00:24:31.090494+0000","last_undegraded":"2024-06-10T00:24:31.090494+0000","last_fullsized":"2024-06-10T00:24:31.090494+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:00:46.684793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092568+0000","last_change":"2024-06-10T00:24:30.079879+0000","last_active":"2024-06-10T00:24:31.092568+0000","last_peered":"2024-06-10T00:24:31.092568+0000","last_clean":"2024-06-10T00:24:31.092568+0000","last_became_active":"2024-06-10T00:24:30.079612+0000","last_became_peered":"2024-06-10T00:24:30.079612+0000","last_unstale":"2024-06-10T00:24:31.092568+0000","last_undegraded":"2024-06-10T00:24:31.092568+0000","last_fullsized":"2024-06-10T00:24:31.092568+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:23:42.653286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086104+0000","last_change":"2024-06-10T00:24:31.080116+0000","last_active":"2024-06-10T00:24:31.086104+0000","last_peered":"2024-06-10T00:24:31.086104+0000","last_clean":"2024-06-10T00:24:31.086104+0000","last_became_active":"2024-06-10T00:24:31.079845+0000","last_became_peered":"2024-06-10T00:24:31.079845+0000","last_unstale":"2024-06-10T00:24:31.086104+0000","last_undegraded":"2024-06-10T00:24:31.086104+0000","last_fullsized":"2024-06-10T00:24:31.086104+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:25:32.468101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.078599+0000","last_change":"2024-06-10T00:24:30.077661+0000","last_active":"2024-06-10T00:24:31.078599+0000","last_peered":"2024-06-10T00:24:31.078599+0000","last_clean":"2024-06-10T00:24:31.078599+0000","last_became_active":"2024-06-10T00:24:30.077381+0000","last_became_peered":"2024-06-10T00:24:30.077381+0000","last_unstale":"2024-06-10T00:24:31.078599+0000","last_undegraded":"2024-06-10T00:24:31.078599+0000","last_fullsized":"2024-06-10T00:24:31.078599+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T07:25:31.462340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.078219+0000","last_change":"2024-06-10T00:24:31.076277+0000","last_active":"2024-06-10T00:24:31.078219+0000","last_peered":"2024-06-10T00:24:31.078219+0000","last_clean":"2024-06-10T00:24:31.078219+0000","last_became_active":"2024-06-10T00:24:31.074264+0000","last_became_peered":"2024-06-10T00:24:31.074264+0000","last_unstale":"2024-06-10T00:24:31.078219+0000","last_undegraded":"2024-06-10T00:24:31.078219+0000","last_fullsized":"2024-06-10T00:24:31.078219+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:50:15.898899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.067361+0000","last_change":"2024-06-10T00:24:30.074084+0000","last_active":"2024-06-10T00:24:31.067361+0000","last_peered":"2024-06-10T00:24:31.067361+0000","last_clean":"2024-06-10T00:24:31.067361+0000","last_became_active":"2024-06-10T00:24:30.073840+0000","last_became_peered":"2024-06-10T00:24:30.073840+0000","last_unstale":"2024-06-10T00:24:31.067361+0000","last_undegraded":"2024-06-10T00:24:31.067361+0000","last_fullsized":"2024-06-10T00:24:31.067361+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:53:26.852362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.085784+0000","last_change":"2024-06-10T00:24:31.078615+0000","last_active":"2024-06-10T00:24:31.085784+0000","last_peered":"2024-06-10T00:24:31.085784+0000","last_clean":"2024-06-10T00:24:31.085784+0000","last_became_active":"2024-06-10T00:24:31.078326+0000","last_became_peered":"2024-06-10T00:24:31.078326+0000","last_unstale":"2024-06-10T00:24:31.085784+0000","last_undegraded":"2024-06-10T00:24:31.085784+0000","last_fullsized":"2024-06-10T00:24:31.085784+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:03.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077600+0000","last_change":"2024-06-10T00:24:30.075104+0000","last_active":"2024-06-10T00:24:31.077600+0000","last_peered":"2024-06-10T00:24:31.077600+0000","last_clean":"2024-06-10T00:24:31.077600+0000","last_became_active":"2024-06-10T00:24:30.074786+0000","last_became_peered":"2024-06-10T00:24:30.074786+0000","last_unstale":"2024-06-10T00:24:31.077600+0000","last_undegraded":"2024-06-10T00:24:31.077600+0000","last_fullsized":"2024-06-10T00:24:31.077600+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:48:06.390100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.087664+0000","last_change":"2024-06-10T00:24:31.083801+0000","last_active":"2024-06-10T00:24:31.087664+0000","last_peered":"2024-06-10T00:24:31.087664+0000","last_clean":"2024-06-10T00:24:31.087664+0000","last_became_active":"2024-06-10T00:24:31.083482+0000","last_became_peered":"2024-06-10T00:24:31.083482+0000","last_unstale":"2024-06-10T00:24:31.087664+0000","last_undegraded":"2024-06-10T00:24:31.087664+0000","last_fullsized":"2024-06-10T00:24:31.087664+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:09:17.946428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091579+0000","last_change":"2024-06-10T00:24:30.081356+0000","last_active":"2024-06-10T00:24:31.091579+0000","last_peered":"2024-06-10T00:24:31.091579+0000","last_clean":"2024-06-10T00:24:31.091579+0000","last_became_active":"2024-06-10T00:24:30.081056+0000","last_became_peered":"2024-06-10T00:24:30.081056+0000","last_unstale":"2024-06-10T00:24:31.091579+0000","last_undegraded":"2024-06-10T00:24:31.091579+0000","last_fullsized":"2024-06-10T00:24:31.091579+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T12:08:19.147100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.082178+0000","last_change":"2024-06-10T00:24:31.075023+0000","last_active":"2024-06-10T00:24:31.082178+0000","last_peered":"2024-06-10T00:24:31.082178+0000","last_clean":"2024-06-10T00:24:31.082178+0000","last_became_active":"2024-06-10T00:24:31.074711+0000","last_became_peered":"2024-06-10T00:24:31.074711+0000","last_unstale":"2024-06-10T00:24:31.082178+0000","last_undegraded":"2024-06-10T00:24:31.082178+0000","last_fullsized":"2024-06-10T00:24:31.082178+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:12:01.461104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.073566+0000","last_change":"2024-06-10T00:24:30.076359+0000","last_active":"2024-06-10T00:24:31.073566+0000","last_peered":"2024-06-10T00:24:31.073566+0000","last_clean":"2024-06-10T00:24:31.073566+0000","last_became_active":"2024-06-10T00:24:30.076057+0000","last_became_peered":"2024-06-10T00:24:30.076057+0000","last_unstale":"2024-06-10T00:24:31.073566+0000","last_undegraded":"2024-06-10T00:24:31.073566+0000","last_fullsized":"2024-06-10T00:24:31.073566+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:02.853379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092866+0000","last_change":"2024-06-10T00:24:31.089102+0000","last_active":"2024-06-10T00:24:31.092866+0000","last_peered":"2024-06-10T00:24:31.092866+0000","last_clean":"2024-06-10T00:24:31.092866+0000","last_became_active":"2024-06-10T00:24:31.086504+0000","last_became_peered":"2024-06-10T00:24:31.086504+0000","last_unstale":"2024-06-10T00:24:31.092866+0000","last_undegraded":"2024-06-10T00:24:31.092866+0000","last_fullsized":"2024-06-10T00:24:31.092866+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:54:43.462262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.072898+0000","last_change":"2024-06-10T00:24:30.073671+0000","last_active":"2024-06-10T00:24:31.072898+0000","last_peered":"2024-06-10T00:24:31.072898+0000","last_clean":"2024-06-10T00:24:31.072898+0000","last_became_active":"2024-06-10T00:24:30.073419+0000","last_became_peered":"2024-06-10T00:24:30.073419+0000","last_unstale":"2024-06-10T00:24:31.072898+0000","last_undegraded":"2024-06-10T00:24:31.072898+0000","last_fullsized":"2024-06-10T00:24:31.072898+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:35:13.265718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.083239+0000","last_change":"2024-06-10T00:24:31.078769+0000","last_active":"2024-06-10T00:24:31.083239+0000","last_peered":"2024-06-10T00:24:31.083239+0000","last_clean":"2024-06-10T00:24:31.083239+0000","last_became_active":"2024-06-10T00:24:31.078508+0000","last_became_peered":"2024-06-10T00:24:31.078508+0000","last_unstale":"2024-06-10T00:24:31.083239+0000","last_undegraded":"2024-06-10T00:24:31.083239+0000","last_fullsized":"2024-06-10T00:24:31.083239+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:41:59.986491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.081456+0000","last_change":"2024-06-10T00:24:30.076879+0000","last_active":"2024-06-10T00:24:31.081456+0000","last_peered":"2024-06-10T00:24:31.081456+0000","last_clean":"2024-06-10T00:24:31.081456+0000","last_became_active":"2024-06-10T00:24:30.076532+0000","last_became_peered":"2024-06-10T00:24:30.076532+0000","last_unstale":"2024-06-10T00:24:31.081456+0000","last_undegraded":"2024-06-10T00:24:31.081456+0000","last_fullsized":"2024-06-10T00:24:31.081456+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:57:18.628926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.091759+0000","last_change":"2024-06-10T00:24:31.087836+0000","last_active":"2024-06-10T00:24:31.091759+0000","last_peered":"2024-06-10T00:24:31.091759+0000","last_clean":"2024-06-10T00:24:31.091759+0000","last_became_active":"2024-06-10T00:24:31.087562+0000","last_became_peered":"2024-06-10T00:24:31.087562+0000","last_unstale":"2024-06-10T00:24:31.091759+0000","last_undegraded":"2024-06-10T00:24:31.091759+0000","last_fullsized":"2024-06-10T00:24:31.091759+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T01:11:44.523658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.067512+0000","last_change":"2024-06-10T00:24:30.069425+0000","last_active":"2024-06-10T00:24:31.067512+0000","last_peered":"2024-06-10T00:24:31.067512+0000","last_clean":"2024-06-10T00:24:31.067512+0000","last_became_active":"2024-06-10T00:24:30.069159+0000","last_became_peered":"2024-06-10T00:24:30.069159+0000","last_unstale":"2024-06-10T00:24:31.067512+0000","last_undegraded":"2024-06-10T00:24:31.067512+0000","last_fullsized":"2024-06-10T00:24:31.067512+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T04:26:45.497922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.086084+0000","last_change":"2024-06-10T00:24:31.075576+0000","last_active":"2024-06-10T00:24:31.086084+0000","last_peered":"2024-06-10T00:24:31.086084+0000","last_clean":"2024-06-10T00:24:31.086084+0000","last_became_active":"2024-06-10T00:24:31.074141+0000","last_became_peered":"2024-06-10T00:24:31.074141+0000","last_unstale":"2024-06-10T00:24:31.086084+0000","last_undegraded":"2024-06-10T00:24:31.086084+0000","last_fullsized":"2024-06-10T00:24:31.086084+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T10:48:07.395861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.066134+0000","last_change":"2024-06-10T00:24:30.065487+0000","last_active":"2024-06-10T00:24:31.066134+0000","last_peered":"2024-06-10T00:24:31.066134+0000","last_clean":"2024-06-10T00:24:31.066134+0000","last_became_active":"2024-06-10T00:24:30.065176+0000","last_became_peered":"2024-06-10T00:24:30.065176+0000","last_unstale":"2024-06-10T00:24:31.066134+0000","last_undegraded":"2024-06-10T00:24:31.066134+0000","last_fullsized":"2024-06-10T00:24:31.066134+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:07:03.190270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092087+0000","last_change":"2024-06-10T00:24:31.084774+0000","last_active":"2024-06-10T00:24:31.092087+0000","last_peered":"2024-06-10T00:24:31.092087+0000","last_clean":"2024-06-10T00:24:31.092087+0000","last_became_active":"2024-06-10T00:24:31.084476+0000","last_became_peered":"2024-06-10T00:24:31.084476+0000","last_unstale":"2024-06-10T00:24:31.092087+0000","last_undegraded":"2024-06-10T00:24:31.092087+0000","last_fullsized":"2024-06-10T00:24:31.092087+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:35:27.890911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077773+0000","last_change":"2024-06-10T00:24:30.073851+0000","last_active":"2024-06-10T00:24:31.077773+0000","last_peered":"2024-06-10T00:24:31.077773+0000","last_clean":"2024-06-10T00:24:31.077773+0000","last_became_active":"2024-06-10T00:24:30.073444+0000","last_became_peered":"2024-06-10T00:24:30.073444+0000","last_unstale":"2024-06-10T00:24:31.077773+0000","last_undegraded":"2024-06-10T00:24:31.077773+0000","last_fullsized":"2024-06-10T00:24:31.077773+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T11:43:31.093814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.089496+0000","last_change":"2024-06-10T00:24:31.085030+0000","last_active":"2024-06-10T00:24:31.089496+0000","last_peered":"2024-06-10T00:24:31.089496+0000","last_clean":"2024-06-10T00:24:31.089496+0000","last_became_active":"2024-06-10T00:24:31.084772+0000","last_became_peered":"2024-06-10T00:24:31.084772+0000","last_unstale":"2024-06-10T00:24:31.089496+0000","last_undegraded":"2024-06-10T00:24:31.089496+0000","last_fullsized":"2024-06-10T00:24:31.089496+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:02:50.272649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077775+0000","last_change":"2024-06-10T00:24:30.075104+0000","last_active":"2024-06-10T00:24:31.077775+0000","last_peered":"2024-06-10T00:24:31.077775+0000","last_clean":"2024-06-10T00:24:31.077775+0000","last_became_active":"2024-06-10T00:24:30.074797+0000","last_became_peered":"2024-06-10T00:24:30.074797+0000","last_unstale":"2024-06-10T00:24:31.077775+0000","last_undegraded":"2024-06-10T00:24:31.077775+0000","last_fullsized":"2024-06-10T00:24:31.077775+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T02:50:14.893138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092838+0000","last_change":"2024-06-10T00:24:31.090827+0000","last_active":"2024-06-10T00:24:31.092838+0000","last_peered":"2024-06-10T00:24:31.092838+0000","last_clean":"2024-06-10T00:24:31.092838+0000","last_became_active":"2024-06-10T00:24:31.089349+0000","last_became_peered":"2024-06-10T00:24:31.089349+0000","last_unstale":"2024-06-10T00:24:31.092838+0000","last_undegraded":"2024-06-10T00:24:31.092838+0000","last_fullsized":"2024-06-10T00:24:31.092838+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:30.052026+0000","last_clean_scrub_stamp":"2024-06-10T00:24:30.052026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T09:44:49.483750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"118'8","reported_seq":20,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.092715+0000","last_change":"2024-06-10T00:24:30.070872+0000","last_active":"2024-06-10T00:24:31.092715+0000","last_peered":"2024-06-10T00:24:31.092715+0000","last_clean":"2024-06-10T00:24:31.092715+0000","last_became_active":"2024-06-10T00:24:30.070609+0000","last_became_peered":"2024-06-10T00:24:30.070609+0000","last_unstale":"2024-06-10T00:24:31.092715+0000","last_undegraded":"2024-06-10T00:24:31.092715+0000","last_fullsized":"2024-06-10T00:24:31.092715+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:24:29.046265+0000","last_clean_scrub_stamp":"2024-06-10T00:24:29.046265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T08:34:02.853379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":349,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-06-10T00:24:31.077923+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:24:31.077923+0000","last_peered":"2024-06-10T00:24:31.077923+0000","last_clean":"2024-06-10T00:24:31.077923+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:24:31.077923+0000","last_undegraded":"2024-06-10T00:24:31.077923+0000","last_fullsized":"2024-06-10T00:24:31.077923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2052096,"data_stored":1268980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":678612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574972,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2052096,"data_stored":1268980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:24:34.375 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:24:34.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-10T00:24:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.519+0000 7f30ed7a9640 1 Processor -- start 2024-06-10T00:24:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.519+0000 7f30ed7a9640 1 -- start start 2024-06-10T00:24:34.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.520+0000 7f30ed7a9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30e80d11f0 0x7f30e80d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.520+0000 7f30ed7a9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e80cf9a0 con 0x7f30e80b2f60 2024-06-10T00:24:34.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.520+0000 7f30ed7a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e80cfc70 con 0x7f30e815e1c0 2024-06-10T00:24:34.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.520+0000 7f30ed7a9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f30e80cff50 con 0x7f30e80d11f0 2024-06-10T00:24:34.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.520+0000 7f30e77fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f30e80b2f60 0x7f30e80d2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42302/0 (socket says 172.21.15.79:42302) 2024-06-10T00:24:34.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.520+0000 7f30e77fe640 1 -- 172.21.15.79:0/2643497991 learned_addr learned my addr 172.21.15.79:0/2643497991 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:34.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30de7fc640 1 --2- 172.21.15.79:0/2643497991 >> v2:172.21.15.117:3300/0 conn(0x7f30e80d11f0 0x7f30e80d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30e67fc640 1 -- 172.21.15.79:0/2643497991 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107510577 0 0) 0x7f30e80cf9a0 con 0x7f30e80b2f60 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30e67fc640 1 -- 172.21.15.79:0/2643497991 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30d4003520 con 0x7f30e80b2f60 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30e67fc640 1 -- 172.21.15.79:0/2643497991 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337413270 0 0) 0x7f30e80cfc70 con 0x7f30e815e1c0 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30e67fc640 1 -- 172.21.15.79:0/2643497991 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30e80cf9a0 con 0x7f30e815e1c0 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30e67fc640 1 -- 172.21.15.79:0/2643497991 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2766552590 0 0) 0x7f30d4003520 con 0x7f30e80b2f60 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30de7fc640 1 -- 172.21.15.79:0/2643497991 >> v1:172.21.15.117:6789/0 conn(0x7f30e815e1c0 legacy=0x7f30e80d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30de7fc640 1 -- 172.21.15.79:0/2643497991 >> v1:172.21.15.79:6789/0 conn(0x7f30e80b2f60 legacy=0x7f30e80d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.521+0000 7f30de7fc640 1 -- 172.21.15.79:0/2643497991 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e80d0230 con 0x7f30e80d11f0 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30de7fc640 1 --2- 172.21.15.79:0/2643497991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80d11f0 0x7f30e80d4bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30d00097a0 tx=0x7f30d002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25f7ed3f58127b74 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30e67fc640 1 -- 172.21.15.79:0/2643497991 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0037070 con 0x7f30e80d11f0 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30e67fc640 1 -- 172.21.15.79:0/2643497991 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d002ac50 con 0x7f30e80d11f0 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30e67fc640 1 -- 172.21.15.79:0/2643497991 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e00019f0 con 0x7f30e80d11f0 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30ed7a9640 1 -- 172.21.15.79:0/2643497991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80d11f0 msgr2=0x7f30e80d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30ed7a9640 1 --2- 172.21.15.79:0/2643497991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80d11f0 0x7f30e80d4bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30d00097a0 tx=0x7f30d002a1c0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30ed7a9640 1 -- 172.21.15.79:0/2643497991 shutdown_connections 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30ed7a9640 1 --2- 172.21.15.79:0/2643497991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80d11f0 0x7f30e80d4bc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30ed7a9640 1 -- 172.21.15.79:0/2643497991 >> 172.21.15.79:0/2643497991 conn(0x7f30e809d3e0 msgr2=0x7f30e80d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30ed7a9640 1 -- 172.21.15.79:0/2643497991 shutdown_connections 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.522+0000 7f30ed7a9640 1 -- 172.21.15.79:0/2643497991 wait complete. 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.524+0000 7f30ed7a9640 1 Processor -- start 2024-06-10T00:24:34.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.524+0000 7f30ed7a9640 1 -- start start 2024-06-10T00:24:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.524+0000 7f30ed7a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80b2f60 0x7f30e81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.524+0000 7f30ed7a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e80d11f0 0x7f30e80b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.524+0000 7f30ed7a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e815e1c0 0x7f30e80b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.524+0000 7f30ed7a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80b0cd0 con 0x7f30e80d11f0 2024-06-10T00:24:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.524+0000 7f30ed7a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80d1d40 con 0x7f30e80b2f60 2024-06-10T00:24:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.524+0000 7f30ed7a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30e80b0e50 con 0x7f30e815e1c0 2024-06-10T00:24:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e80d11f0 0x7f30e80b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e80d11f0 0x7f30e80b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36746/0 (socket says 172.21.15.79:36746) 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 -- 172.21.15.79:0/1932347673 learned_addr learned my addr 172.21.15.79:0/1932347673 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30e77fe640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e815e1c0 0x7f30e80b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30e6ffd640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80b2f60 0x7f30e81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 -- 172.21.15.79:0/1932347673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e815e1c0 msgr2=0x7f30e80b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e815e1c0 0x7f30e80b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 -- 172.21.15.79:0/1932347673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80b2f60 msgr2=0x7f30e81575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80b2f60 0x7f30e81575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 -- 172.21.15.79:0/1932347673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e80b6d20 con 0x7f30e80d11f0 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30de7fc640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e80d11f0 0x7f30e80b7dc0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f30d0035040 tx=0x7f30d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30dffff640 1 -- 172.21.15.79:0/1932347673 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0041020 con 0x7f30e80d11f0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30dffff640 1 -- 172.21.15.79:0/1932347673 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d003d420 con 0x7f30e80d11f0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e80b7000 con 0x7f30e80d11f0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30dffff640 1 -- 172.21.15.79:0/1932347673 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0037040 con 0x7f30e80d11f0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.525+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e80b75c0 con 0x7f30e80d11f0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.526+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e80683c0 con 0x7f30e80d11f0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.527+0000 7f30dffff640 1 -- 172.21.15.79:0/1932347673 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30d0044020 con 0x7f30e80d11f0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.527+0000 7f30dffff640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30c806be60 0x7f30c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.527+0000 7f30dffff640 1 -- 172.21.15.79:0/1932347673 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f30d00ab1b0 con 0x7f30e80d11f0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.527+0000 7f30e6ffd640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30c806be60 0x7f30c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.528+0000 7f30e6ffd640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30c806be60 0x7f30c806e320 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f30d80010e0 tx=0x7f30d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.532+0000 7f30dffff640 1 -- 172.21.15.79:0/1932347673 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f30d004b070 con 0x7f30e80d11f0 2024-06-10T00:24:34.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.771+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f30e80b9ee0 con 0x7f30e80d11f0 2024-06-10T00:24:34.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.773+0000 7f30dffff640 1 -- 172.21.15.79:0/1932347673 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f30d0079930 con 0x7f30e80d11f0 2024-06-10T00:24:34.773 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-06-10T00:24:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQA5RWZmCox6MxAAq0mhHdjdCQaQTXjKDpCKYw== 2024-06-10T00:24:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2024-06-10T00:24:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2024-06-10T00:24:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-10T00:24:34.773 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2024-06-10T00:24:34.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30c806be60 msgr2=0x7f30c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30c806be60 0x7f30c806e320 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f30d80010e0 tx=0x7f30d8009040 comp rx=0 tx=0).stop 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e80d11f0 msgr2=0x7f30e80b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e80d11f0 0x7f30e80b7dc0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f30d0035040 tx=0x7f30d00046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 shutdown_connections 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f30c806be60 0x7f30c806e320 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e815e1c0 0x7f30e80b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e80d11f0 0x7f30e80b7dc0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 --2- 172.21.15.79:0/1932347673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e80b2f60 0x7f30e81575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 >> 172.21.15.79:0/1932347673 conn(0x7f30e809d3e0 msgr2=0x7f30e806c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 shutdown_connections 2024-06-10T00:24:34.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.776+0000 7f30ed7a9640 1 -- 172.21.15.79:0/1932347673 wait complete. 2024-06-10T00:24:34.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.886+0000 7f60b2fe2640 1 Processor -- start 2024-06-10T00:24:34.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.886+0000 7f60b2fe2640 1 -- start start 2024-06-10T00:24:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.887+0000 7f60b2fe2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60ac0b46d0 0x7f60ac071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.887+0000 7f60b2fe2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ac072820 con 0x7f60ac0721a0 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.887+0000 7f60b2fe2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ac072b00 con 0x7f60ac0cc6d0 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.887+0000 7f60b2fe2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f60ac0725d0 con 0x7f60ac0b46d0 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.887+0000 7f60abfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60ac0b46d0 0x7f60ac071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.887+0000 7f60b157f640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f60ac0721a0 0x7f60ac165c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:42306/0 (socket says 172.21.15.79:42306) 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.887+0000 7f60abfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60ac0b46d0 0x7f60ac071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36750/0 (socket says 172.21.15.79:36750) 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.887+0000 7f60b157f640 1 -- 172.21.15.79:0/3501855017 learned_addr learned my addr 172.21.15.79:0/3501855017 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.888+0000 7f60abfff640 1 -- 172.21.15.79:0/3501855017 >> v1:172.21.15.117:6789/0 conn(0x7f60ac0cc6d0 legacy=0x7f60ac0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.888+0000 7f60abfff640 1 -- 172.21.15.79:0/3501855017 >> v1:172.21.15.79:6789/0 conn(0x7f60ac0721a0 legacy=0x7f60ac165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.888+0000 7f60abfff640 1 -- 172.21.15.79:0/3501855017 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac072de0 con 0x7f60ac0b46d0 2024-06-10T00:24:34.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.888+0000 7f60abfff640 1 --2- 172.21.15.79:0/3501855017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0b46d0 0x7f60ac071c60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009d90 tx=0x7f60a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95021069213b13f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.888+0000 7f60ab7fe640 1 -- 172.21.15.79:0/3501855017 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0007740 con 0x7f60ac0b46d0 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60ab7fe640 1 -- 172.21.15.79:0/3501855017 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a00078e0 con 0x7f60ac0b46d0 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60ab7fe640 1 -- 172.21.15.79:0/3501855017 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0007cb0 con 0x7f60ac0b46d0 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60b2fe2640 1 -- 172.21.15.79:0/3501855017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0b46d0 msgr2=0x7f60ac071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60b2fe2640 1 --2- 172.21.15.79:0/3501855017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0b46d0 0x7f60ac071c60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009d90 tx=0x7f60a002a6a0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60b2fe2640 1 -- 172.21.15.79:0/3501855017 shutdown_connections 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60b2fe2640 1 --2- 172.21.15.79:0/3501855017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0b46d0 0x7f60ac071c60 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60b2fe2640 1 -- 172.21.15.79:0/3501855017 >> 172.21.15.79:0/3501855017 conn(0x7f60ac0b19f0 msgr2=0x7f60ac0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60b2fe2640 1 -- 172.21.15.79:0/3501855017 shutdown_connections 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.889+0000 7f60b2fe2640 1 -- 172.21.15.79:0/3501855017 wait complete. 2024-06-10T00:24:34.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.890+0000 7f60b2fe2640 1 Processor -- start 2024-06-10T00:24:34.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.890+0000 7f60b2fe2640 1 -- start start 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b2fe2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0721a0 0x7f60ac09d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b2fe2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ac0b46d0 0x7f60ac1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b2fe2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60ac0cc6d0 0x7f60ac1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b2fe2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac159f60 con 0x7f60ac0721a0 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b2fe2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac15c890 con 0x7f60ac0b46d0 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b2fe2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60ac167350 con 0x7f60ac0cc6d0 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b0d7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0721a0 0x7f60ac09d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b0d7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0721a0 0x7f60ac09d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36764/0 (socket says 172.21.15.79:36764) 2024-06-10T00:24:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b0d7e640 1 -- 172.21.15.79:0/190954291 learned_addr learned my addr 172.21.15.79:0/190954291 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60abfff640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ac0b46d0 0x7f60ac1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b157f640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60ac0cc6d0 0x7f60ac1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b0d7e640 1 -- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60ac0cc6d0 msgr2=0x7f60ac1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b0d7e640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60ac0cc6d0 0x7f60ac1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b0d7e640 1 -- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ac0b46d0 msgr2=0x7f60ac1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b0d7e640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ac0b46d0 0x7f60ac1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60b0d7e640 1 -- 172.21.15.79:0/190954291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac15b600 con 0x7f60ac0721a0 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.891+0000 7f60abfff640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ac0b46d0 0x7f60ac1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.892+0000 7f60b0d7e640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0721a0 0x7f60ac09d280 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c430 tx=0x7f609c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.892+0000 7f60a97fa640 1 -- 172.21.15.79:0/190954291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c011790 con 0x7f60ac0721a0 2024-06-10T00:24:34.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.892+0000 7f60a97fa640 1 -- 172.21.15.79:0/190954291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c017070 con 0x7f60ac0721a0 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.892+0000 7f60a97fa640 1 -- 172.21.15.79:0/190954291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c011bb0 con 0x7f60ac0721a0 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.892+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ac150080 con 0x7f60ac0721a0 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.892+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ac15bba0 con 0x7f60ac0721a0 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.893+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ac068430 con 0x7f60ac0721a0 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.893+0000 7f60a97fa640 1 -- 172.21.15.79:0/190954291 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f609c01c460 con 0x7f60ac0721a0 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.894+0000 7f60a97fa640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609806be30 0x7f609806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.894+0000 7f60a97fa640 1 -- 172.21.15.79:0/190954291 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f609c08aef0 con 0x7f60ac0721a0 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.894+0000 7f60abfff640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609806be30 0x7f609806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.894+0000 7f60abfff640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609806be30 0x7f609806e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f60a0034000 tx=0x7f60a002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:34.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:34.898+0000 7f60a97fa640 1 -- 172.21.15.79:0/190954291 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f609c059710 con 0x7f60ac0721a0 2024-06-10T00:24:35.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.110+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60ac0cdc00 con 0x7f60ac0721a0 2024-06-10T00:24:35.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.110+0000 7f60a97fa640 1 -- 172.21.15.79:0/190954291 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5189 (secure 0 0 0) 0x7f60ac0cdc00 con 0x7f60ac0721a0 2024-06-10T00:24:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:35.110 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":83,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:24:32.428936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8331":{"gid":8331,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/3594456696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3594456696},{"type":"v1","addr":"172.21.15.79:6837","nonce":3594456696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8331,"qdb_cluster":[8331]},"id":8}]} 2024-06-10T00:24:35.110 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 83 2024-06-10T00:24:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609806be30 msgr2=0x7f609806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609806be30 0x7f609806e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f60a0034000 tx=0x7f60a002f000 comp rx=0 tx=0).stop 2024-06-10T00:24:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0721a0 msgr2=0x7f60ac09d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0721a0 0x7f60ac09d280 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c430 tx=0x7f609c00c8f0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 shutdown_connections 2024-06-10T00:24:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f609806be30 0x7f609806e2f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60ac0cc6d0 0x7f60ac1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ac0b46d0 0x7f60ac1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 --2- 172.21.15.79:0/190954291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60ac0721a0 0x7f60ac09d280 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 >> 172.21.15.79:0/190954291 conn(0x7f60ac0b19f0 msgr2=0x7f60ac0afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 shutdown_connections 2024-06-10T00:24:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.112+0000 7f60b2fe2640 1 -- 172.21.15.79:0/190954291 wait complete. 2024-06-10T00:24:35.526 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:24:30.408817+0000', 'modified': '2024-06-10T00:24:32.428936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8331}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8331': {'gid': 8331, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/3594456696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 3594456696}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 3594456696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8331, 'qdb_cluster': [8331]} 2024-06-10T00:24:35.526 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:24:35.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:24:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.631+0000 7f5c365dc640 1 Processor -- start 2024-06-10T00:24:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.631+0000 7f5c365dc640 1 -- start start 2024-06-10T00:24:35.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c365dc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5c3015a870 0x7f5c3006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c365dc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c300af3d0 0x7f5c300cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c365dc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3006e390 con 0x7f5c300aef70 2024-06-10T00:24:35.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c365dc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3015ac50 con 0x7f5c300af3d0 2024-06-10T00:24:35.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c365dc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3006cdb0 con 0x7f5c3015a870 2024-06-10T00:24:35.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c34b79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c300af3d0 0x7f5c300cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c34b79640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c300af3d0 0x7f5c300cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36770/0 (socket says 172.21.15.79:36770) 2024-06-10T00:24:35.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c34b79640 1 -- 172.21.15.79:0/3323830242 learned_addr learned my addr 172.21.15.79:0/3323830242 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:35.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c34b79640 1 -- 172.21.15.79:0/3323830242 >> v2:172.21.15.117:3300/0 conn(0x7f5c3015a870 msgr2=0x7f5c3006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c34b79640 1 --2- 172.21.15.79:0/3323830242 >> v2:172.21.15.117:3300/0 conn(0x7f5c3015a870 0x7f5c3006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c34b79640 1 -- 172.21.15.79:0/3323830242 >> v1:172.21.15.117:6789/0 conn(0x7f5c300aef70 legacy=0x7f5c300b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.632+0000 7f5c34b79640 1 -- 172.21.15.79:0/3323830242 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3006d090 con 0x7f5c300af3d0 2024-06-10T00:24:35.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.633+0000 7f5c34b79640 1 --2- 172.21.15.79:0/3323830242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300af3d0 0x7f5c300cdb40 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f5c30075030 tx=0x7f5c2802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7570e10935caa9f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.633+0000 7f5c2effd640 1 -- 172.21.15.79:0/3323830242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28036070 con 0x7f5c300af3d0 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.633+0000 7f5c2effd640 1 -- 172.21.15.79:0/3323830242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c28031600 con 0x7f5c300af3d0 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.633+0000 7f5c2effd640 1 -- 172.21.15.79:0/3323830242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c280319d0 con 0x7f5c300af3d0 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.634+0000 7f5c365dc640 1 -- 172.21.15.79:0/3323830242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300af3d0 msgr2=0x7f5c300cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.634+0000 7f5c365dc640 1 --2- 172.21.15.79:0/3323830242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300af3d0 0x7f5c300cdb40 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f5c30075030 tx=0x7f5c2802a660 comp rx=0 tx=0).stop 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.634+0000 7f5c365dc640 1 -- 172.21.15.79:0/3323830242 shutdown_connections 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.634+0000 7f5c365dc640 1 --2- 172.21.15.79:0/3323830242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300af3d0 0x7f5c300cdb40 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.634+0000 7f5c365dc640 1 --2- 172.21.15.79:0/3323830242 >> v2:172.21.15.117:3300/0 conn(0x7f5c3015a870 0x7f5c3006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.634+0000 7f5c365dc640 1 -- 172.21.15.79:0/3323830242 >> 172.21.15.79:0/3323830242 conn(0x7f5c300b19f0 msgr2=0x7f5c300b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.634+0000 7f5c365dc640 1 -- 172.21.15.79:0/3323830242 shutdown_connections 2024-06-10T00:24:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.634+0000 7f5c365dc640 1 -- 172.21.15.79:0/3323830242 wait complete. 2024-06-10T00:24:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.635+0000 7f5c365dc640 1 Processor -- start 2024-06-10T00:24:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.635+0000 7f5c365dc640 1 -- start start 2024-06-10T00:24:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c365dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300aef70 0x7f5c3014e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c365dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c300af3d0 0x7f5c3009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c365dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3015a870 0x7f5c30158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c365dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3006d930 con 0x7f5c300aef70 2024-06-10T00:24:35.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c365dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3006d650 con 0x7f5c300af3d0 2024-06-10T00:24:35.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c365dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5c300b2e40 con 0x7f5c3015a870 2024-06-10T00:24:35.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300aef70 0x7f5c3014e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300aef70 0x7f5c3014e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36778/0 (socket says 172.21.15.79:36778) 2024-06-10T00:24:35.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 -- 172.21.15.79:0/2574018042 learned_addr learned my addr 172.21.15.79:0/2574018042 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 -- 172.21.15.79:0/2574018042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3015a870 msgr2=0x7f5c30158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3015a870 0x7f5c30158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 -- 172.21.15.79:0/2574018042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c300af3d0 msgr2=0x7f5c3009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c300af3d0 0x7f5c3009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 -- 172.21.15.79:0/2574018042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c30156330 con 0x7f5c300aef70 2024-06-10T00:24:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300aef70 0x7f5c3014e0c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000b4d0 tx=0x7f5c2000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2cff9640 1 -- 172.21.15.79:0/2574018042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20014070 con 0x7f5c300aef70 2024-06-10T00:24:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2cff9640 1 -- 172.21.15.79:0/2574018042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c20010870 con 0x7f5c300aef70 2024-06-10T00:24:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.636+0000 7f5c2cff9640 1 -- 172.21.15.79:0/2574018042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20010c60 con 0x7f5c300aef70 2024-06-10T00:24:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.637+0000 7f5c365dc640 1 -- 172.21.15.79:0/2574018042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c30156610 con 0x7f5c300aef70 2024-06-10T00:24:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.637+0000 7f5c365dc640 1 -- 172.21.15.79:0/2574018042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c30156bd0 con 0x7f5c300aef70 2024-06-10T00:24:35.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.638+0000 7f5c2cff9640 1 -- 172.21.15.79:0/2574018042 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c20017070 con 0x7f5c300aef70 2024-06-10T00:24:35.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.638+0000 7f5c2cff9640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5c1c06be30 0x7f5c1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.639+0000 7f5c2cff9640 1 -- 172.21.15.79:0/2574018042 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f5c2008adb0 con 0x7f5c300aef70 2024-06-10T00:24:35.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.639+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5c1c06be30 0x7f5c1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.639+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5c1c06be30 0x7f5c1c06e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5c24006fd0 tx=0x7f5c24006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.639+0000 7f5c393c9740 1 Processor -- start 2024-06-10T00:24:35.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.639+0000 7f5c393c9740 1 -- start start 2024-06-10T00:24:35.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x562921476ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921446960 0x56292144c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x562921492ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c393c9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5629213af740 con 0x562921476700 2024-06-10T00:24:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c393c9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56292134da80 con 0x562921492660 2024-06-10T00:24:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c393c9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5629213ab700 con 0x562921446960 2024-06-10T00:24:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x562921476ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x562921476ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36790/0 (socket says 172.21.15.79:36790) 2024-06-10T00:24:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c2ffff640 1 -- 172.21.15.79:0/404777467 learned_addr learned my addr 172.21.15.79:0/404777467 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c2ffff640 1 -- 172.21.15.79:0/404777467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921446960 msgr2=0x56292144c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921446960 0x56292144c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c2ffff640 1 -- 172.21.15.79:0/404777467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 msgr2=0x562921492ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.640+0000 7f5c34b79640 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x562921492ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x562921492ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c2ffff640 1 -- 172.21.15.79:0/404777467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562921378fb0 con 0x562921476700 2024-06-10T00:24:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c34b79640 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x562921492ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x562921476ae0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f5c20089150 tx=0x7f5c2001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b881c8f3bf724e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c15ffb640 1 -- 172.21.15.79:0/404777467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20087070 con 0x562921476700 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c15ffb640 1 -- 172.21.15.79:0/404777467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c20057260 con 0x562921476700 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c15ffb640 1 -- 172.21.15.79:0/404777467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2001e040 con 0x562921476700 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 -- 172.21.15.79:0/404777467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 msgr2=0x562921476ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x562921476ae0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f5c20089150 tx=0x7f5c2001c000 comp rx=0 tx=0).stop 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 -- 172.21.15.79:0/404777467 shutdown_connections 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x562921492ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921446960 0x56292144c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 --2- 172.21.15.79:0/404777467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x562921476ae0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 -- 172.21.15.79:0/404777467 >> 172.21.15.79:0/404777467 conn(0x562921448bd0 msgr2=0x562921491510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 -- 172.21.15.79:0/404777467 shutdown_connections 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.641+0000 7f5c393c9740 1 -- 172.21.15.79:0/404777467 wait complete. 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.642+0000 7f5c393c9740 1 -- start start 2024-06-10T00:24:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.642+0000 7f5c393c9740 1 Processor -- start 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921476700 0x562921478630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x562921498db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x5629214992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c393c9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56292144ced0 con 0x5629214718d0 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c393c9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562921338c30 con 0x562921476700 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c393c9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56292144c500 con 0x562921492660 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c393c9740 10 client.0 _ll_register_callbacks cb 0x56292136a7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c34b79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x5629214992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c34b79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x5629214992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36798/0 (socket says 172.21.15.79:36798) 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c34b79640 1 -- 172.21.15.79:0/3009793190 learned_addr learned my addr 172.21.15.79:0/3009793190 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x562921498db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921476700 0x562921478630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c34b79640 1 -- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 msgr2=0x562921498db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c34b79640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x562921498db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c34b79640 1 -- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921476700 msgr2=0x562921478630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c34b79640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921476700 0x562921478630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c34b79640 1 -- 172.21.15.79:0/3009793190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629210c32d0 con 0x5629214718d0 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x562921498db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.643+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921476700 0x562921478630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c34b79640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x5629214992f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f5c28034040 tx=0x7f5c28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd3049e8e5dc9cb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c0effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c0effd640 1 -- 172.21.15.79:0/3009793190 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28041070 con 0x5629214718d0 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 1 -- 172.21.15.79:0/3009793190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c20057260 con 0x5629214718d0 2024-06-10T00:24:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c0effd640 1 -- 172.21.15.79:0/3009793190 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f5c28031de0 con 0x5629214718d0 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c0effd640 1 -- 172.21.15.79:0/3009793190 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f5c2804c050 con 0x5629214718d0 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 10 client.8460 fetch_fsmap learned FSMap version 83 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 1 -- 172.21.15.79:0/3009793190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x56292118d6b0 con 0x5629214718d0 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c0effd640 1 -- 172.21.15.79:0/3009793190 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c20057260 con 0x5629214718d0 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c0effd640 1 -- 172.21.15.79:0/3009793190 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f5c2804f020 con 0x5629214718d0 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 10 client.8460 fetch_fsmap finished waiting for FSMap version 83 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 10 client.8460 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 20 client.8460 populate_metadata read hostname 'smithi079' 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x5629214962d0 0x5629214966b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 4 client.8460 mds_command: new command op to 8331 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c393c9740 1 -- 172.21.15.79:0/3009793190 --> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629213bce70 con 0x5629214962d0 2024-06-10T00:24:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.644+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x5629214962d0 0x5629214966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c0effd640 10 client.8460 ms_handle_connect on v2:172.21.15.79:6835/3594456696 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x5629214962d0 0x5629214966b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66d4dc8e26661cc5 server_cookie=43b89acc8a94b0ad in_seq=0 out_seq=0 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c0effd640 1 -- 172.21.15.79:0/3009793190 <== mds.0 v2:172.21.15.79:6835/3594456696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5629213bce70 con 0x5629214962d0 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c0effd640 10 client.8460 handle_command_reply: tid=0 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 client.8460 shutdown 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 -- 172.21.15.79:0/3009793190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 msgr2=0x5629214992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x5629214992f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f5c28034040 tx=0x7f5c28004a40 comp rx=0 tx=0).stop 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 -- 172.21.15.79:0/3009793190 shutdown_connections 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x5629214962d0 0x5629214966b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x5629214992f0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x562921498db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 --2- 172.21.15.79:0/3009793190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921476700 0x562921478630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c0effd640 0 client.8460 ms_handle_reset on v2:172.21.15.79:6835/3594456696 2024-06-10T00:24:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.645+0000 7f5c393c9740 1 -- 172.21.15.79:0/3009793190 >> 172.21.15.79:0/3009793190 conn(0x562921446960 msgr2=0x562921491da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.646+0000 7f5c393c9740 1 -- 172.21.15.79:0/3009793190 shutdown_connections 2024-06-10T00:24:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.646+0000 7f5c393c9740 1 -- 172.21.15.79:0/3009793190 wait complete. 2024-06-10T00:24:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.646+0000 7f5c393c9740 20 client.8460 trim_cache size 0 max 16384 2024-06-10T00:24:35.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.664+0000 7f5c393c9740 1 Processor -- start 2024-06-10T00:24:35.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.664+0000 7f5c393c9740 1 -- start start 2024-06-10T00:24:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x562921445970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921476700 0x562921445eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x56292144a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c393c9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c301fbcd0 con 0x5629214718d0 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c393c9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5c30072990 con 0x562921492660 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c393c9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5c301fb7b0 con 0x562921476700 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x562921445970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x562921445970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36812/0 (socket says 172.21.15.79:36812) 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2ffff640 1 -- 172.21.15.79:0/54812987 learned_addr learned my addr 172.21.15.79:0/54812987 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921476700 0x562921445eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c34b79640 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x56292144a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2ffff640 1 -- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921476700 msgr2=0x562921445eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921476700 0x562921445eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2ffff640 1 -- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 msgr2=0x56292144a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x56292144a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2ffff640 1 -- 172.21.15.79:0/54812987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562921446790 con 0x5629214718d0 2024-06-10T00:24:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.665+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921476700 0x562921445eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:35.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x562921445970 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f5c2005d4d0 tx=0x7f5c2001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a842ae04c5c00c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c157fa640 1 -- 172.21.15.79:0/54812987 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20087040 con 0x5629214718d0 2024-06-10T00:24:35.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c157fa640 1 -- 172.21.15.79:0/54812987 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c200555d0 con 0x5629214718d0 2024-06-10T00:24:35.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c157fa640 1 -- 172.21.15.79:0/54812987 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2001e040 con 0x5629214718d0 2024-06-10T00:24:35.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 -- 172.21.15.79:0/54812987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 msgr2=0x562921445970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x562921445970 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f5c2005d4d0 tx=0x7f5c2001b000 comp rx=0 tx=0).stop 2024-06-10T00:24:35.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 -- 172.21.15.79:0/54812987 shutdown_connections 2024-06-10T00:24:35.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562921492660 0x56292144a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921476700 0x562921445eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 --2- 172.21.15.79:0/54812987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5629214718d0 0x562921445970 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 -- 172.21.15.79:0/54812987 >> 172.21.15.79:0/54812987 conn(0x562921446960 msgr2=0x562921498db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:35.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 -- 172.21.15.79:0/54812987 shutdown_connections 2024-06-10T00:24:35.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.666+0000 7f5c393c9740 1 -- 172.21.15.79:0/54812987 wait complete. 2024-06-10T00:24:35.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.667+0000 7f5c393c9740 1 -- start start 2024-06-10T00:24:35.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.667+0000 7f5c393c9740 1 Processor -- start 2024-06-10T00:24:35.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629214718d0 0x562921517620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x5629214a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c393c9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x5629214a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c393c9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562921477090 con 0x562921476700 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c393c9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562921478170 con 0x5629214718d0 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c393c9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562921479830 con 0x562921492660 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c393c9740 10 client.0 _ll_register_callbacks cb 0x7f5c28034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x5629214a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x5629214a81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36818/0 (socket says 172.21.15.79:36818) 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 -- 172.21.15.79:0/2462205853 learned_addr learned my addr 172.21.15.79:0/2462205853 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629214718d0 0x562921517620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c34b79640 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x5629214a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 -- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 msgr2=0x5629214a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x5629214a8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 -- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629214718d0 msgr2=0x562921517620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629214718d0 0x562921517620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 -- 172.21.15.79:0/2462205853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56292144e0f0 con 0x562921476700 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629214718d0 0x562921517620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c2f7fe640 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x5629214a81f0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f5c300b0130 tx=0x7f5c240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b2f76cc65aaf8e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c0effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.668+0000 7f5c0effd640 1 -- 172.21.15.79:0/2462205853 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24024020 con 0x562921476700 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c0effd640 1 -- 172.21.15.79:0/2462205853 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f5c24020660 con 0x562921476700 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 1 -- 172.21.15.79:0/2462205853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c200555d0 con 0x562921476700 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c0effd640 1 -- 172.21.15.79:0/2462205853 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f5c2402e050 con 0x562921476700 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 10 client.8466 fetch_fsmap learned FSMap version 83 2024-06-10T00:24:35.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 1 -- 172.21.15.79:0/2462205853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x562921472e10 con 0x562921476700 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c0effd640 1 -- 172.21.15.79:0/2462205853 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c200555d0 con 0x562921476700 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c0effd640 1 -- 172.21.15.79:0/2462205853 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f5c24031020 con 0x562921476700 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 10 client.8466 fetch_fsmap finished waiting for FSMap version 83 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 10 client.8466 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 20 client.8466 populate_metadata read hostname 'smithi079' 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x562921497130 0x562921494a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 4 client.8466 mds_command: new command op to 8331 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c393c9740 1 -- 172.21.15.79:0/2462205853 --> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] -- command(tid 0: {"prefix": "status"}) -- 0x5629213b71c0 con 0x562921497130 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x562921497130 0x562921494a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c0effd640 10 client.8466 ms_handle_connect on v2:172.21.15.79:6835/3594456696 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c2ffff640 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x562921497130 0x562921494a20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7edc54396acb8f7e server_cookie=fc47187e4e19a4fa in_seq=0 out_seq=0 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c0effd640 1 -- 172.21.15.79:0/2462205853 <== mds.0 v2:172.21.15.79:6835/3594456696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5629213b71c0 con 0x562921497130 2024-06-10T00:24:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.669+0000 7f5c0effd640 10 client.8466 handle_command_reply: tid=0 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 client.8466 shutdown 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 -- 172.21.15.79:0/2462205853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 msgr2=0x5629214a81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x5629214a81f0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f5c300b0130 tx=0x7f5c240046b0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 -- 172.21.15.79:0/2462205853 shutdown_connections 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x562921497130 0x562921494a20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562921492660 0x5629214a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562921476700 0x5629214a81f0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 --2- 172.21.15.79:0/2462205853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629214718d0 0x562921517620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c0effd640 0 client.8466 ms_handle_reset on v2:172.21.15.79:6835/3594456696 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 -- 172.21.15.79:0/2462205853 >> 172.21.15.79:0/2462205853 conn(0x562921446960 msgr2=0x562921498b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 -- 172.21.15.79:0/2462205853 shutdown_connections 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 1 -- 172.21.15.79:0/2462205853 wait complete. 2024-06-10T00:24:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c393c9740 20 client.8466 trim_cache size 0 max 16384 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8331, 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.6120257799999997, 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 83, 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 119, 2024-06-10T00:24:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 119, 2024-06-10T00:24:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 14.966913905 2024-06-10T00:24:35.680 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 -- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5c1c06be30 msgr2=0x7f5c1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5c1c06be30 0x7f5c1c06e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5c24006fd0 tx=0x7f5c24006bc0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 -- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300aef70 msgr2=0x7f5c3014e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300aef70 0x7f5c3014e0c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000b4d0 tx=0x7f5c2000b990 comp rx=0 tx=0).stop 2024-06-10T00:24:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 -- 172.21.15.79:0/2574018042 shutdown_connections 2024-06-10T00:24:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5c1c06be30 0x7f5c1c06e2f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3015a870 0x7f5c30158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c300af3d0 0x7f5c3009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 --2- 172.21.15.79:0/2574018042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c300aef70 0x7f5c3014e0c0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.670+0000 7f5c365dc640 1 -- 172.21.15.79:0/2574018042 >> 172.21.15.79:0/2574018042 conn(0x7f5c300b19f0 msgr2=0x7f5c300cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.671+0000 7f5c365dc640 1 -- 172.21.15.79:0/2574018042 shutdown_connections 2024-06-10T00:24:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.671+0000 7f5c365dc640 1 -- 172.21.15.79:0/2574018042 wait complete. 2024-06-10T00:24:35.682 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:24:35.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.781+0000 7f996cf68640 1 Processor -- start 2024-06-10T00:24:35.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.781+0000 7f996cf68640 1 -- start start 2024-06-10T00:24:35.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.782+0000 7f996cf68640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f996806e050 0x7f99680cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.782+0000 7f996cf68640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f996809aa10 0x7f996809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.782+0000 7f996cf68640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99680d12d0 con 0x7f99680cd360 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.782+0000 7f996cf68640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f99680d1d30 con 0x7f996806e050 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.782+0000 7f996cf68640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f996809b390 con 0x7f996809aa10 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.782+0000 7f996659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f996806e050 0x7f99680cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.783+0000 7f996659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f996806e050 0x7f99680cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36820/0 (socket says 172.21.15.79:36820) 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.783+0000 7f996659c640 1 -- 172.21.15.79:0/48016426 learned_addr learned my addr 172.21.15.79:0/48016426 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.783+0000 7f996659c640 1 -- 172.21.15.79:0/48016426 >> v2:172.21.15.117:3300/0 conn(0x7f996809aa10 msgr2=0x7f996809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.783+0000 7f996659c640 1 --2- 172.21.15.79:0/48016426 >> v2:172.21.15.117:3300/0 conn(0x7f996809aa10 0x7f996809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.783+0000 7f996659c640 1 -- 172.21.15.79:0/48016426 >> v1:172.21.15.117:6789/0 conn(0x7f99680cd360 legacy=0x7f99680cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.783+0000 7f996659c640 1 -- 172.21.15.79:0/48016426 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99680cc5a0 con 0x7f996806e050 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.783+0000 7f996659c640 1 --2- 172.21.15.79:0/48016426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996806e050 0x7f99680cff40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f996806ee80 tx=0x7f995802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd39edae9762b500 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996559a640 1 -- 172.21.15.79:0/48016426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9958036070 con 0x7f996806e050 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996559a640 1 -- 172.21.15.79:0/48016426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9958031600 con 0x7f996806e050 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996559a640 1 -- 172.21.15.79:0/48016426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99580319d0 con 0x7f996806e050 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996cf68640 1 -- 172.21.15.79:0/48016426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996806e050 msgr2=0x7f99680cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996cf68640 1 --2- 172.21.15.79:0/48016426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996806e050 0x7f99680cff40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f996806ee80 tx=0x7f995802a6f0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996cf68640 1 -- 172.21.15.79:0/48016426 shutdown_connections 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996cf68640 1 --2- 172.21.15.79:0/48016426 >> v2:172.21.15.117:3300/0 conn(0x7f996809aa10 0x7f996809ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996cf68640 1 --2- 172.21.15.79:0/48016426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996806e050 0x7f99680cff40 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996cf68640 1 -- 172.21.15.79:0/48016426 >> 172.21.15.79:0/48016426 conn(0x7f99680d1eb0 msgr2=0x7f99680d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996cf68640 1 -- 172.21.15.79:0/48016426 shutdown_connections 2024-06-10T00:24:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.784+0000 7f996cf68640 1 -- 172.21.15.79:0/48016426 wait complete. 2024-06-10T00:24:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f996cf68640 1 Processor -- start 2024-06-10T00:24:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f996cf68640 1 -- start start 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f996cf68640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996806e050 0x7f99680c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f996cf68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996809aa10 0x7f99680b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f996cf68640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99680cd360 0x7f99681f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f996cf68640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99680cce40 con 0x7f996809aa10 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f996cf68640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99680ccb60 con 0x7f996806e050 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f996cf68640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f996806e430 con 0x7f99680cd360 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f9965d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996809aa10 0x7f99680b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f9965d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996809aa10 0x7f99680b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36832/0 (socket says 172.21.15.79:36832) 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.786+0000 7f9965d9b640 1 -- 172.21.15.79:0/1035797409 learned_addr learned my addr 172.21.15.79:0/1035797409 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:35.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f996659c640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996806e050 0x7f99680c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f9966d9d640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99680cd360 0x7f99681f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f9965d9b640 1 -- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99680cd360 msgr2=0x7f99681f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f9965d9b640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99680cd360 0x7f99681f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f9965d9b640 1 -- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996806e050 msgr2=0x7f99680c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f9965d9b640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996806e050 0x7f99680c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f9965d9b640 1 -- 172.21.15.79:0/1035797409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99680b50b0 con 0x7f996809aa10 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f9966d9d640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99680cd360 0x7f99681f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f9965d9b640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996809aa10 0x7f99680b4b70 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f995000b4a0 tx=0x7f995000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f995effd640 1 -- 172.21.15.79:0/1035797409 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950014070 con 0x7f996809aa10 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f995effd640 1 -- 172.21.15.79:0/1035797409 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9950010610 con 0x7f996809aa10 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99680b70d0 con 0x7f996809aa10 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f995effd640 1 -- 172.21.15.79:0/1035797409 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950010a00 con 0x7f996809aa10 2024-06-10T00:24:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.787+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99680b7690 con 0x7f996809aa10 2024-06-10T00:24:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.788+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9968068430 con 0x7f996809aa10 2024-06-10T00:24:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.789+0000 7f995effd640 1 -- 172.21.15.79:0/1035797409 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9950017070 con 0x7f996809aa10 2024-06-10T00:24:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.789+0000 7f995effd640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f994806be30 0x7f994806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.789+0000 7f995effd640 1 -- 172.21.15.79:0/1035797409 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f995008aa20 con 0x7f996809aa10 2024-06-10T00:24:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.789+0000 7f996659c640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f994806be30 0x7f994806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:35.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.790+0000 7f996659c640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f994806be30 0x7f994806e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9958033000 tx=0x7f9958009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:35.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:35.793+0000 7f995effd640 1 -- 172.21.15.79:0/1035797409 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9950059240 con 0x7f996809aa10 2024-06-10T00:24:36.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.003+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f996806ca90 con 0x7f996809aa10 2024-06-10T00:24:36.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.003+0000 7f995effd640 1 -- 172.21.15.79:0/1035797409 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f9950058b40 con 0x7f996809aa10 2024-06-10T00:24:36.003 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:24:36.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f994806be30 msgr2=0x7f994806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:36.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f994806be30 0x7f994806e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9958033000 tx=0x7f9958009000 comp rx=0 tx=0).stop 2024-06-10T00:24:36.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996809aa10 msgr2=0x7f99680b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:36.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996809aa10 0x7f99680b4b70 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f995000b4a0 tx=0x7f995000b960 comp rx=0 tx=0).stop 2024-06-10T00:24:36.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 shutdown_connections 2024-06-10T00:24:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f994806be30 0x7f994806e2f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99680cd360 0x7f99681f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f996809aa10 0x7f99680b4b70 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 --2- 172.21.15.79:0/1035797409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996806e050 0x7f99680c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.005+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 >> 172.21.15.79:0/1035797409 conn(0x7f99680d1eb0 msgr2=0x7f99681e58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.006+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 shutdown_connections 2024-06-10T00:24:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36.006+0000 7f996cf68640 1 -- 172.21.15.79:0/1035797409 wait complete. 2024-06-10T00:24:36.016 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:24:36.016 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:24:36.016 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:24:36.016 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:24:36.016 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:36.016 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:24:36.016 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:24:36.016 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:24:36.017 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:36.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:36.017 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:24:36.032 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:24:36.032+0000 7fa5be3fa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42168sec preferred_lft 42168sec 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:24:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:36.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:36.036 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:24:36.097 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:24:36.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:36.099 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:24:36.154 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:24:36.155 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:24:36.155 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:24:36.155 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:24:36.155 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:24:36.155 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:24:36.155 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:24:36.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:24:36.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:24:36.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:24:36.156 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:24:36.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:24:36.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:36.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:36.282 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:24:36.298 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:24:36.298 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:24:36.298 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:36.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:36.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:24:36.363 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:24:36.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:24:36.363 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:36.419 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:36.419 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:24:36.419 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:36.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:24:36.539 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:24:36.596 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:24:36.597 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:36.599 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:36.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:36.599 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:24:36.651 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:24:36.652 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:24:36.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:24:36.718 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:24:36.775 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:24:36.777 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:24:36.777 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:24:36.777 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:24:36.777 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:24:36.777 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:24:36.777 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:24:36.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:36.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:36.780 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:36.780 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:36.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:36.780 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:24:36.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:24:36.776+0000 7f1df053a480 -1 init, newargv = 0x555f053311a0 newargc=15 2024-06-10T00:24:36.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[74618]: starting ceph client 2024-06-10T00:24:36.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[74618]: starting fuse 2024-06-10T00:24:36.796 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:24:36.796 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:24:36.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:24:36.796 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:24:36.796 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:24:36.796 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:36.796 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:24:36.796 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:36.796 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:24:36.797 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:24:36.798 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:24:36.798 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:36.798 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:24:36.798 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:36.915 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.74618.asok 2024-06-10T00:24:36.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:36.925 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.74618.asok 2024-06-10T00:24:36.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:36.926 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.74618.asok status 2024-06-10T00:24:37.059 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:37.059 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:24:37.059 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:24:37.059 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:24:37.059 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:24:37.059 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "74618", 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8478, 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 8478 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:37.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 767910234 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 767910234 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.8478 192.168.0.1:0/767910234", 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/767910234", 2024-06-10T00:24:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:24:37.062 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 83, 2024-06-10T00:24:37.062 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 119, 2024-06-10T00:24:37.062 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:24:37.062 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:24:37.062 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:24:37.062 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:37.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:37.068 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:24:37.068 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:37.083 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:24:37.084 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:37.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:37.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:37.153 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:37.153 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:37.153 DEBUG:teuthology.orchestra.run.smithi079:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:24:37.153 DEBUG:teuthology.orchestra.run.smithi079:> parent = os.path.join(mount_point, "parent") 2024-06-10T00:24:37.153 DEBUG:teuthology.orchestra.run.smithi079:> os.mkdir(parent) 2024-06-10T00:24:37.153 DEBUG:teuthology.orchestra.run.smithi079:> flushed = os.path.join(parent, "flushed") 2024-06-10T00:24:37.154 DEBUG:teuthology.orchestra.run.smithi079:> os.mkdir(flushed) 2024-06-10T00:24:37.154 DEBUG:teuthology.orchestra.run.smithi079:> for f in ["alpha", "bravo", "charlie"]: 2024-06-10T00:24:37.154 DEBUG:teuthology.orchestra.run.smithi079:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-06-10T00:24:37.154 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:37.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:37.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:37.277 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-06-10T00:24:37.341 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-06-10T00:24:37.341 INFO:teuthology.orchestra.run.smithi079.stdout:./parent 2024-06-10T00:24:37.342 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed 2024-06-10T00:24:37.342 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/charlie 2024-06-10T00:24:37.342 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/alpha 2024-06-10T00:24:37.342 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/bravo 2024-06-10T00:24:37.342 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:37.342 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:37.342 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:37.342 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:37.342 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-06-10T00:24:37.343 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:37.447 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:24:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:37.456 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:37.456 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:37.456 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:37.456 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:37.456 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-06-10T00:24:37.457 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:37.562 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-06-10T00:24:37.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:37.571 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:37.571 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:37.571 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:37.571 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:37.571 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-06-10T00:24:37.572 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:37.677 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-06-10T00:24:37.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:37.686 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:37.686 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:37.686 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:37.687 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:37.687 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-06-10T00:24:37.687 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:37.792 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628280 2024-06-10T00:24:37.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:37.801 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:37.801 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:37.801 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:37.801 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:37.801 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-06-10T00:24:37.801 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:37.907 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-06-10T00:24:37.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:37.916 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:37.916 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:37.916 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:37.917 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:37.917 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-06-10T00:24:37.917 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:38.022 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628279 2024-06-10T00:24:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:38.031 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:38.032 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:38.087 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:24:38.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.228+0000 7f90e7a93640 1 Processor -- start 2024-06-10T00:24:38.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.228+0000 7f90e7a93640 1 -- start start 2024-06-10T00:24:38.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e7a93640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90e00af3b0 0x7f90e00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e7a93640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e015ac50 con 0x7f90e00aef70 2024-06-10T00:24:38.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e7a93640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e006cdb0 con 0x7f90e015a870 2024-06-10T00:24:38.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e7a93640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f90e006d090 con 0x7f90e00af3b0 2024-06-10T00:24:38.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e502e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f90e00aef70 0x7f90e00b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46646/0 (socket says 172.21.15.79:46646) 2024-06-10T00:24:38.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e502e640 1 -- 172.21.15.79:0/24848704 learned_addr learned my addr 172.21.15.79:0/24848704 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:38.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e6030640 1 --2- 172.21.15.79:0/24848704 >> v2:172.21.15.117:3300/0 conn(0x7f90e00af3b0 0x7f90e00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4250723161 0 0) 0x7f90e015ac50 con 0x7f90e00aef70 2024-06-10T00:24:38.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.229+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90cc004630 con 0x7f90e00aef70 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3629795195 0 0) 0x7f90cc004630 con 0x7f90e00aef70 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 >> v2:172.21.15.117:3300/0 conn(0x7f90e00af3b0 msgr2=0x7f90e00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 --2- 172.21.15.79:0/24848704 >> v2:172.21.15.117:3300/0 conn(0x7f90e00af3b0 0x7f90e00cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 >> v1:172.21.15.117:6789/0 conn(0x7f90e015a870 legacy=0x7f90e006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e006d370 con 0x7f90e00aef70 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f90d0001670 con 0x7f90e00aef70 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 >> v1:172.21.15.79:6789/0 conn(0x7f90e00aef70 legacy=0x7f90e00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc004ac0 0x7f90cc004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90cc005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc006230 0x7f90cc00cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90e006d090 con 0x7f90cc0054c0 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc00d170 con 0x7f90cc006230 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc00d370 con 0x7f90cc004ac0 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e502e640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90cc005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e582f640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc004ac0 0x7f90cc004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e6030640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc006230 0x7f90cc00cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e502e640 1 -- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc004ac0 msgr2=0x7f90cc004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e502e640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc004ac0 0x7f90cc004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e502e640 1 -- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc006230 msgr2=0x7f90cc00cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e502e640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc006230 0x7f90cc00cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e502e640 1 -- 172.21.15.79:0/24848704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc004630 con 0x7f90cc0054c0 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e6030640 1 -- 172.21.15.79:0/24848704 reap_dead start 2024-06-10T00:24:38.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.230+0000 7f90e582f640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc004ac0 0x7f90cc004ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e502e640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90cc005990 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f90d000c290 tx=0x7f90cc006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55765176401aa9e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0007d50 con 0x7f90cc0054c0 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d00058d0 con 0x7f90cc0054c0 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e482d640 1 -- 172.21.15.79:0/24848704 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0005d20 con 0x7f90cc0054c0 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e7a93640 1 -- 172.21.15.79:0/24848704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 msgr2=0x7f90cc005990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e7a93640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90cc005990 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f90d000c290 tx=0x7f90cc006940 comp rx=0 tx=0).stop 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e7a93640 1 -- 172.21.15.79:0/24848704 shutdown_connections 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e7a93640 1 --2- 172.21.15.79:0/24848704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90cc005990 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.231+0000 7f90e7a93640 1 -- 172.21.15.79:0/24848704 >> 172.21.15.79:0/24848704 conn(0x7f90e00b19f0 msgr2=0x7f90e00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.232+0000 7f90e7a93640 1 -- 172.21.15.79:0/24848704 shutdown_connections 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.232+0000 7f90e7a93640 1 -- 172.21.15.79:0/24848704 wait complete. 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.233+0000 7f90e7a93640 1 Processor -- start 2024-06-10T00:24:38.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.233+0000 7f90e7a93640 1 -- start start 2024-06-10T00:24:38.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.233+0000 7f90e7a93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90e0157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.233+0000 7f90e7a93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e00c9b70 0x7f90e00c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.233+0000 7f90e7a93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e014a2d0 0x7f90e014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.233+0000 7f90e7a93640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90e00b2e40 con 0x7f90cc0054c0 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.233+0000 7f90e7a93640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90e006d930 con 0x7f90e014a2d0 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.233+0000 7f90e7a93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90e00b2fc0 con 0x7f90e00c9b70 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90e0157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90e0157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40332/0 (socket says 172.21.15.79:40332) 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 -- 172.21.15.79:0/936293836 learned_addr learned my addr 172.21.15.79:0/936293836 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e6030640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e014a2d0 0x7f90e014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e502e640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e00c9b70 0x7f90e00c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 -- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e00c9b70 msgr2=0x7f90e00c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e00c9b70 0x7f90e00c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 -- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e014a2d0 msgr2=0x7f90e014a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e014a2d0 0x7f90e014a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 -- 172.21.15.79:0/936293836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e014ac70 con 0x7f90cc0054c0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e6030640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e014a2d0 0x7f90e014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e502e640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e00c9b70 0x7f90e00c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e582f640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90e0157f20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00e4e0 tx=0x7f90dc00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90d67fc640 1 -- 172.21.15.79:0/936293836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0052e0 con 0x7f90cc0054c0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90d67fc640 1 -- 172.21.15.79:0/936293836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc018070 con 0x7f90cc0054c0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e00adb70 con 0x7f90cc0054c0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90d67fc640 1 -- 172.21.15.79:0/936293836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0037f0 con 0x7f90cc0054c0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.234+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e00ae130 con 0x7f90cc0054c0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.235+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e0068430 con 0x7f90cc0054c0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.236+0000 7f90d67fc640 1 -- 172.21.15.79:0/936293836 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90dc003990 con 0x7f90cc0054c0 2024-06-10T00:24:38.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.236+0000 7f90d67fc640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f90c406be30 0x7f90c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.236+0000 7f90d67fc640 1 -- 172.21.15.79:0/936293836 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f90dc08ad50 con 0x7f90cc0054c0 2024-06-10T00:24:38.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.236+0000 7f90e502e640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f90c406be30 0x7f90c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.236+0000 7f90e502e640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f90c406be30 0x7f90c406e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f90d0033000 tx=0x7f90d002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:38.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.240+0000 7f90d67fc640 1 -- 172.21.15.79:0/936293836 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f90dc08e030 con 0x7f90cc0054c0 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.424+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f90e00b2650 con 0x7f90cc0054c0 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.425+0000 7f90d67fc640 1 -- 172.21.15.79:0/936293836 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7f90dc01a310 con 0x7f90cc0054c0 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f90c406be30 msgr2=0x7f90c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f90c406be30 0x7f90c406e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f90d0033000 tx=0x7f90d002e000 comp rx=0 tx=0).stop 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 msgr2=0x7f90e0157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90e0157f20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00e4e0 tx=0x7f90dc00e9a0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 shutdown_connections 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f90c406be30 0x7f90c406e2f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e014a2d0 0x7f90e014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e00c9b70 0x7f90e00c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 --2- 172.21.15.79:0/936293836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90cc0054c0 0x7f90e0157f20 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 >> 172.21.15.79:0/936293836 conn(0x7f90e00b19f0 msgr2=0x7f90e00ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:38.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 shutdown_connections 2024-06-10T00:24:38.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.427+0000 7f90e7a93640 1 -- 172.21.15.79:0/936293836 wait complete. 2024-06-10T00:24:38.437 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:38.437 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:38.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:24:38.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.593+0000 7effefd7e640 1 Processor -- start 2024-06-10T00:24:38.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effefd7e640 1 -- start start 2024-06-10T00:24:38.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effefd7e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effe80d2680 0x7effe815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effefd7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effe80cef70 0x7effe80cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effefd7e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe80d0ad0 con 0x7effe80d1fc0 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effefd7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7effe80d13e0 con 0x7effe80cef70 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effefd7e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7effe815f890 con 0x7effe80d2680 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effee31b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effe80cef70 0x7effe80cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effee31b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effe80cef70 0x7effe80cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40336/0 (socket says 172.21.15.79:40336) 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.594+0000 7effed319640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7effe80d1fc0 0x7effe80d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46656/0 (socket says 172.21.15.79:46656) 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.595+0000 7effee31b640 1 -- 172.21.15.79:0/1684425019 learned_addr learned my addr 172.21.15.79:0/1684425019 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.595+0000 7effedb1a640 1 --2- 172.21.15.79:0/1684425019 >> v2:172.21.15.117:3300/0 conn(0x7effe80d2680 0x7effe815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.595+0000 7effee31b640 1 -- 172.21.15.79:0/1684425019 >> v2:172.21.15.117:3300/0 conn(0x7effe80d2680 msgr2=0x7effe815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.595+0000 7effee31b640 1 --2- 172.21.15.79:0/1684425019 >> v2:172.21.15.117:3300/0 conn(0x7effe80d2680 0x7effe815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.595+0000 7effee31b640 1 -- 172.21.15.79:0/1684425019 >> v1:172.21.15.79:6789/0 conn(0x7effe80d1fc0 legacy=0x7effe80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.595+0000 7effecb18640 1 -- 172.21.15.79:0/1684425019 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350253354 0 0) 0x7effe80d0ad0 con 0x7effe80d1fc0 2024-06-10T00:24:38.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.595+0000 7effee31b640 1 -- 172.21.15.79:0/1684425019 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe80d0d90 con 0x7effe80cef70 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.595+0000 7effee31b640 1 --2- 172.21.15.79:0/1684425019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80cef70 0x7effe80cf3c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7effe80d1560 tx=0x7effe002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296e285e588072f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effecb18640 1 -- 172.21.15.79:0/1684425019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0037070 con 0x7effe80cef70 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effecb18640 1 -- 172.21.15.79:0/1684425019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe0032440 con 0x7effe80cef70 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effecb18640 1 -- 172.21.15.79:0/1684425019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0032810 con 0x7effe80cef70 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effefd7e640 1 -- 172.21.15.79:0/1684425019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80cef70 msgr2=0x7effe80cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effefd7e640 1 --2- 172.21.15.79:0/1684425019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80cef70 0x7effe80cf3c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7effe80d1560 tx=0x7effe002a270 comp rx=0 tx=0).stop 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effefd7e640 1 -- 172.21.15.79:0/1684425019 shutdown_connections 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effefd7e640 1 --2- 172.21.15.79:0/1684425019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80cef70 0x7effe80cf3c0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effefd7e640 1 --2- 172.21.15.79:0/1684425019 >> v2:172.21.15.117:3300/0 conn(0x7effe80d2680 0x7effe815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effefd7e640 1 -- 172.21.15.79:0/1684425019 >> 172.21.15.79:0/1684425019 conn(0x7effe809d3f0 msgr2=0x7effe80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:38.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effefd7e640 1 -- 172.21.15.79:0/1684425019 shutdown_connections 2024-06-10T00:24:38.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.596+0000 7effefd7e640 1 -- 172.21.15.79:0/1684425019 wait complete. 2024-06-10T00:24:38.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.597+0000 7effefd7e640 1 Processor -- start 2024-06-10T00:24:38.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.597+0000 7effefd7e640 1 -- start start 2024-06-10T00:24:38.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effefd7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effe80cef70 0x7effe815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effefd7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effe80d1fc0 0x7effe8152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effefd7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80d2680 0x7effe81532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effefd7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effe80d4f00 con 0x7effe80d2680 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effefd7e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effe80d2400 con 0x7effe80cef70 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effefd7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effe80d1870 con 0x7effe80d1fc0 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effee31b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80d2680 0x7effe81532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effee31b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80d2680 0x7effe81532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40350/0 (socket says 172.21.15.79:40350) 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effee31b640 1 -- 172.21.15.79:0/1848532740 learned_addr learned my addr 172.21.15.79:0/1848532740 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effedb1a640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effe80cef70 0x7effe815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.598+0000 7effed319640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effe80d1fc0 0x7effe8152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effee31b640 1 -- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effe80d1fc0 msgr2=0x7effe8152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effee31b640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effe80d1fc0 0x7effe8152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effee31b640 1 -- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effe80cef70 msgr2=0x7effe815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effee31b640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effe80cef70 0x7effe815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effee31b640 1 -- 172.21.15.79:0/1848532740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe815cb10 con 0x7effe80d2680 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effed319640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effe80d1fc0 0x7effe8152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effee31b640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80d2680 0x7effe81532c0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7effe00090b0 tx=0x7effe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effe67fc640 1 -- 172.21.15.79:0/1848532740 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0037040 con 0x7effe80d2680 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effe67fc640 1 -- 172.21.15.79:0/1848532740 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe0042070 con 0x7effe80d2680 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe815cdf0 con 0x7effe80d2680 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effe67fc640 1 -- 172.21.15.79:0/1848532740 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0030920 con 0x7effe80d2680 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.599+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe815d3b0 con 0x7effe80d2680 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.600+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe8068430 con 0x7effe80d2680 2024-06-10T00:24:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.600+0000 7effe67fc640 1 -- 172.21.15.79:0/1848532740 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effe0030ac0 con 0x7effe80d2680 2024-06-10T00:24:38.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.601+0000 7effe67fc640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effd406be60 0x7effd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:38.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.601+0000 7effe67fc640 1 -- 172.21.15.79:0/1848532740 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7effe00ab820 con 0x7effe80d2680 2024-06-10T00:24:38.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.601+0000 7effedb1a640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effd406be60 0x7effd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:38.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.601+0000 7effedb1a640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effd406be60 0x7effd406e320 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7effd8003b80 tx=0x7effd80098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:38.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.605+0000 7effe67fc640 1 -- 172.21.15.79:0/1848532740 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7effe007a040 con 0x7effe80d2680 2024-06-10T00:24:38.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.789+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7effe80d2d10 con 0x7effe80d2680 2024-06-10T00:24:38.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.789+0000 7effe67fc640 1 -- 172.21.15.79:0/1848532740 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7effe0079940 con 0x7effe80d2680 2024-06-10T00:24:38.789 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:24:38.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effd406be60 msgr2=0x7effd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effd406be60 0x7effd406e320 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7effd8003b80 tx=0x7effd80098d0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80d2680 msgr2=0x7effe81532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:38.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80d2680 0x7effe81532c0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7effe00090b0 tx=0x7effe00046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 shutdown_connections 2024-06-10T00:24:38.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7effd406be60 0x7effd406e320 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe80d2680 0x7effe81532c0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effe80d1fc0 0x7effe8152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 --2- 172.21.15.79:0/1848532740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effe80cef70 0x7effe815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:38.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 >> 172.21.15.79:0/1848532740 conn(0x7effe809d3f0 msgr2=0x7effe80c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:38.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 shutdown_connections 2024-06-10T00:24:38.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:38.791+0000 7effefd7e640 1 -- 172.21.15.79:0/1848532740 wait complete. 2024-06-10T00:24:38.801 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:24:38.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:38.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:38.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[74618]: fuse finished with error 0 and tester_r 0 2024-06-10T00:24:38.826 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:24:44.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:24:44.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:44.928 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:24:44.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-06-10T00:24:45.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.101+0000 7f013d4cd640 1 Processor -- start 2024-06-10T00:24:45.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.101+0000 7f013d4cd640 1 -- start start 2024-06-10T00:24:45.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f013d4cd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01381474f0 0x7f01380b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f013d4cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f013806e560 0x7f0138161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f013d4cd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01380b5a40 con 0x7f01381449b0 2024-06-10T00:24:45.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f013d4cd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f01380b6050 con 0x7f01381474f0 2024-06-10T00:24:45.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f013d4cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0138072ae0 con 0x7f013806e560 2024-06-10T00:24:45.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f01367fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01381474f0 0x7f01380b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f01367fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01381474f0 0x7f01380b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40366/0 (socket says 172.21.15.79:40366) 2024-06-10T00:24:45.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f01367fc640 1 -- 172.21.15.79:0/1078245291 learned_addr learned my addr 172.21.15.79:0/1078245291 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:45.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f01377fe640 1 --2- 172.21.15.79:0/1078245291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f013806e560 0x7f0138161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f01367fc640 1 -- 172.21.15.79:0/1078245291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f013806e560 msgr2=0x7f0138161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f01367fc640 1 --2- 172.21.15.79:0/1078245291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f013806e560 0x7f0138161d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f01367fc640 1 -- 172.21.15.79:0/1078245291 >> v1:172.21.15.117:6789/0 conn(0x7f01381449b0 legacy=0x7f013806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.102+0000 7f01367fc640 1 -- 172.21.15.79:0/1078245291 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0138072dc0 con 0x7f01381474f0 2024-06-10T00:24:45.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.103+0000 7f01367fc640 1 --2- 172.21.15.79:0/1078245291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01381474f0 0x7f01380b3fe0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f01380b61d0 tx=0x7f012c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3905fcc58c14df61 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.103+0000 7f0135ffb640 1 -- 172.21.15.79:0/1078245291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c037070 con 0x7f01381474f0 2024-06-10T00:24:45.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.103+0000 7f0135ffb640 1 -- 172.21.15.79:0/1078245291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c032440 con 0x7f01381474f0 2024-06-10T00:24:45.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.103+0000 7f0135ffb640 1 -- 172.21.15.79:0/1078245291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c032810 con 0x7f01381474f0 2024-06-10T00:24:45.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.104+0000 7f013d4cd640 1 -- 172.21.15.79:0/1078245291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01381474f0 msgr2=0x7f01380b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.104+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1078245291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01381474f0 0x7f01380b3fe0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f01380b61d0 tx=0x7f012c02a160 comp rx=0 tx=0).stop 2024-06-10T00:24:45.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.104+0000 7f013d4cd640 1 -- 172.21.15.79:0/1078245291 shutdown_connections 2024-06-10T00:24:45.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.104+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1078245291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f013806e560 0x7f0138161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.104+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1078245291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01381474f0 0x7f01380b3fe0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.104+0000 7f013d4cd640 1 -- 172.21.15.79:0/1078245291 >> 172.21.15.79:0/1078245291 conn(0x7f01380b2a00 msgr2=0x7f01380b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:45.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.104+0000 7f013d4cd640 1 -- 172.21.15.79:0/1078245291 shutdown_connections 2024-06-10T00:24:45.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.104+0000 7f013d4cd640 1 -- 172.21.15.79:0/1078245291 wait complete. 2024-06-10T00:24:45.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.105+0000 7f013d4cd640 1 Processor -- start 2024-06-10T00:24:45.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.105+0000 7f013d4cd640 1 -- start start 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.106+0000 7f013d4cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f013806e560 0x7f01381537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.106+0000 7f013d4cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01381449b0 0x7f013815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.106+0000 7f013d4cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01381474f0 0x7f01381600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.106+0000 7f013d4cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f013806ea10 con 0x7f013806e560 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.106+0000 7f013d4cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01380730a0 con 0x7f01381449b0 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.106+0000 7f013d4cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f013806eb90 con 0x7f01381474f0 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f013806e560 0x7f01381537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f013806e560 0x7f01381537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40378/0 (socket says 172.21.15.79:40378) 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 -- 172.21.15.79:0/1526612758 learned_addr learned my addr 172.21.15.79:0/1526612758 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f01377fe640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01381474f0 0x7f01381600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f01367fc640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01381449b0 0x7f013815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 -- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01381474f0 msgr2=0x7f01381600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01381474f0 0x7f01381600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 -- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01381449b0 msgr2=0x7f013815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01381449b0 0x7f013815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 -- 172.21.15.79:0/1526612758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013813f440 con 0x7f013806e560 2024-06-10T00:24:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f01367fc640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01381449b0 0x7f013815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:45.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.107+0000 7f0136ffd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f013806e560 0x7f01381537a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f012800c430 tx=0x7f012800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.108+0000 7f011f7fe640 1 -- 172.21.15.79:0/1526612758 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128011790 con 0x7f013806e560 2024-06-10T00:24:45.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.108+0000 7f011f7fe640 1 -- 172.21.15.79:0/1526612758 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0128017070 con 0x7f013806e560 2024-06-10T00:24:45.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.108+0000 7f011f7fe640 1 -- 172.21.15.79:0/1526612758 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128011bb0 con 0x7f013806e560 2024-06-10T00:24:45.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.108+0000 7f013d4cd640 1 -- 172.21.15.79:0/1526612758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013813f720 con 0x7f013806e560 2024-06-10T00:24:45.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.108+0000 7f013d4cd640 1 -- 172.21.15.79:0/1526612758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013813fce0 con 0x7f013806e560 2024-06-10T00:24:45.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.110+0000 7f011f7fe640 1 -- 172.21.15.79:0/1526612758 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f012801c460 con 0x7f013806e560 2024-06-10T00:24:45.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.110+0000 7f011f7fe640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f012406be30 0x7f012406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.110+0000 7f011f7fe640 1 -- 172.21.15.79:0/1526612758 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f012808ae00 con 0x7f013806e560 2024-06-10T00:24:45.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.110+0000 7f01367fc640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f012406be30 0x7f012406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.111+0000 7f01367fc640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f012406be30 0x7f012406e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f012c034000 tx=0x7f012c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.111+0000 7f01401d9740 1 Processor -- start 2024-06-10T00:24:45.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.111+0000 7f01401d9740 1 -- start start 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01401d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b0daf0 0x55c122aea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01401d9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122ae51a0 0x55c122aea660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01401d9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122aec6d0 0x55c122aeaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01401d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c122a0f7e0 con 0x55c122b0daf0 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01401d9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c122a4de80 con 0x55c122ae51a0 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01401d9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c1229eb700 con 0x55c122aec6d0 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f0136ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b0daf0 0x55c122aea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f0136ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b0daf0 0x55c122aea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40384/0 (socket says 172.21.15.79:40384) 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f0136ffd640 1 -- 172.21.15.79:0/2551047659 learned_addr learned my addr 172.21.15.79:0/2551047659 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01367fc640 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122ae51a0 0x55c122aea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01377fe640 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122aec6d0 0x55c122aeaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f0136ffd640 1 -- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122aec6d0 msgr2=0x55c122aeaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f0136ffd640 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122aec6d0 0x55c122aeaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f0136ffd640 1 -- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122ae51a0 msgr2=0x55c122aea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f0136ffd640 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122ae51a0 0x55c122aea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f0136ffd640 1 -- 172.21.15.79:0/2551047659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c122a0add0 con 0x55c122b0daf0 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01367fc640 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122ae51a0 0x55c122aea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.112+0000 7f01377fe640 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122aec6d0 0x55c122aeaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f0136ffd640 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b0daf0 0x55c122aea120 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f012800a040 tx=0x7f0128058f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cb4192c35142ae server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f011cff9640 1 -- 172.21.15.79:0/2551047659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128061b00 con 0x55c122b0daf0 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f011cff9640 1 -- 172.21.15.79:0/2551047659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0128057220 con 0x55c122b0daf0 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f011cff9640 1 -- 172.21.15.79:0/2551047659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128055590 con 0x55c122b0daf0 2024-06-10T00:24:45.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f01401d9740 1 -- 172.21.15.79:0/2551047659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b0daf0 msgr2=0x55c122aea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f01401d9740 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b0daf0 0x55c122aea120 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f012800a040 tx=0x7f0128058f20 comp rx=0 tx=0).stop 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f01401d9740 1 -- 172.21.15.79:0/2551047659 shutdown_connections 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f01401d9740 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122aec6d0 0x55c122aeaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f01401d9740 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122ae51a0 0x55c122aea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f01401d9740 1 --2- 172.21.15.79:0/2551047659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b0daf0 0x55c122aea120 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.113+0000 7f01401d9740 1 -- 172.21.15.79:0/2551047659 >> 172.21.15.79:0/2551047659 conn(0x55c122ae7410 msgr2=0x55c122b2ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.114+0000 7f01401d9740 1 -- 172.21.15.79:0/2551047659 shutdown_connections 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.114+0000 7f01401d9740 1 -- 172.21.15.79:0/2551047659 wait complete. 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.114+0000 7f01401d9740 1 -- start start 2024-06-10T00:24:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.114+0000 7f01401d9740 1 Processor -- start 2024-06-10T00:24:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01401d9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b0aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01401d9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b0ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01401d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b430e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01401d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c1229d6640 con 0x55c122b10450 2024-06-10T00:24:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01401d9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c122a49e40 con 0x55c122b0daf0 2024-06-10T00:24:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01401d9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c122ae8be0 con 0x55c122b37f90 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01401d9740 10 client.0 _ll_register_callbacks cb 0x55c122a08430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b430e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40390/0 (socket says 172.21.15.79:40390) 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01377fe640 1 -- 172.21.15.79:0/1626776919 learned_addr learned my addr 172.21.15.79:0/1626776919 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01367fc640 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b0ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f0136ffd640 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b0aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01377fe640 1 -- 172.21.15.79:0/1626776919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 msgr2=0x55c122b0ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01377fe640 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b0ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01377fe640 1 -- 172.21.15.79:0/1626776919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 msgr2=0x55c122b0aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01377fe640 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b0aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.115+0000 7f01377fe640 1 -- 172.21.15.79:0/1626776919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c12282b7d0 con 0x55c122b10450 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01377fe640 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b430e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f0130010a60 tx=0x7f0130010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905708964292f27 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0115ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:24:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0115ffb640 1 -- 172.21.15.79:0/1626776919 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000ec00 con 0x55c122b10450 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0115ffb640 1 -- 172.21.15.79:0/1626776919 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f013000eda0 con 0x55c122b10450 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 1 -- 172.21.15.79:0/1626776919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0128057220 con 0x55c122b10450 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0115ffb640 1 -- 172.21.15.79:0/1626776919 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f0130012450 con 0x55c122b10450 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 10 client.8505 fetch_fsmap learned FSMap version 83 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 1 -- 172.21.15.79:0/1626776919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55c1227613f0 con 0x55c122b10450 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0115ffb640 1 -- 172.21.15.79:0/1626776919 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0128057220 con 0x55c122b10450 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0115ffb640 1 -- 172.21.15.79:0/1626776919 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f013000f040 con 0x55c122b10450 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 10 client.8505 fetch_fsmap finished waiting for FSMap version 83 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 10 client.8505 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 20 client.8505 populate_metadata read hostname 'smithi079' 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x55c122b36600 0x55c122b369e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 4 client.8505 mds_command: new command op to 8331 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:24:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f01401d9740 1 -- 172.21.15.79:0/1626776919 --> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c122a5b5b0 con 0x55c122b36600 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0136ffd640 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x55c122b36600 0x55c122b369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0115ffb640 10 client.8505 ms_handle_connect on v2:172.21.15.79:6835/3594456696 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.116+0000 7f0136ffd640 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x55c122b36600 0x55c122b369e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbe4b522d8d119a2 server_cookie=ffbe264dba94d503 in_seq=0 out_seq=0 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f0115ffb640 1 -- 172.21.15.79:0/1626776919 <== mds.0 v2:172.21.15.79:6835/3594456696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f0128077e80 con 0x55c122b36600 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f0115ffb640 10 client.8505 handle_command_reply: tid=0 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 client.8505 shutdown 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 -- 172.21.15.79:0/1626776919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 msgr2=0x55c122b430e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b430e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f0130010a60 tx=0x7f0130010f20 comp rx=0 tx=0).stop 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 -- 172.21.15.79:0/1626776919 shutdown_connections 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x55c122b36600 0x55c122b369e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b430e0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b0ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f0115ffb640 0 client.8505 ms_handle_reset on v2:172.21.15.79:6835/3594456696 2024-06-10T00:24:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 --2- 172.21.15.79:0/1626776919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b0aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 -- 172.21.15.79:0/1626776919 >> 172.21.15.79:0/1626776919 conn(0x55c122aec6d0 msgr2=0x55c122b328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 -- 172.21.15.79:0/1626776919 shutdown_connections 2024-06-10T00:24:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 1 -- 172.21.15.79:0/1626776919 wait complete. 2024-06-10T00:24:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.117+0000 7f01401d9740 20 client.8505 trim_cache size 0 max 16384 2024-06-10T00:24:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.132+0000 7f01401d9740 1 Processor -- start 2024-06-10T00:24:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01401d9740 1 -- start start 2024-06-10T00:24:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01401d9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b36f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01401d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01401d9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b11640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01401d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0138200df0 con 0x55c122b10450 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01401d9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01381ffe30 con 0x55c122b0daf0 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01401d9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01381f8700 con 0x55c122b37f90 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01367fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01367fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b109e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40396/0 (socket says 172.21.15.79:40396) 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.133+0000 7f01367fc640 1 -- 172.21.15.79:0/3241042083 learned_addr learned my addr 172.21.15.79:0/3241042083 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f0136ffd640 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b36f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01377fe640 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b11640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01367fc640 1 -- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 msgr2=0x55c122b11640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01367fc640 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b11640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01367fc640 1 -- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 msgr2=0x55c122b36f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01367fc640 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b36f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01367fc640 1 -- 172.21.15.79:0/3241042083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1227210f0 con 0x55c122b10450 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f0136ffd640 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b36f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01377fe640 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b11640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01367fc640 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b109e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f012c009960 tx=0x7f012c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7114d9ac5ba8f5f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f0117fff640 1 -- 172.21.15.79:0/3241042083 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c04f070 con 0x55c122b10450 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f0117fff640 1 -- 172.21.15.79:0/3241042083 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c03e7e0 con 0x55c122b10450 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f0117fff640 1 -- 172.21.15.79:0/3241042083 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c037040 con 0x55c122b10450 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01401d9740 1 -- 172.21.15.79:0/3241042083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 msgr2=0x55c122b109e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01401d9740 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b109e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f012c009960 tx=0x7f012c008030 comp rx=0 tx=0).stop 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01401d9740 1 -- 172.21.15.79:0/3241042083 shutdown_connections 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01401d9740 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b11640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01401d9740 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b109e0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01401d9740 1 --2- 172.21.15.79:0/3241042083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122b36f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01401d9740 1 -- 172.21.15.79:0/3241042083 >> 172.21.15.79:0/3241042083 conn(0x55c122aec6d0 msgr2=0x55c122aea0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:45.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.134+0000 7f01401d9740 1 -- 172.21.15.79:0/3241042083 shutdown_connections 2024-06-10T00:24:45.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.135+0000 7f01401d9740 1 -- 172.21.15.79:0/3241042083 wait complete. 2024-06-10T00:24:45.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.135+0000 7f01401d9740 1 -- start start 2024-06-10T00:24:45.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.135+0000 7f01401d9740 1 Processor -- start 2024-06-10T00:24:45.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01401d9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122bb0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01401d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b04230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01401d9740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b02bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01401d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c122b37640 con 0x55c122b10450 2024-06-10T00:24:45.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01401d9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0138140f90 con 0x55c122b0daf0 2024-06-10T00:24:45.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01401d9740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c122b0ff10 con 0x55c122b37f90 2024-06-10T00:24:45.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01401d9740 10 client.0 _ll_register_callbacks cb 0x7f01300106c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b04230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b04230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40400/0 (socket says 172.21.15.79:40400) 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 -- 172.21.15.79:0/179614187 learned_addr learned my addr 172.21.15.79:0/179614187 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01377fe640 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b02bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f0136ffd640 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122bb0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 -- 172.21.15.79:0/179614187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 msgr2=0x55c122b02bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b02bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 -- 172.21.15.79:0/179614187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 msgr2=0x55c122bb0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122bb0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 -- 172.21.15.79:0/179614187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c122a14560 con 0x55c122b10450 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01367fc640 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b04230 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f012c0090b0 tx=0x7f012c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577b5677e6e7c705 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f0115ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f0115ffb640 1 -- 172.21.15.79:0/179614187 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c05a060 con 0x55c122b10450 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f0115ffb640 1 -- 172.21.15.79:0/179614187 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f012c055430 con 0x55c122b10450 2024-06-10T00:24:45.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.136+0000 7f01401d9740 1 -- 172.21.15.79:0/179614187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012c03e7e0 con 0x55c122b10450 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f0115ffb640 1 -- 172.21.15.79:0/179614187 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f012c060050 con 0x55c122b10450 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f01401d9740 10 client.8511 fetch_fsmap learned FSMap version 83 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f01401d9740 1 -- 172.21.15.79:0/179614187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55c122b32c90 con 0x55c122b10450 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f0115ffb640 1 -- 172.21.15.79:0/179614187 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c03e7e0 con 0x55c122b10450 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f0115ffb640 1 -- 172.21.15.79:0/179614187 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f012c063020 con 0x55c122b10450 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f01401d9740 10 client.8511 fetch_fsmap finished waiting for FSMap version 83 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f01401d9740 10 client.8511 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f01401d9740 20 client.8511 populate_metadata read hostname 'smithi079' 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f01401d9740 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x55c122ae99e0 0x55c122b0ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f01401d9740 4 client.8511 mds_command: new command op to 8331 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f01401d9740 1 -- 172.21.15.79:0/179614187 --> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c122a55900 con 0x55c122ae99e0 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f0136ffd640 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x55c122ae99e0 0x55c122b0ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f0136ffd640 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x55c122ae99e0 0x55c122b0ded0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cdd425490e70ad5 server_cookie=583100b21186aa83 in_seq=0 out_seq=0 2024-06-10T00:24:45.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.137+0000 7f0115ffb640 10 client.8511 ms_handle_connect on v2:172.21.15.79:6835/3594456696 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f0115ffb640 1 -- 172.21.15.79:0/179614187 <== mds.0 v2:172.21.15.79:6835/3594456696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c122a55900 con 0x55c122ae99e0 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f0115ffb640 10 client.8511 handle_command_reply: tid=0 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 client.8511 shutdown 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 -- 172.21.15.79:0/179614187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 msgr2=0x55c122b04230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b04230 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f012c0090b0 tx=0x7f012c004730 comp rx=0 tx=0).stop 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 -- 172.21.15.79:0/179614187 shutdown_connections 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.79:6835/3594456696,v1:172.21.15.79:6837/3594456696] conn(0x55c122ae99e0 0x55c122b0ded0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c122b37f90 0x55c122b02bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c122b10450 0x55c122b04230 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f0115ffb640 0 client.8511 ms_handle_reset on v2:172.21.15.79:6835/3594456696 2024-06-10T00:24:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 --2- 172.21.15.79:0/179614187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c122b0daf0 0x55c122bb0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 -- 172.21.15.79:0/179614187 >> 172.21.15.79:0/179614187 conn(0x55c122aec6d0 msgr2=0x55c122b116f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 -- 172.21.15.79:0/179614187 shutdown_connections 2024-06-10T00:24:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 1 -- 172.21.15.79:0/179614187 wait complete. 2024-06-10T00:24:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.152+0000 7f01401d9740 20 client.8511 trim_cache size 0 max 16384 2024-06-10T00:24:45.153 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0 2024-06-10T00:24:45.153 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 -- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f012406be30 msgr2=0x7f012406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f012406be30 0x7f012406e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f012c034000 tx=0x7f012c02e000 comp rx=0 tx=0).stop 2024-06-10T00:24:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 -- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f013806e560 msgr2=0x7f01381537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f013806e560 0x7f01381537a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f012800c430 tx=0x7f012800c8f0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 -- 172.21.15.79:0/1526612758 shutdown_connections 2024-06-10T00:24:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f012406be30 0x7f012406e2f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01381474f0 0x7f01381600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01381449b0 0x7f013815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 --2- 172.21.15.79:0/1526612758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f013806e560 0x7f01381537a0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 -- 172.21.15.79:0/1526612758 >> 172.21.15.79:0/1526612758 conn(0x7f01380b2a00 msgr2=0x7f01380b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 -- 172.21.15.79:0/1526612758 shutdown_connections 2024-06-10T00:24:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.153+0000 7f013d4cd640 1 -- 172.21.15.79:0/1526612758 wait complete. 2024-06-10T00:24:45.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:24:45.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.262+0000 7f539861c640 1 Processor -- start 2024-06-10T00:24:45.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.263+0000 7f539861c640 1 -- start start 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.263+0000 7f539861c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f539015c7f0 0x7f53900cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.263+0000 7f539861c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53900725f0 con 0x7f5390156830 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f539861c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53900728d0 con 0x7f53900b4530 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f539861c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f53900b3090 con 0x7f539015c7f0 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53963b8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5390156830 0x7f5390071bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46672/0 (socket says 172.21.15.79:46672) 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53963b8640 1 -- 172.21.15.79:0/1405774395 learned_addr learned my addr 172.21.15.79:0/1405774395 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446037075 0 0) 0x7f53900725f0 con 0x7f5390156830 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f537c003520 con 0x7f5390156830 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f5395bb7640 1 --2- 172.21.15.79:0/1405774395 >> v2:172.21.15.117:3300/0 conn(0x7f539015c7f0 0x7f53900cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2449733762 0 0) 0x7f537c003520 con 0x7f5390156830 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 >> v2:172.21.15.117:3300/0 conn(0x7f539015c7f0 msgr2=0x7f53900cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 --2- 172.21.15.79:0/1405774395 >> v2:172.21.15.117:3300/0 conn(0x7f539015c7f0 0x7f53900cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 >> v1:172.21.15.117:6789/0 conn(0x7f53900b4530 legacy=0x7f5390165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5390072bb0 con 0x7f5390156830 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f538c001670 con 0x7f5390156830 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 >> v1:172.21.15.79:6789/0 conn(0x7f5390156830 legacy=0x7f5390071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0039b0 0x7f537c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c004800 0x7f537c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c0051c0 0x7f537c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53900b3090 con 0x7f537c0051c0 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f537c00c110 con 0x7f537c004800 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f537c00c310 con 0x7f537c0039b0 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f5396bb9640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c0051c0 0x7f537c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f5395bb7640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c004800 0x7f537c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.264+0000 7f53963b8640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0039b0 0x7f537c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f5396bb9640 1 -- 172.21.15.79:0/1405774395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0039b0 msgr2=0x7f537c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f5396bb9640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0039b0 0x7f537c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f5396bb9640 1 -- 172.21.15.79:0/1405774395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c004800 msgr2=0x7f537c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f5396bb9640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c004800 0x7f537c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f5396bb9640 1 -- 172.21.15.79:0/1405774395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c003520 con 0x7f537c0051c0 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f5396bb9640 1 -- 172.21.15.79:0/1405774395 reap_dead start 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f5396bb9640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c0051c0 0x7f537c00b9c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5388001e50 tx=0x7f537c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aaa1ac380de867c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388001a70 con 0x7f537c0051c0 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5388003970 con 0x7f537c0051c0 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.265+0000 7f53953b6640 1 -- 172.21.15.79:0/1405774395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388003d60 con 0x7f537c0051c0 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.266+0000 7f539861c640 1 -- 172.21.15.79:0/1405774395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c0051c0 msgr2=0x7f537c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.266+0000 7f539861c640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c0051c0 0x7f537c00b9c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5388001e50 tx=0x7f537c005830 comp rx=0 tx=0).stop 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.266+0000 7f539861c640 1 -- 172.21.15.79:0/1405774395 shutdown_connections 2024-06-10T00:24:45.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.266+0000 7f539861c640 1 --2- 172.21.15.79:0/1405774395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c0051c0 0x7f537c00b9c0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.266+0000 7f539861c640 1 -- 172.21.15.79:0/1405774395 >> 172.21.15.79:0/1405774395 conn(0x7f53900b19f0 msgr2=0x7f53900b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:45.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.266+0000 7f539861c640 1 -- 172.21.15.79:0/1405774395 shutdown_connections 2024-06-10T00:24:45.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.266+0000 7f539861c640 1 -- 172.21.15.79:0/1405774395 wait complete. 2024-06-10T00:24:45.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.267+0000 7f539861c640 1 Processor -- start 2024-06-10T00:24:45.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.267+0000 7f539861c640 1 -- start start 2024-06-10T00:24:45.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f539861c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0051c0 0x7f539009d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f539861c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f539014e4e0 0x7f539013ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f539861c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539014c5a0 0x7f539014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f539861c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5390071d70 con 0x7f539014e4e0 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f539861c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5390071bf0 con 0x7f537c0051c0 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f539861c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5390071ef0 con 0x7f539014c5a0 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5395bb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f539014e4e0 0x7f539013ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5395bb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f539014e4e0 0x7f539013ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40412/0 (socket says 172.21.15.79:40412) 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5395bb7640 1 -- 172.21.15.79:0/2338670674 learned_addr learned my addr 172.21.15.79:0/2338670674 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f53963b8640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0051c0 0x7f539009d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5396bb9640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539014c5a0 0x7f539014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5395bb7640 1 -- 172.21.15.79:0/2338670674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539014c5a0 msgr2=0x7f539014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5395bb7640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539014c5a0 0x7f539014ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5395bb7640 1 -- 172.21.15.79:0/2338670674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0051c0 msgr2=0x7f539009d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5395bb7640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0051c0 0x7f539009d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.268+0000 7f5395bb7640 1 -- 172.21.15.79:0/2338670674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539014e9c0 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.269+0000 7f5395bb7640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f539014e4e0 0x7f539013ebd0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f538000b7c0 tx=0x7f538000bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.269+0000 7f5386ffd640 1 -- 172.21.15.79:0/2338670674 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380018070 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.269+0000 7f5386ffd640 1 -- 172.21.15.79:0/2338670674 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5380010830 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.269+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539014eca0 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.269+0000 7f5386ffd640 1 -- 172.21.15.79:0/2338670674 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380010c40 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.269+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539014f260 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.270+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539013bea0 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.270+0000 7f5386ffd640 1 -- 172.21.15.79:0/2338670674 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f538001b070 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.271+0000 7f5386ffd640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f537406be30 0x7f537406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.271+0000 7f53963b8640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f537406be30 0x7f537406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.271+0000 7f5386ffd640 1 -- 172.21.15.79:0/2338670674 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f538008b2a0 con 0x7f539014e4e0 2024-06-10T00:24:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.271+0000 7f53963b8640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f537406be30 0x7f537406e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f538c001cd0 tx=0x7f538c001c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:45.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.275+0000 7f5386ffd640 1 -- 172.21.15.79:0/2338670674 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f539013bea0 con 0x7f539014e4e0 2024-06-10T00:24:45.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.488+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5390068430 con 0x7f539014e4e0 2024-06-10T00:24:45.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.489+0000 7f5386ffd640 1 -- 172.21.15.79:0/2338670674 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f538008b0c0 con 0x7f539014e4e0 2024-06-10T00:24:45.488 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:24:45.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f537406be30 msgr2=0x7f537406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f537406be30 0x7f537406e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f538c001cd0 tx=0x7f538c001c40 comp rx=0 tx=0).stop 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f539014e4e0 msgr2=0x7f539013ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f539014e4e0 0x7f539013ebd0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f538000b7c0 tx=0x7f538000bbc0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 shutdown_connections 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f537406be30 0x7f537406e2f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539014c5a0 0x7f539014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f539014e4e0 0x7f539013ebd0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 --2- 172.21.15.79:0/2338670674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0051c0 0x7f539009d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 >> 172.21.15.79:0/2338670674 conn(0x7f53900b19f0 msgr2=0x7f53900ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 shutdown_connections 2024-06-10T00:24:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45.491+0000 7f539861c640 1 -- 172.21.15.79:0/2338670674 wait complete. 2024-06-10T00:24:45.501 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:24:45.501 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:24:45.501 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:24:45.501 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:24:45.501 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:45.501 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:24:45.502 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:24:45.502 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:24:45.502 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:45.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:45.502 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:24:45.518 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:24:45.518 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:24:45.518 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:24:45.518 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:45.518 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:24:45.518 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:45.518 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:45.518 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42159sec preferred_lft 42159sec 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:24:45.519 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:24:45.520 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:45.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:45.521 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:24:45.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:24:45.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:24:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:24:45.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:45.583 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:24:45.671 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:24:45.671 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:24:45.671 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:24:45.671 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:24:45.671 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:24:45.672 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:24:45.672 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:24:45.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:24:45.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:24:45.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:24:45.672 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:24:45.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:24:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:45.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:45.797 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:24:45.812 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:24:45.813 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:24:45.813 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:45.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:45.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:24:45.878 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:24:45.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:24:45.878 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:45.933 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:45.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:24:45.934 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:45.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:24:46.054 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:24:46.111 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:24:46.112 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:46.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:46.114 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:24:46.167 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:24:46.167 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:24:46.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:24:46.235 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:24:46.291 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:24:46.291+0000 7ffa7c73b480 -1 init, newargv = 0x561b4b371090 newargc=15 2024-06-10T00:24:46.291 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[75408]: starting ceph client 2024-06-10T00:24:46.292 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:24:46.293 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:24:46.293 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:24:46.293 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:24:46.293 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:24:46.293 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:24:46.293 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:24:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:46.296 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:46.296 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:46.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:46.296 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:24:46.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[75408]: starting fuse 2024-06-10T00:24:46.311 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:24:46.311 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:24:46.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:24:46.311 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:24:46.311 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:24:46.311 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:46.311 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:24:46.311 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:46.311 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:24:46.312 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:24:46.313 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:24:46.313 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:24:46.313 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:46.313 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:24:46.313 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:46.429 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.75408.asok 2024-06-10T00:24:46.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:46.439 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75408.asok 2024-06-10T00:24:46.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:46.439 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75408.asok status 2024-06-10T00:24:46.574 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:46.574 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "75408", 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8526, 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:24:46.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 8526 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2408227102 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2408227102 2024-06-10T00:24:46.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.8526 192.168.0.1:0/2408227102", 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/2408227102", 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 83, 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 119, 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:24:46.577 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:46.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:46.584 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:24:46.584 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:46.600 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:24:46.600 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:46.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:46.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:46.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:46.664 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-06-10T00:24:46.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:46.724 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-06-10T00:24:46.815 INFO:teuthology.orchestra.run.smithi079.stderr:8+0 records in 2024-06-10T00:24:46.815 INFO:teuthology.orchestra.run.smithi079.stderr:8+0 records out 2024-06-10T00:24:46.815 INFO:teuthology.orchestra.run.smithi079.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0340998 s, 246 MB/s 2024-06-10T00:24:46.816 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:46.816 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:46.816 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:46.816 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:46.816 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-06-10T00:24:46.816 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:46.883 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627779 2024-06-10T00:24:46.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:46.893 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:46.893 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:46.893 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:46.893 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:46.893 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-06-10T00:24:46.893 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:46.998 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627780 2024-06-10T00:24:47.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:47.007 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:47.007 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:47.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:24:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.202+0000 7f2ab3963640 1 Processor -- start 2024-06-10T00:24:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.203+0000 7f2ab3963640 1 -- start start 2024-06-10T00:24:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab3963640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2aac0aef70 0x7f2aac0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab3963640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac0af3b0 0x7f2aac0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab3963640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aac15ac50 con 0x7f2aac15a870 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab3963640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2aac0b4fe0 con 0x7f2aac0aef70 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab3963640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac06cdb0 con 0x7f2aac0af3b0 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab0efe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2aac0aef70 0x7f2aac0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab16ff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2aac15a870 0x7f2aac06de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46688/0 (socket says 172.21.15.79:46688) 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab0efe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2aac0aef70 0x7f2aac0b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40418/0 (socket says 172.21.15.79:40418) 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab16ff640 1 -- 172.21.15.79:0/4110788635 learned_addr learned my addr 172.21.15.79:0/4110788635 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab1f00640 1 --2- 172.21.15.79:0/4110788635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac0af3b0 0x7f2aac0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab0efe640 1 -- 172.21.15.79:0/4110788635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac0af3b0 msgr2=0x7f2aac0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab0efe640 1 --2- 172.21.15.79:0/4110788635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac0af3b0 0x7f2aac0b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab0efe640 1 -- 172.21.15.79:0/4110788635 >> v1:172.21.15.79:6789/0 conn(0x7f2aac15a870 legacy=0x7f2aac06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab0efe640 1 -- 172.21.15.79:0/4110788635 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac06d090 con 0x7f2aac0aef70 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2a9ffff640 1 -- 172.21.15.79:0/4110788635 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1176909137 0 0) 0x7f2aac15ac50 con 0x7f2aac15a870 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.204+0000 7f2ab1f00640 1 --2- 172.21.15.79:0/4110788635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac0af3b0 0x7f2aac0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2ab0efe640 1 --2- 172.21.15.79:0/4110788635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0aef70 0x7f2aac0b4560 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00097a0 tx=0x7f2aa002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f4e42fb790a476 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:47.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2a9ffff640 1 -- 172.21.15.79:0/4110788635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0037070 con 0x7f2aac0aef70 2024-06-10T00:24:47.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2a9ffff640 1 -- 172.21.15.79:0/4110788635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa002adb0 con 0x7f2aac0aef70 2024-06-10T00:24:47.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2a9ffff640 1 -- 172.21.15.79:0/4110788635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0032660 con 0x7f2aac0aef70 2024-06-10T00:24:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2ab3963640 1 -- 172.21.15.79:0/4110788635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0aef70 msgr2=0x7f2aac0b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2ab3963640 1 --2- 172.21.15.79:0/4110788635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0aef70 0x7f2aac0b4560 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00097a0 tx=0x7f2aa002a060 comp rx=0 tx=0).stop 2024-06-10T00:24:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2ab3963640 1 -- 172.21.15.79:0/4110788635 shutdown_connections 2024-06-10T00:24:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2ab3963640 1 --2- 172.21.15.79:0/4110788635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac0af3b0 0x7f2aac0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2ab3963640 1 --2- 172.21.15.79:0/4110788635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0aef70 0x7f2aac0b4560 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.205+0000 7f2ab3963640 1 -- 172.21.15.79:0/4110788635 >> 172.21.15.79:0/4110788635 conn(0x7f2aac0b19f0 msgr2=0x7f2aac0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.206+0000 7f2ab3963640 1 -- 172.21.15.79:0/4110788635 shutdown_connections 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.206+0000 7f2ab3963640 1 -- 172.21.15.79:0/4110788635 wait complete. 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab3963640 1 Processor -- start 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab3963640 1 -- start start 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab3963640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aac0aef70 0x7f2aac15d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab3963640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0af3b0 0x7f2aac0cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab3963640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac15a870 0x7f2aac144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab3963640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac06d930 con 0x7f2aac0af3b0 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab3963640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac06d650 con 0x7f2aac0aef70 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab3963640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac0b2e40 con 0x7f2aac15a870 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.207+0000 7f2ab0efe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0af3b0 0x7f2aac0cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab0efe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0af3b0 0x7f2aac0cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40422/0 (socket says 172.21.15.79:40422) 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab0efe640 1 -- 172.21.15.79:0/5228172 learned_addr learned my addr 172.21.15.79:0/5228172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab1f00640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac15a870 0x7f2aac144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab16ff640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aac0aef70 0x7f2aac15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab0efe640 1 -- 172.21.15.79:0/5228172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac15a870 msgr2=0x7f2aac144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab0efe640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac15a870 0x7f2aac144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab0efe640 1 -- 172.21.15.79:0/5228172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aac0aef70 msgr2=0x7f2aac15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab0efe640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aac0aef70 0x7f2aac15d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab0efe640 1 -- 172.21.15.79:0/5228172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac15ba60 con 0x7f2aac0af3b0 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab0efe640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0af3b0 0x7f2aac0cc5b0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0035040 tx=0x7f2aa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2a9dffb640 1 -- 172.21.15.79:0/5228172 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0041070 con 0x7f2aac0af3b0 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2a9dffb640 1 -- 172.21.15.79:0/5228172 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa003c670 con 0x7f2aac0af3b0 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac15bd40 con 0x7f2aac0af3b0 2024-06-10T00:24:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2a9dffb640 1 -- 172.21.15.79:0/5228172 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0037040 con 0x7f2aac0af3b0 2024-06-10T00:24:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.208+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac0711f0 con 0x7f2aac0af3b0 2024-06-10T00:24:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.209+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac068430 con 0x7f2aac0af3b0 2024-06-10T00:24:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.210+0000 7f2a9dffb640 1 -- 172.21.15.79:0/5228172 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2aa003a070 con 0x7f2aac0af3b0 2024-06-10T00:24:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.210+0000 7f2a9dffb640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2a9006be30 0x7f2a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.210+0000 7f2a9dffb640 1 -- 172.21.15.79:0/5228172 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f2aa00ab410 con 0x7f2aac0af3b0 2024-06-10T00:24:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.210+0000 7f2ab16ff640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2a9006be30 0x7f2a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.211+0000 7f2ab16ff640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2a9006be30 0x7f2a9006e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000f60 tx=0x7f2aa8007b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:47.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.214+0000 7f2a9dffb640 1 -- 172.21.15.79:0/5228172 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2aa0079cc0 con 0x7f2aac0af3b0 2024-06-10T00:24:47.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.400+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2aac09dde0 con 0x7f2aac0af3b0 2024-06-10T00:24:47.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.400+0000 7f2a9dffb640 1 -- 172.21.15.79:0/5228172 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7f2aa00795c0 con 0x7f2aac0af3b0 2024-06-10T00:24:47.400 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:24:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2a9006be30 msgr2=0x7f2a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2a9006be30 0x7f2a9006e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000f60 tx=0x7f2aa8007b70 comp rx=0 tx=0).stop 2024-06-10T00:24:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0af3b0 msgr2=0x7f2aac0cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0af3b0 0x7f2aac0cc5b0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0035040 tx=0x7f2aa00046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 shutdown_connections 2024-06-10T00:24:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2a9006be30 0x7f2a9006e2f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2aac15a870 0x7f2aac144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2aac0af3b0 0x7f2aac0cc5b0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 --2- 172.21.15.79:0/5228172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aac0aef70 0x7f2aac15d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.402+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 >> 172.21.15.79:0/5228172 conn(0x7f2aac0b19f0 msgr2=0x7f2aac159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.403+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 shutdown_connections 2024-06-10T00:24:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.403+0000 7f2ab3963640 1 -- 172.21.15.79:0/5228172 wait complete. 2024-06-10T00:24:47.413 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:47.413 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:47.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:24:47.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.570+0000 7f47d4ed4640 1 Processor -- start 2024-06-10T00:24:47.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.570+0000 7f47d4ed4640 1 -- start start 2024-06-10T00:24:47.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.571+0000 7f47d4ed4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f47d015a870 0x7f47d006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.571+0000 7f47d4ed4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47d00aef70 0x7f47d00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.571+0000 7f47d4ed4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d006e390 con 0x7f47d00af3d0 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.571+0000 7f47d4ed4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f47d015ac50 con 0x7f47d015a870 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.571+0000 7f47d4ed4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f47d006cdb0 con 0x7f47d00aef70 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.571+0000 7f47ce59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f47d015a870 0x7f47d006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.571+0000 7f47ced9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f47d00af3d0 0x7f47d00cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46694/0 (socket says 172.21.15.79:46694) 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.571+0000 7f47ced9d640 1 -- 172.21.15.79:0/1836387358 learned_addr learned my addr 172.21.15.79:0/1836387358 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47cdd9b640 1 --2- 172.21.15.79:0/1836387358 >> v2:172.21.15.117:3300/0 conn(0x7f47d00aef70 0x7f47d00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47ce59c640 1 -- 172.21.15.79:0/1836387358 >> v2:172.21.15.117:3300/0 conn(0x7f47d00aef70 msgr2=0x7f47d00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47ce59c640 1 --2- 172.21.15.79:0/1836387358 >> v2:172.21.15.117:3300/0 conn(0x7f47d00aef70 0x7f47d00b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47ce59c640 1 -- 172.21.15.79:0/1836387358 >> v1:172.21.15.79:6789/0 conn(0x7f47d00af3d0 legacy=0x7f47d00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47ce59c640 1 -- 172.21.15.79:0/1836387358 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d006d090 con 0x7f47d015a870 2024-06-10T00:24:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47cdd9b640 1 --2- 172.21.15.79:0/1836387358 >> v2:172.21.15.117:3300/0 conn(0x7f47d00aef70 0x7f47d00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47ce59c640 1 --2- 172.21.15.79:0/1836387358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d006de50 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f47d00b4070 tx=0x7f47c002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984ced4063a6fde9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47cd59a640 1 -- 172.21.15.79:0/1836387358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0031600 con 0x7f47d015a870 2024-06-10T00:24:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47cd59a640 1 -- 172.21.15.79:0/1836387358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c00317a0 con 0x7f47d015a870 2024-06-10T00:24:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.572+0000 7f47cd59a640 1 -- 172.21.15.79:0/1836387358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0031b70 con 0x7f47d015a870 2024-06-10T00:24:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.573+0000 7f47d4ed4640 1 -- 172.21.15.79:0/1836387358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 msgr2=0x7f47d006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.573+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/1836387358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d006de50 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f47d00b4070 tx=0x7f47c002a610 comp rx=0 tx=0).stop 2024-06-10T00:24:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.573+0000 7f47d4ed4640 1 -- 172.21.15.79:0/1836387358 shutdown_connections 2024-06-10T00:24:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.573+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/1836387358 >> v2:172.21.15.117:3300/0 conn(0x7f47d00aef70 0x7f47d00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.573+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/1836387358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d006de50 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.573+0000 7f47d4ed4640 1 -- 172.21.15.79:0/1836387358 >> 172.21.15.79:0/1836387358 conn(0x7f47d00b19f0 msgr2=0x7f47d00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.573+0000 7f47d4ed4640 1 -- 172.21.15.79:0/1836387358 shutdown_connections 2024-06-10T00:24:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.573+0000 7f47d4ed4640 1 -- 172.21.15.79:0/1836387358 wait complete. 2024-06-10T00:24:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.574+0000 7f47d4ed4640 1 Processor -- start 2024-06-10T00:24:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.574+0000 7f47d4ed4640 1 -- start start 2024-06-10T00:24:47.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47d4ed4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47d00aef70 0x7f47d0147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47d4ed4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47d00af3d0 0x7f47d015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47d4ed4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47d4ed4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f47d006d930 con 0x7f47d015a870 2024-06-10T00:24:47.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47d4ed4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47d006d650 con 0x7f47d00af3d0 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47d4ed4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47d00b2e40 con 0x7f47d00aef70 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47ced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47ced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d015be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40442/0 (socket says 172.21.15.79:40442) 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47ced9d640 1 -- 172.21.15.79:0/3780478768 learned_addr learned my addr 172.21.15.79:0/3780478768 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47cdd9b640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47d00af3d0 0x7f47d015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.575+0000 7f47ce59c640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47d00aef70 0x7f47d0147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47ced9d640 1 -- 172.21.15.79:0/3780478768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47d00aef70 msgr2=0x7f47d0147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47ced9d640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47d00aef70 0x7f47d0147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47ced9d640 1 -- 172.21.15.79:0/3780478768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47d00af3d0 msgr2=0x7f47d015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47ced9d640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47d00af3d0 0x7f47d015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47ced9d640 1 -- 172.21.15.79:0/3780478768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d015c370 con 0x7f47d015a870 2024-06-10T00:24:47.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47ced9d640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d015be30 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c3c0 tx=0x7f47c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47beffd640 1 -- 172.21.15.79:0/3780478768 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8017070 con 0x7f47d015a870 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47beffd640 1 -- 172.21.15.79:0/3780478768 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c8005ce0 con 0x7f47d015a870 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d0148560 con 0x7f47d015a870 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47beffd640 1 -- 172.21.15.79:0/3780478768 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c80072f0 con 0x7f47d015a870 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.576+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d0148b20 con 0x7f47d015a870 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.577+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d0068430 con 0x7f47d015a870 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.577+0000 7f47beffd640 1 -- 172.21.15.79:0/3780478768 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47c801a070 con 0x7f47d015a870 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.578+0000 7f47beffd640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f47b006be60 0x7f47b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.578+0000 7f47beffd640 1 -- 172.21.15.79:0/3780478768 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f47c808a1e0 con 0x7f47d015a870 2024-06-10T00:24:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.578+0000 7f47ce59c640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f47b006be60 0x7f47b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:47.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.578+0000 7f47ce59c640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f47b006be60 0x7f47b006e320 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f47c0034000 tx=0x7f47c002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:47.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.582+0000 7f47beffd640 1 -- 172.21.15.79:0/3780478768 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f47c8058420 con 0x7f47d015a870 2024-06-10T00:24:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.768+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f47d00b2650 con 0x7f47d015a870 2024-06-10T00:24:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.769+0000 7f47beffd640 1 -- 172.21.15.79:0/3780478768 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7f47c805c720 con 0x7f47d015a870 2024-06-10T00:24:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2024-06-10T00:24:47.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.770+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f47b006be60 msgr2=0x7f47b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.770+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f47b006be60 0x7f47b006e320 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f47c0034000 tx=0x7f47c002f000 comp rx=0 tx=0).stop 2024-06-10T00:24:47.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 msgr2=0x7f47d015be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d015be30 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c3c0 tx=0x7f47c800c880 comp rx=0 tx=0).stop 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 shutdown_connections 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f47b006be60 0x7f47b006e320 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d015a870 0x7f47d015be30 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47d00af3d0 0x7f47d015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 --2- 172.21.15.79:0/3780478768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47d00aef70 0x7f47d0147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 >> 172.21.15.79:0/3780478768 conn(0x7f47d00b19f0 msgr2=0x7f47d00b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 shutdown_connections 2024-06-10T00:24:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:47.771+0000 7f47d4ed4640 1 -- 172.21.15.79:0/3780478768 wait complete. 2024-06-10T00:24:47.781 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:24:47.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:47.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:47.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[75408]: fuse finished with error 0 and tester_r 0 2024-06-10T00:24:47.806 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:24:47.881 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:24:47.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:47.882 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:24:47.897 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:47.898 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:47.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:24:47.954 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi079.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:47.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:24:47.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:47.954 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:24:48.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:24:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-10T00:24:48.010 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:24:48.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.152+0000 7fa080283640 1 Processor -- start 2024-06-10T00:24:48.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.153+0000 7fa080283640 1 -- start start 2024-06-10T00:24:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.153+0000 7fa080283640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0780d2680 0x7fa07815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.153+0000 7fa080283640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0780cef70 0x7fa0780cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.153+0000 7fa080283640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0780d0ad0 con 0x7fa0780d1fc0 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.153+0000 7fa080283640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa0780d13e0 con 0x7fa0780cef70 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.153+0000 7fa080283640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa07815f890 con 0x7fa0780d2680 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.154+0000 7fa07e820640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0780cef70 0x7fa0780cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.154+0000 7fa07e820640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0780cef70 0x7fa0780cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38618/0 (socket says 172.21.15.79:38618) 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.154+0000 7fa07e820640 1 -- 172.21.15.79:0/191615474 learned_addr learned my addr 172.21.15.79:0/191615474 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.154+0000 7fa07e820640 1 -- 172.21.15.79:0/191615474 >> v2:172.21.15.117:3300/0 conn(0x7fa0780d2680 msgr2=0x7fa07815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.154+0000 7fa07e820640 1 --2- 172.21.15.79:0/191615474 >> v2:172.21.15.117:3300/0 conn(0x7fa0780d2680 0x7fa07815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.154+0000 7fa07e820640 1 -- 172.21.15.79:0/191615474 >> v1:172.21.15.117:6789/0 conn(0x7fa0780d1fc0 legacy=0x7fa0780d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:48.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.154+0000 7fa07e820640 1 -- 172.21.15.79:0/191615474 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0780d0d90 con 0x7fa0780cef70 2024-06-10T00:24:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa07e820640 1 --2- 172.21.15.79:0/191615474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa0780cf3c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fa0780d1560 tx=0x7fa07002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c8ea62d004d414 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa07d01d640 1 -- 172.21.15.79:0/191615474 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070036070 con 0x7fa0780cef70 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa07d01d640 1 -- 172.21.15.79:0/191615474 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070031600 con 0x7fa0780cef70 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa07d01d640 1 -- 172.21.15.79:0/191615474 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0700319d0 con 0x7fa0780cef70 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa080283640 1 -- 172.21.15.79:0/191615474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 msgr2=0x7fa0780cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa080283640 1 --2- 172.21.15.79:0/191615474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa0780cf3c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fa0780d1560 tx=0x7fa07002a6d0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa080283640 1 -- 172.21.15.79:0/191615474 shutdown_connections 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa080283640 1 --2- 172.21.15.79:0/191615474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa0780cf3c0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa080283640 1 --2- 172.21.15.79:0/191615474 >> v2:172.21.15.117:3300/0 conn(0x7fa0780d2680 0x7fa07815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa080283640 1 -- 172.21.15.79:0/191615474 >> 172.21.15.79:0/191615474 conn(0x7fa07809d3f0 msgr2=0x7fa0780d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa080283640 1 -- 172.21.15.79:0/191615474 shutdown_connections 2024-06-10T00:24:48.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.155+0000 7fa080283640 1 -- 172.21.15.79:0/191615474 wait complete. 2024-06-10T00:24:48.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.156+0000 7fa080283640 1 Processor -- start 2024-06-10T00:24:48.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa080283640 1 -- start start 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa080283640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa07815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa080283640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0780d1fc0 0x7fa0780c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa080283640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0780d2680 0x7fa0780cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa080283640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780d4f00 con 0x7fa0780cef70 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa080283640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780d2400 con 0x7fa0780d2680 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa080283640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0780d1870 con 0x7fa0780d1fc0 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa07e01f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa07815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa07e01f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa07815d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38622/0 (socket says 172.21.15.79:38622) 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.157+0000 7fa07e01f640 1 -- 172.21.15.79:0/314509353 learned_addr learned my addr 172.21.15.79:0/314509353 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa07e01f640 1 -- 172.21.15.79:0/314509353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0780d1fc0 msgr2=0x7fa0780c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa07e01f640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0780d1fc0 0x7fa0780c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa07e01f640 1 -- 172.21.15.79:0/314509353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0780d2680 msgr2=0x7fa0780cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa07e01f640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0780d2680 0x7fa0780cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa07e01f640 1 -- 172.21.15.79:0/314509353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07815c080 con 0x7fa0780cef70 2024-06-10T00:24:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa07e01f640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa07815d2d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fa06800b410 tx=0x7fa06800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa076ffd640 1 -- 172.21.15.79:0/314509353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068015020 con 0x7fa0780cef70 2024-06-10T00:24:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa076ffd640 1 -- 172.21.15.79:0/314509353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa068011850 con 0x7fa0780cef70 2024-06-10T00:24:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07815c7f0 con 0x7fa0780cef70 2024-06-10T00:24:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa076ffd640 1 -- 172.21.15.79:0/314509353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068011c40 con 0x7fa0780cef70 2024-06-10T00:24:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.158+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0780c8780 con 0x7fa0780cef70 2024-06-10T00:24:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.159+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa078068430 con 0x7fa0780cef70 2024-06-10T00:24:48.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.159+0000 7fa076ffd640 1 -- 172.21.15.79:0/314509353 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa068018020 con 0x7fa0780cef70 2024-06-10T00:24:48.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.160+0000 7fa076ffd640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa06406be30 0x7fa06406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.160+0000 7fa076ffd640 1 -- 172.21.15.79:0/314509353 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7fa06808af00 con 0x7fa0780cef70 2024-06-10T00:24:48.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.160+0000 7fa07d81e640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa06406be30 0x7fa06406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.160+0000 7fa07d81e640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa06406be30 0x7fa06406e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa0780cd040 tx=0x7fa06c007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.164+0000 7fa076ffd640 1 -- 172.21.15.79:0/314509353 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa06801f020 con 0x7fa0780cef70 2024-06-10T00:24:48.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.373+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa0780d04e0 con 0x7fa0780cef70 2024-06-10T00:24:48.373 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:24:48.374+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:24:48.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.377+0000 7fa076ffd640 1 -- 172.21.15.79:0/314509353 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) ==== 161+0+0 (secure 0 0 0) 0x7fa0680172c0 con 0x7fa0780cef70 2024-06-10T00:24:48.377 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:24:48.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.380+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa06406be30 msgr2=0x7fa06406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.380+0000 7fa080283640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa06406be30 0x7fa06406e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa0780cd040 tx=0x7fa06c007990 comp rx=0 tx=0).stop 2024-06-10T00:24:48.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.380+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 msgr2=0x7fa07815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.380+0000 7fa080283640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa07815d2d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fa06800b410 tx=0x7fa06800b8d0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.381+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 shutdown_connections 2024-06-10T00:24:48.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.381+0000 7fa080283640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa06406be30 0x7fa06406e2f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.381+0000 7fa080283640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0780d2680 0x7fa0780cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.381+0000 7fa080283640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0780d1fc0 0x7fa0780c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.381+0000 7fa080283640 1 --2- 172.21.15.79:0/314509353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0780cef70 0x7fa07815d2d0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.381+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 >> 172.21.15.79:0/314509353 conn(0x7fa07809d3f0 msgr2=0x7fa078158490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:48.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.381+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 shutdown_connections 2024-06-10T00:24:48.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.381+0000 7fa080283640 1 -- 172.21.15.79:0/314509353 wait complete. 2024-06-10T00:24:48.381 INFO:tasks.ceph.mds.a.smithi079.stderr: -8685> 2024-06-10T00:24:20.702+0000 7fa5c4406640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-06-10T00:24:48.383 INFO:tasks.ceph.mds.a.smithi079.stderr: -7369> 2024-06-10T00:24:36.032+0000 7fa5be3fa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:24:48.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:24:48.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:24:48.415 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:24:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-06-10T00:24:48.439 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-06-10T00:24:48.439 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:24:48.439 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-06-10T00:24:48.439 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.439 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-06-10T00:24:48.439 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:24:48.440 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:24:48.441 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-06-10T00:24:48.443 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-06-10T00:24:48.444 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:24:48.445 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.446 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:24:48.447 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.448 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-06-10T00:24:48.449 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-06-10T00:24:48.450 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = False 2024-06-10T00:24:48.451 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:24:48.451 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:24:48.451 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:24:48.451 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-06-10T00:24:48.451 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-06-10T00:24:48.451 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.452 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-06-10T00:24:48.453 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-06-10T00:24:48.454 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-06-10T00:24:48.455 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.456 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-06-10T00:24:48.457 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:24:48.458 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-06-10T00:24:48.459 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:24:48.460 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-06-10T00:24:48.460 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-06-10T00:24:48.460 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:24:48.462 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.462 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:24:48.462 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-06-10T00:24:48.463 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-06-10T00:24:48.464 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-06-10T00:24:48.465 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = False 2024-06-10T00:24:48.466 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:24:48.466 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:24:48.466 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:24:48.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:24:48.510 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-06-10T00:24:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-06-10T00:24:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-06-10T00:24:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:24:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2024-06-10T00:24:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-06-10T00:24:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-06-10T00:24:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:24:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-06-10T00:24:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = False 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = False 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:24:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-06-10T00:24:48.563 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.564 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-06-10T00:24:48.565 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.566 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-06-10T00:24:48.567 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-06-10T00:24:48.568 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-06-10T00:24:48.569 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-06-10T00:24:48.570 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-06-10T00:24:48.571 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:24:48.572 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:24:48.573 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-06-10T00:24:48.574 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = False 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = False 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:24:48.575 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:24:48.577 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-06-10T00:24:48.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.660+0000 7fd9acf1df40 1 Processor -- start 2024-06-10T00:24:48.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.660+0000 7fd9acf1df40 1 -- start start 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9acf1df40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9acf1df40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e63fe43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9acf1df40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562e640b8b50 0x562e63fe4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9acf1df40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562e6402bfd0 con 0x562e63fe04f0 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9acf1df40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562e63f89e30 con 0x562e640b7930 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9acf1df40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562e63fe0e40 con 0x562e640b8b50 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38650/0 (socket says 172.21.15.79:38650) 2024-06-10T00:24:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 -- 172.21.15.79:0/513688181 learned_addr learned my addr 172.21.15.79:0/513688181 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 -- 172.21.15.79:0/513688181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562e640b8b50 msgr2=0x562e63fe4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a3fff640 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e63fe43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562e640b8b50 0x562e63fe4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 -- 172.21.15.79:0/513688181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 msgr2=0x562e63fe43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e63fe43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 -- 172.21.15.79:0/513688181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e63f0ecb0 con 0x562e63fe04f0 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a3fff640 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e63fe43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a9f6f640 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b4f10 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd99c002de0 tx=0x7fd99c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede75f722abcb31e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a8f6d640 1 -- 172.21.15.79:0/513688181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00f400 con 0x562e63fe04f0 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a8f6d640 1 -- 172.21.15.79:0/513688181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99c014070 con 0x562e63fe04f0 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.661+0000 7fd9a8f6d640 1 -- 172.21.15.79:0/513688181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00f7e0 con 0x562e63fe04f0 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 -- 172.21.15.79:0/513688181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 msgr2=0x562e640b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b4f10 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd99c002de0 tx=0x7fd99c00b5b0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 -- 172.21.15.79:0/513688181 shutdown_connections 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562e640b8b50 0x562e63fe4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e63fe43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 --2- 172.21.15.79:0/513688181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b4f10 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 -- 172.21.15.79:0/513688181 >> 172.21.15.79:0/513688181 conn(0x562e63fe1a40 msgr2=0x562e63fe1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 -- 172.21.15.79:0/513688181 shutdown_connections 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 -- 172.21.15.79:0/513688181 wait complete. 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.662+0000 7fd9acf1df40 1 Processor -- start 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9acf1df40 1 -- start start 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9acf1df40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9acf1df40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e640abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9acf1df40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562e640b8b50 0x562e640ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9acf1df40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562e640b5450 con 0x562e63fe04f0 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9acf1df40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562e640ba5f0 con 0x562e640b7930 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9acf1df40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562e6402ac30 con 0x562e640b8b50 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9a9f6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9a9f6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38664/0 (socket says 172.21.15.79:38664) 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9a9f6f640 1 -- 172.21.15.79:0/430843218 learned_addr learned my addr 172.21.15.79:0/430843218 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9a3fff640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e640abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.663+0000 7fd9aa770640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562e640b8b50 0x562e640ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a9f6f640 1 -- 172.21.15.79:0/430843218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562e640b8b50 msgr2=0x562e640ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a9f6f640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562e640b8b50 0x562e640ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a9f6f640 1 -- 172.21.15.79:0/430843218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 msgr2=0x562e640abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a9f6f640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e640abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a9f6f640 1 -- 172.21.15.79:0/430843218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e640b3d80 con 0x562e63fe04f0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a3fff640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e640b7930 0x562e640abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a9f6f640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b9700 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00bab0 tx=0x7fd99c001fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/430843218 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c019680 con 0x562e63fe04f0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/430843218 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99c019820 con 0x562e63fe04f0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e640b9c40 con 0x562e63fe04f0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/430843218 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c019c10 con 0x562e63fe04f0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.664+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e640b4020 con 0x562e63fe04f0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.665+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/430843218 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd99c00e070 con 0x562e63fe04f0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.666+0000 7fd9a2ffd640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd98c06a810 0x7fd98c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.666+0000 7fd9a2ffd640 1 -- 172.21.15.79:0/430843218 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fd99c08b850 con 0x562e63fe04f0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.666+0000 7fd9a3fff640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd98c06a810 0x7fd98c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.666+0000 7fd9acf1df40 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x562e640b1a80 0x562e640aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.666+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x562e640af130 con 0x562e640b1a80 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.666+0000 7fd9aa770640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x562e640b1a80 0x562e640aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.666+0000 7fd9a3fff640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd98c06a810 0x7fd98c06ccd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd994057000 tx=0x7fd994052000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.666+0000 7fd9aa770640 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x562e640b1a80 0x562e640aebf0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9aa770640 1 -- 172.21.15.79:0/430843218 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v120'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd9a400d6a0 con 0x562e640b1a80 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x562e640b1a80 msgr2=0x562e640aebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x562e640b1a80 0x562e640aebf0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd98c06a810 msgr2=0x7fd98c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd98c06a810 0x7fd98c06ccd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd994057000 tx=0x7fd994052000 comp rx=0 tx=0).stop 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 msgr2=0x562e640b9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 --2- 172.21.15.79:0/430843218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e63fe04f0 0x562e640b9700 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00bab0 tx=0x7fd99c001fe0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9aa770640 1 -- 172.21.15.79:0/430843218 reap_dead start 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 shutdown_connections 2024-06-10T00:24:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 >> 172.21.15.79:0/430843218 conn(0x562e63fe1a40 msgr2=0x562e63fe1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:48.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 shutdown_connections 2024-06-10T00:24:48.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.668+0000 7fd9acf1df40 1 -- 172.21.15.79:0/430843218 wait complete. 2024-06-10T00:24:48.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-06-10T00:24:48.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.818+0000 7f433c08c640 1 Processor -- start 2024-06-10T00:24:48.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.818+0000 7f433c08c640 1 -- start start 2024-06-10T00:24:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f433c08c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43340d0020 0x7f43340d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f433c08c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4334155700 con 0x7f433406e1f0 2024-06-10T00:24:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f433c08c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f433415b6b0 con 0x7f4334155320 2024-06-10T00:24:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f433c08c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f43340d09c0 con 0x7f43340d0020 2024-06-10T00:24:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f433a629640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f433406e1f0 0x7f433406e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44222/0 (socket says 172.21.15.79:44222) 2024-06-10T00:24:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f433a629640 1 -- 172.21.15.79:0/3383980564 learned_addr learned my addr 172.21.15.79:0/3383980564 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4339627640 1 --2- 172.21.15.79:0/3383980564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43340d0020 0x7f43340d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4338e26640 1 -- 172.21.15.79:0/3383980564 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363808469 0 0) 0x7f4334155700 con 0x7f433406e1f0 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4338e26640 1 -- 172.21.15.79:0/3383980564 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4320005730 con 0x7f433406e1f0 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4338e26640 1 -- 172.21.15.79:0/3383980564 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101358530 0 0) 0x7f433415b6b0 con 0x7f4334155320 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4338e26640 1 -- 172.21.15.79:0/3383980564 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4334155700 con 0x7f4334155320 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4339627640 1 -- 172.21.15.79:0/3383980564 >> v1:172.21.15.117:6789/0 conn(0x7f4334155320 legacy=0x7f43340b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4339627640 1 -- 172.21.15.79:0/3383980564 >> v1:172.21.15.79:6789/0 conn(0x7f433406e1f0 legacy=0x7f433406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4338e26640 1 -- 172.21.15.79:0/3383980564 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016126072 0 0) 0x7f4320005730 con 0x7f433406e1f0 2024-06-10T00:24:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.819+0000 7f4339627640 1 -- 172.21.15.79:0/3383980564 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433415b990 con 0x7f43340d0020 2024-06-10T00:24:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.820+0000 7f4339627640 1 --2- 172.21.15.79:0/3383980564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43340d0020 0x7f43340d0480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f43240097d0 tx=0x7f432402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b852a9de94d4c013 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.820+0000 7f4338e26640 1 -- 172.21.15.79:0/3383980564 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324037070 con 0x7f43340d0020 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.820+0000 7f4338e26640 1 -- 172.21.15.79:0/3383980564 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432402ac30 con 0x7f43340d0020 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.820+0000 7f4338e26640 1 -- 172.21.15.79:0/3383980564 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c0019f0 con 0x7f43340d0020 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.821+0000 7f433c08c640 1 -- 172.21.15.79:0/3383980564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43340d0020 msgr2=0x7f43340d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.821+0000 7f433c08c640 1 --2- 172.21.15.79:0/3383980564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43340d0020 0x7f43340d0480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f43240097d0 tx=0x7f432402a1a0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.821+0000 7f433c08c640 1 -- 172.21.15.79:0/3383980564 shutdown_connections 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.821+0000 7f433c08c640 1 --2- 172.21.15.79:0/3383980564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43340d0020 0x7f43340d0480 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.821+0000 7f433c08c640 1 -- 172.21.15.79:0/3383980564 >> 172.21.15.79:0/3383980564 conn(0x7f43340b1d10 msgr2=0x7f43340b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.821+0000 7f433c08c640 1 -- 172.21.15.79:0/3383980564 shutdown_connections 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.821+0000 7f433c08c640 1 -- 172.21.15.79:0/3383980564 wait complete. 2024-06-10T00:24:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.822+0000 7f433c08c640 1 Processor -- start 2024-06-10T00:24:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.822+0000 7f433c08c640 1 -- start start 2024-06-10T00:24:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f433c08c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433406e1f0 0x7f43340cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f433c08c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43340d0020 0x7f4334072060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f433c08c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4334155320 0x7f43340725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f433c08c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f433415b2f0 con 0x7f433406e1f0 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f433c08c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f433415bf50 con 0x7f43340d0020 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f433c08c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f433415b470 con 0x7f4334155320 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433406e1f0 0x7f43340cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433406e1f0 0x7f43340cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38672/0 (socket says 172.21.15.79:38672) 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 -- 172.21.15.79:0/2878764055 learned_addr learned my addr 172.21.15.79:0/2878764055 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f433a629640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4334155320 0x7f43340725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339627640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43340d0020 0x7f4334072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 -- 172.21.15.79:0/2878764055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4334155320 msgr2=0x7f43340725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4334155320 0x7f43340725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 -- 172.21.15.79:0/2878764055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43340d0020 msgr2=0x7f4334072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43340d0020 0x7f4334072060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 -- 172.21.15.79:0/2878764055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4334159aa0 con 0x7f433406e1f0 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.823+0000 7f4339e28640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433406e1f0 0x7f43340cd020 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f433000c430 tx=0x7f433000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.824+0000 7f432a7fc640 1 -- 172.21.15.79:0/2878764055 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330017070 con 0x7f433406e1f0 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.824+0000 7f432a7fc640 1 -- 172.21.15.79:0/2878764055 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43300052f0 con 0x7f433406e1f0 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.824+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4334159d80 con 0x7f433406e1f0 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.824+0000 7f432a7fc640 1 -- 172.21.15.79:0/2878764055 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330003830 con 0x7f433406e1f0 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.824+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f433415a340 con 0x7f433406e1f0 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.825+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43340683c0 con 0x7f433406e1f0 2024-06-10T00:24:48.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.825+0000 7f432a7fc640 1 -- 172.21.15.79:0/2878764055 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f433001a070 con 0x7f433406e1f0 2024-06-10T00:24:48.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.826+0000 7f432a7fc640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f431806be30 0x7f431806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:48.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.826+0000 7f432a7fc640 1 -- 172.21.15.79:0/2878764055 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f433008a360 con 0x7f433406e1f0 2024-06-10T00:24:48.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.826+0000 7f4339627640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f431806be30 0x7f431806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:48.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.826+0000 7f4339627640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f431806be30 0x7f431806e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4324034000 tx=0x7f432402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:48.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:48.830+0000 7f432a7fc640 1 -- 172.21.15.79:0/2878764055 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4330058570 con 0x7f433406e1f0 2024-06-10T00:24:49.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.042+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f43340cf640 con 0x7f433406e1f0 2024-06-10T00:24:49.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.380+0000 7f432a7fc640 1 -- 172.21.15.79:0/2878764055 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v85) ==== 162+0+0 (secure 0 0 0) 0x7f433005c870 con 0x7f433406e1f0 2024-06-10T00:24:49.381 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f431806be30 msgr2=0x7f431806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f431806be30 0x7f431806e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4324034000 tx=0x7f432402e000 comp rx=0 tx=0).stop 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433406e1f0 msgr2=0x7f43340cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433406e1f0 0x7f43340cd020 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f433000c430 tx=0x7f433000c8f0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 shutdown_connections 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f431806be30 0x7f431806e2f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4334155320 0x7f43340725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43340d0020 0x7f4334072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 --2- 172.21.15.79:0/2878764055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433406e1f0 0x7f43340cd020 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 >> 172.21.15.79:0/2878764055 conn(0x7f43340b1d10 msgr2=0x7f43340b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:49.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 shutdown_connections 2024-06-10T00:24:49.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.383+0000 7f433c08c640 1 -- 172.21.15.79:0/2878764055 wait complete. 2024-06-10T00:24:49.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:49.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.496+0000 7f382a942640 1 Processor -- start 2024-06-10T00:24:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.496+0000 7f382a942640 1 -- start start 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f382a942640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38241553c0 0x7f38240cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f382a942640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38240b31a0 con 0x7f38240b2cf0 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f382a942640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38240b3420 con 0x7f38240cec50 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f382a942640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f38240cc750 con 0x7f38241553c0 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f3823fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38241553c0 0x7f38240cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f38237fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f38240b2cf0 0x7f382415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44226/0 (socket says 172.21.15.79:44226) 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f38237fe640 1 -- 172.21.15.79:0/4153564664 learned_addr learned my addr 172.21.15.79:0/4153564664 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f3823fff640 1 -- 172.21.15.79:0/4153564664 >> v1:172.21.15.117:6789/0 conn(0x7f38240cec50 legacy=0x7f3824071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f3823fff640 1 -- 172.21.15.79:0/4153564664 >> v1:172.21.15.79:6789/0 conn(0x7f38240b2cf0 legacy=0x7f382415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:49.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.497+0000 7f3823fff640 1 -- 172.21.15.79:0/4153564664 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38240cca30 con 0x7f38241553c0 2024-06-10T00:24:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f3823fff640 1 --2- 172.21.15.79:0/4153564664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240cd230 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f38140097d0 tx=0x7f381402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4524370704a1ca8b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f3822ffd640 1 -- 172.21.15.79:0/4153564664 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814037070 con 0x7f38241553c0 2024-06-10T00:24:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f3822ffd640 1 -- 172.21.15.79:0/4153564664 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3814032440 con 0x7f38241553c0 2024-06-10T00:24:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f3822ffd640 1 -- 172.21.15.79:0/4153564664 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814032810 con 0x7f38241553c0 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f382a942640 1 -- 172.21.15.79:0/4153564664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 msgr2=0x7f38240cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f382a942640 1 --2- 172.21.15.79:0/4153564664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240cd230 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f38140097d0 tx=0x7f381402a210 comp rx=0 tx=0).stop 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f382a942640 1 -- 172.21.15.79:0/4153564664 shutdown_connections 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f382a942640 1 --2- 172.21.15.79:0/4153564664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240cd230 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.498+0000 7f382a942640 1 -- 172.21.15.79:0/4153564664 >> 172.21.15.79:0/4153564664 conn(0x7f38240b19f0 msgr2=0x7f38240b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.499+0000 7f382a942640 1 -- 172.21.15.79:0/4153564664 shutdown_connections 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.499+0000 7f382a942640 1 -- 172.21.15.79:0/4153564664 wait complete. 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.500+0000 7f382a942640 1 Processor -- start 2024-06-10T00:24:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.500+0000 7f382a942640 1 -- start start 2024-06-10T00:24:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.500+0000 7f382a942640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38240b2cf0 0x7f382409bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.500+0000 7f382a942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38240cec50 0x7f3824148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.500+0000 7f382a942640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f382a942640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38241557a0 con 0x7f38241553c0 2024-06-10T00:24:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f382a942640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38240b3700 con 0x7f38240b2cf0 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f382a942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3824155920 con 0x7f38240cec50 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240ad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38700/0 (socket says 172.21.15.79:38700) 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 -- 172.21.15.79:0/1955042652 learned_addr learned my addr 172.21.15.79:0/1955042652 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3823fff640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38240b2cf0 0x7f382409bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f38237fe640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38240cec50 0x7f3824148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 -- 172.21.15.79:0/1955042652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38240cec50 msgr2=0x7f3824148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38240cec50 0x7f3824148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 -- 172.21.15.79:0/1955042652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38240b2cf0 msgr2=0x7f382409bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38240b2cf0 0x7f382409bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 -- 172.21.15.79:0/1955042652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382409aab0 con 0x7f38241553c0 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3828edf640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240ad7e0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f381c00c780 tx=0x7f381c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3820ff9640 1 -- 172.21.15.79:0/1955042652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c004b60 con 0x7f38241553c0 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3820ff9640 1 -- 172.21.15.79:0/1955042652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381c004d00 con 0x7f38241553c0 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382409ad90 con 0x7f38241553c0 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f3820ff9640 1 -- 172.21.15.79:0/1955042652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c00aa90 con 0x7f38241553c0 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.501+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382409b350 con 0x7f38241553c0 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.502+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3824068430 con 0x7f38241553c0 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.503+0000 7f3820ff9640 1 -- 172.21.15.79:0/1955042652 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f381c00ac30 con 0x7f38241553c0 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.504+0000 7f3820ff9640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f380406be30 0x7f380406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.504+0000 7f3823fff640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f380406be30 0x7f380406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.504+0000 7f3820ff9640 1 -- 172.21.15.79:0/1955042652 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f381c08b420 con 0x7f38241553c0 2024-06-10T00:24:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.504+0000 7f3823fff640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f380406be30 0x7f380406e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3814034000 tx=0x7f381402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.508+0000 7f3820ff9640 1 -- 172.21.15.79:0/1955042652 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f381c059630 con 0x7f38241553c0 2024-06-10T00:24:49.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.717+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3824075430 con 0x7f38241553c0 2024-06-10T00:24:49.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.718+0000 7f3820ff9640 1 -- 172.21.15.79:0/1955042652 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5184 (secure 0 0 0) 0x7f381c05d930 con 0x7f38241553c0 2024-06-10T00:24:49.717 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:49.718 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:24:49.383683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8556":{"gid":8556,"name":"a","rank":0,"incarnation":86,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/1367694301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1367694301},{"type":"v1","addr":"172.21.15.79:6837","nonce":1367694301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-06-10T00:24:49.718 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 86 2024-06-10T00:24:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f380406be30 msgr2=0x7f380406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f380406be30 0x7f380406e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3814034000 tx=0x7f381402e000 comp rx=0 tx=0).stop 2024-06-10T00:24:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 msgr2=0x7f38240ad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240ad7e0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f381c00c780 tx=0x7f381c00cc40 comp rx=0 tx=0).stop 2024-06-10T00:24:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 shutdown_connections 2024-06-10T00:24:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f380406be30 0x7f380406e2f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38241553c0 0x7f38240ad7e0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38240cec50 0x7f3824148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 --2- 172.21.15.79:0/1955042652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38240b2cf0 0x7f382409bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 >> 172.21.15.79:0/1955042652 conn(0x7f38240b19f0 msgr2=0x7f3824153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 shutdown_connections 2024-06-10T00:24:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:49.720+0000 7f382a942640 1 -- 172.21.15.79:0/1955042652 wait complete. 2024-06-10T00:24:50.134 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:24:30.408817+0000', 'modified': '2024-06-10T00:24:49.383683+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8556}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8556': {'gid': 8556, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/1367694301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 1367694301}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 1367694301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:24:50.134 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8556:up:replay 2024-06-10T00:24:51.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:51.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.248+0000 7fb711d29640 1 Processor -- start 2024-06-10T00:24:51.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.248+0000 7fb711d29640 1 -- start start 2024-06-10T00:24:51.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.249+0000 7fb711d29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:51.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.249+0000 7fb711d29640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb70c071c60 0x7fb70c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:51.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.249+0000 7fb711d29640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb70c0ccff0 con 0x7fb70c0b36c0 2024-06-10T00:24:51.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.249+0000 7fb711d29640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb70c072820 con 0x7fb70c071c60 2024-06-10T00:24:51.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.249+0000 7fb711d29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c072b00 con 0x7fb70c0cc6d0 2024-06-10T00:24:51.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb70c071c60 0x7fb70c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb70c071c60 0x7fb70c0720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:44912/0 (socket says 172.21.15.79:44912) 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:50996/0 (socket says 172.21.15.79:50996) 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70bfff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb70c0b36c0 0x7fb70c0b3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:44814/0 (socket says 172.21.15.79:44814) 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70affd640 1 -- 172.21.15.79:0/654238676 learned_addr learned my addr 172.21.15.79:0/654238676 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70affd640 1 -- 172.21.15.79:0/654238676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 msgr2=0x7fb70c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70affd640 1 --2- 172.21.15.79:0/654238676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70affd640 1 -- 172.21.15.79:0/654238676 >> v1:172.21.15.117:6789/0 conn(0x7fb70c0b36c0 legacy=0x7fb70c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70affd640 1 -- 172.21.15.79:0/654238676 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c072de0 con 0x7fb70c071c60 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.250+0000 7fb70b7fe640 1 --2- 172.21.15.79:0/654238676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.251+0000 7fb70affd640 1 --2- 172.21.15.79:0/654238676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 0x7fb70c0720e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb700009870 tx=0x7fb70002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e213f4d490113cf6 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.251+0000 7fb70a7fc640 1 -- 172.21.15.79:0/654238676 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700037070 con 0x7fb70c071c60 2024-06-10T00:24:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.251+0000 7fb70a7fc640 1 -- 172.21.15.79:0/654238676 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb700032440 con 0x7fb70c071c60 2024-06-10T00:24:51.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.251+0000 7fb70a7fc640 1 -- 172.21.15.79:0/654238676 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700032810 con 0x7fb70c071c60 2024-06-10T00:24:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.252+0000 7fb711d29640 1 -- 172.21.15.79:0/654238676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 msgr2=0x7fb70c0720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.252+0000 7fb711d29640 1 --2- 172.21.15.79:0/654238676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 0x7fb70c0720e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb700009870 tx=0x7fb70002a250 comp rx=0 tx=0).stop 2024-06-10T00:24:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.252+0000 7fb711d29640 1 -- 172.21.15.79:0/654238676 shutdown_connections 2024-06-10T00:24:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.252+0000 7fb711d29640 1 --2- 172.21.15.79:0/654238676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 0x7fb70c0720e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.252+0000 7fb711d29640 1 --2- 172.21.15.79:0/654238676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.252+0000 7fb711d29640 1 -- 172.21.15.79:0/654238676 >> 172.21.15.79:0/654238676 conn(0x7fb70c0b19f0 msgr2=0x7fb70c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.252+0000 7fb711d29640 1 -- 172.21.15.79:0/654238676 shutdown_connections 2024-06-10T00:24:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.252+0000 7fb711d29640 1 -- 172.21.15.79:0/654238676 wait complete. 2024-06-10T00:24:51.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.253+0000 7fb711d29640 1 Processor -- start 2024-06-10T00:24:51.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.253+0000 7fb711d29640 1 -- start start 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb711d29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 0x7fb70c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb711d29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0b36c0 0x7fb70c14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb711d29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb711d29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c159f60 con 0x7fb70c0b36c0 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb711d29640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c15c890 con 0x7fb70c071c60 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb711d29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c0b4240 con 0x7fb70c0cc6d0 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0b36c0 0x7fb70c14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0b36c0 0x7fb70c14dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38702/0 (socket says 172.21.15.79:38702) 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 -- 172.21.15.79:0/2341455944 learned_addr learned my addr 172.21.15.79:0/2341455944 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70bfff640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70b7fe640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 0x7fb70c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 -- 172.21.15.79:0/2341455944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 msgr2=0x7fb70c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 -- 172.21.15.79:0/2341455944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 msgr2=0x7fb70c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 0x7fb70c15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 -- 172.21.15.79:0/2341455944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c153fd0 con 0x7fb70c0b36c0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.254+0000 7fb70affd640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0b36c0 0x7fb70c14dfa0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb700000c00 tx=0x7fb7000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.255+0000 7fb6f3fff640 1 -- 172.21.15.79:0/2341455944 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700037040 con 0x7fb70c0b36c0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.255+0000 7fb6f3fff640 1 -- 172.21.15.79:0/2341455944 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb700042070 con 0x7fb70c0b36c0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.255+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c155b60 con 0x7fb70c0b36c0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.255+0000 7fb6f3fff640 1 -- 172.21.15.79:0/2341455944 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700030860 con 0x7fb70c0b36c0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.255+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c156120 con 0x7fb70c0b36c0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.256+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c068430 con 0x7fb70c0b36c0 2024-06-10T00:24:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.256+0000 7fb6f3fff640 1 -- 172.21.15.79:0/2341455944 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb700030a00 con 0x7fb70c0b36c0 2024-06-10T00:24:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.256+0000 7fb6f3fff640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb6f806be30 0x7fb6f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.257+0000 7fb6f3fff640 1 -- 172.21.15.79:0/2341455944 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fb7000ab8e0 con 0x7fb70c0b36c0 2024-06-10T00:24:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.257+0000 7fb70b7fe640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb6f806be30 0x7fb6f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.257+0000 7fb70b7fe640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb6f806be30 0x7fb6f806e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009a30 tx=0x7fb6fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:51.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.261+0000 7fb6f3fff640 1 -- 172.21.15.79:0/2341455944 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb700045360 con 0x7fb70c0b36c0 2024-06-10T00:24:51.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.473+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb70c0cbd40 con 0x7fb70c0b36c0 2024-06-10T00:24:51.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.474+0000 7fb6f3fff640 1 -- 172.21.15.79:0/2341455944 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5184 (secure 0 0 0) 0x7fb70007a0b0 con 0x7fb70c0b36c0 2024-06-10T00:24:51.474 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:51.474 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:24:50.391459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8556":{"gid":8556,"name":"a","rank":0,"incarnation":86,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6837/1367694301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1367694301},{"type":"v1","addr":"172.21.15.79:6837","nonce":1367694301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-06-10T00:24:51.474 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb6f806be30 msgr2=0x7fb6f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb6f806be30 0x7fb6f806e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009a30 tx=0x7fb6fc008040 comp rx=0 tx=0).stop 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0b36c0 msgr2=0x7fb70c14dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0b36c0 0x7fb70c14dfa0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb700000c00 tx=0x7fb7000046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 shutdown_connections 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb6f806be30 0x7fb6f806e2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb70c0cc6d0 0x7fb70c06e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0b36c0 0x7fb70c14dfa0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 --2- 172.21.15.79:0/2341455944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c071c60 0x7fb70c15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:51.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 >> 172.21.15.79:0/2341455944 conn(0x7fb70c0b19f0 msgr2=0x7fb70c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:51.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 shutdown_connections 2024-06-10T00:24:51.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:51.476+0000 7fb711d29640 1 -- 172.21.15.79:0/2341455944 wait complete. 2024-06-10T00:24:51.889 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:24:30.408817+0000', 'modified': '2024-06-10T00:24:50.391459+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8556}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8556': {'gid': 8556, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6837/1367694301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 1367694301}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 1367694301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:24:51.889 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8556:up:rejoin 2024-06-10T00:24:52.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:24:53.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.003+0000 7fa2a6266640 1 Processor -- start 2024-06-10T00:24:53.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.003+0000 7fa2a6266640 1 -- start start 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa2a6266640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2a00d2680 0x7fa2a015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa2a6266640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 0x7fa2a00d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa2a6266640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a00d2fa0 con 0x7fa2a0161fa0 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa2a6266640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a00cff80 con 0x7fa2a00d2680 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa2a6266640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a00d13e0 con 0x7fa2a00d1fc0 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa29ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2a00d2680 0x7fa2a015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa29ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2a00d2680 0x7fa2a015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38710/0 (socket says 172.21.15.79:38710) 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa29ffff640 1 -- 172.21.15.79:0/3129144278 learned_addr learned my addr 172.21.15.79:0/3129144278 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa29f7fe640 1 --2- 172.21.15.79:0/3129144278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 0x7fa2a00d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa29ffff640 1 -- 172.21.15.79:0/3129144278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 msgr2=0x7fa2a00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa29ffff640 1 --2- 172.21.15.79:0/3129144278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 0x7fa2a00d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa29ffff640 1 -- 172.21.15.79:0/3129144278 >> v1:172.21.15.117:6789/0 conn(0x7fa2a0161fa0 legacy=0x7fa2a0162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.004+0000 7fa29ffff640 1 -- 172.21.15.79:0/3129144278 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a00d0ad0 con 0x7fa2a00d2680 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.005+0000 7fa29ffff640 1 --2- 172.21.15.79:0/3129144278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015f1a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa290009870 tx=0x7fa29002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afbf72f9c5415be server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.005+0000 7fa29effd640 1 -- 172.21.15.79:0/3129144278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa290037070 con 0x7fa2a00d2680 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.005+0000 7fa29effd640 1 -- 172.21.15.79:0/3129144278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa290032440 con 0x7fa2a00d2680 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.005+0000 7fa29effd640 1 -- 172.21.15.79:0/3129144278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa290032810 con 0x7fa2a00d2680 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.006+0000 7fa2a6266640 1 -- 172.21.15.79:0/3129144278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 msgr2=0x7fa2a015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.006+0000 7fa2a6266640 1 --2- 172.21.15.79:0/3129144278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015f1a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa290009870 tx=0x7fa29002a210 comp rx=0 tx=0).stop 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.006+0000 7fa2a6266640 1 -- 172.21.15.79:0/3129144278 shutdown_connections 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.006+0000 7fa2a6266640 1 --2- 172.21.15.79:0/3129144278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 0x7fa2a00d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.006+0000 7fa2a6266640 1 --2- 172.21.15.79:0/3129144278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015f1a0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.006+0000 7fa2a6266640 1 -- 172.21.15.79:0/3129144278 >> 172.21.15.79:0/3129144278 conn(0x7fa2a009d3f0 msgr2=0x7fa2a00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.006+0000 7fa2a6266640 1 -- 172.21.15.79:0/3129144278 shutdown_connections 2024-06-10T00:24:53.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.006+0000 7fa2a6266640 1 -- 172.21.15.79:0/3129144278 wait complete. 2024-06-10T00:24:53.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.007+0000 7fa2a6266640 1 Processor -- start 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.007+0000 7fa2a6266640 1 -- start start 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa2a6266640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 0x7fa2a015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa2a6266640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa2a6266640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a0161fa0 0x7fa2a009dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa2a6266640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a00d1070 con 0x7fa2a00d2680 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa2a6266640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a00d0d90 con 0x7fa2a0161fa0 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa2a6266640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a00d2400 con 0x7fa2a00d1fc0 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38722/0 (socket says 172.21.15.79:38722) 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 -- 172.21.15.79:0/2375371728 learned_addr learned my addr 172.21.15.79:0/2375371728 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 -- 172.21.15.79:0/2375371728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 msgr2=0x7fa2a015a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 0x7fa2a015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 -- 172.21.15.79:0/2375371728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a0161fa0 msgr2=0x7fa2a009dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa2a4803640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a0161fa0 0x7fa2a009dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a0161fa0 0x7fa2a009dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 -- 172.21.15.79:0/2375371728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a015c620 con 0x7fa2a00d2680 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.008+0000 7fa29f7fe640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015bbd0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c7f0 tx=0x7fa29400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.009+0000 7fa29cff9640 1 -- 172.21.15.79:0/2375371728 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294015070 con 0x7fa2a00d2680 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.009+0000 7fa29cff9640 1 -- 172.21.15.79:0/2375371728 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa294004240 con 0x7fa2a00d2680 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.009+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a015c900 con 0x7fa2a00d2680 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.009+0000 7fa29cff9640 1 -- 172.21.15.79:0/2375371728 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294007620 con 0x7fa2a00d2680 2024-06-10T00:24:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.009+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a015cec0 con 0x7fa2a00d2680 2024-06-10T00:24:53.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.010+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a0068430 con 0x7fa2a00d2680 2024-06-10T00:24:53.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.010+0000 7fa29cff9640 1 -- 172.21.15.79:0/2375371728 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2940079d0 con 0x7fa2a00d2680 2024-06-10T00:24:53.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.011+0000 7fa29cff9640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa28c06be30 0x7fa28c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.011+0000 7fa29cff9640 1 -- 172.21.15.79:0/2375371728 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fa29408b140 con 0x7fa2a00d2680 2024-06-10T00:24:53.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.011+0000 7fa29ffff640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa28c06be30 0x7fa28c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.011+0000 7fa29ffff640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa28c06be30 0x7fa28c06e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa290034000 tx=0x7fa29002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.015+0000 7fa29cff9640 1 -- 172.21.15.79:0/2375371728 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa294059910 con 0x7fa2a00d2680 2024-06-10T00:24:53.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.223+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2a00d04e0 con 0x7fa2a00d2680 2024-06-10T00:24:53.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.224+0000 7fa29cff9640 1 -- 172.21.15.79:0/2375371728 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5191 (secure 0 0 0) 0x7fa294059210 con 0x7fa2a00d2680 2024-06-10T00:24:53.224 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:24:53.224 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":89,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:24:52.394753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8556":{"gid":8556,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/1367694301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1367694301},{"type":"v1","addr":"172.21.15.79:6837","nonce":1367694301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8556,"qdb_cluster":[8556]},"id":8}]} 2024-06-10T00:24:53.224 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 89 2024-06-10T00:24:53.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa28c06be30 msgr2=0x7fa28c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa28c06be30 0x7fa28c06e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa290034000 tx=0x7fa29002c000 comp rx=0 tx=0).stop 2024-06-10T00:24:53.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 msgr2=0x7fa2a015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015bbd0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c7f0 tx=0x7fa29400ccb0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 shutdown_connections 2024-06-10T00:24:53.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa28c06be30 0x7fa28c06e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a0161fa0 0x7fa2a009dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2a00d2680 0x7fa2a015bbd0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 --2- 172.21.15.79:0/2375371728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a00d1fc0 0x7fa2a015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 >> 172.21.15.79:0/2375371728 conn(0x7fa2a009d3f0 msgr2=0x7fa2a0160410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 shutdown_connections 2024-06-10T00:24:53.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.226+0000 7fa2a6266640 1 -- 172.21.15.79:0/2375371728 wait complete. 2024-06-10T00:24:53.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:24:30.408817+0000', 'modified': '2024-06-10T00:24:52.394753+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8556}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8556': {'gid': 8556, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/1367694301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 1367694301}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 1367694301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8556, 'qdb_cluster': [8556]} 2024-06-10T00:24:53.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:24:53.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:24:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.741+0000 7f5e0c81c640 1 Processor -- start 2024-06-10T00:24:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.741+0000 7f5e0c81c640 1 -- start start 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e0c81c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080b46d0 0x7f5e08071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e0c81c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e080721a0 0x7f5e08165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e0c81c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e08072820 con 0x7f5e080cc6d0 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e0c81c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5e08072b00 con 0x7f5e080721a0 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e0c81c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5e08072de0 con 0x7f5e080b46d0 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e0659c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5e080cc6d0 0x7f5e080ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44236/0 (socket says 172.21.15.79:44236) 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e0659c640 1 -- 172.21.15.79:0/1521592037 learned_addr learned my addr 172.21.15.79:0/1521592037 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/1521592037 >> v2:172.21.15.79:3300/0 conn(0x7f5e080721a0 0x7f5e08165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e05d9b640 1 -- 172.21.15.79:0/1521592037 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2730986820 0 0) 0x7f5e08072820 con 0x7f5e080cc6d0 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e05d9b640 1 -- 172.21.15.79:0/1521592037 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df4003520 con 0x7f5e080cc6d0 2024-06-10T00:24:53.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/1521592037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080b46d0 0x7f5e08071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.742+0000 7f5e06d9d640 1 -- 172.21.15.79:0/1521592037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080b46d0 msgr2=0x7f5e08071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.743+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/1521592037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080b46d0 0x7f5e08071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.743+0000 7f5e06d9d640 1 -- 172.21.15.79:0/1521592037 >> v1:172.21.15.79:6789/0 conn(0x7f5e080cc6d0 legacy=0x7f5e080ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.743+0000 7f5e06d9d640 1 -- 172.21.15.79:0/1521592037 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080b31a0 con 0x7f5e080721a0 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.743+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/1521592037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080b46d0 0x7f5e08071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.743+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/1521592037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080721a0 0x7f5e08165c30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009d90 tx=0x7f5e0002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ee1a63b8568f25 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.743+0000 7f5e05d9b640 1 -- 172.21.15.79:0/1521592037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00007740 con 0x7f5e080721a0 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.743+0000 7f5e05d9b640 1 -- 172.21.15.79:0/1521592037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e000078e0 con 0x7f5e080721a0 2024-06-10T00:24:53.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.743+0000 7f5e05d9b640 1 -- 172.21.15.79:0/1521592037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00007cb0 con 0x7f5e080721a0 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.744+0000 7f5e0c81c640 1 -- 172.21.15.79:0/1521592037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080721a0 msgr2=0x7f5e08165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.744+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/1521592037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080721a0 0x7f5e08165c30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009d90 tx=0x7f5e0002a660 comp rx=0 tx=0).stop 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.744+0000 7f5e0c81c640 1 -- 172.21.15.79:0/1521592037 shutdown_connections 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.744+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/1521592037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080721a0 0x7f5e08165c30 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.744+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/1521592037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080b46d0 0x7f5e08071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.744+0000 7f5e0c81c640 1 -- 172.21.15.79:0/1521592037 >> 172.21.15.79:0/1521592037 conn(0x7f5e080b19f0 msgr2=0x7f5e080b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.744+0000 7f5e0c81c640 1 -- 172.21.15.79:0/1521592037 shutdown_connections 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.744+0000 7f5e0c81c640 1 -- 172.21.15.79:0/1521592037 wait complete. 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.745+0000 7f5e0c81c640 1 Processor -- start 2024-06-10T00:24:53.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.745+0000 7f5e0c81c640 1 -- start start 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5e0c81c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e080721a0 0x7f5e081f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5e0c81c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080b46d0 0x7f5e0814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5e0c81c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080cc6d0 0x7f5e0806e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5e0c81c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e08166170 con 0x7f5e080b46d0 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5e0c81c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e08159f60 con 0x7f5e080721a0 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5e0c81c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5e081662f0 con 0x7f5e080cc6d0 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5dfdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080b46d0 0x7f5e0814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5dfdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080b46d0 0x7f5e0814e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38732/0 (socket says 172.21.15.79:38732) 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5dfdd9b640 1 -- 172.21.15.79:0/3459975402 learned_addr learned my addr 172.21.15.79:0/3459975402 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5e0659c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e080721a0 0x7f5e081f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.746+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080cc6d0 0x7f5e0806e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dfdd9b640 1 -- 172.21.15.79:0/3459975402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080cc6d0 msgr2=0x7f5e0806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080cc6d0 0x7f5e0806e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dfdd9b640 1 -- 172.21.15.79:0/3459975402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e080721a0 msgr2=0x7f5e081f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e080721a0 0x7f5e081f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dfdd9b640 1 -- 172.21.15.79:0/3459975402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080b0d90 con 0x7f5e080b46d0 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080b46d0 0x7f5e0814e4a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c820 tx=0x7f5df000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dff7fe640 1 -- 172.21.15.79:0/3459975402 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0015070 con 0x7f5e080b46d0 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dff7fe640 1 -- 172.21.15.79:0/3459975402 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df0007a30 con 0x7f5e080b46d0 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5e0c81c640 1 -- 172.21.15.79:0/3459975402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e080b1070 con 0x7f5e080b46d0 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5dff7fe640 1 -- 172.21.15.79:0/3459975402 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0007e00 con 0x7f5e080b46d0 2024-06-10T00:24:53.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.747+0000 7f5e0c81c640 1 -- 172.21.15.79:0/3459975402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e08163fa0 con 0x7f5e080b46d0 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.748+0000 7f5dff7fe640 1 -- 172.21.15.79:0/3459975402 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5df0018070 con 0x7f5e080b46d0 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.749+0000 7f5dff7fe640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5de806be30 0x7f5de806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.749+0000 7f5dff7fe640 1 -- 172.21.15.79:0/3459975402 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f5df008b030 con 0x7f5e080b46d0 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.749+0000 7f5e0659c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5de806be30 0x7f5de806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.749+0000 7f5e0659c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5de806be30 0x7f5de806e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5df8005880 tx=0x7f5df8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.750+0000 7f5e0f607740 1 Processor -- start 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.750+0000 7f5e0f607740 1 -- start start 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b1b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b190e0 0x55ce31b1ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31aeb960 0x55ce31aef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5e0f607740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce31a54740 con 0x55ce31b190e0 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5e0f607740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ce319f2a80 con 0x55ce31aeb960 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5e0f607740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ce31a50700 con 0x55ce31b18d00 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b190e0 0x55ce31b1ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b190e0 0x55ce31b1ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38746/0 (socket says 172.21.15.79:38746) 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 -- 172.21.15.79:0/3557667697 learned_addr learned my addr 172.21.15.79:0/3557667697 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31aeb960 0x55ce31aef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5e0659c640 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b1b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 -- 172.21.15.79:0/3557667697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 msgr2=0x55ce31b1b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b1b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 -- 172.21.15.79:0/3557667697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31aeb960 msgr2=0x55ce31aef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31aeb960 0x55ce31aef170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 -- 172.21.15.79:0/3557667697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce31a1dfb0 con 0x55ce31b190e0 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b190e0 0x55ce31b1ba50 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f5df000a120 tx=0x7f5df0059100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d12ecec56dd801 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5de7fff640 1 -- 172.21.15.79:0/3557667697 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0071070 con 0x55ce31b190e0 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5de7fff640 1 -- 172.21.15.79:0/3557667697 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df0057400 con 0x55ce31b190e0 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.751+0000 7f5de7fff640 1 -- 172.21.15.79:0/3557667697 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df001f040 con 0x55ce31b190e0 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 -- 172.21.15.79:0/3557667697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b190e0 msgr2=0x55ce31b1ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b190e0 0x55ce31b1ba50 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f5df000a120 tx=0x7f5df0059100 comp rx=0 tx=0).stop 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 -- 172.21.15.79:0/3557667697 shutdown_connections 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31aeb960 0x55ce31aef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b190e0 0x55ce31b1ba50 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 --2- 172.21.15.79:0/3557667697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b1b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 -- 172.21.15.79:0/3557667697 >> 172.21.15.79:0/3557667697 conn(0x55ce31aedbd0 msgr2=0x55ce31b36510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 -- 172.21.15.79:0/3557667697 shutdown_connections 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.752+0000 7f5e0f607740 1 -- 172.21.15.79:0/3557667697 wait complete. 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.753+0000 7f5e0f607740 1 -- start start 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.753+0000 7f5e0f607740 1 Processor -- start 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b15e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 0x55ce31b393a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31b16ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce31af0d80 con 0x55ce31b398e0 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ce319ddc30 con 0x55ce31b190e0 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ce31af1060 con 0x55ce31b18d00 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 10 client.0 _ll_register_callbacks cb 0x55ce31a0f7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31b16ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31b16ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38756/0 (socket says 172.21.15.79:38756) 2024-06-10T00:24:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 -- 172.21.15.79:0/2406184594 learned_addr learned my addr 172.21.15.79:0/2406184594 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 0x55ce31b393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0659c640 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b15e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 -- 172.21.15.79:0/2406184594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 msgr2=0x55ce31b15e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b15e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 -- 172.21.15.79:0/2406184594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 msgr2=0x55ce31b393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 0x55ce31b393a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 -- 172.21.15.79:0/2406184594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce317682d0 con 0x55ce31b398e0 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31b16ae0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009d90 tx=0x7f5e00004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af15d464c82745b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5de57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5de57fa640 1 -- 172.21.15.79:0/2406184594 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00009450 con 0x55ce31b398e0 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5de57fa640 1 -- 172.21.15.79:0/2406184594 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f5e00046c80 con 0x55ce31b398e0 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 1 -- 172.21.15.79:0/2406184594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df0057400 con 0x55ce31b398e0 2024-06-10T00:24:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5de57fa640 1 -- 172.21.15.79:0/2406184594 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f5e00003990 con 0x55ce31b398e0 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 10 client.8604 fetch_fsmap learned FSMap version 89 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.754+0000 7f5e0f607740 1 -- 172.21.15.79:0/2406184594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55ce318326b0 con 0x55ce31b398e0 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5de57fa640 1 -- 172.21.15.79:0/2406184594 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df0057400 con 0x55ce31b398e0 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5de57fa640 1 -- 172.21.15.79:0/2406184594 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f5e00044070 con 0x55ce31b398e0 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5e0f607740 10 client.8604 fetch_fsmap finished waiting for FSMap version 89 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5e0f607740 10 client.8604 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5e0f607740 20 client.8604 populate_metadata read hostname 'smithi079' 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5e0f607740 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x55ce31b49f70 0x55ce31b1ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5e0f607740 4 client.8604 mds_command: new command op to 8556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5e0f607740 1 -- 172.21.15.79:0/2406184594 --> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce31a61e70 con 0x55ce31b49f70 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5e0659c640 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x55ce31b49f70 0x55ce31b1ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5e0659c640 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x55ce31b49f70 0x55ce31b1ced0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d391ee73d537b30a server_cookie=f0f242f39e4dbe2c in_seq=0 out_seq=0 2024-06-10T00:24:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.755+0000 7f5de57fa640 10 client.8604 ms_handle_connect on v2:172.21.15.79:6835/1367694301 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5de57fa640 1 -- 172.21.15.79:0/2406184594 <== mds.0 v2:172.21.15.79:6835/1367694301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ce31a61e70 con 0x55ce31b49f70 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5de57fa640 10 client.8604 handle_command_reply: tid=0 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 client.8604 shutdown 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 -- 172.21.15.79:0/2406184594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 msgr2=0x55ce31b16ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31b16ae0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009d90 tx=0x7f5e00004ab0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 -- 172.21.15.79:0/2406184594 shutdown_connections 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x55ce31b49f70 0x55ce31b1ced0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31b16ae0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 0x55ce31b393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 --2- 172.21.15.79:0/2406184594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b15e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5de57fa640 0 client.8604 ms_handle_reset on v2:172.21.15.79:6835/1367694301 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 -- 172.21.15.79:0/2406184594 >> 172.21.15.79:0/2406184594 conn(0x55ce31aeb960 msgr2=0x55ce31b340c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 -- 172.21.15.79:0/2406184594 shutdown_connections 2024-06-10T00:24:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 1 -- 172.21.15.79:0/2406184594 wait complete. 2024-06-10T00:24:53.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.756+0000 7f5e0f607740 20 client.8604 trim_cache size 0 max 16384 2024-06-10T00:24:53.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.775+0000 7f5e0f607740 1 Processor -- start 2024-06-10T00:24:53.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.775+0000 7f5e0f607740 1 -- start start 2024-06-10T00:24:53.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.775+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b18d00 0x55ce31b5a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.775+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b190e0 0x55ce31b39230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.775+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b398e0 0x55ce31b1ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.775+0000 7f5e0f607740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e081f7a90 con 0x55ce31b18d00 2024-06-10T00:24:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.775+0000 7f5e0f607740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0806d900 con 0x55ce31b398e0 2024-06-10T00:24:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.775+0000 7f5e0f607740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5e081f7440 con 0x55ce31b190e0 2024-06-10T00:24:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b18d00 0x55ce31b5a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b18d00 0x55ce31b5a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38758/0 (socket says 172.21.15.79:38758) 2024-06-10T00:24:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 -- 172.21.15.79:0/4029674218 learned_addr learned my addr 172.21.15.79:0/4029674218 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b398e0 0x55ce31b1ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b190e0 0x55ce31b39230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 -- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b190e0 msgr2=0x55ce31b39230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b190e0 0x55ce31b39230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 -- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b398e0 msgr2=0x55ce31b1ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b398e0 0x55ce31b1ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 -- 172.21.15.79:0/4029674218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce31b155f0 con 0x55ce31b18d00 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b190e0 0x55ce31b39230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b398e0 0x55ce31b1ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5e0659c640 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b18d00 0x55ce31b5a7b0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x55ce31b4a870 tx=0x7f5df8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43287d3521ef19b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5de77fe640 1 -- 172.21.15.79:0/4029674218 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8028040 con 0x55ce31b18d00 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5de77fe640 1 -- 172.21.15.79:0/4029674218 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df800e7b0 con 0x55ce31b18d00 2024-06-10T00:24:53.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.776+0000 7f5de77fe640 1 -- 172.21.15.79:0/4029674218 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df800e960 con 0x55ce31b18d00 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 -- 172.21.15.79:0/4029674218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b18d00 msgr2=0x55ce31b5a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b18d00 0x55ce31b5a7b0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x55ce31b4a870 tx=0x7f5df8011000 comp rx=0 tx=0).stop 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 -- 172.21.15.79:0/4029674218 shutdown_connections 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b398e0 0x55ce31b1ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b190e0 0x55ce31b39230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 --2- 172.21.15.79:0/4029674218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b18d00 0x55ce31b5a7b0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 -- 172.21.15.79:0/4029674218 >> 172.21.15.79:0/4029674218 conn(0x55ce31aeb960 msgr2=0x55ce31b36510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 -- 172.21.15.79:0/4029674218 shutdown_connections 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 -- 172.21.15.79:0/4029674218 wait complete. 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 -- start start 2024-06-10T00:24:53.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.777+0000 7f5e0f607740 1 Processor -- start 2024-06-10T00:24:53.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b37640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 0x55ce31b1d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e0f607740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31bb4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e0f607740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce31b1da50 con 0x55ce31b398e0 2024-06-10T00:24:53.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e0f607740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ce31b1c3c0 con 0x55ce31b190e0 2024-06-10T00:24:53.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e0f607740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ce31b4a410 con 0x55ce31b18d00 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e0f607740 10 client.0 _ll_register_callbacks cb 0x7f5e00007920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e06d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31bb4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e06d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31bb4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38760/0 (socket says 172.21.15.79:38760) 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e06d9d640 1 -- 172.21.15.79:0/1167525256 learned_addr learned my addr 172.21.15.79:0/1167525256 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5e0659c640 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b37640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.778+0000 7f5dfdd9b640 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 0x55ce31b1d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e06d9d640 1 -- 172.21.15.79:0/1167525256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 msgr2=0x55ce31b37640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b37640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e06d9d640 1 -- 172.21.15.79:0/1167525256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 msgr2=0x55ce31b1d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 0x55ce31b1d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e06d9d640 1 -- 172.21.15.79:0/1167525256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce31b1d770 con 0x55ce31b398e0 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e06d9d640 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31bb4600 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5e0002a6a0 tx=0x7f5e00030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785085d0fbc26512 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5de57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:24:53.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5de57fa640 1 -- 172.21.15.79:0/1167525256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00009450 con 0x55ce31b398e0 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5de57fa640 1 -- 172.21.15.79:0/1167525256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f5e0004aa80 con 0x55ce31b398e0 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 1 -- 172.21.15.79:0/1167525256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df800e7b0 con 0x55ce31b398e0 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5de57fa640 1 -- 172.21.15.79:0/1167525256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f5e0002ace0 con 0x55ce31b398e0 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 10 client.8610 fetch_fsmap learned FSMap version 89 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 1 -- 172.21.15.79:0/1167525256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55ce31b34640 con 0x55ce31b398e0 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5de57fa640 1 -- 172.21.15.79:0/1167525256 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df800e7b0 con 0x55ce31b398e0 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5de57fa640 1 -- 172.21.15.79:0/1167525256 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f5e00044070 con 0x55ce31b398e0 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 10 client.8610 fetch_fsmap finished waiting for FSMap version 89 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 10 client.8610 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 20 client.8610 populate_metadata read hostname 'smithi079' 2024-06-10T00:24:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x55ce31b45610 0x55ce31b459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 4 client.8610 mds_command: new command op to 8556 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.779+0000 7f5e0f607740 1 -- 172.21.15.79:0/1167525256 --> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] -- command(tid 0: {"prefix": "status"}) -- 0x55ce31a5c1c0 con 0x55ce31b45610 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0659c640 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x55ce31b45610 0x55ce31b459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5de57fa640 10 client.8610 ms_handle_connect on v2:172.21.15.79:6835/1367694301 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0659c640 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x55ce31b45610 0x55ce31b459f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db418cebec178f5 server_cookie=b868830149426d48 in_seq=0 out_seq=0 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5de57fa640 1 -- 172.21.15.79:0/1167525256 <== mds.0 v2:172.21.15.79:6835/1367694301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55ce31a5c1c0 con 0x55ce31b45610 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5de57fa640 10 client.8610 handle_command_reply: tid=0 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 client.8610 shutdown 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 -- 172.21.15.79:0/1167525256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 msgr2=0x55ce31bb4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31bb4600 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5e0002a6a0 tx=0x7f5e00030000 comp rx=0 tx=0).stop 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 -- 172.21.15.79:0/1167525256 shutdown_connections 2024-06-10T00:24:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x55ce31b45610 0x55ce31b459f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce31b398e0 0x55ce31bb4600 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce31b190e0 0x55ce31b1d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 --2- 172.21.15.79:0/1167525256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce31b18d00 0x55ce31b37640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5de57fa640 0 client.8610 ms_handle_reset on v2:172.21.15.79:6835/1367694301 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 -- 172.21.15.79:0/1167525256 >> 172.21.15.79:0/1167525256 conn(0x55ce31aeb960 msgr2=0x55ce31b125e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 -- 172.21.15.79:0/1167525256 shutdown_connections 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 1 -- 172.21.15.79:0/1167525256 wait complete. 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.780+0000 7f5e0f607740 20 client.8610 trim_cache size 0 max 16384 2024-06-10T00:24:53.791 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8556, 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3941820189999996, 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 89, 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 120, 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 120, 2024-06-10T00:24:53.792 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 5.363873592 2024-06-10T00:24:53.793 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:53.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 -- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5de806be30 msgr2=0x7f5de806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5de806be30 0x7f5de806e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5df8005880 tx=0x7f5df8009040 comp rx=0 tx=0).stop 2024-06-10T00:24:53.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 -- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080b46d0 msgr2=0x7f5e0814e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080b46d0 0x7f5e0814e4a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c820 tx=0x7f5df000cc20 comp rx=0 tx=0).stop 2024-06-10T00:24:53.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 -- 172.21.15.79:0/3459975402 shutdown_connections 2024-06-10T00:24:53.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5de806be30 0x7f5de806e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e080cc6d0 0x7f5e0806e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e080b46d0 0x7f5e0814e4a0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 --2- 172.21.15.79:0/3459975402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e080721a0 0x7f5e081f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 -- 172.21.15.79:0/3459975402 >> 172.21.15.79:0/3459975402 conn(0x7f5e080b19f0 msgr2=0x7f5e080cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 -- 172.21.15.79:0/3459975402 shutdown_connections 2024-06-10T00:24:53.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.781+0000 7f5e0c81c640 1 -- 172.21.15.79:0/3459975402 wait complete. 2024-06-10T00:24:53.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:24:53.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.894+0000 7f4903b70640 1 Processor -- start 2024-06-10T00:24:53.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.895+0000 7f4903b70640 1 -- start start 2024-06-10T00:24:53.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.895+0000 7f4903b70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48fc0d2680 0x7f48fc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.895+0000 7f4903b70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0cef70 0x7f48fc0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.895+0000 7f4903b70640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48fc0d0ad0 con 0x7f48fc0d1fc0 2024-06-10T00:24:53.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.895+0000 7f4903b70640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f48fc0d13e0 con 0x7f48fc0d2680 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.895+0000 7f4903b70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc15f890 con 0x7f48fc0cef70 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.896+0000 7f490190c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48fc0d2680 0x7f48fc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.896+0000 7f490210d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0cef70 0x7f48fc0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.896+0000 7f490110b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f48fc0d1fc0 0x7f48fc0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:44824/0 (socket says 172.21.15.79:44824) 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.896+0000 7f490110b640 1 -- 172.21.15.79:0/1559002763 learned_addr learned my addr 172.21.15.79:0/1559002763 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.896+0000 7f490190c640 1 -- 172.21.15.79:0/1559002763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0cef70 msgr2=0x7f48fc0cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.896+0000 7f490190c640 1 --2- 172.21.15.79:0/1559002763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0cef70 0x7f48fc0cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.896+0000 7f490190c640 1 -- 172.21.15.79:0/1559002763 >> v1:172.21.15.117:6789/0 conn(0x7f48fc0d1fc0 legacy=0x7f48fc0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.896+0000 7f490190c640 1 -- 172.21.15.79:0/1559002763 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc0d0d90 con 0x7f48fc0d2680 2024-06-10T00:24:53.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f490190c640 1 --2- 172.21.15.79:0/1559002763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 0x7f48fc15f1a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c2c481c2de997 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f490090a640 1 -- 172.21.15.79:0/1559002763 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec007740 con 0x7f48fc0d2680 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f490090a640 1 -- 172.21.15.79:0/1559002763 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec0078e0 con 0x7f48fc0d2680 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f490090a640 1 -- 172.21.15.79:0/1559002763 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec007cb0 con 0x7f48fc0d2680 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f4903b70640 1 -- 172.21.15.79:0/1559002763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 msgr2=0x7f48fc15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f4903b70640 1 --2- 172.21.15.79:0/1559002763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 0x7f48fc15f1a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec02a660 comp rx=0 tx=0).stop 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f4903b70640 1 -- 172.21.15.79:0/1559002763 shutdown_connections 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f4903b70640 1 --2- 172.21.15.79:0/1559002763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0cef70 0x7f48fc0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f4903b70640 1 --2- 172.21.15.79:0/1559002763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 0x7f48fc15f1a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.897+0000 7f4903b70640 1 -- 172.21.15.79:0/1559002763 >> 172.21.15.79:0/1559002763 conn(0x7f48fc09d3f0 msgr2=0x7f48fc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.898+0000 7f4903b70640 1 -- 172.21.15.79:0/1559002763 shutdown_connections 2024-06-10T00:24:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.898+0000 7f4903b70640 1 -- 172.21.15.79:0/1559002763 wait complete. 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.899+0000 7f4903b70640 1 Processor -- start 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.899+0000 7f4903b70640 1 -- start start 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.899+0000 7f4903b70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48fc0cef70 0x7f48fc0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.899+0000 7f4903b70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0d1fc0 0x7f48fc159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.899+0000 7f4903b70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 0x7f48fc0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.899+0000 7f4903b70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc0d4f00 con 0x7f48fc0cef70 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.899+0000 7f4903b70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc0d2400 con 0x7f48fc0d2680 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.899+0000 7f4903b70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc0d1870 con 0x7f48fc0d1fc0 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48fc0cef70 0x7f48fc0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48fc0cef70 0x7f48fc0cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38764/0 (socket says 172.21.15.79:38764) 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 -- 172.21.15.79:0/3137661561 learned_addr learned my addr 172.21.15.79:0/3137661561 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490210d640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 0x7f48fc0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490110b640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0d1fc0 0x7f48fc159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 -- 172.21.15.79:0/3137661561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0d1fc0 msgr2=0x7f48fc159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0d1fc0 0x7f48fc159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 -- 172.21.15.79:0/3137661561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 msgr2=0x7f48fc0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 0x7f48fc0cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 -- 172.21.15.79:0/3137661561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc15bcc0 con 0x7f48fc0cef70 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f490190c640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48fc0cef70 0x7f48fc0cc750 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f48fa7fc640 1 -- 172.21.15.79:0/3137661561 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec040070 con 0x7f48fc0cef70 2024-06-10T00:24:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f48fa7fc640 1 -- 172.21.15.79:0/3137661561 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec031c40 con 0x7f48fc0cef70 2024-06-10T00:24:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f48fa7fc640 1 -- 172.21.15.79:0/3137661561 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec009450 con 0x7f48fc0cef70 2024-06-10T00:24:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc159950 con 0x7f48fc0cef70 2024-06-10T00:24:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.900+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc0cba90 con 0x7f48fc0cef70 2024-06-10T00:24:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.901+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48fc068430 con 0x7f48fc0cef70 2024-06-10T00:24:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.902+0000 7f48fa7fc640 1 -- 172.21.15.79:0/3137661561 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48ec039040 con 0x7f48fc0cef70 2024-06-10T00:24:53.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.902+0000 7f48fa7fc640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48e806be30 0x7f48e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:53.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.902+0000 7f48fa7fc640 1 -- 172.21.15.79:0/3137661561 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f48ec0ac8b0 con 0x7f48fc0cef70 2024-06-10T00:24:53.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.902+0000 7f490110b640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48e806be30 0x7f48e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:53.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.903+0000 7f490110b640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48e806be30 0x7f48e806e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b5900 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:53.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:53.907+0000 7f48fa7fc640 1 -- 172.21.15.79:0/3137661561 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f48ec07aac0 con 0x7f48fc0cef70 2024-06-10T00:24:54.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.124+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f48fc0d04e0 con 0x7f48fc0cef70 2024-06-10T00:24:54.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.124+0000 7f48fa7fc640 1 -- 172.21.15.79:0/3137661561 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) ==== 53+0+73 (secure 0 0 0) 0x7f48ec07edc0 con 0x7f48fc0cef70 2024-06-10T00:24:54.125 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:24:54.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48e806be30 msgr2=0x7f48e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:54.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48e806be30 0x7f48e806e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b5900 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2024-06-10T00:24:54.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48fc0cef70 msgr2=0x7f48fc0cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:54.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48fc0cef70 0x7f48fc0cc750 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec004a40 comp rx=0 tx=0).stop 2024-06-10T00:24:54.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 shutdown_connections 2024-06-10T00:24:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f48e806be30 0x7f48e806e2f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48fc0d2680 0x7f48fc0cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48fc0d1fc0 0x7f48fc159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 --2- 172.21.15.79:0/3137661561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48fc0cef70 0x7f48fc0cc750 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.126+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 >> 172.21.15.79:0/3137661561 conn(0x7f48fc09d3f0 msgr2=0x7f48fc15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.127+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 shutdown_connections 2024-06-10T00:24:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54.127+0000 7f4903b70640 1 -- 172.21.15.79:0/3137661561 wait complete. 2024-06-10T00:24:54.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:24:54.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:24:54.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:24:54.138 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:24:54.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:54.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:24:54.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:24:54.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:24:54.139 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:54.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:54.139 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:24:54.155 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:24:54.155 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:24:54.155 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:24:54.155 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:24:54.156 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42150sec preferred_lft 42150sec 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:24:54.157 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:54.158 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:24:54.158 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:54.158 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:24:54.158 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:24:54.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:54.158 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:24:54.218 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:24:54.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:54.220 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:24:54.277 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:24:54.277 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:24:54.277 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:24:54.277 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:24:54.277 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:24:54.277 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:24:54.278 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:24:54.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:24:54.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:24:54.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:24:54.278 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:24:54.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:24:54.386 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:24:54.385+0000 7f27441df640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:24:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:54.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:54.407 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:24:54.423 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:24:54.423 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:24:54.423 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:54.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:54.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:24:54.488 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:24:54.488 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:24:54.488 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:54.544 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:24:54.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:24:54.544 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:54.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:24:54.665 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:24:54.721 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:24:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:24:54.723 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:54.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:54.725 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:24:54.776 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:24:54.777 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:24:54.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:24:54.844 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:24:54.899 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:24:54.899 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:24:54.899 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:24:54.900 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:24:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:24:54.902 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:54.902 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:24:54.902 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:54.902 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:24:54.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:54.903 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:24:54.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:24:54.899+0000 7efdb761f480 -1 init, newargv = 0x5581baec3300 newargc=15 2024-06-10T00:24:54.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[76481]: starting ceph client 2024-06-10T00:24:54.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[76481]: starting fuse 2024-06-10T00:24:54.919 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:24:54.919 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:24:54.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:24:54.919 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:24:54.919 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:24:54.919 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:24:54.920 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:24:54.921 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:24:54.921 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:24:54.921 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:24:54.921 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:24:54.921 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:24:54.921 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:54.921 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:24:54.921 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:55.037 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.76481.asok 2024-06-10T00:24:55.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:55.048 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76481.asok 2024-06-10T00:24:55.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:55.049 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76481.asok status 2024-06-10T00:24:55.183 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:24:55.183 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:24:55.183 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:24:55.183 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:24:55.183 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:24:55.183 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:24:55.183 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:24:55.183 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "76481", 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8622, 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 8622 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:24:55.184 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1945164645 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1945164645 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.8622 192.168.0.1:0/1945164645", 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/1945164645", 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 89, 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 120, 2024-06-10T00:24:55.185 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:24:55.186 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:24:55.186 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:24:55.186 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:24:55.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:55.191 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:24:55.191 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:55.207 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:24:55.207 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:55.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:55.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:55.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:55.272 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-06-10T00:24:55.336 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-06-10T00:24:55.336 INFO:teuthology.orchestra.run.smithi079.stdout:./parent 2024-06-10T00:24:55.336 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed 2024-06-10T00:24:55.336 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/charlie 2024-06-10T00:24:55.336 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/alpha 2024-06-10T00:24:55.337 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/unflushed 2024-06-10T00:24:55.337 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/unflushed/jfile 2024-06-10T00:24:55.337 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:55.337 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:55.337 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:55.337 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:55.337 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-06-10T00:24:55.337 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:55.442 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:24:55.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:55.451 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:55.451 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:55.451 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:55.451 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:55.452 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-06-10T00:24:55.452 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:55.557 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-06-10T00:24:55.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:55.566 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:55.566 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:55.566 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:55.566 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:55.566 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-06-10T00:24:55.566 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:55.672 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-06-10T00:24:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:55.681 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:55.681 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:55.681 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:55.681 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:55.681 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-06-10T00:24:55.681 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:55.786 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628280 2024-06-10T00:24:55.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:55.795 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:55.795 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:55.796 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:55.796 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:55.796 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-06-10T00:24:55.796 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:55.902 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-06-10T00:24:55.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:55.911 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:55.911 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:55.911 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:55.911 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:55.911 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-06-10T00:24:55.911 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:56.017 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627779 2024-06-10T00:24:56.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:56.025 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:24:56.026 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:24:56.026 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:24:56.026 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:24:56.026 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-06-10T00:24:56.026 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:24:56.131 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627780 2024-06-10T00:24:56.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:24:56.140 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:56.140 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:56.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:24:56.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.336+0000 7fa2f5563640 1 Processor -- start 2024-06-10T00:24:56.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.336+0000 7fa2f5563640 1 -- start start 2024-06-10T00:24:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2f5563640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2f0161830 0x7fa2f00b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2f5563640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 0x7fa2f00d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2f5563640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f00cebb0 con 0x7fa2f00d0a00 2024-06-10T00:24:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2f5563640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f00d4cf0 con 0x7fa2f0161830 2024-06-10T00:24:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2f5563640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f00d2fc0 con 0x7fa2f0161c10 2024-06-10T00:24:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2eeffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2f0161830 0x7fa2f00b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2eeffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2f0161830 0x7fa2f00b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38766/0 (socket says 172.21.15.79:38766) 2024-06-10T00:24:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2eeffd640 1 -- 172.21.15.79:0/3949308511 learned_addr learned my addr 172.21.15.79:0/3949308511 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:56.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2eeffd640 1 -- 172.21.15.79:0/3949308511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 msgr2=0x7fa2f00d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:56.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2eeffd640 1 --2- 172.21.15.79:0/3949308511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 0x7fa2f00d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2eeffd640 1 -- 172.21.15.79:0/3949308511 >> v1:172.21.15.117:6789/0 conn(0x7fa2f00d0a00 legacy=0x7fa2f01620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:56.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.337+0000 7fa2eeffd640 1 -- 172.21.15.79:0/3949308511 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f00d4f20 con 0x7fa2f0161830 2024-06-10T00:24:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.338+0000 7fa2eeffd640 1 --2- 172.21.15.79:0/3949308511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f0161830 0x7fa2f00b5270 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009870 tx=0x7fa2e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64629b59fa01a53b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.338+0000 7fa2edffb640 1 -- 172.21.15.79:0/3949308511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0037070 con 0x7fa2f0161830 2024-06-10T00:24:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.338+0000 7fa2edffb640 1 -- 172.21.15.79:0/3949308511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e0032440 con 0x7fa2f0161830 2024-06-10T00:24:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.338+0000 7fa2edffb640 1 -- 172.21.15.79:0/3949308511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0032810 con 0x7fa2f0161830 2024-06-10T00:24:56.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.338+0000 7fa2f5563640 1 -- 172.21.15.79:0/3949308511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f0161830 msgr2=0x7fa2f00b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.338+0000 7fa2f5563640 1 --2- 172.21.15.79:0/3949308511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f0161830 0x7fa2f00b5270 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009870 tx=0x7fa2e002a210 comp rx=0 tx=0).stop 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.339+0000 7fa2f5563640 1 -- 172.21.15.79:0/3949308511 shutdown_connections 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.339+0000 7fa2f5563640 1 --2- 172.21.15.79:0/3949308511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 0x7fa2f00d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.339+0000 7fa2f5563640 1 --2- 172.21.15.79:0/3949308511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f0161830 0x7fa2f00b5270 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.339+0000 7fa2f5563640 1 -- 172.21.15.79:0/3949308511 >> 172.21.15.79:0/3949308511 conn(0x7fa2f009d3e0 msgr2=0x7fa2f00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.339+0000 7fa2f5563640 1 -- 172.21.15.79:0/3949308511 shutdown_connections 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.339+0000 7fa2f5563640 1 -- 172.21.15.79:0/3949308511 wait complete. 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.340+0000 7fa2f5563640 1 Processor -- start 2024-06-10T00:24:56.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.340+0000 7fa2f5563640 1 -- start start 2024-06-10T00:24:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2f5563640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f00d0a00 0x7fa2f00b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2f5563640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f0161830 0x7fa2f00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2f5563640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 0x7fa2f00b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2f5563640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f00d2ce0 con 0x7fa2f00d0a00 2024-06-10T00:24:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2f5563640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f00d2a00 con 0x7fa2f0161830 2024-06-10T00:24:56.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2f5563640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f00d0060 con 0x7fa2f0161c10 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f00d0a00 0x7fa2f00b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f00d0a00 0x7fa2f00b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38774/0 (socket says 172.21.15.79:38774) 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 -- 172.21.15.79:0/2199925617 learned_addr learned my addr 172.21.15.79:0/2199925617 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 -- 172.21.15.79:0/2199925617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 msgr2=0x7fa2f00b8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2ee7fc640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f0161830 0x7fa2f00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2ef7fe640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 0x7fa2f00b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 0x7fa2f00b8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 -- 172.21.15.79:0/2199925617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f0161830 msgr2=0x7fa2f00b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f0161830 0x7fa2f00b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 -- 172.21.15.79:0/2199925617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f00b0f60 con 0x7fa2f00d0a00 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2eeffd640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f00d0a00 0x7fa2f00b3ab0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009870 tx=0x7fa2e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2d77fe640 1 -- 172.21.15.79:0/2199925617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0041070 con 0x7fa2f00d0a00 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2d77fe640 1 -- 172.21.15.79:0/2199925617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e003c870 con 0x7fa2f00d0a00 2024-06-10T00:24:56.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f00b11d0 con 0x7fa2f00d0a00 2024-06-10T00:24:56.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2d77fe640 1 -- 172.21.15.79:0/2199925617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0037040 con 0x7fa2f00d0a00 2024-06-10T00:24:56.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.341+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f00b1790 con 0x7fa2f00d0a00 2024-06-10T00:24:56.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.342+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f0068430 con 0x7fa2f00d0a00 2024-06-10T00:24:56.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.343+0000 7fa2d77fe640 1 -- 172.21.15.79:0/2199925617 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2e0044070 con 0x7fa2f00d0a00 2024-06-10T00:24:56.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.343+0000 7fa2d77fe640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2dc06be30 0x7fa2dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.343+0000 7fa2ee7fc640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2dc06be30 0x7fa2dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.343+0000 7fa2d77fe640 1 -- 172.21.15.79:0/2199925617 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fa2e00abb80 con 0x7fa2f00d0a00 2024-06-10T00:24:56.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.344+0000 7fa2ee7fc640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2dc06be30 0x7fa2dc06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa2f006c2a0 tx=0x7fa2e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:56.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.348+0000 7fa2d77fe640 1 -- 172.21.15.79:0/2199925617 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa2e007a350 con 0x7fa2f00d0a00 2024-06-10T00:24:56.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.535+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2f00ce4d0 con 0x7fa2f00d0a00 2024-06-10T00:24:56.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.535+0000 7fa2d77fe640 1 -- 172.21.15.79:0/2199925617 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v120) ==== 80+0+122 (secure 0 0 0) 0x7fa2e0079c50 con 0x7fa2f00d0a00 2024-06-10T00:24:56.536 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/3594456696 2024-06-11T00:24:48.375026+0000 2024-06-10T00:24:56.536 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6835/3594456696 2024-06-11T00:24:48.375026+0000 2024-06-10T00:24:56.536 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-06-10T00:24:56.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2dc06be30 msgr2=0x7fa2dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2dc06be30 0x7fa2dc06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa2f006c2a0 tx=0x7fa2e4008040 comp rx=0 tx=0).stop 2024-06-10T00:24:56.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f00d0a00 msgr2=0x7fa2f00b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f00d0a00 0x7fa2f00b3ab0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009870 tx=0x7fa2e00046c0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 shutdown_connections 2024-06-10T00:24:56.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa2dc06be30 0x7fa2dc06e2f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2f0161c10 0x7fa2f00b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f0161830 0x7fa2f00b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 --2- 172.21.15.79:0/2199925617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f00d0a00 0x7fa2f00b3ab0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 >> 172.21.15.79:0/2199925617 conn(0x7fa2f009d3e0 msgr2=0x7fa2f00c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:56.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 shutdown_connections 2024-06-10T00:24:56.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.537+0000 7fa2f5563640 1 -- 172.21.15.79:0/2199925617 wait complete. 2024-06-10T00:24:56.548 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:24:56.549 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:24:56.564 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:24:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.704+0000 7f7efc512640 1 Processor -- start 2024-06-10T00:24:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.704+0000 7f7efc512640 1 -- start start 2024-06-10T00:24:56.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.705+0000 7f7efc512640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ef40cc6d0 0x7f7ef40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.705+0000 7f7efc512640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef40ccff0 con 0x7f7ef4072110 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.705+0000 7f7efc512640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef4072820 con 0x7f7ef4071c60 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.705+0000 7f7efc512640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef4072b00 con 0x7f7ef40cc6d0 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.705+0000 7f7efaaaf640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7ef4072110 0x7f7ef40b3dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44244/0 (socket says 172.21.15.79:44244) 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.705+0000 7f7efaaaf640 1 -- 172.21.15.79:0/3736920523 learned_addr learned my addr 172.21.15.79:0/3736920523 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.705+0000 7f7efa2ae640 1 --2- 172.21.15.79:0/3736920523 >> v2:172.21.15.117:3300/0 conn(0x7f7ef40cc6d0 0x7f7ef40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937470300 0 0) 0x7f7ef40ccff0 con 0x7f7ef4072110 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ee0003520 con 0x7f7ef4072110 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 750397224 0 0) 0x7f7ee0003520 con 0x7f7ef4072110 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 >> v2:172.21.15.117:3300/0 conn(0x7f7ef40cc6d0 msgr2=0x7f7ef40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 --2- 172.21.15.79:0/3736920523 >> v2:172.21.15.117:3300/0 conn(0x7f7ef40cc6d0 0x7f7ef40ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 >> v1:172.21.15.117:6789/0 conn(0x7f7ef4071c60 legacy=0x7f7ef40b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef4072de0 con 0x7f7ef4072110 2024-06-10T00:24:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f7eec0019f0 con 0x7f7ef4072110 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7efa2ae640 1 --2- 172.21.15.79:0/3736920523 >> v2:172.21.15.117:3300/0 conn(0x7f7ef40cc6d0 0x7f7ef40ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 >> v1:172.21.15.79:6789/0 conn(0x7f7ef4072110 legacy=0x7f7ef40b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee00039b0 0x7f7ee0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee0004800 0x7f7ee0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee00051c0 0x7f7ee000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4072b00 con 0x7f7ee0004800 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee000c060 con 0x7f7ee00039b0 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee000c260 con 0x7f7ee00051c0 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef9aad640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee0004800 0x7f7ee0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7efa2ae640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee00039b0 0x7f7ee0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7efaaaf640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee00051c0 0x7f7ee000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef9aad640 1 -- 172.21.15.79:0/3736920523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee00051c0 msgr2=0x7f7ee000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef9aad640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee00051c0 0x7f7ee000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef9aad640 1 -- 172.21.15.79:0/3736920523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee00039b0 msgr2=0x7f7ee0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef9aad640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee00039b0 0x7f7ee0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7ef9aad640 1 -- 172.21.15.79:0/3736920523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee0003520 con 0x7f7ee0004800 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.706+0000 7f7efaaaf640 1 -- 172.21.15.79:0/3736920523 reap_dead start 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.707+0000 7f7ef9aad640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee0004800 0x7f7ee0004c80 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4001750 tx=0x7f7ee0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e992f939ba83d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.707+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4001370 con 0x7f7ee0004800 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.707+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee40052d0 con 0x7f7ee0004800 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.707+0000 7f7ef92ac640 1 -- 172.21.15.79:0/3736920523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee402abc0 con 0x7f7ee0004800 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.708+0000 7f7efc512640 1 -- 172.21.15.79:0/3736920523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee0004800 msgr2=0x7f7ee0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.708+0000 7f7efc512640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee0004800 0x7f7ee0004c80 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4001750 tx=0x7f7ee0005830 comp rx=0 tx=0).stop 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.708+0000 7f7efc512640 1 -- 172.21.15.79:0/3736920523 shutdown_connections 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.708+0000 7f7efc512640 1 --2- 172.21.15.79:0/3736920523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee0004800 0x7f7ee0004c80 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.708+0000 7f7efc512640 1 -- 172.21.15.79:0/3736920523 >> 172.21.15.79:0/3736920523 conn(0x7f7ef40b19f0 msgr2=0x7f7ef40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.708+0000 7f7efc512640 1 -- 172.21.15.79:0/3736920523 shutdown_connections 2024-06-10T00:24:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.708+0000 7f7efc512640 1 -- 172.21.15.79:0/3736920523 wait complete. 2024-06-10T00:24:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.709+0000 7f7efc512640 1 Processor -- start 2024-06-10T00:24:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.709+0000 7f7efc512640 1 -- start start 2024-06-10T00:24:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efc512640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee0004800 0x7f7ef414c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efc512640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ef41f1eb0 0x7f7ef41567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efc512640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ef41f2310 0x7f7ef4156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efc512640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef415c890 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efc512640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4072540 con 0x7f7ee0004800 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efc512640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef4159f60 con 0x7f7ef41f2310 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ef41f1eb0 0x7f7ef41567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ef41f1eb0 0x7f7ef41567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38782/0 (socket says 172.21.15.79:38782) 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 -- 172.21.15.79:0/3145134218 learned_addr learned my addr 172.21.15.79:0/3145134218 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efa2ae640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee0004800 0x7f7ef414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efaaaf640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ef41f2310 0x7f7ef4156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 -- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ef41f2310 msgr2=0x7f7ef4156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ef41f2310 0x7f7ef4156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 -- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee0004800 msgr2=0x7f7ef414c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee0004800 0x7f7ef414c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 -- 172.21.15.79:0/3145134218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef409baa0 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efa2ae640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee0004800 0x7f7ef414c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7ef9aad640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ef41f1eb0 0x7f7ef41567c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4000c00 tx=0x7f7ee4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7eeaffd640 1 -- 172.21.15.79:0/3145134218 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4001370 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7eeaffd640 1 -- 172.21.15.79:0/3145134218 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee402be50 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7eeaffd640 1 -- 172.21.15.79:0/3145134218 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4005480 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef41592e0 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.710+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef415a580 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.711+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef4068430 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.712+0000 7f7eeaffd640 1 -- 172.21.15.79:0/3145134218 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ee4044030 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.712+0000 7f7eeaffd640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ed806be60 0x7f7ed806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.712+0000 7f7efa2ae640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ed806be60 0x7f7ed806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.712+0000 7f7eeaffd640 1 -- 172.21.15.79:0/3145134218 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f7ee40aa780 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.713+0000 7f7efa2ae640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ed806be60 0x7f7ed806e320 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009dd0 tx=0x7f7ef0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:24:56.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.716+0000 7f7eeaffd640 1 -- 172.21.15.79:0/3145134218 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7ee404b060 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.902+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7ef409de70 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.903+0000 7f7eeaffd640 1 -- 172.21.15.79:0/3145134218 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v120) ==== 80+0+122 (secure 0 0 0) 0x7f7ee403ae20 con 0x7f7ef41f1eb0 2024-06-10T00:24:56.904 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/3594456696 2024-06-11T00:24:48.375026+0000 2024-06-10T00:24:56.904 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6835/3594456696 2024-06-11T00:24:48.375026+0000 2024-06-10T00:24:56.904 INFO:teuthology.orchestra.run.smithi079.stderr:listed 2 entries 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ed806be60 msgr2=0x7f7ed806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ed806be60 0x7f7ed806e320 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009dd0 tx=0x7f7ef0008040 comp rx=0 tx=0).stop 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ef41f1eb0 msgr2=0x7f7ef41567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ef41f1eb0 0x7f7ef41567c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4000c00 tx=0x7f7ee4001120 comp rx=0 tx=0).stop 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 shutdown_connections 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f7ed806be60 0x7f7ed806e320 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ef41f2310 0x7f7ef4156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ef41f1eb0 0x7f7ef41567c0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 --2- 172.21.15.79:0/3145134218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee0004800 0x7f7ef414c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:24:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 >> 172.21.15.79:0/3145134218 conn(0x7f7ef40b19f0 msgr2=0x7f7ef40cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:24:56.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 shutdown_connections 2024-06-10T00:24:56.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:24:56.905+0000 7f7efc512640 1 -- 172.21.15.79:0/3145134218 wait complete. 2024-06-10T00:24:56.916 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:24:56.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:24:56.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:24:56.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[76481]: fuse finished with error 0 and tester_r 0 2024-06-10T00:24:56.941 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:03.042 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:25:03.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:03.043 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:25:03.063 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:03.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.210+0000 7fc7b442a640 1 Processor -- start 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.210+0000 7fc7b442a640 1 -- start start 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.211+0000 7fc7b442a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7ac0ae910 0x7fc7ac06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.211+0000 7fc7b442a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7ac06d130 con 0x7fc7ac06ea20 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.211+0000 7fc7b442a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7ac06d410 con 0x7fc7ac0cf360 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.211+0000 7fc7b442a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc7ac06ee90 con 0x7fc7ac0ae910 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.211+0000 7fc7b19c5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc7ac06ea20 0x7fc7ac0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45116/0 (socket says 172.21.15.79:45116) 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.211+0000 7fc7b19c5640 1 -- 172.21.15.79:0/3489958279 learned_addr learned my addr 172.21.15.79:0/3489958279 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.211+0000 7fc7b21c6640 1 --2- 172.21.15.79:0/3489958279 >> v2:172.21.15.117:3300/0 conn(0x7fc7ac0ae910 0x7fc7ac06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.212+0000 7fc7b11c4640 1 -- 172.21.15.79:0/3489958279 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450480066 0 0) 0x7fc7ac06d130 con 0x7fc7ac06ea20 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.212+0000 7fc7b11c4640 1 -- 172.21.15.79:0/3489958279 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc798003520 con 0x7fc7ac06ea20 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.212+0000 7fc7b11c4640 1 -- 172.21.15.79:0/3489958279 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 693631658 0 0) 0x7fc798003520 con 0x7fc7ac06ea20 2024-06-10T00:25:03.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.212+0000 7fc7b21c6640 1 -- 172.21.15.79:0/3489958279 >> v1:172.21.15.117:6789/0 conn(0x7fc7ac0cf360 legacy=0x7fc7ac0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.212+0000 7fc7b21c6640 1 -- 172.21.15.79:0/3489958279 >> v1:172.21.15.79:6789/0 conn(0x7fc7ac06ea20 legacy=0x7fc7ac0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.212+0000 7fc7b21c6640 1 -- 172.21.15.79:0/3489958279 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac06d6f0 con 0x7fc7ac0ae910 2024-06-10T00:25:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b21c6640 1 --2- 172.21.15.79:0/3489958279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 0x7fc7ac06e4e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80097a0 tx=0x7fc7a802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b7f5c1a3ef3a406 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b11c4640 1 -- 172.21.15.79:0/3489958279 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8037070 con 0x7fc7ac0ae910 2024-06-10T00:25:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b11c4640 1 -- 172.21.15.79:0/3489958279 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a802abc0 con 0x7fc7ac0ae910 2024-06-10T00:25:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b11c4640 1 -- 172.21.15.79:0/3489958279 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c001670 con 0x7fc7ac0ae910 2024-06-10T00:25:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b442a640 1 -- 172.21.15.79:0/3489958279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 msgr2=0x7fc7ac06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b442a640 1 --2- 172.21.15.79:0/3489958279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 0x7fc7ac06e4e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80097a0 tx=0x7fc7a802a130 comp rx=0 tx=0).stop 2024-06-10T00:25:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b442a640 1 -- 172.21.15.79:0/3489958279 shutdown_connections 2024-06-10T00:25:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b442a640 1 --2- 172.21.15.79:0/3489958279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 0x7fc7ac06e4e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b442a640 1 -- 172.21.15.79:0/3489958279 >> 172.21.15.79:0/3489958279 conn(0x7fc7ac0b19f0 msgr2=0x7fc7ac0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b442a640 1 -- 172.21.15.79:0/3489958279 shutdown_connections 2024-06-10T00:25:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.213+0000 7fc7b442a640 1 -- 172.21.15.79:0/3489958279 wait complete. 2024-06-10T00:25:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.215+0000 7fc7b442a640 1 Processor -- start 2024-06-10T00:25:03.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.215+0000 7fc7b442a640 1 -- start start 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.215+0000 7fc7b442a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7ac06ea20 0x7fc7ac14f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.215+0000 7fc7b442a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 0x7fc7ac0b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.215+0000 7fc7b442a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7ac0cf360 0x7fc7ac0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.215+0000 7fc7b442a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac0ad450 con 0x7fc7ac0cf360 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.215+0000 7fc7b442a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac0aecf0 con 0x7fc7ac0ae910 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.215+0000 7fc7b442a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ac0ad5d0 con 0x7fc7ac06ea20 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7ac0cf360 0x7fc7ac0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7ac0cf360 0x7fc7ac0b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59304/0 (socket says 172.21.15.79:59304) 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 -- 172.21.15.79:0/1110117700 learned_addr learned my addr 172.21.15.79:0/1110117700 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b21c6640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7ac06ea20 0x7fc7ac14f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b19c5640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 0x7fc7ac0b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 -- 172.21.15.79:0/1110117700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7ac06ea20 msgr2=0x7fc7ac14f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7ac06ea20 0x7fc7ac14f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 -- 172.21.15.79:0/1110117700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 msgr2=0x7fc7ac0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 0x7fc7ac0b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 -- 172.21.15.79:0/1110117700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac1f3e40 con 0x7fc7ac0cf360 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b29c7640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7ac0cf360 0x7fc7ac0b0db0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c7d0 tx=0x7fc7a400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7a2ffd640 1 -- 172.21.15.79:0/1110117700 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4003b70 con 0x7fc7ac0cf360 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7a2ffd640 1 -- 172.21.15.79:0/1110117700 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a4003d30 con 0x7fc7ac0cf360 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac1f4120 con 0x7fc7ac0cf360 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7a2ffd640 1 -- 172.21.15.79:0/1110117700 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400aa90 con 0x7fc7ac0cf360 2024-06-10T00:25:03.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.216+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac1f46e0 con 0x7fc7ac0cf360 2024-06-10T00:25:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.217+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ac068430 con 0x7fc7ac0cf360 2024-06-10T00:25:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.218+0000 7fc7a2ffd640 1 -- 172.21.15.79:0/1110117700 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7a400ac30 con 0x7fc7ac0cf360 2024-06-10T00:25:03.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.218+0000 7fc7a2ffd640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc79006be30 0x7fc79006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.218+0000 7fc7a2ffd640 1 -- 172.21.15.79:0/1110117700 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fc7a408ae30 con 0x7fc7ac0cf360 2024-06-10T00:25:03.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.218+0000 7fc7b21c6640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc79006be30 0x7fc79006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.219+0000 7fc7b21c6640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc79006be30 0x7fc79006e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8034000 tx=0x7fc7a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.222+0000 7fc7a2ffd640 1 -- 172.21.15.79:0/1110117700 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc7a4058fb0 con 0x7fc7ac0cf360 2024-06-10T00:25:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.435+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7ac0d03c0 con 0x7fc7ac0cf360 2024-06-10T00:25:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.436+0000 7fc7a2ffd640 1 -- 172.21.15.79:0/1110117700 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5191 (secure 0 0 0) 0x7fc7a405d2b0 con 0x7fc7ac0cf360 2024-06-10T00:25:03.436 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:03.436 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":89,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:24:52.394753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8556":{"gid":8556,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/1367694301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1367694301},{"type":"v1","addr":"172.21.15.79:6837","nonce":1367694301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8556,"qdb_cluster":[8556]},"id":8}]} 2024-06-10T00:25:03.436 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 89 2024-06-10T00:25:03.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc79006be30 msgr2=0x7fc79006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc79006be30 0x7fc79006e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8034000 tx=0x7fc7a802e000 comp rx=0 tx=0).stop 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7ac0cf360 msgr2=0x7fc7ac0b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7ac0cf360 0x7fc7ac0b0db0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c7d0 tx=0x7fc7a400cc90 comp rx=0 tx=0).stop 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 shutdown_connections 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc79006be30 0x7fc79006e2f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7ac0cf360 0x7fc7ac0b0db0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7ac0ae910 0x7fc7ac0b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 --2- 172.21.15.79:0/1110117700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7ac06ea20 0x7fc7ac14f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 >> 172.21.15.79:0/1110117700 conn(0x7fc7ac0b19f0 msgr2=0x7fc7ac0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 shutdown_connections 2024-06-10T00:25:03.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.438+0000 7fc7b442a640 1 -- 172.21.15.79:0/1110117700 wait complete. 2024-06-10T00:25:03.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parent mytag123 2024-06-10T00:25:03.568 INFO:teuthology.orchestra.run.smithi079.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-06-10T00:25:03.568 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-06-10T00:25:03.568 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f546b00ef40 1 Processor -- start 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f546b00ef40 1 -- start start 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f546b00ef40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77639c00 0x55bb776fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f546b00ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707810 0x55bb77702fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f546b00ef40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77707bf0 0x55bb777034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f546b00ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bb775e2e30 con 0x55bb77707810 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f546b00ef40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bb775e6e70 con 0x55bb77639c00 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f546b00ef40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bb7763e060 con 0x55bb77707bf0 2024-06-10T00:25:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f545f6be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707810 0x55bb77702fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f545f6be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707810 0x55bb77702fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59320/0 (socket says 172.21.15.79:59320) 2024-06-10T00:25:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.612+0000 7f545f6be640 1 -- 172.21.15.79:0/4089253946 learned_addr learned my addr 172.21.15.79:0/4089253946 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f5467ebf640 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77639c00 0x55bb776fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f545f6be640 1 -- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77707bf0 msgr2=0x55bb777034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f54686c0640 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77707bf0 0x55bb777034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f545f6be640 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77707bf0 0x55bb777034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f545f6be640 1 -- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77639c00 msgr2=0x55bb776fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f545f6be640 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77639c00 0x55bb776fbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f545f6be640 1 -- 172.21.15.79:0/4089253946 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb77704b00 con 0x55bb77707810 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f5467ebf640 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77639c00 0x55bb776fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f545f6be640 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707810 0x55bb77702fb0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f5450001d30 tx=0x7f545000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844de0da989521ea server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f5466ebd640 1 -- 172.21.15.79:0/4089253946 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545000bcc0 con 0x55bb77707810 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f5466ebd640 1 -- 172.21.15.79:0/4089253946 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545000f400 con 0x55bb77707810 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f5466ebd640 1 -- 172.21.15.79:0/4089253946 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545000be60 con 0x55bb77707810 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f546b00ef40 1 -- 172.21.15.79:0/4089253946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707810 msgr2=0x55bb77702fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.613+0000 7f546b00ef40 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707810 0x55bb77702fb0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f5450001d30 tx=0x7f545000b5b0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 -- 172.21.15.79:0/4089253946 shutdown_connections 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77707bf0 0x55bb777034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707810 0x55bb77702fb0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 --2- 172.21.15.79:0/4089253946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77639c00 0x55bb776fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 -- 172.21.15.79:0/4089253946 >> 172.21.15.79:0/4089253946 conn(0x55bb7763aa40 msgr2=0x55bb7763ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 -- 172.21.15.79:0/4089253946 shutdown_connections 2024-06-10T00:25:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 -- 172.21.15.79:0/4089253946 wait complete. 2024-06-10T00:25:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 Processor -- start 2024-06-10T00:25:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.614+0000 7f546b00ef40 1 -- start start 2024-06-10T00:25:03.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:25:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f546b00ef40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77639c00 0x55bb776fcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f546b00ef40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77707810 0x55bb776fec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f546b00ef40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707bf0 0x55bb77706170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f546b00ef40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bb776fc270 con 0x55bb77707bf0 2024-06-10T00:25:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f546b00ef40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bb776398a0 con 0x55bb77707810 2024-06-10T00:25:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f546b00ef40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bb77704da0 con 0x55bb77639c00 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707bf0 0x55bb77706170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707bf0 0x55bb77706170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59328/0 (socket says 172.21.15.79:59328) 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 -- 172.21.15.79:0/1923551044 learned_addr learned my addr 172.21.15.79:0/1923551044 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f545f6be640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77707810 0x55bb776fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f5467ebf640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77639c00 0x55bb776fcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 -- 172.21.15.79:0/1923551044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77639c00 msgr2=0x55bb776fcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77639c00 0x55bb776fcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 -- 172.21.15.79:0/1923551044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77707810 msgr2=0x55bb776fec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77707810 0x55bb776fec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 -- 172.21.15.79:0/1923551044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb776fc490 con 0x55bb77707bf0 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f545f6be640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb77707810 0x55bb776fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f5467ebf640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bb77639c00 0x55bb776fcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f54686c0640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707bf0 0x55bb77706170 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f5460046190 tx=0x7f54600033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f5465ebb640 1 -- 172.21.15.79:0/1923551044 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546004fb70 con 0x55bb77707bf0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.615+0000 7f5465ebb640 1 -- 172.21.15.79:0/1923551044 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5460068070 con 0x55bb77707bf0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.616+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb776fc770 con 0x55bb77707bf0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.616+0000 7f5465ebb640 1 -- 172.21.15.79:0/1923551044 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460063460 con 0x55bb77707bf0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.616+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb776ff160 con 0x55bb77707bf0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.617+0000 7f5465ebb640 1 -- 172.21.15.79:0/1923551044 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5460061030 con 0x55bb77707bf0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.617+0000 7f5465ebb640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f544806a810 0x7f544806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.617+0000 7f5465ebb640 1 -- 172.21.15.79:0/1923551044 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f54600cd740 con 0x55bb77707bf0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.617+0000 7f5467ebf640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f544806a810 0x7f544806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55bb777066b0 0x55bb777ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55bb777ad590 con 0x55bb777066b0 2024-06-10T00:25:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f545f6be640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55bb777066b0 0x55bb777ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f5467ebf640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f544806a810 0x7f544806ccd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5458000f60 tx=0x7f5458001730 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f545f6be640 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55bb777066b0 0x55bb777ad050 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f545f6be640 1 -- 172.21.15.79:0/1923551044 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f545000f6c0 con 0x55bb777066b0 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55bb777066b0 msgr2=0x55bb777ad050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55bb777066b0 0x55bb777ad050 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f544806a810 msgr2=0x7f544806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f544806a810 0x7f544806ccd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5458000f60 tx=0x7f5458001730 comp rx=0 tx=0).stop 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707bf0 msgr2=0x55bb77706170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 --2- 172.21.15.79:0/1923551044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb77707bf0 0x55bb77706170 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f5460046190 tx=0x7f54600033a0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f54686c0640 1 -- 172.21.15.79:0/1923551044 reap_dead start 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 shutdown_connections 2024-06-10T00:25:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 >> 172.21.15.79:0/1923551044 conn(0x55bb7763aa40 msgr2=0x55bb7763ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 shutdown_connections 2024-06-10T00:25:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.618+0000 7f546b00ef40 1 -- 172.21.15.79:0/1923551044 wait complete. 2024-06-10T00:25:03.628 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-06-10T00:25:03.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff907e92f40 1 Processor -- start 2024-06-10T00:25:03.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff907e92f40 1 -- start start 2024-06-10T00:25:03.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff907e92f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e533d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff907e92f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 0x5585e529bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff907e92f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 0x5585e533b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff907e92f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5585e5216e30 con 0x5585e52726b0 2024-06-10T00:25:03.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff907e92f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5585e521ae70 con 0x5585e52b8f60 2024-06-10T00:25:03.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff907e92f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5585e529ad30 con 0x5585e5344c90 2024-06-10T00:25:03.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.708+0000 7ff905995640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e533d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905995640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e533d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59346/0 (socket says 172.21.15.79:59346) 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905995640 1 -- 172.21.15.79:0/218394686 learned_addr learned my addr 172.21.15.79:0/218394686 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff906196640 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 0x5585e533b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905194640 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 0x5585e529bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905995640 1 -- 172.21.15.79:0/218394686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 msgr2=0x5585e533b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905995640 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 0x5585e533b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905995640 1 -- 172.21.15.79:0/218394686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 msgr2=0x5585e529bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905995640 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 0x5585e529bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905995640 1 -- 172.21.15.79:0/218394686 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585e52b6d30 con 0x5585e52726b0 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff905995640 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e533d210 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800a430 tx=0x7ff8f800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad3740735822d7f server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff8f7fff640 1 -- 172.21.15.79:0/218394686 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800b920 con 0x5585e52726b0 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff8f7fff640 1 -- 172.21.15.79:0/218394686 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f800f030 con 0x5585e52726b0 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff8f7fff640 1 -- 172.21.15.79:0/218394686 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800bd20 con 0x5585e52726b0 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff907e92f40 1 -- 172.21.15.79:0/218394686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 msgr2=0x5585e533d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff907e92f40 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e533d210 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800a430 tx=0x7ff8f800a8f0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff907e92f40 1 -- 172.21.15.79:0/218394686 shutdown_connections 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff907e92f40 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 0x5585e533b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff907e92f40 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 0x5585e529bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff907e92f40 1 --2- 172.21.15.79:0/218394686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e533d210 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.709+0000 7ff907e92f40 1 -- 172.21.15.79:0/218394686 >> 172.21.15.79:0/218394686 conn(0x5585e529aeb0 msgr2=0x5585e52731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.710+0000 7ff907e92f40 1 -- 172.21.15.79:0/218394686 shutdown_connections 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.710+0000 7ff907e92f40 1 -- 172.21.15.79:0/218394686 wait complete. 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.710+0000 7ff907e92f40 1 Processor -- start 2024-06-10T00:25:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.710+0000 7ff907e92f40 1 -- start start 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff907e92f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e529be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff907e92f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 0x5585e533b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff907e92f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 0x5585e5337250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff907e92f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5585e529e6d0 con 0x5585e52726b0 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff907e92f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5585e52ba0c0 con 0x5585e52b8f60 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff907e92f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5585e52a0660 con 0x5585e5344c90 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e529be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e529be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59348/0 (socket says 172.21.15.79:59348) 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 -- 172.21.15.79:0/1078549193 learned_addr learned my addr 172.21.15.79:0/1078549193 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff906196640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 0x5585e5337250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905194640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 0x5585e533b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 -- 172.21.15.79:0/1078549193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 msgr2=0x5585e5337250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585e5344c90 0x5585e5337250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 -- 172.21.15.79:0/1078549193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 msgr2=0x5585e533b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585e52b8f60 0x5585e533b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 -- 172.21.15.79:0/1078549193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585e53dd100 con 0x5585e52726b0 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff905995640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e529be80 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x5585e529fa80 tx=0x7ff8f8002f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.711+0000 7ff8f6ffd640 1 -- 172.21.15.79:0/1078549193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8024070 con 0x5585e52726b0 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.712+0000 7ff8f6ffd640 1 -- 172.21.15.79:0/1078549193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f8014640 con 0x5585e52726b0 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.712+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585e53dc580 con 0x5585e52726b0 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.712+0000 7ff8f6ffd640 1 -- 172.21.15.79:0/1078549193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8014a30 con 0x5585e52726b0 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.712+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585e53dcb40 con 0x5585e52726b0 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.713+0000 7ff8f6ffd640 1 -- 172.21.15.79:0/1078549193 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8f8027070 con 0x5585e52726b0 2024-06-10T00:25:03.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.713+0000 7ff8f6ffd640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8e806a810 0x7ff8e806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.713+0000 7ff8f6ffd640 1 -- 172.21.15.79:0/1078549193 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7ff8f808aa50 con 0x5585e52726b0 2024-06-10T00:25:03.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.713+0000 7ff905194640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8e806a810 0x7ff8e806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5585e533b9d0 0x5585e53daf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:1 18.12 18:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x5585e53db4d0 con 0x5585e533b9d0 2024-06-10T00:25:03.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff906196640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5585e533b9d0 0x5585e53daf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff905194640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8e806a810 0x7ff8e806ccd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc057000 tx=0x7ff8fc052000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff906196640 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5585e533b9d0 0x5585e53daf90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff906196640 1 -- 172.21.15.79:0/1078549193 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7ff900001630 con 0x5585e533b9d0 2024-06-10T00:25:03.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5585e533b9d0 msgr2=0x5585e53daf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x5585e533b9d0 0x5585e53daf90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8e806a810 msgr2=0x7ff8e806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff8e806a810 0x7ff8e806ccd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc057000 tx=0x7ff8fc052000 comp rx=0 tx=0).stop 2024-06-10T00:25:03.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 msgr2=0x5585e529be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 --2- 172.21.15.79:0/1078549193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585e52726b0 0x5585e529be80 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x5585e529fa80 tx=0x7ff8f8002f70 comp rx=0 tx=0).stop 2024-06-10T00:25:03.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff906196640 1 -- 172.21.15.79:0/1078549193 reap_dead start 2024-06-10T00:25:03.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 shutdown_connections 2024-06-10T00:25:03.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.714+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 >> 172.21.15.79:0/1078549193 conn(0x5585e529aeb0 msgr2=0x5585e52731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.715+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 shutdown_connections 2024-06-10T00:25:03.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.715+0000 7ff907e92f40 1 -- 172.21.15.79:0/1078549193 wait complete. 2024-06-10T00:25:03.721 INFO:teuthology.orchestra.run.smithi079.stdout:mytag123 2024-06-10T00:25:03.721 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-06-10T00:25:03.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.805+0000 7f596770df40 1 Processor -- start 2024-06-10T00:25:03.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.805+0000 7f596770df40 1 -- start start 2024-06-10T00:25:03.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.805+0000 7f596770df40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e58bc00 0x56423e5bd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.805+0000 7f596770df40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56423e5b7650 0x56423e649e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.805+0000 7f596770df40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e64ad70 0x56423e663bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.805+0000 7f596770df40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56423e665840 con 0x56423e58bc00 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.805+0000 7f596770df40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56423e534e30 con 0x56423e5b7650 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.805+0000 7f596770df40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56423e665ae0 con 0x56423e64ad70 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e58bc00 0x56423e5bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e58bc00 0x56423e5bd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59364/0 (socket says 172.21.15.79:59364) 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 -- 172.21.15.79:0/487108763 learned_addr learned my addr 172.21.15.79:0/487108763 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 -- 172.21.15.79:0/487108763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e64ad70 msgr2=0x56423e663bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 --2- 172.21.15.79:0/487108763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e64ad70 0x56423e663bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 -- 172.21.15.79:0/487108763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56423e5b7650 msgr2=0x56423e649e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 --2- 172.21.15.79:0/487108763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56423e5b7650 0x56423e649e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 -- 172.21.15.79:0/487108763 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56423e4b9cb0 con 0x56423e58bc00 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596520e640 1 --2- 172.21.15.79:0/487108763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e58bc00 0x56423e5bd210 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f5958001d80 tx=0x7f5958001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4720d3a85f18a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f595ffff640 1 -- 172.21.15.79:0/487108763 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595800bd70 con 0x56423e58bc00 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f595ffff640 1 -- 172.21.15.79:0/487108763 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595800f400 con 0x56423e58bc00 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f595ffff640 1 -- 172.21.15.79:0/487108763 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595800f7f0 con 0x56423e58bc00 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596770df40 1 -- 172.21.15.79:0/487108763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e58bc00 msgr2=0x56423e5bd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.806+0000 7f596770df40 1 --2- 172.21.15.79:0/487108763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e58bc00 0x56423e5bd210 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f5958001d80 tx=0x7f5958001e70 comp rx=0 tx=0).stop 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 -- 172.21.15.79:0/487108763 shutdown_connections 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 --2- 172.21.15.79:0/487108763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e64ad70 0x56423e663bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 --2- 172.21.15.79:0/487108763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56423e5b7650 0x56423e649e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 --2- 172.21.15.79:0/487108763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e58bc00 0x56423e5bd210 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 -- 172.21.15.79:0/487108763 >> 172.21.15.79:0/487108763 conn(0x56423e58ca40 msgr2=0x56423e65e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 -- 172.21.15.79:0/487108763 shutdown_connections 2024-06-10T00:25:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 -- 172.21.15.79:0/487108763 wait complete. 2024-06-10T00:25:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 Processor -- start 2024-06-10T00:25:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.807+0000 7f596770df40 1 -- start start 2024-06-10T00:25:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f596770df40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56423e58bc00 0x56423e5d48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f596770df40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e5b7650 0x56423e663dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f596770df40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e64ad70 0x56423e5bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f596770df40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56423e649980 con 0x56423e64ad70 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f596770df40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56423e666990 con 0x56423e58bc00 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f596770df40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56423e666440 con 0x56423e5b7650 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e64ad70 0x56423e5bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e64ad70 0x56423e5bbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59380/0 (socket says 172.21.15.79:59380) 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 -- 172.21.15.79:0/2790501328 learned_addr learned my addr 172.21.15.79:0/2790501328 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f596520e640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56423e58bc00 0x56423e5d48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f595ca0d640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e5b7650 0x56423e663dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 -- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e5b7650 msgr2=0x56423e663dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e5b7650 0x56423e663dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 -- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56423e58bc00 msgr2=0x56423e5d48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56423e58bc00 0x56423e5d48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 -- 172.21.15.79:0/2790501328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56423e65eb60 con 0x56423e64ad70 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f595ca0d640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56423e5b7650 0x56423e663dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.808+0000 7f5965a0f640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e64ad70 0x56423e5bbeb0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f5960025a20 tx=0x7f5960051ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.809+0000 7f595effd640 1 -- 172.21.15.79:0/2790501328 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960055040 con 0x56423e64ad70 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.809+0000 7f595effd640 1 -- 172.21.15.79:0/2790501328 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5960065430 con 0x56423e64ad70 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.809+0000 7f595effd640 1 -- 172.21.15.79:0/2790501328 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960005b40 con 0x56423e64ad70 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.809+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56423e6f6310 con 0x56423e64ad70 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.809+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56423e6f3a70 con 0x56423e64ad70 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.810+0000 7f595effd640 1 -- 172.21.15.79:0/2790501328 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5960058020 con 0x56423e64ad70 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.810+0000 7f595effd640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f594806a840 0x7f594806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.811+0000 7f595effd640 1 -- 172.21.15.79:0/2790501328 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f59600cd660 con 0x56423e64ad70 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.811+0000 7f596520e640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f594806a840 0x7f594806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.811+0000 7f596770df40 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56423e664300 0x56423e5bc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.811+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:1 18.19 18:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x56423e6609a0 con 0x56423e664300 2024-06-10T00:25:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.811+0000 7f596520e640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f594806a840 0x7f594806cd00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5958000fd0 tx=0x7f5958009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.811+0000 7f595ca0d640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56423e664300 0x56423e5bc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.811+0000 7f595ca0d640 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56423e664300 0x56423e5bc900 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f595ca0d640 1 -- 172.21.15.79:0/2790501328 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f5950009910 con 0x56423e664300 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56423e664300 msgr2=0x56423e5bc900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56423e664300 0x56423e5bc900 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f594806a840 msgr2=0x7f594806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f594806a840 0x7f594806cd00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5958000fd0 tx=0x7f5958009000 comp rx=0 tx=0).stop 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e64ad70 msgr2=0x56423e5bbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 --2- 172.21.15.79:0/2790501328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56423e64ad70 0x56423e5bbeb0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f5960025a20 tx=0x7f5960051ec0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f5965a0f640 1 -- 172.21.15.79:0/2790501328 reap_dead start 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 shutdown_connections 2024-06-10T00:25:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 >> 172.21.15.79:0/2790501328 conn(0x56423e58ca40 msgr2=0x56423e6477a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 shutdown_connections 2024-06-10T00:25:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.812+0000 7f596770df40 1 -- 172.21.15.79:0/2790501328 wait complete. 2024-06-10T00:25:03.816 INFO:teuthology.orchestra.run.smithi079.stdout:mytag123 2024-06-10T00:25:03.817 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-06-10T00:25:03.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.900+0000 7f463ca45f40 1 Processor -- start 2024-06-10T00:25:03.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.900+0000 7f463ca45f40 1 -- start start 2024-06-10T00:25:03.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f463ca45f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e633564f0 0x558e6339e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f463ca45f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342d930 0x558e63356b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f463ca45f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e6342eb50 0x558e6339f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f463ca45f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e633a2240 con 0x558e6342d930 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f463ca45f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558e632ffe30 con 0x558e633564f0 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f463ca45f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558e6342e170 con 0x558e6342eb50 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342d930 0x558e63356b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342d930 0x558e63356b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59404/0 (socket says 172.21.15.79:59404) 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 -- 172.21.15.79:0/235078263 learned_addr learned my addr 172.21.15.79:0/235078263 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 -- 172.21.15.79:0/235078263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e6342eb50 msgr2=0x558e6339f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 --2- 172.21.15.79:0/235078263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e6342eb50 0x558e6339f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 -- 172.21.15.79:0/235078263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e633564f0 msgr2=0x558e6339e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 --2- 172.21.15.79:0/235078263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e633564f0 0x558e6339e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 -- 172.21.15.79:0/235078263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e63284cb0 con 0x558e6342d930 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4631d45640 1 --2- 172.21.15.79:0/235078263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342d930 0x558e63356b50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f462400b240 tx=0x7f462400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884a54006e7ae0fd server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4639544640 1 -- 172.21.15.79:0/235078263 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624008070 con 0x558e6342d930 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4639544640 1 -- 172.21.15.79:0/235078263 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462400d500 con 0x558e6342d930 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.901+0000 7f4639544640 1 -- 172.21.15.79:0/235078263 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462400d910 con 0x558e6342d930 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 -- 172.21.15.79:0/235078263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342d930 msgr2=0x558e63356b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 --2- 172.21.15.79:0/235078263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342d930 0x558e63356b50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f462400b240 tx=0x7f462400b700 comp rx=0 tx=0).stop 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 -- 172.21.15.79:0/235078263 shutdown_connections 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 --2- 172.21.15.79:0/235078263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e6342eb50 0x558e6339f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 --2- 172.21.15.79:0/235078263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342d930 0x558e63356b50 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 --2- 172.21.15.79:0/235078263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e633564f0 0x558e6339e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 -- 172.21.15.79:0/235078263 >> 172.21.15.79:0/235078263 conn(0x558e63357a40 msgr2=0x558e633595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 -- 172.21.15.79:0/235078263 shutdown_connections 2024-06-10T00:25:03.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 -- 172.21.15.79:0/235078263 wait complete. 2024-06-10T00:25:03.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 Processor -- start 2024-06-10T00:25:03.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.902+0000 7f463ca45f40 1 -- start start 2024-06-10T00:25:03.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ca45f40 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e633564f0 0x558e63422e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ca45f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e6342d930 0x558e63423340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ca45f40 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342eb50 0x558e63423880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ca45f40 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e6335a0a0 con 0x558e6342eb50 2024-06-10T00:25:03.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ca45f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558e6342c5b0 con 0x558e6342d930 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ca45f40 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558e634c0740 con 0x558e633564f0 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ad47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342eb50 0x558e63423880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ad47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342eb50 0x558e63423880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59412/0 (socket says 172.21.15.79:59412) 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ad47640 1 -- 172.21.15.79:0/1787338992 learned_addr learned my addr 172.21.15.79:0/1787338992 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463a546640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e633564f0 0x558e63422e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f4631d45640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e6342d930 0x558e63423340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ad47640 1 -- 172.21.15.79:0/1787338992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e633564f0 msgr2=0x558e63422e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ad47640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558e633564f0 0x558e63422e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ad47640 1 -- 172.21.15.79:0/1787338992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e6342d930 msgr2=0x558e63423340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ad47640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e6342d930 0x558e63423340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.903+0000 7f463ad47640 1 -- 172.21.15.79:0/1787338992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e634c0a20 con 0x558e6342eb50 2024-06-10T00:25:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.904+0000 7f463ad47640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342eb50 0x558e63423880 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f46340091d0 tx=0x7f4634009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.904+0000 7f4633fff640 1 -- 172.21.15.79:0/1787338992 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634014070 con 0x558e6342eb50 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.904+0000 7f4633fff640 1 -- 172.21.15.79:0/1787338992 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4634010800 con 0x558e6342eb50 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.904+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e634c0d00 con 0x558e6342eb50 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.904+0000 7f4633fff640 1 -- 172.21.15.79:0/1787338992 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634010bd0 con 0x558e6342eb50 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.904+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6342ffb0 con 0x558e6342eb50 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.905+0000 7f4633fff640 1 -- 172.21.15.79:0/1787338992 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4634020350 con 0x558e6342eb50 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.906+0000 7f4633fff640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461c06a840 0x7f461c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.906+0000 7f4633fff640 1 -- 172.21.15.79:0/1787338992 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f4634089aa0 con 0x558e6342eb50 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.906+0000 7f463a546640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461c06a840 0x7f461c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.906+0000 7f463ca45f40 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x558e6339f7c0 0x558e6339fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.906+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 18.5 18:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x558e633a00e0 con 0x558e6339f7c0 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.906+0000 7f4631d45640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x558e6339f7c0 0x558e6339fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.906+0000 7f463a546640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461c06a840 0x7f461c06cd00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f462c057000 tx=0x7f462c051000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.906+0000 7f4631d45640 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x558e6339f7c0 0x558e6339fba0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f4631d45640 1 -- 172.21.15.79:0/1787338992 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f462400d730 con 0x558e6339f7c0 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x558e6339f7c0 msgr2=0x558e6339fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x558e6339f7c0 0x558e6339fba0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461c06a840 msgr2=0x7f461c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f461c06a840 0x7f461c06cd00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f462c057000 tx=0x7f462c051000 comp rx=0 tx=0).stop 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342eb50 msgr2=0x558e63423880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 --2- 172.21.15.79:0/1787338992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e6342eb50 0x558e63423880 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f46340091d0 tx=0x7f4634009690 comp rx=0 tx=0).stop 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ad47640 1 -- 172.21.15.79:0/1787338992 reap_dead start 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 shutdown_connections 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 >> 172.21.15.79:0/1787338992 conn(0x558e63357a40 msgr2=0x558e63356b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:03.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 shutdown_connections 2024-06-10T00:25:03.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:03.907+0000 7f463ca45f40 1 -- 172.21.15.79:0/1787338992 wait complete. 2024-06-10T00:25:03.911 INFO:teuthology.orchestra.run.smithi079.stdout:mytag123 2024-06-10T00:25:03.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-06-10T00:25:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.053+0000 7f2bc1cb3640 1 Processor -- start 2024-06-10T00:25:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.053+0000 7f2bc1cb3640 1 -- start start 2024-06-10T00:25:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bc1cb3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2bbc155320 0x7f2bbc0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bc1cb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc0b34e0 0x7f2bbc0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bc1cb3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bbc155700 con 0x7f2bbc0d0560 2024-06-10T00:25:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bc1cb3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2bbc15b6b0 con 0x7f2bbc155320 2024-06-10T00:25:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bc1cb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc15b990 con 0x7f2bbc0b34e0 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2bbc155320 0x7f2bbc0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2bbc155320 0x7f2bbc0b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59426/0 (socket says 172.21.15.79:59426) 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbb7fe640 1 -- 172.21.15.79:0/3264367948 learned_addr learned my addr 172.21.15.79:0/3264367948 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/3264367948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc0b34e0 0x7f2bbc0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbb7fe640 1 -- 172.21.15.79:0/3264367948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc0b34e0 msgr2=0x7f2bbc0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/3264367948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc0b34e0 0x7f2bbc0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbb7fe640 1 -- 172.21.15.79:0/3264367948 >> v1:172.21.15.117:6789/0 conn(0x7f2bbc0d0560 legacy=0x7f2bbc06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbb7fe640 1 -- 172.21.15.79:0/3264367948 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc15bc70 con 0x7f2bbc155320 2024-06-10T00:25:04.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.054+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/3264367948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc0b34e0 0x7f2bbc0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.055+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/3264367948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc155320 0x7f2bbc0b2fa0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00bb10 tx=0x7f2bac02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22d5a9b767d2b87 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.055+0000 7f2bba7fc640 1 -- 172.21.15.79:0/3264367948 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac036020 con 0x7f2bbc155320 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.055+0000 7f2bba7fc640 1 -- 172.21.15.79:0/3264367948 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bac032820 con 0x7f2bbc155320 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.055+0000 7f2bba7fc640 1 -- 172.21.15.79:0/3264367948 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac032bf0 con 0x7f2bbc155320 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.056+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3264367948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc155320 msgr2=0x7f2bbc0b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.056+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3264367948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc155320 0x7f2bbc0b2fa0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00bb10 tx=0x7f2bac02c920 comp rx=0 tx=0).stop 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.056+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3264367948 shutdown_connections 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.056+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3264367948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc0b34e0 0x7f2bbc0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.056+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3264367948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc155320 0x7f2bbc0b2fa0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.056+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3264367948 >> 172.21.15.79:0/3264367948 conn(0x7f2bbc0b1d10 msgr2=0x7f2bbc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.056+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3264367948 shutdown_connections 2024-06-10T00:25:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.056+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3264367948 wait complete. 2024-06-10T00:25:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.057+0000 7f2bc1cb3640 1 Processor -- start 2024-06-10T00:25:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.057+0000 7f2bc1cb3640 1 -- start start 2024-06-10T00:25:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bc1cb3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0b34e0 0x7f2bbc140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bc1cb3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc0d0560 0x7f2bbc0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bc1cb3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc155320 0x7f2bbc152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bc1cb3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc15b470 con 0x7f2bbc0d0560 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bc1cb3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc15b2f0 con 0x7f2bbc0b34e0 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bc1cb3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc06e900 con 0x7f2bbc155320 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc0d0560 0x7f2bbc0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc0d0560 0x7f2bbc0afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59438/0 (socket says 172.21.15.79:59438) 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbaffd640 1 -- 172.21.15.79:0/3340681943 learned_addr learned my addr 172.21.15.79:0/3340681943 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0b34e0 0x7f2bbc140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbbfff640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc155320 0x7f2bbc152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbaffd640 1 -- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc155320 msgr2=0x7f2bbc152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc155320 0x7f2bbc152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbaffd640 1 -- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0b34e0 msgr2=0x7f2bbc140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0b34e0 0x7f2bbc140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbaffd640 1 -- 172.21.15.79:0/3340681943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc14c640 con 0x7f2bbc0d0560 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0b34e0 0x7f2bbc140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.058+0000 7f2bbbfff640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc155320 0x7f2bbc152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.059+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc0d0560 0x7f2bbc0afa60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000e7e0 tx=0x7f2bb000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.059+0000 7f2ba3fff640 1 -- 172.21.15.79:0/3340681943 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb000f040 con 0x7f2bbc0d0560 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.059+0000 7f2ba3fff640 1 -- 172.21.15.79:0/3340681943 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb0004030 con 0x7f2bbc0d0560 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.059+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3340681943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc14c920 con 0x7f2bbc0d0560 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.059+0000 7f2ba3fff640 1 -- 172.21.15.79:0/3340681943 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0004400 con 0x7f2bbc0d0560 2024-06-10T00:25:04.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.059+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3340681943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc14cee0 con 0x7f2bbc0d0560 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.061+0000 7f2ba3fff640 1 -- 172.21.15.79:0/3340681943 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bb000c6d0 con 0x7f2bbc0d0560 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.061+0000 7f2ba3fff640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba806be30 0x7f2ba806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.061+0000 7f2ba3fff640 1 -- 172.21.15.79:0/3340681943 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f2bb008ae80 con 0x7f2bbc0d0560 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.061+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba806be30 0x7f2ba806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.062+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba806be30 0x7f2ba806e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2bac037000 tx=0x7f2bac03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.062+0000 7f2bc49c1740 1 Processor -- start 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.062+0000 7f2bc49c1740 1 -- start start 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa3daf0 0x56172aa1a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa151a0 0x56172aa1a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa1c6d0 0x56172aa1aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56172a93f7e0 con 0x56172aa151a0 2024-06-10T00:25:04.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56172a97de80 con 0x56172aa1c6d0 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56172a91b700 con 0x56172aa3daf0 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa151a0 0x56172aa1a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa151a0 0x56172aa1a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59444/0 (socket says 172.21.15.79:59444) 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 -- 172.21.15.79:0/2712423764 learned_addr learned my addr 172.21.15.79:0/2712423764 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa3daf0 0x56172aa1a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbbfff640 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa1c6d0 0x56172aa1aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 -- 172.21.15.79:0/2712423764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa3daf0 msgr2=0x56172aa1a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa3daf0 0x56172aa1a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 -- 172.21.15.79:0/2712423764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa1c6d0 msgr2=0x56172aa1aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa1c6d0 0x56172aa1aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 -- 172.21.15.79:0/2712423764 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56172a93add0 con 0x56172aa151a0 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.063+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa151a0 0x56172aa1a660 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0089170 tx=0x7f2bb0059090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6aa5656576eb599 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2ba17fa640 1 -- 172.21.15.79:0/2712423764 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0020040 con 0x56172aa151a0 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2ba17fa640 1 -- 172.21.15.79:0/2712423764 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb0057250 con 0x56172aa151a0 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2ba17fa640 1 -- 172.21.15.79:0/2712423764 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0082b30 con 0x56172aa151a0 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2712423764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa151a0 msgr2=0x56172aa1a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa151a0 0x56172aa1a660 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0089170 tx=0x7f2bb0059090 comp rx=0 tx=0).stop 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2712423764 shutdown_connections 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa1c6d0 0x56172aa1aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa151a0 0x56172aa1a660 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2712423764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa3daf0 0x56172aa1a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2712423764 >> 172.21.15.79:0/2712423764 conn(0x56172aa17410 msgr2=0x56172aa5ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2712423764 shutdown_connections 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.064+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2712423764 wait complete. 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.065+0000 7f2bc49c1740 1 -- start start 2024-06-10T00:25:04.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.065+0000 7f2bc49c1740 1 Processor -- start 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa39e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 0x56172aa41aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56172a906640 con 0x56172aa43c30 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56172a979e40 con 0x56172aa3daf0 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56172aa18be0 con 0x56172aa41620 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bc49c1740 10 client.0 _ll_register_callbacks cb 0x56172a938430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa39e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa39e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59454/0 (socket says 172.21.15.79:59454) 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 -- 172.21.15.79:0/1846554204 learned_addr learned my addr 172.21.15.79:0/1846554204 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbbfff640 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 0x56172aa41aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 -- 172.21.15.79:0/1846554204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 msgr2=0x56172aa41aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 0x56172aa41aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 -- 172.21.15.79:0/1846554204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 msgr2=0x56172aa448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 -- 172.21.15.79:0/1846554204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56172a75b7d0 con 0x56172aa43c30 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa39e90 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0071120 tx=0x7f2bb0006d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5edd4a12a9090ee server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2b9a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/1846554204 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0020040 con 0x56172aa43c30 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/1846554204 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f2bb0082d30 con 0x56172aa43c30 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.066+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1846554204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bb0057250 con 0x56172aa43c30 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/1846554204 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f2bb0078020 con 0x56172aa43c30 2024-06-10T00:25:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bc49c1740 10 client.8697 fetch_fsmap learned FSMap version 89 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1846554204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x56172a6913f0 con 0x56172aa43c30 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/1846554204 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb0057250 con 0x56172aa43c30 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/1846554204 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f2bb0079030 con 0x56172aa43c30 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bc49c1740 10 client.8697 fetch_fsmap finished waiting for FSMap version 89 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bc49c1740 10 client.8697 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bc49c1740 20 client.8697 populate_metadata read hostname 'smithi079' 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x56172aa47320 0x56172aa47750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bc49c1740 4 client.8697 mds_command: new command op to 8556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1846554204 --> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56172a98b5b0 con 0x56172aa47320 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x56172aa47320 0x56172aa47750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x56172aa47320 0x56172aa47750 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e63a791e78fdfae server_cookie=2e68e25c1627357f in_seq=0 out_seq=0 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.067+0000 7f2b9a7fc640 10 client.8697 ms_handle_connect on v2:172.21.15.79:6835/1367694301 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/1846554204 <== mds.0 v2:172.21.15.79:6835/1367694301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56172a98b5b0 con 0x56172aa47320 2024-06-10T00:25:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2b9a7fc640 10 client.8697 handle_command_reply: tid=0 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 client.8697 shutdown 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1846554204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 msgr2=0x56172aa39e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa39e90 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0071120 tx=0x7f2bb0006d40 comp rx=0 tx=0).stop 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1846554204 shutdown_connections 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x56172aa47320 0x56172aa47750 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 0x56172aa41aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa39e90 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2b9a7fc640 0 client.8697 ms_handle_reset on v2:172.21.15.79:6835/1367694301 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1846554204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1846554204 >> 172.21.15.79:0/1846554204 conn(0x56172aa1c6d0 msgr2=0x56172aa3b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1846554204 shutdown_connections 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1846554204 wait complete. 2024-06-10T00:25:04.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.068+0000 7f2bc49c1740 20 client.8697 trim_cache size 0 max 16384 2024-06-10T00:25:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.083+0000 7f2bc49c1740 1 Processor -- start 2024-06-10T00:25:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.083+0000 7f2bc49c1740 1 -- start start 2024-06-10T00:25:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa3daf0 0x56172aa63860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa41620 0x56172aa46190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa43c30 0x56172aa466d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56172aa3bb70 con 0x56172aa3daf0 2024-06-10T00:25:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1fcaf0 con 0x56172aa41620 2024-06-10T00:25:04.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc1fbb90 con 0x56172aa43c30 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa3daf0 0x56172aa63860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa3daf0 0x56172aa63860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59460/0 (socket says 172.21.15.79:59460) 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 -- 172.21.15.79:0/1472182945 learned_addr learned my addr 172.21.15.79:0/1472182945 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa41620 0x56172aa46190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbbfff640 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa43c30 0x56172aa466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 -- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa43c30 msgr2=0x56172aa466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa43c30 0x56172aa466d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 -- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa41620 msgr2=0x56172aa46190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa41620 0x56172aa46190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 -- 172.21.15.79:0/1472182945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56172a6510f0 con 0x56172aa3daf0 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa41620 0x56172aa46190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.084+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa3daf0 0x56172aa63860 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b2c0 tx=0x7f2bac031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e361705e96b1a60 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2ba0ff9640 1 -- 172.21.15.79:0/1472182945 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac036040 con 0x56172aa3daf0 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2ba0ff9640 1 -- 172.21.15.79:0/1472182945 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bac053780 con 0x56172aa3daf0 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2ba0ff9640 1 -- 172.21.15.79:0/1472182945 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac053b30 con 0x56172aa3daf0 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1472182945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa3daf0 msgr2=0x56172aa63860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa3daf0 0x56172aa63860 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b2c0 tx=0x7f2bac031000 comp rx=0 tx=0).stop 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1472182945 shutdown_connections 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa43c30 0x56172aa466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa41620 0x56172aa46190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/1472182945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa3daf0 0x56172aa63860 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1472182945 >> 172.21.15.79:0/1472182945 conn(0x56172aa1c6d0 msgr2=0x56172aa10830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1472182945 shutdown_connections 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.085+0000 7f2bc49c1740 1 -- 172.21.15.79:0/1472182945 wait complete. 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.086+0000 7f2bc49c1740 1 -- start start 2024-06-10T00:25:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.086+0000 7f2bc49c1740 1 Processor -- start 2024-06-10T00:25:04.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa3adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 0x56172aa45fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bc49c1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc150c50 con 0x56172aa43c30 2024-06-10T00:25:04.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc14e4e0 con 0x56172aa3daf0 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bc49c1740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56172aa16f30 con 0x56172aa41620 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bc49c1740 10 client.0 _ll_register_callbacks cb 0x7f2bb0058b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59470/0 (socket says 172.21.15.79:59470) 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 -- 172.21.15.79:0/2926524667 learned_addr learned my addr 172.21.15.79:0/2926524667 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbaffd640 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 0x56172aa45fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa3adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 -- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 msgr2=0x56172aa45fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 0x56172aa45fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 -- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 msgr2=0x56172aa3adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa3adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 -- 172.21.15.79:0/2926524667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56172a944560 con 0x56172aa43c30 2024-06-10T00:25:04.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa3adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bbbfff640 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa430f0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005910 tx=0x7f2bb40157e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2060126e853483f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2b9a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/2926524667 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4017640 con 0x56172aa43c30 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/2926524667 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f2bb4020c90 con 0x56172aa43c30 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.087+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2926524667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bac053780 con 0x56172aa43c30 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/2926524667 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f2bb40177e0 con 0x56172aa43c30 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bc49c1740 10 client.8703 fetch_fsmap learned FSMap version 89 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2926524667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x56172aa19720 con 0x56172aa43c30 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/2926524667 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bac053780 con 0x56172aa43c30 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/2926524667 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f2bb4017980 con 0x56172aa43c30 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bc49c1740 10 client.8703 fetch_fsmap finished waiting for FSMap version 89 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bc49c1740 10 client.8703 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-06-10T00:25:04.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bc49c1740 20 client.8703 populate_metadata read hostname 'smithi079' 2024-06-10T00:25:04.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x56172aa43630 0x56172aa2cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bc49c1740 4 client.8703 mds_command: new command op to 8556 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-10T00:25:04.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2926524667 --> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56172a985900 con 0x56172aa43630 2024-06-10T00:25:04.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x56172aa43630 0x56172aa2cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2b9a7fc640 10 client.8703 ms_handle_connect on v2:172.21.15.79:6835/1367694301 2024-06-10T00:25:04.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.088+0000 7f2bbb7fe640 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x56172aa43630 0x56172aa2cb30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afcb4de2d9a26e21 server_cookie=228a9f396b8cd834 in_seq=0 out_seq=0 2024-06-10T00:25:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2b9a7fc640 1 -- 172.21.15.79:0/2926524667 <== mds.0 v2:172.21.15.79:6835/1367694301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56172a985900 con 0x56172aa43630 2024-06-10T00:25:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2b9a7fc640 10 client.8703 handle_command_reply: tid=0 2024-06-10T00:25:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 client.8703 shutdown 2024-06-10T00:25:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2926524667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 msgr2=0x56172aa430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa430f0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005910 tx=0x7f2bb40157e0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2926524667 shutdown_connections 2024-06-10T00:25:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.79:6835/1367694301,v1:172.21.15.79:6837/1367694301] conn(0x56172aa43630 0x56172aa2cb30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56172aa43c30 0x56172aa430f0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56172aa41620 0x56172aa45fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2b9a7fc640 0 client.8703 ms_handle_reset on v2:172.21.15.79:6835/1367694301 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 --2- 172.21.15.79:0/2926524667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56172aa3daf0 0x56172aa3adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2926524667 >> 172.21.15.79:0/2926524667 conn(0x56172aa1c6d0 msgr2=0x56172aa10830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2926524667 shutdown_connections 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 1 -- 172.21.15.79:0/2926524667 wait complete. 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.097+0000 7f2bc49c1740 20 client.8703 trim_cache size 0 max 16384 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0 2024-06-10T00:25:04.098 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:04.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba806be30 msgr2=0x7f2ba806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba806be30 0x7f2ba806e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2bac037000 tx=0x7f2bac03d040 comp rx=0 tx=0).stop 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc0d0560 msgr2=0x7f2bbc0afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc0d0560 0x7f2bbc0afa60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000e7e0 tx=0x7f2bb000eca0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3340681943 shutdown_connections 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f2ba806be30 0x7f2ba806e2f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bbc155320 0x7f2bbc152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bbc0d0560 0x7f2bbc0afa60 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 --2- 172.21.15.79:0/3340681943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0b34e0 0x7f2bbc140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3340681943 >> 172.21.15.79:0/3340681943 conn(0x7f2bbc0b1d10 msgr2=0x7f2bbc1549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3340681943 shutdown_connections 2024-06-10T00:25:04.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.098+0000 7f2bc1cb3640 1 -- 172.21.15.79:0/3340681943 wait complete. 2024-06-10T00:25:04.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:25:04.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.209+0000 7f35573e3640 1 Processor -- start 2024-06-10T00:25:04.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.209+0000 7f35573e3640 1 -- start start 2024-06-10T00:25:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f35573e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 0x7f35500b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f35573e3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355006d160 con 0x7f35500cc680 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f35573e3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355006d440 con 0x7f35500b4b20 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f35573e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f355006dd70 con 0x7f3550165bf0 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f3555980640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f35500cc680 0x7f35500ccb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45166/0 (socket says 172.21.15.79:45166) 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f3555980640 1 -- 172.21.15.79:0/74704923 learned_addr learned my addr 172.21.15.79:0/74704923 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f355517f640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 0x7f35500b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443247622 0 0) 0x7f355006d160 con 0x7f35500cc680 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.210+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f353c003520 con 0x7f35500cc680 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 252726693 0 0) 0x7f353c003520 con 0x7f35500cc680 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 msgr2=0x7f35500b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 0x7f35500b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 >> v1:172.21.15.117:6789/0 conn(0x7f35500b4b20 legacy=0x7f355006e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355006d720 con 0x7f35500cc680 2024-06-10T00:25:04.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f35480019f0 con 0x7f35500cc680 2024-06-10T00:25:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 >> v1:172.21.15.79:6789/0 conn(0x7f35500cc680 legacy=0x7f35500ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 0x7f353c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f353c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353c004d40 0x7f353c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f355006dd70 con 0x7f353c003f20 2024-06-10T00:25:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f353c00ba20 con 0x7f353c004d40 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f353c00bc20 con 0x7f3550165bf0 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f355497e640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f353c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3555980640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353c004d40 0x7f353c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f355517f640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 0x7f353c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f355497e640 1 -- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 msgr2=0x7f353c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f355497e640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 0x7f353c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f355497e640 1 -- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353c004d40 msgr2=0x7f353c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f355497e640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353c004d40 0x7f353c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f355497e640 1 -- 172.21.15.79:0/74704923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c003520 con 0x7f353c003f20 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f355517f640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3550165bf0 0x7f353c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.211+0000 7f3555980640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353c004d40 0x7f353c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f355497e640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f353c004800 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f3540001860 tx=0x7f353c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b83a95e53f18f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540037070 con 0x7f353c003f20 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354002ab60 con 0x7f353c003f20 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f3547fff640 1 -- 172.21.15.79:0/74704923 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540001430 con 0x7f353c003f20 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f35573e3640 1 -- 172.21.15.79:0/74704923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 msgr2=0x7f353c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f35573e3640 1 --2- 172.21.15.79:0/74704923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f353c004800 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f3540001860 tx=0x7f353c005830 comp rx=0 tx=0).stop 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f3555980640 1 -- 172.21.15.79:0/74704923 reap_dead start 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f35573e3640 1 -- 172.21.15.79:0/74704923 shutdown_connections 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.212+0000 7f35573e3640 1 -- 172.21.15.79:0/74704923 >> 172.21.15.79:0/74704923 conn(0x7f35500b19f0 msgr2=0x7f35500b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.213+0000 7f35573e3640 1 -- 172.21.15.79:0/74704923 shutdown_connections 2024-06-10T00:25:04.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.213+0000 7f35573e3640 1 -- 172.21.15.79:0/74704923 wait complete. 2024-06-10T00:25:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f35573e3640 1 Processor -- start 2024-06-10T00:25:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f35573e3640 1 -- start start 2024-06-10T00:25:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f35573e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f3550150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f35573e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35501533f0 0x7f3550153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f35573e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3550153d90 0x7f3550152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f35573e3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f355006e910 con 0x7f353c003f20 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f35573e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35500b4f80 con 0x7f3550153d90 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f35573e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35500b3b50 con 0x7f35501533f0 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f355517f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f3550150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f355517f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f3550150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59486/0 (socket says 172.21.15.79:59486) 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.214+0000 7f355517f640 1 -- 172.21.15.79:0/3987698748 learned_addr learned my addr 172.21.15.79:0/3987698748 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f355497e640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35501533f0 0x7f3550153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f3555980640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3550153d90 0x7f3550152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f355517f640 1 -- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35501533f0 msgr2=0x7f3550153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f355517f640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35501533f0 0x7f3550153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f355517f640 1 -- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3550153d90 msgr2=0x7f3550152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f355517f640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3550153d90 0x7f3550152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f355517f640 1 -- 172.21.15.79:0/3987698748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35500d02b0 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f355497e640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35501533f0 0x7f3550153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f3555980640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3550153d90 0x7f3550152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f355517f640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f3550150c50 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f354c011700 tx=0x7f354c011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f3545ffb640 1 -- 172.21.15.79:0/3987698748 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00f960 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f3545ffb640 1 -- 172.21.15.79:0/3987698748 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c00fb00 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3550151540 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f3545ffb640 1 -- 172.21.15.79:0/3987698748 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c015460 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.215+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3550151b00 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.216+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3550068430 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.217+0000 7f3545ffb640 1 -- 172.21.15.79:0/3987698748 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f354c015600 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.217+0000 7f3545ffb640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f353406be30 0x7f353406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.217+0000 7f355497e640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f353406be30 0x7f353406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.217+0000 7f3545ffb640 1 -- 172.21.15.79:0/3987698748 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f354c08b9c0 con 0x7f353c003f20 2024-06-10T00:25:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.218+0000 7f355497e640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f353406be30 0x7f353406e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3540034000 tx=0x7f3540009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.222+0000 7f3545ffb640 1 -- 172.21.15.79:0/3987698748 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f354c08de20 con 0x7f353c003f20 2024-06-10T00:25:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.435+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f35500732f0 con 0x7f353c003f20 2024-06-10T00:25:04.435 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:25:04.435+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:25:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.437+0000 7f3545ffb640 1 -- 172.21.15.79:0/3987698748 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) ==== 161+0+0 (secure 0 0 0) 0x7f354c019030 con 0x7f353c003f20 2024-06-10T00:25:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:25:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f353406be30 msgr2=0x7f353406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f353406be30 0x7f353406e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3540034000 tx=0x7f3540009030 comp rx=0 tx=0).stop 2024-06-10T00:25:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 msgr2=0x7f3550150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f3550150c50 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f354c011700 tx=0x7f354c011bc0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 shutdown_connections 2024-06-10T00:25:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f353406be30 0x7f353406e2f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3550153d90 0x7f3550152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35501533f0 0x7f3550153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 --2- 172.21.15.79:0/3987698748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c003f20 0x7f3550150c50 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 >> 172.21.15.79:0/3987698748 conn(0x7f35500b19f0 msgr2=0x7f355006ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 shutdown_connections 2024-06-10T00:25:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.439+0000 7f35573e3640 1 -- 172.21.15.79:0/3987698748 wait complete. 2024-06-10T00:25:04.441 INFO:tasks.ceph.mds.a.smithi079.stderr: -2217> 2024-06-10T00:24:54.385+0000 7f27441df640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:25:04.451 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-06-10T00:25:04.468 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:25:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.493+0000 7ff3d72b2280 1 -- start start 2024-06-10T00:25:04.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.493+0000 7ff3d72b2280 1 Processor -- start 2024-06-10T00:25:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048c9c6c00 0x56048ca3e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048c9c7800 0x56048ca3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048c9c7c00 0x56048ca3f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56048d7b0180 con 0x56048c9c7c00 2024-06-10T00:25:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56048d7b0300 con 0x56048c9c7800 2024-06-10T00:25:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56048d7b0480 con 0x56048c9c6c00 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048c9c7c00 0x56048ca3f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048c9c7c00 0x56048ca3f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59526/0 (socket says 172.21.15.79:59526) 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 -- 172.21.15.79:0/348559270 learned_addr learned my addr 172.21.15.79:0/348559270 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 -- 172.21.15.79:0/348559270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048c9c6c00 msgr2=0x56048ca3e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 --2- 172.21.15.79:0/348559270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048c9c6c00 0x56048ca3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 -- 172.21.15.79:0/348559270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048c9c7800 msgr2=0x56048ca3eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 --2- 172.21.15.79:0/348559270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048c9c7800 0x56048ca3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 -- 172.21.15.79:0/348559270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56048c9fc780 con 0x56048c9c7c00 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d6261640 1 --2- 172.21.15.79:0/348559270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048c9c7c00 0x56048ca3f080 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x56048d7f32c0 tx=0x56048d760840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ea4776e44e59bb server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d325b640 1 -- 172.21.15.79:0/348559270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56048c9ec9c0 con 0x56048c9c7c00 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d325b640 1 -- 172.21.15.79:0/348559270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56048c9f2fc0 con 0x56048c9c7c00 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d325b640 1 -- 172.21.15.79:0/348559270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56048c9ec680 con 0x56048c9c7c00 2024-06-10T00:25:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.494+0000 7ff3d72b2280 1 -- 172.21.15.79:0/348559270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56048c9fc3c0 con 0x56048c9c7c00 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d72b2280 1 -- 172.21.15.79:0/348559270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56048c9fd680 con 0x56048c9c7c00 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d72b2280 4 waiting for MDS map... 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d325b640 1 -- 172.21.15.79:0/348559270 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x56048d8a0200 con 0x56048c9c7c00 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d325b640 1 -- 172.21.15.79:0/348559270 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x56048ca21180 con 0x56048c9c7c00 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d72b2280 4 Got MDS map 90 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d72b2280 10 main: JournalTool::main 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d72b2280 4 main: JournalTool: connecting to RADOS... 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d72b2280 1 Processor -- start 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.495+0000 7ff3d72b2280 1 -- start start 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa000 0x56048ca3f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 0x56048ca3fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa800 0x56048ca40100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56048d7b0600 con 0x56048d8fa000 2024-06-10T00:25:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56048d7b0780 con 0x56048d8fa800 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56048d7b0900 con 0x56048d8fa400 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa000 0x56048ca3f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa000 0x56048ca3f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59536/0 (socket says 172.21.15.79:59536) 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 -- 172.21.15.79:0/2626755454 learned_addr learned my addr 172.21.15.79:0/2626755454 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa800 0x56048ca40100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 0x56048ca3fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 -- 172.21.15.79:0/2626755454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 msgr2=0x56048ca3fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 0x56048ca3fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 -- 172.21.15.79:0/2626755454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa800 msgr2=0x56048ca40100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa800 0x56048ca40100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 -- 172.21.15.79:0/2626755454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56048c9fd4a0 con 0x56048d8fa000 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.496+0000 7ff3d525f640 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa000 0x56048ca3f600 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x56048d8ae900 tx=0x56048d8b2c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96b6cf311d0a2a0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d1257640 1 -- 172.21.15.79:0/2626755454 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56048c9ec9c0 con 0x56048d8fa000 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d1257640 1 -- 172.21.15.79:0/2626755454 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56048c9f2c40 con 0x56048d8fa000 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d1257640 1 -- 172.21.15.79:0/2626755454 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56048c9ec680 con 0x56048d8fa000 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 -- 172.21.15.79:0/2626755454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa000 msgr2=0x56048ca3f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa000 0x56048ca3f600 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x56048d8ae900 tx=0x56048d8b2c60 comp rx=0 tx=0).stop 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 -- 172.21.15.79:0/2626755454 shutdown_connections 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa800 0x56048ca40100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 0x56048ca3fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/2626755454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa000 0x56048ca3f600 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 -- 172.21.15.79:0/2626755454 >> 172.21.15.79:0/2626755454 conn(0x56048d7b9c00 msgr2=0x56048cab9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 -- 172.21.15.79:0/2626755454 shutdown_connections 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 -- 172.21.15.79:0/2626755454 wait complete. 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.497+0000 7ff3d72b2280 1 Processor -- start 2024-06-10T00:25:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d72b2280 1 -- start start 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa000 0x56048ca41180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 0x56048ca40c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa800 0x56048ca40680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56048d7b1c80 con 0x56048d8fa800 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56048d7b1b00 con 0x56048d8fa000 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56048d7b1980 con 0x56048d8fa400 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa800 0x56048ca40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa800 0x56048ca40680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59548/0 (socket says 172.21.15.79:59548) 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 -- 172.21.15.79:0/1317693502 learned_addr learned my addr 172.21.15.79:0/1317693502 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa000 0x56048ca41180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 0x56048ca40c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 -- 172.21.15.79:0/1317693502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 msgr2=0x56048ca40c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 0x56048ca40c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 -- 172.21.15.79:0/1317693502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa000 msgr2=0x56048ca41180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa000 0x56048ca41180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.498+0000 7ff3d525f640 1 -- 172.21.15.79:0/1317693502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56048c9fc000 con 0x56048d8fa800 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.499+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa800 0x56048ca40680 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x56048d8af5c0 tx=0x56048d760a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.499+0000 7ff3cfa54640 1 -- 172.21.15.79:0/1317693502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56048c9ec4e0 con 0x56048d8fa800 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.499+0000 7ff3cfa54640 1 -- 172.21.15.79:0/1317693502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56048c9f21c0 con 0x56048d8fa800 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.499+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1317693502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56048c9fc960 con 0x56048d8fa800 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.499+0000 7ff3cfa54640 1 -- 172.21.15.79:0/1317693502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56048c9ec9c0 con 0x56048d8fa800 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.499+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1317693502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56048c9fd860 con 0x56048d8fa800 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.499+0000 7ff3d72b2280 4 main: JournalTool: resolving pool 17 2024-06-10T00:25:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.500+0000 7ff3cfa54640 1 -- 172.21.15.79:0/1317693502 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56048d906c00 con 0x56048d8fa800 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.500+0000 7ff3cfa54640 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x56048cd4c000 0x56048ca41700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.500+0000 7ff3cfa54640 1 -- 172.21.15.79:0/1317693502 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x56048d904a00 con 0x56048d8fa800 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.500+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x56048cd4c000 0x56048ca41700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.500+0000 7ff3d72b2280 4 main: JournalTool: creating IoCtx.. 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.500+0000 7ff3d72b2280 4 main: Executing for rank 0 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.501+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x56048cd4c000 0x56048ca41700 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x56048cabe8a0 tx=0x56048cd56000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.501+0000 7ff3d72b2280 1 -- start start 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.501+0000 7ff3d72b2280 1 Processor -- start 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fb000 0x56048ca40100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048cd4d000 0x56048ca3fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048cd4d400 0x56048ca3f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56048d7b1680 con 0x56048cd4d400 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56048d7b0600 con 0x56048cd4d000 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56048d7b0780 con 0x56048d8fb000 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048cd4d400 0x56048ca3f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048cd4d400 0x56048ca3f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59550/0 (socket says 172.21.15.79:59550) 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 -- 172.21.15.79:0/1330293201 learned_addr learned my addr 172.21.15.79:0/1330293201 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048cd4d000 0x56048ca3fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d6261640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fb000 0x56048ca40100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 -- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fb000 msgr2=0x56048ca40100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fb000 0x56048ca40100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 -- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048cd4d000 msgr2=0x56048ca3fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048cd4d000 0x56048ca3fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56048c9fda40 con 0x56048cd4d400 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048cd4d400 0x56048ca3f600 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x56048d94f5f0 tx=0x56048d8b3680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14286da983cdc5d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3cca4e640 1 -- 172.21.15.79:0/1330293201 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56048cce0d00 con 0x56048cd4d400 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3cca4e640 1 -- 172.21.15.79:0/1330293201 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56048c9f28c0 con 0x56048cd4d400 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56048c9fc960 con 0x56048cd4d400 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56048c9fd860 con 0x56048cd4d400 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3d72b2280 4 waiting for MDS map... 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.502+0000 7ff3cca4e640 1 -- 172.21.15.79:0/1330293201 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56048cce0ea0 con 0x56048cd4d400 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.503+0000 7ff3cca4e640 1 -- 172.21.15.79:0/1330293201 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x56048cdb0600 con 0x56048cd4d400 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.503+0000 7ff3cca4e640 1 -- 172.21.15.79:0/1330293201 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x56048ca21500 con 0x56048cd4d400 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.503+0000 7ff3d72b2280 4 Got MDS map 90 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.503+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x56048cd4d800 0x56048cdc4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.503+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:1 17.f 17:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cd4dc00 con 0x56048cd4d800 2024-06-10T00:25:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.503+0000 7ff3d6261640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x56048cd4d800 0x56048cdc4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.503+0000 7ff3d6261640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x56048cd4d800 0x56048cdc4000 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=503b2dc8798a2e5a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.504+0000 7ff3d6261640 1 -- 172.21.15.79:0/1330293201 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v121'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c000 con 0x56048cd4d800 2024-06-10T00:25:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.504+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x56048cdc2400 0x56048cdc4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.504+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:2 17.14 17:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cdc2800 con 0x56048cdc2400 2024-06-10T00:25:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.505+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x56048cdc2400 0x56048cdc4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.505+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x56048cdc2400 0x56048cdc4580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=36044cbbd0831d0d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d5a60640 1 -- 172.21.15.79:0/1330293201 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v121'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c500 con 0x56048cdc2400 2024-06-10T00:25:04.513 INFO:teuthology.orchestra.run.smithi079.stdout:writing EResetJournal entry 2024-06-10T00:25:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:3 17.14 17:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cdc2c00 con 0x56048cdc2400 2024-06-10T00:25:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56048cdc3000 0x56048cdc4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:4 17.1b 17:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cdc3400 con 0x56048cdc3000 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x56048cdc3800 0x56048cdc5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:5 17.b 17:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cdc3c00 con 0x56048cdc3800 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x56048cdd8000 0x56048cdc5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:6 17.1f 17:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cdd8400 con 0x56048cdd8000 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:7 17.1a 17:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cdd8800 con 0x56048cdc3800 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:8 17.1e 17:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cdd8c00 con 0x56048cd4d800 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x56048cdc3800 0x56048cdc5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.508+0000 7ff3d6261640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56048cdc3000 0x56048cdc4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.509+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x56048cdd8000 0x56048cdc5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.509+0000 7ff3d5a60640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x56048cdc3800 0x56048cdc5080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=511fc4d7b4ea869a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.509+0000 7ff3d6261640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56048cdc3000 0x56048cdc4b00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=ed4ee1ea766c12d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.509+0000 7ff3d525f640 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x56048cdd8000 0x56048cdc5600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=f3b46c57459be3e9 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.510+0000 7ff3d5a60640 1 -- 172.21.15.79:0/1330293201 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== osd_op_reply(3 200.00000001 [delete] v121'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c500 con 0x56048cdc2400 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.510+0000 7ff3d6261640 1 -- 172.21.15.79:0/1330293201 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== osd_op_reply(8 200.00000006 [delete] v121'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c000 con 0x56048cd4d800 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.510+0000 7ff3d5a60640 1 -- 172.21.15.79:0/1330293201 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(7 200.00000005 [delete] v121'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c500 con 0x56048cdc3800 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.510+0000 7ff3d5a60640 1 -- 172.21.15.79:0/1330293201 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== osd_op_reply(5 200.00000003 [delete] v121'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c500 con 0x56048cdc3800 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.510+0000 7ff3d6261640 1 -- 172.21.15.79:0/1330293201 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(4 200.00000002 [delete] v121'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c000 con 0x56048cdc3000 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.510+0000 7ff3cb24b640 1 -- 172.21.15.79:0/1330293201 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:9 17.14 17:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56048cd4cc00 con 0x56048cdc2400 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.512+0000 7ff3d5a60640 1 -- 172.21.15.79:0/1330293201 <== osd.3 v2:172.21.15.79:6800/4145020298 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v121'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c500 con 0x56048cdc2400 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d525f640 1 -- 172.21.15.79:0/1330293201 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(6 200.00000004 [delete] v121'9 uv8 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56048cb3c780 con 0x56048cdd8000 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 4 Successfully wrote new journal pointer and header for rank 8:0 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x56048cdc3800 msgr2=0x56048cdc5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x56048cdc3800 0x56048cdc5080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x56048cd4d800 msgr2=0x56048cdc4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x56048cd4d800 0x56048cdc4000 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x56048cdc2400 msgr2=0x56048cdc4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x56048cdc2400 0x56048cdc4580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56048cdc3000 msgr2=0x56048cdc4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x56048cdc3000 0x56048cdc4b00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x56048cdd8000 msgr2=0x56048cdc5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x56048cdd8000 0x56048cdc5600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048cd4d400 msgr2=0x56048ca3f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1330293201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048cd4d400 0x56048ca3f600 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x56048d94f5f0 tx=0x56048d8b3680 comp rx=0 tx=0).stop 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d525f640 1 -- 172.21.15.79:0/1330293201 reap_dead start 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 shutdown_connections 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d525f640 1 -- 172.21.15.79:0/1330293201 reap_dead start 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.513+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 >> 172.21.15.79:0/1330293201 conn(0x56048d8fac00 msgr2=0x56048cab9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d525f640 1 -- 172.21.15.79:0/1330293201 reap_dead start 2024-06-10T00:25:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 shutdown_connections 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1330293201 wait complete. 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x56048cd4c000 msgr2=0x56048ca41700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x56048cd4c000 0x56048ca41700 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x56048cabe8a0 tx=0x56048cd56000 comp rx=0 tx=0).stop 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa800 msgr2=0x56048ca40680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa800 0x56048ca40680 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x56048d8af5c0 tx=0x56048d760a20 comp rx=0 tx=0).stop 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1317693502 shutdown_connections 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x56048cd4c000 0x56048ca41700 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048d8fa800 0x56048ca40680 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048d8fa400 0x56048ca40c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/1317693502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048d8fa000 0x56048ca41180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1317693502 >> 172.21.15.79:0/1317693502 conn(0x56048d7b9c00 msgr2=0x56048cab9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1317693502 shutdown_connections 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/1317693502 wait complete. 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/348559270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048c9c7c00 msgr2=0x56048ca3f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/348559270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048c9c7c00 0x56048ca3f080 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x56048d7f32c0 tx=0x56048d760840 comp rx=0 tx=0).stop 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/348559270 shutdown_connections 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/348559270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56048c9c7c00 0x56048ca3f080 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/348559270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56048c9c7800 0x56048ca3eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 --2- 172.21.15.79:0/348559270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56048c9c6c00 0x56048ca3e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/348559270 >> 172.21.15.79:0/348559270 conn(0x56048c9c7000 msgr2=0x56048cab8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/348559270 shutdown_connections 2024-06-10T00:25:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.514+0000 7ff3d72b2280 1 -- 172.21.15.79:0/348559270 wait complete. 2024-06-10T00:25:04.522 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.071627, result: writing EResetJournal entry 2024-06-10T00:25:04.523 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-06-10T00:25:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.597+0000 7f90a531b740 1 -- start start 2024-06-10T00:25:04.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.597+0000 7f90a531b740 1 Processor -- start 2024-06-10T00:25:04.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a531b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b595d6c00 0x561b59652580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a531b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b595d7800 0x561b59652b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a531b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b595d7c00 0x561b59653080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a531b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561b5a3c0180 con 0x561b595d7c00 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a531b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561b5a3c0300 con 0x561b595d7800 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a531b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561b5a3c0480 con 0x561b595d6c00 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b595d7c00 0x561b59653080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b595d7c00 0x561b59653080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59568/0 (socket says 172.21.15.79:59568) 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 -- 172.21.15.79:0/2504224650 learned_addr learned my addr 172.21.15.79:0/2504224650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a31f5640 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b595d6c00 0x561b59652580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a29f4640 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b595d7800 0x561b59652b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 -- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b595d6c00 msgr2=0x561b59652580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b595d6c00 0x561b59652580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 -- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b595d7800 msgr2=0x561b59652b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b595d7800 0x561b59652b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 -- 172.21.15.79:0/2504224650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b59603680 con 0x561b595d7c00 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a29f4640 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b595d7800 0x561b59652b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.598+0000 7f90a39f6640 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b595d7c00 0x561b59653080 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x561b5a3ffc50 tx=0x561b5a37aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1effc693d8cff0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a09f0640 1 -- 172.21.15.79:0/2504224650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b595fc680 con 0x561b595d7c00 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a09f0640 1 -- 172.21.15.79:0/2504224650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b5961ee00 con 0x561b595d7c00 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a09f0640 1 -- 172.21.15.79:0/2504224650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b595fcb60 con 0x561b595d7c00 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a531b740 1 -- 172.21.15.79:0/2504224650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b596034a0 con 0x561b595d7c00 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a531b740 1 -- 172.21.15.79:0/2504224650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561b59603a40 con 0x561b595d7c00 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a531b740 4 waiting for MDS map... 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a09f0640 1 -- 172.21.15.79:0/2504224650 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x561b5a4ba600 con 0x561b595d7c00 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a09f0640 1 -- 172.21.15.79:0/2504224650 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x561b5962f180 con 0x561b595d7c00 2024-06-10T00:25:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a531b740 4 Got MDS map 90 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a531b740 4 datascan.main: Using metadata pool output 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a531b740 4 datascan.main: connecting to RADOS... 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.599+0000 7f90a531b740 1 Processor -- start 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a531b740 1 -- start start 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a531b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd400 0x561b59653600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a531b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bd800 0x561b59653b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a531b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bdc00 0x561b59654100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a531b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561b5a3c0600 con 0x561b5a4bd800 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a531b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561b5a3c0780 con 0x561b5a4bd400 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a531b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561b5a3c0900 con 0x561b5a4bdc00 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a31f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bd800 0x561b59653b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a31f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bd800 0x561b59653b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59570/0 (socket says 172.21.15.79:59570) 2024-06-10T00:25:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a31f5640 1 -- 172.21.15.79:0/4248500866 learned_addr learned my addr 172.21.15.79:0/4248500866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a29f4640 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd400 0x561b59653600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a29f4640 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bdc00 0x561b59654100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a31f5640 1 -- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bdc00 msgr2=0x561b59654100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a31f5640 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bdc00 0x561b59654100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a31f5640 1 -- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd400 msgr2=0x561b59653600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.600+0000 7f90a31f5640 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd400 0x561b59653600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a31f5640 1 -- 172.21.15.79:0/4248500866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b59603860 con 0x561b5a4bd800 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a29f4640 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bdc00 0x561b59654100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a31f5640 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bd800 0x561b59653b80 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x561b5a3ff1d0 tx=0x561b5a376ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69b14c8047a187e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f909e9ec640 1 -- 172.21.15.79:0/4248500866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b595fc9c0 con 0x561b5a4bd800 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f909e9ec640 1 -- 172.21.15.79:0/4248500866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b5961ec40 con 0x561b5a4bd800 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f909e9ec640 1 -- 172.21.15.79:0/4248500866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b595fc680 con 0x561b5a4bd800 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 -- 172.21.15.79:0/4248500866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bd800 msgr2=0x561b59653b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bd800 0x561b59653b80 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x561b5a3ff1d0 tx=0x561b5a376ae0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 -- 172.21.15.79:0/4248500866 shutdown_connections 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bdc00 0x561b59654100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bd800 0x561b59653b80 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 --2- 172.21.15.79:0/4248500866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd400 0x561b59653600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 -- 172.21.15.79:0/4248500866 >> 172.21.15.79:0/4248500866 conn(0x561b5a4bd000 msgr2=0x561b5a361000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 -- 172.21.15.79:0/4248500866 shutdown_connections 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.601+0000 7f90a531b740 1 -- 172.21.15.79:0/4248500866 wait complete. 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a531b740 1 Processor -- start 2024-06-10T00:25:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a531b740 1 -- start start 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a531b740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bd400 0x561b59655180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a531b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd800 0x561b59654c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a531b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bdc00 0x561b59654680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a531b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561b5a3c1b00 con 0x561b5a4bdc00 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a531b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561b5a3c1980 con 0x561b5a4bd800 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a531b740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561b5a3c1800 con 0x561b5a4bd400 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.602+0000 7f90a29f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bdc00 0x561b59654680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bdc00 0x561b59654680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59578/0 (socket says 172.21.15.79:59578) 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 learned_addr learned my addr 172.21.15.79:0/929842648 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a31f5640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd800 0x561b59654c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bd400 0x561b59655180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bd400 msgr2=0x561b59655180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b5a4bd400 0x561b59655180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd800 msgr2=0x561b59654c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd800 0x561b59654c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b59603680 con 0x561b5a4bdc00 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a31f5640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b5a4bd800 0x561b59654c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bdc00 0x561b59654680 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x561b5a4a9830 tx=0x561b5a3b78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f909d1e9640 1 -- 172.21.15.79:0/929842648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b595fc9c0 con 0x561b5a4bdc00 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f909d1e9640 1 -- 172.21.15.79:0/929842648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b5961e540 con 0x561b5a4bdc00 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b596034a0 con 0x561b5a4bdc00 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f909d1e9640 1 -- 172.21.15.79:0/929842648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b595fc680 con 0x561b5a4bdc00 2024-06-10T00:25:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b596032c0 con 0x561b5a4bdc00 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.603+0000 7f90a531b740 4 datascan.init: resolving metadata pool 17 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.604+0000 7f909d1e9640 1 -- 172.21.15.79:0/929842648 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x561b5a51ec00 con 0x561b5a4bdc00 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f909d1e9640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x561b5a3e2c00 0x561b59655700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f909d1e9640 1 -- 172.21.15.79:0/929842648 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x561b5a538a00 con 0x561b5a4bdc00 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a531b740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a531b740 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a531b740 4 datascan.main: opening data pool 'cephfs_data' 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a31f5640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x561b5a3e2c00 0x561b59655700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x561b5a3e3000 0x561b59654100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3e3400 con 0x561b5a3e3000 2024-06-10T00:25:04.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x561b5a3e3000 0x561b59654100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a31f5640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x561b5a3e2c00 0x561b59655700 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x561b5a3ff1d0 tx=0x561b5a376a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x561b5a3e3000 0x561b59654100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.605+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(1 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.606+0000 7f909e1eb640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x561b59976000 0x561b5997c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.606+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:2 18.20 18:04000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59976400 con 0x561b59976000 2024-06-10T00:25:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.606+0000 7f90a39f6640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x561b59976000 0x561b5997c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.606+0000 7f90a39f6640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x561b59976000 0x561b5997c000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.606+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(2 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.607+0000 7f909e9ec640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x561b59976c00 0x561b5997c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.607+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:3 18.10 18:08000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977000 con 0x561b59976c00 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.607+0000 7f90a31f5640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x561b59976c00 0x561b5997c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.607+0000 7f90a31f5640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x561b59976c00 0x561b5997c580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.607+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(3 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a780 con 0x561b59976c00 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.607+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:4 18.30 18:0c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59976800 con 0x561b5a3e3000 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== osd_op_reply(4 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:5 18.8 18:10000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977400 con 0x561b5a3e3000 2024-06-10T00:25:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 3 ==== osd_op_reply(5 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:6 18.28 18:14000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977800 con 0x561b59976000 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 2 ==== osd_op_reply(6 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f909e9ec640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x561b59986000 0x561b5997cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:7 18.18 18:18000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986400 con 0x561b59986000 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x561b59986000 0x561b5997cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.608+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x561b59986000 0x561b5997cb00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.609+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(7 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.609+0000 7f909e1eb640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x561b59977c00 0x561b5997d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.609+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:8 18.38 18:1c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986400 con 0x561b59977c00 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.609+0000 7f90a39f6640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x561b59977c00 0x561b5997d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.609+0000 7f90a39f6640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x561b59977c00 0x561b5997d600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.609+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== osd_op_reply(8 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.609+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:9 18.4 18:20000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986800 con 0x561b5a3e3000 2024-06-10T00:25:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.610+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 4 ==== osd_op_reply(9 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.610+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:10 18.24 18:24000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59976800 con 0x561b5a3e3000 2024-06-10T00:25:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.610+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 5 ==== osd_op_reply(10 [pgnls start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.610+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:11 18.14 18:28000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986c00 con 0x561b59976c00 2024-06-10T00:25:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.610+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(11 [pgnls start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a780 con 0x561b59976c00 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.610+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:12 18.34 18:2c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977400 con 0x561b5a3e3000 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.610+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 6 ==== osd_op_reply(12 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.610+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:13 18.c 18:30000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59987000 con 0x561b59976000 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.611+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 3 ==== osd_op_reply(13 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.611+0000 7f909e1eb640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x561b5a3e3400 0x561b5997db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.611+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:14 18.2c 18:34000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986400 con 0x561b5a3e3400 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.611+0000 7f90a31f5640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x561b5a3e3400 0x561b5997db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.611+0000 7f90a31f5640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x561b5a3e3400 0x561b5997db80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.611+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== osd_op_reply(14 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a780 con 0x561b5a3e3400 2024-06-10T00:25:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.611+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:15 18.1c 18:38000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59987400 con 0x561b59986000 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.612+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== osd_op_reply(15 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.612+0000 7f909e1eb640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561b59987000 0x561b5997e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.612+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:16 18.3c 18:3c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59976400 con 0x561b59987000 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.612+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561b59987000 0x561b5997e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.612+0000 7f90a29f4640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561b59987000 0x561b5997e100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.613+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(16 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59987000 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.613+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:17 18.2 18:40000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59987800 con 0x561b59987000 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.613+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.7 v2:172.21.15.117:6816/2099086267 2 ==== osd_op_reply(17 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59987000 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.613+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:18 18.22 18:44000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977800 con 0x561b59977c00 2024-06-10T00:25:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.613+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== osd_op_reply(18 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.613+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:19 18.12 18:48000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59976800 con 0x561b5a3e3400 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.613+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.2 v2:172.21.15.79:6816/3079975341 2 ==== osd_op_reply(19 [pgnls start_epoch 121 out=81b] v120'22 uv22 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x561b5974a780 con 0x561b5a3e3400 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.613+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:20 18.12 18:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3e3800 con 0x561b5a3e3400 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.614+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.2 v2:172.21.15.79:6816/3079975341 3 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x561b5974a780 con 0x561b5a3e3400 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.614+0000 7f90a531b740 10 datascan.operator(): handling object 1099511627778.0 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.614+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:21 18.12 18:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3e3c00 con 0x561b5a3e3400 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.615+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.2 v2:172.21.15.79:6816/3079975341 4 ==== osd_op_reply(21 10000000002.00000000 [call] v121'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561b5974a780 con 0x561b5a3e3400 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.615+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:22 18.32 18:4c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986800 con 0x561b59977c00 2024-06-10T00:25:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.615+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 3 ==== osd_op_reply(22 [pgnls start_epoch 121 out=49b] v119'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.615+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:23 18.a 18:50000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977400 con 0x561b59977c00 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.615+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 4 ==== osd_op_reply(23 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.615+0000 7f909e1eb640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x561b5a4bc800 0x561b5997e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.615+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:24 18.2a 18:54000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6000 con 0x561b5a4bc800 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.616+0000 7f90a39f6640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x561b5a4bc800 0x561b5997e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.616+0000 7f90a39f6640 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x561b5a4bc800 0x561b5997e680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.616+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(24 [pgnls start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.616+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:25 18.1a 18:58000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59976400 con 0x561b59977c00 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.616+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 5 ==== osd_op_reply(25 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.616+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:26 18.3a 18:5c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6400 con 0x561b5a3e3000 2024-06-10T00:25:04.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.617+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 7 ==== osd_op_reply(26 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.617+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:27 18.6 18:60000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3c9400 con 0x561b59987000 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.617+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.7 v2:172.21.15.117:6816/2099086267 3 ==== osd_op_reply(27 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59987000 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.617+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:28 18.26 18:64000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6800 con 0x561b5a3e3400 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.617+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.2 v2:172.21.15.79:6816/3079975341 5 ==== osd_op_reply(28 [pgnls start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a780 con 0x561b5a3e3400 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.617+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:29 18.16 18:68000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3c9000 con 0x561b59977c00 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.618+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 6 ==== osd_op_reply(29 [pgnls start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.618+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:30 18.36 18:6c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6c00 con 0x561b59986000 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.618+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 3 ==== osd_op_reply(30 [pgnls start_epoch 121 out=81b] v119'33 uv17 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.618+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:31 18.36 18:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x561b59987400 con 0x561b59986000 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.618+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 4 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.618+0000 7f90a531b740 10 datascan.operator(): handling object 1099511628279.0 2024-06-10T00:25:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.618+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:32 18.36 18:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x561b59986c00 con 0x561b59986000 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.620+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 5 ==== osd_op_reply(32 100000001f7.00000000 [call] v121'34 uv34 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.620+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:33 18.e 18:70000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986400 con 0x561b5a3e3000 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.620+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 8 ==== osd_op_reply(33 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.620+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:34 18.2e 18:74000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a7000 con 0x561b59977c00 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.620+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 7 ==== osd_op_reply(34 [pgnls start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.620+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:35 18.1e 18:78000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977800 con 0x561b59976000 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.621+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 4 ==== osd_op_reply(35 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.621+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:36 18.3e 18:7c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a7400 con 0x561b59977c00 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.621+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 8 ==== osd_op_reply(36 [pgnls start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.621+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:37 18.1 18:80000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977400 con 0x561b59977c00 2024-06-10T00:25:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.621+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 9 ==== osd_op_reply(37 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.621+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:38 18.21 18:84000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6400 con 0x561b59976000 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.622+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 5 ==== osd_op_reply(38 [pgnls start_epoch 121 out=49b] v119'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.622+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:39 18.11 18:88000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59987800 con 0x561b59986000 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.622+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 6 ==== osd_op_reply(39 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.622+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:40 18.31 18:8c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6c00 con 0x561b5a4bc800 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.622+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== osd_op_reply(40 [pgnls start_epoch 121 out=81b] v119'15 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.622+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:41 18.31 18:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x561b59987c00 con 0x561b5a4bc800 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.623+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 3 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.623+0000 7f90a531b740 10 datascan.operator(): handling object 1099511627780.1 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.623+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:42 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x561b59977000 con 0x561b59986000 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.624+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 7 ==== osd_op_reply(42 10000000004.00000000 [call] v121'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.624+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:43 18.9 18:90000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a7000 con 0x561b59977c00 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.625+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 10 ==== osd_op_reply(43 [pgnls start_epoch 121 out=49b] v119'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.625+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:44 18.29 18:94000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6000 con 0x561b59987000 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.625+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.7 v2:172.21.15.117:6816/2099086267 4 ==== osd_op_reply(44 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59987000 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.625+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:45 18.19 18:98000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59987400 con 0x561b5a4bc800 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.625+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 4 ==== osd_op_reply(45 [pgnls start_epoch 121 out=81b] v120'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.625+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:46 18.19 18:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x561b599a7400 con 0x561b5a4bc800 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.626+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 5 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.626+0000 7f90a531b740 10 datascan.operator(): handling object 1099511628280.0 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.626+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:47 18.19 18:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6400 con 0x561b5a4bc800 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.627+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 6 ==== osd_op_reply(47 100000001f8.00000000 [call] v121'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.627+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:48 18.39 18:9c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6c00 con 0x561b5a3e3000 2024-06-10T00:25:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.627+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 9 ==== osd_op_reply(48 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.627+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:49 18.5 18:a0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986c00 con 0x561b59986000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.628+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 8 ==== osd_op_reply(49 [pgnls start_epoch 121 out=81b] v121'14 uv14 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.628+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:50 18.5 18:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x561b59987c00 con 0x561b59986000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.628+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 9 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.628+0000 7f90a531b740 10 datascan.operator(): handling object 1099511627780.0 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.628+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:51 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x561b59977800 con 0x561b59986000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.629+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 10 ==== osd_op_reply(51 10000000004.00000000 [call] v121'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.629+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:52 18.25 18:a4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977400 con 0x561b59976c00 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.629+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.6 v2:172.21.15.117:6808/1306883621 3 ==== osd_op_reply(52 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a780 con 0x561b59976c00 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.629+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:53 18.15 18:a8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986800 con 0x561b59976000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.630+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 6 ==== osd_op_reply(53 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.630+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:54 18.35 18:ac000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a7800 con 0x561b5a4bc800 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.630+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 7 ==== osd_op_reply(54 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.630+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:55 18.d 18:b0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6000 con 0x561b5a4bc800 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.630+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 8 ==== osd_op_reply(55 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.630+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:56 18.2d 18:b4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3c9400 con 0x561b59976c00 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.631+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.6 v2:172.21.15.117:6808/1306883621 4 ==== osd_op_reply(56 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a780 con 0x561b59976c00 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.631+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:57 18.1d 18:b8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6c00 con 0x561b5a3e3000 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.631+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.0 v2:172.21.15.79:6824/709635793 10 ==== osd_op_reply(57 [pgnls start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b5a3e3000 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.631+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:58 18.3d 18:bc000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3c9000 con 0x561b59977c00 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.631+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.3 v2:172.21.15.79:6800/4145020298 11 ==== osd_op_reply(58 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59977c00 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.631+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:59 18.3 18:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986400 con 0x561b59986000 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.631+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 11 ==== osd_op_reply(59 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.631+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:60 18.23 18:c4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59976400 con 0x561b5a3e3400 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.632+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.2 v2:172.21.15.79:6816/3079975341 6 ==== osd_op_reply(60 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a780 con 0x561b5a3e3400 2024-06-10T00:25:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.632+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:61 18.13 18:c8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59987800 con 0x561b59987000 2024-06-10T00:25:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.632+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.7 v2:172.21.15.117:6816/2099086267 5 ==== osd_op_reply(61 [pgnls start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59987000 2024-06-10T00:25:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.632+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:62 18.33 18:cc000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3c9000 con 0x561b59986000 2024-06-10T00:25:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.632+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 12 ==== osd_op_reply(62 [pgnls start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.632+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:63 18.b 18:d0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59986c00 con 0x561b59976000 2024-06-10T00:25:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.633+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 7 ==== osd_op_reply(63 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.633+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:64 18.2b 18:d4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3c9400 con 0x561b59987000 2024-06-10T00:25:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.633+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.7 v2:172.21.15.117:6816/2099086267 6 ==== osd_op_reply(64 [pgnls start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59987000 2024-06-10T00:25:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.633+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:65 18.1b 18:d8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59987c00 con 0x561b59986000 2024-06-10T00:25:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.633+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 13 ==== osd_op_reply(65 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.633+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:66 18.3b 18:dc000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59976800 con 0x561b5a4bc800 2024-06-10T00:25:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.634+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 9 ==== osd_op_reply(66 [pgnls start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.634+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:67 18.7 18:e0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977000 con 0x561b5a3e3400 2024-06-10T00:25:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.634+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 <== osd.2 v2:172.21.15.79:6816/3079975341 7 ==== osd_op_reply(67 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a780 con 0x561b5a3e3400 2024-06-10T00:25:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.634+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:68 18.27 18:e4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59977400 con 0x561b59976000 2024-06-10T00:25:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.634+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 8 ==== osd_op_reply(68 [pgnls start_epoch 121 out=49b] v119'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.634+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:69 18.17 18:e8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a7000 con 0x561b59976000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.634+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 9 ==== osd_op_reply(69 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.634+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:70 18.37 18:ec000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3e3800 con 0x561b59987000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.635+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.7 v2:172.21.15.117:6816/2099086267 7 ==== osd_op_reply(70 [pgnls start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59987000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.635+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:71 18.f 18:f0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a7400 con 0x561b59976000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.635+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.5 v2:172.21.15.117:6800/419453692 10 ==== osd_op_reply(71 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b59976000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.635+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:72 18.2f 18:f4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b5a3e3c00 con 0x561b59986000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.1 v2:172.21.15.79:6808/15559294 14 ==== osd_op_reply(72 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59986000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f909e9ec640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:73 18.1f 18:f8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b599a6400 con 0x561b59987000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a29f4640 1 -- 172.21.15.79:0/929842648 <== osd.7 v2:172.21.15.117:6816/2099086267 8 ==== osd_op_reply(73 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a000 con 0x561b59987000 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f909e1eb640 1 -- 172.21.15.79:0/929842648 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:74 18.3f 18:fc000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x561b59987400 con 0x561b5a4bc800 2024-06-10T00:25:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a39f6640 1 -- 172.21.15.79:0/929842648 <== osd.4 v2:172.21.15.117:6824/279504764 10 ==== osd_op_reply(74 [pgnls start_epoch 121 out=49b] v119'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x561b5974a500 con 0x561b5a4bc800 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x561b5a3e3000 msgr2=0x561b59654100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x561b5a3e3000 0x561b59654100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x561b59986000 msgr2=0x561b5997cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x561b59986000 0x561b5997cb00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x561b5a3e3400 msgr2=0x561b5997db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x561b5a3e3400 0x561b5997db80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x561b59977c00 msgr2=0x561b5997d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x561b59977c00 0x561b5997d600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 reap_dead start 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x561b5a4bc800 msgr2=0x561b5997e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.636+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x561b5a4bc800 0x561b5997e680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x561b59976000 msgr2=0x561b5997c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x561b59976000 0x561b5997c000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x561b59976c00 msgr2=0x561b5997c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x561b59976c00 0x561b5997c580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561b59987000 msgr2=0x561b5997e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x561b59987000 0x561b5997e100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a31f5640 1 -- 172.21.15.79:0/929842648 reap_dead start 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x561b5a3e2c00 msgr2=0x561b59655700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x561b5a3e2c00 0x561b59655700 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x561b5a3ff1d0 tx=0x561b5a376a80 comp rx=0 tx=0).stop 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bdc00 msgr2=0x561b59654680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bdc00 0x561b59654680 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x561b5a4a9830 tx=0x561b5a3b78c0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 shutdown_connections 2024-06-10T00:25:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x561b5a3e2c00 0x561b59655700 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/929842648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b5a4bdc00 0x561b59654680 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 >> 172.21.15.79:0/929842648 conn(0x561b5a4bd000 msgr2=0x561b5a361000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 shutdown_connections 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/929842648 wait complete. 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/2504224650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b595d7c00 msgr2=0x561b59653080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b595d7c00 0x561b59653080 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x561b5a3ffc50 tx=0x561b5a37aa20 comp rx=0 tx=0).stop 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/2504224650 shutdown_connections 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b595d7c00 0x561b59653080 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561b595d7800 0x561b59652b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 --2- 172.21.15.79:0/2504224650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561b595d6c00 0x561b59652580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/2504224650 >> 172.21.15.79:0/2504224650 conn(0x561b595d7000 msgr2=0x561b5a360800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/2504224650 shutdown_connections 2024-06-10T00:25:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.637+0000 7f90a531b740 1 -- 172.21.15.79:0/2504224650 wait complete. 2024-06-10T00:25:04.657 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.134014, result: 2024-06-10T00:25:04.657 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-06-10T00:25:04.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.733+0000 7fdcb8c1c740 1 -- start start 2024-06-10T00:25:04.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.733+0000 7fdcb8c1c740 1 Processor -- start 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff15344c00 0x55ff153c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff15345800 0x55ff153c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff15345c00 0x55ff153c1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ff16200180 con 0x55ff15345c00 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ff16200300 con 0x55ff15345800 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ff16200480 con 0x55ff15344c00 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff15345c00 0x55ff153c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff15345c00 0x55ff153c1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59590/0 (socket says 172.21.15.79:59590) 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 -- 172.21.15.79:0/1713451715 learned_addr learned my addr 172.21.15.79:0/1713451715 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb6130640 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff15345800 0x55ff153c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb6931640 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff15344c00 0x55ff153c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 -- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff15344c00 msgr2=0x55ff153c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff15344c00 0x55ff153c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 -- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff15345800 msgr2=0x55ff153c0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff15345800 0x55ff153c0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 -- 172.21.15.79:0/1713451715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff15371680 con 0x55ff15345c00 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb6931640 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff15344c00 0x55ff153c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb6130640 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff15345800 0x55ff153c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb7132640 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff15345c00 0x55ff153c1080 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x55ff1615f170 tx=0x55ff160e4a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b128eec5280b349 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.734+0000 7fdcb412c640 1 -- 172.21.15.79:0/1713451715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ff1536a9c0 con 0x55ff15345c00 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb412c640 1 -- 172.21.15.79:0/1713451715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ff1538ce00 con 0x55ff15345c00 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb412c640 1 -- 172.21.15.79:0/1713451715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ff1536a680 con 0x55ff15345c00 2024-06-10T00:25:04.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/1713451715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff153714a0 con 0x55ff15345c00 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/1713451715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55ff15371a40 con 0x55ff15345c00 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 4 waiting for MDS map... 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb412c640 1 -- 172.21.15.79:0/1713451715 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x55ff1621a200 con 0x55ff15345c00 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb412c640 1 -- 172.21.15.79:0/1713451715 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x55ff1539d180 con 0x55ff15345c00 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 4 Got MDS map 90 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 4 datascan.main: Using metadata pool output 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 4 datascan.main: connecting to RADOS... 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 1 Processor -- start 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.735+0000 7fdcb8c1c740 1 -- start start 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e000 0x55ff153c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e400 0x55ff153c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e800 0x55ff153c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ff16200600 con 0x55ff1626e400 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ff16200780 con 0x55ff1626e000 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ff16200900 con 0x55ff1626e800 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e400 0x55ff153c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e400 0x55ff153c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59592/0 (socket says 172.21.15.79:59592) 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 -- 172.21.15.79:0/3483549254 learned_addr learned my addr 172.21.15.79:0/3483549254 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6130640 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e000 0x55ff153c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6130640 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e800 0x55ff153c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 -- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e800 msgr2=0x55ff153c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e800 0x55ff153c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 -- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e000 msgr2=0x55ff153c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e000 0x55ff153c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 -- 172.21.15.79:0/3483549254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff15371860 con 0x55ff1626e400 2024-06-10T00:25:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6130640 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e800 0x55ff153c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.736+0000 7fdcb6931640 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e400 0x55ff153c1b80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x55ff16226ed0 tx=0x55ff1622aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18314a103729cbe server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb2128640 1 -- 172.21.15.79:0/3483549254 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ff1536a9c0 con 0x55ff1626e400 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb2128640 1 -- 172.21.15.79:0/3483549254 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ff1538ca80 con 0x55ff1626e400 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb2128640 1 -- 172.21.15.79:0/3483549254 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ff1536a680 con 0x55ff1626e400 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/3483549254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e400 msgr2=0x55ff153c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e400 0x55ff153c1b80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x55ff16226ed0 tx=0x55ff1622aea0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/3483549254 shutdown_connections 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e800 0x55ff153c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e400 0x55ff153c1b80 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/3483549254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e000 0x55ff153c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/3483549254 >> 172.21.15.79:0/3483549254 conn(0x55ff16127c00 msgr2=0x55ff15431000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/3483549254 shutdown_connections 2024-06-10T00:25:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.737+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/3483549254 wait complete. 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb8c1c740 1 Processor -- start 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb8c1c740 1 -- start start 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e000 0x55ff153c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e400 0x55ff153c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb8c1c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e800 0x55ff153c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ff16201c80 con 0x55ff1626e000 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ff16201b00 con 0x55ff1626e800 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb8c1c740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ff16201980 con 0x55ff1626e400 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb6130640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e000 0x55ff153c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb6130640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e000 0x55ff153c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59606/0 (socket says 172.21.15.79:59606) 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 learned_addr learned my addr 172.21.15.79:0/2446583240 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb6931640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e400 0x55ff153c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.738+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e800 0x55ff153c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e400 msgr2=0x55ff153c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff1626e400 0x55ff153c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e800 msgr2=0x55ff153c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff1626e800 0x55ff153c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff153712c0 con 0x55ff1626e000 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e000 0x55ff153c3180 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x55ff16227b30 tx=0x55ff1622ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb0925640 1 -- 172.21.15.79:0/2446583240 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ff1536a9c0 con 0x55ff1626e000 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb0925640 1 -- 172.21.15.79:0/2446583240 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ff1538c540 con 0x55ff1626e000 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff153710e0 con 0x55ff1626e000 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb0925640 1 -- 172.21.15.79:0/2446583240 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ff1536a680 con 0x55ff1626e000 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff153703c0 con 0x55ff1626e000 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.739+0000 7fdcb8c1c740 4 datascan.init: resolving metadata pool 17 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb0925640 1 -- 172.21.15.79:0/2446583240 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55ff16286c00 con 0x55ff1626e000 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb0925640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55ff1629cc00 0x55ff153c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb0925640 1 -- 172.21.15.79:0/2446583240 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x55ff16285000 con 0x55ff1626e000 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb8c1c740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb8c1c740 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb8c1c740 4 datascan.main: opening data pool 'cephfs_data' 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb6931640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55ff1629cc00 0x55ff153c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55ff1626ec00 0x55ff153c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.740+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:1 17.14 17:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55ff1626f000 con 0x55ff1626ec00 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.741+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55ff1626ec00 0x55ff153c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.741+0000 7fdcb6931640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55ff1629cc00 0x55ff153c3700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x55ff16226ed0 tx=0x55ff1622ac00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.741+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55ff1626ec00 0x55ff153c2100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.741+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv34 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.741+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55ff1629d000 0x55ff153c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.741+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:2 17.1f 17:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55ff1629d400 con 0x55ff1629d000 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.741+0000 7fdcb7132640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55ff1629d000 0x55ff153c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.742+0000 7fdcb7132640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55ff1629d000 0x55ff153c1b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.742+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x55ff160d2500 con 0x55ff1629d000 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.742+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ff1629d800 0x55ff153c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.742+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:3 18.0 18:00000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1629dc00 con 0x55ff1629d800 2024-06-10T00:25:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.742+0000 7fdcb6931640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ff1629d800 0x55ff153c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.742+0000 7fdcb6931640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ff1629d800 0x55ff153c1600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.743+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.743+0000 7fdcb1927640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55ff156e8000 0x55ff156ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.743+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:4 18.20 18:04000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8400 con 0x55ff156e8000 2024-06-10T00:25:04.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.743+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55ff156e8000 0x55ff156ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.743+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55ff156e8000 0x55ff156ee000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.744+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.744+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:5 18.10 18:08000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8c00 con 0x55ff1629d000 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.744+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff1629d000 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.744+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:6 18.30 18:0c000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8800 con 0x55ff1629d800 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.744+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.744+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:7 18.8 18:10000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e9000 con 0x55ff1629d800 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 3 ==== osd_op_reply(7 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:8 18.28 18:14000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8800 con 0x55ff156e8000 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb2128640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55ff156e9400 0x55ff156ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:9 18.18 18:18000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e9000 con 0x55ff156e9400 2024-06-10T00:25:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb7132640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55ff156e9400 0x55ff156ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb7132640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55ff156e9400 0x55ff156ee580 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.745+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1629dc00 con 0x55ff1626ec00 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.746+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.746+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e9800 con 0x55ff1629d800 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.746+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.746+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1626fc00 con 0x55ff1629d800 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.746+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 5 ==== osd_op_reply(12 [pgnls-filter start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.746+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e9c00 con 0x55ff1629d000 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.747+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.6 v2:172.21.15.117:6808/1306883621 3 ==== osd_op_reply(13 [pgnls-filter start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff1629d000 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.747+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1629dc00 con 0x55ff1629d800 2024-06-10T00:25:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.747+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 6 ==== osd_op_reply(14 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.747+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8000 con 0x55ff156e8000 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.747+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.747+0000 7fdcb1927640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55ff156e8400 0x55ff156eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.747+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8800 con 0x55ff156e8400 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.747+0000 7fdcb6931640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55ff156e8400 0x55ff156eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.748+0000 7fdcb6931640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55ff156e8400 0x55ff156eeb00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.748+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff156e8400 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.748+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8400 con 0x55ff156e9400 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.748+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.748+0000 7fdcb1927640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ff1626f000 0x55ff156ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.748+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8400 con 0x55ff1626f000 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.748+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ff1626f000 0x55ff156ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.749+0000 7fdcb6130640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ff1626f000 0x55ff156ef080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.749+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.749+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8800 con 0x55ff1626f000 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.749+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.749+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8c00 con 0x55ff1626ec00 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.750+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.750+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8c00 con 0x55ff156e8400 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.750+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.2 v2:172.21.15.79:6816/3079975341 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 121 out=81b] v121'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55ff160d2780 con 0x55ff156e8400 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.750+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:22 18.0 18:00000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8c00 con 0x55ff1629d800 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.750+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 7 ==== osd_op_reply(22 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.750+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:23 18.20 18:04000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f9800 con 0x55ff156e8000 2024-06-10T00:25:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.751+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.751+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:24 18.10 18:08000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e9000 con 0x55ff1629d000 2024-06-10T00:25:04.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.751+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.6 v2:172.21.15.117:6808/1306883621 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff1629d000 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.751+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:25 18.30 18:0c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f9c00 con 0x55ff1629d800 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.751+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 8 ==== osd_op_reply(25 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.751+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:26 18.8 18:10000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e9c00 con 0x55ff1629d800 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.751+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 9 ==== osd_op_reply(26 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.752+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:27 18.28 18:14000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8000 con 0x55ff156e8000 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.752+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 5 ==== osd_op_reply(27 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.752+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:28 18.18 18:18000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1629d400 con 0x55ff156e9400 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.752+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.752+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:29 18.38 18:1c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8400 con 0x55ff1626ec00 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.752+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 4 ==== osd_op_reply(29 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.752+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:30 18.4 18:20000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704000 con 0x55ff1629d800 2024-06-10T00:25:04.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.753+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 10 ==== osd_op_reply(30 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.753+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:31 18.24 18:24000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8800 con 0x55ff1629d800 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.753+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 11 ==== osd_op_reply(31 [pgnls-filter start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.753+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:32 18.14 18:28000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704400 con 0x55ff1629d000 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.753+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.6 v2:172.21.15.117:6808/1306883621 5 ==== osd_op_reply(32 [pgnls-filter start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff1629d000 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.753+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:33 18.34 18:2c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f9800 con 0x55ff1629d800 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.753+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 12 ==== osd_op_reply(33 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.753+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:34 18.c 18:30000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704800 con 0x55ff156e8000 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.754+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.754+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:35 18.2c 18:34000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8c00 con 0x55ff156e8400 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.754+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.2 v2:172.21.15.79:6816/3079975341 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff156e8400 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.754+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:36 18.1c 18:38000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704c00 con 0x55ff156e9400 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.754+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.754+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:37 18.3c 18:3c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704000 con 0x55ff1626f000 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.754+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 3 ==== osd_op_reply(37 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.754+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:38 18.2 18:40000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705000 con 0x55ff1626f000 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.755+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.755+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:39 18.22 18:44000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705800 con 0x55ff1626ec00 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.755+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.755+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:40 18.12 18:48000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705400 con 0x55ff156e8400 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.755+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.2 v2:172.21.15.79:6816/3079975341 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 121 out=49b] v121'23 uv23 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff156e8400 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.755+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:41 18.32 18:4c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8c00 con 0x55ff1626ec00 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.755+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 121 out=49b] v119'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.756+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:42 18.a 18:50000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704800 con 0x55ff1626ec00 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.756+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 7 ==== osd_op_reply(42 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.756+0000 7fdcb2128640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55ff156f9c00 0x55ff156ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.756+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:43 18.2a 18:54000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8800 con 0x55ff156f9c00 2024-06-10T00:25:04.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.756+0000 7fdcb7132640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55ff156f9c00 0x55ff156ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.757+0000 7fdcb7132640 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55ff156f9c00 0x55ff156ef600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.757+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(43 [pgnls-filter start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156f9c00 2024-06-10T00:25:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.757+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:44 18.1a 18:58000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704000 con 0x55ff1626ec00 2024-06-10T00:25:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.757+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 8 ==== osd_op_reply(44 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.757+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:45 18.3a 18:5c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f9800 con 0x55ff1629d800 2024-06-10T00:25:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.757+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 13 ==== osd_op_reply(45 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.757+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:46 18.6 18:60000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705000 con 0x55ff1626f000 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 5 ==== osd_op_reply(46 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:47 18.26 18:64000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e9c00 con 0x55ff156e8400 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.2 v2:172.21.15.79:6816/3079975341 5 ==== osd_op_reply(47 [pgnls-filter start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff156e8400 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:48 18.16 18:68000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705800 con 0x55ff1626ec00 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:49 18.36 18:6c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570e000 con 0x55ff156e9400 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 121 out=81b] v121'34 uv34 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb8c1c740 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb8c1c740 10 datascan.operator(): handling object 100000001f7.0 2024-06-10T00:25:04.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.758+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:50 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f9400 con 0x55ff156e9400 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 6 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) ==== 416+0+194 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:51 17.7 17:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e9800 con 0x55ff1629d800 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 14 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:52 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8800 con 0x55ff1626ec00 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 10 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv12 ondisk = 0) ==== 164+0+524 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 20 datascan.get_frag_of: frag is * 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.759+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:53 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55ff1629dc00 con 0x55ff1629d800 2024-06-10T00:25:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 15 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb8c1c740 10 datascan.find_or_create_dirfrag: read_version = 8 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb8c1c740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:54 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55ff1626fc00 con 0x55ff1629d800 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 16 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb8c1c740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb8c1c740 20 datascan.read_dentry: bravo_head not found in result 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb8c1c740 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.760+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:55 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705400 con 0x55ff1629d800 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.761+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 17 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v121'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.761+0000 7fdcb8c1c740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.761+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:56 18.e 18:70000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1629dc00 con 0x55ff1629d800 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.761+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 18 ==== osd_op_reply(56 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.761+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:57 18.2e 18:74000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570e400 con 0x55ff1626ec00 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.761+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 11 ==== osd_op_reply(57 [pgnls-filter start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.761+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:58 18.1e 18:78000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705c00 con 0x55ff156e8000 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.762+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 7 ==== osd_op_reply(58 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.762+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:59 18.3e 18:7c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570e800 con 0x55ff1626ec00 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.762+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 12 ==== osd_op_reply(59 [pgnls-filter start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.762+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:60 18.1 18:80000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8000 con 0x55ff1626ec00 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.762+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 13 ==== osd_op_reply(60 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.762+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:61 18.21 18:84000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570ec00 con 0x55ff156e8000 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.763+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 8 ==== osd_op_reply(61 [pgnls-filter start_epoch 121 out=49b] v119'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.763+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:62 18.11 18:88000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8400 con 0x55ff156e9400 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.763+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 7 ==== osd_op_reply(62 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.763+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:63 18.31 18:8c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570f000 con 0x55ff156f9c00 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.763+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== osd_op_reply(63 [pgnls-filter start_epoch 121 out=49b] v119'15 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156f9c00 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.763+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:64 18.9 18:90000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8c00 con 0x55ff1626ec00 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.764+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 14 ==== osd_op_reply(64 [pgnls-filter start_epoch 121 out=49b] v119'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.764+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:65 18.29 18:94000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570f400 con 0x55ff1626f000 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.764+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.764+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:66 18.19 18:98000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704800 con 0x55ff156f9c00 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.764+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.4 v2:172.21.15.117:6824/279504764 3 ==== osd_op_reply(66 [pgnls-filter start_epoch 121 out=49b] v121'24 uv24 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156f9c00 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.764+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:67 18.39 18:9c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570f800 con 0x55ff1629d800 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.765+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 19 ==== osd_op_reply(67 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.765+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:68 18.5 18:a0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704000 con 0x55ff156e9400 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.765+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 8 ==== osd_op_reply(68 [pgnls-filter start_epoch 121 out=49b] v121'15 uv15 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.765+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:69 18.25 18:a4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570fc00 con 0x55ff1629d000 2024-06-10T00:25:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.765+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.6 v2:172.21.15.117:6808/1306883621 6 ==== osd_op_reply(69 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff1629d000 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.765+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:70 18.15 18:a8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705000 con 0x55ff156e8000 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.766+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 9 ==== osd_op_reply(70 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.766+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:71 18.35 18:ac000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570f000 con 0x55ff156f9c00 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.766+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.4 v2:172.21.15.117:6824/279504764 4 ==== osd_op_reply(71 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156f9c00 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.766+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:72 18.d 18:b0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15705800 con 0x55ff156f9c00 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.766+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.4 v2:172.21.15.117:6824/279504764 5 ==== osd_op_reply(72 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156f9c00 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.766+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:73 18.2d 18:b4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570fc00 con 0x55ff1629d000 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.767+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.6 v2:172.21.15.117:6808/1306883621 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff1629d000 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.767+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:74 18.1d 18:b8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704400 con 0x55ff1629d800 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.767+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.0 v2:172.21.15.79:6824/709635793 20 ==== osd_op_reply(74 [pgnls-filter start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff1629d800 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.767+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:75 18.3d 18:bc000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f9400 con 0x55ff1626ec00 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.767+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.3 v2:172.21.15.79:6800/4145020298 15 ==== osd_op_reply(75 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626ec00 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.767+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:76 18.3 18:c0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704c00 con 0x55ff156e9400 2024-06-10T00:25:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.767+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 9 ==== osd_op_reply(76 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.767+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:77 18.23 18:c4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f9000 con 0x55ff156e8400 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.768+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.2 v2:172.21.15.79:6816/3079975341 6 ==== osd_op_reply(77 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff156e8400 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.768+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:78 18.13 18:c8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156e8800 con 0x55ff1626f000 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.768+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.768+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:79 18.33 18:cc000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8400 con 0x55ff156e9400 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.768+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 10 ==== osd_op_reply(79 [pgnls-filter start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.768+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:80 18.b 18:d0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570e800 con 0x55ff156e8000 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.769+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 10 ==== osd_op_reply(80 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.769+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:81 18.2b 18:d4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f9800 con 0x55ff1626f000 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.769+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.769+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:82 18.1b 18:d8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570ec00 con 0x55ff156e9400 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.769+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.769+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:83 18.3b 18:dc000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8800 con 0x55ff156f9c00 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.770+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.4 v2:172.21.15.117:6824/279504764 6 ==== osd_op_reply(83 [pgnls-filter start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156f9c00 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.770+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:84 18.7 18:e0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570f400 con 0x55ff156e8400 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.770+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 <== osd.2 v2:172.21.15.79:6816/3079975341 7 ==== osd_op_reply(84 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2780 con 0x55ff156e8400 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.770+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:85 18.27 18:e4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704800 con 0x55ff156e8000 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.771+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 11 ==== osd_op_reply(85 [pgnls-filter start_epoch 121 out=49b] v119'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.771+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:86 18.17 18:e8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570e400 con 0x55ff156e8000 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.771+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 12 ==== osd_op_reply(86 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.771+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:87 18.37 18:ec000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff15704000 con 0x55ff1626f000 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.771+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 9 ==== osd_op_reply(87 [pgnls-filter start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.771+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:88 18.f 18:f0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8000 con 0x55ff156e8000 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.772+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.5 v2:172.21.15.117:6800/419453692 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff156e8000 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.772+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:89 18.2f 18:f4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570e000 con 0x55ff156e9400 2024-06-10T00:25:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.772+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.1 v2:172.21.15.79:6808/15559294 12 ==== osd_op_reply(89 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156e9400 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.772+0000 7fdcb1927640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:90 18.1f 18:f8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff156f8c00 con 0x55ff1626f000 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.772+0000 7fdcb6130640 1 -- 172.21.15.79:0/2446583240 <== osd.7 v2:172.21.15.117:6816/2099086267 10 ==== osd_op_reply(90 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2000 con 0x55ff1626f000 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.772+0000 7fdcb2128640 1 -- 172.21.15.79:0/2446583240 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:91 18.3f 18:fc000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55ff1570f000 con 0x55ff156f9c00 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb7132640 1 -- 172.21.15.79:0/2446583240 <== osd.4 v2:172.21.15.117:6824/279504764 7 ==== osd_op_reply(91 [pgnls-filter start_epoch 121 out=49b] v119'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ff160d2500 con 0x55ff156f9c00 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ff1629d800 msgr2=0x55ff153c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x55ff1629d800 0x55ff153c1600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55ff156e9400 msgr2=0x55ff156ee580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x55ff156e9400 0x55ff156ee580 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55ff156e8400 msgr2=0x55ff156eeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x55ff156e8400 0x55ff156eeb00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55ff1626ec00 msgr2=0x55ff153c2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 reap_dead start 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x55ff1626ec00 0x55ff153c2100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55ff156f9c00 msgr2=0x55ff156ef600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x55ff156f9c00 0x55ff156ef600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55ff156e8000 msgr2=0x55ff156ee000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x55ff156e8000 0x55ff156ee000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55ff1629d000 msgr2=0x55ff153c1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x55ff1629d000 0x55ff153c1b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ff1626f000 msgr2=0x55ff156ef080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x55ff1626f000 0x55ff156ef080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb6931640 1 -- 172.21.15.79:0/2446583240 reap_dead start 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55ff1629cc00 msgr2=0x55ff153c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55ff1629cc00 0x55ff153c3700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x55ff16226ed0 tx=0x55ff1622ac00 comp rx=0 tx=0).stop 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e000 msgr2=0x55ff153c3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e000 0x55ff153c3180 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x55ff16227b30 tx=0x55ff1622ad80 comp rx=0 tx=0).stop 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 shutdown_connections 2024-06-10T00:25:04.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x55ff1629cc00 0x55ff153c3700 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/2446583240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff1626e000 0x55ff153c3180 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 >> 172.21.15.79:0/2446583240 conn(0x55ff16127c00 msgr2=0x55ff15431000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 shutdown_connections 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/2446583240 wait complete. 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/1713451715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff15345c00 msgr2=0x55ff153c1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff15345c00 0x55ff153c1080 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x55ff1615f170 tx=0x55ff160e4a80 comp rx=0 tx=0).stop 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/1713451715 shutdown_connections 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.773+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff15345c00 0x55ff153c1080 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.774+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff15345800 0x55ff153c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.774+0000 7fdcb8c1c740 1 --2- 172.21.15.79:0/1713451715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ff15344c00 0x55ff153c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.774+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/1713451715 >> 172.21.15.79:0/1713451715 conn(0x55ff15345000 msgr2=0x55ff15430800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.774+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/1713451715 shutdown_connections 2024-06-10T00:25:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.774+0000 7fdcb8c1c740 1 -- 172.21.15.79:0/1713451715 wait complete. 2024-06-10T00:25:04.790 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.133398, result: 2024-06-10T00:25:04.791 DEBUG:teuthology.orchestra.run.smithi079:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-06-10T00:25:04.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.869+0000 7f29d0e36740 1 -- start start 2024-06-10T00:25:04.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.869+0000 7f29d0e36740 1 Processor -- start 2024-06-10T00:25:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560404f34c00 0x560404fb1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560404f35800 0x560404fb1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560404f35c00 0x560404fb1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29d0e36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560405d14180 con 0x560404f35c00 2024-06-10T00:25:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29d0e36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560404f94900 con 0x560404f34c00 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29d0e36740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560404f94480 con 0x560404f35800 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560404f35c00 0x560404fb1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560404f35c00 0x560404fb1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59614/0 (socket says 172.21.15.79:59614) 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 -- 172.21.15.79:0/3337006271 learned_addr learned my addr 172.21.15.79:0/3337006271 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29ce73f640 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560404f34c00 0x560404fb1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560404f35800 0x560404fb1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 -- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560404f35800 msgr2=0x560404fb1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560404f35800 0x560404fb1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 -- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560404f34c00 msgr2=0x560404fb1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560404f34c00 0x560404fb1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 -- 172.21.15.79:0/3337006271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560404f61680 con 0x560404f35c00 2024-06-10T00:25:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560404f35800 0x560404fb1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cef40640 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560404f35c00 0x560404fb1080 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x560405d53c50 tx=0x560405cd68a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fded681462e66a07 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.870+0000 7f29cbf3a640 1 -- 172.21.15.79:0/3337006271 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560404f5a680 con 0x560404f35c00 2024-06-10T00:25:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29cbf3a640 1 -- 172.21.15.79:0/3337006271 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560404f7c1c0 con 0x560404f35c00 2024-06-10T00:25:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29cbf3a640 1 -- 172.21.15.79:0/3337006271 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560404f5ab60 con 0x560404f35c00 2024-06-10T00:25:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29d0e36740 1 -- 172.21.15.79:0/3337006271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560404f61860 con 0x560404f35c00 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29d0e36740 1 -- 172.21.15.79:0/3337006271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=0}) -- 0x560404f612c0 con 0x560404f35c00 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29d0e36740 4 waiting for MDS map... 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29cbf3a640 1 -- 172.21.15.79:0/3337006271 <== mon.0 v2:172.21.15.79:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x560405e0a600 con 0x560404f35c00 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29cbf3a640 1 -- 172.21.15.79:0/3337006271 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x560404f8d180 con 0x560404f35c00 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29d0e36740 4 Got MDS map 90 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29d0e36740 4 datascan.main: Using metadata pool output 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29d0e36740 4 datascan.main: connecting to RADOS... 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29d0e36740 1 Processor -- start 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.871+0000 7f29d0e36740 1 -- start start 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09400 0x560404fb0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 0x560404fb0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09c00 0x560404fb2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29d0e36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560404f94180 con 0x560405d09400 2024-06-10T00:25:04.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29d0e36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560405d14d80 con 0x560405d09800 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29d0e36740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560405d14f00 con 0x560405d09c00 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09400 0x560404fb0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09400 0x560404fb0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59626/0 (socket says 172.21.15.79:59626) 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 -- 172.21.15.79:0/1022451774 learned_addr learned my addr 172.21.15.79:0/1022451774 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29ce73f640 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 0x560404fb0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09c00 0x560404fb2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 -- 172.21.15.79:0/1022451774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09c00 msgr2=0x560404fb2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09c00 0x560404fb2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 -- 172.21.15.79:0/1022451774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 msgr2=0x560404fb0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 0x560404fb0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.872+0000 7f29cdf3e640 1 -- 172.21.15.79:0/1022451774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560404f614a0 con 0x560405d09400 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09400 0x560404fb0b00 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x560405d53ce0 tx=0x560405e26cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e88f928cb4e2ba server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29c9f36640 1 -- 172.21.15.79:0/1022451774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560404f5a680 con 0x560405d09400 2024-06-10T00:25:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29c9f36640 1 -- 172.21.15.79:0/1022451774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560404f7ce00 con 0x560405d09400 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29c9f36640 1 -- 172.21.15.79:0/1022451774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560404f5ab60 con 0x560405d09400 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 -- 172.21.15.79:0/1022451774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09400 msgr2=0x560404fb0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09400 0x560404fb0b00 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x560405d53ce0 tx=0x560405e26cc0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 -- 172.21.15.79:0/1022451774 shutdown_connections 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09c00 0x560404fb2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 0x560404fb0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 --2- 172.21.15.79:0/1022451774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09400 0x560404fb0b00 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 -- 172.21.15.79:0/1022451774 >> 172.21.15.79:0/1022451774 conn(0x560405d09000 msgr2=0x560405021000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 -- 172.21.15.79:0/1022451774 shutdown_connections 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.873+0000 7f29d0e36740 1 -- 172.21.15.79:0/1022451774 wait complete. 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29d0e36740 1 Processor -- start 2024-06-10T00:25:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29d0e36740 1 -- start start 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09400 0x560404fb0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 0x560404fb0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29d0e36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09c00 0x560404fb2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29d0e36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560405d15200 con 0x560405d09c00 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29d0e36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560405d15080 con 0x560405d09800 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29d0e36740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560405d15380 con 0x560405d09400 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29cdf3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09c00 0x560404fb2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29cdf3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09c00 0x560404fb2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59630/0 (socket says 172.21.15.79:59630) 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.874+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 learned_addr learned my addr 172.21.15.79:0/787155795 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09400 0x560404fb0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09400 msgr2=0x560404fb0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560405d09400 0x560404fb0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 msgr2=0x560404fb0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 0x560404fb0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560405d09800 0x560404fb0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560404f61680 con 0x560405d09c00 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09c00 0x560404fb2100 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x560405e23b30 tx=0x560405cd5f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29c8733640 1 -- 172.21.15.79:0/787155795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560404f5a4e0 con 0x560405d09c00 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29c8733640 1 -- 172.21.15.79:0/787155795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560404f7c540 con 0x560405d09c00 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560404f61860 con 0x560405d09c00 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29c8733640 1 -- 172.21.15.79:0/787155795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560404f5a680 con 0x560405d09c00 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560404f610e0 con 0x560405d09c00 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.875+0000 7f29d0e36740 4 datascan.init: resolving metadata pool 17 2024-06-10T00:25:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.876+0000 7f29c8733640 1 -- 172.21.15.79:0/787155795 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x560405e8cc00 con 0x560405d09c00 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.876+0000 7f29c8733640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x560405e88c00 0x5604052cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.876+0000 7f29c8733640 1 -- 172.21.15.79:0/787155795 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x560405e8aa00 con 0x560405d09c00 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29d0e36740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29d0e36740 4 datascan.main: resolving metadata pool 17 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x560405e88c00 0x5604052cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x560405e89000 0x560404fb2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405e89400 con 0x560405e89000 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x560405e89000 0x560404fb2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x560405e88c00 0x5604052cc000 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x560405cd8150 tx=0x560405cd5f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x560405e89000 0x560404fb2680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== osd_op_reply(1 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.877+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x560405e89400 0x5604052cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.878+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:2 17.10 17:08000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36000 con 0x560405e89400 2024-06-10T00:25:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.878+0000 7f29cef40640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x560405e89400 0x5604052cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.878+0000 7f29cef40640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x560405e89400 0x5604052cc580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.878+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== osd_op_reply(2 [pgnls start_epoch 121 out=177b] v120'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.878+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:3 17.8 17:10000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36000 con 0x560405e89000 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.878+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 2 ==== osd_op_reply(3 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.878+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x560405d36000 0x5604052ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.878+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:4 17.18 17:18000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36400 con 0x560405d36000 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.879+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x560405d36000 0x5604052ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.879+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x560405d36000 0x5604052ccb00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.879+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== osd_op_reply(4 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.879+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:5 17.4 17:20000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36400 con 0x560405d36000 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.879+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== osd_op_reply(5 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.879+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:6 17.14 17:28000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36400 con 0x560405e89400 2024-06-10T00:25:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.880+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== osd_op_reply(6 [pgnls start_epoch 121 out=149b] v121'41 uv41 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.880+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:7 17.c 17:30000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36400 con 0x560405e89000 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.880+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 3 ==== osd_op_reply(7 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.880+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x560405d36400 0x5604052cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.880+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:8 17.1c 17:38000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36800 con 0x560405d36400 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.880+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x560405d36400 0x5604052cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.881+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x560405d36400 0x5604052cd080 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.881+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== osd_op_reply(8 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x560405cc2000 con 0x560405d36400 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.881+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x560405d36800 0x5604052cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.881+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:9 17.2 17:40000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36c00 con 0x560405d36800 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.881+0000 7f29cef40640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x560405d36800 0x5604052cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.881+0000 7f29cef40640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x560405d36800 0x5604052cd600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.882+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== osd_op_reply(9 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405d36800 2024-06-10T00:25:04.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.882+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:10 17.12 17:48000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36c00 con 0x560405e89400 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.882+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 3 ==== osd_op_reply(10 [pgnls start_epoch 121 out=81b] v120'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.882+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:11 17.a 17:50000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36c00 con 0x560405e89000 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.882+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 4 ==== osd_op_reply(11 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.882+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:12 17.1a 17:58000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d36c00 con 0x560405d36000 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.883+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 3 ==== osd_op_reply(12 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.883+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x560405d36c00 0x5604052ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.883+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:13 17.6 17:60000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d1b000 con 0x560405d36c00 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.883+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x560405d36c00 0x5604052ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.883+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x560405d36c00 0x5604052ce680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== osd_op_reply(13 [pgnls start_epoch 121 out=77b] v120'10 uv10 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29ce73f640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x560405d1b000 0x5604052cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:14 17.16 17:68000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d1b400 con 0x560405d1b000 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x560405d1b000 0x5604052cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x560405d1b000 0x5604052cec00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== osd_op_reply(14 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405d1b000 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29cdf3e640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x560405d1b400 0x5604052cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:15 17.e 17:70000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d1b400 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.884+0000 7f29cef40640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x560405d1b400 0x5604052cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:04.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.885+0000 7f29cef40640 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x560405d1b400 0x5604052cdb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.885+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== osd_op_reply(15 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x560405cc2500 con 0x560405d1b400 2024-06-10T00:25:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.885+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:16 17.1e 17:78000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36400 2024-06-10T00:25:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.885+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== osd_op_reply(16 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405d36400 2024-06-10T00:25:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.885+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:17 17.1 17:80000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36000 2024-06-10T00:25:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.885+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 4 ==== osd_op_reply(17 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.886+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:18 17.11 17:88000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405e89400 2024-06-10T00:25:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.886+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 4 ==== osd_op_reply(18 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.886+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:19 17.9 17:90000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405e89400 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.886+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 5 ==== osd_op_reply(19 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.886+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:20 17.19 17:98000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d1b000 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.886+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.5 v2:172.21.15.117:6800/419453692 2 ==== osd_op_reply(20 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405d1b000 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.886+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:21 17.5 17:a0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36c00 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.887+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== osd_op_reply(21 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.887+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:22 17.15 17:a8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d1b000 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.887+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.5 v2:172.21.15.117:6800/419453692 3 ==== osd_op_reply(22 [pgnls start_epoch 121 out=97b] v120'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x560405cc2000 con 0x560405d1b000 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.887+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:23 17.d 17:b0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405e89000 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.887+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 5 ==== osd_op_reply(23 [pgnls start_epoch 121 out=74b] v118'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.887+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:24 17.1d 17:b8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405e89000 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.887+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 6 ==== osd_op_reply(24 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.887+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:25 17.3 17:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36800 2024-06-10T00:25:04.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.888+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== osd_op_reply(25 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405d36800 2024-06-10T00:25:04.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.888+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:26 17.13 17:c8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405e89400 2024-06-10T00:25:04.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.888+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 6 ==== osd_op_reply(26 [pgnls start_epoch 121 out=98b] v120'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.888+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:27 17.b 17:d0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36000 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.889+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 5 ==== osd_op_reply(27 [pgnls start_epoch 121 out=76b] v121'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.889+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:28 17.1b 17:d8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36800 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.889+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.4 v2:172.21.15.117:6824/279504764 3 ==== osd_op_reply(28 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405d36800 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.889+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:29 17.7 17:e0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36000 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.889+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 6 ==== osd_op_reply(29 [pgnls start_epoch 121 out=105b] v121'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.889+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:30 17.17 17:e8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36c00 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.889+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 3 ==== osd_op_reply(30 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:31 17.f 17:f0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36400 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.1 v2:172.21.15.79:6808/15559294 3 ==== osd_op_reply(31 [pgnls start_epoch 121 out=73b] v121'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x560405cc2000 con 0x560405d36400 2024-06-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:32 17.1f 17:f8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d37000 con 0x560405d36c00 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 4 ==== osd_op_reply(32 [pgnls start_epoch 121 out=101b] v121'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:33 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x560405e89800 con 0x560405e89400 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 7 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.890+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:34 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x560405e89c00 con 0x560405e89400 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 8 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x560405d37c00 con 0x560405e89400 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 9 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) ==== 164+0+1047 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:36 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f2000 con 0x560405e89400 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 10 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:37 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f2400 con 0x560405e89400 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 11 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-06-10T00:25:04.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.891+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:38 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f2800 con 0x560405e89400 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 12 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:39 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f2c00 con 0x560405d36400 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.1 v2:172.21.15.79:6808/15559294 4 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2000 con 0x560405d36400 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:40 17.12 17:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3000 con 0x560405e89400 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 13 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=523b] v0'0 uv3 ondisk = 0) ==== 164+0+523 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-06-10T00:25:04.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:41 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3400 con 0x560405d1b400 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.892+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.2 v2:172.21.15.79:6816/3079975341 2 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405d1b400 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:42 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3800 con 0x560405d1b000 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.5 v2:172.21.15.117:6800/419453692 4 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2000 con 0x560405d1b000 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-06-10T00:25:04.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:43 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f2000 con 0x560405e89000 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 7 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.893+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:44 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3c00 con 0x560405e89400 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 14 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:45 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x560405d37c00 con 0x560405d36000 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 7 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-06-10T00:25:04.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x560405e89800 con 0x560405d36000 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1545b] v0'0 uv9 ondisk = 0) ==== 164+0+1545 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 20 datascan.scan_links: injected ino detected 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.894+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:47 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x560405e89c00 con 0x560405d36c00 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.895+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 5 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) ==== 154+0+524 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.895+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:48 17.0 17:00000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89000 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.895+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 8 ==== osd_op_reply(48 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.895+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:49 17.10 17:08000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89400 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.895+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 15 ==== osd_op_reply(49 [pgnls start_epoch 121 out=177b] v120'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.895+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:50 17.8 17:10000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89000 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.896+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 9 ==== osd_op_reply(50 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.896+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:51 17.18 17:18000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36000 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.896+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 9 ==== osd_op_reply(51 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.896+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:52 17.4 17:20000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36000 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.896+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 10 ==== osd_op_reply(52 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.896+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:53 17.14 17:28000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89400 2024-06-10T00:25:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.896+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 16 ==== osd_op_reply(53 [pgnls start_epoch 121 out=149b] v121'41 uv41 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.897+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:54 17.c 17:30000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89000 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.897+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 10 ==== osd_op_reply(54 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.897+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:55 17.1c 17:38000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36400 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.897+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.1 v2:172.21.15.79:6808/15559294 5 ==== osd_op_reply(55 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x560405cc2000 con 0x560405d36400 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.897+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:56 17.2 17:40000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36800 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.898+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.4 v2:172.21.15.117:6824/279504764 4 ==== osd_op_reply(56 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405d36800 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.898+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:57 17.12 17:48000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89400 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.898+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 17 ==== osd_op_reply(57 [pgnls start_epoch 121 out=81b] v120'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.898+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:58 17.a 17:50000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89000 2024-06-10T00:25:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.898+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 11 ==== osd_op_reply(58 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.898+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:59 17.1a 17:58000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36000 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.898+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 11 ==== osd_op_reply(59 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.898+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:60 17.6 17:60000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36c00 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.899+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 6 ==== osd_op_reply(60 [pgnls start_epoch 121 out=77b] v120'10 uv10 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.899+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:61 17.16 17:68000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d1b000 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.899+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.5 v2:172.21.15.117:6800/419453692 5 ==== osd_op_reply(61 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405d1b000 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.899+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:62 17.e 17:70000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d1b400 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.900+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.2 v2:172.21.15.79:6816/3079975341 3 ==== osd_op_reply(62 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x560405cc2500 con 0x560405d1b400 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.900+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:63 17.1e 17:78000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36400 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.900+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.1 v2:172.21.15.79:6808/15559294 6 ==== osd_op_reply(63 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405d36400 2024-06-10T00:25:04.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.900+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:64 17.1 17:80000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36000 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.900+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 12 ==== osd_op_reply(64 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.900+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:65 17.11 17:88000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89400 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.900+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 18 ==== osd_op_reply(65 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.900+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:66 17.9 17:90000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89400 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.901+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 19 ==== osd_op_reply(66 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.901+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:67 17.19 17:98000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d1b000 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.901+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.5 v2:172.21.15.117:6800/419453692 6 ==== osd_op_reply(67 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2000 con 0x560405d1b000 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.901+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36c00 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.901+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 7 ==== osd_op_reply(68 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.901+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:69 17.15 17:a8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d1b000 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.902+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.5 v2:172.21.15.117:6800/419453692 7 ==== osd_op_reply(69 [pgnls start_epoch 121 out=97b] v120'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x560405cc2000 con 0x560405d1b000 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.902+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:70 17.d 17:b0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89000 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.902+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 12 ==== osd_op_reply(70 [pgnls start_epoch 121 out=74b] v118'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.902+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:71 17.1d 17:b8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89000 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.903+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 13 ==== osd_op_reply(71 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.903+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:72 17.3 17:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36800 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.903+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.4 v2:172.21.15.117:6824/279504764 5 ==== osd_op_reply(72 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405d36800 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.903+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:73 17.13 17:c8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405e89400 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.903+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 20 ==== osd_op_reply(73 [pgnls start_epoch 121 out=98b] v120'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.903+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:74 17.b 17:d0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36000 2024-06-10T00:25:04.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.904+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 13 ==== osd_op_reply(74 [pgnls start_epoch 121 out=76b] v121'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.904+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- osd_op(unknown.0.0:75 17.1b 17:d8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36800 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.904+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.4 v2:172.21.15.117:6824/279504764 6 ==== osd_op_reply(75 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2500 con 0x560405d36800 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.904+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:76 17.7 17:e0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36000 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.904+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 14 ==== osd_op_reply(76 [pgnls start_epoch 121 out=105b] v121'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.904+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:77 17.17 17:e8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36c00 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.905+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 8 ==== osd_op_reply(77 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.905+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:78 17.f 17:f0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36400 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.905+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.1 v2:172.21.15.79:6808/15559294 7 ==== osd_op_reply(78 [pgnls start_epoch 121 out=73b] v121'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x560405cc2000 con 0x560405d36400 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.905+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:79 17.1f 17:f8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x560405d08800 con 0x560405d36c00 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.905+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 9 ==== osd_op_reply(79 [pgnls start_epoch 121 out=101b] v121'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.905+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.905+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:80 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f8000 con 0x560405e89400 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 21 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:81 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f8400 con 0x560405e89400 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 22 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:82 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f8800 con 0x560405e89400 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 23 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) ==== 164+0+1047 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-06-10T00:25:04.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.906+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:83 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f8c00 con 0x560405e89400 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 24 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:84 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f9000 con 0x560405e89400 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 25 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-06-10T00:25:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:85 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f9400 con 0x560405e89400 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 26 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- osd_op(unknown.0.0:86 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f9800 con 0x560405d36400 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.1 v2:172.21.15.79:6808/15559294 8 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2000 con 0x560405d36400 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.907+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:87 17.12 17:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f9c00 con 0x560405e89400 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 27 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=523b] v0'0 uv3 ondisk = 0) ==== 164+0+523 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-06-10T00:25:04.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- osd_op(unknown.0.0:88 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f8000 con 0x560405d1b400 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.2 v2:172.21.15.79:6816/3079975341 4 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2500 con 0x560405d1b400 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- osd_op(unknown.0.0:89 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f8400 con 0x560405d1b000 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.5 v2:172.21.15.117:6800/419453692 8 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2000 con 0x560405d1b000 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-06-10T00:25:04.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.908+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:90 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f8800 con 0x560405e89000 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 14 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:91 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3c00 con 0x560405e89400 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 28 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-06-10T00:25:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.909+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:92 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3400 con 0x560405d36000 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 15 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:93 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3000 con 0x560405d36000 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 16 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1545b] v0'0 uv9 ondisk = 0) ==== 164+0+1545 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 20 datascan.scan_links: injected ino detected 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-06-10T00:25:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- osd_op(unknown.0.0:94 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f2800 con 0x560405d36c00 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.6 v2:172.21.15.117:6808/1306883621 10 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) ==== 154+0+524 (crc 0 0 0) 0x560405cc2780 con 0x560405d36c00 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: processing 1 injected_inos 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 10 datascan.scan_links: handling injected_ino 0x100000001f7 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-06-10T00:25:04.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.910+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:95 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f2400 con 0x560405d36000 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.911+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 17 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.911+0000 7f29d0e36740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.911+0000 7f29d0e36740 20 datascan.scan_links: first is now 2 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.911+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- osd_op(unknown.0.0:96 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3400 con 0x560405d36000 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.912+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 <== osd.0 v2:172.21.15.79:6824/709635793 18 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v121'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x560405cc2780 con 0x560405d36000 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.912+0000 7f29d0e36740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.912+0000 7f29d0e36740 10 datascan.scan_links: updating inotable 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.912+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:97 17.13 17:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3000 con 0x560405e89400 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.912+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 29 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.912+0000 7f29d0e36740 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.912+0000 7f29d0e36740 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.912+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- osd_op(unknown.0.0:98 17.13 17:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5604052f2000 con 0x560405e89400 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29cef40640 1 -- 172.21.15.79:0/787155795 <== osd.3 v2:172.21.15.79:6800/4145020298 30 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v121'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x560405cc2500 con 0x560405e89400 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 10 datascan.scan_links: updating snaptable 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- osd_op(unknown.0.0:99 17.d 17:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5604052f3800 con 0x560405e89000 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29cdf3e640 1 -- 172.21.15.79:0/787155795 <== osd.7 v2:172.21.15.117:6816/2099086267 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x560405cc2000 con 0x560405e89000 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x560405d36000 msgr2=0x5604052ccb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x560405d36000 0x5604052ccb00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x560405d36400 msgr2=0x5604052cd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x560405d36400 0x5604052cd080 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x560405d1b400 msgr2=0x5604052cdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x560405d1b400 0x5604052cdb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x560405e89400 msgr2=0x5604052cc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x560405e89400 0x5604052cc580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 reap_dead start 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x560405d36800 msgr2=0x5604052cd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x560405d36800 0x5604052cd600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x560405d1b000 msgr2=0x5604052cec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x560405d1b000 0x5604052cec00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x560405d36c00 msgr2=0x5604052ce680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x560405d36c00 0x5604052ce680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x560405e89000 msgr2=0x560404fb2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x560405e89000 0x560404fb2680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29ce73f640 1 -- 172.21.15.79:0/787155795 reap_dead start 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x560405e88c00 msgr2=0x5604052cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x560405e88c00 0x5604052cc000 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x560405cd8150 tx=0x560405cd5f80 comp rx=0 tx=0).stop 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09c00 msgr2=0x560404fb2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09c00 0x560404fb2100 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x560405e23b30 tx=0x560405cd5f20 comp rx=0 tx=0).stop 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 shutdown_connections 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x560405e88c00 0x5604052cc000 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 --2- 172.21.15.79:0/787155795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560405d09c00 0x560404fb2100 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 >> 172.21.15.79:0/787155795 conn(0x560405d09000 msgr2=0x560405021000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 shutdown_connections 2024-06-10T00:25:04.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.914+0000 7f29d0e36740 1 -- 172.21.15.79:0/787155795 wait complete. 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 -- 172.21.15.79:0/3337006271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560404f35c00 msgr2=0x560404fb1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560404f35c00 0x560404fb1080 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x560405d53c50 tx=0x560405cd68a0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 -- 172.21.15.79:0/3337006271 shutdown_connections 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560404f35c00 0x560404fb1080 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560404f35800 0x560404fb1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 --2- 172.21.15.79:0/3337006271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560404f34c00 0x560404fb1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 -- 172.21.15.79:0/3337006271 >> 172.21.15.79:0/3337006271 conn(0x560404f35000 msgr2=0x560405020800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 -- 172.21.15.79:0/3337006271 shutdown_connections 2024-06-10T00:25:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:04.915+0000 7f29d0e36740 1 -- 172.21.15.79:0/3337006271 wait complete. 2024-06-10T00:25:04.943 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.152091, result: 2024-06-10T00:25:04.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:25:04.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:25:05.000 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-06-10T00:25:05.000 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-06-10T00:25:05.000 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:25:05.000 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-06-10T00:25:05.000 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.000 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-06-10T00:25:05.001 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.001 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-06-10T00:25:05.001 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.001 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-06-10T00:25:05.001 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-06-10T00:25:05.001 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.001 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-06-10T00:25:05.001 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-06-10T00:25:05.002 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.003 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-06-10T00:25:05.004 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-06-10T00:25:05.005 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2024-06-10T00:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:25:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:25:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:25:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-06-10T00:25:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-06-10T00:25:05.012 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = False 2024-06-10T00:25:05.013 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-06-10T00:25:05.014 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2024-06-10T00:25:05.014 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:25:05.014 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:25:05.014 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:25:05.014 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-06-10T00:25:05.014 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.015 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-06-10T00:25:05.016 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.017 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-06-10T00:25:05.018 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-06-10T00:25:05.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-06-10T00:25:05.020 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:25:05.021 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-06-10T00:25:05.022 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-06-10T00:25:05.023 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-06-10T00:25:05.024 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:25:05.025 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-06-10T00:25:05.026 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = False 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:25:05.027 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:25:05.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:25:05.071 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-10T00:25:05.111 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-06-10T00:25:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-06-10T00:25:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:25:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-06-10T00:25:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:25:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:25:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-06-10T00:25:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-06-10T00:25:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-06-10T00:25:05.123 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.124 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-06-10T00:25:05.125 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-06-10T00:25:05.126 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.79,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 8b20248b-d94c-44bd-ba6f-faf8829473b3 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.127 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-06-10T00:25:05.128 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-06-10T00:25:05.129 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:25:05.130 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-06-10T00:25:05.131 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-06-10T00:25:05.132 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-06-10T00:25:05.133 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-06-10T00:25:05.134 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-06-10T00:25:05.135 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-06-10T00:25:05.135 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-06-10T00:25:05.136 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-06-10T00:25:05.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-06-10T00:25:05.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.280+0000 7fe7a8864640 1 Processor -- start 2024-06-10T00:25:05.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.280+0000 7fe7a8864640 1 -- start start 2024-06-10T00:25:05.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe7a8864640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a40b3bf0 0x7fe7a406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:05.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe7a8864640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe7a406d500 0x7fe7a4071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:05.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe7a8864640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a4155000 con 0x7fe7a4154c20 2024-06-10T00:25:05.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe7a8864640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a406dd30 con 0x7fe7a406d500 2024-06-10T00:25:05.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe7a8864640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a406e010 con 0x7fe7a40b3bf0 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe7a2d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe7a406d500 0x7fe7a4071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe7a259c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe7a4154c20 0x7fe7a40b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52030/0 (socket says 172.21.15.79:52030) 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe7a259c640 1 -- 172.21.15.79:0/4127600014 learned_addr learned my addr 172.21.15.79:0/4127600014 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.281+0000 7fe79bfff640 1 --2- 172.21.15.79:0/4127600014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a40b3bf0 0x7fe7a406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a2d9d640 1 -- 172.21.15.79:0/4127600014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a40b3bf0 msgr2=0x7fe7a406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a2d9d640 1 --2- 172.21.15.79:0/4127600014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a40b3bf0 0x7fe7a406cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a2d9d640 1 -- 172.21.15.79:0/4127600014 >> v1:172.21.15.117:6789/0 conn(0x7fe7a4154c20 legacy=0x7fe7a40b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a1d9b640 1 -- 172.21.15.79:0/4127600014 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129852231 0 0) 0x7fe7a4155000 con 0x7fe7a4154c20 2024-06-10T00:25:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a2d9d640 1 -- 172.21.15.79:0/4127600014 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a406e2f0 con 0x7fe7a406d500 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a2d9d640 1 --2- 172.21.15.79:0/4127600014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a406d500 0x7fe7a4071550 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009d90 tx=0x7fe79c02c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc0b25f9afab0868 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a1d9b640 1 -- 172.21.15.79:0/4127600014 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c032770 con 0x7fe7a406d500 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a1d9b640 1 -- 172.21.15.79:0/4127600014 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c038070 con 0x7fe7a406d500 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.282+0000 7fe7a1d9b640 1 -- 172.21.15.79:0/4127600014 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c032b30 con 0x7fe7a406d500 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.283+0000 7fe7a8864640 1 -- 172.21.15.79:0/4127600014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a406d500 msgr2=0x7fe7a4071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.283+0000 7fe7a8864640 1 --2- 172.21.15.79:0/4127600014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a406d500 0x7fe7a4071550 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009d90 tx=0x7fe79c02c870 comp rx=0 tx=0).stop 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.283+0000 7fe7a8864640 1 -- 172.21.15.79:0/4127600014 shutdown_connections 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.283+0000 7fe7a8864640 1 --2- 172.21.15.79:0/4127600014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a406d500 0x7fe7a4071550 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.283+0000 7fe7a8864640 1 --2- 172.21.15.79:0/4127600014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a40b3bf0 0x7fe7a406cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.283+0000 7fe7a8864640 1 -- 172.21.15.79:0/4127600014 >> 172.21.15.79:0/4127600014 conn(0x7fe7a40b1d10 msgr2=0x7fe7a40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:05.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.283+0000 7fe7a8864640 1 -- 172.21.15.79:0/4127600014 shutdown_connections 2024-06-10T00:25:05.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.283+0000 7fe7a8864640 1 -- 172.21.15.79:0/4127600014 wait complete. 2024-06-10T00:25:05.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.284+0000 7fe7a8864640 1 Processor -- start 2024-06-10T00:25:05.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.284+0000 7fe7a8864640 1 -- start start 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a8864640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a406d500 0x7fe7a40af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a8864640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a40b3bf0 0x7fe7a4138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a8864640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7a4154c20 0x7fe7a413ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a8864640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a40d0020 con 0x7fe7a4154c20 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a8864640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a406d9b0 con 0x7fe7a40b3bf0 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a8864640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a40d01a0 con 0x7fe7a406d500 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7a4154c20 0x7fe7a413ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7a4154c20 0x7fe7a413ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59636/0 (socket says 172.21.15.79:59636) 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a2d9d640 1 -- 172.21.15.79:0/3013842541 learned_addr learned my addr 172.21.15.79:0/3013842541 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe79bfff640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a40b3bf0 0x7fe7a4138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.285+0000 7fe7a259c640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a406d500 0x7fe7a40af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:05.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe7a2d9d640 1 -- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a406d500 msgr2=0x7fe7a40af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe7a2d9d640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a406d500 0x7fe7a40af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe7a2d9d640 1 -- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a40b3bf0 msgr2=0x7fe7a4138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe7a2d9d640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a40b3bf0 0x7fe7a4138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe7a2d9d640 1 -- 172.21.15.79:0/3013842541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a40afd40 con 0x7fe7a4154c20 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe79bfff640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a40b3bf0 0x7fe7a4138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe7a2d9d640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7a4154c20 0x7fe7a413ab30 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009eb0 tx=0x7fe79c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe79affd640 1 -- 172.21.15.79:0/3013842541 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c047600 con 0x7fe7a4154c20 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe79affd640 1 -- 172.21.15.79:0/3013842541 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c0477a0 con 0x7fe7a4154c20 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a40b0020 con 0x7fe7a4154c20 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe79affd640 1 -- 172.21.15.79:0/3013842541 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c047b90 con 0x7fe7a4154c20 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.286+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a40b05e0 con 0x7fe7a4154c20 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.287+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a40683c0 con 0x7fe7a4154c20 2024-06-10T00:25:05.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.287+0000 7fe79affd640 1 -- 172.21.15.79:0/3013842541 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe79c032070 con 0x7fe7a4154c20 2024-06-10T00:25:05.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.288+0000 7fe79affd640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe78406be60 0x7fe78406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:05.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.288+0000 7fe79affd640 1 -- 172.21.15.79:0/3013842541 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fe79c0adf90 con 0x7fe7a4154c20 2024-06-10T00:25:05.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.288+0000 7fe7a259c640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe78406be60 0x7fe78406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:05.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.288+0000 7fe7a259c640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe78406be60 0x7fe78406e320 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe794007fd0 tx=0x7fe794007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:05.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.292+0000 7fe79affd640 1 -- 172.21.15.79:0/3013842541 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe79c042070 con 0x7fe7a4154c20 2024-06-10T00:25:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:05.507+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fe7a415a490 con 0x7fe7a4154c20 2024-06-10T00:25:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.445+0000 7fe79affd640 1 -- 172.21.15.79:0/3013842541 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v92) ==== 162+0+0 (secure 0 0 0) 0x7fe79c032e90 con 0x7fe7a4154c20 2024-06-10T00:25:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked joinable; MDS may join as newly active. 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe78406be60 msgr2=0x7fe78406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe78406be60 0x7fe78406e320 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe794007fd0 tx=0x7fe794007de0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7a4154c20 msgr2=0x7fe7a413ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7a4154c20 0x7fe7a413ab30 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009eb0 tx=0x7fe79c004a40 comp rx=0 tx=0).stop 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 shutdown_connections 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fe78406be60 0x7fe78406e320 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7a4154c20 0x7fe7a413ab30 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7a40b3bf0 0x7fe7a4138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 --2- 172.21.15.79:0/3013842541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7a406d500 0x7fe7a40af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 >> 172.21.15.79:0/3013842541 conn(0x7fe7a40b1d10 msgr2=0x7fe7a40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 shutdown_connections 2024-06-10T00:25:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.448+0000 7fe7a8864640 1 -- 172.21.15.79:0/3013842541 wait complete. 2024-06-10T00:25:06.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.568+0000 7f04fc4da640 1 Processor -- start 2024-06-10T00:25:06.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.568+0000 7f04fc4da640 1 -- start start 2024-06-10T00:25:06.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.569+0000 7f04fc4da640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 0x7f04f40d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:06.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.569+0000 7f04fc4da640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04f40cef70 0x7f04f40cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:06.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.569+0000 7f04fc4da640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f415f5e0 con 0x7f04f40d2680 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.569+0000 7f04fc4da640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f04f40d13e0 con 0x7f04f40cef70 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.569+0000 7f04fc4da640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04f40d0ad0 con 0x7f04f415f1a0 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.569+0000 7f04fa276640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f04f40d2680 0x7f04f40d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45196/0 (socket says 172.21.15.79:45196) 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.569+0000 7f04fa276640 1 -- 172.21.15.79:0/3737065804 learned_addr learned my addr 172.21.15.79:0/3737065804 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04f9a75640 1 --2- 172.21.15.79:0/3737065804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 0x7f04f40d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04faa77640 1 --2- 172.21.15.79:0/3737065804 >> v2:172.21.15.117:3300/0 conn(0x7f04f40cef70 0x7f04f40cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04f9274640 1 -- 172.21.15.79:0/3737065804 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042595904 0 0) 0x7f04f415f5e0 con 0x7f04f40d2680 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04f9274640 1 -- 172.21.15.79:0/3737065804 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04dc003520 con 0x7f04f40d2680 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04f9274640 1 -- 172.21.15.79:0/3737065804 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 125027245 0 0) 0x7f04dc003520 con 0x7f04f40d2680 2024-06-10T00:25:06.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04faa77640 1 -- 172.21.15.79:0/3737065804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 msgr2=0x7f04f40d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04faa77640 1 --2- 172.21.15.79:0/3737065804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 0x7f04f40d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04faa77640 1 -- 172.21.15.79:0/3737065804 >> v1:172.21.15.79:6789/0 conn(0x7f04f40d2680 legacy=0x7f04f40d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:06.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.570+0000 7f04faa77640 1 -- 172.21.15.79:0/3737065804 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f415f890 con 0x7f04f40cef70 2024-06-10T00:25:06.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.571+0000 7f04faa77640 1 --2- 172.21.15.79:0/3737065804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40cef70 0x7f04f40cf400 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009d90 tx=0x7f04ec02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b9880d224026950 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:06.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.571+0000 7f04f9274640 1 -- 172.21.15.79:0/3737065804 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4001670 con 0x7f04f40cef70 2024-06-10T00:25:06.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.571+0000 7f04f9274640 1 -- 172.21.15.79:0/3737065804 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ec007540 con 0x7f04f40cef70 2024-06-10T00:25:06.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.571+0000 7f04f9274640 1 -- 172.21.15.79:0/3737065804 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec007910 con 0x7f04f40cef70 2024-06-10T00:25:06.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.572+0000 7f04fc4da640 1 -- 172.21.15.79:0/3737065804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40cef70 msgr2=0x7f04f40cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:06.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.572+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3737065804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40cef70 0x7f04f40cf400 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009d90 tx=0x7f04ec02a5f0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.572+0000 7f04fc4da640 1 -- 172.21.15.79:0/3737065804 shutdown_connections 2024-06-10T00:25:06.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.572+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3737065804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40cef70 0x7f04f40cf400 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.572+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3737065804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 0x7f04f40d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.572+0000 7f04fc4da640 1 -- 172.21.15.79:0/3737065804 >> 172.21.15.79:0/3737065804 conn(0x7f04f409d3f0 msgr2=0x7f04f40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:06.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.572+0000 7f04fc4da640 1 -- 172.21.15.79:0/3737065804 shutdown_connections 2024-06-10T00:25:06.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.572+0000 7f04fc4da640 1 -- 172.21.15.79:0/3737065804 wait complete. 2024-06-10T00:25:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.573+0000 7f04fc4da640 1 Processor -- start 2024-06-10T00:25:06.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.573+0000 7f04fc4da640 1 -- start start 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fc4da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f40cef70 0x7f04f40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fc4da640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d2680 0x7f04f41f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fc4da640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 0x7f04f415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fc4da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04f40d4f00 con 0x7f04f40cef70 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fc4da640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04f40d1070 con 0x7f04f40d2680 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fc4da640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04f40d1870 con 0x7f04f415f1a0 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f40cef70 0x7f04f40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f40cef70 0x7f04f40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59648/0 (socket says 172.21.15.79:59648) 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 -- 172.21.15.79:0/3974172570 learned_addr learned my addr 172.21.15.79:0/3974172570 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04f9a75640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d2680 0x7f04f41f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04faa77640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 0x7f04f415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:06.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 -- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 msgr2=0x7f04f415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 0x7f04f415cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 -- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d2680 msgr2=0x7f04f41f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d2680 0x7f04f41f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 -- 172.21.15.79:0/3974172570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f415dc40 con 0x7f04f40cef70 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04f9a75640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d2680 0x7f04f41f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fa276640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f40cef70 0x7f04f40ca360 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c780 tx=0x7f04e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04f2ffd640 1 -- 172.21.15.79:0/3974172570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4017070 con 0x7f04f40cef70 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04f2ffd640 1 -- 172.21.15.79:0/3974172570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e4005ad0 con 0x7f04f40cef70 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.574+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f415df20 con 0x7f04f40cef70 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.575+0000 7f04f2ffd640 1 -- 172.21.15.79:0/3974172570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4007070 con 0x7f04f40cef70 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.575+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f40ca8a0 con 0x7f04f40cef70 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.576+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f415e0f0 con 0x7f04f40cef70 2024-06-10T00:25:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.576+0000 7f04f2ffd640 1 -- 172.21.15.79:0/3974172570 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04e401a070 con 0x7f04f40cef70 2024-06-10T00:25:06.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.577+0000 7f04f2ffd640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04e006be30 0x7f04e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:06.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.577+0000 7f04f9a75640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04e006be30 0x7f04e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:06.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.577+0000 7f04f2ffd640 1 -- 172.21.15.79:0/3974172570 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f04e408a680 con 0x7f04f40cef70 2024-06-10T00:25:06.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.577+0000 7f04f9a75640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04e006be30 0x7f04e006e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f04f41530f0 tx=0x7f04e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:06.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.581+0000 7f04f2ffd640 1 -- 172.21.15.79:0/3974172570 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f04e4058d60 con 0x7f04f40cef70 2024-06-10T00:25:06.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.788+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04f4068430 con 0x7f04f40cef70 2024-06-10T00:25:06.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.789+0000 7f04f2ffd640 1 -- 172.21.15.79:0/3974172570 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5181 (secure 0 0 0) 0x7f04e4058660 con 0x7f04f40cef70 2024-06-10T00:25:06.788 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:25:06.448198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8715":{"gid":8715,"name":"a","rank":0,"incarnation":93,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6837/781838074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":781838074},{"type":"v1","addr":"172.21.15.79:6837","nonce":781838074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-06-10T00:25:06.789 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 93 2024-06-10T00:25:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.790+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04e006be30 msgr2=0x7f04e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.790+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04e006be30 0x7f04e006e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f04f41530f0 tx=0x7f04e8008040 comp rx=0 tx=0).stop 2024-06-10T00:25:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f40cef70 msgr2=0x7f04f40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f40cef70 0x7f04f40ca360 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c780 tx=0x7f04e400cc40 comp rx=0 tx=0).stop 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 shutdown_connections 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f04e006be30 0x7f04e006e2f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f415f1a0 0x7f04f415cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d2680 0x7f04f41f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 --2- 172.21.15.79:0/3974172570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f40cef70 0x7f04f40ca360 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 >> 172.21.15.79:0/3974172570 conn(0x7f04f409d3f0 msgr2=0x7f04f40b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 shutdown_connections 2024-06-10T00:25:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:06.791+0000 7f04fc4da640 1 -- 172.21.15.79:0/3974172570 wait complete. 2024-06-10T00:25:07.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:24:30.408817+0000', 'modified': '2024-06-10T00:25:06.448198+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 121, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8715}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8715': {'gid': 8715, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/781838074', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 781838074}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 781838074}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:25:07.204 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8715:up:replay 2024-06-10T00:25:08.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:08.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.315+0000 7fa1efa38640 1 Processor -- start 2024-06-10T00:25:08.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.315+0000 7fa1efa38640 1 -- start start 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1efa38640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1e80b7940 0x7fa1e80d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1efa38640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 0x7fa1e80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1efa38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e80b7d20 con 0x7fa1e80b4c80 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1efa38640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e80cc620 con 0x7fa1e80b7940 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1efa38640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80cc900 con 0x7fa1e80cede0 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1ed7d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1e80b7940 0x7fa1e80d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1ecfd3640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa1e80b4c80 0x7fa1e80ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57980/0 (socket says 172.21.15.79:57980) 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1ecfd3640 1 -- 172.21.15.79:0/1015089301 learned_addr learned my addr 172.21.15.79:0/1015089301 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1ed7d4640 1 -- 172.21.15.79:0/1015089301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 msgr2=0x7fa1e80cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:08.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1ed7d4640 1 --2- 172.21.15.79:0/1015089301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 0x7fa1e80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1ed7d4640 1 -- 172.21.15.79:0/1015089301 >> v1:172.21.15.79:6789/0 conn(0x7fa1e80b4c80 legacy=0x7fa1e80ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:08.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1ed7d4640 1 -- 172.21.15.79:0/1015089301 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e80ccbe0 con 0x7fa1e80b7940 2024-06-10T00:25:08.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.316+0000 7fa1dffff640 1 -- 172.21.15.79:0/1015089301 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969310788 0 0) 0x7fa1e80b7d20 con 0x7fa1e80b4c80 2024-06-10T00:25:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.317+0000 7fa1ed7d4640 1 --2- 172.21.15.79:0/1015089301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b7940 0x7fa1e80d0af0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40097a0 tx=0x7fa1e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451ac5992cdbb6b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.317+0000 7fa1dffff640 1 -- 172.21.15.79:0/1015089301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4037070 con 0x7fa1e80b7940 2024-06-10T00:25:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.317+0000 7fa1dffff640 1 -- 172.21.15.79:0/1015089301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4032440 con 0x7fa1e80b7940 2024-06-10T00:25:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.317+0000 7fa1dffff640 1 -- 172.21.15.79:0/1015089301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4032810 con 0x7fa1e80b7940 2024-06-10T00:25:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.318+0000 7fa1efa38640 1 -- 172.21.15.79:0/1015089301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b7940 msgr2=0x7fa1e80d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.318+0000 7fa1efa38640 1 --2- 172.21.15.79:0/1015089301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b7940 0x7fa1e80d0af0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40097a0 tx=0x7fa1e402a1a0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.318+0000 7fa1efa38640 1 -- 172.21.15.79:0/1015089301 shutdown_connections 2024-06-10T00:25:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.318+0000 7fa1efa38640 1 --2- 172.21.15.79:0/1015089301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 0x7fa1e80cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.318+0000 7fa1efa38640 1 --2- 172.21.15.79:0/1015089301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b7940 0x7fa1e80d0af0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.318+0000 7fa1efa38640 1 -- 172.21.15.79:0/1015089301 >> 172.21.15.79:0/1015089301 conn(0x7fa1e80d1e50 msgr2=0x7fa1e80d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.318+0000 7fa1efa38640 1 -- 172.21.15.79:0/1015089301 shutdown_connections 2024-06-10T00:25:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.318+0000 7fa1efa38640 1 -- 172.21.15.79:0/1015089301 wait complete. 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.319+0000 7fa1efa38640 1 Processor -- start 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.319+0000 7fa1efa38640 1 -- start start 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1efa38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b4c80 0x7fa1e80c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1efa38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e80b7940 0x7fa1e81f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1efa38640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 0x7fa1e81f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1efa38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80d2c10 con 0x7fa1e80b4c80 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1efa38640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80d2a90 con 0x7fa1e80b7940 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1efa38640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80d1030 con 0x7fa1e80cede0 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ed7d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b4c80 0x7fa1e80c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ed7d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b4c80 0x7fa1e80c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36958/0 (socket says 172.21.15.79:36958) 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ed7d4640 1 -- 172.21.15.79:0/3924795717 learned_addr learned my addr 172.21.15.79:0/3924795717 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ecfd3640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e80b7940 0x7fa1e81f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1edfd5640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 0x7fa1e81f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ed7d4640 1 -- 172.21.15.79:0/3924795717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 msgr2=0x7fa1e81f7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ed7d4640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 0x7fa1e81f7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ed7d4640 1 -- 172.21.15.79:0/3924795717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e80b7940 msgr2=0x7fa1e81f7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ed7d4640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e80b7940 0x7fa1e81f7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.320+0000 7fa1ed7d4640 1 -- 172.21.15.79:0/3924795717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e80c6e00 con 0x7fa1e80b4c80 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.321+0000 7fa1ed7d4640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b4c80 0x7fa1e80c7c50 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40097a0 tx=0x7fa1e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.321+0000 7fa1ddffb640 1 -- 172.21.15.79:0/3924795717 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4041070 con 0x7fa1e80b4c80 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.321+0000 7fa1ddffb640 1 -- 172.21.15.79:0/3924795717 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e403c870 con 0x7fa1e80b4c80 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.321+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e80c5d60 con 0x7fa1e80b4c80 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.321+0000 7fa1ddffb640 1 -- 172.21.15.79:0/3924795717 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4037040 con 0x7fa1e80b4c80 2024-06-10T00:25:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.321+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e80c6320 con 0x7fa1e80b4c80 2024-06-10T00:25:08.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.322+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e8068430 con 0x7fa1e80b4c80 2024-06-10T00:25:08.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.322+0000 7fa1ddffb640 1 -- 172.21.15.79:0/3924795717 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1e4044070 con 0x7fa1e80b4c80 2024-06-10T00:25:08.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.323+0000 7fa1ddffb640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1cc06be30 0x7fa1cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:08.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.323+0000 7fa1ecfd3640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1cc06be30 0x7fa1cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:08.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.323+0000 7fa1ddffb640 1 -- 172.21.15.79:0/3924795717 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fa1e40abe90 con 0x7fa1e80b4c80 2024-06-10T00:25:08.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.323+0000 7fa1ecfd3640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1cc06be30 0x7fa1cc06e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa1e815e760 tx=0x7fa1d8007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:08.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.327+0000 7fa1ddffb640 1 -- 172.21.15.79:0/3924795717 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa1e407a720 con 0x7fa1e80b4c80 2024-06-10T00:25:08.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.538+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1e8071110 con 0x7fa1e80b4c80 2024-06-10T00:25:08.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.538+0000 7fa1ddffb640 1 -- 172.21.15.79:0/3924795717 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5181 (secure 0 0 0) 0x7fa1e407a020 con 0x7fa1e80b4c80 2024-06-10T00:25:08.538 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:08.538 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":95,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:25:07.455044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8715":{"gid":8715,"name":"a","rank":0,"incarnation":93,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.79:6837/781838074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":781838074},{"type":"v1","addr":"172.21.15.79:6837","nonce":781838074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-06-10T00:25:08.539 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 95 2024-06-10T00:25:08.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1cc06be30 msgr2=0x7fa1cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:08.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1cc06be30 0x7fa1cc06e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa1e815e760 tx=0x7fa1d8007b50 comp rx=0 tx=0).stop 2024-06-10T00:25:08.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b4c80 msgr2=0x7fa1e80c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b4c80 0x7fa1e80c7c50 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40097a0 tx=0x7fa1e40046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 shutdown_connections 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1cc06be30 0x7fa1cc06e2f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e80cede0 0x7fa1e81f7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e80b7940 0x7fa1e81f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 --2- 172.21.15.79:0/3924795717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e80b4c80 0x7fa1e80c7c50 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.540+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 >> 172.21.15.79:0/3924795717 conn(0x7fa1e80d1e50 msgr2=0x7fa1e81611f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.541+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 shutdown_connections 2024-06-10T00:25:08.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:08.541+0000 7fa1efa38640 1 -- 172.21.15.79:0/3924795717 wait complete. 2024-06-10T00:25:08.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:24:30.408817+0000', 'modified': '2024-06-10T00:25:07.455044+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 121, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8715}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8715': {'gid': 8715, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.79:6837/781838074', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 781838074}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 781838074}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-06-10T00:25:08.955 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8715:up:rejoin 2024-06-10T00:25:09.955 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:10.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.067+0000 7fd2433c8640 1 Processor -- start 2024-06-10T00:25:10.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.067+0000 7fd2433c8640 1 -- start start 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd2433c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd23c15f1a0 0x7fd23c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd2433c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 0x7fd23c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd2433c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23c15f5e0 con 0x7fd23c0d2680 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd2433c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd23c0d13e0 con 0x7fd23c15f1a0 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd2433c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c0d0ad0 con 0x7fd23c0cef70 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd241164640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd23c0d2680 0x7fd23c0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57984/0 (socket says 172.21.15.79:57984) 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd241164640 1 -- 172.21.15.79:0/3118622731 learned_addr learned my addr 172.21.15.79:0/3118622731 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd240963640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd23c15f1a0 0x7fd23c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.068+0000 7fd241965640 1 --2- 172.21.15.79:0/3118622731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 0x7fd23c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.069+0000 7fd240963640 1 -- 172.21.15.79:0/3118622731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 msgr2=0x7fd23c0cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.069+0000 7fd240963640 1 --2- 172.21.15.79:0/3118622731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 0x7fd23c0cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.069+0000 7fd240963640 1 -- 172.21.15.79:0/3118622731 >> v1:172.21.15.79:6789/0 conn(0x7fd23c0d2680 legacy=0x7fd23c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.069+0000 7fd240963640 1 -- 172.21.15.79:0/3118622731 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c15f890 con 0x7fd23c15f1a0 2024-06-10T00:25:10.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.069+0000 7fd233fff640 1 -- 172.21.15.79:0/3118622731 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907764866 0 0) 0x7fd23c15f5e0 con 0x7fd23c0d2680 2024-06-10T00:25:10.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.069+0000 7fd240963640 1 --2- 172.21.15.79:0/3118622731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0d1fc0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fd2380097a0 tx=0x7fd23802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd8c05057121d2b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd233fff640 1 -- 172.21.15.79:0/3118622731 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238037070 con 0x7fd23c15f1a0 2024-06-10T00:25:10.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd233fff640 1 -- 172.21.15.79:0/3118622731 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd238032440 con 0x7fd23c15f1a0 2024-06-10T00:25:10.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd233fff640 1 -- 172.21.15.79:0/3118622731 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238032810 con 0x7fd23c15f1a0 2024-06-10T00:25:10.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd2433c8640 1 -- 172.21.15.79:0/3118622731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 msgr2=0x7fd23c0d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd2433c8640 1 --2- 172.21.15.79:0/3118622731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0d1fc0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fd2380097a0 tx=0x7fd23802a180 comp rx=0 tx=0).stop 2024-06-10T00:25:10.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd2433c8640 1 -- 172.21.15.79:0/3118622731 shutdown_connections 2024-06-10T00:25:10.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd2433c8640 1 --2- 172.21.15.79:0/3118622731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 0x7fd23c0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd2433c8640 1 --2- 172.21.15.79:0/3118622731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0d1fc0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd2433c8640 1 -- 172.21.15.79:0/3118622731 >> 172.21.15.79:0/3118622731 conn(0x7fd23c09d3f0 msgr2=0x7fd23c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd2433c8640 1 -- 172.21.15.79:0/3118622731 shutdown_connections 2024-06-10T00:25:10.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.070+0000 7fd2433c8640 1 -- 172.21.15.79:0/3118622731 wait complete. 2024-06-10T00:25:10.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.071+0000 7fd2433c8640 1 Processor -- start 2024-06-10T00:25:10.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd2433c8640 1 -- start start 2024-06-10T00:25:10.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd2433c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 0x7fd23c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd2433c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0d2680 0x7fd23c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd2433c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd2433c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0d4f00 con 0x7fd23c15f1a0 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd2433c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0d1070 con 0x7fd23c0d2680 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd2433c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c0d1870 con 0x7fd23c0cef70 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd241965640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd241965640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0b9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36974/0 (socket says 172.21.15.79:36974) 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd241965640 1 -- 172.21.15.79:0/2947043962 learned_addr learned my addr 172.21.15.79:0/2947043962 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd241164640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 0x7fd23c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.072+0000 7fd240963640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0d2680 0x7fd23c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd241965640 1 -- 172.21.15.79:0/2947043962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 msgr2=0x7fd23c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd241965640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 0x7fd23c15e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd241965640 1 -- 172.21.15.79:0/2947043962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0d2680 msgr2=0x7fd23c15c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd241965640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0d2680 0x7fd23c15c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd241965640 1 -- 172.21.15.79:0/2947043962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c15c560 con 0x7fd23c15f1a0 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd241965640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0b9930 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd23400efc0 tx=0x7fd23400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd231ffb640 1 -- 172.21.15.79:0/2947043962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234018020 con 0x7fd23c15f1a0 2024-06-10T00:25:10.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd231ffb640 1 -- 172.21.15.79:0/2947043962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd234014480 con 0x7fd23c15f1a0 2024-06-10T00:25:10.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c15c800 con 0x7fd23c15f1a0 2024-06-10T00:25:10.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.073+0000 7fd231ffb640 1 -- 172.21.15.79:0/2947043962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234014870 con 0x7fd23c15f1a0 2024-06-10T00:25:10.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.074+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c0b6ef0 con 0x7fd23c15f1a0 2024-06-10T00:25:10.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.075+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c0caec0 con 0x7fd23c15f1a0 2024-06-10T00:25:10.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.075+0000 7fd231ffb640 1 -- 172.21.15.79:0/2947043962 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd234005d10 con 0x7fd23c15f1a0 2024-06-10T00:25:10.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.076+0000 7fd231ffb640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd22006be30 0x7fd22006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.076+0000 7fd231ffb640 1 -- 172.21.15.79:0/2947043962 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fd23408ba50 con 0x7fd23c15f1a0 2024-06-10T00:25:10.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.076+0000 7fd241164640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd22006be30 0x7fd22006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.076+0000 7fd241164640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd22006be30 0x7fd22006e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000f60 tx=0x7fd22c007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.081+0000 7fd231ffb640 1 -- 172.21.15.79:0/2947043962 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd23c0caec0 con 0x7fd23c15f1a0 2024-06-10T00:25:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.290+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd23c068430 con 0x7fd23c15f1a0 2024-06-10T00:25:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.291+0000 7fd231ffb640 1 -- 172.21.15.79:0/2947043962 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5188 (secure 0 0 0) 0x7fd234022070 con 0x7fd23c15f1a0 2024-06-10T00:25:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:25:09.459143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8715":{"gid":8715,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/781838074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":781838074},{"type":"v1","addr":"172.21.15.79:6837","nonce":781838074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8715,"qdb_cluster":[8715]},"id":8}]} 2024-06-10T00:25:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd22006be30 msgr2=0x7fd22006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd22006be30 0x7fd22006e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000f60 tx=0x7fd22c007d50 comp rx=0 tx=0).stop 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 msgr2=0x7fd23c0b9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0b9930 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd23400efc0 tx=0x7fd23400c490 comp rx=0 tx=0).stop 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 shutdown_connections 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd22006be30 0x7fd22006e2f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd23c15f1a0 0x7fd23c0b9930 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0d2680 0x7fd23c15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 --2- 172.21.15.79:0/2947043962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cef70 0x7fd23c15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 >> 172.21.15.79:0/2947043962 conn(0x7fd23c09d3f0 msgr2=0x7fd23c0d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 shutdown_connections 2024-06-10T00:25:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.293+0000 7fd2433c8640 1 -- 172.21.15.79:0/2947043962 wait complete. 2024-06-10T00:25:10.444 INFO:tasks.ceph.mds.a.smithi079.stderr:2024-06-10T00:25:10.444+0000 7f1a33196640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:25:10.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-10T00:24:30.408817+0000', 'modified': '2024-06-10T00:25:09.459143+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 121, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8715}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8715': {'gid': 8715, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/781838074', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6835', 'nonce': 781838074}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 781838074}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8715, 'qdb_cluster': [8715]} 2024-06-10T00:25:10.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-10T00:25:10.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-10T00:25:10.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.809+0000 7f22ca279640 1 Processor -- start 2024-06-10T00:25:10.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.809+0000 7f22ca279640 1 -- start start 2024-06-10T00:25:10.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22ca279640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22c41553c0 0x7f22c40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22ca279640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 0x7f22c40cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22ca279640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c40b31a0 con 0x7f22c40b2cf0 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22ca279640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f22c40b3420 con 0x7f22c41553c0 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22ca279640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22c40cc750 con 0x7f22c40cec50 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22c3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22c41553c0 0x7f22c40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22c3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22c41553c0 0x7f22c40cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36986/0 (socket says 172.21.15.79:36986) 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22c3fff640 1 -- 172.21.15.79:0/2632926813 learned_addr learned my addr 172.21.15.79:0/2632926813 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22c8816640 1 --2- 172.21.15.79:0/2632926813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 0x7f22c40cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22c3fff640 1 -- 172.21.15.79:0/2632926813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 msgr2=0x7f22c40cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22c3fff640 1 --2- 172.21.15.79:0/2632926813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 0x7f22c40cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22c3fff640 1 -- 172.21.15.79:0/2632926813 >> v1:172.21.15.117:6789/0 conn(0x7f22c40b2cf0 legacy=0x7f22c415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.810+0000 7f22c3fff640 1 -- 172.21.15.79:0/2632926813 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c40cca30 con 0x7f22c41553c0 2024-06-10T00:25:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.811+0000 7f22c3fff640 1 --2- 172.21.15.79:0/2632926813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c41553c0 0x7f22c40cd230 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009870 tx=0x7f22b402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8c07ff14959fd8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.811+0000 7f22c2ffd640 1 -- 172.21.15.79:0/2632926813 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4037070 con 0x7f22c41553c0 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.811+0000 7f22c2ffd640 1 -- 172.21.15.79:0/2632926813 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4032440 con 0x7f22c41553c0 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.811+0000 7f22c2ffd640 1 -- 172.21.15.79:0/2632926813 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4032810 con 0x7f22c41553c0 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.812+0000 7f22ca279640 1 -- 172.21.15.79:0/2632926813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c41553c0 msgr2=0x7f22c40cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.812+0000 7f22ca279640 1 --2- 172.21.15.79:0/2632926813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c41553c0 0x7f22c40cd230 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009870 tx=0x7f22b402a210 comp rx=0 tx=0).stop 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.812+0000 7f22ca279640 1 -- 172.21.15.79:0/2632926813 shutdown_connections 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.812+0000 7f22ca279640 1 --2- 172.21.15.79:0/2632926813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 0x7f22c40cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.812+0000 7f22ca279640 1 --2- 172.21.15.79:0/2632926813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c41553c0 0x7f22c40cd230 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.812+0000 7f22ca279640 1 -- 172.21.15.79:0/2632926813 >> 172.21.15.79:0/2632926813 conn(0x7f22c40b19f0 msgr2=0x7f22c40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.812+0000 7f22ca279640 1 -- 172.21.15.79:0/2632926813 shutdown_connections 2024-06-10T00:25:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.812+0000 7f22ca279640 1 -- 172.21.15.79:0/2632926813 wait complete. 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.813+0000 7f22ca279640 1 Processor -- start 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.813+0000 7f22ca279640 1 -- start start 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22ca279640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40b2cf0 0x7f22c415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22ca279640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 0x7f22c415de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22ca279640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c41553c0 0x7f22c41f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22ca279640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22c41557a0 con 0x7f22c40b2cf0 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22ca279640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22c40b3700 con 0x7f22c41553c0 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22ca279640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22c4155920 con 0x7f22c40cec50 2024-06-10T00:25:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40b2cf0 0x7f22c415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40b2cf0 0x7f22c415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36996/0 (socket says 172.21.15.79:36996) 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 -- 172.21.15.79:0/1210256814 learned_addr learned my addr 172.21.15.79:0/1210256814 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 -- 172.21.15.79:0/1210256814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 msgr2=0x7f22c415de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 0x7f22c415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 -- 172.21.15.79:0/1210256814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c41553c0 msgr2=0x7f22c41f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c41553c0 0x7f22c41f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 -- 172.21.15.79:0/1210256814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c415e4e0 con 0x7f22c40b2cf0 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.814+0000 7f22c3fff640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40b2cf0 0x7f22c415d900 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f22b4000c00 tx=0x7f22b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.815+0000 7f22c0ff9640 1 -- 172.21.15.79:0/1210256814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4037040 con 0x7f22c40b2cf0 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.815+0000 7f22c0ff9640 1 -- 172.21.15.79:0/1210256814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4042070 con 0x7f22c40b2cf0 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.815+0000 7f22ca279640 1 -- 172.21.15.79:0/1210256814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c415e7c0 con 0x7f22c40b2cf0 2024-06-10T00:25:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.815+0000 7f22c0ff9640 1 -- 172.21.15.79:0/1210256814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4030bb0 con 0x7f22c40b2cf0 2024-06-10T00:25:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.815+0000 7f22ca279640 1 -- 172.21.15.79:0/1210256814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c415ed80 con 0x7f22c40b2cf0 2024-06-10T00:25:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.816+0000 7f22c0ff9640 1 -- 172.21.15.79:0/1210256814 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22b4047460 con 0x7f22c40b2cf0 2024-06-10T00:25:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.817+0000 7f22c0ff9640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22b006be30 0x7f22b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.817+0000 7f22c0ff9640 1 -- 172.21.15.79:0/1210256814 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f22b40abd30 con 0x7f22c40b2cf0 2024-06-10T00:25:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.817+0000 7f22c37fe640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22b006be30 0x7f22b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.817+0000 7f22c37fe640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22b006be30 0x7f22b006e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f22c415ce80 tx=0x7f22b80079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22ccf83740 1 Processor -- start 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22ccf83740 1 -- start start 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e759ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e729960 0x55d24e72f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e775ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22ccf83740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d24e692740 con 0x55d24e775660 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22ccf83740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d24e630a80 con 0x55d24e729960 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22ccf83740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d24e68e700 con 0x55d24e759700 2024-06-10T00:25:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22c8816640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e775ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22c8816640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e775ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37008/0 (socket says 172.21.15.79:37008) 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.818+0000 7f22c8816640 1 -- 172.21.15.79:0/1579954549 learned_addr learned my addr 172.21.15.79:0/1579954549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c3fff640 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e759ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c37fe640 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e729960 0x55d24e72f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c8816640 1 -- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 msgr2=0x55d24e759ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c8816640 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e759ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c8816640 1 -- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e729960 msgr2=0x55d24e72f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c8816640 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e729960 0x55d24e72f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c8816640 1 -- 172.21.15.79:0/1579954549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24e65bfb0 con 0x55d24e775660 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c37fe640 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e729960 0x55d24e72f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22c8816640 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e775ae0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f22bc007f20 tx=0x7f22bc00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a32ad8e017d5fc server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22a9ffb640 1 -- 172.21.15.79:0/1579954549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc003b90 con 0x55d24e775660 2024-06-10T00:25:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22a9ffb640 1 -- 172.21.15.79:0/1579954549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22bc003d30 con 0x55d24e775660 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22a9ffb640 1 -- 172.21.15.79:0/1579954549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc004240 con 0x55d24e775660 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22ccf83740 1 -- 172.21.15.79:0/1579954549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 msgr2=0x55d24e775ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.819+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e775ae0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f22bc007f20 tx=0x7f22bc00c7a0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 -- 172.21.15.79:0/1579954549 shutdown_connections 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e775ae0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e729960 0x55d24e72f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1579954549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e759ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 -- 172.21.15.79:0/1579954549 >> 172.21.15.79:0/1579954549 conn(0x55d24e72bbd0 msgr2=0x55d24e774510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 -- 172.21.15.79:0/1579954549 shutdown_connections 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 -- 172.21.15.79:0/1579954549 wait complete. 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 -- start start 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.820+0000 7f22ccf83740 1 Processor -- start 2024-06-10T00:25:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e778be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e775660 0x55d24e775a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e753150 0x55d24e775fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22ccf83740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d24e72fed0 con 0x55d24e753150 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22ccf83740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d24e61bc30 con 0x55d24e775660 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22ccf83740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d24e72f500 con 0x55d24e759700 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22ccf83740 10 client.0 _ll_register_callbacks cb 0x55d24e64d7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c8816640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e753150 0x55d24e775fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c8816640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e753150 0x55d24e775fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37010/0 (socket says 172.21.15.79:37010) 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c8816640 1 -- 172.21.15.79:0/1635128749 learned_addr learned my addr 172.21.15.79:0/1635128749 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c3fff640 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e778be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c37fe640 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e775660 0x55d24e775a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c8816640 1 -- 172.21.15.79:0/1635128749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 msgr2=0x55d24e778be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c8816640 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e778be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c8816640 1 -- 172.21.15.79:0/1635128749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e775660 msgr2=0x55d24e775a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.821+0000 7f22c8816640 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e775660 0x55d24e775a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22c8816640 1 -- 172.21.15.79:0/1635128749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d24e3a62d0 con 0x55d24e753150 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22c8816640 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e753150 0x55d24e775fa0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f22bc007e10 tx=0x7f22bc00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4d664333b590ba server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22a2ffd640 1 -- 172.21.15.79:0/1635128749 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00ea10 con 0x55d24e753150 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22a2ffd640 1 -- 172.21.15.79:0/1635128749 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f22bc00ebb0 con 0x55d24e753150 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 1 -- 172.21.15.79:0/1635128749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22bc003d30 con 0x55d24e753150 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22a2ffd640 1 -- 172.21.15.79:0/1635128749 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f22bc00edb0 con 0x55d24e753150 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 10 client.8814 fetch_fsmap learned FSMap version 96 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 1 -- 172.21.15.79:0/1635128749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55d24e4706b0 con 0x55d24e753150 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22a2ffd640 1 -- 172.21.15.79:0/1635128749 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22bc003d30 con 0x55d24e753150 2024-06-10T00:25:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22a2ffd640 1 -- 172.21.15.79:0/1635128749 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 96) ==== 3494+0+0 (secure 0 0 0) 0x7f22bc029360 con 0x55d24e753150 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 10 client.8814 fetch_fsmap finished waiting for FSMap version 96 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 10 client.8814 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 20 client.8814 populate_metadata read hostname 'smithi079' 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] conn(0x55d24e794de0 0x55d24e7971d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 4 client.8814 mds_command: new command op to 8715 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22ccf83740 1 -- 172.21.15.79:0/1635128749 --> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d24e69fe70 con 0x55d24e794de0 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.822+0000 7f22c3fff640 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] conn(0x55d24e794de0 0x55d24e7971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.823+0000 7f22a2ffd640 10 client.8814 ms_handle_connect on v2:172.21.15.79:6835/781838074 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.823+0000 7f22c3fff640 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] conn(0x55d24e794de0 0x55d24e7971d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4e04478cbe120d3 server_cookie=e5a74a95fd8a0f10 in_seq=0 out_seq=0 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.823+0000 7f22a2ffd640 1 -- 172.21.15.79:0/1635128749 <== mds.0 v2:172.21.15.79:6835/781838074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d24e69fe70 con 0x55d24e794de0 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.823+0000 7f22a2ffd640 10 client.8814 handle_command_reply: tid=0 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.823+0000 7f22ccf83740 1 client.8814 shutdown 2024-06-10T00:25:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.823+0000 7f22ccf83740 1 -- 172.21.15.79:0/1635128749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e753150 msgr2=0x55d24e775fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.823+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e753150 0x55d24e775fa0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f22bc007e10 tx=0x7f22bc00f000 comp rx=0 tx=0).stop 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 1 -- 172.21.15.79:0/1635128749 shutdown_connections 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] conn(0x55d24e794de0 0x55d24e7971d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e753150 0x55d24e775fa0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e775660 0x55d24e775a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22a2ffd640 0 client.8814 ms_handle_reset on v2:172.21.15.79:6835/781838074 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 1 --2- 172.21.15.79:0/1635128749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e778be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 1 -- 172.21.15.79:0/1635128749 >> 172.21.15.79:0/1635128749 conn(0x55d24e729960 msgr2=0x55d24e777a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 1 -- 172.21.15.79:0/1635128749 shutdown_connections 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 1 -- 172.21.15.79:0/1635128749 wait complete. 2024-06-10T00:25:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.824+0000 7f22ccf83740 20 client.8814 trim_cache size 0 max 16384 2024-06-10T00:25:10.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.842+0000 7f22ccf83740 1 Processor -- start 2024-06-10T00:25:10.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.842+0000 7f22ccf83740 1 -- start start 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 0x55d24e72e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e759700 0x55d24e751c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e775660 0x55d24e752140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22ccf83740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22c40725f0 con 0x55d24e759700 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22ccf83740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22c409d240 con 0x55d24e753150 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22ccf83740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22c409d890 con 0x55d24e775660 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22c37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e759700 0x55d24e751c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22c37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e759700 0x55d24e751c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37018/0 (socket says 172.21.15.79:37018) 2024-06-10T00:25:10.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22c37fe640 1 -- 172.21.15.79:0/4191223758 learned_addr learned my addr 172.21.15.79:0/4191223758 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22c37fe640 1 -- 172.21.15.79:0/4191223758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e775660 msgr2=0x55d24e752140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22c37fe640 1 --2- 172.21.15.79:0/4191223758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e775660 0x55d24e752140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22c37fe640 1 -- 172.21.15.79:0/4191223758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 msgr2=0x55d24e72e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22c37fe640 1 --2- 172.21.15.79:0/4191223758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 0x55d24e72e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.843+0000 7f22c37fe640 1 -- 172.21.15.79:0/4191223758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24e741440 con 0x55d24e759700 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22c37fe640 1 --2- 172.21.15.79:0/4191223758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e759700 0x55d24e751c00 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f22b8004620 tx=0x7f22b8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81a0b04ab2dda8b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22a97fa640 1 -- 172.21.15.79:0/4191223758 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8027070 con 0x55d24e759700 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22a97fa640 1 -- 172.21.15.79:0/4191223758 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b80176e0 con 0x55d24e759700 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22a97fa640 1 -- 172.21.15.79:0/4191223758 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8017ad0 con 0x55d24e759700 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 -- 172.21.15.79:0/4191223758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e759700 msgr2=0x55d24e751c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 --2- 172.21.15.79:0/4191223758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e759700 0x55d24e751c00 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f22b8004620 tx=0x7f22b8012000 comp rx=0 tx=0).stop 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 -- 172.21.15.79:0/4191223758 shutdown_connections 2024-06-10T00:25:10.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 --2- 172.21.15.79:0/4191223758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e775660 0x55d24e752140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 --2- 172.21.15.79:0/4191223758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e759700 0x55d24e751c00 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 --2- 172.21.15.79:0/4191223758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 0x55d24e72e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 -- 172.21.15.79:0/4191223758 >> 172.21.15.79:0/4191223758 conn(0x55d24e729960 msgr2=0x55d24e725090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 -- 172.21.15.79:0/4191223758 shutdown_connections 2024-06-10T00:25:10.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.844+0000 7f22ccf83740 1 -- 172.21.15.79:0/4191223758 wait complete. 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.845+0000 7f22ccf83740 1 -- start start 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.845+0000 7f22ccf83740 1 Processor -- start 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 0x55d24e7f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e751a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22ccf83740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e751f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22ccf83740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d24e75c270 con 0x55d24e775660 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22ccf83740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d24e779410 con 0x55d24e753150 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22ccf83740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d24e75c8c0 con 0x55d24e759700 2024-06-10T00:25:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22ccf83740 10 client.0 _ll_register_callbacks cb 0x7f22bc0072d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c8816640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e751f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c8816640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e751f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37028/0 (socket says 172.21.15.79:37028) 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c8816640 1 -- 172.21.15.79:0/3792092590 learned_addr learned my addr 172.21.15.79:0/3792092590 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c37fe640 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e751a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c3fff640 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 0x55d24e7f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c8816640 1 -- 172.21.15.79:0/3792092590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 msgr2=0x55d24e751a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c8816640 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e751a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c8816640 1 -- 172.21.15.79:0/3792092590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 msgr2=0x55d24e7f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c8816640 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 0x55d24e7f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.846+0000 7f22c8816640 1 -- 172.21.15.79:0/3792092590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d24e75bbb0 con 0x55d24e775660 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22c8816640 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e751f80 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00c7e0 tx=0x7f22bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651ede1b8695f66b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-10T00:25:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22a2ffd640 1 -- 172.21.15.79:0/3792092590 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc016840 con 0x55d24e775660 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22a2ffd640 1 -- 172.21.15.79:0/3792092590 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f22bc0169e0 con 0x55d24e775660 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 1 -- 172.21.15.79:0/3792092590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22b80176e0 con 0x55d24e775660 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22a2ffd640 1 -- 172.21.15.79:0/3792092590 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f22bc03e050 con 0x55d24e775660 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 10 client.8820 fetch_fsmap learned FSMap version 96 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 1 -- 172.21.15.79:0/3792092590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55d24e777fb0 con 0x55d24e775660 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22a2ffd640 1 -- 172.21.15.79:0/3792092590 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b80176e0 con 0x55d24e775660 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22a2ffd640 1 -- 172.21.15.79:0/3792092590 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 96) ==== 3494+0+0 (secure 0 0 0) 0x7f22bc041020 con 0x55d24e775660 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 10 client.8820 fetch_fsmap finished waiting for FSMap version 96 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 10 client.8820 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 20 client.8820 populate_metadata read hostname 'smithi079' 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] conn(0x55d24e773530 0x55d24e773910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 4 client.8820 mds_command: new command op to 8715 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22ccf83740 1 -- 172.21.15.79:0/3792092590 --> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] -- command(tid 0: {"prefix": "status"}) -- 0x55d24e69a1c0 con 0x55d24e773530 2024-06-10T00:25:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22c3fff640 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] conn(0x55d24e773530 0x55d24e773910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22a2ffd640 10 client.8820 ms_handle_connect on v2:172.21.15.79:6835/781838074 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.847+0000 7f22c3fff640 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] conn(0x55d24e773530 0x55d24e773910 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4225fae00e5c6f33 server_cookie=639e3b0d43f6672f in_seq=0 out_seq=0 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22a2ffd640 1 -- 172.21.15.79:0/3792092590 <== mds.0 v2:172.21.15.79:6835/781838074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55d24e69a1c0 con 0x55d24e773530 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22a2ffd640 10 client.8820 handle_command_reply: tid=0 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 client.8820 shutdown 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 -- 172.21.15.79:0/3792092590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 msgr2=0x55d24e751f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e751f80 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00c7e0 tx=0x7f22bc004a40 comp rx=0 tx=0).stop 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 -- 172.21.15.79:0/3792092590 shutdown_connections 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.79:6835/781838074,v1:172.21.15.79:6837/781838074] conn(0x55d24e773530 0x55d24e773910 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d24e775660 0x55d24e751f80 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d24e759700 0x55d24e751a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22a2ffd640 0 client.8820 ms_handle_reset on v2:172.21.15.79:6835/781838074 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 --2- 172.21.15.79:0/3792092590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d24e753150 0x55d24e7f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 -- 172.21.15.79:0/3792092590 >> 172.21.15.79:0/3792092590 conn(0x55d24e729960 msgr2=0x55d24e776a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 -- 172.21.15.79:0/3792092590 shutdown_connections 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 1 -- 172.21.15.79:0/3792092590 wait complete. 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ccf83740 20 client.8820 trim_cache size 0 max 16384 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "8b20248b-d94c-44bd-ba6f-faf8829473b3", 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-06-10T00:25:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8715, 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.3988635949999999, 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 96, 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 121, 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 121, 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 6.3775130349999998 2024-06-10T00:25:10.855 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ca279640 1 -- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22b006be30 msgr2=0x7f22b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ca279640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22b006be30 0x7f22b006e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f22c415ce80 tx=0x7f22b80079b0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ca279640 1 -- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40b2cf0 msgr2=0x7f22c415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.848+0000 7f22ca279640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40b2cf0 0x7f22c415d900 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f22b4000c00 tx=0x7f22b40046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.849+0000 7f22ca279640 1 -- 172.21.15.79:0/1210256814 shutdown_connections 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.849+0000 7f22ca279640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22b006be30 0x7f22b006e2f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.849+0000 7f22ca279640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c41553c0 0x7f22c41f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.849+0000 7f22ca279640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40cec50 0x7f22c415de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.849+0000 7f22ca279640 1 --2- 172.21.15.79:0/1210256814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c40b2cf0 0x7f22c415d900 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.849+0000 7f22ca279640 1 -- 172.21.15.79:0/1210256814 >> 172.21.15.79:0/1210256814 conn(0x7f22c40b19f0 msgr2=0x7f22c40cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.849+0000 7f22ca279640 1 -- 172.21.15.79:0/1210256814 shutdown_connections 2024-06-10T00:25:10.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.849+0000 7f22ca279640 1 -- 172.21.15.79:0/1210256814 wait complete. 2024-06-10T00:25:10.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-10T00:25:10.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.958+0000 7f651c0d4640 1 Processor -- start 2024-06-10T00:25:10.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.958+0000 7f651c0d4640 1 -- start start 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651c0d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65141553c0 0x7f65140cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651c0d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651c0d4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f651415c3f0 con 0x7f65140cec50 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651c0d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f65140b3170 con 0x7f65141553c0 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651c0d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f65140b3420 con 0x7f65140b2cf0 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f6519e70640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65141553c0 0x7f65140cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651a671640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65140cec50 0x7f6514071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57988/0 (socket says 172.21.15.79:57988) 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f6519e70640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65141553c0 0x7f65140cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37032/0 (socket says 172.21.15.79:37032) 2024-06-10T00:25:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651a671640 1 -- 172.21.15.79:0/576354751 learned_addr learned my addr 172.21.15.79:0/576354751 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651966f640 1 --2- 172.21.15.79:0/576354751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f6519e70640 1 -- 172.21.15.79:0/576354751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 msgr2=0x7f651415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f6519e70640 1 --2- 172.21.15.79:0/576354751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651415beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f6519e70640 1 -- 172.21.15.79:0/576354751 >> v1:172.21.15.79:6789/0 conn(0x7f65140cec50 legacy=0x7f6514071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f6519e70640 1 -- 172.21.15.79:0/576354751 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65140cc750 con 0x7f65141553c0 2024-06-10T00:25:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f6518e6e640 1 -- 172.21.15.79:0/576354751 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503991 0 0) 0x7f6504001490 con 0x7f65140cec50 2024-06-10T00:25:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.959+0000 7f651966f640 1 --2- 172.21.15.79:0/576354751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.960+0000 7f6519e70640 1 --2- 172.21.15.79:0/576354751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f65140cd230 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f650c0097a0 tx=0x7f650c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fda72d07dea1ce server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.960+0000 7f6518e6e640 1 -- 172.21.15.79:0/576354751 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c037070 con 0x7f65141553c0 2024-06-10T00:25:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.960+0000 7f6518e6e640 1 -- 172.21.15.79:0/576354751 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650c032440 con 0x7f65141553c0 2024-06-10T00:25:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.960+0000 7f6518e6e640 1 -- 172.21.15.79:0/576354751 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c032810 con 0x7f65141553c0 2024-06-10T00:25:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.961+0000 7f651c0d4640 1 -- 172.21.15.79:0/576354751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 msgr2=0x7f65140cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.961+0000 7f651c0d4640 1 --2- 172.21.15.79:0/576354751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f65140cd230 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f650c0097a0 tx=0x7f650c02a180 comp rx=0 tx=0).stop 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.961+0000 7f651c0d4640 1 -- 172.21.15.79:0/576354751 shutdown_connections 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.961+0000 7f651c0d4640 1 --2- 172.21.15.79:0/576354751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.961+0000 7f651c0d4640 1 --2- 172.21.15.79:0/576354751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f65140cd230 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.961+0000 7f651c0d4640 1 -- 172.21.15.79:0/576354751 >> 172.21.15.79:0/576354751 conn(0x7f65140b19f0 msgr2=0x7f65140b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.961+0000 7f651c0d4640 1 -- 172.21.15.79:0/576354751 shutdown_connections 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.961+0000 7f651c0d4640 1 -- 172.21.15.79:0/576354751 wait complete. 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.962+0000 7f651c0d4640 1 Processor -- start 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.962+0000 7f651c0d4640 1 -- start start 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651c0d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651414e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651c0d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65140cec50 0x7f651415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651c0d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f651415e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651c0d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65140b3700 con 0x7f65141553c0 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651c0d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f65140ccd10 con 0x7f65140cec50 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651c0d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f65141557a0 con 0x7f65140b2cf0 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f651415e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f651415e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37048/0 (socket says 172.21.15.79:37048) 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 -- 172.21.15.79:0/3328527805 learned_addr learned my addr 172.21.15.79:0/3328527805 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f6519e70640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651414e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 -- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 msgr2=0x7f651414e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651414e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651966f640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65140cec50 0x7f651415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 -- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65140cec50 msgr2=0x7f651415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65140cec50 0x7f651415e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 -- 172.21.15.79:0/3328527805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651415c7b0 con 0x7f65141553c0 2024-06-10T00:25:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f6519e70640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651414e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651a671640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f651415e5f0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f650400c820 tx=0x7f650400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f65127fc640 1 -- 172.21.15.79:0/3328527805 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6504018070 con 0x7f65141553c0 2024-06-10T00:25:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f65127fc640 1 -- 172.21.15.79:0/3328527805 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650400a5e0 con 0x7f65141553c0 2024-06-10T00:25:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651415ca90 con 0x7f65141553c0 2024-06-10T00:25:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f65127fc640 1 -- 172.21.15.79:0/3328527805 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650400a9d0 con 0x7f65141553c0 2024-06-10T00:25:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.963+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f651415d050 con 0x7f65141553c0 2024-06-10T00:25:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.964+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6514068430 con 0x7f65141553c0 2024-06-10T00:25:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.965+0000 7f65127fc640 1 -- 172.21.15.79:0/3328527805 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f650401b070 con 0x7f65141553c0 2024-06-10T00:25:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.965+0000 7f65127fc640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f650006be30 0x7f650006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.966+0000 7f65127fc640 1 -- 172.21.15.79:0/3328527805 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f650408a6f0 con 0x7f65141553c0 2024-06-10T00:25:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.966+0000 7f6519e70640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f650006be30 0x7f650006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.966+0000 7f6519e70640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f650006be30 0x7f650006e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f650c034000 tx=0x7f650c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:10.970+0000 7f65127fc640 1 -- 172.21.15.79:0/3328527805 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f651415c3f0 con 0x7f65141553c0 2024-06-10T00:25:11.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.186+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f651415f930 con 0x7f65141553c0 2024-06-10T00:25:11.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.186+0000 7f65127fc640 1 -- 172.21.15.79:0/3328527805 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) ==== 53+0+73 (secure 0 0 0) 0x7f6504058e60 con 0x7f65141553c0 2024-06-10T00:25:11.186 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-10T00:25:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f650006be30 msgr2=0x7f650006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f650006be30 0x7f650006e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f650c034000 tx=0x7f650c02e000 comp rx=0 tx=0).stop 2024-06-10T00:25:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 msgr2=0x7f651415e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f651415e5f0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f650400c820 tx=0x7f650400cce0 comp rx=0 tx=0).stop 2024-06-10T00:25:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 shutdown_connections 2024-06-10T00:25:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f650006be30 0x7f650006e2f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65141553c0 0x7f651415e5f0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65140cec50 0x7f651415e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 --2- 172.21.15.79:0/3328527805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65140b2cf0 0x7f651414e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 >> 172.21.15.79:0/3328527805 conn(0x7f65140b19f0 msgr2=0x7f65140ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 shutdown_connections 2024-06-10T00:25:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11.188+0000 7f651c0d4640 1 -- 172.21.15.79:0/3328527805 wait complete. 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-10T00:25:11.199 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:25:11.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:11.200 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-06-10T00:25:11.215 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-10T00:25:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-06-10T00:25:11.216 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42133sec preferred_lft 42133sec 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:25:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5858:2eff:fe37:e090/64 scope link 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fe:36:df:b4:6a:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::fc36:dfff:feb4:6a72/64 scope link 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:85:47:02:2a:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a885:47ff:fe02:2afc/64 scope link 2024-06-10T00:25:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-06-10T00:25:11.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:11.219 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-10T00:25:11.278 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:25:11.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:11.280 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-06-10T00:25:11.336 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-06-10T00:25:11.336 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-10T00:25:11.336 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-10T00:25:11.336 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-10T00:25:11.336 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-10T00:25:11.337 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-10T00:25:11.337 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-06-10T00:25:11.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-10T00:25:11.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-10T00:25:11.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-10T00:25:11.337 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-06-10T00:25:11.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-10T00:25:11.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:11.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:11.463 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:25:11.478 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:25:11.478 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:25:11.478 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:25:11.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:11.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-06-10T00:25:11.544 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-10T00:25:11.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:25:11.544 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-10T00:25:11.600 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-10T00:25:11.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-10T00:25:11.601 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:25:11.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:25:11.721 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:25:11.777 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:25:11.777 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:25:11.777 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:25:11.777 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:25:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:25:11.779 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:25:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:25:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:25:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:25:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:25:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:25:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:25:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:25:11.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:11.780 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:25:11.833 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-10T00:25:11.833 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-10T00:25:11.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-06-10T00:25:11.900 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-06-10T00:25:11.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-06-10T00:25:11.958+0000 7fe650520480 -1 init, newargv = 0x5651f43b0af0 newargc=15 2024-06-10T00:25:11.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[78003]: starting ceph client 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-06-10T00:25:11.958 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-06-10T00:25:11.959 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-0 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-1 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-2 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph/osd/ceph-3 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:25:11.960 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:25:11.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:11.961 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-06-10T00:25:11.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[78003]: starting fuse 2024-06-10T00:25:11.976 INFO:teuthology.orchestra.run.smithi079.stdout:40 2024-06-10T00:25:11.976 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-10T00:25:11.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-06-10T00:25:11.976 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-06-10T00:25:11.976 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-06-10T00:25:11.977 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-06-10T00:25:11.978 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:12.094 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.78003.asok 2024-06-10T00:25:12.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:12.105 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.78003.asok 2024-06-10T00:25:12.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:12.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.78003.asok status 2024-06-10T00:25:12.239 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-06-10T00:25:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-10T00:25:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-10T00:25:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-06-10T00:25:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-06-10T00:25:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "78003", 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8835, 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 8835 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:25:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 477270528 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 477270528 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.8835 192.168.0.1:0/477270528", 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/477270528", 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-06-10T00:25:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 96, 2024-06-10T00:25:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 121, 2024-06-10T00:25:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-06-10T00:25:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-06-10T00:25:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-06-10T00:25:12.242 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:12.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:12.248 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-06-10T00:25:12.248 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-10T00:25:12.263 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-06-10T00:25:12.263 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-10T00:25:12.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:12.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-10T00:25:12.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:12.330 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-06-10T00:25:12.393 INFO:teuthology.orchestra.run.smithi079.stdout:./ 2024-06-10T00:25:12.394 INFO:teuthology.orchestra.run.smithi079.stdout:./parent 2024-06-10T00:25:12.394 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed 2024-06-10T00:25:12.394 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/charlie 2024-06-10T00:25:12.394 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/alpha 2024-06-10T00:25:12.394 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/flushed/bravo 2024-06-10T00:25:12.394 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/unflushed 2024-06-10T00:25:12.394 INFO:teuthology.orchestra.run.smithi079.stdout:./parent/unflushed/jfile 2024-06-10T00:25:12.394 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:25:12.395 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:12.395 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:25:12.395 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:12.395 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-06-10T00:25:12.395 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-06-10T00:25:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:12.510 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:25:12.510 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:12.510 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:25:12.510 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:12.510 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-06-10T00:25:12.510 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:12.616 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627776 2024-06-10T00:25:12.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:12.625 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:25:12.625 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:12.626 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:25:12.626 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:12.626 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-06-10T00:25:12.626 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:12.731 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627777 2024-06-10T00:25:12.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:12.740 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:25:12.740 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:12.740 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:25:12.740 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:12.740 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-06-10T00:25:12.740 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:12.846 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628280 2024-06-10T00:25:12.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:12.855 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:25:12.855 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:12.855 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:25:12.855 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:12.856 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-06-10T00:25:12.856 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:12.961 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627778 2024-06-10T00:25:12.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:12.969 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:25:12.969 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:12.969 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:25:12.970 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:12.970 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-06-10T00:25:12.970 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:13.075 INFO:teuthology.orchestra.run.smithi079.stdout:1099511628279 2024-06-10T00:25:13.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:13.084 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:25:13.084 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:13.084 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:25:13.084 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:13.085 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-06-10T00:25:13.085 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:13.190 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627779 2024-06-10T00:25:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:13.199 DEBUG:teuthology.orchestra.run.smithi079:> stdin-killer -- python3 -c ' 2024-06-10T00:25:13.199 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-06-10T00:25:13.199 DEBUG:teuthology.orchestra.run.smithi079:> import stat 2024-06-10T00:25:13.199 DEBUG:teuthology.orchestra.run.smithi079:> 2024-06-10T00:25:13.199 DEBUG:teuthology.orchestra.run.smithi079:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-06-10T00:25:13.199 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-06-10T00:25:13.305 INFO:teuthology.orchestra.run.smithi079.stdout:1099511627780 2024-06-10T00:25:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-10T00:25:13.314 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-10T00:25:13.314 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:25:13.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-10T00:25:13.430 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-10T00:25:13.430 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:25:13.430 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:25:13.430 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:25:13.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-10T00:25:13.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.587+0000 7f104b3a5640 1 Processor -- start 2024-06-10T00:25:13.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.587+0000 7f104b3a5640 1 -- start start 2024-06-10T00:25:13.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f104b3a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10440d2680 0x7f104415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:13.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f104b3a5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f10440d1fc0 0x7f10440d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f104b3a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10440d2fa0 con 0x7f1044161fa0 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f104b3a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f10440cff80 con 0x7f10440d2680 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f104b3a5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f10440d13e0 con 0x7f10440d1fc0 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f1049141640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10440d2680 0x7f104415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f1049141640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10440d2680 0x7f104415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37062/0 (socket says 172.21.15.79:37062) 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f1049141640 1 -- 172.21.15.79:0/4135165034 learned_addr learned my addr 172.21.15.79:0/4135165034 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f1049141640 1 -- 172.21.15.79:0/4135165034 >> v2:172.21.15.117:3300/0 conn(0x7f10440d1fc0 msgr2=0x7f10440d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f1049141640 1 --2- 172.21.15.79:0/4135165034 >> v2:172.21.15.117:3300/0 conn(0x7f10440d1fc0 0x7f10440d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f1049141640 1 -- 172.21.15.79:0/4135165034 >> v1:172.21.15.117:6789/0 conn(0x7f1044161fa0 legacy=0x7f10441623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:13.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.588+0000 7f1049141640 1 -- 172.21.15.79:0/4135165034 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10440d0ad0 con 0x7f10440d2680 2024-06-10T00:25:13.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.589+0000 7f1049141640 1 --2- 172.21.15.79:0/4135165034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d2680 0x7f104415f1a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f10440c7960 tx=0x7f104002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e89113f779e327 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:13.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.589+0000 7f103bfff640 1 -- 172.21.15.79:0/4135165034 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040037070 con 0x7f10440d2680 2024-06-10T00:25:13.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.589+0000 7f103bfff640 1 -- 172.21.15.79:0/4135165034 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1040032440 con 0x7f10440d2680 2024-06-10T00:25:13.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.589+0000 7f103bfff640 1 -- 172.21.15.79:0/4135165034 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040032810 con 0x7f10440d2680 2024-06-10T00:25:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.589+0000 7f104b3a5640 1 -- 172.21.15.79:0/4135165034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d2680 msgr2=0x7f104415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.589+0000 7f104b3a5640 1 --2- 172.21.15.79:0/4135165034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d2680 0x7f104415f1a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f10440c7960 tx=0x7f104002a230 comp rx=0 tx=0).stop 2024-06-10T00:25:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.590+0000 7f104b3a5640 1 -- 172.21.15.79:0/4135165034 shutdown_connections 2024-06-10T00:25:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.590+0000 7f104b3a5640 1 --2- 172.21.15.79:0/4135165034 >> v2:172.21.15.117:3300/0 conn(0x7f10440d1fc0 0x7f10440d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.590+0000 7f104b3a5640 1 --2- 172.21.15.79:0/4135165034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d2680 0x7f104415f1a0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.590+0000 7f104b3a5640 1 -- 172.21.15.79:0/4135165034 >> 172.21.15.79:0/4135165034 conn(0x7f104409d3f0 msgr2=0x7f10440d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.590+0000 7f104b3a5640 1 -- 172.21.15.79:0/4135165034 shutdown_connections 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.590+0000 7f104b3a5640 1 -- 172.21.15.79:0/4135165034 wait complete. 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.591+0000 7f104b3a5640 1 Processor -- start 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.591+0000 7f104b3a5640 1 -- start start 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.591+0000 7f104b3a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d1fc0 0x7f10440b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.591+0000 7f104b3a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10440d2680 0x7f1044159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.591+0000 7f104b3a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1044161fa0 0x7f104415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.591+0000 7f104b3a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10440d1070 con 0x7f10440d1fc0 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.591+0000 7f104b3a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10440d0d90 con 0x7f10440d2680 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.591+0000 7f104b3a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10440d2400 con 0x7f1044161fa0 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d1fc0 0x7f10440b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d1fc0 0x7f10440b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37064/0 (socket says 172.21.15.79:37064) 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 -- 172.21.15.79:0/3866250001 learned_addr learned my addr 172.21.15.79:0/3866250001 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049942640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1044161fa0 0x7f104415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1048940640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10440d2680 0x7f1044159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 -- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1044161fa0 msgr2=0x7f104415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1044161fa0 0x7f104415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 -- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10440d2680 msgr2=0x7f1044159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10440d2680 0x7f1044159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 -- 172.21.15.79:0/3866250001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104415a470 con 0x7f10440d1fc0 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049942640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1044161fa0 0x7f104415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1048940640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10440d2680 0x7f1044159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1049141640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d1fc0 0x7f10440b97f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f104002a270 tx=0x7f10400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1039ffb640 1 -- 172.21.15.79:0/3866250001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040041070 con 0x7f10440d1fc0 2024-06-10T00:25:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1039ffb640 1 -- 172.21.15.79:0/3866250001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104003c870 con 0x7f10440d1fc0 2024-06-10T00:25:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10440b7050 con 0x7f10440d1fc0 2024-06-10T00:25:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f1039ffb640 1 -- 172.21.15.79:0/3866250001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040037040 con 0x7f10440d1fc0 2024-06-10T00:25:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.592+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10440ccd10 con 0x7f10440d1fc0 2024-06-10T00:25:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.593+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1044068430 con 0x7f10440d1fc0 2024-06-10T00:25:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.594+0000 7f1039ffb640 1 -- 172.21.15.79:0/3866250001 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1040044070 con 0x7f10440d1fc0 2024-06-10T00:25:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.594+0000 7f1039ffb640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f102806be60 0x7f102806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.594+0000 7f1039ffb640 1 -- 172.21.15.79:0/3866250001 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f10400abc40 con 0x7f10440d1fc0 2024-06-10T00:25:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.594+0000 7f1048940640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f102806be60 0x7f102806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.595+0000 7f1048940640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f102806be60 0x7f102806e320 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1034006fd0 tx=0x7f1034008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.599+0000 7f1039ffb640 1 -- 172.21.15.79:0/3866250001 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f104007a560 con 0x7f10440d1fc0 2024-06-10T00:25:13.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.786+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f10440d0270 con 0x7f10440d1fc0 2024-06-10T00:25:13.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.786+0000 7f1039ffb640 1 -- 172.21.15.79:0/3866250001 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v121) ==== 80+0+244 (secure 0 0 0) 0x7f1040079e60 con 0x7f10440d1fc0 2024-06-10T00:25:13.786 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6835/1367694301 2024-06-11T00:25:04.436503+0000 2024-06-10T00:25:13.786 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/3594456696 2024-06-11T00:24:48.375026+0000 2024-06-10T00:25:13.786 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6837/1367694301 2024-06-11T00:25:04.436503+0000 2024-06-10T00:25:13.786 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6835/3594456696 2024-06-11T00:24:48.375026+0000 2024-06-10T00:25:13.786 INFO:teuthology.orchestra.run.smithi079.stderr:listed 4 entries 2024-06-10T00:25:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f102806be60 msgr2=0x7f102806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f102806be60 0x7f102806e320 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1034006fd0 tx=0x7f1034008040 comp rx=0 tx=0).stop 2024-06-10T00:25:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d1fc0 msgr2=0x7f10440b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d1fc0 0x7f10440b97f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f104002a270 tx=0x7f10400046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 shutdown_connections 2024-06-10T00:25:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f102806be60 0x7f102806e320 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1044161fa0 0x7f104415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10440d2680 0x7f1044159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 --2- 172.21.15.79:0/3866250001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10440d1fc0 0x7f10440b97f0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:13.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 >> 172.21.15.79:0/3866250001 conn(0x7f104409d3f0 msgr2=0x7f10440b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:13.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 shutdown_connections 2024-06-10T00:25:13.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:13.788+0000 7f104b3a5640 1 -- 172.21.15.79:0/3866250001 wait complete. 2024-06-10T00:25:13.799 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-06-10T00:25:13.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:13.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-10T00:25:13.822 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[78003]: fuse finished with error 0 and tester_r 0 2024-06-10T00:25:13.823 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:25:13.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:13.823 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-10T00:25:13.946 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:25:13.946 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:25:13.946 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:25:13.966 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:25:13.966 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:25:13.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:13.966 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-10T00:25:14.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:25:14.025 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-10T00:25:14.025 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:25:14.025 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:25:14.025 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:25:14.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:25:14.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:25:14.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:14.042 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-10T00:25:14.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:25:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-10T00:25:14.097 INFO:tasks.cephfs.mount:Terminating background process 2024-06-10T00:25:14.097 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:25:14.097 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:25:14.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:25:14.116 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:25:14.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:14.116 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-10T00:25:14.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:25:14.174 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-10T00:25:14.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:14.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.274+0000 7fa993342640 1 Processor -- start 2024-06-10T00:25:14.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.275+0000 7fa993342640 1 -- start start 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.275+0000 7fa993342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 0x7fa98c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.275+0000 7fa993342640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa98c0cec50 0x7fa98c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.275+0000 7fa993342640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa98c0b3170 con 0x7fa98c0b2cf0 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.275+0000 7fa993342640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa98c0b3420 con 0x7fa98c0cec50 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.275+0000 7fa993342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa98c0cc750 con 0x7fa98c1553c0 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.276+0000 7fa9918df640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa98c0cec50 0x7fa98c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.276+0000 7fa9908dd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa98c0b2cf0 0x7fa98c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57996/0 (socket says 172.21.15.79:57996) 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.276+0000 7fa9908dd640 1 -- 172.21.15.79:0/2214329377 learned_addr learned my addr 172.21.15.79:0/2214329377 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.276+0000 7fa9918df640 1 -- 172.21.15.79:0/2214329377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 msgr2=0x7fa98c0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:14.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.276+0000 7fa9918df640 1 --2- 172.21.15.79:0/2214329377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 0x7fa98c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.276+0000 7fa9918df640 1 -- 172.21.15.79:0/2214329377 >> v1:172.21.15.79:6789/0 conn(0x7fa98c0b2cf0 legacy=0x7fa98c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.276+0000 7fa9918df640 1 -- 172.21.15.79:0/2214329377 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c0cca30 con 0x7fa98c0cec50 2024-06-10T00:25:14.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.276+0000 7fa97ffff640 1 -- 172.21.15.79:0/2214329377 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046079180 0 0) 0x7fa98c0b3170 con 0x7fa98c0b2cf0 2024-06-10T00:25:14.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa9918df640 1 --2- 172.21.15.79:0/2214329377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c0cf0e0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fa984009d90 tx=0x7fa98402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d07f421d67a215 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa97ffff640 1 -- 172.21.15.79:0/2214329377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984007740 con 0x7fa98c0cec50 2024-06-10T00:25:14.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa97ffff640 1 -- 172.21.15.79:0/2214329377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9840078e0 con 0x7fa98c0cec50 2024-06-10T00:25:14.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa97ffff640 1 -- 172.21.15.79:0/2214329377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984007cb0 con 0x7fa98c0cec50 2024-06-10T00:25:14.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa993342640 1 -- 172.21.15.79:0/2214329377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 msgr2=0x7fa98c0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa993342640 1 --2- 172.21.15.79:0/2214329377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c0cf0e0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fa984009d90 tx=0x7fa98402a660 comp rx=0 tx=0).stop 2024-06-10T00:25:14.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa993342640 1 -- 172.21.15.79:0/2214329377 shutdown_connections 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa993342640 1 --2- 172.21.15.79:0/2214329377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c0cf0e0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa993342640 1 --2- 172.21.15.79:0/2214329377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 0x7fa98c0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa993342640 1 -- 172.21.15.79:0/2214329377 >> 172.21.15.79:0/2214329377 conn(0x7fa98c0b19f0 msgr2=0x7fa98c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa993342640 1 -- 172.21.15.79:0/2214329377 shutdown_connections 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.277+0000 7fa993342640 1 -- 172.21.15.79:0/2214329377 wait complete. 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.278+0000 7fa993342640 1 Processor -- start 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.278+0000 7fa993342640 1 -- start start 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa993342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa98c0b2cf0 0x7fa98c132030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa993342640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c06e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa993342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 0x7fa98c06e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa993342640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c1557a0 con 0x7fa98c0cec50 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa993342640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c0b3700 con 0x7fa98c0b2cf0 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa993342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa98c155920 con 0x7fa98c1553c0 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa9908dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa9908dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c06e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37080/0 (socket says 172.21.15.79:37080) 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa9908dd640 1 -- 172.21.15.79:0/1713603868 learned_addr learned my addr 172.21.15.79:0/1713603868 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa9918df640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 0x7fa98c06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa9908dd640 1 -- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 msgr2=0x7fa98c06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa9908dd640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 0x7fa98c06e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa9910de640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa98c0b2cf0 0x7fa98c132030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.279+0000 7fa9908dd640 1 -- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa98c0b2cf0 msgr2=0x7fa98c132030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa9908dd640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa98c0b2cf0 0x7fa98c132030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa9908dd640 1 -- 172.21.15.79:0/1713603868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c130040 con 0x7fa98c0cec50 2024-06-10T00:25:14.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa9918df640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 0x7fa98c06e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:14.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa9910de640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa98c0b2cf0 0x7fa98c132030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:14.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa9908dd640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c06e220 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fa98000c4d0 tx=0x7fa98000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa97dffb640 1 -- 172.21.15.79:0/1713603868 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980018070 con 0x7fa98c0cec50 2024-06-10T00:25:14.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa97dffb640 1 -- 172.21.15.79:0/1713603868 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa980007500 con 0x7fa98c0cec50 2024-06-10T00:25:14.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa97dffb640 1 -- 172.21.15.79:0/1713603868 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980004a20 con 0x7fa98c0cec50 2024-06-10T00:25:14.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98c132610 con 0x7fa98c0cec50 2024-06-10T00:25:14.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.280+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa98c132bd0 con 0x7fa98c0cec50 2024-06-10T00:25:14.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.281+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa98c068430 con 0x7fa98c0cec50 2024-06-10T00:25:14.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.281+0000 7fa97dffb640 1 -- 172.21.15.79:0/1713603868 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa980004bc0 con 0x7fa98c0cec50 2024-06-10T00:25:14.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.282+0000 7fa97dffb640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa97006be30 0x7fa97006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.282+0000 7fa97dffb640 1 -- 172.21.15.79:0/1713603868 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fa98008a370 con 0x7fa98c0cec50 2024-06-10T00:25:14.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.282+0000 7fa9910de640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa97006be30 0x7fa97006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.282+0000 7fa9910de640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa97006be30 0x7fa97006e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa98800a870 tx=0x7fa988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.286+0000 7fa97dffb640 1 -- 172.21.15.79:0/1713603868 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa980058ae0 con 0x7fa98c0cec50 2024-06-10T00:25:14.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.496+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa98c0ce8c0 con 0x7fa98c0cec50 2024-06-10T00:25:14.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.496+0000 7fa97dffb640 1 -- 172.21.15.79:0/1713603868 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5188 (secure 0 0 0) 0x7fa9800583e0 con 0x7fa98c0cec50 2024-06-10T00:25:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:14.496 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:25:09.459143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8715":{"gid":8715,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/781838074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":781838074},{"type":"v1","addr":"172.21.15.79:6837","nonce":781838074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8715,"qdb_cluster":[8715]},"id":8}]} 2024-06-10T00:25:14.496 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-06-10T00:25:14.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa97006be30 msgr2=0x7fa97006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa97006be30 0x7fa97006e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa98800a870 tx=0x7fa988008040 comp rx=0 tx=0).stop 2024-06-10T00:25:14.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 msgr2=0x7fa98c06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c06e220 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fa98000c4d0 tx=0x7fa98000c990 comp rx=0 tx=0).stop 2024-06-10T00:25:14.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 shutdown_connections 2024-06-10T00:25:14.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa97006be30 0x7fa97006e2f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98c1553c0 0x7fa98c06e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c0cec50 0x7fa98c06e220 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 --2- 172.21.15.79:0/1713603868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa98c0b2cf0 0x7fa98c132030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.498+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 >> 172.21.15.79:0/1713603868 conn(0x7fa98c0b19f0 msgr2=0x7fa98c0cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:14.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.499+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 shutdown_connections 2024-06-10T00:25:14.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.499+0000 7fa993342640 1 -- 172.21.15.79:0/1713603868 wait complete. 2024-06-10T00:25:14.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.609+0000 7f6f5b05d640 1 Processor -- start 2024-06-10T00:25:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.609+0000 7f6f5b05d640 1 -- start start 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f5b05d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6f5415c7f0 0x7f6f540cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f5b05d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f540725f0 con 0x7f6f540b4530 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f5b05d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f540728d0 con 0x7f6f54156830 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f5b05d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6f540b3090 con 0x7f6f5415c7f0 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f595fa640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6f540b4530 0x7f6f54165cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58006/0 (socket says 172.21.15.79:58006) 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f595fa640 1 -- 172.21.15.79:0/39292978 learned_addr learned my addr 172.21.15.79:0/39292978 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1055729177 0 0) 0x7f6f540725f0 con 0x7f6f540b4530 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f4bfff640 1 --2- 172.21.15.79:0/39292978 >> v2:172.21.15.117:3300/0 conn(0x7f6f5415c7f0 0x7f6f540cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.610+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f3c003520 con 0x7f6f540b4530 2024-06-10T00:25:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3895874250 0 0) 0x7f6f3c003520 con 0x7f6f540b4530 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 >> v2:172.21.15.117:3300/0 conn(0x7f6f5415c7f0 msgr2=0x7f6f540cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 --2- 172.21.15.79:0/39292978 >> v2:172.21.15.117:3300/0 conn(0x7f6f5415c7f0 0x7f6f540cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 >> v1:172.21.15.117:6789/0 conn(0x7f6f54156830 legacy=0x7f6f54071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f54072bb0 con 0x7f6f540b4530 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f6f4c0019f0 con 0x7f6f540b4530 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 >> v1:172.21.15.79:6789/0 conn(0x7f6f540b4530 legacy=0x7f6f54165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f3c0039b0 0x7f6f3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f3c004800 0x7f6f3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c0051c0 0x7f6f3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6f540b3090 con 0x7f6f3c004800 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c00c060 con 0x7f6f3c0039b0 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3c00c260 con 0x7f6f3c0051c0 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4bfff640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f3c004800 0x7f6f3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f58df9640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f3c0039b0 0x7f6f3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f595fa640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c0051c0 0x7f6f3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4bfff640 1 -- 172.21.15.79:0/39292978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c0051c0 msgr2=0x7f6f3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4bfff640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c0051c0 0x7f6f3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4bfff640 1 -- 172.21.15.79:0/39292978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f3c0039b0 msgr2=0x7f6f3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4bfff640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f3c0039b0 0x7f6f3c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f4bfff640 1 -- 172.21.15.79:0/39292978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c003520 con 0x7f6f3c004800 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.611+0000 7f6f595fa640 1 -- 172.21.15.79:0/39292978 reap_dead start 2024-06-10T00:25:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.612+0000 7f6f4bfff640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f3c004800 0x7f6f3c004c80 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009ac0 tx=0x7f6f3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4999146b1bb3fa05 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.612+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44036070 con 0x7f6f3c004800 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.612+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f44031400 con 0x7f6f3c004800 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.612+0000 7f6f4b7fe640 1 -- 172.21.15.79:0/39292978 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44009690 con 0x7f6f3c004800 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.613+0000 7f6f5b05d640 1 -- 172.21.15.79:0/39292978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f3c004800 msgr2=0x7f6f3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.613+0000 7f6f5b05d640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f3c004800 0x7f6f3c004c80 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009ac0 tx=0x7f6f3c005830 comp rx=0 tx=0).stop 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.613+0000 7f6f5b05d640 1 -- 172.21.15.79:0/39292978 shutdown_connections 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.613+0000 7f6f5b05d640 1 --2- 172.21.15.79:0/39292978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f3c004800 0x7f6f3c004c80 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.613+0000 7f6f5b05d640 1 -- 172.21.15.79:0/39292978 >> 172.21.15.79:0/39292978 conn(0x7f6f540b19f0 msgr2=0x7f6f540b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.613+0000 7f6f5b05d640 1 -- 172.21.15.79:0/39292978 shutdown_connections 2024-06-10T00:25:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.613+0000 7f6f5b05d640 1 -- 172.21.15.79:0/39292978 wait complete. 2024-06-10T00:25:14.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.614+0000 7f6f5b05d640 1 Processor -- start 2024-06-10T00:25:14.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.614+0000 7f6f5b05d640 1 -- start start 2024-06-10T00:25:14.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f5b05d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c004800 0x7f6f54144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f5b05d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f54145de0 0x7f6f541f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f5b05d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f541430d0 0x7f6f54156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f5b05d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54071d70 con 0x7f6f54145de0 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f5b05d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54071bf0 con 0x7f6f541430d0 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f5b05d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f54071ef0 con 0x7f6f3c004800 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f54145de0 0x7f6f541f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f54145de0 0x7f6f541f11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37104/0 (socket says 172.21.15.79:37104) 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 -- 172.21.15.79:0/3796880844 learned_addr learned my addr 172.21.15.79:0/3796880844 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f595fa640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f541430d0 0x7f6f54156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 -- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c004800 msgr2=0x7f6f54144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f58df9640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c004800 0x7f6f54144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c004800 0x7f6f54144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 -- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f541430d0 msgr2=0x7f6f54156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f541430d0 0x7f6f54156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 -- 172.21.15.79:0/3796880844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f541439d0 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f595fa640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f541430d0 0x7f6f54156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f4bfff640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f54145de0 0x7f6f541f11c0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f6f44034040 tx=0x7f6f44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f497fa640 1 -- 172.21.15.79:0/3796880844 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4403f020 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f497fa640 1 -- 172.21.15.79:0/3796880844 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f44037040 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f497fa640 1 -- 172.21.15.79:0/3796880844 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44036070 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f54143cb0 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.615+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f54144270 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.616+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f54068430 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.617+0000 7f6f497fa640 1 -- 172.21.15.79:0/3796880844 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f44042020 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.617+0000 7f6f497fa640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f4006be60 0x7f6f4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.617+0000 7f6f497fa640 1 -- 172.21.15.79:0/3796880844 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f6f440ab150 con 0x7f6f54145de0 2024-06-10T00:25:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.617+0000 7f6f58df9640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f4006be60 0x7f6f4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.618+0000 7f6f58df9640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f4006be60 0x7f6f4006e320 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6f50000c00 tx=0x7f6f50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.621+0000 7f6f497fa640 1 -- 172.21.15.79:0/3796880844 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6f44049030 con 0x7f6f54145de0 2024-06-10T00:25:14.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.833+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f54075430 con 0x7f6f54145de0 2024-06-10T00:25:14.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.833+0000 7f6f497fa640 1 -- 172.21.15.79:0/3796880844 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5188 (secure 0 0 0) 0x7f6f440798c0 con 0x7f6f54145de0 2024-06-10T00:25:14.833 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:14.833 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:25:09.459143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8715":{"gid":8715,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/781838074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":781838074},{"type":"v1","addr":"172.21.15.79:6837","nonce":781838074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8715,"qdb_cluster":[8715]},"id":8}]} 2024-06-10T00:25:14.833 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-06-10T00:25:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f4006be60 msgr2=0x7f6f4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f4006be60 0x7f6f4006e320 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6f50000c00 tx=0x7f6f50009040 comp rx=0 tx=0).stop 2024-06-10T00:25:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f54145de0 msgr2=0x7f6f541f11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f54145de0 0x7f6f541f11c0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f6f44034040 tx=0x7f6f44004730 comp rx=0 tx=0).stop 2024-06-10T00:25:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 shutdown_connections 2024-06-10T00:25:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6f4006be60 0x7f6f4006e320 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f541430d0 0x7f6f54156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f54145de0 0x7f6f541f11c0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 --2- 172.21.15.79:0/3796880844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f3c004800 0x7f6f54144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 >> 172.21.15.79:0/3796880844 conn(0x7f6f540b19f0 msgr2=0x7f6f5415ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 shutdown_connections 2024-06-10T00:25:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.835+0000 7f6f5b05d640 1 -- 172.21.15.79:0/3796880844 wait complete. 2024-06-10T00:25:14.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:25:14.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.946+0000 7f01c6fe9640 1 Processor -- start 2024-06-10T00:25:14.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.946+0000 7f01c6fe9640 1 -- start start 2024-06-10T00:25:14.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01c6fe9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01c00b46d0 0x7f01c0071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01c6fe9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 0x7f01c0165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01c6fe9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c0072820 con 0x7f01c00cc6d0 2024-06-10T00:25:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01c6fe9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f01c0072b00 con 0x7f01c00b46d0 2024-06-10T00:25:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01c6fe9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01c0072de0 con 0x7f01c00721a0 2024-06-10T00:25:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01b7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01c00b46d0 0x7f01c0071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01b7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01c00b46d0 0x7f01c0071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:56570/0 (socket says 172.21.15.79:56570) 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01c4d85640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f01c00cc6d0 0x7f01c00ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:37986/0 (socket says 172.21.15.79:37986) 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01b7fff640 1 -- 172.21.15.79:0/1094100023 learned_addr learned my addr 172.21.15.79:0/1094100023 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01c5586640 1 --2- 172.21.15.79:0/1094100023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 0x7f01c0165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01b7fff640 1 -- 172.21.15.79:0/1094100023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 msgr2=0x7f01c0165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01b7fff640 1 --2- 172.21.15.79:0/1094100023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 0x7f01c0165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01b7fff640 1 -- 172.21.15.79:0/1094100023 >> v1:172.21.15.117:6789/0 conn(0x7f01c00cc6d0 legacy=0x7f01c00ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.947+0000 7f01b7fff640 1 -- 172.21.15.79:0/1094100023 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c00b31a0 con 0x7f01c00b46d0 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.948+0000 7f01b7fff640 1 --2- 172.21.15.79:0/1094100023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00b46d0 0x7f01c0071c60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009870 tx=0x7f01b002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd26a15371f1cb0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.948+0000 7f01b77fe640 1 -- 172.21.15.79:0/1094100023 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0037070 con 0x7f01c00b46d0 2024-06-10T00:25:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.948+0000 7f01b77fe640 1 -- 172.21.15.79:0/1094100023 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b0032440 con 0x7f01c00b46d0 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.948+0000 7f01b77fe640 1 -- 172.21.15.79:0/1094100023 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0032810 con 0x7f01c00b46d0 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.949+0000 7f01c6fe9640 1 -- 172.21.15.79:0/1094100023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00b46d0 msgr2=0x7f01c0071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.949+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/1094100023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00b46d0 0x7f01c0071c60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009870 tx=0x7f01b002a270 comp rx=0 tx=0).stop 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.949+0000 7f01c6fe9640 1 -- 172.21.15.79:0/1094100023 shutdown_connections 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.949+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/1094100023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 0x7f01c0165c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.949+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/1094100023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00b46d0 0x7f01c0071c60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.949+0000 7f01c6fe9640 1 -- 172.21.15.79:0/1094100023 >> 172.21.15.79:0/1094100023 conn(0x7f01c00b19f0 msgr2=0x7f01c00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.949+0000 7f01c6fe9640 1 -- 172.21.15.79:0/1094100023 shutdown_connections 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.949+0000 7f01c6fe9640 1 -- 172.21.15.79:0/1094100023 wait complete. 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.950+0000 7f01c6fe9640 1 Processor -- start 2024-06-10T00:25:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.950+0000 7f01c6fe9640 1 -- start start 2024-06-10T00:25:14.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01c6fe9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 0x7f01c014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01c6fe9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c00b46d0 0x7f01c015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01c6fe9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00cc6d0 0x7f01c015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01c6fe9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f01c0166170 con 0x7f01c00b46d0 2024-06-10T00:25:14.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01c6fe9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01c0159f60 con 0x7f01c00cc6d0 2024-06-10T00:25:14.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01c6fe9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01c01662f0 con 0x7f01c00721a0 2024-06-10T00:25:14.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c00b46d0 0x7f01c015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c00b46d0 0x7f01c015b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37118/0 (socket says 172.21.15.79:37118) 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01b7fff640 1 -- 172.21.15.79:0/3467072964 learned_addr learned my addr 172.21.15.79:0/3467072964 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01c4d85640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 0x7f01c014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.951+0000 7f01c5586640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00cc6d0 0x7f01c015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b7fff640 1 -- 172.21.15.79:0/3467072964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 msgr2=0x7f01c014d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b7fff640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 0x7f01c014d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b7fff640 1 -- 172.21.15.79:0/3467072964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00cc6d0 msgr2=0x7f01c015b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b7fff640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00cc6d0 0x7f01c015b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b7fff640 1 -- 172.21.15.79:0/3467072964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c00acde0 con 0x7f01c00b46d0 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b7fff640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c00b46d0 0x7f01c015b270 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f01b002a2b0 tx=0x7f01b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b57fa640 1 -- 172.21.15.79:0/3467072964 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0037040 con 0x7f01c00b46d0 2024-06-10T00:25:14.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b57fa640 1 -- 172.21.15.79:0/3467072964 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b0042070 con 0x7f01c00b46d0 2024-06-10T00:25:14.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01b57fa640 1 -- 172.21.15.79:0/3467072964 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0030880 con 0x7f01c00b46d0 2024-06-10T00:25:14.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c00ade00 con 0x7f01c00b46d0 2024-06-10T00:25:14.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.952+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c015bf30 con 0x7f01c00b46d0 2024-06-10T00:25:14.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.953+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c0071870 con 0x7f01c00b46d0 2024-06-10T00:25:14.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.953+0000 7f01b57fa640 1 -- 172.21.15.79:0/3467072964 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01b0030a20 con 0x7f01c00b46d0 2024-06-10T00:25:14.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.954+0000 7f01b57fa640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01ac06be30 0x7f01ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:14.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.954+0000 7f01b57fa640 1 -- 172.21.15.79:0/3467072964 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f01b00ab7f0 con 0x7f01c00b46d0 2024-06-10T00:25:14.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.954+0000 7f01c4d85640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01ac06be30 0x7f01ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:14.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.954+0000 7f01c4d85640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01ac06be30 0x7f01ac06e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f01bc007fd0 tx=0x7f01bc007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:14.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:14.958+0000 7f01b57fa640 1 -- 172.21.15.79:0/3467072964 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f01c0071870 con 0x7f01c00b46d0 2024-06-10T00:25:15.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.134+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01c0068430 con 0x7f01c00b46d0 2024-06-10T00:25:15.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.135+0000 7f01b57fa640 1 -- 172.21.15.79:0/3467072964 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+17163 (secure 0 0 0) 0x7f01b0079880 con 0x7f01c00b46d0 2024-06-10T00:25:15.135 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:15.135 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":121,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:25:04.436521+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:24:29.040364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-06-10T00:24:29.380624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6835/1367694301":"2024-06-11T00:25:04.436503+0000","172.21.15.79:6837/3594456696":"2024-06-11T00:24:48.375026+0000","172.21.15.79:6837/1367694301":"2024-06-11T00:25:04.436503+0000","172.21.15.79:6835/3594456696":"2024-06-11T00:24:48.375026+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:25:15.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01ac06be30 msgr2=0x7f01ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01ac06be30 0x7f01ac06e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f01bc007fd0 tx=0x7f01bc007e80 comp rx=0 tx=0).stop 2024-06-10T00:25:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c00b46d0 msgr2=0x7f01c015b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c00b46d0 0x7f01c015b270 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f01b002a2b0 tx=0x7f01b00046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 shutdown_connections 2024-06-10T00:25:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f01ac06be30 0x7f01ac06e2f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c00cc6d0 0x7f01c015b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c00b46d0 0x7f01c015b270 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 --2- 172.21.15.79:0/3467072964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00721a0 0x7f01c014d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 >> 172.21.15.79:0/3467072964 conn(0x7f01c00b19f0 msgr2=0x7f01c00ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 shutdown_connections 2024-06-10T00:25:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.137+0000 7f01c6fe9640 1 -- 172.21.15.79:0/3467072964 wait complete. 2024-06-10T00:25:15.149 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:25:15.149 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:15.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.249+0000 7f2847e76640 1 Processor -- start 2024-06-10T00:25:15.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.249+0000 7f2847e76640 1 -- start start 2024-06-10T00:25:15.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.250+0000 7f2847e76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f284015a870 0x7f284006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.250+0000 7f2847e76640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f284006e390 con 0x7f28400af3d0 2024-06-10T00:25:15.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.250+0000 7f2847e76640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f284015ac50 con 0x7f28400aef70 2024-06-10T00:25:15.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.250+0000 7f2847e76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f284006cdb0 con 0x7f284015a870 2024-06-10T00:25:15.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.250+0000 7f2846413640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f28400af3d0 0x7f28400cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58022/0 (socket says 172.21.15.79:58022) 2024-06-10T00:25:15.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.250+0000 7f2846413640 1 -- 172.21.15.79:0/4054931526 learned_addr learned my addr 172.21.15.79:0/4054931526 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:15.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.250+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935553869 0 0) 0x7f284006e390 con 0x7f28400af3d0 2024-06-10T00:25:15.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.250+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f282c003520 con 0x7f28400af3d0 2024-06-10T00:25:15.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845c12640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f284015a870 0x7f284006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 215764420 0 0) 0x7f282c003520 con 0x7f28400af3d0 2024-06-10T00:25:15.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f284015a870 msgr2=0x7f284006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:15.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f284015a870 0x7f284006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 >> v1:172.21.15.117:6789/0 conn(0x7f28400aef70 legacy=0x7f28400b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284006d090 con 0x7f28400af3d0 2024-06-10T00:25:15.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f28380019f0 con 0x7f28400af3d0 2024-06-10T00:25:15.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 >> v1:172.21.15.79:6789/0 conn(0x7f28400af3d0 legacy=0x7f28400cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c0039e0 0x7f282c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f282c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f284015a870 0x7f282c005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f284006cdb0 con 0x7f282c004800 2024-06-10T00:25:15.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f282c005520 con 0x7f282c0039e0 2024-06-10T00:25:15.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f282c005ed0 con 0x7f284015a870 2024-06-10T00:25:15.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845411640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f282c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845c12640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c0039e0 0x7f282c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2846413640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f284015a870 0x7f282c005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845411640 1 -- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f284015a870 msgr2=0x7f282c005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:15.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845411640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f284015a870 0x7f282c005990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845411640 1 -- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c0039e0 msgr2=0x7f282c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845411640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c0039e0 0x7f282c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845411640 1 -- 172.21.15.79:0/4054931526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c003520 con 0x7f282c004800 2024-06-10T00:25:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.251+0000 7f2845c12640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c0039e0 0x7f282c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2845411640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f282c004c80 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f2830001750 tx=0x7f282c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9c72b513eed7a0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830001370 con 0x7f282c004800 2024-06-10T00:25:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28300052d0 con 0x7f282c004800 2024-06-10T00:25:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2844c10640 1 -- 172.21.15.79:0/4054931526 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283002abe0 con 0x7f282c004800 2024-06-10T00:25:15.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2847e76640 1 -- 172.21.15.79:0/4054931526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 msgr2=0x7f282c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2847e76640 1 --2- 172.21.15.79:0/4054931526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f282c004c80 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f2830001750 tx=0x7f282c005830 comp rx=0 tx=0).stop 2024-06-10T00:25:15.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2846413640 1 -- 172.21.15.79:0/4054931526 reap_dead start 2024-06-10T00:25:15.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2847e76640 1 -- 172.21.15.79:0/4054931526 shutdown_connections 2024-06-10T00:25:15.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.252+0000 7f2847e76640 1 -- 172.21.15.79:0/4054931526 >> 172.21.15.79:0/4054931526 conn(0x7f28400b19f0 msgr2=0x7f28400b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:15.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.253+0000 7f2847e76640 1 -- 172.21.15.79:0/4054931526 shutdown_connections 2024-06-10T00:25:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.253+0000 7f2847e76640 1 -- 172.21.15.79:0/4054931526 wait complete. 2024-06-10T00:25:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.254+0000 7f2847e76640 1 Processor -- start 2024-06-10T00:25:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.254+0000 7f2847e76640 1 -- start start 2024-06-10T00:25:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.254+0000 7f2847e76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f284014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.254+0000 7f2847e76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28400b4520 0x7f28400b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.254+0000 7f2847e76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28401f3650 0x7f28401f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2847e76640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f284006d930 con 0x7f282c004800 2024-06-10T00:25:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2847e76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f284006d650 con 0x7f28401f3650 2024-06-10T00:25:15.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2847e76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28400b2e40 con 0x7f28400b4520 2024-06-10T00:25:15.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f284014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f284014dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37126/0 (socket says 172.21.15.79:37126) 2024-06-10T00:25:15.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 -- 172.21.15.79:0/246453573 learned_addr learned my addr 172.21.15.79:0/246453573 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:15.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845411640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28400b4520 0x7f28400b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2846413640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28401f3650 0x7f28401f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 -- 172.21.15.79:0/246453573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28400b4520 msgr2=0x7f28400b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28400b4520 0x7f28400b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 -- 172.21.15.79:0/246453573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28401f3650 msgr2=0x7f28401f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28401f3650 0x7f28401f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 -- 172.21.15.79:0/246453573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284015db20 con 0x7f282c004800 2024-06-10T00:25:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2845c12640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f284014dac0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f283c006a90 tx=0x7f283c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f28367fc640 1 -- 172.21.15.79:0/246453573 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c019020 con 0x7f282c004800 2024-06-10T00:25:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f28367fc640 1 -- 172.21.15.79:0/246453573 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c014870 con 0x7f282c004800 2024-06-10T00:25:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28401f4230 con 0x7f282c004800 2024-06-10T00:25:15.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f28367fc640 1 -- 172.21.15.79:0/246453573 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c014c40 con 0x7f282c004800 2024-06-10T00:25:15.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.255+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28400ace90 con 0x7f282c004800 2024-06-10T00:25:15.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.256+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2840068430 con 0x7f282c004800 2024-06-10T00:25:15.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.257+0000 7f28367fc640 1 -- 172.21.15.79:0/246453573 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f283c01c020 con 0x7f282c004800 2024-06-10T00:25:15.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.257+0000 7f28367fc640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f282406be60 0x7f282406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.257+0000 7f28367fc640 1 -- 172.21.15.79:0/246453573 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f283c08b590 con 0x7f282c004800 2024-06-10T00:25:15.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.257+0000 7f2845411640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f282406be60 0x7f282406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.258+0000 7f2845411640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f282406be60 0x7f282406e320 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2830032000 tx=0x7f283002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.262+0000 7f28367fc640 1 -- 172.21.15.79:0/246453573 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f283c023030 con 0x7f282c004800 2024-06-10T00:25:15.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.474+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28400b2650 con 0x7f282c004800 2024-06-10T00:25:15.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.475+0000 7f28367fc640 1 -- 172.21.15.79:0/246453573 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5188 (secure 0 0 0) 0x7f283c025300 con 0x7f282c004800 2024-06-10T00:25:15.475 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:15.475 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:25:09.459143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8715":{"gid":8715,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/781838074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":781838074},{"type":"v1","addr":"172.21.15.79:6837","nonce":781838074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8715,"qdb_cluster":[8715]},"id":8}]} 2024-06-10T00:25:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f282406be60 msgr2=0x7f282406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f282406be60 0x7f282406e320 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2830032000 tx=0x7f283002e000 comp rx=0 tx=0).stop 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 msgr2=0x7f284014dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f284014dac0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f283c006a90 tx=0x7f283c004610 comp rx=0 tx=0).stop 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 shutdown_connections 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f282406be60 0x7f282406e320 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28401f3650 0x7f28401f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28400b4520 0x7f28400b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 --2- 172.21.15.79:0/246453573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c004800 0x7f284014dac0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 >> 172.21.15.79:0/246453573 conn(0x7f28400b19f0 msgr2=0x7f284014e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 shutdown_connections 2024-06-10T00:25:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.477+0000 7f2847e76640 1 -- 172.21.15.79:0/246453573 wait complete. 2024-06-10T00:25:15.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:15.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.587+0000 7fccba31d640 1 Processor -- start 2024-06-10T00:25:15.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.587+0000 7fccba31d640 1 -- start start 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccba31d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 0x7fccb406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccba31d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fccb40af3d0 0x7fccb40cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccba31d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb406e390 con 0x7fccb40aef70 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccba31d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fccb415ac50 con 0x7fccb40af3d0 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccba31d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fccb406cdb0 con 0x7fccb415a870 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb37fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fccb40aef70 0x7fccb40b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58034/0 (socket says 172.21.15.79:58034) 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb37fe640 1 -- 172.21.15.79:0/2672616803 learned_addr learned my addr 172.21.15.79:0/2672616803 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738803388 0 0) 0x7fccb406e390 con 0x7fccb40aef70 2024-06-10T00:25:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb3fff640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 0x7fccb406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb88ba640 1 --2- 172.21.15.79:0/2672616803 >> v2:172.21.15.117:3300/0 conn(0x7fccb40af3d0 0x7fccb40cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc9c004630 con 0x7fccb40aef70 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 665165563 0 0) 0x7fcc9c004630 con 0x7fccb40aef70 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 msgr2=0x7fccb406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 0x7fccb406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 >> v2:172.21.15.117:3300/0 conn(0x7fccb40af3d0 msgr2=0x7fccb40cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 --2- 172.21.15.79:0/2672616803 >> v2:172.21.15.117:3300/0 conn(0x7fccb40af3d0 0x7fccb40cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb406d090 con 0x7fccb40aef70 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fcca8001670 con 0x7fccb40aef70 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 >> v1:172.21.15.79:6789/0 conn(0x7fccb40aef70 legacy=0x7fccb40b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9c004ac0 0x7fcc9c004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 0x7fcc9c005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c005e50 0x7fcc9c0062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fccb415ac50 con 0x7fcc9c004ac0 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fccb406cdb0 con 0x7fcc9c005e50 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c003520 con 0x7fccb415a870 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.588+0000 7fccb3fff640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9c004ac0 0x7fcc9c004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb37fe640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 0x7fcc9c005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb88ba640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c005e50 0x7fcc9c0062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb3fff640 1 -- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 msgr2=0x7fcc9c005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb3fff640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 0x7fcc9c005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb3fff640 1 -- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c005e50 msgr2=0x7fcc9c0062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb3fff640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c005e50 0x7fcc9c0062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb3fff640 1 -- 172.21.15.79:0/2672616803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c004630 con 0x7fcc9c004ac0 2024-06-10T00:25:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb37fe640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb415a870 0x7fcc9c005910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.589+0000 7fccb3fff640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9c004ac0 0x7fcc9c004ee0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009ac0 tx=0x7fcc9c006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfac5962b992a37b server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4036070 con 0x7fcc9c004ac0 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca4031400 con 0x7fcc9c004ac0 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccb2ffd640 1 -- 172.21.15.79:0/2672616803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4009690 con 0x7fcc9c004ac0 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccba31d640 1 -- 172.21.15.79:0/2672616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9c004ac0 msgr2=0x7fcc9c004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccba31d640 1 --2- 172.21.15.79:0/2672616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc9c004ac0 0x7fcc9c004ee0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009ac0 tx=0x7fcc9c006940 comp rx=0 tx=0).stop 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccb88ba640 1 -- 172.21.15.79:0/2672616803 reap_dead start 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccba31d640 1 -- 172.21.15.79:0/2672616803 shutdown_connections 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccba31d640 1 -- 172.21.15.79:0/2672616803 >> 172.21.15.79:0/2672616803 conn(0x7fccb40b19f0 msgr2=0x7fccb40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccba31d640 1 -- 172.21.15.79:0/2672616803 shutdown_connections 2024-06-10T00:25:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.590+0000 7fccba31d640 1 -- 172.21.15.79:0/2672616803 wait complete. 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.591+0000 7fccba31d640 1 Processor -- start 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccba31d640 1 -- start start 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccba31d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c004ac0 0x7fccb41efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccba31d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb41f0b50 0x7fccb4155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccba31d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb41575e0 0x7fccb415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccba31d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fccb406d930 con 0x7fccb41f0b50 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccba31d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fccb406d650 con 0x7fcc9c004ac0 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccba31d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fccb40b2e40 con 0x7fccb41575e0 2024-06-10T00:25:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccb37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb41f0b50 0x7fccb4155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccb37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb41f0b50 0x7fccb4155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37142/0 (socket says 172.21.15.79:37142) 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.592+0000 7fccb37fe640 1 -- 172.21.15.79:0/575222136 learned_addr learned my addr 172.21.15.79:0/575222136 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb88ba640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb41575e0 0x7fccb415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb3fff640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c004ac0 0x7fccb41efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb37fe640 1 -- 172.21.15.79:0/575222136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb41575e0 msgr2=0x7fccb415b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb37fe640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb41575e0 0x7fccb415b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb37fe640 1 -- 172.21.15.79:0/575222136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c004ac0 msgr2=0x7fccb41efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb37fe640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c004ac0 0x7fccb41efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb37fe640 1 -- 172.21.15.79:0/575222136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb415db40 con 0x7fccb41f0b50 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb37fe640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb41f0b50 0x7fccb4155ff0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fcca800e870 tx=0x7fcca800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb0ff9640 1 -- 172.21.15.79:0/575222136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca800c7f0 con 0x7fccb41f0b50 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb0ff9640 1 -- 172.21.15.79:0/575222136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca8018070 con 0x7fccb41f0b50 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb4156820 con 0x7fccb41f0b50 2024-06-10T00:25:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccb0ff9640 1 -- 172.21.15.79:0/575222136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca800cbb0 con 0x7fccb41f0b50 2024-06-10T00:25:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.593+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb4156de0 con 0x7fccb41f0b50 2024-06-10T00:25:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.594+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb4068430 con 0x7fccb41f0b50 2024-06-10T00:25:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.595+0000 7fccb0ff9640 1 -- 172.21.15.79:0/575222136 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcca801d460 con 0x7fccb41f0b50 2024-06-10T00:25:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.595+0000 7fccb0ff9640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcca006be30 0x7fcca006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.595+0000 7fccb0ff9640 1 -- 172.21.15.79:0/575222136 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fcca808b040 con 0x7fccb41f0b50 2024-06-10T00:25:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.595+0000 7fccb3fff640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcca006be30 0x7fcca006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.595+0000 7fccb3fff640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcca006be30 0x7fcca006e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcca4033000 tx=0x7fcca4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.599+0000 7fccb0ff9640 1 -- 172.21.15.79:0/575222136 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcca80597b0 con 0x7fccb41f0b50 2024-06-10T00:25:15.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:25:15.635 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:25:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.810+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccb40b2650 con 0x7fccb41f0b50 2024-06-10T00:25:15.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.811+0000 7fccb0ff9640 1 -- 172.21.15.79:0/575222136 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5188 (secure 0 0 0) 0x7fcca80590b0 con 0x7fccb41f0b50 2024-06-10T00:25:15.811 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:15.811 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-10T00:24:30.408817+0000","modified":"2024-06-10T00:25:09.459143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8715},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8715":{"gid":8715,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/781838074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":781838074},{"type":"v1","addr":"172.21.15.79:6837","nonce":781838074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8715,"qdb_cluster":[8715]},"id":8}]} 2024-06-10T00:25:15.811 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 96 2024-06-10T00:25:15.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcca006be30 msgr2=0x7fcca006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcca006be30 0x7fcca006e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcca4033000 tx=0x7fcca4008030 comp rx=0 tx=0).stop 2024-06-10T00:25:15.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb41f0b50 msgr2=0x7fccb4155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb41f0b50 0x7fccb4155ff0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fcca800e870 tx=0x7fcca800ed30 comp rx=0 tx=0).stop 2024-06-10T00:25:15.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 shutdown_connections 2024-06-10T00:25:15.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcca006be30 0x7fcca006e2f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccb41575e0 0x7fccb415b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb41f0b50 0x7fccb4155ff0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 --2- 172.21.15.79:0/575222136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc9c004ac0 0x7fccb41efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 >> 172.21.15.79:0/575222136 conn(0x7fccb40b19f0 msgr2=0x7fccb414e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:15.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 shutdown_connections 2024-06-10T00:25:15.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.813+0000 7fccba31d640 1 -- 172.21.15.79:0/575222136 wait complete. 2024-06-10T00:25:15.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:25:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.923+0000 7f52c287d640 1 Processor -- start 2024-06-10T00:25:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.923+0000 7f52c287d640 1 -- start start 2024-06-10T00:25:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c287d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f52bc0cd230 0x7f52bc0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c287d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52bc0cec50 0x7f52bc0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c287d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52bc0b3420 con 0x7f52bc1553c0 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c287d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f52bc0cc750 con 0x7f52bc0cec50 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c287d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f52bc0cca30 con 0x7f52bc0cd230 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52bbfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f52bc1553c0 0x7f52bc15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58046/0 (socket says 172.21.15.79:58046) 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52bbfff640 1 -- 172.21.15.79:0/191908846 learned_addr learned my addr 172.21.15.79:0/191908846 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c0e1a640 1 --2- 172.21.15.79:0/191908846 >> v2:172.21.15.79:3300/0 conn(0x7f52bc0cec50 0x7f52bc0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52baffd640 1 -- 172.21.15.79:0/191908846 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639628084 0 0) 0x7f52bc0b3420 con 0x7f52bc1553c0 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52baffd640 1 -- 172.21.15.79:0/191908846 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52a4003520 con 0x7f52bc1553c0 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52bb7fe640 1 --2- 172.21.15.79:0/191908846 >> v2:172.21.15.117:3300/0 conn(0x7f52bc0cd230 0x7f52bc0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c0e1a640 1 -- 172.21.15.79:0/191908846 >> v2:172.21.15.117:3300/0 conn(0x7f52bc0cd230 msgr2=0x7f52bc0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c0e1a640 1 --2- 172.21.15.79:0/191908846 >> v2:172.21.15.117:3300/0 conn(0x7f52bc0cd230 0x7f52bc0b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c0e1a640 1 -- 172.21.15.79:0/191908846 >> v1:172.21.15.79:6789/0 conn(0x7f52bc1553c0 legacy=0x7f52bc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.924+0000 7f52c0e1a640 1 -- 172.21.15.79:0/191908846 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc0ccd10 con 0x7f52bc0cec50 2024-06-10T00:25:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.925+0000 7f52c0e1a640 1 --2- 172.21.15.79:0/191908846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0cec50 0x7f52bc0cf0e0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f52bc075150 tx=0x7f52b402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf0df471fe28082 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.925+0000 7f52baffd640 1 -- 172.21.15.79:0/191908846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4007740 con 0x7f52bc0cec50 2024-06-10T00:25:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.925+0000 7f52baffd640 1 -- 172.21.15.79:0/191908846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b40078e0 con 0x7f52bc0cec50 2024-06-10T00:25:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.925+0000 7f52baffd640 1 -- 172.21.15.79:0/191908846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4007cb0 con 0x7f52bc0cec50 2024-06-10T00:25:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.926+0000 7f52c287d640 1 -- 172.21.15.79:0/191908846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0cec50 msgr2=0x7f52bc0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.926+0000 7f52c287d640 1 --2- 172.21.15.79:0/191908846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0cec50 0x7f52bc0cf0e0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f52bc075150 tx=0x7f52b402a680 comp rx=0 tx=0).stop 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.926+0000 7f52c287d640 1 -- 172.21.15.79:0/191908846 shutdown_connections 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.926+0000 7f52c287d640 1 --2- 172.21.15.79:0/191908846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0cec50 0x7f52bc0cf0e0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.926+0000 7f52c287d640 1 --2- 172.21.15.79:0/191908846 >> v2:172.21.15.117:3300/0 conn(0x7f52bc0cd230 0x7f52bc0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.926+0000 7f52c287d640 1 -- 172.21.15.79:0/191908846 >> 172.21.15.79:0/191908846 conn(0x7f52bc0b19f0 msgr2=0x7f52bc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.926+0000 7f52c287d640 1 -- 172.21.15.79:0/191908846 shutdown_connections 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.926+0000 7f52c287d640 1 -- 172.21.15.79:0/191908846 wait complete. 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.927+0000 7f52c287d640 1 Processor -- start 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.927+0000 7f52c287d640 1 -- start start 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c287d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0cd230 0x7f52bc0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c287d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0cec50 0x7f52bc1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c287d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc1553c0 0x7f52bc159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c287d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc155920 con 0x7f52bc1553c0 2024-06-10T00:25:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c287d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1557a0 con 0x7f52bc0cec50 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c287d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc071030 con 0x7f52bc0cd230 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc1553c0 0x7f52bc159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc1553c0 0x7f52bc159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37170/0 (socket says 172.21.15.79:37170) 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 -- 172.21.15.79:0/2463359268 learned_addr learned my addr 172.21.15.79:0/2463359268 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52bb7fe640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0cec50 0x7f52bc1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52bbfff640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0cd230 0x7f52bc0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 -- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0cd230 msgr2=0x7f52bc0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0cd230 0x7f52bc0ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 -- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0cec50 msgr2=0x7f52bc1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0cec50 0x7f52bc1541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 -- 172.21.15.79:0/2463359268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc15cc30 con 0x7f52bc1553c0 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52bbfff640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0cd230 0x7f52bc0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52c0e1a640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc1553c0 0x7f52bc159eb0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f52b402ac70 tx=0x7f52b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52b8ff9640 1 -- 172.21.15.79:0/2463359268 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4040070 con 0x7f52bc1553c0 2024-06-10T00:25:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.928+0000 7f52b8ff9640 1 -- 172.21.15.79:0/2463359268 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4031bc0 con 0x7f52bc1553c0 2024-06-10T00:25:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.929+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc15cf10 con 0x7f52bc1553c0 2024-06-10T00:25:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.929+0000 7f52b8ff9640 1 -- 172.21.15.79:0/2463359268 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4009450 con 0x7f52bc1553c0 2024-06-10T00:25:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.929+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc15d7b0 con 0x7f52bc1553c0 2024-06-10T00:25:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.929+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc15d0e0 con 0x7f52bc1553c0 2024-06-10T00:25:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.930+0000 7f52b8ff9640 1 -- 172.21.15.79:0/2463359268 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52b4039040 con 0x7f52bc1553c0 2024-06-10T00:25:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.930+0000 7f52b8ff9640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52a806be30 0x7f52a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.930+0000 7f52b8ff9640 1 -- 172.21.15.79:0/2463359268 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f52b40ac9b0 con 0x7f52bc1553c0 2024-06-10T00:25:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.930+0000 7f52bbfff640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52a806be30 0x7f52a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.931+0000 7f52bbfff640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52a806be30 0x7f52a806e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f52ac005880 tx=0x7f52ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:15.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:15.934+0000 7f52b8ff9640 1 -- 172.21.15.79:0/2463359268 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f52b407aa40 con 0x7f52bc1553c0 2024-06-10T00:25:16.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.109+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52bc068430 con 0x7f52bc1553c0 2024-06-10T00:25:16.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.110+0000 7f52b8ff9640 1 -- 172.21.15.79:0/2463359268 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+17163 (secure 0 0 0) 0x7f52b407ed40 con 0x7f52bc1553c0 2024-06-10T00:25:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:16.110 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":121,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:25:04.436521+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-06-10T00:24:29.040364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-06-10T00:24:29.380624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6835/1367694301":"2024-06-11T00:25:04.436503+0000","172.21.15.79:6837/3594456696":"2024-06-11T00:24:48.375026+0000","172.21.15.79:6837/1367694301":"2024-06-11T00:25:04.436503+0000","172.21.15.79:6835/3594456696":"2024-06-11T00:24:48.375026+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:25:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52a806be30 msgr2=0x7f52a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52a806be30 0x7f52a806e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f52ac005880 tx=0x7f52ac009040 comp rx=0 tx=0).stop 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc1553c0 msgr2=0x7f52bc159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc1553c0 0x7f52bc159eb0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f52b402ac70 tx=0x7f52b4004a40 comp rx=0 tx=0).stop 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 shutdown_connections 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f52a806be30 0x7f52a806e2f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc1553c0 0x7f52bc159eb0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0cec50 0x7f52bc1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 --2- 172.21.15.79:0/2463359268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0cd230 0x7f52bc0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 >> 172.21.15.79:0/2463359268 conn(0x7f52bc0b19f0 msgr2=0x7f52bc15ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 shutdown_connections 2024-06-10T00:25:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.112+0000 7f52c287d640 1 -- 172.21.15.79:0/2463359268 wait complete. 2024-06-10T00:25:16.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-10T00:25:16.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.225+0000 7fc726b34640 1 Processor -- start 2024-06-10T00:25:16.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.225+0000 7fc726b34640 1 -- start start 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.225+0000 7fc726b34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7200d1fc0 0x7fc7200cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.225+0000 7fc726b34640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc72015f5e0 con 0x7fc7200d2680 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc726b34640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7200d0ad0 con 0x7fc72015f1a0 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc726b34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc7200d13e0 con 0x7fc7200d1fc0 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc7248d0640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc7200d2680 0x7fc7200d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58050/0 (socket says 172.21.15.79:58050) 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc7248d0640 1 -- 172.21.15.79:0/3404586975 learned_addr learned my addr 172.21.15.79:0/3404586975 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc7250d1640 1 --2- 172.21.15.79:0/3404586975 >> v2:172.21.15.117:3300/0 conn(0x7fc7200d1fc0 0x7fc7200cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920753452 0 0) 0x7fc72015f5e0 con 0x7fc7200d2680 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc710003520 con 0x7fc7200d2680 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2184421695 0 0) 0x7fc710003520 con 0x7fc7200d2680 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 >> v2:172.21.15.117:3300/0 conn(0x7fc7200d1fc0 msgr2=0x7fc7200cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 --2- 172.21.15.79:0/3404586975 >> v2:172.21.15.117:3300/0 conn(0x7fc7200d1fc0 0x7fc7200cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 >> v1:172.21.15.117:6789/0 conn(0x7fc72015f1a0 legacy=0x7fc7200cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72015f890 con 0x7fc7200d2680 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fc714001670 con 0x7fc7200d2680 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 >> v1:172.21.15.79:6789/0 conn(0x7fc7200d2680 legacy=0x7fc7200d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7100039b0 0x7fc710003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc710004800 0x7fc710004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100051c0 0x7fc71000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200d13e0 con 0x7fc7100039b0 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc71000c060 con 0x7fc710004800 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc71000c260 con 0x7fc7100051c0 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc7248d0640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7100039b0 0x7fc710003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc71ffff640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc710004800 0x7fc710004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.226+0000 7fc7250d1640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100051c0 0x7fc71000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc7248d0640 1 -- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100051c0 msgr2=0x7fc71000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc7248d0640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100051c0 0x7fc71000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc7248d0640 1 -- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc710004800 msgr2=0x7fc710004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc7248d0640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc710004800 0x7fc710004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc7248d0640 1 -- 172.21.15.79:0/3404586975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc710003520 con 0x7fc7100039b0 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc71ffff640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc710004800 0x7fc710004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc7250d1640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100051c0 0x7fc71000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc7250d1640 1 -- 172.21.15.79:0/3404586975 reap_dead start 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc7248d0640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7100039b0 0x7fc710003dd0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c240 tx=0x7fc710005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df646f2177e9b9d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714007d10 con 0x7fc7100039b0 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714005ad0 con 0x7fc7100039b0 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.227+0000 7fc71f7fe640 1 -- 172.21.15.79:0/3404586975 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714007070 con 0x7fc7100039b0 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.228+0000 7fc726b34640 1 -- 172.21.15.79:0/3404586975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7100039b0 msgr2=0x7fc710003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.228+0000 7fc726b34640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7100039b0 0x7fc710003dd0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c240 tx=0x7fc710005830 comp rx=0 tx=0).stop 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.228+0000 7fc726b34640 1 -- 172.21.15.79:0/3404586975 shutdown_connections 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.228+0000 7fc726b34640 1 --2- 172.21.15.79:0/3404586975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7100039b0 0x7fc710003dd0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.228+0000 7fc726b34640 1 -- 172.21.15.79:0/3404586975 >> 172.21.15.79:0/3404586975 conn(0x7fc72009d3f0 msgr2=0x7fc7200d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.228+0000 7fc726b34640 1 -- 172.21.15.79:0/3404586975 shutdown_connections 2024-06-10T00:25:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.228+0000 7fc726b34640 1 -- 172.21.15.79:0/3404586975 wait complete. 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.229+0000 7fc726b34640 1 Processor -- start 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.229+0000 7fc726b34640 1 -- start start 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc726b34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100039b0 0x7fc7201f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc726b34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc72015d260 0x7fc7201f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc726b34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7200b9660 0x7fc72015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc726b34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200d2410 con 0x7fc72015d260 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc726b34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200d1070 con 0x7fc7200b9660 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc726b34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc7200d4f00 con 0x7fc7100039b0 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc71ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc72015d260 0x7fc7201f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc71ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc72015d260 0x7fc7201f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37186/0 (socket says 172.21.15.79:37186) 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc71ffff640 1 -- 172.21.15.79:0/3976728913 learned_addr learned my addr 172.21.15.79:0/3976728913 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc7248d0640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100039b0 0x7fc7201f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc7250d1640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7200b9660 0x7fc72015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc71ffff640 1 -- 172.21.15.79:0/3976728913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100039b0 msgr2=0x7fc7201f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc71ffff640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100039b0 0x7fc7201f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc71ffff640 1 -- 172.21.15.79:0/3976728913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7200b9660 msgr2=0x7fc72015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc71ffff640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7200b9660 0x7fc72015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.230+0000 7fc71ffff640 1 -- 172.21.15.79:0/3976728913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72015d6e0 con 0x7fc72015d260 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.231+0000 7fc71ffff640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc72015d260 0x7fc7201f7400 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc70c000c00 tx=0x7fc70c00e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.231+0000 7fc71d7fa640 1 -- 172.21.15.79:0/3976728913 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c019070 con 0x7fc72015d260 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.231+0000 7fc71d7fa640 1 -- 172.21.15.79:0/3976728913 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c0052e0 con 0x7fc72015d260 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.231+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7200b6e40 con 0x7fc72015d260 2024-06-10T00:25:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.231+0000 7fc71d7fa640 1 -- 172.21.15.79:0/3976728913 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c003830 con 0x7fc72015d260 2024-06-10T00:25:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.231+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7200b7100 con 0x7fc72015d260 2024-06-10T00:25:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.232+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc720068430 con 0x7fc72015d260 2024-06-10T00:25:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.232+0000 7fc71d7fa640 1 -- 172.21.15.79:0/3976728913 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc70c01c070 con 0x7fc72015d260 2024-06-10T00:25:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.233+0000 7fc71d7fa640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc70406be30 0x7fc70406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.233+0000 7fc71d7fa640 1 -- 172.21.15.79:0/3976728913 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fc70c08a630 con 0x7fc72015d260 2024-06-10T00:25:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.233+0000 7fc7248d0640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc70406be30 0x7fc70406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.233+0000 7fc7248d0640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc70406be30 0x7fc70406e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc714032000 tx=0x7fc71402d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.237+0000 7fc71d7fa640 1 -- 172.21.15.79:0/3976728913 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc70c058750 con 0x7fc72015d260 2024-06-10T00:25:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.447+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc72015e9c0 con 0x7fc72015d260 2024-06-10T00:25:16.447 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-06-10T00:25:16.448+0000 7f5229b99640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-10T00:25:16.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.449+0000 7fc71d7fa640 1 -- 172.21.15.79:0/3976728913 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v97) ==== 161+0+0 (secure 0 0 0) 0x7fc70c05ca50 con 0x7fc72015d260 2024-06-10T00:25:16.448 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-10T00:25:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc70406be30 msgr2=0x7fc70406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc70406be30 0x7fc70406e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc714032000 tx=0x7fc71402d000 comp rx=0 tx=0).stop 2024-06-10T00:25:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc72015d260 msgr2=0x7fc7201f7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc72015d260 0x7fc7201f7400 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc70c000c00 tx=0x7fc70c00e8f0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 shutdown_connections 2024-06-10T00:25:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc70406be30 0x7fc70406e2f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7200b9660 0x7fc72015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc72015d260 0x7fc7201f7400 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 --2- 172.21.15.79:0/3976728913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7100039b0 0x7fc7201f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.451+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 >> 172.21.15.79:0/3976728913 conn(0x7fc72009d3f0 msgr2=0x7fc7200cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.452+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 shutdown_connections 2024-06-10T00:25:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.452+0000 7fc726b34640 1 -- 172.21.15.79:0/3976728913 wait complete. 2024-06-10T00:25:16.453 INFO:tasks.ceph.mds.a.smithi079.stderr: -1337> 2024-06-10T00:25:10.444+0000 7f1a33196640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-10T00:25:16.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-10T00:25:16.479 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2024-06-10T00:25:16.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.566+0000 7fabe24ba640 1 Processor -- start 2024-06-10T00:25:16.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.566+0000 7fabe24ba640 1 -- start start 2024-06-10T00:25:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.567+0000 7fabe24ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0b3b40 0x7fabdc0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.567+0000 7fabe24ba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabdc0b48e0 0x7fabdc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.567+0000 7fabe24ba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabdc15c870 con 0x7fabdc0d0020 2024-06-10T00:25:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.567+0000 7fabe24ba640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fabdc15cb50 con 0x7fabdc0b48e0 2024-06-10T00:25:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.567+0000 7fabe24ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc15ce30 con 0x7fabdc0b3b40 2024-06-10T00:25:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.567+0000 7fabd3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabdc0b48e0 0x7fabdc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.567+0000 7fabe0a57640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fabdc0d0020 0x7fabdc06d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58056/0 (socket says 172.21.15.79:58056) 2024-06-10T00:25:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.567+0000 7fabe0a57640 1 -- 172.21.15.79:0/1657694400 learned_addr learned my addr 172.21.15.79:0/1657694400 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabdbfff640 1 --2- 172.21.15.79:0/1657694400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0b3b40 0x7fabdc0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabd3fff640 1 -- 172.21.15.79:0/1657694400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0b3b40 msgr2=0x7fabdc0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabd3fff640 1 --2- 172.21.15.79:0/1657694400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0b3b40 0x7fabdc0b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabd3fff640 1 -- 172.21.15.79:0/1657694400 >> v1:172.21.15.79:6789/0 conn(0x7fabdc0d0020 legacy=0x7fabdc06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabd3fff640 1 -- 172.21.15.79:0/1657694400 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc15d110 con 0x7fabdc0b48e0 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabdb7fe640 1 -- 172.21.15.79:0/1657694400 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760954253 0 0) 0x7fabdc15c870 con 0x7fabdc0d0020 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabd3fff640 1 --2- 172.21.15.79:0/1657694400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc0b4d40 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fabc40097a0 tx=0x7fabc402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a776549df59dad8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabdb7fe640 1 -- 172.21.15.79:0/1657694400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4037070 con 0x7fabdc0b48e0 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabdb7fe640 1 -- 172.21.15.79:0/1657694400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc402ae50 con 0x7fabdc0b48e0 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.568+0000 7fabdb7fe640 1 -- 172.21.15.79:0/1657694400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4032660 con 0x7fabdc0b48e0 2024-06-10T00:25:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.569+0000 7fabe24ba640 1 -- 172.21.15.79:0/1657694400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 msgr2=0x7fabdc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.569+0000 7fabe24ba640 1 --2- 172.21.15.79:0/1657694400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc0b4d40 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fabc40097a0 tx=0x7fabc402a100 comp rx=0 tx=0).stop 2024-06-10T00:25:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.569+0000 7fabe24ba640 1 -- 172.21.15.79:0/1657694400 shutdown_connections 2024-06-10T00:25:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.569+0000 7fabe24ba640 1 --2- 172.21.15.79:0/1657694400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc0b4d40 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.569+0000 7fabe24ba640 1 --2- 172.21.15.79:0/1657694400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0b3b40 0x7fabdc0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.569+0000 7fabe24ba640 1 -- 172.21.15.79:0/1657694400 >> 172.21.15.79:0/1657694400 conn(0x7fabdc0b1d10 msgr2=0x7fabdc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.569+0000 7fabe24ba640 1 -- 172.21.15.79:0/1657694400 shutdown_connections 2024-06-10T00:25:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.569+0000 7fabe24ba640 1 -- 172.21.15.79:0/1657694400 wait complete. 2024-06-10T00:25:16.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.570+0000 7fabe24ba640 1 Processor -- start 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.570+0000 7fabe24ba640 1 -- start start 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabe24ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b3b40 0x7fabdc1e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabe24ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc09c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabe24ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0d0020 0x7fabdc157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabe24ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc15c490 con 0x7fabdc0b48e0 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabe24ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0b3f20 con 0x7fabdc0b3b40 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabe24ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc15c610 con 0x7fabdc0d0020 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc09c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc09c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37216/0 (socket says 172.21.15.79:37216) 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabd3fff640 1 -- 172.21.15.79:0/3654354989 learned_addr learned my addr 172.21.15.79:0/3654354989 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabe0a57640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0d0020 0x7fabdc157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabdbfff640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b3b40 0x7fabdc1e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabd3fff640 1 -- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0d0020 msgr2=0x7fabdc157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabd3fff640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0d0020 0x7fabdc157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabd3fff640 1 -- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b3b40 msgr2=0x7fabdc1e3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabd3fff640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b3b40 0x7fabdc1e3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabd3fff640 1 -- 172.21.15.79:0/3654354989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc1e39c0 con 0x7fabdc0b48e0 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabe0a57640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0d0020 0x7fabdc157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.571+0000 7fabdbfff640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b3b40 0x7fabdc1e3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.572+0000 7fabd3fff640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc09c4b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fabc4035040 tx=0x7fabc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.572+0000 7fabd97fa640 1 -- 172.21.15.79:0/3654354989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4041070 con 0x7fabdc0b48e0 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.572+0000 7fabd97fa640 1 -- 172.21.15.79:0/3654354989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc403c670 con 0x7fabdc0b48e0 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.572+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabdc09cd00 con 0x7fabdc0b48e0 2024-06-10T00:25:16.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.572+0000 7fabd97fa640 1 -- 172.21.15.79:0/3654354989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4037040 con 0x7fabdc0b48e0 2024-06-10T00:25:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.572+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc09d2c0 con 0x7fabdc0b48e0 2024-06-10T00:25:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.573+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabdc0683c0 con 0x7fabdc0b48e0 2024-06-10T00:25:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.573+0000 7fabd97fa640 1 -- 172.21.15.79:0/3654354989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabc403a070 con 0x7fabdc0b48e0 2024-06-10T00:25:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.574+0000 7fabd97fa640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fabbc06be30 0x7fabbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.574+0000 7fabd97fa640 1 -- 172.21.15.79:0/3654354989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6359+0+0 (secure 0 0 0) 0x7fabc40ab350 con 0x7fabdc0b48e0 2024-06-10T00:25:16.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.574+0000 7fabdbfff640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fabbc06be30 0x7fabbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:16.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.574+0000 7fabdbfff640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fabbc06be30 0x7fabbc06e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fabcc006fd0 tx=0x7fabcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:16.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.578+0000 7fabd97fa640 1 -- 172.21.15.79:0/3654354989 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fabdc1e39c0 con 0x7fabdc0b48e0 2024-06-10T00:25:16.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:16.790+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fabdc09c290 con 0x7fabdc0b48e0 2024-06-10T00:25:17.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.479+0000 7fabd97fa640 1 -- 172.21.15.79:0/3654354989 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v98) ==== 104+0+0 (secure 0 0 0) 0x7fabc4079a70 con 0x7fabdc0b48e0 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fabbc06be30 msgr2=0x7fabbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fabbc06be30 0x7fabbc06e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fabcc006fd0 tx=0x7fabcc008040 comp rx=0 tx=0).stop 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 msgr2=0x7fabdc09c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc09c4b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fabc4035040 tx=0x7fabc40046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 shutdown_connections 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fabbc06be30 0x7fabbc06e2f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc0d0020 0x7fabdc157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0b48e0 0x7fabdc09c4b0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 --2- 172.21.15.79:0/3654354989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b3b40 0x7fabdc1e3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 >> 172.21.15.79:0/3654354989 conn(0x7fabdc0b1d10 msgr2=0x7fabdc0ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 shutdown_connections 2024-06-10T00:25:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.482+0000 7fabe24ba640 1 -- 172.21.15.79:0/3654354989 wait complete. 2024-06-10T00:25:17.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-10T00:25:17.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.643+0000 7f0281314640 1 Processor -- start 2024-06-10T00:25:17.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.643+0000 7f0281314640 1 -- start start 2024-06-10T00:25:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f0281314640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f027c15e650 0x7f027c0d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f0281314640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f027c0d4cc0 0x7f027c0d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f0281314640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f027c0d0ff0 0x7f027c0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f0281314640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f027c0d2fb0 con 0x7f027c0d4cc0 2024-06-10T00:25:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f0281314640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f027c0d3290 con 0x7f027c15e650 2024-06-10T00:25:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f0281314640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f027c0b3930 con 0x7f027c0d0ff0 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f02727fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f027c0d4cc0 0x7f027c0d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f02727fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f027c0d4cc0 0x7f027c0d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37232/0 (socket says 172.21.15.79:37232) 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f02727fc640 1 -- 172.21.15.79:0/4015057313 learned_addr learned my addr 172.21.15.79:0/4015057313 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f02727fc640 1 -- 172.21.15.79:0/4015057313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f027c0d0ff0 msgr2=0x7f027c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f02727fc640 1 --2- 172.21.15.79:0/4015057313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f027c0d0ff0 0x7f027c0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f02727fc640 1 -- 172.21.15.79:0/4015057313 >> v2:172.21.15.117:3300/0 conn(0x7f027c15e650 msgr2=0x7f027c0d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f02727fc640 1 --2- 172.21.15.79:0/4015057313 >> v2:172.21.15.117:3300/0 conn(0x7f027c15e650 0x7f027c0d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.644+0000 7f02727fc640 1 -- 172.21.15.79:0/4015057313 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c0b3c10 con 0x7f027c0d4cc0 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.645+0000 7f02727fc640 1 --2- 172.21.15.79:0/4015057313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d4cc0 0x7f027c0d0ab0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f027c0b6c00 tx=0x7f026402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba3a50cbac3bac3 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.645+0000 7f027a7fc640 1 -- 172.21.15.79:0/4015057313 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264037070 con 0x7f027c0d4cc0 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.645+0000 7f027a7fc640 1 -- 172.21.15.79:0/4015057313 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0264032440 con 0x7f027c0d4cc0 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.645+0000 7f027a7fc640 1 -- 172.21.15.79:0/4015057313 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264032810 con 0x7f027c0d4cc0 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 -- 172.21.15.79:0/4015057313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d4cc0 msgr2=0x7f027c0d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 --2- 172.21.15.79:0/4015057313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d4cc0 0x7f027c0d0ab0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f027c0b6c00 tx=0x7f026402a1e0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 -- 172.21.15.79:0/4015057313 shutdown_connections 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 --2- 172.21.15.79:0/4015057313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f027c0d0ff0 0x7f027c0cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 --2- 172.21.15.79:0/4015057313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d4cc0 0x7f027c0d0ab0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 --2- 172.21.15.79:0/4015057313 >> v2:172.21.15.117:3300/0 conn(0x7f027c15e650 0x7f027c0d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 -- 172.21.15.79:0/4015057313 >> 172.21.15.79:0/4015057313 conn(0x7f027c09d370 msgr2=0x7f027c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 -- 172.21.15.79:0/4015057313 shutdown_connections 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.646+0000 7f0281314640 1 -- 172.21.15.79:0/4015057313 wait complete. 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.647+0000 7f0281314640 1 Processor -- start 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.647+0000 7f0281314640 1 -- start start 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0281314640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d0ff0 0x7f027c15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0281314640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f027c0d4cc0 0x7f027c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0281314640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f027c15e650 0x7f027c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0281314640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f027c15ea30 con 0x7f027c0d0ff0 2024-06-10T00:25:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0281314640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f027c0d2bc0 con 0x7f027c0d4cc0 2024-06-10T00:25:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0281314640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f027c0b86e0 con 0x7f027c15e650 2024-06-10T00:25:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d0ff0 0x7f027c15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d0ff0 0x7f027c15cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37234/0 (socket says 172.21.15.79:37234) 2024-06-10T00:25:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 -- 172.21.15.79:0/615918802 learned_addr learned my addr 172.21.15.79:0/615918802 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 -- 172.21.15.79:0/615918802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f027c15e650 msgr2=0x7f027c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f027c15e650 0x7f027c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 -- 172.21.15.79:0/615918802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f027c0d4cc0 msgr2=0x7f027c0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f027c0d4cc0 0x7f027c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 -- 172.21.15.79:0/615918802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c0b7ad0 con 0x7f027c0d0ff0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f027affd640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d0ff0 0x7f027c15cb10 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f026c00b440 tx=0x7f026c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0273fff640 1 -- 172.21.15.79:0/615918802 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c015020 con 0x7f027c0d0ff0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0273fff640 1 -- 172.21.15.79:0/615918802 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c011890 con 0x7f027c0d0ff0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c0b7db0 con 0x7f027c0d0ff0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0273fff640 1 -- 172.21.15.79:0/615918802 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c011c80 con 0x7f027c0d0ff0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.648+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c0b8370 con 0x7f027c0d0ff0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.649+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027c08cd70 con 0x7f027c0d0ff0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.650+0000 7f0273fff640 1 -- 172.21.15.79:0/615918802 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f026c018020 con 0x7f027c0d0ff0 2024-06-10T00:25:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.650+0000 7f0273fff640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f025c06be60 0x7f025c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:17.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.650+0000 7f0273fff640 1 -- 172.21.15.79:0/615918802 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6359+0+0 (secure 0 0 0) 0x7f026c08b170 con 0x7f027c0d0ff0 2024-06-10T00:25:17.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.650+0000 7f02727fc640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f025c06be60 0x7f025c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:17.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.651+0000 7f02727fc640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f025c06be60 0x7f025c06e320 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0264034000 tx=0x7f026402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:17.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.655+0000 7f0273fff640 1 -- 172.21.15.79:0/615918802 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f027c08cd70 con 0x7f027c0d0ff0 2024-06-10T00:25:17.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:17.829+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f027c068540 con 0x7f027c0d0ff0 2024-06-10T00:25:18.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.486+0000 7f0273fff640 1 -- 172.21.15.79:0/615918802 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v123) ==== 181+0+0 (secure 0 0 0) 0x7f026c01f020 con 0x7f027c0d0ff0 2024-06-10T00:25:18.486 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-06-10T00:25:18.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f025c06be60 msgr2=0x7f025c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:18.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f025c06be60 0x7f025c06e320 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0264034000 tx=0x7f026402c000 comp rx=0 tx=0).stop 2024-06-10T00:25:18.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d0ff0 msgr2=0x7f027c15cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:18.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d0ff0 0x7f027c15cb10 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f026c00b440 tx=0x7f026c00b900 comp rx=0 tx=0).stop 2024-06-10T00:25:18.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 shutdown_connections 2024-06-10T00:25:18.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f025c06be60 0x7f025c06e320 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f027c15e650 0x7f027c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f027c0d4cc0 0x7f027c0cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 --2- 172.21.15.79:0/615918802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c0d0ff0 0x7f027c15cb10 secure :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f026c00b440 tx=0x7f026c00b900 comp rx=0 tx=0).stop 2024-06-10T00:25:18.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.489+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 >> 172.21.15.79:0/615918802 conn(0x7f027c09d370 msgr2=0x7f027c06cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:18.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.490+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 shutdown_connections 2024-06-10T00:25:18.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.490+0000 7f0281314640 1 -- 172.21.15.79:0/615918802 wait complete. 2024-06-10T00:25:18.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-10T00:25:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.607+0000 7f7366e7b640 1 Processor -- start 2024-06-10T00:25:18.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.608+0000 7f7366e7b640 1 -- start start 2024-06-10T00:25:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.608+0000 7f7366e7b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f736015e670 0x7f73600d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.608+0000 7f7366e7b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73600d0e00 0x7f73600cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.608+0000 7f7366e7b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f736015ec90 con 0x7f73600d1f30 2024-06-10T00:25:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.608+0000 7f7366e7b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f736015fa50 con 0x7f736015e670 2024-06-10T00:25:18.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.608+0000 7f7366e7b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f736015ea50 con 0x7f73600d0e00 2024-06-10T00:25:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7364c17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f736015e670 0x7f73600d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7365418640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73600d0e00 0x7f73600cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7357fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f73600d1f30 0x7f73600d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52556/0 (socket says 172.21.15.79:52556) 2024-06-10T00:25:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7364c17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f736015e670 0x7f73600d49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:38470/0 (socket says 172.21.15.79:38470) 2024-06-10T00:25:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7365418640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73600d0e00 0x7f73600cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:40946/0 (socket says 172.21.15.79:40946) 2024-06-10T00:25:18.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7357fff640 1 -- 172.21.15.79:0/2969658355 learned_addr learned my addr 172.21.15.79:0/2969658355 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:18.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7365418640 1 -- 172.21.15.79:0/2969658355 >> v2:172.21.15.117:3300/0 conn(0x7f736015e670 msgr2=0x7f73600d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7365418640 1 --2- 172.21.15.79:0/2969658355 >> v2:172.21.15.117:3300/0 conn(0x7f736015e670 0x7f73600d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7365418640 1 -- 172.21.15.79:0/2969658355 >> v1:172.21.15.117:6789/0 conn(0x7f73600d1f30 legacy=0x7f73600d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7365418640 1 -- 172.21.15.79:0/2969658355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736015ef70 con 0x7f73600d0e00 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.609+0000 7f7364c17640 1 --2- 172.21.15.79:0/2969658355 >> v2:172.21.15.117:3300/0 conn(0x7f736015e670 0x7f73600d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.610+0000 7f7365418640 1 --2- 172.21.15.79:0/2969658355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73600d0e00 0x7f73600cebd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7358009d90 tx=0x7f735802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b2828e406c114e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.610+0000 7f73577fe640 1 -- 172.21.15.79:0/2969658355 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358007740 con 0x7f73600d0e00 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.610+0000 7f73577fe640 1 -- 172.21.15.79:0/2969658355 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73580078e0 con 0x7f73600d0e00 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.610+0000 7f73577fe640 1 -- 172.21.15.79:0/2969658355 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358007cb0 con 0x7f73600d0e00 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.611+0000 7f7366e7b640 1 -- 172.21.15.79:0/2969658355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73600d0e00 msgr2=0x7f73600cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.611+0000 7f7366e7b640 1 --2- 172.21.15.79:0/2969658355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73600d0e00 0x7f73600cebd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7358009d90 tx=0x7f735802a6f0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.611+0000 7f7366e7b640 1 -- 172.21.15.79:0/2969658355 shutdown_connections 2024-06-10T00:25:18.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.611+0000 7f7366e7b640 1 --2- 172.21.15.79:0/2969658355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73600d0e00 0x7f73600cebd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.611+0000 7f7366e7b640 1 --2- 172.21.15.79:0/2969658355 >> v2:172.21.15.117:3300/0 conn(0x7f736015e670 0x7f73600d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.611+0000 7f7366e7b640 1 -- 172.21.15.79:0/2969658355 >> 172.21.15.79:0/2969658355 conn(0x7f736009d400 msgr2=0x7f73600d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:18.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.611+0000 7f7366e7b640 1 -- 172.21.15.79:0/2969658355 shutdown_connections 2024-06-10T00:25:18.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.611+0000 7f7366e7b640 1 -- 172.21.15.79:0/2969658355 wait complete. 2024-06-10T00:25:18.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.612+0000 7f7366e7b640 1 Processor -- start 2024-06-10T00:25:18.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.612+0000 7f7366e7b640 1 -- start start 2024-06-10T00:25:18.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7366e7b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73600d0e00 0x7f73601506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:18.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7366e7b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73600d1f30 0x7f73600b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7366e7b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736015e670 0x7f73600cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7366e7b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f73600d2370 con 0x7f73600d0e00 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7366e7b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f736015f530 con 0x7f73600d1f30 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7366e7b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f73600cf110 con 0x7f736015e670 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73600d0e00 0x7f73601506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73600d0e00 0x7f73601506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49944/0 (socket says 172.21.15.79:49944) 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 -- 172.21.15.79:0/3351089945 learned_addr learned my addr 172.21.15.79:0/3351089945 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7365418640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736015e670 0x7f73600cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7357fff640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73600d1f30 0x7f73600b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 -- 172.21.15.79:0/3351089945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736015e670 msgr2=0x7f73600cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736015e670 0x7f73600cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 -- 172.21.15.79:0/3351089945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73600d1f30 msgr2=0x7f73600b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73600d1f30 0x7f73600b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 -- 172.21.15.79:0/3351089945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73600b6f30 con 0x7f73600d0e00 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7364c17640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73600d0e00 0x7f73601506b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f735c00e960 tx=0x7f735c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f73557fa640 1 -- 172.21.15.79:0/3351089945 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c017070 con 0x7f73600d0e00 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f73557fa640 1 -- 172.21.15.79:0/3351089945 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f735c00ca00 con 0x7f73600d0e00 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f73557fa640 1 -- 172.21.15.79:0/3351089945 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c00cdd0 con 0x7f73600d0e00 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.613+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73600b7210 con 0x7f73600d0e00 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.614+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73600b77d0 con 0x7f73600d0e00 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.615+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7360068540 con 0x7f73600d0e00 2024-06-10T00:25:18.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.615+0000 7f73557fa640 1 -- 172.21.15.79:0/3351089945 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f735c01a070 con 0x7f73600d0e00 2024-06-10T00:25:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.615+0000 7f73557fa640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f734c06be30 0x7f734c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.615+0000 7f73557fa640 1 -- 172.21.15.79:0/3351089945 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5921+0+0 (secure 0 0 0) 0x7f735c08ae20 con 0x7f73600d0e00 2024-06-10T00:25:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.615+0000 7f7357fff640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f734c06be30 0x7f734c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.616+0000 7f7357fff640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f734c06be30 0x7f734c06e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f73600c7a70 tx=0x7f7350009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:18.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.620+0000 7f73557fa640 1 -- 172.21.15.79:0/3351089945 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f735c0596f0 con 0x7f73600d0e00 2024-06-10T00:25:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:18.798+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73600d1670 con 0x7f73600d0e00 2024-06-10T00:25:19.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.490+0000 7f73557fa640 1 -- 172.21.15.79:0/3351089945 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v124) ==== 169+0+0 (secure 0 0 0) 0x7f735c058ff0 con 0x7f73600d0e00 2024-06-10T00:25:19.490 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-06-10T00:25:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f734c06be30 msgr2=0x7f734c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f734c06be30 0x7f734c06e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f73600c7a70 tx=0x7f7350009040 comp rx=0 tx=0).stop 2024-06-10T00:25:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73600d0e00 msgr2=0x7f73601506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73600d0e00 0x7f73601506b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f735c00e960 tx=0x7f735c00ee20 comp rx=0 tx=0).stop 2024-06-10T00:25:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 shutdown_connections 2024-06-10T00:25:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f734c06be30 0x7f734c06e2f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f736015e670 0x7f73600cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73600d1f30 0x7f73600b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 --2- 172.21.15.79:0/3351089945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73600d0e00 0x7f73601506b0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.494+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 >> 172.21.15.79:0/3351089945 conn(0x7f736009d400 msgr2=0x7f736006d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.495+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 shutdown_connections 2024-06-10T00:25:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.495+0000 7f7366e7b640 1 -- 172.21.15.79:0/3351089945 wait complete. 2024-06-10T00:25:19.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-10T00:25:19.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.616+0000 7fd2a6410640 1 Processor -- start 2024-06-10T00:25:19.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.616+0000 7fd2a6410640 1 -- start start 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd2a6410640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2a00b2bf0 0x7fd2a00d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd2a6410640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00d0560 0x7fd2a006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd2a6410640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a00b3080 con 0x7fd2a00b3b40 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd2a6410640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd2a00d09b0 con 0x7fd2a00b2bf0 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd2a6410640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a015c870 con 0x7fd2a00d0560 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd29f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2a00b2bf0 0x7fd2a00d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd29f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2a00b2bf0 0x7fd2a00d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49946/0 (socket says 172.21.15.79:49946) 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd29f7fe640 1 -- 172.21.15.79:0/592623613 learned_addr learned my addr 172.21.15.79:0/592623613 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd29f7fe640 1 -- 172.21.15.79:0/592623613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00d0560 msgr2=0x7fd2a006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd2a49ad640 1 --2- 172.21.15.79:0/592623613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00d0560 0x7fd2a006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd29f7fe640 1 --2- 172.21.15.79:0/592623613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00d0560 0x7fd2a006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd29f7fe640 1 -- 172.21.15.79:0/592623613 >> v1:172.21.15.117:6789/0 conn(0x7fd2a00b3b40 legacy=0x7fd2a00b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:19.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.617+0000 7fd29f7fe640 1 -- 172.21.15.79:0/592623613 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a015cb50 con 0x7fd2a00b2bf0 2024-06-10T00:25:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd29f7fe640 1 --2- 172.21.15.79:0/592623613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b2bf0 0x7fd2a00d0020 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fd294009870 tx=0x7fd29402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f651314cc08b90 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd29effd640 1 -- 172.21.15.79:0/592623613 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294037070 con 0x7fd2a00b2bf0 2024-06-10T00:25:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd29effd640 1 -- 172.21.15.79:0/592623613 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd294032440 con 0x7fd2a00b2bf0 2024-06-10T00:25:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd29effd640 1 -- 172.21.15.79:0/592623613 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294032810 con 0x7fd2a00b2bf0 2024-06-10T00:25:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd2a6410640 1 -- 172.21.15.79:0/592623613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b2bf0 msgr2=0x7fd2a00d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd2a6410640 1 --2- 172.21.15.79:0/592623613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b2bf0 0x7fd2a00d0020 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fd294009870 tx=0x7fd29402a210 comp rx=0 tx=0).stop 2024-06-10T00:25:19.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd2a6410640 1 -- 172.21.15.79:0/592623613 shutdown_connections 2024-06-10T00:25:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd2a6410640 1 --2- 172.21.15.79:0/592623613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00d0560 0x7fd2a006d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd2a6410640 1 --2- 172.21.15.79:0/592623613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b2bf0 0x7fd2a00d0020 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.618+0000 7fd2a6410640 1 -- 172.21.15.79:0/592623613 >> 172.21.15.79:0/592623613 conn(0x7fd2a00b1d10 msgr2=0x7fd2a00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.619+0000 7fd2a6410640 1 -- 172.21.15.79:0/592623613 shutdown_connections 2024-06-10T00:25:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.619+0000 7fd2a6410640 1 -- 172.21.15.79:0/592623613 wait complete. 2024-06-10T00:25:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.620+0000 7fd2a6410640 1 Processor -- start 2024-06-10T00:25:19.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.620+0000 7fd2a6410640 1 -- start start 2024-06-10T00:25:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a6410640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00b2bf0 0x7fd2a0145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a6410640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b3b40 0x7fd2a009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a6410640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2a00d0560 0x7fd2a009b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a6410640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a015d3f0 con 0x7fd2a00b3b40 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a6410640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a015d110 con 0x7fd2a00d0560 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a6410640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a00b3f20 con 0x7fd2a00b2bf0 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b3b40 0x7fd2a009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b3b40 0x7fd2a009aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49960/0 (socket says 172.21.15.79:49960) 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 -- 172.21.15.79:0/2760900245 learned_addr learned my addr 172.21.15.79:0/2760900245 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29ffff640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00b2bf0 0x7fd2a0145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a49ad640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2a00d0560 0x7fd2a009b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 -- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00b2bf0 msgr2=0x7fd2a0145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00b2bf0 0x7fd2a0145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 -- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2a00d0560 msgr2=0x7fd2a009b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2a00d0560 0x7fd2a009b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 -- 172.21.15.79:0/2760900245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a01f2dd0 con 0x7fd2a00b3b40 2024-06-10T00:25:19.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29ffff640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00b2bf0 0x7fd2a0145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29f7fe640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b3b40 0x7fd2a009aa10 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fd294000c00 tx=0x7fd2940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29cff9640 1 -- 172.21.15.79:0/2760900245 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294037040 con 0x7fd2a00b3b40 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29cff9640 1 -- 172.21.15.79:0/2760900245 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd294042070 con 0x7fd2a00b3b40 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a01f2250 con 0x7fd2a00b3b40 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd29cff9640 1 -- 172.21.15.79:0/2760900245 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294030bb0 con 0x7fd2a00b3b40 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.621+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a01f2810 con 0x7fd2a00b3b40 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.622+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a00683c0 con 0x7fd2a00b3b40 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.623+0000 7fd29cff9640 1 -- 172.21.15.79:0/2760900245 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd294047460 con 0x7fd2a00b3b40 2024-06-10T00:25:19.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.623+0000 7fd29cff9640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd28c06be30 0x7fd28c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.623+0000 7fd29cff9640 1 -- 172.21.15.79:0/2760900245 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fd2940aba30 con 0x7fd2a00b3b40 2024-06-10T00:25:19.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.623+0000 7fd29ffff640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd28c06be30 0x7fd28c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.624+0000 7fd29ffff640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd28c06be30 0x7fd28c06e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0159340 tx=0x7fd290009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:19.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.628+0000 7fd29cff9640 1 -- 172.21.15.79:0/2760900245 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd294045360 con 0x7fd2a00b3b40 2024-06-10T00:25:19.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.806+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd2a00ce3a0 con 0x7fd2a00b3b40 2024-06-10T00:25:19.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.809+0000 7fd29cff9640 1 -- 172.21.15.79:0/2760900245 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7fd29407a4a0 con 0x7fd2a00b3b40 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd28c06be30 msgr2=0x7fd28c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd28c06be30 0x7fd28c06e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0159340 tx=0x7fd290009040 comp rx=0 tx=0).stop 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b3b40 msgr2=0x7fd2a009aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b3b40 0x7fd2a009aa10 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fd294000c00 tx=0x7fd2940046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 shutdown_connections 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd28c06be30 0x7fd28c06e2f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2a00d0560 0x7fd2a009b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a00b3b40 0x7fd2a009aa10 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 --2- 172.21.15.79:0/2760900245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2a00b2bf0 0x7fd2a0145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 >> 172.21.15.79:0/2760900245 conn(0x7fd2a00b1d10 msgr2=0x7fd2a00cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 shutdown_connections 2024-06-10T00:25:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.811+0000 7fd2a6410640 1 -- 172.21.15.79:0/2760900245 wait complete. 2024-06-10T00:25:19.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-06-10T00:25:19.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.922+0000 7fc99d55a640 1 Processor -- start 2024-06-10T00:25:19.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.922+0000 7fc99d55a640 1 -- start start 2024-06-10T00:25:19.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc99d55a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc99815f1a0 0x7fc9980d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc99d55a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99815f5e0 con 0x7fc9980d2680 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc99d55a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9980d0ad0 con 0x7fc9980cef70 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc99d55a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc9980d13e0 con 0x7fc99815f1a0 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc98ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc99815f1a0 0x7fc9980d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc996ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc9980d2680 0x7fc9980d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44764/0 (socket says 172.21.15.79:44764) 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc996ffd640 1 -- 172.21.15.79:0/4176831655 learned_addr learned my addr 172.21.15.79:0/4176831655 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc98ffff640 1 -- 172.21.15.79:0/4176831655 >> v1:172.21.15.117:6789/0 conn(0x7fc9980cef70 legacy=0x7fc9980cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc98ffff640 1 -- 172.21.15.79:0/4176831655 >> v1:172.21.15.79:6789/0 conn(0x7fc9980d2680 legacy=0x7fc9980d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.923+0000 7fc98ffff640 1 -- 172.21.15.79:0/4176831655 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99815f890 con 0x7fc99815f1a0 2024-06-10T00:25:19.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc98ffff640 1 --2- 172.21.15.79:0/4176831655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99815f1a0 0x7fc9980d1fc0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc9800097a0 tx=0x7fc98002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7105c6aea05c0d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:19.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc9967fc640 1 -- 172.21.15.79:0/4176831655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980037070 con 0x7fc99815f1a0 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc9967fc640 1 -- 172.21.15.79:0/4176831655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc980032440 con 0x7fc99815f1a0 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc9967fc640 1 -- 172.21.15.79:0/4176831655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980032810 con 0x7fc99815f1a0 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc99d55a640 1 -- 172.21.15.79:0/4176831655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99815f1a0 msgr2=0x7fc9980d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc99d55a640 1 --2- 172.21.15.79:0/4176831655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99815f1a0 0x7fc9980d1fc0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc9800097a0 tx=0x7fc98002a1e0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc99d55a640 1 -- 172.21.15.79:0/4176831655 shutdown_connections 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc99d55a640 1 --2- 172.21.15.79:0/4176831655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc99815f1a0 0x7fc9980d1fc0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.924+0000 7fc99d55a640 1 -- 172.21.15.79:0/4176831655 >> 172.21.15.79:0/4176831655 conn(0x7fc99809d3f0 msgr2=0x7fc9980d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.925+0000 7fc99d55a640 1 -- 172.21.15.79:0/4176831655 shutdown_connections 2024-06-10T00:25:19.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.925+0000 7fc99d55a640 1 -- 172.21.15.79:0/4176831655 wait complete. 2024-06-10T00:25:19.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc99d55a640 1 Processor -- start 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc99d55a640 1 -- start start 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc99d55a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9980cef70 0x7fc9980b9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc99d55a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9980d2680 0x7fc99814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc99d55a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc99815f1a0 0x7fc99815c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc99d55a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980d4f00 con 0x7fc9980cef70 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc99d55a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980d1070 con 0x7fc9980d2680 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc99d55a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc9980d1870 con 0x7fc99815f1a0 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.926+0000 7fc996ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9980cef70 0x7fc9980b9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc996ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9980cef70 0x7fc9980b9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49986/0 (socket says 172.21.15.79:49986) 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc996ffd640 1 -- 172.21.15.79:0/780449257 learned_addr learned my addr 172.21.15.79:0/780449257 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc98ffff640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9980d2680 0x7fc99814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc9977fe640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc99815f1a0 0x7fc99815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc996ffd640 1 -- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc99815f1a0 msgr2=0x7fc99815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc996ffd640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc99815f1a0 0x7fc99815c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc996ffd640 1 -- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9980d2680 msgr2=0x7fc99814bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc996ffd640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9980d2680 0x7fc99814bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc996ffd640 1 -- 172.21.15.79:0/780449257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99814a160 con 0x7fc9980cef70 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc98ffff640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9980d2680 0x7fc99814bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc9977fe640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc99815f1a0 0x7fc99815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc996ffd640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9980cef70 0x7fc9980b9440 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fc98800c400 tx=0x7fc98800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc98f7fe640 1 -- 172.21.15.79:0/780449257 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988017070 con 0x7fc9980cef70 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc98f7fe640 1 -- 172.21.15.79:0/780449257 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc988005ce0 con 0x7fc9980cef70 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99814a440 con 0x7fc9980cef70 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc98f7fe640 1 -- 172.21.15.79:0/780449257 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9880072f0 con 0x7fc9980cef70 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.927+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99814ace0 con 0x7fc9980cef70 2024-06-10T00:25:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.928+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99814a610 con 0x7fc9980cef70 2024-06-10T00:25:19.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.929+0000 7fc98f7fe640 1 -- 172.21.15.79:0/780449257 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc98801a070 con 0x7fc9980cef70 2024-06-10T00:25:19.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.929+0000 7fc98f7fe640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97806be30 0x7fc97806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:19.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.929+0000 7fc98f7fe640 1 -- 172.21.15.79:0/780449257 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fc98808a1d0 con 0x7fc9980cef70 2024-06-10T00:25:19.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.929+0000 7fc98ffff640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97806be30 0x7fc97806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:19.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.930+0000 7fc98ffff640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97806be30 0x7fc97806e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc980034000 tx=0x7fc98002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:19.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:19.933+0000 7fc98f7fe640 1 -- 172.21.15.79:0/780449257 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc988058c40 con 0x7fc9980cef70 2024-06-10T00:25:20.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.173+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7fc998068430 con 0x7fc9980cef70 2024-06-10T00:25:20.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.492+0000 7fc98f7fe640 1 -- 172.21.15.79:0/780449257 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v480) ==== 144+0+0 (secure 0 0 0) 0x7fc988058540 con 0x7fc9980cef70 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97806be30 msgr2=0x7fc97806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97806be30 0x7fc97806e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc980034000 tx=0x7fc98002e000 comp rx=0 tx=0).stop 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9980cef70 msgr2=0x7fc9980b9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9980cef70 0x7fc9980b9440 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fc98800c400 tx=0x7fc98800c8c0 comp rx=0 tx=0).stop 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 shutdown_connections 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fc97806be30 0x7fc97806e2f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc99815f1a0 0x7fc99815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9980d2680 0x7fc99814bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 --2- 172.21.15.79:0/780449257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9980cef70 0x7fc9980b9440 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 >> 172.21.15.79:0/780449257 conn(0x7fc99809d3f0 msgr2=0x7fc9981611d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 shutdown_connections 2024-06-10T00:25:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:20.494+0000 7fc99d55a640 1 -- 172.21.15.79:0/780449257 wait complete. 2024-06-10T00:25:20.505 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-06-10T00:25:20.505 INFO:tasks.cephfs_test_runner: 2024-06-10T00:25:20.505 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-10T00:25:20.505 INFO:tasks.cephfs_test_runner:Ran 7 tests in 602.360s 2024-06-10T00:25:20.505 INFO:tasks.cephfs_test_runner: 2024-06-10T00:25:20.505 INFO:tasks.cephfs_test_runner:OK 2024-06-10T00:25:20.506 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-06-10T00:25:20.516 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-06-10T00:25:20.543 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-06-10T00:25:20.543 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:25:20.543 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:25:20.559 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:25:20.559 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-10T00:25:20.559 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:25:20.615 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16729 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-10T00:25:20.615 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:25:20.615 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:25:20.635 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:25:20.635 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-06-10T00:25:20.635 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-10T00:25:20.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056331,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-10T00:25:20.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:20.693 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-06-10T00:25:20.708 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-10T00:25:20.708 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-10T00:25:20.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:20.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-10T00:25:20.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:20.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-10T00:25:20.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:20.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-06-10T00:25:20.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:20.936 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-06-10T00:25:20.955 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-06-10T00:25:20.955 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-10T00:25:20.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:20.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-10T00:25:21.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:21.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-10T00:25:21.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-10T00:25:21.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-06-10T00:25:21.197 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-06-10T00:25:21.207 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-10T00:25:21.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:25:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.310+0000 7fbc99409640 1 Processor -- start 2024-06-10T00:25:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.310+0000 7fbc99409640 1 -- start start 2024-06-10T00:25:21.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.311+0000 7fbc99409640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc940cc6d0 0x7fbc940ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.311+0000 7fbc99409640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc940ccff0 con 0x7fbc940720e0 2024-06-10T00:25:21.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.311+0000 7fbc99409640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc94072550 con 0x7fbc94071c60 2024-06-10T00:25:21.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.311+0000 7fbc99409640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc94072820 con 0x7fbc940cc6d0 2024-06-10T00:25:21.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.311+0000 7fbc937fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbc940720e0 0x7fbc940b3dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44768/0 (socket says 172.21.15.79:44768) 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.311+0000 7fbc937fe640 1 -- 172.21.15.79:0/1675012714 learned_addr learned my addr 172.21.15.79:0/1675012714 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc92ffd640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc940cc6d0 0x7fbc940ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1019896114 0 0) 0x7fbc940ccff0 con 0x7fbc940720e0 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc7c003520 con 0x7fbc940720e0 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2420153854 0 0) 0x7fbc7c003520 con 0x7fbc940720e0 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc940cc6d0 msgr2=0x7fbc940ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc940cc6d0 0x7fbc940ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 >> v1:172.21.15.117:6789/0 conn(0x7fbc94071c60 legacy=0x7fbc940b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc94072b00 con 0x7fbc940720e0 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fbc8c001670 con 0x7fbc940720e0 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 >> v1:172.21.15.79:6789/0 conn(0x7fbc940720e0 legacy=0x7fbc940b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c0039e0 0x7fbc7c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc940cc6d0 0x7fbc7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c004d40 0x7fbc7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94072820 con 0x7fbc7c0039e0 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c00ba70 con 0x7fbc7c004d40 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc7c00bc70 con 0x7fbc940cc6d0 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc92ffd640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c0039e0 0x7fbc7c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc937fe640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c004d40 0x7fbc7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc927fc640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc940cc6d0 0x7fbc7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc92ffd640 1 -- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc940cc6d0 msgr2=0x7fbc7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc92ffd640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc940cc6d0 0x7fbc7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc92ffd640 1 -- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c004d40 msgr2=0x7fbc7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc92ffd640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c004d40 0x7fbc7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc92ffd640 1 -- 172.21.15.79:0/1675012714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7c003520 con 0x7fbc7c0039e0 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.312+0000 7fbc937fe640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c004d40 0x7fbc7c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc92ffd640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c0039e0 0x7fbc7c003e00 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009f90 tx=0x7fbc7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61bed8b6ea4db68 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84009c10 con 0x7fbc7c0039e0 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc84036070 con 0x7fbc7c0039e0 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc91ffb640 1 -- 172.21.15.79:0/1675012714 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84031850 con 0x7fbc7c0039e0 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc99409640 1 -- 172.21.15.79:0/1675012714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c0039e0 msgr2=0x7fbc7c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc99409640 1 --2- 172.21.15.79:0/1675012714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c0039e0 0x7fbc7c003e00 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009f90 tx=0x7fbc7c005830 comp rx=0 tx=0).stop 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc937fe640 1 -- 172.21.15.79:0/1675012714 reap_dead start 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc99409640 1 -- 172.21.15.79:0/1675012714 shutdown_connections 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc99409640 1 -- 172.21.15.79:0/1675012714 >> 172.21.15.79:0/1675012714 conn(0x7fbc940b19f0 msgr2=0x7fbc940b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.313+0000 7fbc99409640 1 -- 172.21.15.79:0/1675012714 shutdown_connections 2024-06-10T00:25:21.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.314+0000 7fbc99409640 1 -- 172.21.15.79:0/1675012714 wait complete. 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.315+0000 7fbc99409640 1 Processor -- start 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.315+0000 7fbc99409640 1 -- start start 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc99409640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c0039e0 0x7fbc94145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc99409640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94158910 0x7fbc940cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc99409640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94155eb0 0x7fbc94156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc99409640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9415c890 con 0x7fbc94158910 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc99409640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc940b31a0 con 0x7fbc7c0039e0 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc99409640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc94159f60 con 0x7fbc94155eb0 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94158910 0x7fbc940cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94158910 0x7fbc940cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49996/0 (socket says 172.21.15.79:49996) 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 -- 172.21.15.79:0/4166907549 learned_addr learned my addr 172.21.15.79:0/4166907549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc937fe640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94155eb0 0x7fbc94156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc92ffd640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c0039e0 0x7fbc94145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 -- 172.21.15.79:0/4166907549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94155eb0 msgr2=0x7fbc94156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94155eb0 0x7fbc94156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 -- 172.21.15.79:0/4166907549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c0039e0 msgr2=0x7fbc94145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c0039e0 0x7fbc94145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 -- 172.21.15.79:0/4166907549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc94158ff0 con 0x7fbc94158910 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc927fc640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94158910 0x7fbc940cf840 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800e550 tx=0x7fbc8800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc7b7fe640 1 -- 172.21.15.79:0/4166907549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880052e0 con 0x7fbc94158910 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc7b7fe640 1 -- 172.21.15.79:0/4166907549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc88018070 con 0x7fbc94158910 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc7b7fe640 1 -- 172.21.15.79:0/4166907549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88003810 con 0x7fbc94158910 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc941592d0 con 0x7fbc94158910 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.316+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc941477b0 con 0x7fbc94158910 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.317+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc940732a0 con 0x7fbc94158910 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.318+0000 7fbc7b7fe640 1 -- 172.21.15.79:0/4166907549 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc880039b0 con 0x7fbc94158910 2024-06-10T00:25:21.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.318+0000 7fbc7b7fe640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc8006be30 0x7fbc8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.318+0000 7fbc7b7fe640 1 -- 172.21.15.79:0/4166907549 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fbc8808aa00 con 0x7fbc94158910 2024-06-10T00:25:21.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.318+0000 7fbc92ffd640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc8006be30 0x7fbc8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.319+0000 7fbc92ffd640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc8006be30 0x7fbc8006e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbc84035000 tx=0x7fbc8402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.323+0000 7fbc7b7fe640 1 -- 172.21.15.79:0/4166907549 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc940732a0 con 0x7fbc94158910 2024-06-10T00:25:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.493+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc941597f0 con 0x7fbc8006be30 2024-06-10T00:25:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.494+0000 7fbc7b7fe640 1 -- 172.21.15.79:0/4166907549 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13516 (secure 0 0 0) 0x7fbc941597f0 con 0x7fbc8006be30 2024-06-10T00:25:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:25:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc8006be30 msgr2=0x7fbc8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc8006be30 0x7fbc8006e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbc84035000 tx=0x7fbc8402f000 comp rx=0 tx=0).stop 2024-06-10T00:25:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94158910 msgr2=0x7fbc940cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94158910 0x7fbc940cf840 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800e550 tx=0x7fbc8800ea10 comp rx=0 tx=0).stop 2024-06-10T00:25:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 shutdown_connections 2024-06-10T00:25:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc8006be30 0x7fbc8006e2f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94155eb0 0x7fbc94156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94158910 0x7fbc940cf840 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 --2- 172.21.15.79:0/4166907549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7c0039e0 0x7fbc94145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 >> 172.21.15.79:0/4166907549 conn(0x7fbc940b19f0 msgr2=0x7fbc9415ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 shutdown_connections 2024-06-10T00:25:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.496+0000 7fbc99409640 1 -- 172.21.15.79:0/4166907549 wait complete. 2024-06-10T00:25:21.507 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-06-10T00:25:21.292908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262740,"kb_used_data":13276,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711980,"statfs":{"total":773094113280,"available":772825067520,"internally_reserved":0,"allocated":13594624,"data_stored":6973364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390143,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-249,"num_read_kb":-254,"num_write":-169,"num_write_kb":-8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":362,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-06-10T00:25:19.989102+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:25:19.989102+0000","last_peered":"2024-06-10T00:25:19.989102+0000","last_clean":"2024-06-10T00:25:19.989102+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:25:19.989102+0000","last_undegraded":"2024-06-10T00:25:19.989102+0000","last_fullsized":"2024-06-10T00:25:19.989102+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":718720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:25:21.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:25:21.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.607+0000 7f3723ca7640 1 Processor -- start 2024-06-10T00:25:21.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.608+0000 7f3723ca7640 1 -- start start 2024-06-10T00:25:21.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.608+0000 7f3723ca7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f371c15f1a0 0x7f371c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.608+0000 7f3723ca7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f371c0cef70 0x7f371c0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.608+0000 7f3723ca7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371c15f5e0 con 0x7f371c0d2680 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.608+0000 7f3723ca7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f371c0d13e0 con 0x7f371c0cef70 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.608+0000 7f3723ca7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f371c0d0ad0 con 0x7f371c15f1a0 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3722244640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f371c0cef70 0x7f371c0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3721a43640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f371c0d2680 0x7f371c0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44778/0 (socket says 172.21.15.79:44778) 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3721a43640 1 -- 172.21.15.79:0/2741213855 learned_addr learned my addr 172.21.15.79:0/2741213855 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3721242640 1 --2- 172.21.15.79:0/2741213855 >> v2:172.21.15.117:3300/0 conn(0x7f371c15f1a0 0x7f371c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3722244640 1 -- 172.21.15.79:0/2741213855 >> v2:172.21.15.117:3300/0 conn(0x7f371c15f1a0 msgr2=0x7f371c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3722244640 1 --2- 172.21.15.79:0/2741213855 >> v2:172.21.15.117:3300/0 conn(0x7f371c15f1a0 0x7f371c0d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3722244640 1 -- 172.21.15.79:0/2741213855 >> v1:172.21.15.79:6789/0 conn(0x7f371c0d2680 legacy=0x7f371c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3720a41640 1 -- 172.21.15.79:0/2741213855 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479131893 0 0) 0x7f371c15f5e0 con 0x7f371c0d2680 2024-06-10T00:25:21.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.609+0000 7f3722244640 1 -- 172.21.15.79:0/2741213855 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c15f890 con 0x7f371c0cef70 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3722244640 1 --2- 172.21.15.79:0/2741213855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c0cef70 0x7f371c0cf3c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f371c0d1560 tx=0x7f371402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab172bc4503e97 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3720a41640 1 -- 172.21.15.79:0/2741213855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714007740 con 0x7f371c0cef70 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3720a41640 1 -- 172.21.15.79:0/2741213855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37140078e0 con 0x7f371c0cef70 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3720a41640 1 -- 172.21.15.79:0/2741213855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714007cb0 con 0x7f371c0cef70 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3723ca7640 1 -- 172.21.15.79:0/2741213855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c0cef70 msgr2=0x7f371c0cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3723ca7640 1 --2- 172.21.15.79:0/2741213855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c0cef70 0x7f371c0cf3c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f371c0d1560 tx=0x7f371402a660 comp rx=0 tx=0).stop 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3723ca7640 1 -- 172.21.15.79:0/2741213855 shutdown_connections 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3723ca7640 1 --2- 172.21.15.79:0/2741213855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c0cef70 0x7f371c0cf3c0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3723ca7640 1 --2- 172.21.15.79:0/2741213855 >> v2:172.21.15.117:3300/0 conn(0x7f371c15f1a0 0x7f371c0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3723ca7640 1 -- 172.21.15.79:0/2741213855 >> 172.21.15.79:0/2741213855 conn(0x7f371c09d3f0 msgr2=0x7f371c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:21.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3723ca7640 1 -- 172.21.15.79:0/2741213855 shutdown_connections 2024-06-10T00:25:21.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.610+0000 7f3723ca7640 1 -- 172.21.15.79:0/2741213855 wait complete. 2024-06-10T00:25:21.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.611+0000 7f3723ca7640 1 Processor -- start 2024-06-10T00:25:21.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3723ca7640 1 -- start start 2024-06-10T00:25:21.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3723ca7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f371c0cef70 0x7f371c159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3723ca7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f371c0d2680 0x7f371c0a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3723ca7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c15f1a0 0x7f371c09de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3723ca7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f371c0d4f00 con 0x7f371c15f1a0 2024-06-10T00:25:21.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3723ca7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f371c0d1070 con 0x7f371c0cef70 2024-06-10T00:25:21.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3723ca7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f371c0d1870 con 0x7f371c0d2680 2024-06-10T00:25:21.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3722244640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c15f1a0 0x7f371c09de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3722244640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c15f1a0 0x7f371c09de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50020/0 (socket says 172.21.15.79:50020) 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.612+0000 7f3722244640 1 -- 172.21.15.79:0/3915994074 learned_addr learned my addr 172.21.15.79:0/3915994074 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3721242640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f371c0d2680 0x7f371c0a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3721a43640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f371c0cef70 0x7f371c159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3722244640 1 -- 172.21.15.79:0/3915994074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f371c0d2680 msgr2=0x7f371c0a0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3722244640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f371c0d2680 0x7f371c0a0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3722244640 1 -- 172.21.15.79:0/3915994074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f371c0cef70 msgr2=0x7f371c159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3722244640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f371c0cef70 0x7f371c159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3722244640 1 -- 172.21.15.79:0/3915994074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c15e0f0 con 0x7f371c15f1a0 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3722244640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c15f1a0 0x7f371c09de60 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f371402ac50 tx=0x7f3714004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f37127fc640 1 -- 172.21.15.79:0/3915994074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371403f070 con 0x7f371c15f1a0 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f37127fc640 1 -- 172.21.15.79:0/3915994074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3714031bc0 con 0x7f371c15f1a0 2024-06-10T00:25:21.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c15e3d0 con 0x7f371c15f1a0 2024-06-10T00:25:21.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f37127fc640 1 -- 172.21.15.79:0/3915994074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714044460 con 0x7f371c15f1a0 2024-06-10T00:25:21.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.613+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c15b440 con 0x7f371c15f1a0 2024-06-10T00:25:21.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.614+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c15e8f0 con 0x7f371c15f1a0 2024-06-10T00:25:21.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.614+0000 7f37127fc640 1 -- 172.21.15.79:0/3915994074 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3714007790 con 0x7f371c15f1a0 2024-06-10T00:25:21.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.615+0000 7f37127fc640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f370006be30 0x7f370006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.615+0000 7f37127fc640 1 -- 172.21.15.79:0/3915994074 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f37140ac510 con 0x7f371c15f1a0 2024-06-10T00:25:21.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.615+0000 7f3721a43640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f370006be30 0x7f370006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.616+0000 7f3721a43640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f370006be30 0x7f370006e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3718007fd0 tx=0x7f3718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.619+0000 7f37127fc640 1 -- 172.21.15.79:0/3915994074 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f371407b010 con 0x7f371c15f1a0 2024-06-10T00:25:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.793+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f371c068430 con 0x7f370006be30 2024-06-10T00:25:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.794+0000 7f37127fc640 1 -- 172.21.15.79:0/3915994074 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13516 (secure 0 0 0) 0x7f371c068430 con 0x7f370006be30 2024-06-10T00:25:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:21.794 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:25:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f370006be30 msgr2=0x7f370006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f370006be30 0x7f370006e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3718007fd0 tx=0x7f3718009040 comp rx=0 tx=0).stop 2024-06-10T00:25:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c15f1a0 msgr2=0x7f371c09de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c15f1a0 0x7f371c09de60 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f371402ac50 tx=0x7f3714004a40 comp rx=0 tx=0).stop 2024-06-10T00:25:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 shutdown_connections 2024-06-10T00:25:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f370006be30 0x7f370006e2f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f371c15f1a0 0x7f371c09de60 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f371c0d2680 0x7f371c0a0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 --2- 172.21.15.79:0/3915994074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f371c0cef70 0x7f371c159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 >> 172.21.15.79:0/3915994074 conn(0x7f371c09d3f0 msgr2=0x7f371c0c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 shutdown_connections 2024-06-10T00:25:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.796+0000 7f3723ca7640 1 -- 172.21.15.79:0/3915994074 wait complete. 2024-06-10T00:25:21.807 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-06-10T00:25:21.292908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262740,"kb_used_data":13276,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711980,"statfs":{"total":773094113280,"available":772825067520,"internally_reserved":0,"allocated":13594624,"data_stored":6973364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390143,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-249,"num_read_kb":-254,"num_write":-169,"num_write_kb":-8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":362,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-06-10T00:25:19.989102+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:25:19.989102+0000","last_peered":"2024-06-10T00:25:19.989102+0000","last_clean":"2024-06-10T00:25:19.989102+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:25:19.989102+0000","last_undegraded":"2024-06-10T00:25:19.989102+0000","last_fullsized":"2024-06-10T00:25:19.989102+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":718720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:25:21.807 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-10T00:25:21.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:25:21.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.907+0000 7f307a25d640 1 Processor -- start 2024-06-10T00:25:21.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.907+0000 7f307a25d640 1 -- start start 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.907+0000 7f307a25d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3074156830 0x7f3074071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f307a25d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30740725f0 con 0x7f3074072130 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f307a25d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30740728d0 con 0x7f307415c7f0 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f307a25d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30740b3090 con 0x7f3074156830 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f3072ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3074072130 0x7f30740cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44790/0 (socket says 172.21.15.79:44790) 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f3072ffd640 1 -- 172.21.15.79:0/1458229105 learned_addr learned my addr 172.21.15.79:0/1458229105 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864650421 0 0) 0x7f30740725f0 con 0x7f3074072130 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f305c003520 con 0x7f3074072130 2024-06-10T00:25:21.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30737fe640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3074156830 0x7f3074071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3107106368 0 0) 0x7f305c003520 con 0x7f3074072130 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3074156830 msgr2=0x7f3074071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3074156830 0x7f3074071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 >> v1:172.21.15.117:6789/0 conn(0x7f307415c7f0 legacy=0x7f3074165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3074072bb0 con 0x7f3074072130 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f3068001670 con 0x7f3074072130 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 >> v1:172.21.15.79:6789/0 conn(0x7f3074072130 legacy=0x7f30740cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c0039e0 0x7f305c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3074156830 0x7f305c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f305c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30740b3090 con 0x7f305c004d40 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f305c00bb50 con 0x7f305c0039e0 2024-06-10T00:25:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f305c00bd20 con 0x7f3074156830 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f3073fff640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f305c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f3072ffd640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3074156830 0x7f305c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.908+0000 7f30737fe640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c0039e0 0x7f305c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f3073fff640 1 -- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3074156830 msgr2=0x7f305c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f3073fff640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3074156830 0x7f305c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f3073fff640 1 -- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c0039e0 msgr2=0x7f305c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f3073fff640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c0039e0 0x7f305c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f3073fff640 1 -- 172.21.15.79:0/1458229105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c003520 con 0x7f305c004d40 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f3073fff640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f305c0051c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f306c001e50 tx=0x7f305c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607b5b0c83416253 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c001a70 con 0x7f305c004d40 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c02ae30 con 0x7f305c004d40 2024-06-10T00:25:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.909+0000 7f30727fc640 1 -- 172.21.15.79:0/1458229105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c003b90 con 0x7f305c004d40 2024-06-10T00:25:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.910+0000 7f307a25d640 1 -- 172.21.15.79:0/1458229105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 msgr2=0x7f305c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.910+0000 7f307a25d640 1 --2- 172.21.15.79:0/1458229105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f305c0051c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f306c001e50 tx=0x7f305c005830 comp rx=0 tx=0).stop 2024-06-10T00:25:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.910+0000 7f3073fff640 1 -- 172.21.15.79:0/1458229105 reap_dead start 2024-06-10T00:25:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.910+0000 7f307a25d640 1 -- 172.21.15.79:0/1458229105 shutdown_connections 2024-06-10T00:25:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.910+0000 7f307a25d640 1 -- 172.21.15.79:0/1458229105 >> 172.21.15.79:0/1458229105 conn(0x7f30740b19f0 msgr2=0x7f30740b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.910+0000 7f307a25d640 1 -- 172.21.15.79:0/1458229105 shutdown_connections 2024-06-10T00:25:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.910+0000 7f307a25d640 1 -- 172.21.15.79:0/1458229105 wait complete. 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.911+0000 7f307a25d640 1 Processor -- start 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.911+0000 7f307a25d640 1 -- start start 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f307a25d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f30741f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f307a25d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f307406e8a0 0x7f30740cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f307a25d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307414f520 0x7f307414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f307a25d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30740ccf00 con 0x7f305c004d40 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f307a25d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30740ccd80 con 0x7f307414f520 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f307a25d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30740cd080 con 0x7f307406e8a0 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f30737fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f30741f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f30737fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f30741f4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50040/0 (socket says 172.21.15.79:50040) 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f30737fe640 1 -- 172.21.15.79:0/3019450904 learned_addr learned my addr 172.21.15.79:0/3019450904 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f3073fff640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307414f520 0x7f307414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f30737fe640 1 -- 172.21.15.79:0/3019450904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f307406e8a0 msgr2=0x7f30740cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f30737fe640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f307406e8a0 0x7f30740cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f30737fe640 1 -- 172.21.15.79:0/3019450904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307414f520 msgr2=0x7f307414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.912+0000 7f30737fe640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307414f520 0x7f307414f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.913+0000 7f30737fe640 1 -- 172.21.15.79:0/3019450904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307406ce50 con 0x7f305c004d40 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.913+0000 7f30737fe640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f30741f4070 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f306400b7f0 tx=0x7f306400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.913+0000 7f305bfff640 1 -- 172.21.15.79:0/3019450904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064018070 con 0x7f305c004d40 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.913+0000 7f305bfff640 1 -- 172.21.15.79:0/3019450904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3064010830 con 0x7f305c004d40 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.913+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30741f4910 con 0x7f305c004d40 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.913+0000 7f305bfff640 1 -- 172.21.15.79:0/3019450904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064010c00 con 0x7f305c004d40 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.913+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307406d0c0 con 0x7f305c004d40 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.914+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3074068430 con 0x7f305c004d40 2024-06-10T00:25:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.914+0000 7f305bfff640 1 -- 172.21.15.79:0/3019450904 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f306401b070 con 0x7f305c004d40 2024-06-10T00:25:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.915+0000 7f305bfff640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f306006be60 0x7f306006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.915+0000 7f3072ffd640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f306006be60 0x7f306006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.915+0000 7f305bfff640 1 -- 172.21.15.79:0/3019450904 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f306408b3c0 con 0x7f305c004d40 2024-06-10T00:25:21.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.915+0000 7f3072ffd640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f306006be60 0x7f306006e320 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f30680011e0 tx=0x7f3068001be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:21.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:21.919+0000 7f305bfff640 1 -- 172.21.15.79:0/3019450904 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3064059e30 con 0x7f305c004d40 2024-06-10T00:25:22.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.092+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30740b27f0 con 0x7f306006be60 2024-06-10T00:25:22.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.093+0000 7f305bfff640 1 -- 172.21.15.79:0/3019450904 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13516 (secure 0 0 0) 0x7f30740b27f0 con 0x7f306006be60 2024-06-10T00:25:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:22.092 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:25:22.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f306006be60 msgr2=0x7f306006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:22.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f306006be60 0x7f306006e320 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f30680011e0 tx=0x7f3068001be0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 msgr2=0x7f30741f4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f30741f4070 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f306400b7f0 tx=0x7f306400bcb0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 shutdown_connections 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f306006be60 0x7f306006e320 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f307414f520 0x7f307414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f307406e8a0 0x7f30740cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 --2- 172.21.15.79:0/3019450904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f305c004d40 0x7f30741f4070 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.094+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 >> 172.21.15.79:0/3019450904 conn(0x7f30740b19f0 msgr2=0x7f307415cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.095+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 shutdown_connections 2024-06-10T00:25:22.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.095+0000 7f307a25d640 1 -- 172.21.15.79:0/3019450904 wait complete. 2024-06-10T00:25:22.105 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-06-10T00:25:21.292908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262740,"kb_used_data":13276,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711980,"statfs":{"total":773094113280,"available":772825067520,"internally_reserved":0,"allocated":13594624,"data_stored":6973364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390143,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-249,"num_read_kb":-254,"num_write":-169,"num_write_kb":-8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":362,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-06-10T00:25:19.989102+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:25:19.989102+0000","last_peered":"2024-06-10T00:25:19.989102+0000","last_clean":"2024-06-10T00:25:19.989102+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:25:19.989102+0000","last_undegraded":"2024-06-10T00:25:19.989102+0000","last_fullsized":"2024-06-10T00:25:19.989102+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":718720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:25:22.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-10T00:25:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.207+0000 7f9b88c76640 1 Processor -- start 2024-06-10T00:25:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.207+0000 7f9b88c76640 1 -- start start 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.208+0000 7f9b88c76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b840d2680 0x7f9b8415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.208+0000 7f9b88c76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b840cef70 0x7f9b840cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.208+0000 7f9b88c76640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b840d0ad0 con 0x7f9b840d1fc0 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.208+0000 7f9b88c76640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9b840d13e0 con 0x7f9b840cef70 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.208+0000 7f9b88c76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9b8415f890 con 0x7f9b840d2680 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.208+0000 7f9b81d9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9b840d1fc0 0x7f9b840d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44806/0 (socket says 172.21.15.79:44806) 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.208+0000 7f9b81d9b640 1 -- 172.21.15.79:0/627626170 learned_addr learned my addr 172.21.15.79:0/627626170 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673693260 0 0) 0x7f9b840d0ad0 con 0x7f9b840d1fc0 2024-06-10T00:25:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b82d9d640 1 --2- 172.21.15.79:0/627626170 >> v2:172.21.15.117:3300/0 conn(0x7f9b840cef70 0x7f9b840cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b6c003520 con 0x7f9b840d1fc0 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8259c640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b840d2680 0x7f9b8415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938884537 0 0) 0x7f9b6c003520 con 0x7f9b840d1fc0 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b840d2680 msgr2=0x7f9b8415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b840d2680 0x7f9b8415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 >> v2:172.21.15.117:3300/0 conn(0x7f9b840cef70 msgr2=0x7f9b840cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 --2- 172.21.15.79:0/627626170 >> v2:172.21.15.117:3300/0 conn(0x7f9b840cef70 0x7f9b840cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b840d0d90 con 0x7f9b840d1fc0 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f9b78001670 con 0x7f9b840d1fc0 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 >> v1:172.21.15.79:6789/0 conn(0x7f9b840d1fc0 legacy=0x7f9b840d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0039b0 0x7f9b6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b840d2680 0x7f9b6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b6c004d40 0x7f9b6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b840d13e0 con 0x7f9b6c004d40 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8415f890 con 0x7f9b6c0039b0 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6c00b9c0 con 0x7f9b840d2680 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b82d9d640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b6c004d40 0x7f9b6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b81d9b640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b840d2680 0x7f9b6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8259c640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0039b0 0x7f9b6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b82d9d640 1 -- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b840d2680 msgr2=0x7f9b6c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b82d9d640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b840d2680 0x7f9b6c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b82d9d640 1 -- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0039b0 msgr2=0x7f9b6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b82d9d640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0039b0 0x7f9b6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b82d9d640 1 -- 172.21.15.79:0/627626170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6c003520 con 0x7f9b6c004d40 2024-06-10T00:25:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.209+0000 7f9b8259c640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0039b0 0x7f9b6c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.210+0000 7f9b82d9d640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b6c004d40 0x7f9b6c0051c0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009fc0 tx=0x7f9b6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93de240c6aab3455 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.210+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c009c10 con 0x7f9b6c004d40 2024-06-10T00:25:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.210+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c036070 con 0x7f9b6c004d40 2024-06-10T00:25:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.210+0000 7f9b8159a640 1 -- 172.21.15.79:0/627626170 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c02d070 con 0x7f9b6c004d40 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.211+0000 7f9b88c76640 1 -- 172.21.15.79:0/627626170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b6c004d40 msgr2=0x7f9b6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.211+0000 7f9b88c76640 1 --2- 172.21.15.79:0/627626170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b6c004d40 0x7f9b6c0051c0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009fc0 tx=0x7f9b6c005830 comp rx=0 tx=0).stop 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.211+0000 7f9b82d9d640 1 -- 172.21.15.79:0/627626170 reap_dead start 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.211+0000 7f9b88c76640 1 -- 172.21.15.79:0/627626170 shutdown_connections 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.211+0000 7f9b88c76640 1 -- 172.21.15.79:0/627626170 >> 172.21.15.79:0/627626170 conn(0x7f9b8409d3f0 msgr2=0x7f9b840d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.211+0000 7f9b88c76640 1 -- 172.21.15.79:0/627626170 shutdown_connections 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.211+0000 7f9b88c76640 1 -- 172.21.15.79:0/627626170 wait complete. 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.212+0000 7f9b88c76640 1 Processor -- start 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.212+0000 7f9b88c76640 1 -- start start 2024-06-10T00:25:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b88c76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c004d40 0x7f9b840b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b88c76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b841f86a0 0x7f9b841f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b88c76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b841f49e0 0x7f9b8409fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b88c76640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b840d4f00 con 0x7f9b841f86a0 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b88c76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b840d2400 con 0x7f9b841f49e0 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b88c76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9b840d1870 con 0x7f9b6c004d40 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b81d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b841f86a0 0x7f9b841f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b81d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b841f86a0 0x7f9b841f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50060/0 (socket says 172.21.15.79:50060) 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b81d9b640 1 -- 172.21.15.79:0/3436911866 learned_addr learned my addr 172.21.15.79:0/3436911866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b82d9d640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b841f49e0 0x7f9b8409fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b8259c640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c004d40 0x7f9b840b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b81d9b640 1 -- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c004d40 msgr2=0x7f9b840b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b81d9b640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c004d40 0x7f9b840b93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b81d9b640 1 -- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b841f49e0 msgr2=0x7f9b8409fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b81d9b640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b841f49e0 0x7f9b8409fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b81d9b640 1 -- 172.21.15.79:0/3436911866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b841f4e60 con 0x7f9b841f86a0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b82d9d640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b841f49e0 0x7f9b8409fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.213+0000 7f9b8259c640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c004d40 0x7f9b840b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.214+0000 7f9b81d9b640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b841f86a0 0x7f9b841f44a0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f9b78007290 tx=0x7f9b78007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.214+0000 7f9b72ffd640 1 -- 172.21.15.79:0/3436911866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800f960 con 0x7f9b841f86a0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.214+0000 7f9b72ffd640 1 -- 172.21.15.79:0/3436911866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b78018070 con 0x7f9b841f86a0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.214+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b841f53b0 con 0x7f9b841f86a0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.214+0000 7f9b72ffd640 1 -- 172.21.15.79:0/3436911866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800fd60 con 0x7f9b841f86a0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.214+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841f7bc0 con 0x7f9b841f86a0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.215+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b84068430 con 0x7f9b841f86a0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.215+0000 7f9b72ffd640 1 -- 172.21.15.79:0/3436911866 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b7801d460 con 0x7f9b841f86a0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.216+0000 7f9b72ffd640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9b6406be60 0x7f9b6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.216+0000 7f9b8259c640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9b6406be60 0x7f9b6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.216+0000 7f9b72ffd640 1 -- 172.21.15.79:0/3436911866 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f9b7808ada0 con 0x7f9b841f86a0 2024-06-10T00:25:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.216+0000 7f9b8259c640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9b6406be60 0x7f9b6406e320 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9b8415df30 tx=0x7f9b74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.220+0000 7f9b72ffd640 1 -- 172.21.15.79:0/3436911866 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9b780598a0 con 0x7f9b841f86a0 2024-06-10T00:25:22.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.404+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b840d04e0 con 0x7f9b841f86a0 2024-06-10T00:25:22.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.405+0000 7f9b72ffd640 1 -- 172.21.15.79:0/3436911866 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+13513 (secure 0 0 0) 0x7f9b780591a0 con 0x7f9b841f86a0 2024-06-10T00:25:22.404 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:22.405 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":124,"fsid":"8b20248b-d94c-44bd-ba6f-faf8829473b3","created":"2024-06-10T00:14:18.985163+0000","modified":"2024-06-10T00:25:19.487339+0000","last_up_change":"2024-06-10T00:14:30.231320+0000","last_in_change":"2024-06-10T00:14:21.103656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-10T00:14:31.177808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fe5b02f-a366-4f2b-8196-055149f5c0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6825","nonce":709635793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6827","nonce":709635793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6831","nonce":709635793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":709635793},{"type":"v1","addr":"172.21.15.79:6829","nonce":709635793}]},"public_addr":"172.21.15.79:6825/709635793","cluster_addr":"172.21.15.79:6827/709635793","heartbeat_back_addr":"172.21.15.79:6831/709635793","heartbeat_front_addr":"172.21.15.79:6829/709635793","state":["exists","up"]},{"osd":1,"uuid":"657ccf9c-6301-4c19-b2a0-9660aa22bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6809","nonce":15559294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6811","nonce":15559294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6815","nonce":15559294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":15559294},{"type":"v1","addr":"172.21.15.79:6813","nonce":15559294}]},"public_addr":"172.21.15.79:6809/15559294","cluster_addr":"172.21.15.79:6811/15559294","heartbeat_back_addr":"172.21.15.79:6815/15559294","heartbeat_front_addr":"172.21.15.79:6813/15559294","state":["exists","up"]},{"osd":2,"uuid":"fd4c315a-bfb4-420b-8f2e-c7cc3ceb1e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6817","nonce":3079975341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6819","nonce":3079975341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6823","nonce":3079975341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3079975341},{"type":"v1","addr":"172.21.15.79:6821","nonce":3079975341}]},"public_addr":"172.21.15.79:6817/3079975341","cluster_addr":"172.21.15.79:6819/3079975341","heartbeat_back_addr":"172.21.15.79:6823/3079975341","heartbeat_front_addr":"172.21.15.79:6821/3079975341","state":["exists","up"]},{"osd":3,"uuid":"1a300340-c4e7-4a45-af4f-6c84fa0a2934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6801","nonce":4145020298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6803","nonce":4145020298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6807","nonce":4145020298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4145020298},{"type":"v1","addr":"172.21.15.79:6805","nonce":4145020298}]},"public_addr":"172.21.15.79:6801/4145020298","cluster_addr":"172.21.15.79:6803/4145020298","heartbeat_back_addr":"172.21.15.79:6807/4145020298","heartbeat_front_addr":"172.21.15.79:6805/4145020298","state":["exists","up"]},{"osd":4,"uuid":"c51cdf83-096e-4b8c-8000-a81ee31a407f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6825","nonce":279504764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6827","nonce":279504764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6831","nonce":279504764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":279504764},{"type":"v1","addr":"172.21.15.117:6829","nonce":279504764}]},"public_addr":"172.21.15.117:6825/279504764","cluster_addr":"172.21.15.117:6827/279504764","heartbeat_back_addr":"172.21.15.117:6831/279504764","heartbeat_front_addr":"172.21.15.117:6829/279504764","state":["exists","up"]},{"osd":5,"uuid":"8bf0f524-2442-40f4-80f8-cc4cf976d8d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6801","nonce":419453692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6803","nonce":419453692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6807","nonce":419453692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":419453692},{"type":"v1","addr":"172.21.15.117:6805","nonce":419453692}]},"public_addr":"172.21.15.117:6801/419453692","cluster_addr":"172.21.15.117:6803/419453692","heartbeat_back_addr":"172.21.15.117:6807/419453692","heartbeat_front_addr":"172.21.15.117:6805/419453692","state":["exists","up"]},{"osd":6,"uuid":"dd792ef1-cf04-4f23-9f81-803564887b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6809","nonce":1306883621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6811","nonce":1306883621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6815","nonce":1306883621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1306883621},{"type":"v1","addr":"172.21.15.117:6813","nonce":1306883621}]},"public_addr":"172.21.15.117:6809/1306883621","cluster_addr":"172.21.15.117:6811/1306883621","heartbeat_back_addr":"172.21.15.117:6815/1306883621","heartbeat_front_addr":"172.21.15.117:6813/1306883621","state":["exists","up"]},{"osd":7,"uuid":"83c1913b-a6fc-4c99-b879-498b586eebd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6817","nonce":2099086267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6819","nonce":2099086267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6823","nonce":2099086267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2099086267},{"type":"v1","addr":"172.21.15.117:6821","nonce":2099086267}]},"public_addr":"172.21.15.117:6817/2099086267","cluster_addr":"172.21.15.117:6819/2099086267","heartbeat_back_addr":"172.21.15.117:6823/2099086267","heartbeat_front_addr":"172.21.15.117:6821/2099086267","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.231467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.294045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.273523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.190192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.347426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.203117+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.275222+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-10T00:14:26.329154+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:6837/781838074":"2024-06-11T00:25:16.448629+0000","172.21.15.79:6835/781838074":"2024-06-11T00:25:16.448629+0000","172.21.15.79:6835/1367694301":"2024-06-11T00:25:04.436503+0000","172.21.15.79:6837/3594456696":"2024-06-11T00:24:48.375026+0000","172.21.15.79:6837/1367694301":"2024-06-11T00:25:04.436503+0000","172.21.15.79:6835/3594456696":"2024-06-11T00:24:48.375026+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-10T00:25:22.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9b6406be60 msgr2=0x7f9b6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:22.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9b6406be60 0x7f9b6406e320 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9b8415df30 tx=0x7f9b74008040 comp rx=0 tx=0).stop 2024-06-10T00:25:22.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b841f86a0 msgr2=0x7f9b841f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:22.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b841f86a0 0x7f9b841f44a0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f9b78007290 tx=0x7f9b78007750 comp rx=0 tx=0).stop 2024-06-10T00:25:22.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 shutdown_connections 2024-06-10T00:25:22.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9b6406be60 0x7f9b6406e320 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b841f49e0 0x7f9b8409fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b841f86a0 0x7f9b841f44a0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 --2- 172.21.15.79:0/3436911866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c004d40 0x7f9b840b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:22.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 >> 172.21.15.79:0/3436911866 conn(0x7f9b8409d3f0 msgr2=0x7f9b8406c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:22.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 shutdown_connections 2024-06-10T00:25:22.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:22.407+0000 7f9b88c76640 1 -- 172.21.15.79:0/3436911866 wait complete. 2024-06-10T00:25:23.419 INFO:tasks.ceph:Scrubbing osd.0 2024-06-10T00:25:23.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-06-10T00:25:23.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.526+0000 7f9869b90640 1 Processor -- start 2024-06-10T00:25:23.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.526+0000 7f9869b90640 1 -- start start 2024-06-10T00:25:23.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.526+0000 7f9869b90640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9864155590 0x7f986415b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.526+0000 7f9869b90640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f986415b9a0 0x7f98640cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f9869b90640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98640acd40 con 0x7f98640cf1a0 2024-06-10T00:25:23.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f9869b90640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f98640cf610 con 0x7f9864155590 2024-06-10T00:25:23.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f9869b90640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f986415bfe0 con 0x7f986415b9a0 2024-06-10T00:25:23.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f98637fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9864155590 0x7f986415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f98637fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9864155590 0x7f986415b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50076/0 (socket says 172.21.15.79:50076) 2024-06-10T00:25:23.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f98637fe640 1 -- 172.21.15.79:0/55057039 learned_addr learned my addr 172.21.15.79:0/55057039 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f98637fe640 1 -- 172.21.15.79:0/55057039 >> v2:172.21.15.117:3300/0 conn(0x7f986415b9a0 msgr2=0x7f98640cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f98637fe640 1 --2- 172.21.15.79:0/55057039 >> v2:172.21.15.117:3300/0 conn(0x7f986415b9a0 0x7f98640cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f98637fe640 1 -- 172.21.15.79:0/55057039 >> v1:172.21.15.117:6789/0 conn(0x7f98640cf1a0 legacy=0x7f986415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.527+0000 7f98637fe640 1 -- 172.21.15.79:0/55057039 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986415c2c0 con 0x7f9864155590 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f98637fe640 1 --2- 172.21.15.79:0/55057039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9864155590 0x7f986415b460 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f9864070c40 tx=0x7f985402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac533c5867f544a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f98627fc640 1 -- 172.21.15.79:0/55057039 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854037070 con 0x7f9864155590 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f98627fc640 1 -- 172.21.15.79:0/55057039 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9854032440 con 0x7f9864155590 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f98627fc640 1 -- 172.21.15.79:0/55057039 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854032810 con 0x7f9864155590 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f9869b90640 1 -- 172.21.15.79:0/55057039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9864155590 msgr2=0x7f986415b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f9869b90640 1 --2- 172.21.15.79:0/55057039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9864155590 0x7f986415b460 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f9864070c40 tx=0x7f985402a230 comp rx=0 tx=0).stop 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f9869b90640 1 -- 172.21.15.79:0/55057039 shutdown_connections 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f9869b90640 1 --2- 172.21.15.79:0/55057039 >> v2:172.21.15.117:3300/0 conn(0x7f986415b9a0 0x7f98640cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f9869b90640 1 --2- 172.21.15.79:0/55057039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9864155590 0x7f986415b460 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f9869b90640 1 -- 172.21.15.79:0/55057039 >> 172.21.15.79:0/55057039 conn(0x7f98640b1980 msgr2=0x7f98640b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:23.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f9869b90640 1 -- 172.21.15.79:0/55057039 shutdown_connections 2024-06-10T00:25:23.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.528+0000 7f9869b90640 1 -- 172.21.15.79:0/55057039 wait complete. 2024-06-10T00:25:23.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.530+0000 7f9869b90640 1 Processor -- start 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.530+0000 7f9869b90640 1 -- start start 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.530+0000 7f9869b90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640cf1a0 0x7f986409b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.530+0000 7f9869b90640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9864155590 0x7f98641e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.530+0000 7f9869b90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f986415b9a0 0x7f986413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.530+0000 7f9869b90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98640b26d0 con 0x7f98640cf1a0 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.530+0000 7f9869b90640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f98640ad2e0 con 0x7f9864155590 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.530+0000 7f9869b90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f98640ae810 con 0x7f986415b9a0 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640cf1a0 0x7f986409b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640cf1a0 0x7f986409b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50088/0 (socket says 172.21.15.79:50088) 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 -- 172.21.15.79:0/1413218155 learned_addr learned my addr 172.21.15.79:0/1413218155 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:23.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 -- 172.21.15.79:0/1413218155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f986415b9a0 msgr2=0x7f986413ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f986415b9a0 0x7f986413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 -- 172.21.15.79:0/1413218155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9864155590 msgr2=0x7f98641e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9864155590 0x7f98641e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 -- 172.21.15.79:0/1413218155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986413f830 con 0x7f98640cf1a0 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f98637fe640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640cf1a0 0x7f986409b0e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f9854000c00 tx=0x7f98540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854041070 con 0x7f98640cf1a0 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985403c870 con 0x7f98640cf1a0 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854037040 con 0x7f98640cf1a0 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986413fb10 con 0x7f98640cf1a0 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.531+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98641400d0 con 0x7f98640cf1a0 2024-06-10T00:25:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.532+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9864068540 con 0x7f98640cf1a0 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.533+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9854044070 con 0x7f98640cf1a0 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.533+0000 7f984bfff640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f985006be30 0x7f985006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.533+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f98540abde0 con 0x7f98640cf1a0 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.533+0000 7f9862ffd640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f985006be30 0x7f985006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.533+0000 7f984bfff640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f9850072410 0x7f9850074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.533+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9854032440 con 0x7f9850072410 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.533+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f98540ac270 con 0x7f98640cf1a0 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.533+0000 7f9863fff640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f9850072410 0x7f9850074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.534+0000 7f9862ffd640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f985006be30 0x7f985006e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f986409ad30 tx=0x7f9858006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.534+0000 7f9863fff640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f9850072410 0x7f9850074850 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.534+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 <== osd.0 v2:172.21.15.79:6824/709635793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9854032440 con 0x7f9850072410 2024-06-10T00:25:23.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.547+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 --> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f98640ce6e0 con 0x7f9850072410 2024-06-10T00:25:23.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.547+0000 7f984bfff640 1 -- 172.21.15.79:0/1413218155 <== osd.0 v2:172.21.15.79:6824/709635793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f98640ce6e0 con 0x7f9850072410 2024-06-10T00:25:23.547 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:23.547 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-10T00:25:23.547 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:23.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f9850072410 msgr2=0x7f9850074850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6824/709635793,v1:172.21.15.79:6825/709635793] conn(0x7f9850072410 0x7f9850074850 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f985006be30 msgr2=0x7f985006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f985006be30 0x7f985006e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f986409ad30 tx=0x7f9858006bf0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640cf1a0 msgr2=0x7f986409b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 --2- 172.21.15.79:0/1413218155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98640cf1a0 0x7f986409b0e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f9854000c00 tx=0x7f98540046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9863fff640 1 -- 172.21.15.79:0/1413218155 reap_dead start 2024-06-10T00:25:23.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 shutdown_connections 2024-06-10T00:25:23.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 >> 172.21.15.79:0/1413218155 conn(0x7f98640b1980 msgr2=0x7f98640b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:23.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 shutdown_connections 2024-06-10T00:25:23.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.548+0000 7f9869b90640 1 -- 172.21.15.79:0/1413218155 wait complete. 2024-06-10T00:25:23.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-06-10T00:25:23.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.658+0000 7f60016c3640 1 Processor -- start 2024-06-10T00:25:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.658+0000 7f60016c3640 1 -- start start 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f60016c3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc161cc0 0x7f5ffc0d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f60016c3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ffc0d4cd0 0x7f5ffc0d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f60016c3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ffc0d03e0 con 0x7f5ffc1618e0 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f60016c3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5ffc0b4130 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f60016c3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ffc0d0100 con 0x7f5ffc161cc0 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f5ffb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ffc0d4cd0 0x7f5ffc0d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f5ffb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ffc0d4cd0 0x7f5ffc0d2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50104/0 (socket says 172.21.15.79:50104) 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f5ffb7fe640 1 -- 172.21.15.79:0/3905426962 learned_addr learned my addr 172.21.15.79:0/3905426962 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f5ffa7fc640 1 --2- 172.21.15.79:0/3905426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc161cc0 0x7f5ffc0d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f5ffb7fe640 1 -- 172.21.15.79:0/3905426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc161cc0 msgr2=0x7f5ffc0d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:23.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f5ffb7fe640 1 --2- 172.21.15.79:0/3905426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc161cc0 0x7f5ffc0d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f5ffb7fe640 1 -- 172.21.15.79:0/3905426962 >> v1:172.21.15.117:6789/0 conn(0x7f5ffc1618e0 legacy=0x7f5ffc0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.659+0000 7f5ffb7fe640 1 -- 172.21.15.79:0/3905426962 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc0b3ae0 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.660+0000 7f5ffb7fe640 1 --2- 172.21.15.79:0/3905426962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0d2a50 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009e50 tx=0x7f5ff402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a863f33d525f408c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.660+0000 7f5ff9ffb640 1 -- 172.21.15.79:0/3905426962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4036070 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.660+0000 7f5ff9ffb640 1 -- 172.21.15.79:0/3905426962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff4031600 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.660+0000 7f5ff9ffb640 1 -- 172.21.15.79:0/3905426962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40319d0 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.661+0000 7f60016c3640 1 -- 172.21.15.79:0/3905426962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 msgr2=0x7f5ffc0d2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.661+0000 7f60016c3640 1 --2- 172.21.15.79:0/3905426962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0d2a50 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009e50 tx=0x7f5ff402a710 comp rx=0 tx=0).stop 2024-06-10T00:25:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.661+0000 7f60016c3640 1 -- 172.21.15.79:0/3905426962 shutdown_connections 2024-06-10T00:25:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.661+0000 7f60016c3640 1 --2- 172.21.15.79:0/3905426962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0d2a50 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.661+0000 7f60016c3640 1 --2- 172.21.15.79:0/3905426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc161cc0 0x7f5ffc0d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.661+0000 7f60016c3640 1 -- 172.21.15.79:0/3905426962 >> 172.21.15.79:0/3905426962 conn(0x7f5ffc09d410 msgr2=0x7f5ffc0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.661+0000 7f60016c3640 1 -- 172.21.15.79:0/3905426962 shutdown_connections 2024-06-10T00:25:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.661+0000 7f60016c3640 1 -- 172.21.15.79:0/3905426962 wait complete. 2024-06-10T00:25:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.662+0000 7f60016c3640 1 Processor -- start 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.662+0000 7f60016c3640 1 -- start start 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f60016c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f60016c3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc1618e0 0x7f5ffc0b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f60016c3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ffc161cc0 0x7f5ffc0b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f60016c3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc0b4740 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f60016c3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc0b45c0 con 0x7f5ffc161cc0 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f60016c3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ffc0b48c0 con 0x7f5ffc1618e0 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50106/0 (socket says 172.21.15.79:50106) 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 -- 172.21.15.79:0/1286989463 learned_addr learned my addr 172.21.15.79:0/1286989463 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 -- 172.21.15.79:0/1286989463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc1618e0 msgr2=0x7f5ffc0b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc1618e0 0x7f5ffc0b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 -- 172.21.15.79:0/1286989463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ffc161cc0 msgr2=0x7f5ffc0b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ffc161cc0 0x7f5ffc0b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 -- 172.21.15.79:0/1286989463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc15bcc0 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5ffaffd640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0ca590 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c430 tx=0x7f5fec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5fe37fe640 1 -- 172.21.15.79:0/1286989463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0052d0 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.663+0000 7f5fe37fe640 1 -- 172.21.15.79:0/1286989463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec005470 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.664+0000 7f5fe37fe640 1 -- 172.21.15.79:0/1286989463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec007260 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.664+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ffc0cda10 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.664+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ffc0cb1b0 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.665+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ffc068430 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.665+0000 7f5fe37fe640 1 -- 172.21.15.79:0/1286989463 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fec007400 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.665+0000 7f5fe37fe640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.665+0000 7f5ffa7fc640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.665+0000 7f5fe37fe640 1 -- 172.21.15.79:0/1286989463 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f5fec08a2c0 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.666+0000 7f5ffa7fc640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fe806be30 0x7f5fe806e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0006a90 tx=0x7f5ff0006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.669+0000 7f5fe37fe640 1 -- 172.21.15.79:0/1286989463 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5ffc15bcc0 con 0x7f5ffc0d4cd0 2024-06-10T00:25:23.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.843+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5ffc0cc890 con 0x7f5fe806be30 2024-06-10T00:25:23.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.844+0000 7f5fe37fe640 1 -- 172.21.15.79:0/1286989463 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5ffc0cc890 con 0x7f5fe806be30 2024-06-10T00:25:23.843 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 0 to deep-scrub 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fe806be30 msgr2=0x7f5fe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fe806be30 0x7f5fe806e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0006a90 tx=0x7f5ff0006a20 comp rx=0 tx=0).stop 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 msgr2=0x7f5ffc0ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0ca590 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c430 tx=0x7f5fec00c8f0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 shutdown_connections 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ffc161cc0 0x7f5ffc0b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ffc1618e0 0x7f5ffc0b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 --2- 172.21.15.79:0/1286989463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ffc0d4cd0 0x7f5ffc0ca590 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 >> 172.21.15.79:0/1286989463 conn(0x7f5ffc09d410 msgr2=0x7f5ffc06cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:23.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 shutdown_connections 2024-06-10T00:25:23.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.846+0000 7f60016c3640 1 -- 172.21.15.79:0/1286989463 wait complete. 2024-06-10T00:25:23.856 INFO:tasks.ceph:Scrubbing osd.1 2024-06-10T00:25:23.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-06-10T00:25:23.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.959+0000 7fa80eb34640 1 Processor -- start 2024-06-10T00:25:23.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.959+0000 7fa80eb34640 1 -- start start 2024-06-10T00:25:23.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.960+0000 7fa80eb34640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa80815be50 0x7fa808071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.960+0000 7fa80eb34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa8080b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.960+0000 7fa80eb34640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa808072570 con 0x7fa8080720d0 2024-06-10T00:25:23.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.960+0000 7fa80eb34640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa8080b3020 con 0x7fa80815be50 2024-06-10T00:25:23.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.960+0000 7fa80eb34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa808072850 con 0x7fa8080ccd30 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.960+0000 7fa80c8d0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa80815be50 0x7fa808071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.960+0000 7fa807fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa8080720d0 0x7fa8080cc620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44818/0 (socket says 172.21.15.79:44818) 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.960+0000 7fa807fff640 1 -- 172.21.15.79:0/1852350768 learned_addr learned my addr 172.21.15.79:0/1852350768 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa80c8d0640 1 -- 172.21.15.79:0/1852350768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 msgr2=0x7fa8080b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa80d0d1640 1 --2- 172.21.15.79:0/1852350768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa8080b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa80c8d0640 1 --2- 172.21.15.79:0/1852350768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa8080b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa80c8d0640 1 -- 172.21.15.79:0/1852350768 >> v1:172.21.15.79:6789/0 conn(0x7fa8080720d0 legacy=0x7fa8080cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa80c8d0640 1 -- 172.21.15.79:0/1852350768 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa808072b30 con 0x7fa80815be50 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa8077fe640 1 -- 172.21.15.79:0/1852350768 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380016405 0 0) 0x7fa808072570 con 0x7fa8080720d0 2024-06-10T00:25:23.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa80d0d1640 1 --2- 172.21.15.79:0/1852350768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa8080b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa80c8d0640 1 --2- 172.21.15.79:0/1852350768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa80815be50 0x7fa808071b90 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80097a0 tx=0x7fa7f802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77ade30493982db server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa8077fe640 1 -- 172.21.15.79:0/1852350768 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8037070 con 0x7fa80815be50 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa8077fe640 1 -- 172.21.15.79:0/1852350768 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8032440 con 0x7fa80815be50 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.961+0000 7fa8077fe640 1 -- 172.21.15.79:0/1852350768 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8032810 con 0x7fa80815be50 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.962+0000 7fa80eb34640 1 -- 172.21.15.79:0/1852350768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa80815be50 msgr2=0x7fa808071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.962+0000 7fa80eb34640 1 --2- 172.21.15.79:0/1852350768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa80815be50 0x7fa808071b90 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80097a0 tx=0x7fa7f802a180 comp rx=0 tx=0).stop 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.962+0000 7fa80eb34640 1 -- 172.21.15.79:0/1852350768 shutdown_connections 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.962+0000 7fa80eb34640 1 --2- 172.21.15.79:0/1852350768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa8080b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.962+0000 7fa80eb34640 1 --2- 172.21.15.79:0/1852350768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa80815be50 0x7fa808071b90 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.962+0000 7fa80eb34640 1 -- 172.21.15.79:0/1852350768 >> 172.21.15.79:0/1852350768 conn(0x7fa8080b1980 msgr2=0x7fa8080b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.962+0000 7fa80eb34640 1 -- 172.21.15.79:0/1852350768 shutdown_connections 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.962+0000 7fa80eb34640 1 -- 172.21.15.79:0/1852350768 wait complete. 2024-06-10T00:25:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.963+0000 7fa80eb34640 1 Processor -- start 2024-06-10T00:25:23.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.963+0000 7fa80eb34640 1 -- start start 2024-06-10T00:25:23.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80eb34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080720d0 0x7fa8081549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80eb34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa808157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80eb34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80815be50 0x7fa80809c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80eb34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa80815c8c0 con 0x7fa8080720d0 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80eb34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa80815c740 con 0x7fa80815be50 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80eb34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa80815c230 con 0x7fa8080ccd30 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80c8d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080720d0 0x7fa8081549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80c8d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080720d0 0x7fa8081549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50120/0 (socket says 172.21.15.79:50120) 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80c8d0640 1 -- 172.21.15.79:0/680331467 learned_addr learned my addr 172.21.15.79:0/680331467 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa807fff640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa808157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80d0d1640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80815be50 0x7fa80809c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80c8d0640 1 -- 172.21.15.79:0/680331467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 msgr2=0x7fa808157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80c8d0640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa808157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80c8d0640 1 -- 172.21.15.79:0/680331467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80815be50 msgr2=0x7fa80809c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80c8d0640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80815be50 0x7fa80809c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80c8d0640 1 -- 172.21.15.79:0/680331467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8081587a0 con 0x7fa8080720d0 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa807fff640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8080ccd30 0x7fa808157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.964+0000 7fa80d0d1640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80815be50 0x7fa80809c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.965+0000 7fa80c8d0640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080720d0 0x7fa8081549b0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80098c0 tx=0x7fa7f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.965+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8041070 con 0x7fa8080720d0 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.965+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f803c930 con 0x7fa8080720d0 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.965+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa808158a80 con 0x7fa8080720d0 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.965+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8037040 con 0x7fa8080720d0 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.965+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa808154ef0 con 0x7fa8080720d0 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.965+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8080af120 con 0x7fa8080720d0 2024-06-10T00:25:23.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.966+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7f8044070 con 0x7fa8080720d0 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa8057fa640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7f406be60 0x7fa7f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fa7f80abdf0 con 0x7fa8080720d0 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa807fff640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7f406be60 0x7fa7f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa8057fa640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7fa7f4072440 0x7fa7f4074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7f8041e70 con 0x7fa7f4072440 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fa7f80ac280 con 0x7fa8080720d0 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa80d0d1640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7fa7f4072440 0x7fa7f4074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa807fff640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7f406be60 0x7fa7f406e320 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa8081f4c30 tx=0x7fa7fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.967+0000 7fa80d0d1640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7fa7f4072440 0x7fa7f4074880 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:23.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.968+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 <== osd.1 v2:172.21.15.79:6808/15559294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7f8041e70 con 0x7fa7f4072440 2024-06-10T00:25:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 --> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa808068540 con 0x7fa7f4072440 2024-06-10T00:25:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa8057fa640 1 -- 172.21.15.79:0/680331467 <== osd.1 v2:172.21.15.79:6808/15559294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa808068540 con 0x7fa7f4072440 2024-06-10T00:25:23.981 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-10T00:25:23.981 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7fa7f4072440 msgr2=0x7fa7f4074880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa80eb34640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6808/15559294,v1:172.21.15.79:6809/15559294] conn(0x7fa7f4072440 0x7fa7f4074880 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7f406be60 msgr2=0x7fa7f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa80eb34640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa7f406be60 0x7fa7f406e320 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa8081f4c30 tx=0x7fa7fc009040 comp rx=0 tx=0).stop 2024-06-10T00:25:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080720d0 msgr2=0x7fa8081549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa80eb34640 1 --2- 172.21.15.79:0/680331467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080720d0 0x7fa8081549b0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80098c0 tx=0x7fa7f80046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.981+0000 7fa80d0d1640 1 -- 172.21.15.79:0/680331467 reap_dead start 2024-06-10T00:25:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.982+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 shutdown_connections 2024-06-10T00:25:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.982+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 >> 172.21.15.79:0/680331467 conn(0x7fa8080b1980 msgr2=0x7fa8080748a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.982+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 shutdown_connections 2024-06-10T00:25:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:23.982+0000 7fa80eb34640 1 -- 172.21.15.79:0/680331467 wait complete. 2024-06-10T00:25:23.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-06-10T00:25:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.091+0000 7f9d5fbf9640 1 Processor -- start 2024-06-10T00:25:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.091+0000 7f9d5fbf9640 1 -- start start 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.092+0000 7f9d5fbf9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d5815f1a0 0x7f9d580d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.092+0000 7f9d5fbf9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d580cef70 0x7f9d580cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.092+0000 7f9d5fbf9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5815f5e0 con 0x7f9d580d2680 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.092+0000 7f9d5fbf9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9d580d13e0 con 0x7f9d580cef70 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.092+0000 7f9d5fbf9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9d580d0ad0 con 0x7f9d5815f1a0 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.092+0000 7f9d5e196640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d580cef70 0x7f9d580cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.092+0000 7f9d5d194640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d5815f1a0 0x7f9d580d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.092+0000 7f9d5d995640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9d580d2680 0x7f9d580d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52610/0 (socket says 172.21.15.79:52610) 2024-06-10T00:25:24.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5d995640 1 -- 172.21.15.79:0/605621022 learned_addr learned my addr 172.21.15.79:0/605621022 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5e196640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d580cef70 0x7f9d580cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:38640/0 (socket says 172.21.15.79:38640) 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5c993640 1 -- 172.21.15.79:0/605621022 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1939743832 0 0) 0x7f9d5815f5e0 con 0x7f9d580d2680 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5c993640 1 -- 172.21.15.79:0/605621022 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d40003520 con 0x7f9d580d2680 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5d194640 1 -- 172.21.15.79:0/605621022 >> v2:172.21.15.117:3300/0 conn(0x7f9d580cef70 msgr2=0x7f9d580cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5d194640 1 --2- 172.21.15.79:0/605621022 >> v2:172.21.15.117:3300/0 conn(0x7f9d580cef70 0x7f9d580cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5d194640 1 -- 172.21.15.79:0/605621022 >> v1:172.21.15.117:6789/0 conn(0x7f9d580d2680 legacy=0x7f9d580d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5d194640 1 -- 172.21.15.79:0/605621022 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5815f890 con 0x7f9d5815f1a0 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.093+0000 7f9d5e196640 1 --2- 172.21.15.79:0/605621022 >> v2:172.21.15.117:3300/0 conn(0x7f9d580cef70 0x7f9d580cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:25:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5d194640 1 --2- 172.21.15.79:0/605621022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d5815f1a0 0x7f9d580d1fc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0097a0 tx=0x7f9d4c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245b8dd65c0c2a73 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5c993640 1 -- 172.21.15.79:0/605621022 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c037070 con 0x7f9d5815f1a0 2024-06-10T00:25:24.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5c993640 1 -- 172.21.15.79:0/605621022 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c032440 con 0x7f9d5815f1a0 2024-06-10T00:25:24.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5c993640 1 -- 172.21.15.79:0/605621022 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c032810 con 0x7f9d5815f1a0 2024-06-10T00:25:24.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/605621022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d5815f1a0 msgr2=0x7f9d580d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/605621022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d5815f1a0 0x7f9d580d1fc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0097a0 tx=0x7f9d4c02a180 comp rx=0 tx=0).stop 2024-06-10T00:25:24.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/605621022 shutdown_connections 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/605621022 >> v2:172.21.15.117:3300/0 conn(0x7f9d580cef70 0x7f9d580cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/605621022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d5815f1a0 0x7f9d580d1fc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/605621022 >> 172.21.15.79:0/605621022 conn(0x7f9d5809d3f0 msgr2=0x7f9d580d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/605621022 shutdown_connections 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.094+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/605621022 wait complete. 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.095+0000 7f9d5fbf9640 1 Processor -- start 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5fbf9640 1 -- start start 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5fbf9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d580cef70 0x7f9d581523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5fbf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d580d2680 0x7f9d580c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5fbf9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5815f1a0 0x7f9d580cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5fbf9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d580d4f00 con 0x7f9d580d2680 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5fbf9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9d580d1070 con 0x7f9d5815f1a0 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5fbf9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9d580d1870 con 0x7f9d580cef70 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5d194640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d580d2680 0x7f9d580c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5d194640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d580d2680 0x7f9d580c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50134/0 (socket says 172.21.15.79:50134) 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.096+0000 7f9d5d194640 1 -- 172.21.15.79:0/1035091823 learned_addr learned my addr 172.21.15.79:0/1035091823 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5d995640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d580cef70 0x7f9d581523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5e196640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5815f1a0 0x7f9d580cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5d194640 1 -- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d580cef70 msgr2=0x7f9d581523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5d194640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d580cef70 0x7f9d581523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5d194640 1 -- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5815f1a0 msgr2=0x7f9d580cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5d194640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5815f1a0 0x7f9d580cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5d194640 1 -- 172.21.15.79:0/1035091823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d580ce090 con 0x7f9d580d2680 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5d995640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d580cef70 0x7f9d581523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5d194640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d580d2680 0x7f9d580c8040 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0098c0 tx=0x7f9d4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d567fc640 1 -- 172.21.15.79:0/1035091823 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c041070 con 0x7f9d580d2680 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d567fc640 1 -- 172.21.15.79:0/1035091823 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c03c870 con 0x7f9d580d2680 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d567fc640 1 -- 172.21.15.79:0/1035091823 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c037040 con 0x7f9d580d2680 2024-06-10T00:25:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5815b9f0 con 0x7f9d580d2680 2024-06-10T00:25:24.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.097+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d581528e0 con 0x7f9d580d2680 2024-06-10T00:25:24.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.098+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d58068430 con 0x7f9d580d2680 2024-06-10T00:25:24.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.099+0000 7f9d567fc640 1 -- 172.21.15.79:0/1035091823 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d4c044070 con 0x7f9d580d2680 2024-06-10T00:25:24.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.099+0000 7f9d567fc640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d4406be60 0x7f9d4406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.099+0000 7f9d5d995640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d4406be60 0x7f9d4406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.099+0000 7f9d567fc640 1 -- 172.21.15.79:0/1035091823 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f9d4c0ab840 con 0x7f9d580d2680 2024-06-10T00:25:24.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.100+0000 7f9d5d995640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d4406be60 0x7f9d4406e320 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005c00 tx=0x7f9d50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.104+0000 7f9d567fc640 1 -- 172.21.15.79:0/1035091823 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9d4c07a3d0 con 0x7f9d580d2680 2024-06-10T00:25:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.276+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9d5808de90 con 0x7f9d4406be60 2024-06-10T00:25:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.276+0000 7f9d567fc640 1 -- 172.21.15.79:0/1035091823 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9d5808de90 con 0x7f9d4406be60 2024-06-10T00:25:24.276 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 1 to deep-scrub 2024-06-10T00:25:24.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d4406be60 msgr2=0x7f9d4406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d4406be60 0x7f9d4406e320 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005c00 tx=0x7f9d50009040 comp rx=0 tx=0).stop 2024-06-10T00:25:24.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d580d2680 msgr2=0x7f9d580c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d580d2680 0x7f9d580c8040 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0098c0 tx=0x7f9d4c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 shutdown_connections 2024-06-10T00:25:24.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f9d4406be60 0x7f9d4406e320 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5815f1a0 0x7f9d580cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d580d2680 0x7f9d580c8040 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 --2- 172.21.15.79:0/1035091823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d580cef70 0x7f9d581523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 >> 172.21.15.79:0/1035091823 conn(0x7f9d5809d3f0 msgr2=0x7f9d580b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 shutdown_connections 2024-06-10T00:25:24.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.278+0000 7f9d5fbf9640 1 -- 172.21.15.79:0/1035091823 wait complete. 2024-06-10T00:25:24.290 INFO:tasks.ceph:Scrubbing osd.2 2024-06-10T00:25:24.290 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-06-10T00:25:24.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.393+0000 7ff0fe0b3640 1 Processor -- start 2024-06-10T00:25:24.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.393+0000 7ff0fe0b3640 1 -- start start 2024-06-10T00:25:24.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.394+0000 7ff0fe0b3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff0f815a810 0x7ff0f80b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.394+0000 7ff0fe0b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f80af420 0x7ff0f80b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.394+0000 7ff0fe0b3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f8073270 con 0x7ff0f80cd170 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.394+0000 7ff0fe0b3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f80ce560 con 0x7ff0f815a810 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.394+0000 7ff0fe0b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f80b4e30 con 0x7ff0f80af420 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.394+0000 7ff0f7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff0f80cd170 0x7ff0f815e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44826/0 (socket says 172.21.15.79:44826) 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.394+0000 7ff0f7fff640 1 -- 172.21.15.79:0/1180696354 learned_addr learned my addr 172.21.15.79:0/1180696354 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f6ffd640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f80af420 0x7ff0f80b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f77fe640 1 --2- 172.21.15.79:0/1180696354 >> v2:172.21.15.117:3300/0 conn(0x7ff0f815a810 0x7ff0f80b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645510910 0 0) 0x7ff0f8073270 con 0x7ff0f80cd170 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e0003500 con 0x7ff0f80cd170 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1242758038 0 0) 0x7ff0e0003500 con 0x7ff0f80cd170 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f80af420 msgr2=0x7ff0f80b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f80af420 0x7ff0f80b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 >> v2:172.21.15.117:3300/0 conn(0x7ff0f815a810 msgr2=0x7ff0f80b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 --2- 172.21.15.79:0/1180696354 >> v2:172.21.15.117:3300/0 conn(0x7ff0f815a810 0x7ff0f80b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f815abf0 con 0x7ff0f80cd170 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7ff0f00019f0 con 0x7ff0f80cd170 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 >> v1:172.21.15.79:6789/0 conn(0x7ff0f80cd170 legacy=0x7ff0f815e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e0003b60 0x7ff0e0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f80af420 0x7ff0e000a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e000ae20 0x7ff0e000d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f80ce560 con 0x7ff0e000ae20 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f80b4e30 con 0x7ff0e0003b60 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e000db10 con 0x7ff0f80af420 2024-06-10T00:25:24.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f7fff640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e000ae20 0x7ff0e000d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f77fe640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e0003b60 0x7ff0e0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f6ffd640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f80af420 0x7ff0e000a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f7fff640 1 -- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f80af420 msgr2=0x7ff0e000a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f7fff640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f80af420 0x7ff0e000a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f7fff640 1 -- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e0003b60 msgr2=0x7ff0e0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f7fff640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e0003b60 0x7ff0e0003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.395+0000 7ff0f7fff640 1 -- 172.21.15.79:0/1180696354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e0003500 con 0x7ff0e000ae20 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.396+0000 7ff0f7fff640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e000ae20 0x7ff0e000d2b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000a870 tx=0x7ff0e00037f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e648d7cfd78a06e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.396+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000a4c0 con 0x7ff0e000ae20 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.396+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f002f070 con 0x7ff0e000ae20 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.396+0000 7ff0f67fc640 1 -- 172.21.15.79:0/1180696354 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f002bcc0 con 0x7ff0e000ae20 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.397+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/1180696354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e000ae20 msgr2=0x7ff0e000d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.397+0000 7ff0fe0b3640 1 --2- 172.21.15.79:0/1180696354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e000ae20 0x7ff0e000d2b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000a870 tx=0x7ff0e00037f0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.397+0000 7ff0f7fff640 1 -- 172.21.15.79:0/1180696354 reap_dead start 2024-06-10T00:25:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.397+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/1180696354 shutdown_connections 2024-06-10T00:25:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.397+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/1180696354 >> 172.21.15.79:0/1180696354 conn(0x7ff0f80b1980 msgr2=0x7ff0f80b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.397+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/1180696354 shutdown_connections 2024-06-10T00:25:24.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.397+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/1180696354 wait complete. 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.398+0000 7ff0fe0b3640 1 Processor -- start 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.398+0000 7ff0fe0b3640 1 -- start start 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0fe0b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f8144590 0x7ff0f806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0fe0b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0f8144970 0x7ff0f806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0fe0b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0f8156100 0x7ff0f81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0fe0b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f80ced70 con 0x7ff0f8156100 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0fe0b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f80cea90 con 0x7ff0f8144970 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0fe0b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f80cf050 con 0x7ff0f8144590 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0f8156100 0x7ff0f81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0f8156100 0x7ff0f81565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50150/0 (socket says 172.21.15.79:50150) 2024-06-10T00:25:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 -- 172.21.15.79:0/4183932641 learned_addr learned my addr 172.21.15.79:0/4183932641 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f77fe640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f8144590 0x7ff0f806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f6ffd640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0f8144970 0x7ff0f806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 -- 172.21.15.79:0/4183932641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f8144590 msgr2=0x7ff0f806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0f8144590 0x7ff0f806ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 -- 172.21.15.79:0/4183932641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0f8144970 msgr2=0x7ff0f806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0f8144970 0x7ff0f806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 -- 172.21.15.79:0/4183932641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f8156df0 con 0x7ff0f8156100 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f6ffd640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0f8144970 0x7ff0f806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0f7fff640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0f8156100 0x7ff0f81565b0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000a870 tx=0x7ff0f80cf330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.399+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000a4c0 con 0x7ff0f8156100 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.400+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f0034470 con 0x7ff0f8156100 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.400+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f81570d0 con 0x7ff0f8156100 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.400+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0002030 con 0x7ff0f8156100 2024-06-10T00:25:24.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.400+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f81486d0 con 0x7ff0f8156100 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.400+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0f8068540 con 0x7ff0f8156100 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.401+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0f0034860 con 0x7ff0f8156100 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.401+0000 7ff0dffff640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff0e406be60 0x7ff0e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.402+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7ff0f00aadf0 con 0x7ff0f8156100 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.402+0000 7ff0f77fe640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff0e406be60 0x7ff0e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.402+0000 7ff0dffff640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff0e4072440 0x7ff0e4074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.402+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0e4074f50 con 0x7ff0e4072440 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.402+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7ff0f00ad4f0 con 0x7ff0f8156100 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.402+0000 7ff0f6ffd640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff0e4072440 0x7ff0e4074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.402+0000 7ff0f77fe640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff0e406be60 0x7ff0e406e320 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009b00 tx=0x7ff0e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.402+0000 7ff0f6ffd640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff0e4072440 0x7ff0e4074880 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.403+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 <== osd.2 v2:172.21.15.79:6816/3079975341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0e4074f50 con 0x7ff0e4072440 2024-06-10T00:25:24.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.415+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 --> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff0f80b25e0 con 0x7ff0e4072440 2024-06-10T00:25:24.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0dffff640 1 -- 172.21.15.79:0/4183932641 <== osd.2 v2:172.21.15.79:6816/3079975341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff0f80b25e0 con 0x7ff0e4072440 2024-06-10T00:25:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:24.416 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-10T00:25:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff0e4072440 msgr2=0x7ff0e4074880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6816/3079975341,v1:172.21.15.79:6817/3079975341] conn(0x7ff0e4072440 0x7ff0e4074880 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff0e406be60 msgr2=0x7ff0e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7ff0e406be60 0x7ff0e406e320 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009b00 tx=0x7ff0e8008040 comp rx=0 tx=0).stop 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0f8156100 msgr2=0x7ff0f81565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 --2- 172.21.15.79:0/4183932641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0f8156100 0x7ff0f81565b0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000a870 tx=0x7ff0f80cf330 comp rx=0 tx=0).stop 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0f7fff640 1 -- 172.21.15.79:0/4183932641 reap_dead start 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 shutdown_connections 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 >> 172.21.15.79:0/4183932641 conn(0x7ff0f80b1980 msgr2=0x7ff0f8158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 shutdown_connections 2024-06-10T00:25:24.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.416+0000 7ff0fe0b3640 1 -- 172.21.15.79:0/4183932641 wait complete. 2024-06-10T00:25:24.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-06-10T00:25:24.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.529+0000 7f782ff70640 1 Processor -- start 2024-06-10T00:25:24.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.529+0000 7f782ff70640 1 -- start start 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782ff70640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78280d0430 0x7f78280d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782ff70640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78280c59a0 con 0x7f782815c1d0 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782ff70640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78280d0910 con 0x7f78280cef50 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782ff70640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f78280c5fb0 con 0x7f78280d0430 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782e50d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78280d0430 0x7f78280d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782dd0c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f782815c1d0 0x7f78280ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44840/0 (socket says 172.21.15.79:44840) 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782dd0c640 1 -- 172.21.15.79:0/611756820 learned_addr learned my addr 172.21.15.79:0/611756820 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782e50d640 1 -- 172.21.15.79:0/611756820 >> v1:172.21.15.117:6789/0 conn(0x7f78280cef50 legacy=0x7f78280c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782e50d640 1 -- 172.21.15.79:0/611756820 >> v1:172.21.15.79:6789/0 conn(0x7f782815c1d0 legacy=0x7f78280ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.530+0000 7f782e50d640 1 -- 172.21.15.79:0/611756820 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78280d0bf0 con 0x7f78280d0430 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.531+0000 7f782e50d640 1 --2- 172.21.15.79:0/611756820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78280d0430 0x7f78280d2970 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f7820009d90 tx=0x7f782002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1972ba0a905d824a server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.531+0000 7f782cd0a640 1 -- 172.21.15.79:0/611756820 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820031600 con 0x7f78280d0430 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.531+0000 7f782cd0a640 1 -- 172.21.15.79:0/611756820 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78200317a0 con 0x7f78280d0430 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.531+0000 7f782cd0a640 1 -- 172.21.15.79:0/611756820 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820031b70 con 0x7f78280d0430 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.531+0000 7f782ff70640 1 -- 172.21.15.79:0/611756820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78280d0430 msgr2=0x7f78280d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.532+0000 7f782ff70640 1 --2- 172.21.15.79:0/611756820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78280d0430 0x7f78280d2970 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f7820009d90 tx=0x7f782002a610 comp rx=0 tx=0).stop 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.532+0000 7f782ff70640 1 -- 172.21.15.79:0/611756820 shutdown_connections 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.532+0000 7f782ff70640 1 --2- 172.21.15.79:0/611756820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78280d0430 0x7f78280d2970 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.532+0000 7f782ff70640 1 -- 172.21.15.79:0/611756820 >> 172.21.15.79:0/611756820 conn(0x7f78280d1e50 msgr2=0x7f78280d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.532+0000 7f782ff70640 1 -- 172.21.15.79:0/611756820 shutdown_connections 2024-06-10T00:25:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.532+0000 7f782ff70640 1 -- 172.21.15.79:0/611756820 wait complete. 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.533+0000 7f782ff70640 1 Processor -- start 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.533+0000 7f782ff70640 1 -- start start 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.533+0000 7f782ff70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280cef50 0x7f78281f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.533+0000 7f782ff70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d0430 0x7f78281f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.533+0000 7f782ff70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782815c1d0 0x7f7828153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.533+0000 7f782ff70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78280cf520 con 0x7f782815c1d0 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.533+0000 7f782ff70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f782815c5b0 con 0x7f78280d0430 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782ff70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f78280cf6a0 con 0x7f78280cef50 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782815c1d0 0x7f7828153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782815c1d0 0x7f7828153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50158/0 (socket says 172.21.15.79:50158) 2024-06-10T00:25:24.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 -- 172.21.15.79:0/1127548586 learned_addr learned my addr 172.21.15.79:0/1127548586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782dd0c640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280cef50 0x7f78281f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782d50b640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d0430 0x7f78281f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 -- 172.21.15.79:0/1127548586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280cef50 msgr2=0x7f78281f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280cef50 0x7f78281f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 -- 172.21.15.79:0/1127548586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d0430 msgr2=0x7f78281f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d0430 0x7f78281f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 -- 172.21.15.79:0/1127548586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78281f5da0 con 0x7f782815c1d0 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782e50d640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782815c1d0 0x7f7828153bb0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7820009d90 tx=0x7f7820004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f781e7fc640 1 -- 172.21.15.79:0/1127548586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820040070 con 0x7f782815c1d0 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f781e7fc640 1 -- 172.21.15.79:0/1127548586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7820030b60 con 0x7f782815c1d0 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f781e7fc640 1 -- 172.21.15.79:0/1127548586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782003c420 con 0x7f782815c1d0 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78280c9b70 con 0x7f782815c1d0 2024-06-10T00:25:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.534+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7828158e70 con 0x7f782815c1d0 2024-06-10T00:25:24.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.535+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78280c9f60 con 0x7f782815c1d0 2024-06-10T00:25:24.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.536+0000 7f781e7fc640 1 -- 172.21.15.79:0/1127548586 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7820039040 con 0x7f782815c1d0 2024-06-10T00:25:24.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.536+0000 7f781e7fc640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f780c06be30 0x7f780c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.536+0000 7f781e7fc640 1 -- 172.21.15.79:0/1127548586 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f78200ac190 con 0x7f782815c1d0 2024-06-10T00:25:24.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.536+0000 7f782dd0c640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f780c06be30 0x7f780c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.537+0000 7f782dd0c640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f780c06be30 0x7f780c06e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7824000f60 tx=0x7f7824009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.540+0000 7f781e7fc640 1 -- 172.21.15.79:0/1127548586 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f78281f5da0 con 0x7f782815c1d0 2024-06-10T00:25:24.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.714+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f78281f1670 con 0x7f780c06be30 2024-06-10T00:25:24.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.714+0000 7f781e7fc640 1 -- 172.21.15.79:0/1127548586 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f78281f1670 con 0x7f780c06be30 2024-06-10T00:25:24.714 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 2 to deep-scrub 2024-06-10T00:25:24.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f780c06be30 msgr2=0x7f780c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f780c06be30 0x7f780c06e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7824000f60 tx=0x7f7824009040 comp rx=0 tx=0).stop 2024-06-10T00:25:24.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782815c1d0 msgr2=0x7f7828153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782815c1d0 0x7f7828153bb0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7820009d90 tx=0x7f7820004a40 comp rx=0 tx=0).stop 2024-06-10T00:25:24.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 shutdown_connections 2024-06-10T00:25:24.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f780c06be30 0x7f780c06e2f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782815c1d0 0x7f7828153bb0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d0430 0x7f78281f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 --2- 172.21.15.79:0/1127548586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280cef50 0x7f78281f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 >> 172.21.15.79:0/1127548586 conn(0x7f78280d1e50 msgr2=0x7f7828070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 shutdown_connections 2024-06-10T00:25:24.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.716+0000 7f782ff70640 1 -- 172.21.15.79:0/1127548586 wait complete. 2024-06-10T00:25:24.727 INFO:tasks.ceph:Scrubbing osd.3 2024-06-10T00:25:24.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-06-10T00:25:24.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.830+0000 7fa430bd5640 1 Processor -- start 2024-06-10T00:25:24.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.830+0000 7fa430bd5640 1 -- start start 2024-06-10T00:25:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.830+0000 7fa430bd5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa42c15be50 0x7fa42c071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa430bd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c0720d0 0x7fa42c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa430bd5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa42c15c740 0x7fa42c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa430bd5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa42c0b3020 con 0x7fa42c15be50 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa430bd5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa42c072570 con 0x7fa42c15c740 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa430bd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa42c072850 con 0x7fa42c0720d0 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa42c15be50 0x7fa42c071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42a59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa42c15be50 0x7fa42c071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50162/0 (socket says 172.21.15.79:50162) 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42a59c640 1 -- 172.21.15.79:0/3057525622 learned_addr learned my addr 172.21.15.79:0/3057525622 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42a59c640 1 -- 172.21.15.79:0/3057525622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c0720d0 msgr2=0x7fa42c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42a59c640 1 --2- 172.21.15.79:0/3057525622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c0720d0 0x7fa42c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42ad9d640 1 --2- 172.21.15.79:0/3057525622 >> v2:172.21.15.117:3300/0 conn(0x7fa42c15c740 0x7fa42c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42a59c640 1 -- 172.21.15.79:0/3057525622 >> v2:172.21.15.117:3300/0 conn(0x7fa42c15c740 msgr2=0x7fa42c0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42a59c640 1 --2- 172.21.15.79:0/3057525622 >> v2:172.21.15.117:3300/0 conn(0x7fa42c15c740 0x7fa42c0ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.831+0000 7fa42a59c640 1 -- 172.21.15.79:0/3057525622 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42c072b30 con 0x7fa42c15be50 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa42a59c640 1 --2- 172.21.15.79:0/3057525622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c15be50 0x7fa42c071b90 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fa42c072a60 tx=0x7fa41c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356b1420bc416ea2 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa429d9b640 1 -- 172.21.15.79:0/3057525622 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c037070 con 0x7fa42c15be50 2024-06-10T00:25:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa429d9b640 1 -- 172.21.15.79:0/3057525622 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41c032440 con 0x7fa42c15be50 2024-06-10T00:25:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa429d9b640 1 -- 172.21.15.79:0/3057525622 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c032810 con 0x7fa42c15be50 2024-06-10T00:25:24.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 -- 172.21.15.79:0/3057525622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c15be50 msgr2=0x7fa42c071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 --2- 172.21.15.79:0/3057525622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c15be50 0x7fa42c071b90 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fa42c072a60 tx=0x7fa41c02a1c0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 -- 172.21.15.79:0/3057525622 shutdown_connections 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 --2- 172.21.15.79:0/3057525622 >> v2:172.21.15.117:3300/0 conn(0x7fa42c15c740 0x7fa42c0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 --2- 172.21.15.79:0/3057525622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c0720d0 0x7fa42c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 --2- 172.21.15.79:0/3057525622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c15be50 0x7fa42c071b90 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 -- 172.21.15.79:0/3057525622 >> 172.21.15.79:0/3057525622 conn(0x7fa42c0b1980 msgr2=0x7fa42c0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 -- 172.21.15.79:0/3057525622 shutdown_connections 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.832+0000 7fa430bd5640 1 -- 172.21.15.79:0/3057525622 wait complete. 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.834+0000 7fa430bd5640 1 Processor -- start 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.834+0000 7fa430bd5640 1 -- start start 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.834+0000 7fa430bd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c0720d0 0x7fa42c0ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.834+0000 7fa430bd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c15be50 0x7fa42c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.834+0000 7fa430bd5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c15c740 0x7fa42c09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa430bd5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c15c3b0 con 0x7fa42c0720d0 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa430bd5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c15c230 con 0x7fa42c15c740 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa430bd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa42c15c530 con 0x7fa42c15be50 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c0720d0 0x7fa42c0ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c0720d0 0x7fa42c0ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50174/0 (socket says 172.21.15.79:50174) 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 -- 172.21.15.79:0/423585657 learned_addr learned my addr 172.21.15.79:0/423585657 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 -- 172.21.15.79:0/423585657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c15be50 msgr2=0x7fa42c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c15be50 0x7fa42c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 -- 172.21.15.79:0/423585657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c15c740 msgr2=0x7fa42c09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c15c740 0x7fa42c09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 -- 172.21.15.79:0/423585657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42c0cefe0 con 0x7fa42c0720d0 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa42a59c640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c0720d0 0x7fa42c0ce560 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fa41c000c00 tx=0x7fa41c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c041020 con 0x7fa42c0720d0 2024-06-10T00:25:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41c030970 con 0x7fa42c0720d0 2024-06-10T00:25:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42c0cf530 con 0x7fa42c0720d0 2024-06-10T00:25:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c037040 con 0x7fa42c0720d0 2024-06-10T00:25:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.835+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42c0cf250 con 0x7fa42c0720d0 2024-06-10T00:25:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.836+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa42c068540 con 0x7fa42c0720d0 2024-06-10T00:25:24.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.837+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa41c044020 con 0x7fa42c0720d0 2024-06-10T00:25:24.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.837+0000 7fa4237fe640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa40c06be30 0x7fa40c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.837+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fa41c0ab740 con 0x7fa42c0720d0 2024-06-10T00:25:24.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.837+0000 7fa421d9b640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa40c06be30 0x7fa40c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.837+0000 7fa4237fe640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fa40c072410 0x7fa40c074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.837+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa41c00af30 con 0x7fa40c072410 2024-06-10T00:25:24.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.837+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fa41c0b2050 con 0x7fa42c0720d0 2024-06-10T00:25:24.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.837+0000 7fa42ad9d640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fa40c072410 0x7fa40c074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.838+0000 7fa421d9b640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa40c06be30 0x7fa40c06e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0cf850 tx=0x7fa414006c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.838+0000 7fa42ad9d640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fa40c072410 0x7fa40c074850 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.838+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 <== osd.3 v2:172.21.15.79:6800/4145020298 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa41c00af30 con 0x7fa40c072410 2024-06-10T00:25:24.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.851+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 --> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa42c0b1760 con 0x7fa40c072410 2024-06-10T00:25:24.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.851+0000 7fa4237fe640 1 -- 172.21.15.79:0/423585657 <== osd.3 v2:172.21.15.79:6800/4145020298 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa42c0b1760 con 0x7fa40c072410 2024-06-10T00:25:24.851 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:24.851 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-10T00:25:24.851 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:24.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fa40c072410 msgr2=0x7fa40c074850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6800/4145020298,v1:172.21.15.79:6801/4145020298] conn(0x7fa40c072410 0x7fa40c074850 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa40c06be30 msgr2=0x7fa40c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa40c06be30 0x7fa40c06e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0cf850 tx=0x7fa414006c90 comp rx=0 tx=0).stop 2024-06-10T00:25:24.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c0720d0 msgr2=0x7fa42c0ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 --2- 172.21.15.79:0/423585657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c0720d0 0x7fa42c0ce560 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fa41c000c00 tx=0x7fa41c0046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa42ad9d640 1 -- 172.21.15.79:0/423585657 reap_dead start 2024-06-10T00:25:24.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 shutdown_connections 2024-06-10T00:25:24.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 >> 172.21.15.79:0/423585657 conn(0x7fa42c0b1980 msgr2=0x7fa42c15e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 shutdown_connections 2024-06-10T00:25:24.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.852+0000 7fa430bd5640 1 -- 172.21.15.79:0/423585657 wait complete. 2024-06-10T00:25:24.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-06-10T00:25:24.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.964+0000 7fb846b70640 1 Processor -- start 2024-06-10T00:25:24.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.964+0000 7fb846b70640 1 -- start start 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb846b70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8401553c0 0x7fb8400cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb846b70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb8400cec50 0x7fb8400cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb846b70640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8400b3170 con 0x7fb8400b2cf0 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb846b70640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb8400b3420 con 0x7fb8400cec50 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb846b70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb8400cc750 con 0x7fb8401553c0 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84490c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8401553c0 0x7fb8400cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84510d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb8400cec50 0x7fb8400cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84490c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8401553c0 0x7fb8400cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:41210/0 (socket says 172.21.15.79:41210) 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84510d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb8400cec50 0x7fb8400cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.79:38686/0 (socket says 172.21.15.79:38686) 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84490c640 1 -- 172.21.15.79:0/697156068 learned_addr learned my addr 172.21.15.79:0/697156068 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:24.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb83ffff640 1 --1- 172.21.15.79:0/697156068 >> v1:172.21.15.117:6789/0 conn(0x7fb8400b2cf0 0x7fb84015beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52628/0 (socket says 172.21.15.79:52628) 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84490c640 1 -- 172.21.15.79:0/697156068 >> v2:172.21.15.117:3300/0 conn(0x7fb8400cec50 msgr2=0x7fb8400cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84490c640 1 --2- 172.21.15.79:0/697156068 >> v2:172.21.15.117:3300/0 conn(0x7fb8400cec50 0x7fb8400cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84490c640 1 -- 172.21.15.79:0/697156068 >> v1:172.21.15.117:6789/0 conn(0x7fb8400b2cf0 legacy=0x7fb84015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84490c640 1 -- 172.21.15.79:0/697156068 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8400cca30 con 0x7fb8401553c0 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.965+0000 7fb84510d640 1 --2- 172.21.15.79:0/697156068 >> v2:172.21.15.117:3300/0 conn(0x7fb8400cec50 0x7fb8400cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.966+0000 7fb84490c640 1 --2- 172.21.15.79:0/697156068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8401553c0 0x7fb8400cd230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb834009870 tx=0x7fb83402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=273443c393c94c86 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.966+0000 7fb83f7fe640 1 -- 172.21.15.79:0/697156068 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834037070 con 0x7fb8401553c0 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.966+0000 7fb83f7fe640 1 -- 172.21.15.79:0/697156068 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb834032440 con 0x7fb8401553c0 2024-06-10T00:25:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.966+0000 7fb83f7fe640 1 -- 172.21.15.79:0/697156068 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834032810 con 0x7fb8401553c0 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.967+0000 7fb846b70640 1 -- 172.21.15.79:0/697156068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8401553c0 msgr2=0x7fb8400cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.967+0000 7fb846b70640 1 --2- 172.21.15.79:0/697156068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8401553c0 0x7fb8400cd230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb834009870 tx=0x7fb83402a270 comp rx=0 tx=0).stop 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.967+0000 7fb846b70640 1 -- 172.21.15.79:0/697156068 shutdown_connections 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.967+0000 7fb846b70640 1 --2- 172.21.15.79:0/697156068 >> v2:172.21.15.117:3300/0 conn(0x7fb8400cec50 0x7fb8400cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.967+0000 7fb846b70640 1 --2- 172.21.15.79:0/697156068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8401553c0 0x7fb8400cd230 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.967+0000 7fb846b70640 1 -- 172.21.15.79:0/697156068 >> 172.21.15.79:0/697156068 conn(0x7fb8400b19f0 msgr2=0x7fb8400b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.967+0000 7fb846b70640 1 -- 172.21.15.79:0/697156068 shutdown_connections 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.967+0000 7fb846b70640 1 -- 172.21.15.79:0/697156068 wait complete. 2024-06-10T00:25:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.968+0000 7fb846b70640 1 Processor -- start 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.968+0000 7fb846b70640 1 -- start start 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb846b70640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400b2cf0 0x7fb840147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb846b70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400cec50 0x7fb84009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb846b70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8401553c0 0x7fb8400cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb846b70640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8401557a0 con 0x7fb8400b2cf0 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb846b70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb8400b3700 con 0x7fb8401553c0 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb846b70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb840155920 con 0x7fb8400cec50 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84490c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400b2cf0 0x7fb840147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84490c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400b2cf0 0x7fb840147760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50190/0 (socket says 172.21.15.79:50190) 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84490c640 1 -- 172.21.15.79:0/4016120517 learned_addr learned my addr 172.21.15.79:0/4016120517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb83ffff640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400cec50 0x7fb84009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84510d640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8401553c0 0x7fb8400cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84490c640 1 -- 172.21.15.79:0/4016120517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400cec50 msgr2=0x7fb84009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84490c640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400cec50 0x7fb84009aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84490c640 1 -- 172.21.15.79:0/4016120517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8401553c0 msgr2=0x7fb8400cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84490c640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8401553c0 0x7fb8400cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.969+0000 7fb84490c640 1 -- 172.21.15.79:0/4016120517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb840147ca0 con 0x7fb8400b2cf0 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.970+0000 7fb84490c640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400b2cf0 0x7fb840147760 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb83402a2b0 tx=0x7fb8340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.970+0000 7fb83d7fa640 1 -- 172.21.15.79:0/4016120517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834041030 con 0x7fb8400b2cf0 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.970+0000 7fb83d7fa640 1 -- 172.21.15.79:0/4016120517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb834030440 con 0x7fb8400b2cf0 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.970+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84009b380 con 0x7fb8400b2cf0 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.970+0000 7fb83d7fa640 1 -- 172.21.15.79:0/4016120517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834037040 con 0x7fb8400b2cf0 2024-06-10T00:25:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.970+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84009b940 con 0x7fb8400b2cf0 2024-06-10T00:25:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.971+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb840068430 con 0x7fb8400b2cf0 2024-06-10T00:25:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.971+0000 7fb83d7fa640 1 -- 172.21.15.79:0/4016120517 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb834044070 con 0x7fb8400b2cf0 2024-06-10T00:25:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.972+0000 7fb83d7fa640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb82406be30 0x7fb82406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.972+0000 7fb83ffff640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb82406be30 0x7fb82406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.972+0000 7fb83d7fa640 1 -- 172.21.15.79:0/4016120517 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fb8340ab310 con 0x7fb8400b2cf0 2024-06-10T00:25:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.972+0000 7fb83ffff640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb82406be30 0x7fb82406e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb84015f1b0 tx=0x7fb82c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:24.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:24.976+0000 7fb83d7fa640 1 -- 172.21.15.79:0/4016120517 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb840147ca0 con 0x7fb8400b2cf0 2024-06-10T00:25:25.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.148+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb84015b7f0 con 0x7fb82406be30 2024-06-10T00:25:25.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.148+0000 7fb83d7fa640 1 -- 172.21.15.79:0/4016120517 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb84015b7f0 con 0x7fb82406be30 2024-06-10T00:25:25.148 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 3 to deep-scrub 2024-06-10T00:25:25.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb82406be30 msgr2=0x7fb82406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb82406be30 0x7fb82406e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb84015f1b0 tx=0x7fb82c007e80 comp rx=0 tx=0).stop 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400b2cf0 msgr2=0x7fb840147760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400b2cf0 0x7fb840147760 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb83402a2b0 tx=0x7fb8340046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 shutdown_connections 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fb82406be30 0x7fb82406e2f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8401553c0 0x7fb8400cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400cec50 0x7fb84009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 --2- 172.21.15.79:0/4016120517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400b2cf0 0x7fb840147760 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 >> 172.21.15.79:0/4016120517 conn(0x7fb8400b19f0 msgr2=0x7fb8400715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 shutdown_connections 2024-06-10T00:25:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.150+0000 7fb846b70640 1 -- 172.21.15.79:0/4016120517 wait complete. 2024-06-10T00:25:25.161 INFO:tasks.ceph:Scrubbing osd.4 2024-06-10T00:25:25.161 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-06-10T00:25:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.265+0000 7fa1e345d640 1 Processor -- start 2024-06-10T00:25:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.265+0000 7fa1e345d640 1 -- start start 2024-06-10T00:25:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e345d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1dc15a810 0x7fa1dc0b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e345d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc072020 0x7fa1dc0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e345d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1dc073270 con 0x7fa1dc0af420 2024-06-10T00:25:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e345d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa1dc0ce560 con 0x7fa1dc15a810 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e345d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc0b4e30 con 0x7fa1dc072020 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e19fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc072020 0x7fa1dc0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e09f8640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa1dc0af420 0x7fa1dc15e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52630/0 (socket says 172.21.15.79:52630) 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e11f9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1dc15a810 0x7fa1dc0b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.266+0000 7fa1e09f8640 1 -- 172.21.15.79:0/1685000288 learned_addr learned my addr 172.21.15.79:0/1685000288 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.267+0000 7fa1d3fff640 1 -- 172.21.15.79:0/1685000288 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655441449 0 0) 0x7fa1dc073270 con 0x7fa1dc0af420 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.267+0000 7fa1d3fff640 1 -- 172.21.15.79:0/1685000288 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c8003440 con 0x7fa1dc0af420 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.267+0000 7fa1e11f9640 1 -- 172.21.15.79:0/1685000288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc072020 msgr2=0x7fa1dc0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.267+0000 7fa1e11f9640 1 --2- 172.21.15.79:0/1685000288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc072020 0x7fa1dc0b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.267+0000 7fa1e11f9640 1 -- 172.21.15.79:0/1685000288 >> v1:172.21.15.117:6789/0 conn(0x7fa1dc0af420 legacy=0x7fa1dc15e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.267+0000 7fa1e11f9640 1 -- 172.21.15.79:0/1685000288 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc15abf0 con 0x7fa1dc15a810 2024-06-10T00:25:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.267+0000 7fa1e19fa640 1 --2- 172.21.15.79:0/1685000288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc072020 0x7fa1dc0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.267+0000 7fa1e11f9640 1 --2- 172.21.15.79:0/1685000288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 0x7fa1dc0b43b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80097a0 tx=0x7fa1d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a05473fd0fc6afc8 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1d3fff640 1 -- 172.21.15.79:0/1685000288 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8037070 con 0x7fa1dc15a810 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1d3fff640 1 -- 172.21.15.79:0/1685000288 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d8032440 con 0x7fa1dc15a810 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1d3fff640 1 -- 172.21.15.79:0/1685000288 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80327f0 con 0x7fa1dc15a810 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1e345d640 1 -- 172.21.15.79:0/1685000288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 msgr2=0x7fa1dc0b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1e345d640 1 --2- 172.21.15.79:0/1685000288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 0x7fa1dc0b43b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80097a0 tx=0x7fa1d802a180 comp rx=0 tx=0).stop 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1e345d640 1 -- 172.21.15.79:0/1685000288 shutdown_connections 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1e345d640 1 --2- 172.21.15.79:0/1685000288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc072020 0x7fa1dc0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1e345d640 1 --2- 172.21.15.79:0/1685000288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 0x7fa1dc0b43b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1e345d640 1 -- 172.21.15.79:0/1685000288 >> 172.21.15.79:0/1685000288 conn(0x7fa1dc0b1980 msgr2=0x7fa1dc0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1e345d640 1 -- 172.21.15.79:0/1685000288 shutdown_connections 2024-06-10T00:25:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.268+0000 7fa1e345d640 1 -- 172.21.15.79:0/1685000288 wait complete. 2024-06-10T00:25:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.269+0000 7fa1e345d640 1 Processor -- start 2024-06-10T00:25:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.269+0000 7fa1e345d640 1 -- start start 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e345d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc072020 0x7fa1dc1f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e345d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0af420 0x7fa1dc09c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e345d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 0x7fa1dc09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e345d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0ced70 con 0x7fa1dc072020 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e345d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0cea90 con 0x7fa1dc15a810 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e345d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc0cf050 con 0x7fa1dc0af420 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e11f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc072020 0x7fa1dc1f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e11f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc072020 0x7fa1dc1f3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50200/0 (socket says 172.21.15.79:50200) 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e11f9640 1 -- 172.21.15.79:0/2151248491 learned_addr learned my addr 172.21.15.79:0/2151248491 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e09f8640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0af420 0x7fa1dc09c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.270+0000 7fa1e19fa640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 0x7fa1dc09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e11f9640 1 -- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0af420 msgr2=0x7fa1dc09c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e11f9640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0af420 0x7fa1dc09c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e11f9640 1 -- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 msgr2=0x7fa1dc09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e11f9640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 0x7fa1dc09aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e11f9640 1 -- 172.21.15.79:0/2151248491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc09c840 con 0x7fa1dc072020 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e19fa640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc15a810 0x7fa1dc09aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e11f9640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc072020 0x7fa1dc1f3f80 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8035040 tx=0x7fa1d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8037040 con 0x7fa1dc072020 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d8042070 con 0x7fa1dc072020 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc09b260 con 0x7fa1dc072020 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d803b930 con 0x7fa1dc072020 2024-06-10T00:25:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.271+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc09bb00 con 0x7fa1dc072020 2024-06-10T00:25:25.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.272+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1dc09b650 con 0x7fa1dc072020 2024-06-10T00:25:25.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.273+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1d803bad0 con 0x7fa1dc072020 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.273+0000 7fa1d1ffb640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c006be30 0x7fa1c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.273+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fa1d80ab670 con 0x7fa1dc072020 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.273+0000 7fa1e09f8640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c006be30 0x7fa1c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.273+0000 7fa1d1ffb640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7fa1c0072410 0x7fa1c0074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.273+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1c0074f20 con 0x7fa1c0072410 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.273+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fa1d80b2050 con 0x7fa1dc072020 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.274+0000 7fa1e09f8640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c006be30 0x7fa1c006e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc158e30 tx=0x7fa1cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.274+0000 7fa1e19fa640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7fa1c0072410 0x7fa1c0074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.274+0000 7fa1e19fa640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7fa1c0072410 0x7fa1c0074850 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.275+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 <== osd.4 v2:172.21.15.117:6824/279504764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1c0074f20 con 0x7fa1c0072410 2024-06-10T00:25:25.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.287+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 --> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa1dc0b3cb0 con 0x7fa1c0072410 2024-06-10T00:25:25.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1d1ffb640 1 -- 172.21.15.79:0/2151248491 <== osd.4 v2:172.21.15.117:6824/279504764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa1dc0b3cb0 con 0x7fa1c0072410 2024-06-10T00:25:25.288 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-10T00:25:25.288 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7fa1c0072410 msgr2=0x7fa1c0074850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e345d640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.117:6824/279504764,v1:172.21.15.117:6825/279504764] conn(0x7fa1c0072410 0x7fa1c0074850 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c006be30 msgr2=0x7fa1c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e345d640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fa1c006be30 0x7fa1c006e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc158e30 tx=0x7fa1cc009040 comp rx=0 tx=0).stop 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc072020 msgr2=0x7fa1dc1f3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e345d640 1 --2- 172.21.15.79:0/2151248491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc072020 0x7fa1dc1f3f80 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8035040 tx=0x7fa1d80046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e19fa640 1 -- 172.21.15.79:0/2151248491 reap_dead start 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 shutdown_connections 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.288+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 >> 172.21.15.79:0/2151248491 conn(0x7fa1dc0b1980 msgr2=0x7fa1dc06cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.289+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 shutdown_connections 2024-06-10T00:25:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.289+0000 7fa1e345d640 1 -- 172.21.15.79:0/2151248491 wait complete. 2024-06-10T00:25:25.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-06-10T00:25:25.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.399+0000 7fcd8ef1b640 1 Processor -- start 2024-06-10T00:25:25.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.400+0000 7fcd8ef1b640 1 -- start start 2024-06-10T00:25:25.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.400+0000 7fcd8ef1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 0x7fcd8815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.400+0000 7fcd8ef1b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd880d0ad0 con 0x7fcd880cef70 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.400+0000 7fcd8ef1b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8815f890 con 0x7fcd880d1fc0 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.400+0000 7fcd8ef1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd880d13e0 con 0x7fcd880d2680 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.400+0000 7fcd8d4b8640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcd880cef70 0x7fcd880cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44856/0 (socket says 172.21.15.79:44856) 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/2219600392 learned_addr learned my addr 172.21.15.79:0/2219600392 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151165383 0 0) 0x7fcd880d0ad0 con 0x7fcd880cef70 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8ccb7640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 0x7fcd8815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd70003520 con 0x7fcd880cef70 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3177561017 0 0) 0x7fcd70003520 con 0x7fcd880cef70 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 msgr2=0x7fcd8815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 0x7fcd8815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 >> v1:172.21.15.117:6789/0 conn(0x7fcd880d1fc0 legacy=0x7fcd880d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880d0d90 con 0x7fcd880cef70 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8ccb7640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 0x7fcd8815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fcd80001670 con 0x7fcd880cef70 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 >> v1:172.21.15.79:6789/0 conn(0x7fcd880cef70 legacy=0x7fcd880cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd700039e0 0x7fcd70003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 0x7fcd70004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd70004d40 0x7fcd700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880d13e0 con 0x7fcd70004d40 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7000bad0 con 0x7fcd700039e0 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7000bcd0 con 0x7fcd880d2680 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8d4b8640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd70004d40 0x7fcd700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8ccb7640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd700039e0 0x7fcd70003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd87fff640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 0x7fcd70004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 msgr2=0x7fcd70004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8d4b8640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd880d2680 0x7fcd70004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd700039e0 msgr2=0x7fcd70003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8d4b8640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd700039e0 0x7fcd70003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.401+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/2219600392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd70003520 con 0x7fcd70004d40 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.402+0000 7fcd8d4b8640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd70004d40 0x7fcd700051c0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001eb0 tx=0x7fcd70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34352bd84d04c78 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.402+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80007d30 con 0x7fcd70004d40 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.402+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd800058d0 con 0x7fcd70004d40 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.402+0000 7fcd877fe640 1 -- 172.21.15.79:0/2219600392 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80005ce0 con 0x7fcd70004d40 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.403+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/2219600392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd70004d40 msgr2=0x7fcd700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.403+0000 7fcd8ef1b640 1 --2- 172.21.15.79:0/2219600392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd70004d40 0x7fcd700051c0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001eb0 tx=0x7fcd70005830 comp rx=0 tx=0).stop 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.403+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/2219600392 reap_dead start 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.403+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/2219600392 shutdown_connections 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.403+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/2219600392 >> 172.21.15.79:0/2219600392 conn(0x7fcd8809d3f0 msgr2=0x7fcd880d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:25.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.403+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/2219600392 shutdown_connections 2024-06-10T00:25:25.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.403+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/2219600392 wait complete. 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.404+0000 7fcd8ef1b640 1 Processor -- start 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.404+0000 7fcd8ef1b640 1 -- start start 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8ef1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd70004d40 0x7fcd881f88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8ef1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8814d5f0 0x7fcd881f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8ef1b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd88161050 0x7fcd881614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8ef1b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880d4f00 con 0x7fcd88161050 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8ef1b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880d2400 con 0x7fcd70004d40 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8ef1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd880d1870 con 0x7fcd8814d5f0 2024-06-10T00:25:25.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd88161050 0x7fcd881614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd88161050 0x7fcd881614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50226/0 (socket says 172.21.15.79:50226) 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/63830756 learned_addr learned my addr 172.21.15.79:0/63830756 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd87fff640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8814d5f0 0x7fcd881f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8ccb7640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd70004d40 0x7fcd881f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8814d5f0 msgr2=0x7fcd881f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8814d5f0 0x7fcd881f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd70004d40 msgr2=0x7fcd881f88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd70004d40 0x7fcd881f88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 -- 172.21.15.79:0/63830756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880b5f90 con 0x7fcd88161050 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd87fff640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8814d5f0 0x7fcd881f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.405+0000 7fcd8d4b8640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd88161050 0x7fcd881614d0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001eb0 tx=0x7fcd80001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.406+0000 7fcd857fa640 1 -- 172.21.15.79:0/63830756 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80042070 con 0x7fcd88161050 2024-06-10T00:25:25.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.406+0000 7fcd857fa640 1 -- 172.21.15.79:0/63830756 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd80007d10 con 0x7fcd88161050 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.406+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd881f7e00 con 0x7fcd88161050 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.406+0000 7fcd857fa640 1 -- 172.21.15.79:0/63830756 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80038040 con 0x7fcd88161050 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.406+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd881f83c0 con 0x7fcd88161050 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.407+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd881f85c0 con 0x7fcd88161050 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.407+0000 7fcd857fa640 1 -- 172.21.15.79:0/63830756 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd80045070 con 0x7fcd88161050 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.408+0000 7fcd857fa640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd7406be30 0x7fcd7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.408+0000 7fcd857fa640 1 -- 172.21.15.79:0/63830756 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fcd800a9df0 con 0x7fcd88161050 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.408+0000 7fcd8ccb7640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd7406be30 0x7fcd7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.408+0000 7fcd8ccb7640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd7406be30 0x7fcd7406e2f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcd78006fd0 tx=0x7fcd78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.412+0000 7fcd857fa640 1 -- 172.21.15.79:0/63830756 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcd881f85c0 con 0x7fcd88161050 2024-06-10T00:25:25.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.590+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcd88068430 con 0x7fcd7406be30 2024-06-10T00:25:25.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.591+0000 7fcd857fa640 1 -- 172.21.15.79:0/63830756 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcd88068430 con 0x7fcd7406be30 2024-06-10T00:25:25.591 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 4 to deep-scrub 2024-06-10T00:25:25.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd7406be30 msgr2=0x7fcd7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd7406be30 0x7fcd7406e2f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcd78006fd0 tx=0x7fcd78008040 comp rx=0 tx=0).stop 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd88161050 msgr2=0x7fcd881614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd88161050 0x7fcd881614d0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001eb0 tx=0x7fcd80001a40 comp rx=0 tx=0).stop 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 shutdown_connections 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fcd7406be30 0x7fcd7406e2f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd88161050 0x7fcd881614d0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8814d5f0 0x7fcd881f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 --2- 172.21.15.79:0/63830756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd70004d40 0x7fcd881f88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 >> 172.21.15.79:0/63830756 conn(0x7fcd8809d3f0 msgr2=0x7fcd8815a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 shutdown_connections 2024-06-10T00:25:25.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.593+0000 7fcd8ef1b640 1 -- 172.21.15.79:0/63830756 wait complete. 2024-06-10T00:25:25.603 INFO:tasks.ceph:Scrubbing osd.5 2024-06-10T00:25:25.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-06-10T00:25:25.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.707+0000 7f067b8e1640 1 Processor -- start 2024-06-10T00:25:25.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.707+0000 7f067b8e1640 1 -- start start 2024-06-10T00:25:25.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f067b8e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0674155590 0x7f067415b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f067b8e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06740cf370 0x7f06740ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f067b8e1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06740acd40 con 0x7f067415b9a0 2024-06-10T00:25:25.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f067b8e1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f067415bfe0 con 0x7f06740cf370 2024-06-10T00:25:25.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f067b8e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f067415c2c0 con 0x7f0674155590 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f067967d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0674155590 0x7f067415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f0679e7e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06740cf370 0x7f06740ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f067967d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0674155590 0x7f067415b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.79:41276/0 (socket says 172.21.15.79:41276) 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f067967d640 1 -- 172.21.15.79:0/700698017 learned_addr learned my addr 172.21.15.79:0/700698017 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.708+0000 7f0678e7c640 1 --1- 172.21.15.79:0/700698017 >> v1:172.21.15.117:6789/0 conn(0x7f067415b9a0 0x7f06740cec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.79:52638/0 (socket says 172.21.15.79:52638) 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.709+0000 7f067967d640 1 -- 172.21.15.79:0/700698017 >> v2:172.21.15.117:3300/0 conn(0x7f06740cf370 msgr2=0x7f06740ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.709+0000 7f067967d640 1 --2- 172.21.15.79:0/700698017 >> v2:172.21.15.117:3300/0 conn(0x7f06740cf370 0x7f06740ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.709+0000 7f067967d640 1 -- 172.21.15.79:0/700698017 >> v1:172.21.15.117:6789/0 conn(0x7f067415b9a0 legacy=0x7f06740cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.709+0000 7f067967d640 1 -- 172.21.15.79:0/700698017 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06740ad000 con 0x7f0674155590 2024-06-10T00:25:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.709+0000 7f067967d640 1 --2- 172.21.15.79:0/700698017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0674155590 0x7f067415b460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0670009870 tx=0x7f067002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6be708ee6bc900 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f066bfff640 1 -- 172.21.15.79:0/700698017 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670037070 con 0x7f0674155590 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f066bfff640 1 -- 172.21.15.79:0/700698017 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0670032440 con 0x7f0674155590 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f066bfff640 1 -- 172.21.15.79:0/700698017 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670032810 con 0x7f0674155590 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f067b8e1640 1 -- 172.21.15.79:0/700698017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0674155590 msgr2=0x7f067415b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f067b8e1640 1 --2- 172.21.15.79:0/700698017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0674155590 0x7f067415b460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0670009870 tx=0x7f067002a270 comp rx=0 tx=0).stop 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f067b8e1640 1 -- 172.21.15.79:0/700698017 shutdown_connections 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f067b8e1640 1 --2- 172.21.15.79:0/700698017 >> v2:172.21.15.117:3300/0 conn(0x7f06740cf370 0x7f06740ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f067b8e1640 1 --2- 172.21.15.79:0/700698017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0674155590 0x7f067415b460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f067b8e1640 1 -- 172.21.15.79:0/700698017 >> 172.21.15.79:0/700698017 conn(0x7f06740b1980 msgr2=0x7f06740b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f067b8e1640 1 -- 172.21.15.79:0/700698017 shutdown_connections 2024-06-10T00:25:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.710+0000 7f067b8e1640 1 -- 172.21.15.79:0/700698017 wait complete. 2024-06-10T00:25:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.711+0000 7f067b8e1640 1 Processor -- start 2024-06-10T00:25:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.711+0000 7f067b8e1640 1 -- start start 2024-06-10T00:25:25.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f067b8e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06740cf370 0x7f067414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f067b8e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0674155590 0x7f067415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f067b8e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067415b9a0 0x7f067415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f067b8e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06740add40 con 0x7f0674155590 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f067b8e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06740b26d0 con 0x7f067415b9a0 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f067b8e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06740adec0 con 0x7f06740cf370 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f0678e7c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0674155590 0x7f067415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f0678e7c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0674155590 0x7f067415a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50232/0 (socket says 172.21.15.79:50232) 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f0678e7c640 1 -- 172.21.15.79:0/3500161916 learned_addr learned my addr 172.21.15.79:0/3500161916 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f067967d640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06740cf370 0x7f067414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.712+0000 7f0679e7e640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067415b9a0 0x7f067415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0678e7c640 1 -- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06740cf370 msgr2=0x7f067414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0678e7c640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06740cf370 0x7f067414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0678e7c640 1 -- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067415b9a0 msgr2=0x7f067415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0678e7c640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067415b9a0 0x7f067415ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0678e7c640 1 -- 172.21.15.79:0/3500161916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06741f6610 con 0x7f0674155590 2024-06-10T00:25:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0679e7e640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067415b9a0 0x7f067415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0678e7c640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0674155590 0x7f067415a640 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f066400c3e0 tx=0x7f066400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640074e0 con 0x7f0674155590 2024-06-10T00:25:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0664007680 con 0x7f0674155590 2024-06-10T00:25:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640049e0 con 0x7f0674155590 2024-06-10T00:25:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06741f5850 con 0x7f0674155590 2024-06-10T00:25:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.713+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06741f5e10 con 0x7f0674155590 2024-06-10T00:25:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.714+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f067409da70 con 0x7f0674155590 2024-06-10T00:25:25.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.714+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f066401a020 con 0x7f0674155590 2024-06-10T00:25:25.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.715+0000 7f0669ffb640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f065806be30 0x7f065806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.715+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f066408a500 con 0x7f0674155590 2024-06-10T00:25:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.715+0000 7f067967d640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f065806be30 0x7f065806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.715+0000 7f0669ffb640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f0658072410 0x7f0658074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.715+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0658074f20 con 0x7f0658072410 2024-06-10T00:25:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.715+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f0664091050 con 0x7f0674155590 2024-06-10T00:25:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.715+0000 7f0679e7e640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f0658072410 0x7f0658074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.715+0000 7f067967d640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f065806be30 0x7f065806e2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0670034000 tx=0x7f067002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.716+0000 7f0679e7e640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f0658072410 0x7f0658074850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.717+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 <== osd.5 v2:172.21.15.117:6800/419453692 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0658074f20 con 0x7f0658072410 2024-06-10T00:25:25.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.730+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 --> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0674068540 con 0x7f0658072410 2024-06-10T00:25:25.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.730+0000 7f0669ffb640 1 -- 172.21.15.79:0/3500161916 <== osd.5 v2:172.21.15.117:6800/419453692 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0674068540 con 0x7f0658072410 2024-06-10T00:25:25.730 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:25.730 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-10T00:25:25.730 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.730+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f0658072410 msgr2=0x7f0658074850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.117:6800/419453692,v1:172.21.15.117:6801/419453692] conn(0x7f0658072410 0x7f0658074850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f065806be30 msgr2=0x7f065806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f065806be30 0x7f065806e2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0670034000 tx=0x7f067002e000 comp rx=0 tx=0).stop 2024-06-10T00:25:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0674155590 msgr2=0x7f067415a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 --2- 172.21.15.79:0/3500161916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0674155590 0x7f067415a640 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f066400c3e0 tx=0x7f066400c8a0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f0679e7e640 1 -- 172.21.15.79:0/3500161916 reap_dead start 2024-06-10T00:25:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 shutdown_connections 2024-06-10T00:25:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 >> 172.21.15.79:0/3500161916 conn(0x7f06740b1980 msgr2=0x7f06740b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 shutdown_connections 2024-06-10T00:25:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.731+0000 7f067b8e1640 1 -- 172.21.15.79:0/3500161916 wait complete. 2024-06-10T00:25:25.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-06-10T00:25:25.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.841+0000 7f5b068ee640 1 Processor -- start 2024-06-10T00:25:25.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.841+0000 7f5b068ee640 1 -- start start 2024-06-10T00:25:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.841+0000 7f5b068ee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b000d2680 0x7f5b0015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.841+0000 7f5b068ee640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b000d1fc0 0x7f5b000d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.841+0000 7f5b068ee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b000d2fa0 con 0x7f5b00161fa0 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.841+0000 7f5b068ee640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5b000cff80 con 0x7f5b000d1fc0 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.841+0000 7f5b068ee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5b000d13e0 con 0x7f5b000d2680 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.842+0000 7f5aff7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b000d1fc0 0x7f5b000d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.842+0000 7f5aff7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b000d1fc0 0x7f5b000d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50238/0 (socket says 172.21.15.79:50238) 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.842+0000 7f5aff7fe640 1 -- 172.21.15.79:0/451005021 learned_addr learned my addr 172.21.15.79:0/451005021 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.842+0000 7f5afffff640 1 --2- 172.21.15.79:0/451005021 >> v2:172.21.15.117:3300/0 conn(0x7f5b000d2680 0x7f5b0015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.842+0000 7f5aff7fe640 1 -- 172.21.15.79:0/451005021 >> v2:172.21.15.117:3300/0 conn(0x7f5b000d2680 msgr2=0x7f5b0015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.842+0000 7f5aff7fe640 1 --2- 172.21.15.79:0/451005021 >> v2:172.21.15.117:3300/0 conn(0x7f5b000d2680 0x7f5b0015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.842+0000 7f5aff7fe640 1 -- 172.21.15.79:0/451005021 >> v1:172.21.15.117:6789/0 conn(0x7f5b00161fa0 legacy=0x7f5b001623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.842+0000 7f5aff7fe640 1 -- 172.21.15.79:0/451005021 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b000d0ad0 con 0x7f5b000d1fc0 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5aff7fe640 1 --2- 172.21.15.79:0/451005021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b000d2a60 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5b0008ca40 tx=0x7f5ae802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69af58ef476e704 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5afeffd640 1 -- 172.21.15.79:0/451005021 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8037070 con 0x7f5b000d1fc0 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5afeffd640 1 -- 172.21.15.79:0/451005021 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae8032440 con 0x7f5b000d1fc0 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5afeffd640 1 -- 172.21.15.79:0/451005021 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8032810 con 0x7f5b000d1fc0 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5b068ee640 1 -- 172.21.15.79:0/451005021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 msgr2=0x7f5b000d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5b068ee640 1 --2- 172.21.15.79:0/451005021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b000d2a60 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5b0008ca40 tx=0x7f5ae802a270 comp rx=0 tx=0).stop 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5b068ee640 1 -- 172.21.15.79:0/451005021 shutdown_connections 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5b068ee640 1 --2- 172.21.15.79:0/451005021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b000d2a60 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5b068ee640 1 --2- 172.21.15.79:0/451005021 >> v2:172.21.15.117:3300/0 conn(0x7f5b000d2680 0x7f5b0015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5b068ee640 1 -- 172.21.15.79:0/451005021 >> 172.21.15.79:0/451005021 conn(0x7f5b0009d3f0 msgr2=0x7f5b000d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5b068ee640 1 -- 172.21.15.79:0/451005021 shutdown_connections 2024-06-10T00:25:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.843+0000 7f5b068ee640 1 -- 172.21.15.79:0/451005021 wait complete. 2024-06-10T00:25:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.845+0000 7f5b068ee640 1 Processor -- start 2024-06-10T00:25:25.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.845+0000 7f5b068ee640 1 -- start start 2024-06-10T00:25:25.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.845+0000 7f5b068ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b001526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.845+0000 7f5b068ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b000d2680 0x7f5b0015c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.845+0000 7f5b068ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b00161fa0 0x7f5b001f8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.845+0000 7f5b068ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b000d1070 con 0x7f5b000d1fc0 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.845+0000 7f5b068ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b000d0d90 con 0x7f5b00161fa0 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.845+0000 7f5b068ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5b000d2400 con 0x7f5b000d2680 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b001526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b001526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50250/0 (socket says 172.21.15.79:50250) 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 -- 172.21.15.79:0/3800004521 learned_addr learned my addr 172.21.15.79:0/3800004521 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5b04e8b640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b00161fa0 0x7f5b001f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5aff7fe640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b000d2680 0x7f5b0015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 -- 172.21.15.79:0/3800004521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b000d2680 msgr2=0x7f5b0015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b000d2680 0x7f5b0015c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 -- 172.21.15.79:0/3800004521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b00161fa0 msgr2=0x7f5b001f8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b00161fa0 0x7f5b001f8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:25.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 -- 172.21.15.79:0/3800004521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b00152c10 con 0x7f5b000d1fc0 2024-06-10T00:25:25.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afffff640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b001526d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f5af000d800 tx=0x7f5af000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afcff9640 1 -- 172.21.15.79:0/3800004521 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af000b6c0 con 0x7f5b000d1fc0 2024-06-10T00:25:25.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afcff9640 1 -- 172.21.15.79:0/3800004521 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af0019070 con 0x7f5b000d1fc0 2024-06-10T00:25:25.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b001f89e0 con 0x7f5b000d1fc0 2024-06-10T00:25:25.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5afcff9640 1 -- 172.21.15.79:0/3800004521 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af000ba80 con 0x7f5b000d1fc0 2024-06-10T00:25:25.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.846+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b001f8fa0 con 0x7f5b000d1fc0 2024-06-10T00:25:25.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.847+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b00068430 con 0x7f5b000d1fc0 2024-06-10T00:25:25.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.848+0000 7f5afcff9640 1 -- 172.21.15.79:0/3800004521 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5af000bc20 con 0x7f5b000d1fc0 2024-06-10T00:25:25.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.848+0000 7f5afcff9640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ae006be30 0x7f5ae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:25.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.848+0000 7f5afcff9640 1 -- 172.21.15.79:0/3800004521 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f5af008b030 con 0x7f5b000d1fc0 2024-06-10T00:25:25.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.848+0000 7f5aff7fe640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ae006be30 0x7f5ae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:25.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.849+0000 7f5aff7fe640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ae006be30 0x7f5ae006e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8034000 tx=0x7f5ae802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:25.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:25.852+0000 7f5afcff9640 1 -- 172.21.15.79:0/3800004521 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5b00152c10 con 0x7f5b000d1fc0 2024-06-10T00:25:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.025+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f5b000ce580 con 0x7f5ae006be30 2024-06-10T00:25:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.026+0000 7f5afcff9640 1 -- 172.21.15.79:0/3800004521 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5b000ce580 con 0x7f5ae006be30 2024-06-10T00:25:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 5 to deep-scrub 2024-06-10T00:25:26.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ae006be30 msgr2=0x7f5ae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ae006be30 0x7f5ae006e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8034000 tx=0x7f5ae802e000 comp rx=0 tx=0).stop 2024-06-10T00:25:26.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 msgr2=0x7f5b001526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b001526d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f5af000d800 tx=0x7f5af000dcc0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 shutdown_connections 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f5ae006be30 0x7f5ae006e2f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b00161fa0 0x7f5b001f8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b000d2680 0x7f5b0015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 --2- 172.21.15.79:0/3800004521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b000d1fc0 0x7f5b001526d0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 >> 172.21.15.79:0/3800004521 conn(0x7f5b0009d3f0 msgr2=0x7f5b000b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 shutdown_connections 2024-06-10T00:25:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.028+0000 7f5b068ee640 1 -- 172.21.15.79:0/3800004521 wait complete. 2024-06-10T00:25:26.038 INFO:tasks.ceph:Scrubbing osd.6 2024-06-10T00:25:26.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-06-10T00:25:26.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.143+0000 7f101ea9e640 1 Processor -- start 2024-06-10T00:25:26.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.143+0000 7f101ea9e640 1 -- start start 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f101ea9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 0x7f1018166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f101ea9e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10180722a0 con 0x7f101815be50 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f101ea9e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1018072570 con 0x7f101815c740 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f101ea9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10180b3020 con 0x7f10180ccd30 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f101c83a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f101815be50 0x7f1018071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44872/0 (socket says 172.21.15.79:44872) 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f101c83a640 1 -- 172.21.15.79:0/827746748 learned_addr learned my addr 172.21.15.79:0/827746748 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477733135 0 0) 0x7f10180722a0 con 0x7f101815be50 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1000003520 con 0x7f101815be50 2024-06-10T00:25:26.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f101d03b640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 0x7f1018166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 307988634 0 0) 0x7f1000003520 con 0x7f101815be50 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 msgr2=0x7f1018166db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 0x7f1018166db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 >> v1:172.21.15.117:6789/0 conn(0x7f101815c740 legacy=0x7f10180cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1018072850 con 0x7f101815be50 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f10140019f0 con 0x7f101815be50 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 >> v1:172.21.15.79:6789/0 conn(0x7f101815be50 legacy=0x7f1018071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000039e0 0x7f1000003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1000004800 0x7f1000004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 0x7f10000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10180b3020 con 0x7f10000039e0 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f100000baa0 con 0x7f1000004800 2024-06-10T00:25:26.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f100000bca0 con 0x7f10180ccd30 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.144+0000 7f101c83a640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000039e0 0x7f1000003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f100ffff640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1000004800 0x7f1000004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f101d03b640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 0x7f10000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f101c83a640 1 -- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 msgr2=0x7f10000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f101c83a640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 0x7f10000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f101c83a640 1 -- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1000004800 msgr2=0x7f1000004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f101c83a640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1000004800 0x7f1000004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f101c83a640 1 -- 172.21.15.79:0/827746748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1000003520 con 0x7f10000039e0 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f101d03b640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10180ccd30 0x7f10000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.145+0000 7f101c83a640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000039e0 0x7f1000003e00 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f101400a810 tx=0x7f1000005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d079aec68812a4 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101400a460 con 0x7f10000039e0 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101402f070 con 0x7f10000039e0 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f100f7fe640 1 -- 172.21.15.79:0/827746748 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101402bc50 con 0x7f10000039e0 2024-06-10T00:25:26.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f101ea9e640 1 -- 172.21.15.79:0/827746748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000039e0 msgr2=0x7f1000003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f101ea9e640 1 --2- 172.21.15.79:0/827746748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000039e0 0x7f1000003e00 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f101400a810 tx=0x7f1000005830 comp rx=0 tx=0).stop 2024-06-10T00:25:26.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f101d03b640 1 -- 172.21.15.79:0/827746748 reap_dead start 2024-06-10T00:25:26.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f101ea9e640 1 -- 172.21.15.79:0/827746748 shutdown_connections 2024-06-10T00:25:26.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f101ea9e640 1 -- 172.21.15.79:0/827746748 >> 172.21.15.79:0/827746748 conn(0x7f10180b1980 msgr2=0x7f10180b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f101ea9e640 1 -- 172.21.15.79:0/827746748 shutdown_connections 2024-06-10T00:25:26.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.146+0000 7f101ea9e640 1 -- 172.21.15.79:0/827746748 wait complete. 2024-06-10T00:25:26.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.147+0000 7f101ea9e640 1 Processor -- start 2024-06-10T00:25:26.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.147+0000 7f101ea9e640 1 -- start start 2024-06-10T00:25:26.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f101ea9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10000039e0 0x7f101809d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f101ea9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101809c4b0 0x7f1018149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f101ea9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10180cae00 0x7f10180cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f101ea9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f101815c230 con 0x7f101809c4b0 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f101ea9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1018072e10 con 0x7f10180cae00 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f101ea9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f101815c3b0 con 0x7f10000039e0 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f100ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101809c4b0 0x7f1018149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f100ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101809c4b0 0x7f1018149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50266/0 (socket says 172.21.15.79:50266) 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.148+0000 7f100ffff640 1 -- 172.21.15.79:0/4142911973 learned_addr learned my addr 172.21.15.79:0/4142911973 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f101c83a640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10000039e0 0x7f101809d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f101d03b640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10180cae00 0x7f10180cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100ffff640 1 -- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10000039e0 msgr2=0x7f101809d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100ffff640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10000039e0 0x7f101809d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100ffff640 1 -- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10180cae00 msgr2=0x7f10180cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100ffff640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10180cae00 0x7f10180cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100ffff640 1 -- 172.21.15.79:0/4142911973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101814a320 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f101c83a640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10000039e0 0x7f101809d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f101d03b640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10180cae00 0x7f10180cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100ffff640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101809c4b0 0x7f1018149de0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f100800f850 tx=0x7f100800fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100800fe40 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1008018070 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10180cb750 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100800d730 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.149+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101809bcb0 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.150+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f101809c090 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.151+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f100800d8d0 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.151+0000 7f100d7fa640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f100406be30 0x7f100406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.151+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f100808ab90 con 0x7f101809c4b0 2024-06-10T00:25:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.151+0000 7f101c83a640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f100406be30 0x7f100406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.151+0000 7f100d7fa640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7f1004072410 0x7f1004074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.151+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1008019ec0 con 0x7f1004072410 2024-06-10T00:25:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.151+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f100808d290 con 0x7f101809c4b0 2024-06-10T00:25:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.151+0000 7f101c83a640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f100406be30 0x7f100406e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1014033000 tx=0x7f1014007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.152+0000 7f101d03b640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7f1004072410 0x7f1004074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.152+0000 7f101d03b640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7f1004072410 0x7f1004074850 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.153+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 <== osd.6 v2:172.21.15.117:6808/1306883621 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1008019ec0 con 0x7f1004072410 2024-06-10T00:25:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.166+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 --> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1018067d20 con 0x7f1004072410 2024-06-10T00:25:26.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.166+0000 7f100d7fa640 1 -- 172.21.15.79:0/4142911973 <== osd.6 v2:172.21.15.117:6808/1306883621 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1018067d20 con 0x7f1004072410 2024-06-10T00:25:26.166 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-10T00:25:26.166 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7f1004072410 msgr2=0x7f1004074850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.117:6808/1306883621,v1:172.21.15.117:6809/1306883621] conn(0x7f1004072410 0x7f1004074850 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f100406be30 msgr2=0x7f100406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f100406be30 0x7f100406e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1014033000 tx=0x7f1014007000 comp rx=0 tx=0).stop 2024-06-10T00:25:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101809c4b0 msgr2=0x7f1018149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 --2- 172.21.15.79:0/4142911973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f101809c4b0 0x7f1018149de0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f100800f850 tx=0x7f100800fd10 comp rx=0 tx=0).stop 2024-06-10T00:25:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101d03b640 1 -- 172.21.15.79:0/4142911973 reap_dead start 2024-06-10T00:25:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 shutdown_connections 2024-06-10T00:25:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 >> 172.21.15.79:0/4142911973 conn(0x7f10180b1980 msgr2=0x7f10180af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 shutdown_connections 2024-06-10T00:25:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.167+0000 7f101ea9e640 1 -- 172.21.15.79:0/4142911973 wait complete. 2024-06-10T00:25:26.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-06-10T00:25:26.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.279+0000 7fbc2e122640 1 Processor -- start 2024-06-10T00:25:26.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.279+0000 7fbc2e122640 1 -- start start 2024-06-10T00:25:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc2e122640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc280d2680 0x7fbc2815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc2e122640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc280cef70 0x7fbc280cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc2e122640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc280d0ad0 con 0x7fbc280d1fc0 2024-06-10T00:25:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc2e122640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbc280d13e0 con 0x7fbc280d2680 2024-06-10T00:25:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc2e122640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2815f890 con 0x7fbc280cef70 2024-06-10T00:25:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc26ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbc280d1fc0 0x7fbc280d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44878/0 (socket says 172.21.15.79:44878) 2024-06-10T00:25:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc26ffd640 1 -- 172.21.15.79:0/1138790888 learned_addr learned my addr 172.21.15.79:0/1138790888 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292952072 0 0) 0x7fbc280d0ad0 con 0x7fbc280d1fc0 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc277fe640 1 --2- 172.21.15.79:0/1138790888 >> v2:172.21.15.117:3300/0 conn(0x7fbc280d2680 0x7fbc2815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc10003520 con 0x7fbc280d1fc0 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc27fff640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc280cef70 0x7fbc280cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3006104971 0 0) 0x7fbc10003520 con 0x7fbc280d1fc0 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc280cef70 msgr2=0x7fbc280cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc280cef70 0x7fbc280cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 >> v2:172.21.15.117:3300/0 conn(0x7fbc280d2680 msgr2=0x7fbc2815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 --2- 172.21.15.79:0/1138790888 >> v2:172.21.15.117:3300/0 conn(0x7fbc280d2680 0x7fbc2815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc280d0d90 con 0x7fbc280d1fc0 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fbc1c001670 con 0x7fbc280d1fc0 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 >> v1:172.21.15.79:6789/0 conn(0x7fbc280d1fc0 legacy=0x7fbc280d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc100039b0 0x7fbc10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc10004800 0x7fbc10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100051c0 0x7fbc1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc280d13e0 con 0x7fbc100039b0 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2815f890 con 0x7fbc10004800 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1000c000 con 0x7fbc100051c0 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc27fff640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc280cef70 0x7fbc280cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc277fe640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc100039b0 0x7fbc10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.280+0000 7fbc26ffd640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc10004800 0x7fbc10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc27fff640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100051c0 0x7fbc1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc277fe640 1 -- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100051c0 msgr2=0x7fbc1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc277fe640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100051c0 0x7fbc1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc277fe640 1 -- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc10004800 msgr2=0x7fbc10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc277fe640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc10004800 0x7fbc10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc277fe640 1 -- 172.21.15.79:0/1138790888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc10003520 con 0x7fbc100039b0 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc26ffd640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc10004800 0x7fbc10004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc27fff640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100051c0 0x7fbc1000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc277fe640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc100039b0 0x7fbc10003dd0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800ba60 tx=0x7fbc10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fd6dce0875e8ac server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18030070 con 0x7fbc100039b0 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1802ae40 con 0x7fbc100039b0 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.281+0000 7fbc267fc640 1 -- 172.21.15.79:0/1138790888 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800b600 con 0x7fbc100039b0 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.282+0000 7fbc2e122640 1 -- 172.21.15.79:0/1138790888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc100039b0 msgr2=0x7fbc10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.282+0000 7fbc2e122640 1 --2- 172.21.15.79:0/1138790888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc100039b0 0x7fbc10003dd0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800ba60 tx=0x7fbc10005830 comp rx=0 tx=0).stop 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.282+0000 7fbc27fff640 1 -- 172.21.15.79:0/1138790888 reap_dead start 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.282+0000 7fbc2e122640 1 -- 172.21.15.79:0/1138790888 shutdown_connections 2024-06-10T00:25:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.282+0000 7fbc2e122640 1 -- 172.21.15.79:0/1138790888 >> 172.21.15.79:0/1138790888 conn(0x7fbc2809d3f0 msgr2=0x7fbc280d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.282+0000 7fbc2e122640 1 -- 172.21.15.79:0/1138790888 shutdown_connections 2024-06-10T00:25:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.282+0000 7fbc2e122640 1 -- 172.21.15.79:0/1138790888 wait complete. 2024-06-10T00:25:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.283+0000 7fbc2e122640 1 Processor -- start 2024-06-10T00:25:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.283+0000 7fbc2e122640 1 -- start start 2024-06-10T00:25:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc2e122640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100039b0 0x7fbc281591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc2e122640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc280c9a90 0x7fbc280c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc2e122640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2815fb90 0x7fbc28160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc2e122640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc280d4f00 con 0x7fbc2815fb90 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc2e122640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc280d2400 con 0x7fbc280c9a90 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc2e122640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc280d1870 con 0x7fbc100039b0 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2815fb90 0x7fbc28160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2815fb90 0x7fbc28160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50276/0 (socket says 172.21.15.79:50276) 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc27fff640 1 -- 172.21.15.79:0/609788248 learned_addr learned my addr 172.21.15.79:0/609788248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc26ffd640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc280c9a90 0x7fbc280c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc277fe640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100039b0 0x7fbc281591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc27fff640 1 -- 172.21.15.79:0/609788248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100039b0 msgr2=0x7fbc281591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc27fff640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100039b0 0x7fbc281591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc27fff640 1 -- 172.21.15.79:0/609788248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc280c9a90 msgr2=0x7fbc280c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc27fff640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc280c9a90 0x7fbc280c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.284+0000 7fbc27fff640 1 -- 172.21.15.79:0/609788248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc280b7b40 con 0x7fbc2815fb90 2024-06-10T00:25:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.285+0000 7fbc27fff640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2815fb90 0x7fbc28160010 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fbc280cec20 tx=0x7fbc20004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.285+0000 7fbc0ffff640 1 -- 172.21.15.79:0/609788248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20019070 con 0x7fbc2815fb90 2024-06-10T00:25:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.285+0000 7fbc0ffff640 1 -- 172.21.15.79:0/609788248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc20007cb0 con 0x7fbc2815fb90 2024-06-10T00:25:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.285+0000 7fbc0ffff640 1 -- 172.21.15.79:0/609788248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20007e60 con 0x7fbc2815fb90 2024-06-10T00:25:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.285+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc280ca570 con 0x7fbc2815fb90 2024-06-10T00:25:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.285+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc281f4790 con 0x7fbc2815fb90 2024-06-10T00:25:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.286+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc28068430 con 0x7fbc2815fb90 2024-06-10T00:25:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.286+0000 7fbc0ffff640 1 -- 172.21.15.79:0/609788248 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc2001c070 con 0x7fbc2815fb90 2024-06-10T00:25:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.287+0000 7fbc0ffff640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc1406be60 0x7fbc1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.287+0000 7fbc0ffff640 1 -- 172.21.15.79:0/609788248 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fbc2008a850 con 0x7fbc2815fb90 2024-06-10T00:25:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.287+0000 7fbc277fe640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc1406be60 0x7fbc1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.287+0000 7fbc277fe640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc1406be60 0x7fbc1406e320 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800ba30 tx=0x7fbc18030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.291+0000 7fbc0ffff640 1 -- 172.21.15.79:0/609788248 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc280b7b40 con 0x7fbc2815fb90 2024-06-10T00:25:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.464+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbc280d04e0 con 0x7fbc1406be60 2024-06-10T00:25:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.464+0000 7fbc0ffff640 1 -- 172.21.15.79:0/609788248 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbc280d04e0 con 0x7fbc1406be60 2024-06-10T00:25:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 6 to deep-scrub 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc1406be60 msgr2=0x7fbc1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc1406be60 0x7fbc1406e320 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800ba30 tx=0x7fbc18030000 comp rx=0 tx=0).stop 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2815fb90 msgr2=0x7fbc28160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2815fb90 0x7fbc28160010 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fbc280cec20 tx=0x7fbc20004840 comp rx=0 tx=0).stop 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 shutdown_connections 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fbc1406be60 0x7fbc1406e320 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2815fb90 0x7fbc28160010 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc280c9a90 0x7fbc280c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 --2- 172.21.15.79:0/609788248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc100039b0 0x7fbc281591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 >> 172.21.15.79:0/609788248 conn(0x7fbc2809d3f0 msgr2=0x7fbc2815a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 shutdown_connections 2024-06-10T00:25:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.466+0000 7fbc2e122640 1 -- 172.21.15.79:0/609788248 wait complete. 2024-06-10T00:25:26.476 INFO:tasks.ceph:Scrubbing osd.7 2024-06-10T00:25:26.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-06-10T00:25:26.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.580+0000 7fd1e687b640 1 Processor -- start 2024-06-10T00:25:26.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.580+0000 7fd1e687b640 1 -- start start 2024-06-10T00:25:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.580+0000 7fd1e687b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1e0155590 0x7fd1e015b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.580+0000 7fd1e687b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1e00cf370 0x7fd1e00ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.580+0000 7fd1e687b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e00acd40 con 0x7fd1e015b9a0 2024-06-10T00:25:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.580+0000 7fd1e687b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd1e015bfe0 con 0x7fd1e00cf370 2024-06-10T00:25:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.580+0000 7fd1e687b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd1e015c2c0 con 0x7fd1e0155590 2024-06-10T00:25:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1df7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd1e015b9a0 0x7fd1e00cec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44880/0 (socket says 172.21.15.79:44880) 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1e4e18640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1e00cf370 0x7fd1e00ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1df7fe640 1 -- 172.21.15.79:0/376609456 learned_addr learned my addr 172.21.15.79:0/376609456 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1dffff640 1 --2- 172.21.15.79:0/376609456 >> v2:172.21.15.117:3300/0 conn(0x7fd1e0155590 0x7fd1e015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1e4e18640 1 -- 172.21.15.79:0/376609456 >> v2:172.21.15.117:3300/0 conn(0x7fd1e0155590 msgr2=0x7fd1e015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1e4e18640 1 --2- 172.21.15.79:0/376609456 >> v2:172.21.15.117:3300/0 conn(0x7fd1e0155590 0x7fd1e015b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1e4e18640 1 -- 172.21.15.79:0/376609456 >> v1:172.21.15.79:6789/0 conn(0x7fd1e015b9a0 legacy=0x7fd1e00cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1e4e18640 1 -- 172.21.15.79:0/376609456 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e00ad000 con 0x7fd1e00cf370 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.581+0000 7fd1deffd640 1 -- 172.21.15.79:0/376609456 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812723012 0 0) 0x7fd1e00acd40 con 0x7fd1e015b9a0 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e4e18640 1 --2- 172.21.15.79:0/376609456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e00cf370 0x7fd1e00ad800 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0074220 tx=0x7fd1d802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf095cd9a34274c server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1deffd640 1 -- 172.21.15.79:0/376609456 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8007740 con 0x7fd1e00cf370 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1deffd640 1 -- 172.21.15.79:0/376609456 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d80078e0 con 0x7fd1e00cf370 2024-06-10T00:25:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1deffd640 1 -- 172.21.15.79:0/376609456 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8007cb0 con 0x7fd1e00cf370 2024-06-10T00:25:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e687b640 1 -- 172.21.15.79:0/376609456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e00cf370 msgr2=0x7fd1e00ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e687b640 1 --2- 172.21.15.79:0/376609456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e00cf370 0x7fd1e00ad800 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0074220 tx=0x7fd1d802a680 comp rx=0 tx=0).stop 2024-06-10T00:25:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e687b640 1 -- 172.21.15.79:0/376609456 shutdown_connections 2024-06-10T00:25:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e687b640 1 --2- 172.21.15.79:0/376609456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e00cf370 0x7fd1e00ad800 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e687b640 1 --2- 172.21.15.79:0/376609456 >> v2:172.21.15.117:3300/0 conn(0x7fd1e0155590 0x7fd1e015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e687b640 1 -- 172.21.15.79:0/376609456 >> 172.21.15.79:0/376609456 conn(0x7fd1e00b1980 msgr2=0x7fd1e00b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e687b640 1 -- 172.21.15.79:0/376609456 shutdown_connections 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.582+0000 7fd1e687b640 1 -- 172.21.15.79:0/376609456 wait complete. 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.583+0000 7fd1e687b640 1 Processor -- start 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1e687b640 1 -- start start 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1e687b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1e00cf370 0x7fd1e01f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1e687b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0155590 0x7fd1e015d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1e687b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1e015b9a0 0x7fd1e00ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1e687b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e00add40 con 0x7fd1e0155590 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1e687b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e00b26d0 con 0x7fd1e015b9a0 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1e687b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e00adec0 con 0x7fd1e00cf370 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0155590 0x7fd1e015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0155590 0x7fd1e015d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50296/0 (socket says 172.21.15.79:50296) 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.584+0000 7fd1df7fe640 1 -- 172.21.15.79:0/3263545941 learned_addr learned my addr 172.21.15.79:0/3263545941 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1e4e18640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1e015b9a0 0x7fd1e00ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1dffff640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1e00cf370 0x7fd1e01f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1df7fe640 1 -- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1e00cf370 msgr2=0x7fd1e01f0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1df7fe640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1e00cf370 0x7fd1e01f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1df7fe640 1 -- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1e015b9a0 msgr2=0x7fd1e00ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1df7fe640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1e015b9a0 0x7fd1e00ae460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1df7fe640 1 -- 172.21.15.79:0/3263545941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e015dff0 con 0x7fd1e0155590 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1df7fe640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0155590 0x7fd1e015d200 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400c430 tx=0x7fd1d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40074e0 con 0x7fd1e0155590 2024-06-10T00:25:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d40047e0 con 0x7fd1e0155590 2024-06-10T00:25:26.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e015e2d0 con 0x7fd1e0155590 2024-06-10T00:25:26.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4004bd0 con 0x7fd1e0155590 2024-06-10T00:25:26.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.585+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e009bee0 con 0x7fd1e0155590 2024-06-10T00:25:26.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.586+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd1e0068540 con 0x7fd1e0155590 2024-06-10T00:25:26.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1d4011070 con 0x7fd1e0155590 2024-06-10T00:25:26.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1dcff9640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fd1d408aa30 con 0x7fd1e0155590 2024-06-10T00:25:26.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1dffff640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1dcff9640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fd1cc072410 0x7fd1cc074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1cc074f20 con 0x7fd1cc072410 2024-06-10T00:25:26.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fd1d408f2c0 con 0x7fd1e0155590 2024-06-10T00:25:26.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1e4e18640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fd1cc072410 0x7fd1cc074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.587+0000 7fd1dffff640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0006fd0 tx=0x7fd1d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.588+0000 7fd1e4e18640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fd1cc072410 0x7fd1cc074850 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.589+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 <== osd.7 v2:172.21.15.117:6816/2099086267 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1cc074f20 con 0x7fd1cc072410 2024-06-10T00:25:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.601+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 --> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd1e0072d90 con 0x7fd1cc072410 2024-06-10T00:25:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.602+0000 7fd1dcff9640 1 -- 172.21.15.79:0/3263545941 <== osd.7 v2:172.21.15.117:6816/2099086267 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd1e0072d90 con 0x7fd1cc072410 2024-06-10T00:25:26.602 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-10T00:25:26.602 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-10T00:25:26.602 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-10T00:25:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.602+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fd1cc072410 msgr2=0x7fd1cc074850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.602+0000 7fd1e687b640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.117:6816/2099086267,v1:172.21.15.117:6817/2099086267] conn(0x7fd1cc072410 0x7fd1cc074850 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.602+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd1cc06be30 msgr2=0x7fd1cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.602+0000 7fd1e687b640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0006fd0 tx=0x7fd1d0008040 comp rx=0 tx=0).stop 2024-06-10T00:25:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.603+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0155590 msgr2=0x7fd1e015d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.603+0000 7fd1e687b640 1 --2- 172.21.15.79:0/3263545941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0155590 0x7fd1e015d200 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400c430 tx=0x7fd1d400c8f0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.603+0000 7fd1e4e18640 1 -- 172.21.15.79:0/3263545941 reap_dead start 2024-06-10T00:25:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.603+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 shutdown_connections 2024-06-10T00:25:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.603+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 >> 172.21.15.79:0/3263545941 conn(0x7fd1e00b1980 msgr2=0x7fd1e006eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.603+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 shutdown_connections 2024-06-10T00:25:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.603+0000 7fd1e687b640 1 -- 172.21.15.79:0/3263545941 wait complete. 2024-06-10T00:25:26.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-06-10T00:25:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.712+0000 7fda6f09a640 1 Processor -- start 2024-06-10T00:25:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.712+0000 7fda6f09a640 1 -- start start 2024-06-10T00:25:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda6f09a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda680add50 0x7fda68165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda6f09a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6806d130 con 0x7fda6806ebf0 2024-06-10T00:25:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda6f09a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6806d410 con 0x7fda680ae910 2024-06-10T00:25:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda6f09a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fda6806d6f0 con 0x7fda680add50 2024-06-10T00:25:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda67fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fda6806ebf0 0x7fda680cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44882/0 (socket says 172.21.15.79:44882) 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda67fff640 1 -- 172.21.15.79:0/455772482 learned_addr learned my addr 172.21.15.79:0/455772482 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda6d637640 1 --2- 172.21.15.79:0/455772482 >> v2:172.21.15.117:3300/0 conn(0x7fda680add50 0x7fda68165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911200597 0 0) 0x7fda6806d130 con 0x7fda6806ebf0 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.713+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda50003520 con 0x7fda6806ebf0 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036475182 0 0) 0x7fda6806d410 con 0x7fda680ae910 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda6806d130 con 0x7fda680ae910 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2099017478 0 0) 0x7fda50003520 con 0x7fda6806ebf0 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 >> v2:172.21.15.117:3300/0 conn(0x7fda680add50 msgr2=0x7fda68165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 --2- 172.21.15.79:0/455772482 >> v2:172.21.15.117:3300/0 conn(0x7fda680add50 0x7fda68165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 >> v1:172.21.15.117:6789/0 conn(0x7fda680ae910 legacy=0x7fda6806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6806d9d0 con 0x7fda6806ebf0 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7fda5c001670 con 0x7fda6806ebf0 2024-06-10T00:25:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 >> v1:172.21.15.79:6789/0 conn(0x7fda6806ebf0 legacy=0x7fda680cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda50003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda50004800 0x7fda50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50005210 0x7fda5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda6806d6f0 con 0x7fda50003b90 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda5000c140 con 0x7fda50005210 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda5000c340 con 0x7fda50004800 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6ce36640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda50003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6d637640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50005210 0x7fda5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda67fff640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda50004800 0x7fda50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6ce36640 1 -- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda50004800 msgr2=0x7fda50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6ce36640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda50004800 0x7fda50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6ce36640 1 -- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50005210 msgr2=0x7fda5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6ce36640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50005210 0x7fda5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6ce36640 1 -- 172.21.15.79:0/455772482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda50003520 con 0x7fda50003b90 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6d637640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50005210 0x7fda5000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.714+0000 7fda6d637640 1 -- 172.21.15.79:0/455772482 reap_dead start 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda6ce36640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda50003f90 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fda580018d0 tx=0x7fda50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92157543b537d166 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda580014f0 con 0x7fda50003b90 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda580052d0 con 0x7fda50003b90 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda677fe640 1 -- 172.21.15.79:0/455772482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5802ac40 con 0x7fda50003b90 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda6f09a640 1 -- 172.21.15.79:0/455772482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 msgr2=0x7fda50003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda6f09a640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda50003f90 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fda580018d0 tx=0x7fda50005830 comp rx=0 tx=0).stop 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda6f09a640 1 -- 172.21.15.79:0/455772482 shutdown_connections 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda6f09a640 1 --2- 172.21.15.79:0/455772482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda50003f90 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.715+0000 7fda6f09a640 1 -- 172.21.15.79:0/455772482 >> 172.21.15.79:0/455772482 conn(0x7fda680b19f0 msgr2=0x7fda680b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.716+0000 7fda6f09a640 1 -- 172.21.15.79:0/455772482 shutdown_connections 2024-06-10T00:25:26.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.716+0000 7fda6f09a640 1 -- 172.21.15.79:0/455772482 wait complete. 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.717+0000 7fda6f09a640 1 Processor -- start 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.717+0000 7fda6f09a640 1 -- start start 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6f09a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda6815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6f09a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda68154380 0x7fda6809ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6f09a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815cd70 0x7fda6815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6f09a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda6806e660 con 0x7fda50003b90 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6f09a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda6806e4e0 con 0x7fda68154380 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6f09a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda6806e7e0 con 0x7fda6815cd70 2024-06-10T00:25:26.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda6815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda6815b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50308/0 (socket says 172.21.15.79:50308) 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 -- 172.21.15.79:0/2810609606 learned_addr learned my addr 172.21.15.79:0/2810609606 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda67fff640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda68154380 0x7fda6809ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6d637640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815cd70 0x7fda6815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 -- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815cd70 msgr2=0x7fda6815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815cd70 0x7fda6815d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 -- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda68154380 msgr2=0x7fda6809ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda68154380 0x7fda6809ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 -- 172.21.15.79:0/2810609606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6815baa0 con 0x7fda50003b90 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6d637640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815cd70 0x7fda6815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda67fff640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda68154380 0x7fda6809ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6ce36640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda6815b4c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fda58000c00 tx=0x7fda580012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda657fa640 1 -- 172.21.15.79:0/2810609606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda58040030 con 0x7fda50003b90 2024-06-10T00:25:26.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda657fa640 1 -- 172.21.15.79:0/2810609606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda58005480 con 0x7fda50003b90 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6815bd80 con 0x7fda50003b90 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda657fa640 1 -- 172.21.15.79:0/2810609606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda580014f0 con 0x7fda50003b90 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.718+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6815c340 con 0x7fda50003b90 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.719+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda68068430 con 0x7fda50003b90 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.720+0000 7fda657fa640 1 -- 172.21.15.79:0/2810609606 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda58043070 con 0x7fda50003b90 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.720+0000 7fda657fa640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fda5406be30 0x7fda5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.720+0000 7fda657fa640 1 -- 172.21.15.79:0/2810609606 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fda580aadf0 con 0x7fda50003b90 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.720+0000 7fda67fff640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fda5406be30 0x7fda5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:26.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.721+0000 7fda67fff640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fda5406be30 0x7fda5406e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fda680ce8a0 tx=0x7fda5c001d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:26.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.724+0000 7fda657fa640 1 -- 172.21.15.79:0/2810609606 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fda58079860 con 0x7fda50003b90 2024-06-10T00:25:26.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.896+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fda680ce180 con 0x7fda5406be30 2024-06-10T00:25:26.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.896+0000 7fda657fa640 1 -- 172.21.15.79:0/2810609606 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fda680ce180 con 0x7fda5406be30 2024-06-10T00:25:26.896 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 7 to deep-scrub 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fda5406be30 msgr2=0x7fda5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fda5406be30 0x7fda5406e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fda680ce8a0 tx=0x7fda5c001d50 comp rx=0 tx=0).stop 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 msgr2=0x7fda6815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda6815b4c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fda58000c00 tx=0x7fda580012d0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 shutdown_connections 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7fda5406be30 0x7fda5406e2f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815cd70 0x7fda6815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda68154380 0x7fda6809ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 --2- 172.21.15.79:0/2810609606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda50003b90 0x7fda6815b4c0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:26.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 >> 172.21.15.79:0/2810609606 conn(0x7fda680b19f0 msgr2=0x7fda6815a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:26.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 shutdown_connections 2024-06-10T00:25:26.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:26.898+0000 7fda6f09a640 1 -- 172.21.15.79:0/2810609606 wait complete. 2024-06-10T00:25:26.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:25:27.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.008+0000 7f660a930640 1 Processor -- start 2024-06-10T00:25:27.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.008+0000 7f660a930640 1 -- start start 2024-06-10T00:25:27.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.009+0000 7f660a930640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 0x7f66040cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:27.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.009+0000 7f660a930640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66040cf640 con 0x7f66040cf190 2024-06-10T00:25:27.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.009+0000 7f660a930640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f660406d130 con 0x7f66040ae910 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.009+0000 7f660a930640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f660406d410 con 0x7f660406ebf0 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.009+0000 7f6608ecd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f66040cf190 0x7f66040acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44886/0 (socket says 172.21.15.79:44886) 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.009+0000 7f6608ecd640 1 -- 172.21.15.79:0/3091659588 learned_addr learned my addr 172.21.15.79:0/3091659588 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.009+0000 7f66037fe640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 0x7f66040cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.009+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964577513 0 0) 0x7f66040cf640 con 0x7f66040cf190 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65ec003520 con 0x7f66040cf190 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 639883929 0 0) 0x7f65ec003520 con 0x7f66040cf190 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 msgr2=0x7f66040cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 0x7f66040cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 >> v1:172.21.15.117:6789/0 conn(0x7f66040ae910 legacy=0x7f660406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660406d6f0 con 0x7f66040cf190 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 652041092 0 0) 0x7f65fc0019f0 con 0x7f66040cf190 2024-06-10T00:25:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f66037fe640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 0x7f66040cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 >> v1:172.21.15.79:6789/0 conn(0x7f66040cf190 legacy=0x7f66040acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 0x7f65ec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f65ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65ec004d40 0x7f65ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f660406d410 con 0x7f65ec003f20 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec00bad0 con 0x7f65ec004d40 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec00bcd0 con 0x7f660406ebf0 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f66037fe640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f65ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6603fff640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 0x7f65ec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f6608ecd640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65ec004d40 0x7f65ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f66037fe640 1 -- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 msgr2=0x7f65ec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f66037fe640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660406ebf0 0x7f65ec0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f66037fe640 1 -- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65ec004d40 msgr2=0x7f65ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f66037fe640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65ec004d40 0x7f65ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.010+0000 7f66037fe640 1 -- 172.21.15.79:0/3091659588 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec003520 con 0x7f65ec003f20 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.011+0000 7f66037fe640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f65ec004800 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009c50 tx=0x7f65ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdc45d7456be236 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.011+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8036070 con 0x7f65ec003f20 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.011+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f8031400 con 0x7f65ec003f20 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.011+0000 7f6602ffd640 1 -- 172.21.15.79:0/3091659588 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8009820 con 0x7f65ec003f20 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.012+0000 7f660a930640 1 -- 172.21.15.79:0/3091659588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 msgr2=0x7f65ec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.012+0000 7f660a930640 1 --2- 172.21.15.79:0/3091659588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f65ec004800 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009c50 tx=0x7f65ec005830 comp rx=0 tx=0).stop 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.012+0000 7f6608ecd640 1 -- 172.21.15.79:0/3091659588 reap_dead start 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.012+0000 7f660a930640 1 -- 172.21.15.79:0/3091659588 shutdown_connections 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.012+0000 7f660a930640 1 -- 172.21.15.79:0/3091659588 >> 172.21.15.79:0/3091659588 conn(0x7f66040b19f0 msgr2=0x7f66040b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.012+0000 7f660a930640 1 -- 172.21.15.79:0/3091659588 shutdown_connections 2024-06-10T00:25:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.012+0000 7f660a930640 1 -- 172.21.15.79:0/3091659588 wait complete. 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.013+0000 7f660a930640 1 Processor -- start 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.013+0000 7f660a930640 1 -- start start 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f660a930640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f6604158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f660a930640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660415d1e0 0x7f660415d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f660a930640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66041ef580 0x7f66041efa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f660a930640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f66040ad450 con 0x7f65ec003f20 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f660a930640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66040aecf0 con 0x7f66041ef580 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f660a930640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66040ad5d0 con 0x7f660415d1e0 2024-06-10T00:25:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f6604158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f6604158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50328/0 (socket says 172.21.15.79:50328) 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 -- 172.21.15.79:0/3905985921 learned_addr learned my addr 172.21.15.79:0/3905985921 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6608ecd640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66041ef580 0x7f66041efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 -- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660415d1e0 msgr2=0x7f660415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f66037fe640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660415d1e0 0x7f660415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660415d1e0 0x7f660415d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 -- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66041ef580 msgr2=0x7f66041efa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66041ef580 0x7f66041efa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 -- 172.21.15.79:0/3905985921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660415c0d0 con 0x7f65ec003f20 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6608ecd640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66041ef580 0x7f66041efa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6603fff640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f6604158da0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f65f400f7f0 tx=0x7f65f400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6600ff9640 1 -- 172.21.15.79:0/3905985921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40052e0 con 0x7f65ec003f20 2024-06-10T00:25:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6600ff9640 1 -- 172.21.15.79:0/3905985921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f4018070 con 0x7f65ec003f20 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660415c3b0 con 0x7f65ec003f20 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f6600ff9640 1 -- 172.21.15.79:0/3905985921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f400d970 con 0x7f65ec003f20 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.014+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660415ccc0 con 0x7f65ec003f20 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.015+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660406e1d0 con 0x7f65ec003f20 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.016+0000 7f6600ff9640 1 -- 172.21.15.79:0/3905985921 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65f400db10 con 0x7f65ec003f20 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.016+0000 7f6600ff9640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65f006be30 0x7f65f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.016+0000 7f6600ff9640 1 -- 172.21.15.79:0/3905985921 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f65f408ad30 con 0x7f65ec003f20 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.016+0000 7f66037fe640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65f006be30 0x7f65f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:27.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.017+0000 7f66037fe640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65f006be30 0x7f65f006e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f65f8033000 tx=0x7f65f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:27.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.021+0000 7f6600ff9640 1 -- 172.21.15.79:0/3905985921 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f660406e1d0 con 0x7f65ec003f20 2024-06-10T00:25:27.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.193+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6604068430 con 0x7f65f006be30 2024-06-10T00:25:27.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.194+0000 7f6600ff9640 1 -- 172.21.15.79:0/3905985921 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13516 (secure 0 0 0) 0x7f6604068430 con 0x7f65f006be30 2024-06-10T00:25:27.194 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:27.194 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:25:27.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65f006be30 msgr2=0x7f65f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:27.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65f006be30 0x7f65f006e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f65f8033000 tx=0x7f65f8008030 comp rx=0 tx=0).stop 2024-06-10T00:25:27.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 msgr2=0x7f6604158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:27.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f6604158da0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f65f400f7f0 tx=0x7f65f400fcb0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 shutdown_connections 2024-06-10T00:25:27.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f65f006be30 0x7f65f006e2f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66041ef580 0x7f66041efa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660415d1e0 0x7f660415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 --2- 172.21.15.79:0/3905985921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65ec003f20 0x7f6604158da0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:27.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 >> 172.21.15.79:0/3905985921 conn(0x7f66040b19f0 msgr2=0x7f66040b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:27.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 shutdown_connections 2024-06-10T00:25:27.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:27.196+0000 7f660a930640 1 -- 172.21.15.79:0/3905985921 wait complete. 2024-06-10T00:25:27.206 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-06-10T00:25:25.293486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262740,"kb_used_data":13276,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711980,"statfs":{"total":773094113280,"available":772825067520,"internally_reserved":0,"allocated":13594624,"data_stored":6973364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392375,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-265,"num_write":-177,"num_write_kb":-8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001303"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":362,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-06-10T00:25:19.989102+0000","last_change":"2024-06-10T00:14:32.265605+0000","last_active":"2024-06-10T00:25:19.989102+0000","last_peered":"2024-06-10T00:25:19.989102+0000","last_clean":"2024-06-10T00:25:19.989102+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:25:19.989102+0000","last_undegraded":"2024-06-10T00:25:19.989102+0000","last_fullsized":"2024-06-10T00:25:19.989102+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-10T00:14:31.233273+0000","last_clean_scrub_stamp":"2024-06-10T00:14:31.233273+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T05:28:48.584006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":718720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:25:27.209 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-06-10T00:14:31.233273+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=10, tm_hour=0, tm_min=14, tm_sec=31, tm_wday=0, tm_yday=162, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=10, tm_hour=0, tm_min=25, tm_sec=22, tm_wday=0, tm_yday=162, tm_isdst=0) 2024-06-10T00:25:27.209 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-10T00:25:45.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:25:45.691 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:25:47.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-10T00:25:47.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.323+0000 7f922d516640 1 Processor -- start 2024-06-10T00:25:47.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.323+0000 7f922d516640 1 -- start start 2024-06-10T00:25:47.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f922d516640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f922815c1d0 0x7f92280d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f922d516640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280cef50 0x7f92280c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f922d516640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92280c59a0 con 0x7f92280d0430 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f922d516640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f92280c5fb0 con 0x7f922815c1d0 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f922d516640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92280d0910 con 0x7f92280cef50 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f9226ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f922815c1d0 0x7f92280d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f921e7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f92280d0430 0x7f92280ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39144/0 (socket says 172.21.15.79:39144) 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f921e7fc640 1 -- 172.21.15.79:0/2257779984 learned_addr learned my addr 172.21.15.79:0/2257779984 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f92277fe640 1 --2- 172.21.15.79:0/2257779984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280cef50 0x7f92280c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f9226ffd640 1 -- 172.21.15.79:0/2257779984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280cef50 msgr2=0x7f92280c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f9226ffd640 1 --2- 172.21.15.79:0/2257779984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280cef50 0x7f92280c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f9226ffd640 1 -- 172.21.15.79:0/2257779984 >> v1:172.21.15.79:6789/0 conn(0x7f92280d0430 legacy=0x7f92280ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f9226ffd640 1 -- 172.21.15.79:0/2257779984 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92280d0bf0 con 0x7f922815c1d0 2024-06-10T00:25:47.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f92267fc640 1 -- 172.21.15.79:0/2257779984 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575590754 0 0) 0x7f92280c59a0 con 0x7f92280d0430 2024-06-10T00:25:47.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.324+0000 7f92277fe640 1 --2- 172.21.15.79:0/2257779984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280cef50 0x7f92280c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:47.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.325+0000 7f9226ffd640 1 --2- 172.21.15.79:0/2257779984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f922815c1d0 0x7f92280d2970 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f92180097a0 tx=0x7f921802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7f22efa1a46b6d server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.325+0000 7f92267fc640 1 -- 172.21.15.79:0/2257779984 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218037070 con 0x7f922815c1d0 2024-06-10T00:25:47.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.325+0000 7f92267fc640 1 -- 172.21.15.79:0/2257779984 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921802ae50 con 0x7f922815c1d0 2024-06-10T00:25:47.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.325+0000 7f92267fc640 1 -- 172.21.15.79:0/2257779984 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218032660 con 0x7f922815c1d0 2024-06-10T00:25:47.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.325+0000 7f922d516640 1 -- 172.21.15.79:0/2257779984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f922815c1d0 msgr2=0x7f92280d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.325+0000 7f922d516640 1 --2- 172.21.15.79:0/2257779984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f922815c1d0 0x7f92280d2970 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f92180097a0 tx=0x7f921802a100 comp rx=0 tx=0).stop 2024-06-10T00:25:47.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.326+0000 7f922d516640 1 -- 172.21.15.79:0/2257779984 shutdown_connections 2024-06-10T00:25:47.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.326+0000 7f922d516640 1 --2- 172.21.15.79:0/2257779984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280cef50 0x7f92280c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.326+0000 7f922d516640 1 --2- 172.21.15.79:0/2257779984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f922815c1d0 0x7f92280d2970 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.326+0000 7f922d516640 1 -- 172.21.15.79:0/2257779984 >> 172.21.15.79:0/2257779984 conn(0x7f92280d1e50 msgr2=0x7f92280d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.326+0000 7f922d516640 1 -- 172.21.15.79:0/2257779984 shutdown_connections 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.326+0000 7f922d516640 1 -- 172.21.15.79:0/2257779984 wait complete. 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.327+0000 7f922d516640 1 Processor -- start 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.327+0000 7f922d516640 1 -- start start 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f922d516640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92280cef50 0x7f92280b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f922d516640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280d0430 0x7f9228159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f922d516640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f922815c1d0 0x7f922815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f922d516640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92280cf520 con 0x7f92280cef50 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f922d516640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f922815c5b0 con 0x7f922815c1d0 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f922d516640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92280cf6a0 con 0x7f92280d0430 2024-06-10T00:25:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92280cef50 0x7f92280b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92280cef50 0x7f92280b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54502/0 (socket says 172.21.15.79:54502) 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 -- 172.21.15.79:0/2794800291 learned_addr learned my addr 172.21.15.79:0/2794800291 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 -- 172.21.15.79:0/2794800291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280d0430 msgr2=0x7f9228159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280d0430 0x7f9228159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 -- 172.21.15.79:0/2794800291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f922815c1d0 msgr2=0x7f922815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f922815c1d0 0x7f922815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 -- 172.21.15.79:0/2794800291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92280afbf0 con 0x7f92280cef50 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f9226ffd640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92280cef50 0x7f92280b1700 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f9218000c00 tx=0x7f92180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f921ffff640 1 -- 172.21.15.79:0/2794800291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218041070 con 0x7f92280cef50 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f921ffff640 1 -- 172.21.15.79:0/2794800291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921803c670 con 0x7f92280cef50 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.328+0000 7f921ffff640 1 -- 172.21.15.79:0/2794800291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218037040 con 0x7f92280cef50 2024-06-10T00:25:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.329+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92280afed0 con 0x7f92280cef50 2024-06-10T00:25:47.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.329+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92280b0490 con 0x7f92280cef50 2024-06-10T00:25:47.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.330+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9228068430 con 0x7f92280cef50 2024-06-10T00:25:47.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.330+0000 7f921ffff640 1 -- 172.21.15.79:0/2794800291 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9218044070 con 0x7f92280cef50 2024-06-10T00:25:47.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.330+0000 7f921ffff640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f920806be30 0x7f920806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.330+0000 7f921e7fc640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f920806be30 0x7f920806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.331+0000 7f921ffff640 1 -- 172.21.15.79:0/2794800291 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f92180ab790 con 0x7f92280cef50 2024-06-10T00:25:47.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.331+0000 7f921e7fc640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f920806be30 0x7f920806e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9210007fd0 tx=0x7f9210007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.335+0000 7f921ffff640 1 -- 172.21.15.79:0/2794800291 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f921807a320 con 0x7f92280cef50 2024-06-10T00:25:47.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.505+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 --> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f922815b740 con 0x7f920806be30 2024-06-10T00:25:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.506+0000 7f921ffff640 1 -- 172.21.15.79:0/2794800291 <== mgr.4107 v2:172.21.15.79:6832/3912288700 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f922815b740 con 0x7f920806be30 2024-06-10T00:25:47.505 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:47.506 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-06-10T00:25:47.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f920806be30 msgr2=0x7f920806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f920806be30 0x7f920806e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9210007fd0 tx=0x7f9210007920 comp rx=0 tx=0).stop 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92280cef50 msgr2=0x7f92280b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92280cef50 0x7f92280b1700 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f9218000c00 tx=0x7f92180046c0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 shutdown_connections 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f920806be30 0x7f920806e2f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f922815c1d0 0x7f922815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92280d0430 0x7f9228159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 --2- 172.21.15.79:0/2794800291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92280cef50 0x7f92280b1700 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 >> 172.21.15.79:0/2794800291 conn(0x7f92280d1e50 msgr2=0x7f9228070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 shutdown_connections 2024-06-10T00:25:47.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.508+0000 7f922d516640 1 -- 172.21.15.79:0/2794800291 wait complete. 2024-06-10T00:25:47.518 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2024-06-10T00:25:47.297466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262744,"kb_used_data":13288,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711976,"statfs":{"total":773094113280,"available":772825063424,"internally_reserved":0,"allocated":13606912,"data_stored":6979488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002323"},"pg_stats":[{"pgid":"1.0","version":"124'119","reported_seq":373,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-06-10T00:25:26.938365+0000","last_change":"2024-06-10T00:25:26.938401+0000","last_active":"2024-06-10T00:25:26.938365+0000","last_peered":"2024-06-10T00:25:26.938365+0000","last_clean":"2024-06-10T00:25:26.938365+0000","last_became_active":"2024-06-10T00:14:32.264717+0000","last_became_peered":"2024-06-10T00:14:32.264717+0000","last_unstale":"2024-06-10T00:25:26.938365+0000","last_undegraded":"2024-06-10T00:25:26.938365+0000","last_fullsized":"2024-06-10T00:25:26.938365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'119","last_scrub_stamp":"2024-06-10T00:25:26.938256+0000","last_deep_scrub":"124'119","last_deep_scrub_stamp":"2024-06-10T00:25:26.938256+0000","last_clean_scrub_stamp":"2024-06-10T00:25:26.938256+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-11T06:41:30.658969+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":724844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2146304,"data_stored":1315212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-10T00:25:47.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-06-10T00:25:47.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.618+0000 7f6caccca640 1 Processor -- start 2024-06-10T00:25:47.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.618+0000 7f6caccca640 1 -- start start 2024-06-10T00:25:47.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6caccca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b3b40 0x7f6ca80b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6caccca640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ca80b48e0 0x7f6ca80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6caccca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca815c870 con 0x7f6ca80d0020 2024-06-10T00:25:47.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6caccca640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca815cb50 con 0x7f6ca80b48e0 2024-06-10T00:25:47.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6caccca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca815ce30 con 0x7f6ca80b3b40 2024-06-10T00:25:47.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6ca5d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ca80b48e0 0x7f6ca80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6ca6d9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6ca80d0020 0x7f6ca806d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39158/0 (socket says 172.21.15.79:39158) 2024-06-10T00:25:47.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6ca5d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ca80b48e0 0x7f6ca80b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54518/0 (socket says 172.21.15.79:54518) 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.619+0000 7f6ca6d9d640 1 -- 172.21.15.79:0/4232047529 learned_addr learned my addr 172.21.15.79:0/4232047529 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca659c640 1 --2- 172.21.15.79:0/4232047529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b3b40 0x7f6ca80b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca5d9b640 1 -- 172.21.15.79:0/4232047529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b3b40 msgr2=0x7f6ca80b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca5d9b640 1 --2- 172.21.15.79:0/4232047529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b3b40 0x7f6ca80b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca5d9b640 1 -- 172.21.15.79:0/4232047529 >> v1:172.21.15.79:6789/0 conn(0x7f6ca80d0020 legacy=0x7f6ca806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca5d9b640 1 -- 172.21.15.79:0/4232047529 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca815d110 con 0x7f6ca80b48e0 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca559a640 1 -- 172.21.15.79:0/4232047529 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180576835 0 0) 0x7f6ca815c870 con 0x7f6ca80d0020 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca659c640 1 --2- 172.21.15.79:0/4232047529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b3b40 0x7f6ca80b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca5d9b640 1 --2- 172.21.15.79:0/4232047529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80b48e0 0x7f6ca80b4d40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0097a0 tx=0x7f6c9c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80354b4654eee349 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.620+0000 7f6ca559a640 1 -- 172.21.15.79:0/4232047529 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c037070 con 0x7f6ca80b48e0 2024-06-10T00:25:47.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6ca559a640 1 -- 172.21.15.79:0/4232047529 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c02ae50 con 0x7f6ca80b48e0 2024-06-10T00:25:47.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6ca559a640 1 -- 172.21.15.79:0/4232047529 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c032660 con 0x7f6ca80b48e0 2024-06-10T00:25:47.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6caccca640 1 -- 172.21.15.79:0/4232047529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80b48e0 msgr2=0x7f6ca80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6caccca640 1 --2- 172.21.15.79:0/4232047529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80b48e0 0x7f6ca80b4d40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0097a0 tx=0x7f6c9c02a100 comp rx=0 tx=0).stop 2024-06-10T00:25:47.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6caccca640 1 -- 172.21.15.79:0/4232047529 shutdown_connections 2024-06-10T00:25:47.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6caccca640 1 --2- 172.21.15.79:0/4232047529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80b48e0 0x7f6ca80b4d40 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6caccca640 1 --2- 172.21.15.79:0/4232047529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b3b40 0x7f6ca80b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6caccca640 1 -- 172.21.15.79:0/4232047529 >> 172.21.15.79:0/4232047529 conn(0x7f6ca80b1d10 msgr2=0x7f6ca80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:47.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6caccca640 1 -- 172.21.15.79:0/4232047529 shutdown_connections 2024-06-10T00:25:47.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.621+0000 7f6caccca640 1 -- 172.21.15.79:0/4232047529 wait complete. 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.622+0000 7f6caccca640 1 Processor -- start 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.622+0000 7f6caccca640 1 -- start start 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6caccca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ca80b3b40 0x7f6ca8145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6caccca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b48e0 0x7f6ca809b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6caccca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80d0020 0x7f6ca809bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6caccca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca815c490 con 0x7f6ca80d0020 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6caccca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca80b3f20 con 0x7f6ca80b3b40 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6caccca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca815c610 con 0x7f6ca80b48e0 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6ca6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80d0020 0x7f6ca809bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6ca6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80d0020 0x7f6ca809bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54526/0 (socket says 172.21.15.79:54526) 2024-06-10T00:25:47.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6ca6d9d640 1 -- 172.21.15.79:0/51594150 learned_addr learned my addr 172.21.15.79:0/51594150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6ca659c640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ca80b3b40 0x7f6ca8145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.623+0000 7f6ca5d9b640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b48e0 0x7f6ca809b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6ca6d9d640 1 -- 172.21.15.79:0/51594150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b48e0 msgr2=0x7f6ca809b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6ca6d9d640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b48e0 0x7f6ca809b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6ca6d9d640 1 -- 172.21.15.79:0/51594150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ca80b3b40 msgr2=0x7f6ca8145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6ca6d9d640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ca80b3b40 0x7f6ca8145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6ca6d9d640 1 -- 172.21.15.79:0/51594150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca809c240 con 0x7f6ca80d0020 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6ca6d9d640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80d0020 0x7f6ca809bbc0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000c480 tx=0x7f6ca000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6c96ffd640 1 -- 172.21.15.79:0/51594150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0018070 con 0x7f6ca80d0020 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6c96ffd640 1 -- 172.21.15.79:0/51594150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca0007500 con 0x7f6ca80d0020 2024-06-10T00:25:47.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca809c520 con 0x7f6ca80d0020 2024-06-10T00:25:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6c96ffd640 1 -- 172.21.15.79:0/51594150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0004a20 con 0x7f6ca80d0020 2024-06-10T00:25:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.624+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca8146580 con 0x7f6ca80d0020 2024-06-10T00:25:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.625+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca81460b0 con 0x7f6ca80d0020 2024-06-10T00:25:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.625+0000 7f6c96ffd640 1 -- 172.21.15.79:0/51594150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ca001b070 con 0x7f6ca80d0020 2024-06-10T00:25:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.626+0000 7f6c96ffd640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c8806be30 0x7f6c8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.626+0000 7f6ca659c640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c8806be30 0x7f6c8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.626+0000 7f6c96ffd640 1 -- 172.21.15.79:0/51594150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f6ca008a050 con 0x7f6ca80d0020 2024-06-10T00:25:47.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.626+0000 7f6ca659c640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c8806be30 0x7f6c8806e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007510 tx=0x7f6c980074a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.630+0000 7f6c96ffd640 1 -- 172.21.15.79:0/51594150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6ca0058b50 con 0x7f6ca80d0020 2024-06-10T00:25:47.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.804+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f6ca80683c0 con 0x7f6ca80d0020 2024-06-10T00:25:47.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.807+0000 7f6c96ffd640 1 -- 172.21.15.79:0/51594150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f6ca0058450 con 0x7f6ca80d0020 2024-06-10T00:25:47.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.808+0000 7f6c96ffd640 1 -- 172.21.15.79:0/51594150 <== mon.0 v2:172.21.15.79:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ca005c800 con 0x7f6ca80d0020 2024-06-10T00:25:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c8806be30 msgr2=0x7f6c8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c8806be30 0x7f6c8806e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007510 tx=0x7f6c980074a0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80d0020 msgr2=0x7f6ca809bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80d0020 0x7f6ca809bbc0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000c480 tx=0x7f6ca000c940 comp rx=0 tx=0).stop 2024-06-10T00:25:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 shutdown_connections 2024-06-10T00:25:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f6c8806be30 0x7f6c8806e2f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ca80d0020 0x7f6ca809bbc0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ca80b48e0 0x7f6ca809b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 --2- 172.21.15.79:0/51594150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ca80b3b40 0x7f6ca8145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 >> 172.21.15.79:0/51594150 conn(0x7f6ca80b1d10 msgr2=0x7f6ca80b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:47.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 shutdown_connections 2024-06-10T00:25:47.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.810+0000 7f6caccca640 1 -- 172.21.15.79:0/51594150 wait complete. 2024-06-10T00:25:47.821 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-10T00:25:47.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-10T00:25:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.921+0000 7f22bdc64640 1 Processor -- start 2024-06-10T00:25:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.921+0000 7f22bdc64640 1 -- start start 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22bdc64640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22b80ae910 0x7f22b806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22bdc64640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b806d130 con 0x7f22b806ea20 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22bdc64640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b806d410 con 0x7f22b80cf360 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22bdc64640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f22b806ee90 con 0x7f22b80ae910 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22b77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22b80ae910 0x7f22b806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22b6ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f22b806ea20 0x7f22b80cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39164/0 (socket says 172.21.15.79:39164) 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22b6ffd640 1 -- 172.21.15.79:0/3388435279 learned_addr learned my addr 172.21.15.79:0/3388435279 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22b77fe640 1 -- 172.21.15.79:0/3388435279 >> v1:172.21.15.117:6789/0 conn(0x7f22b80cf360 legacy=0x7f22b80acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22b77fe640 1 -- 172.21.15.79:0/3388435279 >> v1:172.21.15.79:6789/0 conn(0x7f22b806ea20 legacy=0x7f22b80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22b67fc640 1 -- 172.21.15.79:0/3388435279 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225716451 0 0) 0x7f22b806d130 con 0x7f22b806ea20 2024-06-10T00:25:47.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.922+0000 7f22b77fe640 1 -- 172.21.15.79:0/3388435279 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b806d6f0 con 0x7f22b80ae910 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.923+0000 7f22b77fe640 1 --2- 172.21.15.79:0/3388435279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80ae910 0x7f22b806e4e0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f22a80097a0 tx=0x7f22a802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc65d1ec2fddd45e server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.923+0000 7f22b67fc640 1 -- 172.21.15.79:0/3388435279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8037070 con 0x7f22b80ae910 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.923+0000 7f22b67fc640 1 -- 172.21.15.79:0/3388435279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f22a802ae50 con 0x7f22b80ae910 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.923+0000 7f22b67fc640 1 -- 172.21.15.79:0/3388435279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8032680 con 0x7f22b80ae910 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.923+0000 7f22bdc64640 1 -- 172.21.15.79:0/3388435279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80ae910 msgr2=0x7f22b806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.923+0000 7f22bdc64640 1 --2- 172.21.15.79:0/3388435279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80ae910 0x7f22b806e4e0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f22a80097a0 tx=0x7f22a802a140 comp rx=0 tx=0).stop 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.924+0000 7f22bdc64640 1 -- 172.21.15.79:0/3388435279 shutdown_connections 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.924+0000 7f22bdc64640 1 --2- 172.21.15.79:0/3388435279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80ae910 0x7f22b806e4e0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.924+0000 7f22bdc64640 1 -- 172.21.15.79:0/3388435279 >> 172.21.15.79:0/3388435279 conn(0x7f22b80b19f0 msgr2=0x7f22b80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.924+0000 7f22bdc64640 1 -- 172.21.15.79:0/3388435279 shutdown_connections 2024-06-10T00:25:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.924+0000 7f22bdc64640 1 -- 172.21.15.79:0/3388435279 wait complete. 2024-06-10T00:25:47.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.925+0000 7f22bdc64640 1 Processor -- start 2024-06-10T00:25:47.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.925+0000 7f22bdc64640 1 -- start start 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.925+0000 7f22bdc64640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b806ea20 0x7f22b81f0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22bdc64640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b80ae910 0x7f22b8159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22bdc64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80cf360 0x7f22b809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22bdc64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22b80ad450 con 0x7f22b80cf360 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22bdc64640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22b80aecf0 con 0x7f22b806ea20 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22bdc64640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22b80ad5d0 con 0x7f22b80ae910 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80cf360 0x7f22b809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80cf360 0x7f22b809aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54532/0 (socket says 172.21.15.79:54532) 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 -- 172.21.15.79:0/1207983139 learned_addr learned my addr 172.21.15.79:0/1207983139 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b77fe640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b806ea20 0x7f22b81f0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b6ffd640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b80ae910 0x7f22b8159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 -- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b80ae910 msgr2=0x7f22b8159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b80ae910 0x7f22b8159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 -- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b806ea20 msgr2=0x7f22b81f0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b806ea20 0x7f22b81f0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 -- 172.21.15.79:0/1207983139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b809d7d0 con 0x7f22b80cf360 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b77fe640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b806ea20 0x7f22b81f0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b6ffd640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b80ae910 0x7f22b8159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22b7fff640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80cf360 0x7f22b809aa10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c780 tx=0x7f22b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f229ffff640 1 -- 172.21.15.79:0/1207983139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0004b60 con 0x7f22b80cf360 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f229ffff640 1 -- 172.21.15.79:0/1207983139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f22b0004d00 con 0x7f22b80cf360 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b809cc50 con 0x7f22b80cf360 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f229ffff640 1 -- 172.21.15.79:0/1207983139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b000aab0 con 0x7f22b80cf360 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.926+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b809d210 con 0x7f22b80cf360 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.927+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b806e4e0 con 0x7f22b80cf360 2024-06-10T00:25:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.928+0000 7f229ffff640 1 -- 172.21.15.79:0/1207983139 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22b000ac50 con 0x7f22b80cf360 2024-06-10T00:25:47.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.928+0000 7f229ffff640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22a406be30 0x7f22a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-10T00:25:47.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.928+0000 7f229ffff640 1 -- 172.21.15.79:0/1207983139 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f22b008b2f0 con 0x7f22b80cf360 2024-06-10T00:25:47.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.928+0000 7f22b77fe640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22a406be30 0x7f22a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-10T00:25:47.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.929+0000 7f22b77fe640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22a406be30 0x7f22a406e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f22a8034000 tx=0x7f22a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-10T00:25:47.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:47.932+0000 7f229ffff640 1 -- 172.21.15.79:0/1207983139 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f22b806e4e0 con 0x7f22b80cf360 2024-06-10T00:25:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.140+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22b8068430 con 0x7f22b80cf360 2024-06-10T00:25:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.140+0000 7f229ffff640 1 -- 172.21.15.79:0/1207983139 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+3875 (secure 0 0 0) 0x7f22b0059d60 con 0x7f22b80cf360 2024-06-10T00:25:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-10T00:25:48.140 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":98,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1675300942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1675300942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1675300942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2101455884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2101455884},{"type":"v1","addr":"172.21.15.117:6833","nonce":2101455884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3050363790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3050363790},{"type":"v1","addr":"172.21.15.79:6836","nonce":3050363790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1831469097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":1831469097},{"type":"v1","addr":"172.21.15.79:6837","nonce":1831469097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[]} 2024-06-10T00:25:48.141 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 98 2024-06-10T00:25:48.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22a406be30 msgr2=0x7f22a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:48.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22a406be30 0x7f22a406e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f22a8034000 tx=0x7f22a802e000 comp rx=0 tx=0).stop 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80cf360 msgr2=0x7f22b809aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80cf360 0x7f22b809aa10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c780 tx=0x7f22b000cc40 comp rx=0 tx=0).stop 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 shutdown_connections 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:6832/3912288700,v1:172.21.15.79:6833/3912288700] conn(0x7f22a406be30 0x7f22a406e2f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b80cf360 0x7f22b809aa10 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b80ae910 0x7f22b8159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 --2- 172.21.15.79:0/1207983139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b806ea20 0x7f22b81f0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 >> 172.21.15.79:0/1207983139 conn(0x7f22b80b19f0 msgr2=0x7f22b80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 shutdown_connections 2024-06-10T00:25:48.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-10T00:25:48.142+0000 7f22bdc64640 1 -- 172.21.15.79:0/1207983139 wait complete. 2024-06-10T00:25:48.153 DEBUG:tasks.cephfs.filesystem:already dead... 2024-06-10T00:25:48.153 INFO:teuthology.misc:Shutting down mds daemons... 2024-06-10T00:25:48.153 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-10T00:25:48.154 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.162 INFO:tasks.ceph.mds.a:Stopped 2024-06-10T00:25:48.162 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-10T00:25:48.162 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.211 INFO:tasks.ceph.mds.c:Stopped 2024-06-10T00:25:48.212 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-10T00:25:48.212 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.223 INFO:tasks.ceph.mds.b:Stopped 2024-06-10T00:25:48.223 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-10T00:25:48.224 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.275 INFO:tasks.ceph.mds.d:Stopped 2024-06-10T00:25:48.275 INFO:teuthology.misc:Shutting down osd daemons... 2024-06-10T00:25:48.275 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-06-10T00:25:48.275 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.301 INFO:tasks.ceph.osd.0:Stopped 2024-06-10T00:25:48.302 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-06-10T00:25:48.302 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.371 INFO:tasks.ceph.osd.1:Stopped 2024-06-10T00:25:48.371 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-06-10T00:25:48.371 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.439 INFO:tasks.ceph.osd.2:Stopped 2024-06-10T00:25:48.439 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-06-10T00:25:48.440 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.511 INFO:tasks.ceph.osd.3:Stopped 2024-06-10T00:25:48.511 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-06-10T00:25:48.511 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.544 INFO:tasks.ceph.osd.4:Stopped 2024-06-10T00:25:48.544 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-06-10T00:25:48.544 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.614 INFO:tasks.ceph.osd.5:Stopped 2024-06-10T00:25:48.614 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-06-10T00:25:48.614 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.683 INFO:tasks.ceph.osd.6:Stopped 2024-06-10T00:25:48.684 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-06-10T00:25:48.684 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.753 INFO:tasks.ceph.osd.7:Stopped 2024-06-10T00:25:48.753 INFO:teuthology.misc:Shutting down mgr daemons... 2024-06-10T00:25:48.753 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-06-10T00:25:48.753 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.779 INFO:tasks.ceph.mgr.y:Stopped 2024-06-10T00:25:48.779 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-06-10T00:25:48.780 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.822 INFO:tasks.ceph.mgr.x:Stopped 2024-06-10T00:25:48.822 INFO:teuthology.misc:Shutting down mon daemons... 2024-06-10T00:25:48.822 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-06-10T00:25:48.823 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.834 INFO:tasks.ceph.mon.a:Stopped 2024-06-10T00:25:48.869 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-06-10T00:25:48.869 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.881 INFO:tasks.ceph.mon.b:Stopped 2024-06-10T00:25:48.881 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-06-10T00:25:48.881 INFO:teuthology.orchestra.run:waiting for 300 2024-06-10T00:25:48.934 INFO:tasks.ceph.mon.c:Stopped 2024-06-10T00:25:48.934 INFO:tasks.ceph:Checking cluster log for badness... 2024-06-10T00:25:48.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-06-10T00:25:48.977 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:18:59.733096+0000 mds.c (mds.0) 1 : cluster [WRN] Corrupt dentry 'file_to_be_damaged' in dir frag 0x10000000000: Invalid tag char 'd' pos 0: Malformed input [buffer:3](/subdir) 2024-06-10T00:25:48.978 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-06-10T00:25:48.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-06-10T00:25:49.049 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-06-10T00:25:49.121 INFO:teuthology.orchestra.run.smithi079.stdout:2024-06-10T00:20:39.747503+0000 mds.a (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-06-10T00:25:49.121 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:25:49.122 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-06-10T00:25:49.335 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:25:49.335 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-06-10T00:25:49.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:25:49.466 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-06-10T00:25:49.532 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:25:49.533 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-06-10T00:25:49.581 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:25:49.582 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-06-10T00:25:49.752 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:25:49.752 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-06-10T00:25:49.830 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:25:49.830 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-06-10T00:25:49.882 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:25:49.882 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-06-10T00:25:49.930 INFO:tasks.ceph:Archiving mon data... 2024-06-10T00:25:49.931 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/data/mon.a.tgz 2024-06-10T00:25:49.932 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-06-10T00:25:49.948 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.OIm176K173 2024-06-10T00:25:49.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OIm176K173 2024-06-10T00:25:50.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.OIm176K173 2024-06-10T00:25:50.178 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.OIm176K173 is 385KB 2024-06-10T00:25:50.275 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.OIm176K173 2024-06-10T00:25:50.290 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/data/mon.b.tgz 2024-06-10T00:25:50.291 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-06-10T00:25:50.310 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.roIh18OT5e 2024-06-10T00:25:50.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.roIh18OT5e 2024-06-10T00:25:50.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.roIh18OT5e 2024-06-10T00:25:50.553 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.roIh18OT5e is 388KB 2024-06-10T00:25:50.650 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.roIh18OT5e 2024-06-10T00:25:50.666 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/data/mon.c.tgz 2024-06-10T00:25:50.667 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-06-10T00:25:50.721 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.rRuu6msca5 2024-06-10T00:25:50.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.rRuu6msca5 2024-06-10T00:25:50.856 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.rRuu6msca5 2024-06-10T00:25:50.939 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.rRuu6msca5 is 388KB 2024-06-10T00:25:51.006 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.rRuu6msca5 2024-06-10T00:25:51.021 INFO:tasks.ceph:Cleaning ceph cluster... 2024-06-10T00:25:51.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-10T00:25:51.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-10T00:25:51.104 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-10T00:25:51.140 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-10T00:25:51.140 INFO:tasks.ceph:Archiving crash dumps... 2024-06-10T00:25:51.142 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/remote/smithi079/crash 2024-06-10T00:25:51.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-10T00:25:51.170 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/remote/smithi117/crash 2024-06-10T00:25:51.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-10T00:25:51.203 INFO:tasks.ceph:Shutting down logrotate 2024-06-10T00:25:51.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:25:51.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-10T00:25:51.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-06-10T00:25:51.326 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-06-10T00:25:51.351 INFO:tasks.ceph:Compressing logs... 2024-06-10T00:25:51.351 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-10T00:25:51.369 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-10T00:25:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44153.log 2024-06-10T00:25:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76481.log 2024-06-10T00:25:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37665.log 2024-06-10T00:25:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37796.log 2024-06-10T00:25:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37665.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37796.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37665.log.gz 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37796.log.gz 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37916.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37916.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37916.log.gz 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37876.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44067.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37876.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-06-10T00:25:51.443 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37876.log.gz 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.44067.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: 87.8% -- replaced with /var/log/ceph/ceph-client.1.44067.log.gz 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- 94.4% /var/log/ceph/ceph-client.admin.37749.log 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr: 87.0%/var/log/ceph/ceph-osd.6.log: -- replaced with /var/log/ceph/ceph-client.admin.37749.log.gz 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44506.log 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37836.log 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.3.44506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37705.log 2024-06-10T00:25:51.444 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37836.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37836.log.gz 2024-06-10T00:25:51.445 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.3.44506.log.gz 2024-06-10T00:25:51.445 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-06-10T00:25:51.445 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37705.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-06-10T00:25:51.445 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37705.log.gz 2024-06-10T00:25:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-06-10T00:25:51.487 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-06-10T00:25:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72866.log 2024-06-10T00:25:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44153.log: /var/log/ceph/ceph-client.0.76481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77334.log 2024-06-10T00:25:51.573 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44153.log.gz 2024-06-10T00:25:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77376.log 2024-06-10T00:25:51.573 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6%/var/log/ceph/ceph-client.admin.77334.log: -- replaced with /var/log/ceph/ceph-client.admin.72866.log.gz 2024-06-10T00:25:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73910.log 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71862.log 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69671.log 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73910.log.gz 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.77334.log.gz 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79422.log 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73687.log 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71862.log.gz 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79422.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69671.log.gz 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72043.log 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.77376.log.gz 2024-06-10T00:25:51.574 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79422.log.gz 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46448.log 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73687.log: /var/log/ceph/ceph-client.admin.72043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78588.log 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73687.log.gz 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.76481.log.gz 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46448.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72043.log.gz 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63234.log 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46448.log.gz 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62697.log 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79296.log 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78588.log.gz 2024-06-10T00:25:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62697.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63234.log.gz 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68555.log 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62697.log.gz 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69192.log 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66998.log 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79296.log.gz 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57337.log 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68555.log.gz 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69192.log.gz 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69415.log 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77635.log 2024-06-10T00:25:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79590.log 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69415.log.gz 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77635.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57337.log.gz 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55941.log 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77635.log.gz 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79590.log: gzip 92.4% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.66998.log.gz 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr: /var/log/ceph/ceph-client.admin.73773.log 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79590.log.gz 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77547.log 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55941.log.gz 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49987.log 2024-06-10T00:25:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77547.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73773.log.gz 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50736.log 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77547.log.gz 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55669.log 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49987.log.gz 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74082.log 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62891.log 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55669.log.gz 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50736.log.gz 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50550.log 2024-06-10T00:25:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62891.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74082.log.gz 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46942.log 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50550.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62891.log.gzgzip 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61603.log 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46942.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50550.log.gz 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60583.log 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60583.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.46942.log.gz 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60583.log.gz 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.43751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60833.log 2024-06-10T00:25:51.579 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61603.log.gz 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44321.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49945.log 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62188.log 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.60833.log.gz 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62849.log 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68851.log 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49945.log.gz 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62188.log.gz 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73094.log 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68851.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62849.log.gz 2024-06-10T00:25:51.580 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65320.log 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68851.log.gz 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73346.log 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53614.log 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73094.log.gz 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73346.log: gzip -5 88.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.65320.log.gz -- 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr: /var/log/ceph/ceph-client.admin.73178.log 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73346.log.gz 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68243.log 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8%/var/log/ceph/ceph-client.admin.73178.log: -- replaced with /var/log/ceph/ceph-client.admin.53614.log.gz 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63141.log 2024-06-10T00:25:51.581 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73178.log.gz 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64445.log 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68243.log.gz 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79926.log 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64445.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63141.log.gz 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31488.log 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79926.log: gzip -5 --verbose 89.2% -- /var/log/ceph/ceph-client.admin.63915.log -- replaced with /var/log/ceph/ceph-client.admin.64445.log.gz 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.tmp-client.admin.31488.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79926.log.gz 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56164.log 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31488.log.gz 2024-06-10T00:25:51.582 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45346.log 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56164.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63915.log.gz 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58277.log 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56164.log.gz 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46452.log 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45346.log: /var/log/ceph/ceph-client.admin.58277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43879.log 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45346.log.gz 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58277.log.gz 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70309.log 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46452.log.gz 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.43879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55452.log 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.70309.log: gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43879.log.gz -- 2024-06-10T00:25:51.583 INFO:teuthology.orchestra.run.smithi079.stderr: /var/log/ceph/ceph.log 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56542.log 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55452.log.gz 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71712.log 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48099.log 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71712.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56542.log.gz 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49569.log 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50075.log 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48099.log: /var/log/ceph/ceph-client.admin.49569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78961.log 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48099.log.gz 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.71712.log.gz 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49569.log.gz 2024-06-10T00:25:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52597.log 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73729.log 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50075.log.gz 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78961.log: gzip/var/log/ceph/ceph-client.admin.52597.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57853.log 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78961.log.gz 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77203.log 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52597.log.gz 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73729.log.gz 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46114.log 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.70309.log.gz 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77203.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57853.log.gz 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78630.log 2024-06-10T00:25:51.585 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77203.log.gz 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80112.log 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78630.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46114.log.gz 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55158.log 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.80112.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78630.log.gz 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70736.log 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55158.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80112.log.gz 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73220.log 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55158.log.gz 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.70736.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.79200.log 2024-06-10T00:25:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55589.log 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70736.log.gz 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79200.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73220.log.gz 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59680.log 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79200.log.gz 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46900.log 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59680.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55589.log.gz 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48776.log 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59680.log.gz 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55326.log 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46900.log.gz 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68453.log 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48776.log.gz 2024-06-10T00:25:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77677.log 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55326.log.gz 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68453.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61317.log 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68453.log.gz 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52327.log 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.77677.log.gz 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46648.log 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61317.log.gz 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65021.log 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46648.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.72824.log -- replaced with /var/log/ceph/ceph-client.admin.52327.log.gz 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.588 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46648.log.gz 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79884.log 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78003.log 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65021.log.gz 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79884.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.72824.log.gz 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51829.log 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79884.log.gz 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.78003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57162.log 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52734.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51829.log.gz 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80070.log 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2024-06-10T00:25:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80030.log 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.80070.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57162.log.gz 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56122.log 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80070.log.gz 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70574.log 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.80030.log: /var/log/ceph/ceph-client.admin.56122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58975.log 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80030.log.gz 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49069.log 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56122.log.gz 2024-06-10T00:25:51.590 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70574.log.gz 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37884.log 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58975.log.gz 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60679.log 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49069.log.gz 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.78003.log.gz 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52284.log 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59247.log 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37884.log.gz 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52284.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60679.log.gz 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60725.log 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52284.log.gz 2024-06-10T00:25:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45556.log 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59247.log.gz 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61777.log 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45556.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60725.log.gz 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45556.log.gz 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68683.log 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61777.log.gz 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.68683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46100.log 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46112.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68683.log.gzgzip 2024-06-10T00:25:51.592 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58151.log 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66167.log 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58151.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46100.log.gz 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59057.log 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66167.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58151.log.gz 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51638.log 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66167.log.gz 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63017.log 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59057.log.gz/var/log/ceph/ceph-client.admin.51638.log: 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65450.log 2024-06-10T00:25:51.593 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51638.log.gz 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59298.log 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49027.log 89.0% 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63017.log.gz 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr: 89.7%/var/log/ceph/ceph-client.admin.59298.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48141.log 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59298.log.gz 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72950.log 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65450.log.gz 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48141.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49027.log.gz 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66101.log 2024-06-10T00:25:51.594 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48141.log.gz 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77743.log 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66101.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72950.log.gz 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44069.log 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50298.log 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66101.log.gz 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77743.log.gz 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69234.log 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose 88.7% -- /var/log/ceph/ceph-client.admin.53194.log -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50298.log: /var/log/ceph/ceph-client.admin.69234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52896.log 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50298.log.gz 2024-06-10T00:25:51.595 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69234.log.gz 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58548.log 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62975.log 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53194.log.gz 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58548.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52896.log.gz 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56206.log 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58548.log.gz 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56034.log 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56206.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62975.log.gz 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56206.log.gz 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68327.log 2024-06-10T00:25:51.596 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51062.log 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56034.log.gz 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68327.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79158.log 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.51062.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68327.log.gz 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49321.log 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49692.log 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49321.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79158.log.gz 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49321.log.gz 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74040.log 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49692.log: /var/log/ceph/ceph-client.admin.43835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67201.log 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49692.log.gz 2024-06-10T00:25:51.597 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76155.log 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75130.log 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67201.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74040.log.gz 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51792.log 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67201.log.gz 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68725.log 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75130.log: /var/log/ceph/ceph-client.admin.51792.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.76155.log.gz 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75130.log.gz 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51792.log.gz 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72573.log 2024-06-10T00:25:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68725.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78792.log 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68725.log.gz 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56584.log 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56248.log 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.72573.log.gz 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56584.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78792.log.gzgzip 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68369.log 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44195.log 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68369.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56248.log.gz 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56584.log.gz 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.78732.log 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.51062.log.gz 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68369.log.gz 2024-06-10T00:25:51.599 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79464.log 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44195.log.gz 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54384.log 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79464.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78732.log.gz 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73998.log 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79464.log.gz 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66657.log 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54384.log.gz 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72311.log 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73998.log.gz 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72484.log 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66657.log.gz 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62807.log 2024-06-10T00:25:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72311.log: /var/log/ceph/ceph-client.admin.72484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76927.log 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73645.log 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72311.log.gz 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.72484.log.gz 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62807.log.gz 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.76927.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.78462.log 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73645.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76927.log.gz 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52555.log 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73645.log.gz 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59596.log 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78462.log: /var/log/ceph/ceph-client.admin.52555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53698.log 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78462.log.gz 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52555.log.gz 2024-06-10T00:25:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69373.log 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53698.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59596.log.gz 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45777.log 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54233.log 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69373.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53698.log.gz 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66275.log 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69373.log.gz 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54233.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45777.log.gz 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59340.log 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54233.log.gz 2024-06-10T00:25:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.66275.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53110.log 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79116.log 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66275.log.gz 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59340.log.gz 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46113.log 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.53110.log.gz --verbose 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr: -- /var/log/ceph/ceph-client.admin.46109.log 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79116.log: /var/log/ceph/ceph-client.admin.46113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63402.log 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79116.log.gz 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46732.log 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46109.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46113.log.gz 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63402.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46109.log.gz 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69150.log 2024-06-10T00:25:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57961.log 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63402.log.gz 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46732.log: /var/log/ceph/ceph-client.admin.69150.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46732.log.gz 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72227.log 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69150.log.gz 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57961.log: /var/log/ceph/ceph-client.admin.72227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51441.log 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57961.log.gz 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63444.log 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50802.log 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.72227.log.gz 2024-06-10T00:25:51.604 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49195.log 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51441.log.gz 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59382.log 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63444.log.gz 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49195.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50802.log.gz 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58895.log 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49195.log.gz 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52471.log 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64043.log 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58895.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59382.log.gz 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45771.log 2024-06-10T00:25:51.605 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58895.log.gz 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52471.log.gz/var/log/ceph/ceph-client.admin.64043.log: 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45771.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64043.log.gzgzip 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66873.log 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45771.log.gz 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55242.log 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66873.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75708.log 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%/var/log/ceph/ceph-client.admin.55242.log: -- replaced with /var/log/ceph/ceph-client.admin.66873.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72550.log 2024-06-10T00:25:51.606 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75708.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55242.log.gz 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68988.log 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75708.log.gz 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66317.log 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73304.log 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72550.log.gz 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2%/var/log/ceph/ceph-client.admin.66317.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.68988.log.gz -5 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53152.log 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73304.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.73304.log.gz 2024-06-10T00:25:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53152.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66317.log.gz 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.60048.log 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53152.log.gz 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43669.log 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.60048.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.43669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48850.log 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43669.log.gz 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50168.log 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53278.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48850.log.gz 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52014.log 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53278.log: /var/log/ceph/ceph-client.admin.50168.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50168.log.gz 2024-06-10T00:25:51.608 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53278.log.gz 92.5% 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.0.60048.log.gz 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44111.log 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61093.log 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52014.log: gzip/var/log/ceph/ceph-client.admin.44111.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67792.log 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.61093.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44111.log.gz 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52014.log.gz 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50126.log 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46858.log 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50126.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.67792.log.gz 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.61093.log.gz 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50126.log.gz 2024-06-10T00:25:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76970.log 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47070.log 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1%/var/log/ceph/ceph-client.admin.76970.log: -- replaced with /var/log/ceph/ceph-client.admin.46858.log.gz 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57895.log 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76970.log.gz 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61452.log 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47583.log 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47070.log.gz 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57895.log: /var/log/ceph/ceph-client.admin.61452.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57895.log.gz 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.61452.log.gz 2024-06-10T00:25:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55116.log 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.47583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79800.log 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47583.log.gz 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56458.log 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55116.log.gz/var/log/ceph/ceph-client.admin.79800.log: 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43793.log 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79800.log.gz 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56458.log: /var/log/ceph/ceph-client.admin.43793.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56458.log.gz 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43793.log.gz 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69857.log 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72139.log 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.0.log: gzip/var/log/ceph/ceph-client.admin.69857.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63827.log 2024-06-10T00:25:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72139.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69857.log.gz 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72139.log.gz 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44279.log 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52938.log 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63827.log.gz 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44279.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44279.log.gz 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59554.log 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79674.log 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52938.log: /var/log/ceph/ceph-client.admin.59554.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52938.log.gz 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74124.log 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59554.log.gz 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79674.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79674.log.gz 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69278.log 2024-06-10T00:25:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79338.log 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74124.log: /var/log/ceph/ceph-client.admin.69278.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74124.log.gz 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69278.log.gzgzip 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64963.log 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79338.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79338.log.gz 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67726.log 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50610.log 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64963.log: /var/log/ceph/ceph-client.admin.67726.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64963.log.gz 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69503.log 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50610.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.67726.log.gz 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50610.log.gz 2024-06-10T00:25:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67243.log 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69503.log: /var/log/ceph/ceph-client.admin.46332.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69503.log.gz 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48377.log 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67243.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.67243.log.gz 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60486.log 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54948.log 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48377.log: /var/log/ceph/ceph-client.admin.60486.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48377.log.gz 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65516.log 2024-06-10T00:25:51.614 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60486.log.gz 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54948.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54948.log.gz 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67309.log 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45043.log 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65516.log: /var/log/ceph/ceph-client.admin.67309.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65516.log.gz 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55897.log 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67309.log.gz 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45043.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45043.log.gz 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56500.log 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57421.log 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55897.log: /var/log/ceph/ceph-client.admin.56500.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55897.log.gz 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56500.log.gz 2024-06-10T00:25:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76113.log 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57421.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.57421.log.gz 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59470.log 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61819.log 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76113.log: /var/log/ceph/ceph-client.admin.59470.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76113.log.gz 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69545.log 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59470.log.gz 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61819.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61819.log.gz 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74618.log 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71434.log 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69545.log: /var/log/ceph/ceph-client.0.74618.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69545.log.gz 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48293.log 2024-06-10T00:25:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71434.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71434.log.gz 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45430.log 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48293.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48293.log.gz 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51972.log 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45430.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45430.log.gz 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45779.log 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51972.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51972.log.gz 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64127.log 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45779.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45779.log.gz 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78877.log 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64127.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64127.log.gz 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.74618.log.gz 2024-06-10T00:25:51.617 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47461.log 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79243.log 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78877.log: /var/log/ceph/ceph-client.0.47461.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78877.log.gz 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68411.log 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79243.log: 88.9% -- replaced with /var/log/ceph/ceph-client.0.47461.log.gz 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.79243.log.gz 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52639.log 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58193.log 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68411.log: /var/log/ceph/ceph-client.admin.52639.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68411.log.gz 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52639.log.gz 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63957.log 2024-06-10T00:25:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58193.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58193.log.gz 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63581.log 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53236.log 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63957.log: /var/log/ceph/ceph-client.admin.63581.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63957.log.gz 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63581.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67155.log 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53236.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53236.log.gz 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45178.log 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51576.log 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67155.log: /var/log/ceph/ceph-client.admin.45178.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67155.log.gz 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45178.log.gz 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49111.log 2024-06-10T00:25:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45598.log 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51576.log: /var/log/ceph/ceph-client.admin.49111.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51576.log.gz 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51681.log 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49111.log.gz 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45598.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45598.log.gz 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74250.log 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63743.log 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51681.log: /var/log/ceph/ceph-client.admin.74250.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51681.log.gz 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74250.log.gz 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74987.log 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63743.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63743.log.gz 2024-06-10T00:25:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52224.log 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69713.log 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74987.log: /var/log/ceph/ceph-client.admin.52224.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74987.log.gz 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52224.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79758.log 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69713.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69713.log.gz 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73034.log 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65776.log 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79758.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73034.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79758.log.gz 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73034.log.gz 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73868.log 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.65776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55200.log 2024-06-10T00:25:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51718.log 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73868.log.gz 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48251.log 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51718.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55200.log.gz 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.65776.log.gz 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78504.log 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.51718.log.gz 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44363.log 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48251.log: /var/log/ceph/ceph-client.admin.78504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79842.log 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44363.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78504.log.gz 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48251.log.gz 2024-06-10T00:25:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1%/var/log/ceph/ceph-client.admin.79842.log: -- replaced with /var/log/ceph/ceph-client.admin.44363.log.gz 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59638.log 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79842.log.gz 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53320.log 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.59638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55032.log 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0%/var/log/ceph/ceph-client.admin.53320.log: -- replaced with /var/log/ceph/ceph-client.admin.59638.log.gz 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53320.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45780.log 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48461.log 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55032.log.gz 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77493.log 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45780.log.gz 2024-06-10T00:25:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63060.log 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77493.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48461.log.gz 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78546.log 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77493.log.gz 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46774.log 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63060.log: /var/log/ceph/ceph-client.admin.78546.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78546.log.gz 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63060.log.gz 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69899.log 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5/var/log/ceph/ceph-client.admin.46774.log: --verbose -- /var/log/ceph/ceph-client.admin.73262.log 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46774.log.gz 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52056.log 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73262.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69899.log.gz 2024-06-10T00:25:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68893.log 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73262.log.gz 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65140.log 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68893.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52056.log.gz 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68893.log.gz 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49777.log 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67945.log 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49777.log: /var/log/ceph/ceph-client.admin.65140.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65140.log.gz 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49777.log.gz 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64253.log 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59788.log 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67945.log: /var/log/ceph/ceph-client.admin.64253.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67945.log.gz 2024-06-10T00:25:51.625 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64253.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69322.log 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46449.log 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69322.log: /var/log/ceph/ceph-client.admin.59788.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59788.log.gz 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69322.log.gz 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72908.log 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.46449.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64085.log 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46449.log.gz 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43965.log 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72908.log.gz 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63661.log 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.43965.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64085.log.gz 2024-06-10T00:25:51.626 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75971.log 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43965.log.gz 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75408.log 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75971.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63661.log.gz 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75971.log.gz 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53404.log 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.0.75408.log: -5 --verbose -- /var/log/ceph/ceph-client.0.62448.log 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53404.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.62448.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.62448.log.gz 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67059.log 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46690.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2024-06-10T00:25:51.627 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43481.log 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.0.75408.log.gz 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45262.log 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.43481.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67059.log.gz 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43481.log.gz 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60347.log 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71624.log 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45262.log: /var/log/ceph/ceph-client.admin.60347.log: 88.8% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60347.log.gz 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45262.log.gz 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57271.log 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77137.log 2024-06-10T00:25:51.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57271.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71624.log.gz 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53572.log 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77137.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57271.log.gz 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- 91.2% /var/log/ceph/ceph-client.admin.71511.log 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77137.log.gz 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46111.log 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53572.log: /var/log/ceph/ceph-client.admin.71511.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71511.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53572.log.gz 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44858.log 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52369.log 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46111.log.gz 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.44858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45101.log 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52369.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52369.log.gz 2024-06-10T00:25:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56416.log 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45101.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.44858.log.gz 89.0% 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45101.log.gz 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46115.log 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76850.log 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56416.log: /var/log/ceph/ceph-client.admin.46115.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56416.log.gz 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46115.log.gz 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70792.log 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59722.log 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70792.log: /var/log/ceph/ceph-client.admin.76850.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76850.log.gz 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70792.log.gz 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59512.log 2024-06-10T00:25:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50508.log 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59722.log: /var/log/ceph/ceph-client.admin.59512.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59512.log.gz 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59722.log.gz 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68053.log 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67879.log 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50508.log: /var/log/ceph/ceph-client.admin.68053.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50508.log.gz 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68053.log.gz 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55074.log 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64211.log 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55074.log: /var/log/ceph/ceph-client.admin.67879.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55074.log.gz 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.67879.log.gz 2024-06-10T00:25:51.631 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53446.log 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74358.log 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64211.log.gz 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72739.log 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74358.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53446.log.gz 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74358.log.gz 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69941.log 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5/var/log/ceph/ceph-client.admin.72739.log: --verbose -- /var/log/ceph/ceph-client.admin.66533.log 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72739.log.gz 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57787.log 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69941.log.gz 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58403.log 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66533.log.gz 2024-06-10T00:25:51.632 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58403.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57787.log.gz 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58403.log.gz 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69983.log 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63192.log 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48908.log: /var/log/ceph/ceph-client.admin.69983.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65163.log 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2%/var/log/ceph/ceph-client.admin.63192.log: -- replaced with /var/log/ceph/ceph-client.admin.69983.log.gz 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63192.log.gz 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73388.log 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69815.log 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73388.log: /var/log/ceph/ceph-client.admin.65163.log: 88.9% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65163.log.gz 2024-06-10T00:25:51.633 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73388.log.gz 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54906.log 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79632.log 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69815.log: /var/log/ceph/ceph-client.admin.54906.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69815.log.gz 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54906.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61375.log 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.79632.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57487.log 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79632.log.gz 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47977.log 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57487.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61375.log.gz 2024-06-10T00:25:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71625.log 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57487.log.gz 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.2.47977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52429.log 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.2.47977.log.gz 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.71625.log.gz 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52182.log 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64705.log 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52429.log.gz 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.64705.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52182.log.gz 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45774.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2024-06-10T00:25:51.635 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65951.log 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48503.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50214.log 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65951.log: 92.3% -- replaced with /var/log/ceph/ceph-client.0.64705.log.gz 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.65951.log.gz 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64337.log 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50214.log: /var/log/ceph/ceph-client.admin.44429.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50214.log.gz 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56290.log 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64337.log: /var/log/ceph/ceph-client.admin.56290.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64337.log.gz 2024-06-10T00:25:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54024.log 2024-06-10T00:25:51.637 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56290.log.gz 2024-06-10T00:25:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50466.log 2024-06-10T00:25:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.54024.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2024-06-10T00:25:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77226.log 2024-06-10T00:25:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50466.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50466.log.gz 2024-06-10T00:25:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64379.log 2024-06-10T00:25:51.707 INFO:teuthology.orchestra.run.smithi117.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-06-10T00:25:51.751 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77226.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.77226.log.gz 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.54024.log.gz 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79506.log 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72992.log 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64379.log: /var/log/ceph/ceph-client.admin.79506.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79506.log.gz 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64379.log.gz 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73136.log 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49489.log 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72992.log: /var/log/ceph/ceph-client.admin.73136.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72992.log.gz 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73136.log.gzgzip 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46116.log 2024-06-10T00:25:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65408.log 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46116.log: /var/log/ceph/ceph-client.admin.49489.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49489.log.gz 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46116.log.gz 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72097.log 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50256.log 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65408.log: /var/log/ceph/ceph-client.admin.72097.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65408.log.gz 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72097.log.gz 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62604.log 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66896.log 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50256.log: /var/log/ceph/ceph-client.admin.62604.log: 89.7% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50256.log.gz 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62604.log.gz 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71376.log 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58040.log 2024-06-10T00:25:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66896.log: /var/log/ceph/ceph-client.admin.71376.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71376.log.gz 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66715.log 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58040.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.66896.log.gz 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58040.log.gz 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71945.log 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58506.log 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66715.log: /var/log/ceph/ceph-client.admin.71945.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66715.log.gz 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62933.log 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.71945.log.gz 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54471.log 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62933.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58506.log.gz 2024-06-10T00:25:51.754 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62933.log.gz 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67987.log 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72781.log 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54471.log: /var/log/ceph/ceph-client.admin.67987.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54471.log.gz 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.67987.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53764.log 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64000.log 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72781.log: /var/log/ceph/ceph-client.admin.53764.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72781.log.gz 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53764.log.gz 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66575.log 2024-06-10T00:25:51.755 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61669.log/var/log/ceph/ceph-client.admin.64000.log: 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64000.log.gz 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57595.log 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61669.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.66575.log.gz 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61669.log.gz 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59185.log 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49447.log 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57595.log: /var/log/ceph/ceph-client.admin.59185.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57595.log.gz 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54644.log 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3%/var/log/ceph/ceph-client.admin.49447.log: -- replaced with /var/log/ceph/ceph-client.admin.59185.log.gz 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52513.log 2024-06-10T00:25:51.756 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49447.log.gz 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76792.log 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54644.log: /var/log/ceph/ceph-client.admin.52513.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54644.log.gz 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52513.log.gz 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48734.log 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59141.log 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76792.log: /var/log/ceph/ceph-client.admin.48734.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76792.log.gz 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48734.log.gz 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58590.log 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45388.log 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58590.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59141.log.gz 2024-06-10T00:25:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72399.log 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58590.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78919.log 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45388.log: /var/log/ceph/ceph-client.admin.72399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74292.log 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78919.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45388.log.gz 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78919.log.gz 91.2% 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72399.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79716.log 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45776.log 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61885.log 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79716.log: /var/log/ceph/ceph-client.admin.45776.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74292.log.gz 2024-06-10T00:25:51.758 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79716.log.gz 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45776.log.gz 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56374.log 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49650.log 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56374.log.gz 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61885.log.gz 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55853.log 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6%/var/log/ceph/ceph-client.admin.45304.log: -- replaced with /var/log/ceph/ceph-client.admin.49650.log.gz 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48656.log 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55853.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75650.log 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76067.log 2024-06-10T00:25:51.759 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55853.log.gz 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54309.log 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75650.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48656.log.gz 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72312.log 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75650.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76067.log.gz 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66956.log 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.54309.log.gz 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79548.log 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.72312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53068.log 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.72312.log.gz 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66956.log: /var/log/ceph/ceph-client.admin.79548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58461.log 2024-06-10T00:25:51.760 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79548.log.gz 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53068.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53068.log.gz 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51755.log 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.66956.log.gz/var/log/ceph/ceph-client.admin.58461.log: 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55284.log 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58461.log.gz 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56332.log 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.51755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68809.log 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55284.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.51755.log.gz 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58758.log 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55284.log.gz 88.1% 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56332.log.gz 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54864.log 2024-06-10T00:25:51.761 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68809.log.gz 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48985.log 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58758.log.gz 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59099.log 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54864.log: /var/log/ceph/ceph-client.admin.48985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58235.log 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.59099.log: 87.9% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54864.log.gz 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48985.log.gz 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59099.log.gz 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62038.log 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.58235.log: /var/log/ceph/ceph-client.admin.43573.log 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.62038.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58235.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61711.log 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.762 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62038.log.gz 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66811.log 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.43573.log: /var/log/ceph/ceph-client.admin.61711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50652.log 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66811.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43573.log.gz 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.61711.log.gz 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75915.log 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66811.log.gz 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50382.log 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68132.log 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50652.log.gz 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75915.log: /var/log/ceph/ceph-client.admin.50382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46450.log 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.75915.log.gz 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5%/var/log/ceph/ceph-client.admin.68132.log: -- replaced with /var/log/ceph/ceph-client.admin.50382.log.gz 2024-06-10T00:25:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76025.log 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.68132.log.gz 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.46450.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.73483.log 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76025.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46450.log.gz 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74208.log 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76025.log.gz 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58716.log 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73483.log: /var/log/ceph/ceph-client.admin.74208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52814.log 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58716.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74208.log.gz 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73483.log.gz 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58716.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49279.log 2024-06-10T00:25:51.764 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71052.log 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.52814.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.55368.log 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49279.log: /var/log/ceph/ceph-client.0.71052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45778.log 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49279.log.gz 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77044.log 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45778.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55368.log.gz 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45778.log.gz 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46451.log 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63276.log 2024-06-10T00:25:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.46451.log: /var/log/ceph/ceph-client.admin.77044.log: 87.7% 89.6% -- replaced with /var/log/ceph/ceph-client.admin.77044.log.gz 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46451.log.gz 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61518.log 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.63276.log: -- /var/log/ceph/ceph-client.admin.46816.log 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63276.log.gz 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68495.log 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0%/var/log/ceph/ceph-client.admin.46816.log: -- replaced with /var/log/ceph/ceph-client.admin.61518.log.gz 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64169.log 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57703.log 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68495.log: /var/log/ceph/ceph-client.admin.64169.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64169.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68495.log.gz 2024-06-10T00:25:51.766 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51499.log 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77081.log 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57703.log: /var/log/ceph/ceph-client.admin.51499.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51499.log.gz 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57703.log.gz 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.0.71052.log.gz 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70049.log 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73603.log 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77081.log.gz/var/log/ceph/ceph-client.admin.70049.log: 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74929.log 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70049.log.gz 2024-06-10T00:25:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65098.log 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73603.log: /var/log/ceph/ceph-client.admin.74929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60767.log 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65098.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73603.log.gz 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74929.log.gz 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62146.log 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65098.log.gz 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54621.log 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60767.log: /var/log/ceph/ceph-client.admin.62146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68641.log 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62146.log.gz/var/log/ceph/ceph-client.admin.54621.log: 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60767.log.gz 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54621.log.gz 2024-06-10T00:25:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59428.log 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50340.log 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68641.log.gz/var/log/ceph/ceph-client.admin.59428.log: 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54990.log 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59428.log.gz 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66209.log 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50340.log: gzip/var/log/ceph/ceph-client.admin.54990.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50424.log 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66209.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54990.log.gz 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50340.log.gz 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53656.log 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63871.log 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.66209.log.gz 2024-06-10T00:25:51.769 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57637.log 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50424.log.gz 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53656.log: /var/log/ceph/ceph-client.admin.63871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74166.log 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.57637.log: 89.3% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53656.log.gz 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63871.log.gz 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49861.log 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50694.log 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57637.log.gz 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.74166.log: /var/log/ceph/ceph-client.admin.49861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52140.log 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.50694.log: 89.3% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74166.log.gz 2024-06-10T00:25:51.770 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50694.log.gz 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61970.log 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65362.log 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77007.log 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.61970.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52140.log.gz 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60289.log 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65362.log.gz 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77007.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61970.log.gz 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65267.log 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77007.log.gz 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70516.log 2024-06-10T00:25:51.771 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60289.log.gz 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65267.log.gz 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49237.log 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70516.log: /var/log/ceph/ceph-client.admin.44237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52980.log 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70516.log.gz 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57529.log 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49237.log.gz 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53024.log 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52980.log: /var/log/ceph/ceph-client.admin.57529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69587.log 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53024.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52980.log.gz 2024-06-10T00:25:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63785.log 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57529.log.gz 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53024.log.gz 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55410.log 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69587.log: /var/log/ceph/ceph-client.admin.63785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57215.log 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69587.log.gz 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63785.log.gz 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67569.log 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4%/var/log/ceph/ceph-client.admin.57215.log: -- replaced with /var/log/ceph/ceph-client.admin.55410.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.67569.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.57215.log.gz 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66467.log 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77292.log 2024-06-10T00:25:51.773 INFO:teuthology.orchestra.run.smithi079.stderr: 92.1%/var/log/ceph/ceph-client.admin.66467.log: -- replaced with /var/log/ceph/ceph-client.0.67569.log.gz 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75818.log 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77292.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66467.log.gz 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55494.log 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75818.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.77292.log.gz 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75818.log.gz 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70713.log 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65200.log 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55494.log: /var/log/ceph/ceph-client.admin.70713.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55494.log.gz 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60424.log 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70713.log.gz 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48419.log 2024-06-10T00:25:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.65200.log: /var/log/ceph/ceph-client.admin.60424.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60424.log.gz 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48335.log 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65200.log.gz 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48419.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68598.log 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48419.log.gz 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68767.log 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68598.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48335.log.gz 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68598.log.gz 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49153.log 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.68767.log: -- /var/log/ceph/ceph-client.admin.73817.log 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68767.log.gz 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56650.log 2024-06-10T00:25:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73817.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49153.log.gz 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73817.log.gz 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37805.log 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52098.log 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.56650.log: /var/log/ceph/ceph-client.admin.37805.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56650.log.gz 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37805.log.gz 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62080.log 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58800.log 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.52098.log: /var/log/ceph/ceph-client.admin.62080.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52098.log.gz 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77589.log 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58800.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62080.log.gz 2024-06-10T00:25:51.776 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58800.log.gz 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78835.log 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.77589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66017.log 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77589.log.gz 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49405.log 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66017.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78835.log.gz 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50031.log 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66017.log.gz/var/log/ceph/ceph-client.admin.49405.log: 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72185.log 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49405.log.gz/var/log/ceph/ceph-client.admin.50031.log: 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50031.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64295.log 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53488.log 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.64295.log: /var/log/ceph/ceph-client.admin.72185.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72185.log.gz 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64295.log.gz 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55769.log 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60509.log 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.53488.log: /var/log/ceph/ceph-client.admin.55769.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53488.log.gz 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55769.log.gz 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63360.log 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5/var/log/ceph/ceph-client.admin.60509.log: --verbose -- /var/log/ceph/ceph-client.admin.73952.log 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60509.log.gz 2024-06-10T00:25:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.63360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79968.log 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63360.log.gz 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.73952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49903.log 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73952.log.gz/var/log/ceph/ceph-client.admin.79968.log: 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43923.log 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9%/var/log/ceph/ceph-client.admin.49903.log: -- replaced with /var/log/ceph/ceph-client.admin.79968.log.gz 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49903.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57119.log 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56910.log 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.43923.log: /var/log/ceph/ceph-client.admin.57119.log: 87.7% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57119.log.gz 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43923.log.gz 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54555.log 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.56910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58632.log 2024-06-10T00:25:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54555.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54555.log.gz 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58632.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58632.log.gz 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54256.log 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.56910.log.gz 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56076.log 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54256.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54256.log.gz 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60637.log 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.56076.log: -- /var/log/ceph/ceph-client.admin.78690.log 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56076.log.gz 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.60637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79380.log 2024-06-10T00:25:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78690.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60637.log.gz 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78690.log.gz 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58319.log 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54383.log 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.79380.log: /var/log/ceph/ceph-client.admin.58319.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79380.log.gz 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58319.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58674.log 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71987.log 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54383.log.gz 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71885.log 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71987.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58674.log.gz 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.71987.log.gz 2024-06-10T00:25:51.781 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45220.log 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55992.log 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.71885.log: /var/log/ceph/ceph-client.admin.45220.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45220.log.gz 90.6% -- replaced with /var/log/ceph/ceph-client.admin.71885.log.gz 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69629.log 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68285.log 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55992.log: /var/log/ceph/ceph-client.admin.69629.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55992.log.gz 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69629.log.gz 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63318.log 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69773.log 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.68285.log: /var/log/ceph/ceph-client.admin.63318.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68285.log.gz 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53362.log 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63318.log.gz 2024-06-10T00:25:51.782 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37520.log 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69773.log: /var/log/ceph/ceph-client.admin.53362.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69773.log.gz 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53362.log.gz 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53530.log 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37520.log: /var/log/ceph/ceph-client.admin.44025.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37520.log.gz 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75064.log 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45514.log 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.75064.log: /var/log/ceph/ceph-client.admin.53530.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53530.log.gz 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69457.log 2024-06-10T00:25:51.783 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.75064.log.gz 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71796.log 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69457.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45514.log.gz 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69457.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55811.log 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.55811.log: /var/log/ceph/ceph-client.admin.71796.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78352.log 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71796.log.gz 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.45472.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69068.log 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.78352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63486.log 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.69068.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78352.log.gz 2024-06-10T00:25:51.784 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69068.log.gz 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66383.log 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.63486.log: -- /var/log/ceph/ceph-client.admin.67113.log 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63486.log.gz 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.66383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49734.log 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.67113.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67113.log.gz 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58361.log 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66383.log.gz 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.49734.log: gzip 89.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.45767.log 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49734.log.gz 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76221.log 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.58361.log: /var/log/ceph/ceph-client.admin.45767.log: 88.7% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45767.log.gz 2024-06-10T00:25:51.785 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58361.log.gz 2024-06-10T00:25:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54753.log 2024-06-10T00:25:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.76221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48598.log 2024-06-10T00:25:51.786 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76221.log.gz 2024-06-10T00:25:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.54753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70651.log 2024-06-10T00:25:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.48598.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54753.log.gz 2024-06-10T00:25:51.786 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48598.log.gz 2024-06-10T00:25:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.70651.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70651.log.gz 2024-06-10T00:25:51.787 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-06-10T00:25:51.948 INFO:teuthology.orchestra.run.smithi079.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-06-10T00:25:52.396 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-06-10T00:25:52.615 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-06-10T00:25:52.679 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-06-10T00:25:52.695 INFO:teuthology.orchestra.run.smithi079.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-06-10T00:25:52.717 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-06-10T00:25:52.740 INFO:teuthology.orchestra.run.smithi079.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-06-10T00:25:52.779 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-06-10T00:25:52.781 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-06-10T00:25:52.781 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m1.376s 2024-06-10T00:25:52.781 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m5.644s 2024-06-10T00:25:52.781 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.192s 2024-06-10T00:25:52.819 INFO:teuthology.orchestra.run.smithi079.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-06-10T00:25:52.997 INFO:teuthology.orchestra.run.smithi079.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-06-10T00:25:52.999 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-10T00:25:52.999 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m1.617s 2024-06-10T00:25:52.999 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m6.979s 2024-06-10T00:25:52.999 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.585s 2024-06-10T00:25:52.999 INFO:tasks.ceph:Archiving logs... 2024-06-10T00:25:53.000 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/remote/smithi079/log 2024-06-10T00:25:53.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-10T00:25:54.426 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/remote/smithi117/log 2024-06-10T00:25:54.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-10T00:25:55.225 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-10T00:25:55.235 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-10T00:25:55.235 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-10T00:25:55.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-10T00:25:55.320 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-10T00:25:55.329 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-10T00:25:55.329 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-10T00:25:55.332 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-10T00:25:55.347 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-06-10T00:25:55.347 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-06-10T00:25:55.352 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 -120us[ -105us] +/- 56ms 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -935us[ -935us] +/- 52ms 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +1536us[+1536us] +/- 79ms 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 -106us[ -102us] +/- 56ms 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -928us[ -923us] +/- 52ms 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +1545us[+1545us] +/- 79ms 2024-06-10T00:25:55.353 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-10T00:25:55.354 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-10T00:25:55.362 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-10T00:25:55.363 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-10T00:25:55.380 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-10T00:25:55.480 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-10T00:25:55.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-10T00:25:55.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:25:55.578 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-10T00:25:55.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:25:55.606 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-10T00:25:55.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-10T00:25:55.663 INFO:teuthology.task.internal:Duration was 1101.319674 seconds 2024-06-10T00:25:55.663 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-10T00:25:55.677 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-10T00:25:55.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-10T00:25:55.680 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-10T00:25:55.717 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-10T00:25:55.719 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-10T00:25:55.977 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-10T00:25:55.978 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-06-10T00:25:55.978 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-10T00:25:56.038 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-06-10T00:25:56.039 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-10T00:25:56.071 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-10T00:25:56.071 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-10T00:25:56.081 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-10T00:25:56.137 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-10T00:25:56.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-10T00:25:56.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-10T00:25:56.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-10T00:25:56.292 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-10T00:25:56.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-10T00:25:56.316 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-10T00:25:56.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-10T00:25:56.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-10T00:25:56.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-10T00:25:56.379 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-06-10T00:25:56.404 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-06-10T00:25:56.434 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-10T00:25:56.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:25:56.449 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-10T00:25:56.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-10T00:25:56.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-10T00:25:56.499 INFO:teuthology.task.internal:Transferring archived files... 2024-06-10T00:25:56.500 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/remote/smithi079 2024-06-10T00:25:56.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-10T00:25:56.537 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-09_21:24:02-fs-squid-distro-default-smithi/7747319/remote/smithi117 2024-06-10T00:25:56.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-10T00:25:56.571 INFO:teuthology.task.internal:Removing archive directory... 2024-06-10T00:25:56.571 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-10T00:25:56.574 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-10T00:25:56.621 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-10T00:25:56.632 INFO:teuthology.task.internal:Not uploading archives. 2024-06-10T00:25:56.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-10T00:25:56.652 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-10T00:25:56.653 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-10T00:25:56.655 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-10T00:25:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 10 00:25 /home/ubuntu/cephtest 2024-06-10T00:25:56.675 INFO:teuthology.orchestra.run.smithi117.stdout: 265921 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 10 00:25 /home/ubuntu/cephtest 2024-06-10T00:25:56.676 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-10T00:25:56.691 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-10T00:25:56.726 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} duration: 1101.3196737766266 failure_reason: '"2024-06-10T00:20:39.747503+0000 mds.a (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir)" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-06-10T00:25:56.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-10T00:25:56.812 INFO:teuthology.run:FAIL